Jul 03 09:34:09.450786 np0000004400 systemd[1]: Started devstack@c-bak.service - Devstack devstack@c-bak.service. Jul 03 09:34:09.583188 np0000004400 cinder-backup[101319]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning: Jul 03 09:34:09.583188 np0000004400 cinder-backup[101319]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Jul 03 09:34:09.583188 np0000004400 cinder-backup[101319]: we strongly recommend against using it for new projects. Jul 03 09:34:09.583188 np0000004400 cinder-backup[101319]: If you are already using Eventlet, we recommend migrating to a different Jul 03 09:34:09.583188 np0000004400 cinder-backup[101319]: framework. For more detail see Jul 03 09:34:09.583188 np0000004400 cinder-backup[101319]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Jul 03 09:34:09.583188 np0000004400 cinder-backup[101319]: import eventlet # noqa Jul 03 09:34:10.607261 np0000004400 cinder-backup[101319]: INFO cinder.cmd.backup [-] Backup running in single process mode. Jul 03 09:34:10.714078 np0000004400 cinder-backup[101319]: INFO dbcounter [None req-5f770af2-e09b-483c-8da6-1399998bb49b None None] Registered counter for database cinder Jul 03 09:34:10.751958 np0000004400 cinder-backup[101319]: DEBUG oslo_db.sqlalchemy.engines [None req-5f770af2-e09b-483c-8da6-1399998bb49b None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=101319) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 03 09:34:10.844083 np0000004400 cinder-backup[101319]: DEBUG dbcounter [-] [101319] Writer thread running {{(pid=101319) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Jul 03 09:34:10.846056 np0000004400 cinder-backup[101319]: INFO cinder.rpc [None req-5f770af2-e09b-483c-8da6-1399998bb49b None None] Automatically selected cinder-backup objects version 1.39 as minimum service version. Jul 03 09:34:10.847943 np0000004400 cinder-backup[101319]: INFO cinder.rpc [None req-5f770af2-e09b-483c-8da6-1399998bb49b None None] Automatically selected cinder-backup RPC version 2.4 as minimum service version. Jul 03 09:34:10.849703 np0000004400 cinder-backup[101319]: INFO cinder.rpc [None req-5f770af2-e09b-483c-8da6-1399998bb49b None None] Automatically selected cinder-volume objects version 1.39 as minimum service version. Jul 03 09:34:10.851328 np0000004400 cinder-backup[101319]: INFO cinder.rpc [None req-5f770af2-e09b-483c-8da6-1399998bb49b None None] Automatically selected cinder-volume RPC version 3.20 as minimum service version. Jul 03 09:34:10.853422 np0000004400 cinder-backup[101319]: INFO cinder.rpc [None req-5f770af2-e09b-483c-8da6-1399998bb49b None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Jul 03 09:34:10.855258 np0000004400 cinder-backup[101319]: INFO cinder.rpc [None req-5f770af2-e09b-483c-8da6-1399998bb49b None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Jul 03 09:34:10.903940 np0000004400 cinder-backup[101319]: DEBUG oslo_db.sqlalchemy.engines [None req-5f770af2-e09b-483c-8da6-1399998bb49b None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=101319) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 03 09:34:10.916884 np0000004400 cinder-backup[101319]: DEBUG oslo_concurrency.lockutils [None req-5f770af2-e09b-483c-8da6-1399998bb49b None None] Acquiring lock "singleton_lock" {{(pid=101319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jul 03 09:34:10.917029 np0000004400 cinder-backup[101319]: DEBUG oslo_concurrency.lockutils [None req-5f770af2-e09b-483c-8da6-1399998bb49b None None] Acquired lock "singleton_lock" {{(pid=101319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jul 03 09:34:10.917247 np0000004400 cinder-backup[101319]: DEBUG oslo_concurrency.lockutils [None req-5f770af2-e09b-483c-8da6-1399998bb49b None None] Releasing lock "singleton_lock" {{(pid=101319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jul 03 09:34:10.917437 np0000004400 cinder-backup[101319]: DEBUG cinder.service [None req-5f770af2-e09b-483c-8da6-1399998bb49b None None] ******************************************************************************** {{(pid=101319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3226}} Jul 03 09:34:10.917535 np0000004400 cinder-backup[101319]: DEBUG cinder.service [None req-5f770af2-e09b-483c-8da6-1399998bb49b None None] Configuration options gathered from: {{(pid=101319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3227}} Jul 03 09:34:10.917622 np0000004400 cinder-backup[101319]: DEBUG cinder.service [None req-5f770af2-e09b-483c-8da6-1399998bb49b None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=101319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3228}} Jul 03 09:34:10.917773 np0000004400 cinder-backup[101319]: DEBUG cinder.service [None req-5f770af2-e09b-483c-8da6-1399998bb49b None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=101319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3229}} Jul 03 09:34:10.917861 np0000004400 cinder-backup[101319]: DEBUG cinder.service [None req-5f770af2-e09b-483c-8da6-1399998bb49b None None] ================================================================================ {{(pid=101319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3234}} Jul 03 09:34:10.918032 np0000004400 cinder-backup[101319]: DEBUG cinder.service [None req-5f770af2-e09b-483c-8da6-1399998bb49b None None] allow_availability_zone_fallback = False {{(pid=101319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 09:34:10.918146 np0000004400 cinder-backup[101319]: DEBUG cinder.service [None req-5f770af2-e09b-483c-8da6-1399998bb49b None None] allow_compression_on_image_upload = False {{(pid=101319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 09:34:10.918259 np0000004400 cinder-backup[101319]: DEBUG cinder.service [None req-5f770af2-e09b-483c-8da6-1399998bb49b None None] allowed_direct_url_schemes = [] {{(pid=101319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 09:34:10.918364 np0000004400 cinder-backup[101319]: DEBUG cinder.service [None req-5f770af2-e09b-483c-8da6-1399998bb49b None None] api_rate_limit = True {{(pid=101319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 09:34:10.918494 np0000004400 cinder-backup[101319]: DEBUG cinder.service [None req-5f770af2-e09b-483c-8da6-1399998bb49b None None] auth_strategy = keystone {{(pid=101319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 09:34:10.918578 np0000004400 cinder-backup[101319]: DEBUG cinder.service [None req-5f770af2-e09b-483c-8da6-1399998bb49b None None] backdoor_port = None {{(pid=101319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 09:34:10.918660 np0000004400 cinder-backup[101319]: DEBUG cinder.service [None req-5f770af2-e09b-483c-8da6-1399998bb49b None None] backdoor_socket = None {{(pid=101319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 09:34:10.918780 np0000004400 cinder-backup[101319]: DEBUG cinder.service [None req-5f770af2-e09b-483c-8da6-1399998bb49b None None] backend_availability_zone = None {{(pid=101319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 09:34:10.918897 np0000004400 cinder-backup[101319]: DEBUG cinder.service [None req-5f770af2-e09b-483c-8da6-1399998bb49b None None] backup_api_class = cinder.backup.api.API {{(pid=101319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 09:34:10.919026 np0000004400 cinder-backup[101319]: DEBUG cinder.service [None req-5f770af2-e09b-483c-8da6-1399998bb49b None None] backup_compression_algorithm = zlib {{(pid=101319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 09:34:10.919120 np0000004400 cinder-backup[101319]: DEBUG cinder.service [None req-5f770af2-e09b-483c-8da6-1399998bb49b None None] backup_create_containers = True {{(pid=101319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 09:34:10.919233 np0000004400 cinder-backup[101319]: DEBUG cinder.service [None req-5f770af2-e09b-483c-8da6-1399998bb49b None None] backup_driver = cinder.backup.drivers.swift.SwiftBackupDriver {{(pid=101319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 09:34:10.919334 np0000004400 cinder-backup[101319]: DEBUG cinder.service [None req-5f770af2-e09b-483c-8da6-1399998bb49b None None] backup_driver_init_check_interval = 60 {{(pid=101319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 09:34:10.919455 np0000004400 cinder-backup[101319]: DEBUG cinder.service [None req-5f770af2-e09b-483c-8da6-1399998bb49b None None] backup_driver_stats_polling_interval = 60 {{(pid=101319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 09:34:10.919562 np0000004400 cinder-backup[101319]: DEBUG cinder.service [None req-5f770af2-e09b-483c-8da6-1399998bb49b None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=101319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 09:34:10.919661 np0000004400 cinder-backup[101319]: DEBUG cinder.service [None req-5f770af2-e09b-483c-8da6-1399998bb49b None None] backup_max_operations = 15 {{(pid=101319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 09:34:10.919778 np0000004400 cinder-backup[101319]: DEBUG cinder.service [None req-5f770af2-e09b-483c-8da6-1399998bb49b None None] backup_metadata_version = 2 {{(pid=101319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 09:34:10.919905 np0000004400 cinder-backup[101319]: DEBUG cinder.service [None req-5f770af2-e09b-483c-8da6-1399998bb49b None None] backup_name_template = backup-%s {{(pid=101319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 09:34:10.920026 np0000004400 cinder-backup[101319]: DEBUG cinder.service [None req-5f770af2-e09b-483c-8da6-1399998bb49b None None] backup_native_threads_pool_size = 60 {{(pid=101319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 09:34:10.920138 np0000004400 cinder-backup[101319]: DEBUG cinder.service [None req-5f770af2-e09b-483c-8da6-1399998bb49b None None] backup_object_number_per_notification = 10 {{(pid=101319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 09:34:10.920238 np0000004400 cinder-backup[101319]: DEBUG cinder.service [None req-5f770af2-e09b-483c-8da6-1399998bb49b None None] backup_service_inithost_offload = True {{(pid=101319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 09:34:10.920341 np0000004400 cinder-backup[101319]: DEBUG cinder.service [None req-5f770af2-e09b-483c-8da6-1399998bb49b None None] backup_swift_auth = per_user {{(pid=101319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 09:34:10.920463 np0000004400 cinder-backup[101319]: DEBUG cinder.service [None req-5f770af2-e09b-483c-8da6-1399998bb49b None None] backup_swift_auth_insecure = False {{(pid=101319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 09:34:10.920563 np0000004400 cinder-backup[101319]: DEBUG cinder.service [None req-5f770af2-e09b-483c-8da6-1399998bb49b None None] backup_swift_auth_url = None {{(pid=101319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 09:34:10.920670 np0000004400 cinder-backup[101319]: DEBUG cinder.service [None req-5f770af2-e09b-483c-8da6-1399998bb49b None None] backup_swift_auth_version = 1 {{(pid=101319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 09:34:10.920784 np0000004400 cinder-backup[101319]: DEBUG cinder.service [None req-5f770af2-e09b-483c-8da6-1399998bb49b None None] backup_swift_block_size = 32768 {{(pid=101319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 09:34:10.920896 np0000004400 cinder-backup[101319]: DEBUG cinder.service [None req-5f770af2-e09b-483c-8da6-1399998bb49b None None] backup_swift_ca_cert_file = /opt/stack/data/ca-bundle.pem {{(pid=101319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 09:34:10.920998 np0000004400 cinder-backup[101319]: DEBUG cinder.service [None req-5f770af2-e09b-483c-8da6-1399998bb49b None None] backup_swift_container = volumebackups {{(pid=101319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 09:34:10.921111 np0000004400 cinder-backup[101319]: DEBUG cinder.service [None req-5f770af2-e09b-483c-8da6-1399998bb49b None None] backup_swift_create_storage_policy = None {{(pid=101319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 09:34:10.921211 np0000004400 cinder-backup[101319]: DEBUG cinder.service [None req-5f770af2-e09b-483c-8da6-1399998bb49b None None] backup_swift_enable_progress_timer = True {{(pid=101319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 09:34:10.921314 np0000004400 cinder-backup[101319]: DEBUG cinder.service [None req-5f770af2-e09b-483c-8da6-1399998bb49b None None] backup_swift_key = **** {{(pid=101319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 09:34:10.921427 np0000004400 cinder-backup[101319]: DEBUG cinder.service [None req-5f770af2-e09b-483c-8da6-1399998bb49b None None] backup_swift_object_size = 52428800 {{(pid=101319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 09:34:10.921533 np0000004400 cinder-backup[101319]: DEBUG cinder.service [None req-5f770af2-e09b-483c-8da6-1399998bb49b None None] backup_swift_project = None {{(pid=101319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 09:34:10.921626 np0000004400 cinder-backup[101319]: DEBUG cinder.service [None req-5f770af2-e09b-483c-8da6-1399998bb49b None None] backup_swift_project_domain = None {{(pid=101319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 09:34:10.921731 np0000004400 cinder-backup[101319]: DEBUG cinder.service [None req-5f770af2-e09b-483c-8da6-1399998bb49b None None] backup_swift_region_name = None {{(pid=101319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 09:34:10.921845 np0000004400 cinder-backup[101319]: DEBUG cinder.service [None req-5f770af2-e09b-483c-8da6-1399998bb49b None None] backup_swift_retry_attempts = 3 {{(pid=101319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 09:34:10.921945 np0000004400 cinder-backup[101319]: DEBUG cinder.service [None req-5f770af2-e09b-483c-8da6-1399998bb49b None None] backup_swift_retry_backoff = 2 {{(pid=101319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 09:34:10.922056 np0000004400 cinder-backup[101319]: DEBUG cinder.service [None req-5f770af2-e09b-483c-8da6-1399998bb49b None None] backup_swift_service_auth = False {{(pid=101319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 09:34:10.922159 np0000004400 cinder-backup[101319]: DEBUG cinder.service [None req-5f770af2-e09b-483c-8da6-1399998bb49b None None] backup_swift_tenant = None {{(pid=101319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 09:34:10.922379 np0000004400 cinder-backup[101319]: DEBUG cinder.service [None req-5f770af2-e09b-483c-8da6-1399998bb49b None None] backup_swift_url = https://10.4.3.95:8080/v1/AUTH_ {{(pid=101319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 09:34:10.922497 np0000004400 cinder-backup[101319]: DEBUG cinder.service [None req-5f770af2-e09b-483c-8da6-1399998bb49b None None] backup_swift_user = None {{(pid=101319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 09:34:10.922599 np0000004400 cinder-backup[101319]: DEBUG cinder.service [None req-5f770af2-e09b-483c-8da6-1399998bb49b None None] backup_swift_user_domain = None {{(pid=101319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 09:34:10.922700 np0000004400 cinder-backup[101319]: DEBUG cinder.service [None req-5f770af2-e09b-483c-8da6-1399998bb49b None None] backup_timer_interval = 120 {{(pid=101319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 09:34:10.922816 np0000004400 cinder-backup[101319]: DEBUG cinder.service [None req-5f770af2-e09b-483c-8da6-1399998bb49b None None] backup_use_same_host = False {{(pid=101319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 09:34:10.922918 np0000004400 cinder-backup[101319]: DEBUG cinder.service [None req-5f770af2-e09b-483c-8da6-1399998bb49b None None] backup_use_temp_snapshot = False {{(pid=101319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 09:34:10.923027 np0000004400 cinder-backup[101319]: DEBUG cinder.service [None req-5f770af2-e09b-483c-8da6-1399998bb49b None None] backup_workers = 1 {{(pid=101319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 09:34:10.923133 np0000004400 cinder-backup[101319]: DEBUG cinder.service [None req-5f770af2-e09b-483c-8da6-1399998bb49b None None] chap_password = **** {{(pid=101319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 09:34:10.923234 np0000004400 cinder-backup[101319]: DEBUG cinder.service [None req-5f770af2-e09b-483c-8da6-1399998bb49b None None] chap_username = {{(pid=101319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 09:34:10.923337 np0000004400 cinder-backup[101319]: DEBUG cinder.service [None req-5f770af2-e09b-483c-8da6-1399998bb49b None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=101319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 09:34:10.923471 np0000004400 cinder-backup[101319]: DEBUG cinder.service [None req-5f770af2-e09b-483c-8da6-1399998bb49b None None] cinder_internal_tenant_project_id = 5ed3b4f0846842d78b8d7e1a1f248918 {{(pid=101319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 09:34:10.923578 np0000004400 cinder-backup[101319]: DEBUG cinder.service [None req-5f770af2-e09b-483c-8da6-1399998bb49b None None] cinder_internal_tenant_user_id = 7fad36d3087049eb9a952ab4e4322b37 {{(pid=101319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 09:34:10.923683 np0000004400 cinder-backup[101319]: DEBUG cinder.service [None req-5f770af2-e09b-483c-8da6-1399998bb49b None None] compression_format = gzip {{(pid=101319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 09:34:10.923809 np0000004400 cinder-backup[101319]: DEBUG cinder.service [None req-5f770af2-e09b-483c-8da6-1399998bb49b None None] config_dir = [] {{(pid=101319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 09:34:10.923896 np0000004400 cinder-backup[101319]: DEBUG cinder.service [None req-5f770af2-e09b-483c-8da6-1399998bb49b None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=101319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 09:34:10.924002 np0000004400 cinder-backup[101319]: DEBUG cinder.service [None req-5f770af2-e09b-483c-8da6-1399998bb49b None None] config_source = [] {{(pid=101319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 09:34:10.924118 np0000004400 cinder-backup[101319]: DEBUG cinder.service [None req-5f770af2-e09b-483c-8da6-1399998bb49b None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=101319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 09:34:10.924224 np0000004400 cinder-backup[101319]: DEBUG cinder.service [None req-5f770af2-e09b-483c-8da6-1399998bb49b None None] control_exchange = openstack {{(pid=101319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 09:34:10.924333 np0000004400 cinder-backup[101319]: DEBUG cinder.service [None req-5f770af2-e09b-483c-8da6-1399998bb49b None None] debug = True {{(pid=101319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 09:34:10.924454 np0000004400 cinder-backup[101319]: DEBUG cinder.service [None req-5f770af2-e09b-483c-8da6-1399998bb49b None None] default_availability_zone = None {{(pid=101319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 09:34:10.924550 np0000004400 cinder-backup[101319]: DEBUG cinder.service [None req-5f770af2-e09b-483c-8da6-1399998bb49b None None] default_group_type = None {{(pid=101319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 09:34:10.924696 np0000004400 cinder-backup[101319]: DEBUG cinder.service [None req-5f770af2-e09b-483c-8da6-1399998bb49b None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'swiftclient=WARN', 'botocore=WARN'] {{(pid=101319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 09:34:10.924816 np0000004400 cinder-backup[101319]: DEBUG cinder.service [None req-5f770af2-e09b-483c-8da6-1399998bb49b None None] default_volume_type = storpool {{(pid=101319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 09:34:10.924919 np0000004400 cinder-backup[101319]: DEBUG cinder.service [None req-5f770af2-e09b-483c-8da6-1399998bb49b None None] disk_geometry = None {{(pid=101319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 09:34:10.925026 np0000004400 cinder-backup[101319]: DEBUG cinder.service [None req-5f770af2-e09b-483c-8da6-1399998bb49b None None] driver_client_cert = None {{(pid=101319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 09:34:10.925123 np0000004400 cinder-backup[101319]: DEBUG cinder.service [None req-5f770af2-e09b-483c-8da6-1399998bb49b None None] driver_client_cert_key = None {{(pid=101319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 09:34:10.925218 np0000004400 cinder-backup[101319]: DEBUG cinder.service [None req-5f770af2-e09b-483c-8da6-1399998bb49b None None] driver_data_namespace = None {{(pid=101319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 09:34:10.925313 np0000004400 cinder-backup[101319]: DEBUG cinder.service [None req-5f770af2-e09b-483c-8da6-1399998bb49b None None] driver_ssl_cert_path = None {{(pid=101319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 09:34:10.925416 np0000004400 cinder-backup[101319]: DEBUG cinder.service [None req-5f770af2-e09b-483c-8da6-1399998bb49b None None] driver_ssl_cert_verify = False {{(pid=101319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 09:34:10.925529 np0000004400 cinder-backup[101319]: DEBUG cinder.service [None req-5f770af2-e09b-483c-8da6-1399998bb49b None None] driver_use_ssl = False {{(pid=101319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 09:34:10.925627 np0000004400 cinder-backup[101319]: DEBUG cinder.service [None req-5f770af2-e09b-483c-8da6-1399998bb49b None None] enable_new_services = True {{(pid=101319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 09:34:10.925724 np0000004400 cinder-backup[101319]: DEBUG cinder.service [None req-5f770af2-e09b-483c-8da6-1399998bb49b None None] enable_unsupported_driver = False {{(pid=101319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 09:34:10.925851 np0000004400 cinder-backup[101319]: DEBUG cinder.service [None req-5f770af2-e09b-483c-8da6-1399998bb49b None None] enabled_backends = ['storpool'] {{(pid=101319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 09:34:10.925955 np0000004400 cinder-backup[101319]: DEBUG cinder.service [None req-5f770af2-e09b-483c-8da6-1399998bb49b None None] enforce_multipath_for_image_xfer = False {{(pid=101319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 09:34:10.926169 np0000004400 cinder-backup[101319]: DEBUG cinder.service [None req-5f770af2-e09b-483c-8da6-1399998bb49b None None] filter_function = None {{(pid=101319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 09:34:10.926276 np0000004400 cinder-backup[101319]: DEBUG cinder.service [None req-5f770af2-e09b-483c-8da6-1399998bb49b None None] glance_api_insecure = False {{(pid=101319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 09:34:10.926383 np0000004400 cinder-backup[101319]: DEBUG cinder.service [None req-5f770af2-e09b-483c-8da6-1399998bb49b None None] glance_api_servers = ['https://10.4.3.95/image'] {{(pid=101319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 09:34:10.926501 np0000004400 cinder-backup[101319]: DEBUG cinder.service [None req-5f770af2-e09b-483c-8da6-1399998bb49b None None] glance_api_ssl_compression = False {{(pid=101319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 09:34:10.926604 np0000004400 cinder-backup[101319]: DEBUG cinder.service [None req-5f770af2-e09b-483c-8da6-1399998bb49b None None] glance_ca_certificates_file = /opt/stack/data/ca-bundle.pem {{(pid=101319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 09:34:10.926707 np0000004400 cinder-backup[101319]: DEBUG cinder.service [None req-5f770af2-e09b-483c-8da6-1399998bb49b None None] glance_catalog_info = image:glance:publicURL {{(pid=101319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 09:34:10.926803 np0000004400 cinder-backup[101319]: DEBUG cinder.service [None req-5f770af2-e09b-483c-8da6-1399998bb49b None None] glance_certfile = None {{(pid=101319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 09:34:10.926934 np0000004400 cinder-backup[101319]: DEBUG cinder.service [None req-5f770af2-e09b-483c-8da6-1399998bb49b None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=101319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 09:34:10.927050 np0000004400 cinder-backup[101319]: DEBUG cinder.service [None req-5f770af2-e09b-483c-8da6-1399998bb49b None None] glance_keyfile = None {{(pid=101319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 09:34:10.927261 np0000004400 cinder-backup[101319]: DEBUG cinder.service [None req-5f770af2-e09b-483c-8da6-1399998bb49b None None] glance_num_retries = 3 {{(pid=101319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 09:34:10.927359 np0000004400 cinder-backup[101319]: DEBUG cinder.service [None req-5f770af2-e09b-483c-8da6-1399998bb49b None None] glance_request_timeout = None {{(pid=101319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 09:34:10.927471 np0000004400 cinder-backup[101319]: DEBUG cinder.service [None req-5f770af2-e09b-483c-8da6-1399998bb49b None None] goodness_function = None {{(pid=101319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 09:34:10.927581 np0000004400 cinder-backup[101319]: DEBUG cinder.service [None req-5f770af2-e09b-483c-8da6-1399998bb49b None None] graceful_shutdown_timeout = 5 {{(pid=101319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 09:34:10.927686 np0000004400 cinder-backup[101319]: DEBUG cinder.service [None req-5f770af2-e09b-483c-8da6-1399998bb49b None None] group_api_class = cinder.group.api.API {{(pid=101319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 09:34:10.927790 np0000004400 cinder-backup[101319]: DEBUG cinder.service [None req-5f770af2-e09b-483c-8da6-1399998bb49b None None] host = np0000004400 {{(pid=101319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 09:34:10.927889 np0000004400 cinder-backup[101319]: DEBUG cinder.service [None req-5f770af2-e09b-483c-8da6-1399998bb49b None None] image_compress_on_upload = True {{(pid=101319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 09:34:10.928015 np0000004400 cinder-backup[101319]: DEBUG cinder.service [None req-5f770af2-e09b-483c-8da6-1399998bb49b None None] image_conversion_address_space_limit = 1 {{(pid=101319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 09:34:10.928118 np0000004400 cinder-backup[101319]: DEBUG cinder.service [None req-5f770af2-e09b-483c-8da6-1399998bb49b None None] image_conversion_cpu_limit = 60 {{(pid=101319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 09:34:10.928267 np0000004400 cinder-backup[101319]: DEBUG cinder.service [None req-5f770af2-e09b-483c-8da6-1399998bb49b None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=101319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 09:34:10.928367 np0000004400 cinder-backup[101319]: DEBUG cinder.service [None req-5f770af2-e09b-483c-8da6-1399998bb49b None None] image_conversion_disable = False {{(pid=101319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 09:34:10.928488 np0000004400 cinder-backup[101319]: DEBUG cinder.service [None req-5f770af2-e09b-483c-8da6-1399998bb49b None None] image_upload_use_cinder_backend = False {{(pid=101319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 09:34:10.928588 np0000004400 cinder-backup[101319]: DEBUG cinder.service [None req-5f770af2-e09b-483c-8da6-1399998bb49b None None] image_upload_use_internal_tenant = False {{(pid=101319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 09:34:10.928686 np0000004400 cinder-backup[101319]: DEBUG cinder.service [None req-5f770af2-e09b-483c-8da6-1399998bb49b None None] image_volume_cache_enabled = False {{(pid=101319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 09:34:10.928785 np0000004400 cinder-backup[101319]: DEBUG cinder.service [None req-5f770af2-e09b-483c-8da6-1399998bb49b None None] image_volume_cache_max_count = 0 {{(pid=101319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 09:34:10.928882 np0000004400 cinder-backup[101319]: DEBUG cinder.service [None req-5f770af2-e09b-483c-8da6-1399998bb49b None None] image_volume_cache_max_size_gb = 0 {{(pid=101319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 09:34:10.928999 np0000004400 cinder-backup[101319]: DEBUG cinder.service [None req-5f770af2-e09b-483c-8da6-1399998bb49b None None] instance_format = [instance: %(uuid)s] {{(pid=101319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 09:34:10.929116 np0000004400 cinder-backup[101319]: DEBUG cinder.service [None req-5f770af2-e09b-483c-8da6-1399998bb49b None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=101319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 09:34:10.929219 np0000004400 cinder-backup[101319]: DEBUG cinder.service [None req-5f770af2-e09b-483c-8da6-1399998bb49b None None] iscsi_target_flags = {{(pid=101319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 09:34:10.929325 np0000004400 cinder-backup[101319]: DEBUG cinder.service [None req-5f770af2-e09b-483c-8da6-1399998bb49b None None] iscsi_write_cache = on {{(pid=101319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 09:34:10.929449 np0000004400 cinder-backup[101319]: DEBUG cinder.service [None req-5f770af2-e09b-483c-8da6-1399998bb49b None None] iser_helper = tgtadm {{(pid=101319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 09:34:10.929606 np0000004400 cinder-backup[101319]: DEBUG cinder.service [None req-5f770af2-e09b-483c-8da6-1399998bb49b None None] iser_ip_address = 10.4.3.95 {{(pid=101319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 09:34:10.929715 np0000004400 cinder-backup[101319]: DEBUG cinder.service [None req-5f770af2-e09b-483c-8da6-1399998bb49b None None] iser_port = 3260 {{(pid=101319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 09:34:10.929822 np0000004400 cinder-backup[101319]: DEBUG cinder.service [None req-5f770af2-e09b-483c-8da6-1399998bb49b None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=101319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 09:34:10.929926 np0000004400 cinder-backup[101319]: DEBUG cinder.service [None req-5f770af2-e09b-483c-8da6-1399998bb49b None None] keystone_catalog_info = identity:Identity Service:publicURL {{(pid=101319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 09:34:10.930064 np0000004400 cinder-backup[101319]: DEBUG cinder.service [None req-5f770af2-e09b-483c-8da6-1399998bb49b None None] log_color = False {{(pid=101319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 09:34:10.930171 np0000004400 cinder-backup[101319]: DEBUG cinder.service [None req-5f770af2-e09b-483c-8da6-1399998bb49b None None] log_config_append = None {{(pid=101319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 09:34:10.930279 np0000004400 cinder-backup[101319]: DEBUG cinder.service [None req-5f770af2-e09b-483c-8da6-1399998bb49b None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=101319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 09:34:10.930379 np0000004400 cinder-backup[101319]: DEBUG cinder.service [None req-5f770af2-e09b-483c-8da6-1399998bb49b None None] log_dir = None {{(pid=101319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 09:34:10.930499 np0000004400 cinder-backup[101319]: DEBUG cinder.service [None req-5f770af2-e09b-483c-8da6-1399998bb49b None None] log_file = None {{(pid=101319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 09:34:10.930601 np0000004400 cinder-backup[101319]: DEBUG cinder.service [None req-5f770af2-e09b-483c-8da6-1399998bb49b None None] log_options = True {{(pid=101319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 09:34:10.930699 np0000004400 cinder-backup[101319]: DEBUG cinder.service [None req-5f770af2-e09b-483c-8da6-1399998bb49b None None] log_rotate_interval = 1 {{(pid=101319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 09:34:10.930803 np0000004400 cinder-backup[101319]: DEBUG cinder.service [None req-5f770af2-e09b-483c-8da6-1399998bb49b None None] log_rotate_interval_type = days {{(pid=101319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 09:34:10.930903 np0000004400 cinder-backup[101319]: DEBUG cinder.service [None req-5f770af2-e09b-483c-8da6-1399998bb49b None None] log_rotation_type = none {{(pid=101319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 09:34:10.930994 np0000004400 cinder-backup[101319]: DEBUG cinder.service [None req-5f770af2-e09b-483c-8da6-1399998bb49b None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=101319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 09:34:10.931101 np0000004400 cinder-backup[101319]: DEBUG cinder.service [None req-5f770af2-e09b-483c-8da6-1399998bb49b None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=101319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 09:34:10.931203 np0000004400 cinder-backup[101319]: DEBUG cinder.service [None req-5f770af2-e09b-483c-8da6-1399998bb49b None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=101319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 09:34:10.931303 np0000004400 cinder-backup[101319]: DEBUG cinder.service [None req-5f770af2-e09b-483c-8da6-1399998bb49b None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=101319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 09:34:10.931384 np0000004400 cinder-backup[101319]: DEBUG cinder.service [None req-5f770af2-e09b-483c-8da6-1399998bb49b None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=101319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 09:34:10.931509 np0000004400 cinder-backup[101319]: DEBUG cinder.service [None req-5f770af2-e09b-483c-8da6-1399998bb49b None None] max_age = 0 {{(pid=101319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 09:34:10.931612 np0000004400 cinder-backup[101319]: DEBUG cinder.service [None req-5f770af2-e09b-483c-8da6-1399998bb49b None None] max_logfile_count = 30 {{(pid=101319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 09:34:10.931709 np0000004400 cinder-backup[101319]: DEBUG cinder.service [None req-5f770af2-e09b-483c-8da6-1399998bb49b None None] max_logfile_size_mb = 200 {{(pid=101319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 09:34:10.931817 np0000004400 cinder-backup[101319]: DEBUG cinder.service [None req-5f770af2-e09b-483c-8da6-1399998bb49b None None] max_over_subscription_ratio = 20.0 {{(pid=101319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 09:34:10.931922 np0000004400 cinder-backup[101319]: DEBUG cinder.service [None req-5f770af2-e09b-483c-8da6-1399998bb49b None None] message_reap_interval = 86400 {{(pid=101319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 09:34:10.932028 np0000004400 cinder-backup[101319]: DEBUG cinder.service [None req-5f770af2-e09b-483c-8da6-1399998bb49b None None] message_ttl = 2592000 {{(pid=101319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 09:34:10.932145 np0000004400 cinder-backup[101319]: DEBUG cinder.service [None req-5f770af2-e09b-483c-8da6-1399998bb49b None None] monkey_patch = False {{(pid=101319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 09:34:10.932248 np0000004400 cinder-backup[101319]: DEBUG cinder.service [None req-5f770af2-e09b-483c-8da6-1399998bb49b None None] monkey_patch_modules = [] {{(pid=101319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 09:34:10.932331 np0000004400 cinder-backup[101319]: DEBUG cinder.service [None req-5f770af2-e09b-483c-8da6-1399998bb49b None None] my_ip = 10.4.3.95 {{(pid=101319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 09:34:10.932454 np0000004400 cinder-backup[101319]: DEBUG cinder.service [None req-5f770af2-e09b-483c-8da6-1399998bb49b None None] no_snapshot_gb_quota = False {{(pid=101319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 09:34:10.932551 np0000004400 cinder-backup[101319]: DEBUG cinder.service [None req-5f770af2-e09b-483c-8da6-1399998bb49b None None] num_iser_scan_tries = 3 {{(pid=101319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 09:34:10.932650 np0000004400 cinder-backup[101319]: DEBUG cinder.service [None req-5f770af2-e09b-483c-8da6-1399998bb49b None None] num_shell_tries = 3 {{(pid=101319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 09:34:10.932749 np0000004400 cinder-backup[101319]: DEBUG cinder.service [None req-5f770af2-e09b-483c-8da6-1399998bb49b None None] num_volume_device_scan_tries = 3 {{(pid=101319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 09:34:10.932848 np0000004400 cinder-backup[101319]: DEBUG cinder.service [None req-5f770af2-e09b-483c-8da6-1399998bb49b None None] nvmeof_conn_info_version = 1 {{(pid=101319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 09:34:10.932980 np0000004400 cinder-backup[101319]: DEBUG cinder.service [None req-5f770af2-e09b-483c-8da6-1399998bb49b None None] nvmet_ns_id = 10 {{(pid=101319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 09:34:10.933117 np0000004400 cinder-backup[101319]: DEBUG cinder.service [None req-5f770af2-e09b-483c-8da6-1399998bb49b None None] nvmet_port_id = 1 {{(pid=101319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 09:34:10.933232 np0000004400 cinder-backup[101319]: DEBUG cinder.service [None req-5f770af2-e09b-483c-8da6-1399998bb49b None None] osapi_max_limit = 1000 {{(pid=101319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 09:34:10.933333 np0000004400 cinder-backup[101319]: DEBUG cinder.service [None req-5f770af2-e09b-483c-8da6-1399998bb49b None None] osapi_volume_ext_list = [] {{(pid=101319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 09:34:10.933470 np0000004400 cinder-backup[101319]: DEBUG cinder.service [None req-5f770af2-e09b-483c-8da6-1399998bb49b None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=101319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 09:34:10.933581 np0000004400 cinder-backup[101319]: DEBUG cinder.service [None req-5f770af2-e09b-483c-8da6-1399998bb49b None None] osapi_volume_listen = 0.0.0.0 {{(pid=101319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 09:34:10.933684 np0000004400 cinder-backup[101319]: DEBUG cinder.service [None req-5f770af2-e09b-483c-8da6-1399998bb49b None None] osapi_volume_listen_port = 8776 {{(pid=101319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 09:34:10.933785 np0000004400 cinder-backup[101319]: DEBUG cinder.service [None req-5f770af2-e09b-483c-8da6-1399998bb49b None None] osapi_volume_use_ssl = False {{(pid=101319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 09:34:10.933881 np0000004400 cinder-backup[101319]: DEBUG cinder.service [None req-5f770af2-e09b-483c-8da6-1399998bb49b None None] osapi_volume_workers = None {{(pid=101319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 09:34:10.933986 np0000004400 cinder-backup[101319]: DEBUG cinder.service [None req-5f770af2-e09b-483c-8da6-1399998bb49b None None] per_volume_size_limit = -1 {{(pid=101319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 09:34:10.934104 np0000004400 cinder-backup[101319]: DEBUG cinder.service [None req-5f770af2-e09b-483c-8da6-1399998bb49b None None] periodic_fuzzy_delay = 60 {{(pid=101319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 09:34:10.934207 np0000004400 cinder-backup[101319]: DEBUG cinder.service [None req-5f770af2-e09b-483c-8da6-1399998bb49b None None] periodic_interval = 60 {{(pid=101319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 09:34:10.934318 np0000004400 cinder-backup[101319]: DEBUG cinder.service [None req-5f770af2-e09b-483c-8da6-1399998bb49b None None] project_id_regex = [0-9a-f\-]+ {{(pid=101319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 09:34:10.934426 np0000004400 cinder-backup[101319]: DEBUG cinder.service [None req-5f770af2-e09b-483c-8da6-1399998bb49b None None] public_endpoint = None {{(pid=101319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 09:34:10.934534 np0000004400 cinder-backup[101319]: DEBUG cinder.service [None req-5f770af2-e09b-483c-8da6-1399998bb49b None None] publish_errors = False {{(pid=101319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 09:34:10.934632 np0000004400 cinder-backup[101319]: DEBUG cinder.service [None req-5f770af2-e09b-483c-8da6-1399998bb49b None None] quota_backup_gigabytes = 1000 {{(pid=101319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 09:34:10.934736 np0000004400 cinder-backup[101319]: DEBUG cinder.service [None req-5f770af2-e09b-483c-8da6-1399998bb49b None None] quota_backups = 10 {{(pid=101319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 09:34:10.934839 np0000004400 cinder-backup[101319]: DEBUG cinder.service [None req-5f770af2-e09b-483c-8da6-1399998bb49b None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=101319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 09:34:10.934937 np0000004400 cinder-backup[101319]: DEBUG cinder.service [None req-5f770af2-e09b-483c-8da6-1399998bb49b None None] quota_gigabytes = 1000 {{(pid=101319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 09:34:10.935049 np0000004400 cinder-backup[101319]: DEBUG cinder.service [None req-5f770af2-e09b-483c-8da6-1399998bb49b None None] quota_groups = 10 {{(pid=101319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 09:34:10.935170 np0000004400 cinder-backup[101319]: DEBUG cinder.service [None req-5f770af2-e09b-483c-8da6-1399998bb49b None None] quota_snapshots = 10 {{(pid=101319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 09:34:10.935274 np0000004400 cinder-backup[101319]: DEBUG cinder.service [None req-5f770af2-e09b-483c-8da6-1399998bb49b None None] quota_volumes = 10 {{(pid=101319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 09:34:10.935374 np0000004400 cinder-backup[101319]: DEBUG cinder.service [None req-5f770af2-e09b-483c-8da6-1399998bb49b None None] rate_limit_burst = 0 {{(pid=101319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 09:34:10.935503 np0000004400 cinder-backup[101319]: DEBUG cinder.service [None req-5f770af2-e09b-483c-8da6-1399998bb49b None None] rate_limit_except_level = CRITICAL {{(pid=101319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 09:34:10.935603 np0000004400 cinder-backup[101319]: DEBUG cinder.service [None req-5f770af2-e09b-483c-8da6-1399998bb49b None None] rate_limit_interval = 0 {{(pid=101319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 09:34:10.935706 np0000004400 cinder-backup[101319]: DEBUG cinder.service [None req-5f770af2-e09b-483c-8da6-1399998bb49b None None] replication_device = **** {{(pid=101319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 09:34:10.935806 np0000004400 cinder-backup[101319]: DEBUG cinder.service [None req-5f770af2-e09b-483c-8da6-1399998bb49b None None] report_discard_supported = False {{(pid=101319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 09:34:10.935910 np0000004400 cinder-backup[101319]: DEBUG cinder.service [None req-5f770af2-e09b-483c-8da6-1399998bb49b None None] report_interval = 120 {{(pid=101319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 09:34:10.936060 np0000004400 cinder-backup[101319]: DEBUG cinder.service [None req-5f770af2-e09b-483c-8da6-1399998bb49b None None] reservation_clean_interval = 86400 {{(pid=101319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 09:34:10.936157 np0000004400 cinder-backup[101319]: DEBUG cinder.service [None req-5f770af2-e09b-483c-8da6-1399998bb49b None None] reservation_expire = 86400 {{(pid=101319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 09:34:10.936261 np0000004400 cinder-backup[101319]: DEBUG cinder.service [None req-5f770af2-e09b-483c-8da6-1399998bb49b None None] reserved_image_namespaces = [] {{(pid=101319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 09:34:10.936361 np0000004400 cinder-backup[101319]: DEBUG cinder.service [None req-5f770af2-e09b-483c-8da6-1399998bb49b None None] reserved_percentage = 0 {{(pid=101319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 09:34:10.936491 np0000004400 cinder-backup[101319]: DEBUG cinder.service [None req-5f770af2-e09b-483c-8da6-1399998bb49b None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=101319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 09:34:10.936594 np0000004400 cinder-backup[101319]: DEBUG cinder.service [None req-5f770af2-e09b-483c-8da6-1399998bb49b None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=101319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 09:34:10.936705 np0000004400 cinder-backup[101319]: DEBUG cinder.service [None req-5f770af2-e09b-483c-8da6-1399998bb49b None None] rpc_response_timeout = 120 {{(pid=101319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 09:34:10.936802 np0000004400 cinder-backup[101319]: DEBUG cinder.service [None req-5f770af2-e09b-483c-8da6-1399998bb49b None None] run_external_periodic_tasks = True {{(pid=101319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 09:34:10.936905 np0000004400 cinder-backup[101319]: DEBUG cinder.service [None req-5f770af2-e09b-483c-8da6-1399998bb49b None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=101319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 09:34:10.937015 np0000004400 cinder-backup[101319]: DEBUG cinder.service [None req-5f770af2-e09b-483c-8da6-1399998bb49b None None] scst_target_driver = iscsi {{(pid=101319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 09:34:10.937129 np0000004400 cinder-backup[101319]: DEBUG cinder.service [None req-5f770af2-e09b-483c-8da6-1399998bb49b None None] scst_target_iqn_name = None {{(pid=101319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 09:34:10.937238 np0000004400 cinder-backup[101319]: DEBUG cinder.service [None req-5f770af2-e09b-483c-8da6-1399998bb49b None None] service_down_time = 720 {{(pid=101319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 09:34:10.937335 np0000004400 cinder-backup[101319]: DEBUG cinder.service [None req-5f770af2-e09b-483c-8da6-1399998bb49b None None] shell_completion = None {{(pid=101319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 09:34:10.937467 np0000004400 cinder-backup[101319]: DEBUG cinder.service [None req-5f770af2-e09b-483c-8da6-1399998bb49b None None] snapshot_name_template = snapshot-%s {{(pid=101319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 09:34:10.937562 np0000004400 cinder-backup[101319]: DEBUG cinder.service [None req-5f770af2-e09b-483c-8da6-1399998bb49b None None] split_loggers = False {{(pid=101319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 09:34:10.937645 np0000004400 cinder-backup[101319]: DEBUG cinder.service [None req-5f770af2-e09b-483c-8da6-1399998bb49b None None] state_path = /opt/stack/data/cinder {{(pid=101319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 09:34:10.937749 np0000004400 cinder-backup[101319]: DEBUG cinder.service [None req-5f770af2-e09b-483c-8da6-1399998bb49b None None] storage_availability_zone = nova {{(pid=101319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 09:34:10.937851 np0000004400 cinder-backup[101319]: DEBUG cinder.service [None req-5f770af2-e09b-483c-8da6-1399998bb49b None None] storage_protocol = iSCSI {{(pid=101319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 09:34:10.937952 np0000004400 cinder-backup[101319]: DEBUG cinder.service [None req-5f770af2-e09b-483c-8da6-1399998bb49b None None] swift_catalog_info = object-store:swift:publicURL {{(pid=101319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 09:34:10.938069 np0000004400 cinder-backup[101319]: DEBUG cinder.service [None req-5f770af2-e09b-483c-8da6-1399998bb49b None None] syslog_log_facility = LOG_USER {{(pid=101319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 09:34:10.938190 np0000004400 cinder-backup[101319]: DEBUG cinder.service [None req-5f770af2-e09b-483c-8da6-1399998bb49b None None] target_helper = lioadm {{(pid=101319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 09:34:10.938342 np0000004400 cinder-backup[101319]: DEBUG cinder.service [None req-5f770af2-e09b-483c-8da6-1399998bb49b None None] target_ip_address = 10.4.3.95 {{(pid=101319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 09:34:10.938469 np0000004400 cinder-backup[101319]: DEBUG cinder.service [None req-5f770af2-e09b-483c-8da6-1399998bb49b None None] target_port = 3260 {{(pid=101319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 09:34:10.938576 np0000004400 cinder-backup[101319]: DEBUG cinder.service [None req-5f770af2-e09b-483c-8da6-1399998bb49b None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=101319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 09:34:10.938683 np0000004400 cinder-backup[101319]: DEBUG cinder.service [None req-5f770af2-e09b-483c-8da6-1399998bb49b None None] target_protocol = iscsi {{(pid=101319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 09:34:10.938782 np0000004400 cinder-backup[101319]: DEBUG cinder.service [None req-5f770af2-e09b-483c-8da6-1399998bb49b None None] target_secondary_ip_addresses = [] {{(pid=101319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 09:34:10.938879 np0000004400 cinder-backup[101319]: DEBUG cinder.service [None req-5f770af2-e09b-483c-8da6-1399998bb49b None None] trace_flags = None {{(pid=101319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 09:34:10.938982 np0000004400 cinder-backup[101319]: DEBUG cinder.service [None req-5f770af2-e09b-483c-8da6-1399998bb49b None None] transfer_api_class = cinder.transfer.api.API {{(pid=101319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 09:34:10.939096 np0000004400 cinder-backup[101319]: DEBUG cinder.service [None req-5f770af2-e09b-483c-8da6-1399998bb49b None None] transport_url = **** {{(pid=101319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 09:34:10.939212 np0000004400 cinder-backup[101319]: DEBUG cinder.service [None req-5f770af2-e09b-483c-8da6-1399998bb49b None None] until_refresh = 0 {{(pid=101319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 09:34:10.939311 np0000004400 cinder-backup[101319]: DEBUG cinder.service [None req-5f770af2-e09b-483c-8da6-1399998bb49b None None] use_chap_auth = False {{(pid=101319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 09:34:10.939417 np0000004400 cinder-backup[101319]: DEBUG cinder.service [None req-5f770af2-e09b-483c-8da6-1399998bb49b None None] use_default_quota_class = True {{(pid=101319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 09:34:10.939531 np0000004400 cinder-backup[101319]: DEBUG cinder.service [None req-5f770af2-e09b-483c-8da6-1399998bb49b None None] use_journal = False {{(pid=101319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 09:34:10.939635 np0000004400 cinder-backup[101319]: DEBUG cinder.service [None req-5f770af2-e09b-483c-8da6-1399998bb49b None None] use_json = False {{(pid=101319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 09:34:10.939729 np0000004400 cinder-backup[101319]: DEBUG cinder.service [None req-5f770af2-e09b-483c-8da6-1399998bb49b None None] use_multipath_for_image_xfer = False {{(pid=101319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 09:34:10.939826 np0000004400 cinder-backup[101319]: DEBUG cinder.service [None req-5f770af2-e09b-483c-8da6-1399998bb49b None None] use_stderr = False {{(pid=101319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 09:34:10.939926 np0000004400 cinder-backup[101319]: DEBUG cinder.service [None req-5f770af2-e09b-483c-8da6-1399998bb49b None None] use_syslog = False {{(pid=101319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 09:34:10.940042 np0000004400 cinder-backup[101319]: DEBUG cinder.service [None req-5f770af2-e09b-483c-8da6-1399998bb49b None None] verify_glance_signatures = enabled {{(pid=101319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 09:34:10.940164 np0000004400 cinder-backup[101319]: DEBUG cinder.service [None req-5f770af2-e09b-483c-8da6-1399998bb49b None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=101319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 09:34:10.940272 np0000004400 cinder-backup[101319]: DEBUG cinder.service [None req-5f770af2-e09b-483c-8da6-1399998bb49b None None] volume_api_class = cinder.volume.api.API {{(pid=101319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 09:34:10.940367 np0000004400 cinder-backup[101319]: DEBUG cinder.service [None req-5f770af2-e09b-483c-8da6-1399998bb49b None None] volume_backend_name = None {{(pid=101319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 09:34:10.940492 np0000004400 cinder-backup[101319]: DEBUG cinder.service [None req-5f770af2-e09b-483c-8da6-1399998bb49b None None] volume_clear = zero {{(pid=101319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 09:34:10.940590 np0000004400 cinder-backup[101319]: DEBUG cinder.service [None req-5f770af2-e09b-483c-8da6-1399998bb49b None None] volume_clear_ionice = None {{(pid=101319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 09:34:10.940686 np0000004400 cinder-backup[101319]: DEBUG cinder.service [None req-5f770af2-e09b-483c-8da6-1399998bb49b None None] volume_clear_size = 0 {{(pid=101319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 09:34:10.940789 np0000004400 cinder-backup[101319]: DEBUG cinder.service [None req-5f770af2-e09b-483c-8da6-1399998bb49b None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=101319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 09:34:10.940886 np0000004400 cinder-backup[101319]: DEBUG cinder.service [None req-5f770af2-e09b-483c-8da6-1399998bb49b None None] volume_copy_bps_limit = 0 {{(pid=101319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 09:34:10.940987 np0000004400 cinder-backup[101319]: DEBUG cinder.service [None req-5f770af2-e09b-483c-8da6-1399998bb49b None None] volume_dd_blocksize = 1M {{(pid=101319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 09:34:10.941119 np0000004400 cinder-backup[101319]: DEBUG cinder.service [None req-5f770af2-e09b-483c-8da6-1399998bb49b None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=101319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 09:34:10.941209 np0000004400 cinder-backup[101319]: DEBUG cinder.service [None req-5f770af2-e09b-483c-8da6-1399998bb49b None None] volume_name_template = volume-%s {{(pid=101319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 09:34:10.941318 np0000004400 cinder-backup[101319]: DEBUG cinder.service [None req-5f770af2-e09b-483c-8da6-1399998bb49b None None] volume_usage_audit_period = month {{(pid=101319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 09:34:10.941463 np0000004400 cinder-backup[101319]: DEBUG cinder.service [None req-5f770af2-e09b-483c-8da6-1399998bb49b None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=101319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 09:34:10.941586 np0000004400 cinder-backup[101319]: DEBUG cinder.service [None req-5f770af2-e09b-483c-8da6-1399998bb49b None None] oslo_concurrency.disable_process_locking = False {{(pid=101319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 09:34:10.941697 np0000004400 cinder-backup[101319]: DEBUG cinder.service [None req-5f770af2-e09b-483c-8da6-1399998bb49b None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=101319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 09:34:10.941868 np0000004400 cinder-backup[101319]: DEBUG cinder.service [None req-5f770af2-e09b-483c-8da6-1399998bb49b None None] os_brick.lightos_discovery_client_address = localhost {{(pid=101319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 09:34:10.941975 np0000004400 cinder-backup[101319]: DEBUG cinder.service [None req-5f770af2-e09b-483c-8da6-1399998bb49b None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=101319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 09:34:10.942094 np0000004400 cinder-backup[101319]: DEBUG cinder.service [None req-5f770af2-e09b-483c-8da6-1399998bb49b None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=101319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 09:34:10.942214 np0000004400 cinder-backup[101319]: DEBUG cinder.service [None req-5f770af2-e09b-483c-8da6-1399998bb49b None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=101319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 09:34:10.942324 np0000004400 cinder-backup[101319]: DEBUG cinder.service [None req-5f770af2-e09b-483c-8da6-1399998bb49b None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=101319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 09:34:10.942442 np0000004400 cinder-backup[101319]: DEBUG cinder.service [None req-5f770af2-e09b-483c-8da6-1399998bb49b None None] os_brick.wait_mpath_device_interval = 1 {{(pid=101319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 09:34:10.942556 np0000004400 cinder-backup[101319]: DEBUG cinder.service [None req-5f770af2-e09b-483c-8da6-1399998bb49b None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=101319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 09:34:10.942661 np0000004400 cinder-backup[101319]: DEBUG cinder.service [None req-5f770af2-e09b-483c-8da6-1399998bb49b None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=101319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 09:34:10.942776 np0000004400 cinder-backup[101319]: DEBUG cinder.service [None req-5f770af2-e09b-483c-8da6-1399998bb49b None None] keystone_authtoken.auth_section = None {{(pid=101319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 09:34:10.942884 np0000004400 cinder-backup[101319]: DEBUG cinder.service [None req-5f770af2-e09b-483c-8da6-1399998bb49b None None] keystone_authtoken.auth_type = password {{(pid=101319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 09:34:10.942983 np0000004400 cinder-backup[101319]: DEBUG cinder.service [None req-5f770af2-e09b-483c-8da6-1399998bb49b None None] keystone_authtoken.auth_version = None {{(pid=101319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 09:34:10.943091 np0000004400 cinder-backup[101319]: DEBUG cinder.service [None req-5f770af2-e09b-483c-8da6-1399998bb49b None None] keystone_authtoken.cache = None {{(pid=101319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 09:34:10.943211 np0000004400 cinder-backup[101319]: DEBUG cinder.service [None req-5f770af2-e09b-483c-8da6-1399998bb49b None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=101319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 09:34:10.943316 np0000004400 cinder-backup[101319]: DEBUG cinder.service [None req-5f770af2-e09b-483c-8da6-1399998bb49b None None] keystone_authtoken.certfile = None {{(pid=101319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 09:34:10.943473 np0000004400 cinder-backup[101319]: DEBUG cinder.service [None req-5f770af2-e09b-483c-8da6-1399998bb49b None None] keystone_authtoken.delay_auth_decision = False {{(pid=101319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 09:34:10.943548 np0000004400 cinder-backup[101319]: DEBUG cinder.service [None req-5f770af2-e09b-483c-8da6-1399998bb49b None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=101319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 09:34:10.943646 np0000004400 cinder-backup[101319]: DEBUG cinder.service [None req-5f770af2-e09b-483c-8da6-1399998bb49b None None] keystone_authtoken.http_connect_timeout = None {{(pid=101319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 09:34:10.943743 np0000004400 cinder-backup[101319]: DEBUG cinder.service [None req-5f770af2-e09b-483c-8da6-1399998bb49b None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=101319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 09:34:10.943845 np0000004400 cinder-backup[101319]: DEBUG cinder.service [None req-5f770af2-e09b-483c-8da6-1399998bb49b None None] keystone_authtoken.include_service_catalog = True {{(pid=101319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 09:34:10.943941 np0000004400 cinder-backup[101319]: DEBUG cinder.service [None req-5f770af2-e09b-483c-8da6-1399998bb49b None None] keystone_authtoken.insecure = False {{(pid=101319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 09:34:10.944055 np0000004400 cinder-backup[101319]: DEBUG cinder.service [None req-5f770af2-e09b-483c-8da6-1399998bb49b None None] keystone_authtoken.interface = public {{(pid=101319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 09:34:10.944150 np0000004400 cinder-backup[101319]: DEBUG cinder.service [None req-5f770af2-e09b-483c-8da6-1399998bb49b None None] keystone_authtoken.keyfile = None {{(pid=101319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 09:34:10.944269 np0000004400 cinder-backup[101319]: DEBUG cinder.service [None req-5f770af2-e09b-483c-8da6-1399998bb49b None None] keystone_authtoken.memcache_password = {{(pid=101319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 09:34:10.944372 np0000004400 cinder-backup[101319]: DEBUG cinder.service [None req-5f770af2-e09b-483c-8da6-1399998bb49b None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=101319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 09:34:10.944494 np0000004400 cinder-backup[101319]: DEBUG cinder.service [None req-5f770af2-e09b-483c-8da6-1399998bb49b None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=101319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 09:34:10.944595 np0000004400 cinder-backup[101319]: DEBUG cinder.service [None req-5f770af2-e09b-483c-8da6-1399998bb49b None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=101319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 09:34:10.944700 np0000004400 cinder-backup[101319]: DEBUG cinder.service [None req-5f770af2-e09b-483c-8da6-1399998bb49b None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=101319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 09:34:10.944804 np0000004400 cinder-backup[101319]: DEBUG cinder.service [None req-5f770af2-e09b-483c-8da6-1399998bb49b None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=101319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 09:34:10.944902 np0000004400 cinder-backup[101319]: DEBUG cinder.service [None req-5f770af2-e09b-483c-8da6-1399998bb49b None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=101319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 09:34:10.944998 np0000004400 cinder-backup[101319]: DEBUG cinder.service [None req-5f770af2-e09b-483c-8da6-1399998bb49b None None] keystone_authtoken.memcache_secret_key = **** {{(pid=101319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 09:34:10.945117 np0000004400 cinder-backup[101319]: DEBUG cinder.service [None req-5f770af2-e09b-483c-8da6-1399998bb49b None None] keystone_authtoken.memcache_security_strategy = None {{(pid=101319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 09:34:10.945219 np0000004400 cinder-backup[101319]: DEBUG cinder.service [None req-5f770af2-e09b-483c-8da6-1399998bb49b None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=101319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 09:34:10.945332 np0000004400 cinder-backup[101319]: DEBUG cinder.service [None req-5f770af2-e09b-483c-8da6-1399998bb49b None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=101319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 09:34:10.945453 np0000004400 cinder-backup[101319]: DEBUG cinder.service [None req-5f770af2-e09b-483c-8da6-1399998bb49b None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=101319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 09:34:10.945557 np0000004400 cinder-backup[101319]: DEBUG cinder.service [None req-5f770af2-e09b-483c-8da6-1399998bb49b None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=101319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 09:34:10.945653 np0000004400 cinder-backup[101319]: DEBUG cinder.service [None req-5f770af2-e09b-483c-8da6-1399998bb49b None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=101319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 09:34:10.945754 np0000004400 cinder-backup[101319]: DEBUG cinder.service [None req-5f770af2-e09b-483c-8da6-1399998bb49b None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=101319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 09:34:10.945853 np0000004400 cinder-backup[101319]: DEBUG cinder.service [None req-5f770af2-e09b-483c-8da6-1399998bb49b None None] keystone_authtoken.memcache_username = {{(pid=101319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 09:34:10.945966 np0000004400 cinder-backup[101319]: DEBUG cinder.service [None req-5f770af2-e09b-483c-8da6-1399998bb49b None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=101319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 09:34:10.946079 np0000004400 cinder-backup[101319]: DEBUG cinder.service [None req-5f770af2-e09b-483c-8da6-1399998bb49b None None] keystone_authtoken.region_name = None {{(pid=101319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 09:34:10.946187 np0000004400 cinder-backup[101319]: DEBUG cinder.service [None req-5f770af2-e09b-483c-8da6-1399998bb49b None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=101319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 09:34:10.946307 np0000004400 cinder-backup[101319]: DEBUG cinder.service [None req-5f770af2-e09b-483c-8da6-1399998bb49b None None] keystone_authtoken.service_token_roles_required = True {{(pid=101319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 09:34:10.946424 np0000004400 cinder-backup[101319]: DEBUG cinder.service [None req-5f770af2-e09b-483c-8da6-1399998bb49b None None] keystone_authtoken.service_type = None {{(pid=101319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 09:34:10.946534 np0000004400 cinder-backup[101319]: DEBUG cinder.service [None req-5f770af2-e09b-483c-8da6-1399998bb49b None None] keystone_authtoken.token_cache_time = 300 {{(pid=101319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 09:34:10.946642 np0000004400 cinder-backup[101319]: DEBUG cinder.service [None req-5f770af2-e09b-483c-8da6-1399998bb49b None None] keystone_authtoken.www_authenticate_uri = https://10.4.3.95/identity {{(pid=101319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 09:34:10.946764 np0000004400 cinder-backup[101319]: DEBUG cinder.service [None req-5f770af2-e09b-483c-8da6-1399998bb49b None None] cache.backend = dogpile.cache.null {{(pid=101319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 09:34:10.946867 np0000004400 cinder-backup[101319]: DEBUG cinder.service [None req-5f770af2-e09b-483c-8da6-1399998bb49b None None] cache.backend_argument = **** {{(pid=101319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 09:34:10.946964 np0000004400 cinder-backup[101319]: DEBUG cinder.service [None req-5f770af2-e09b-483c-8da6-1399998bb49b None None] cache.backend_expiration_time = None {{(pid=101319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 09:34:10.947079 np0000004400 cinder-backup[101319]: DEBUG cinder.service [None req-5f770af2-e09b-483c-8da6-1399998bb49b None None] cache.config_prefix = cache.oslo {{(pid=101319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 09:34:10.947179 np0000004400 cinder-backup[101319]: DEBUG cinder.service [None req-5f770af2-e09b-483c-8da6-1399998bb49b None None] cache.debug_cache_backend = False {{(pid=101319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 09:34:10.947294 np0000004400 cinder-backup[101319]: DEBUG cinder.service [None req-5f770af2-e09b-483c-8da6-1399998bb49b None None] cache.enable_retry_client = False {{(pid=101319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 09:34:10.947397 np0000004400 cinder-backup[101319]: DEBUG cinder.service [None req-5f770af2-e09b-483c-8da6-1399998bb49b None None] cache.enable_socket_keepalive = False {{(pid=101319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 09:34:10.947522 np0000004400 cinder-backup[101319]: DEBUG cinder.service [None req-5f770af2-e09b-483c-8da6-1399998bb49b None None] cache.enabled = False {{(pid=101319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 09:34:10.947625 np0000004400 cinder-backup[101319]: DEBUG cinder.service [None req-5f770af2-e09b-483c-8da6-1399998bb49b None None] cache.expiration_time = 600 {{(pid=101319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 09:34:10.947736 np0000004400 cinder-backup[101319]: DEBUG cinder.service [None req-5f770af2-e09b-483c-8da6-1399998bb49b None None] cache.hashclient_dead_timeout = 60.0 {{(pid=101319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 09:34:10.947836 np0000004400 cinder-backup[101319]: DEBUG cinder.service [None req-5f770af2-e09b-483c-8da6-1399998bb49b None None] cache.hashclient_retry_attempts = 2 {{(pid=101319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 09:34:10.947937 np0000004400 cinder-backup[101319]: DEBUG cinder.service [None req-5f770af2-e09b-483c-8da6-1399998bb49b None None] cache.hashclient_retry_timeout = 1.0 {{(pid=101319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 09:34:10.948051 np0000004400 cinder-backup[101319]: DEBUG cinder.service [None req-5f770af2-e09b-483c-8da6-1399998bb49b None None] cache.memcache_dead_retry = 300 {{(pid=101319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 09:34:10.948152 np0000004400 cinder-backup[101319]: DEBUG cinder.service [None req-5f770af2-e09b-483c-8da6-1399998bb49b None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=101319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 09:34:10.948249 np0000004400 cinder-backup[101319]: DEBUG cinder.service [None req-5f770af2-e09b-483c-8da6-1399998bb49b None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=101319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 09:34:10.948364 np0000004400 cinder-backup[101319]: DEBUG cinder.service [None req-5f770af2-e09b-483c-8da6-1399998bb49b None None] cache.memcache_pool_maxsize = 10 {{(pid=101319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 09:34:10.948485 np0000004400 cinder-backup[101319]: DEBUG cinder.service [None req-5f770af2-e09b-483c-8da6-1399998bb49b None None] cache.memcache_pool_unused_timeout = 60 {{(pid=101319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 09:34:10.948583 np0000004400 cinder-backup[101319]: DEBUG cinder.service [None req-5f770af2-e09b-483c-8da6-1399998bb49b None None] cache.memcache_sasl_enabled = False {{(pid=101319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 09:34:10.948690 np0000004400 cinder-backup[101319]: DEBUG cinder.service [None req-5f770af2-e09b-483c-8da6-1399998bb49b None None] cache.memcache_servers = ['localhost:11211'] {{(pid=101319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 09:34:10.948793 np0000004400 cinder-backup[101319]: DEBUG cinder.service [None req-5f770af2-e09b-483c-8da6-1399998bb49b None None] cache.password = **** {{(pid=101319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 09:34:10.948891 np0000004400 cinder-backup[101319]: DEBUG cinder.service [None req-5f770af2-e09b-483c-8da6-1399998bb49b None None] cache.proxies = [] {{(pid=101319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 09:34:10.948989 np0000004400 cinder-backup[101319]: DEBUG cinder.service [None req-5f770af2-e09b-483c-8da6-1399998bb49b None None] cache.redis_db = 0 {{(pid=101319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 09:34:10.949107 np0000004400 cinder-backup[101319]: DEBUG cinder.service [None req-5f770af2-e09b-483c-8da6-1399998bb49b None None] cache.redis_sentinel_service_name = mymaster {{(pid=101319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 09:34:10.949208 np0000004400 cinder-backup[101319]: DEBUG cinder.service [None req-5f770af2-e09b-483c-8da6-1399998bb49b None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=101319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 09:34:10.949328 np0000004400 cinder-backup[101319]: DEBUG cinder.service [None req-5f770af2-e09b-483c-8da6-1399998bb49b None None] cache.redis_server = localhost:6379 {{(pid=101319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 09:34:10.949449 np0000004400 cinder-backup[101319]: DEBUG cinder.service [None req-5f770af2-e09b-483c-8da6-1399998bb49b None None] cache.retry_attempts = 2 {{(pid=101319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 09:34:10.949550 np0000004400 cinder-backup[101319]: DEBUG cinder.service [None req-5f770af2-e09b-483c-8da6-1399998bb49b None None] cache.retry_delay = 0.0 {{(pid=101319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 09:34:10.949647 np0000004400 cinder-backup[101319]: DEBUG cinder.service [None req-5f770af2-e09b-483c-8da6-1399998bb49b None None] cache.socket_keepalive_count = 1 {{(pid=101319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 09:34:10.949745 np0000004400 cinder-backup[101319]: DEBUG cinder.service [None req-5f770af2-e09b-483c-8da6-1399998bb49b None None] cache.socket_keepalive_idle = 1 {{(pid=101319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 09:34:10.949841 np0000004400 cinder-backup[101319]: DEBUG cinder.service [None req-5f770af2-e09b-483c-8da6-1399998bb49b None None] cache.socket_keepalive_interval = 1 {{(pid=101319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 09:34:10.949949 np0000004400 cinder-backup[101319]: DEBUG cinder.service [None req-5f770af2-e09b-483c-8da6-1399998bb49b None None] cache.socket_timeout = 1.0 {{(pid=101319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 09:34:10.950061 np0000004400 cinder-backup[101319]: DEBUG cinder.service [None req-5f770af2-e09b-483c-8da6-1399998bb49b None None] cache.tls_allowed_ciphers = None {{(pid=101319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 09:34:10.950161 np0000004400 cinder-backup[101319]: DEBUG cinder.service [None req-5f770af2-e09b-483c-8da6-1399998bb49b None None] cache.tls_cafile = None {{(pid=101319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 09:34:10.950258 np0000004400 cinder-backup[101319]: DEBUG cinder.service [None req-5f770af2-e09b-483c-8da6-1399998bb49b None None] cache.tls_certfile = None {{(pid=101319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 09:34:10.950374 np0000004400 cinder-backup[101319]: DEBUG cinder.service [None req-5f770af2-e09b-483c-8da6-1399998bb49b None None] cache.tls_enabled = False {{(pid=101319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 09:34:10.950503 np0000004400 cinder-backup[101319]: DEBUG cinder.service [None req-5f770af2-e09b-483c-8da6-1399998bb49b None None] cache.tls_keyfile = None {{(pid=101319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 09:34:10.950600 np0000004400 cinder-backup[101319]: DEBUG cinder.service [None req-5f770af2-e09b-483c-8da6-1399998bb49b None None] cache.username = None {{(pid=101319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 09:34:10.950715 np0000004400 cinder-backup[101319]: DEBUG cinder.service [None req-5f770af2-e09b-483c-8da6-1399998bb49b None None] coordination.backend_url = **** {{(pid=101319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 09:34:10.950818 np0000004400 cinder-backup[101319]: DEBUG cinder.service [None req-5f770af2-e09b-483c-8da6-1399998bb49b None None] database.asyncio_connection = **** {{(pid=101319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 09:34:10.950917 np0000004400 cinder-backup[101319]: DEBUG cinder.service [None req-5f770af2-e09b-483c-8da6-1399998bb49b None None] database.asyncio_slave_connection = **** {{(pid=101319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 09:34:10.951031 np0000004400 cinder-backup[101319]: DEBUG cinder.service [None req-5f770af2-e09b-483c-8da6-1399998bb49b None None] database.backend = sqlalchemy {{(pid=101319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 09:34:10.951140 np0000004400 cinder-backup[101319]: DEBUG cinder.service [None req-5f770af2-e09b-483c-8da6-1399998bb49b None None] database.connection = **** {{(pid=101319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 09:34:10.951237 np0000004400 cinder-backup[101319]: DEBUG cinder.service [None req-5f770af2-e09b-483c-8da6-1399998bb49b None None] database.connection_debug = 0 {{(pid=101319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 09:34:10.951361 np0000004400 cinder-backup[101319]: DEBUG cinder.service [None req-5f770af2-e09b-483c-8da6-1399998bb49b None None] database.connection_parameters = {{(pid=101319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 09:34:10.951484 np0000004400 cinder-backup[101319]: DEBUG cinder.service [None req-5f770af2-e09b-483c-8da6-1399998bb49b None None] database.connection_recycle_time = 3600 {{(pid=101319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 09:34:10.951587 np0000004400 cinder-backup[101319]: DEBUG cinder.service [None req-5f770af2-e09b-483c-8da6-1399998bb49b None None] database.connection_trace = False {{(pid=101319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 09:34:10.951679 np0000004400 cinder-backup[101319]: DEBUG cinder.service [None req-5f770af2-e09b-483c-8da6-1399998bb49b None None] database.db_inc_retry_interval = True {{(pid=101319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 09:34:10.951777 np0000004400 cinder-backup[101319]: DEBUG cinder.service [None req-5f770af2-e09b-483c-8da6-1399998bb49b None None] database.db_max_retries = 20 {{(pid=101319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 09:34:10.951874 np0000004400 cinder-backup[101319]: DEBUG cinder.service [None req-5f770af2-e09b-483c-8da6-1399998bb49b None None] database.db_max_retry_interval = 10 {{(pid=101319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 09:34:10.952976 np0000004400 cinder-backup[101319]: DEBUG cinder.service [None req-5f770af2-e09b-483c-8da6-1399998bb49b None None] database.db_retry_interval = 1 {{(pid=101319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 09:34:10.952976 np0000004400 cinder-backup[101319]: DEBUG cinder.service [None req-5f770af2-e09b-483c-8da6-1399998bb49b None None] database.max_overflow = 50 {{(pid=101319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 09:34:10.952976 np0000004400 cinder-backup[101319]: DEBUG cinder.service [None req-5f770af2-e09b-483c-8da6-1399998bb49b None None] database.max_pool_size = 5 {{(pid=101319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 09:34:10.952976 np0000004400 cinder-backup[101319]: DEBUG cinder.service [None req-5f770af2-e09b-483c-8da6-1399998bb49b None None] database.max_retries = 10 {{(pid=101319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 09:34:10.952976 np0000004400 cinder-backup[101319]: DEBUG cinder.service [None req-5f770af2-e09b-483c-8da6-1399998bb49b None None] database.mysql_sql_mode = TRADITIONAL {{(pid=101319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 09:34:10.952976 np0000004400 cinder-backup[101319]: DEBUG cinder.service [None req-5f770af2-e09b-483c-8da6-1399998bb49b None None] database.mysql_wsrep_sync_wait = None {{(pid=101319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 09:34:10.952976 np0000004400 cinder-backup[101319]: DEBUG cinder.service [None req-5f770af2-e09b-483c-8da6-1399998bb49b None None] database.pool_timeout = None {{(pid=101319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 09:34:10.953142 np0000004400 cinder-backup[101319]: DEBUG cinder.service [None req-5f770af2-e09b-483c-8da6-1399998bb49b None None] database.retry_interval = 10 {{(pid=101319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 09:34:10.953142 np0000004400 cinder-backup[101319]: DEBUG cinder.service [None req-5f770af2-e09b-483c-8da6-1399998bb49b None None] database.slave_connection = **** {{(pid=101319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 09:34:10.953142 np0000004400 cinder-backup[101319]: DEBUG cinder.service [None req-5f770af2-e09b-483c-8da6-1399998bb49b None None] database.sqlite_synchronous = True {{(pid=101319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 09:34:10.953142 np0000004400 cinder-backup[101319]: DEBUG cinder.service [None req-5f770af2-e09b-483c-8da6-1399998bb49b None None] database.synchronous_reader = True {{(pid=101319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 09:34:10.953142 np0000004400 cinder-backup[101319]: DEBUG cinder.service [None req-5f770af2-e09b-483c-8da6-1399998bb49b None None] database.use_db_reconnect = False {{(pid=101319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 09:34:10.953142 np0000004400 cinder-backup[101319]: DEBUG cinder.service [None req-5f770af2-e09b-483c-8da6-1399998bb49b None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=101319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 09:34:10.953263 np0000004400 cinder-backup[101319]: DEBUG cinder.service [None req-5f770af2-e09b-483c-8da6-1399998bb49b None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=101319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 09:34:10.953327 np0000004400 cinder-backup[101319]: DEBUG cinder.service [None req-5f770af2-e09b-483c-8da6-1399998bb49b None None] oslo_messaging_metrics.metrics_process_name = {{(pid=101319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 09:34:10.953463 np0000004400 cinder-backup[101319]: DEBUG cinder.service [None req-5f770af2-e09b-483c-8da6-1399998bb49b None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=101319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 09:34:10.953573 np0000004400 cinder-backup[101319]: DEBUG cinder.service [None req-5f770af2-e09b-483c-8da6-1399998bb49b None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=101319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 09:34:10.953684 np0000004400 cinder-backup[101319]: DEBUG cinder.service [None req-5f770af2-e09b-483c-8da6-1399998bb49b None None] profiler.connection_string = messaging:// {{(pid=101319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 09:34:10.953781 np0000004400 cinder-backup[101319]: DEBUG cinder.service [None req-5f770af2-e09b-483c-8da6-1399998bb49b None None] profiler.enabled = False {{(pid=101319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 09:34:10.953882 np0000004400 cinder-backup[101319]: DEBUG cinder.service [None req-5f770af2-e09b-483c-8da6-1399998bb49b None None] profiler.es_doc_type = notification {{(pid=101319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 09:34:10.953984 np0000004400 cinder-backup[101319]: DEBUG cinder.service [None req-5f770af2-e09b-483c-8da6-1399998bb49b None None] profiler.es_scroll_size = 10000 {{(pid=101319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 09:34:10.954097 np0000004400 cinder-backup[101319]: DEBUG cinder.service [None req-5f770af2-e09b-483c-8da6-1399998bb49b None None] profiler.es_scroll_time = 2m {{(pid=101319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 09:34:10.954195 np0000004400 cinder-backup[101319]: DEBUG cinder.service [None req-5f770af2-e09b-483c-8da6-1399998bb49b None None] profiler.filter_error_trace = False {{(pid=101319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 09:34:10.954297 np0000004400 cinder-backup[101319]: DEBUG cinder.service [None req-5f770af2-e09b-483c-8da6-1399998bb49b None None] profiler.hmac_keys = **** {{(pid=101319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 09:34:10.954430 np0000004400 cinder-backup[101319]: DEBUG cinder.service [None req-5f770af2-e09b-483c-8da6-1399998bb49b None None] profiler.sentinel_service_name = mymaster {{(pid=101319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 09:34:10.954542 np0000004400 cinder-backup[101319]: DEBUG cinder.service [None req-5f770af2-e09b-483c-8da6-1399998bb49b None None] profiler.socket_timeout = 0.1 {{(pid=101319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 09:34:10.954641 np0000004400 cinder-backup[101319]: DEBUG cinder.service [None req-5f770af2-e09b-483c-8da6-1399998bb49b None None] profiler.trace_requests = False {{(pid=101319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 09:34:10.954738 np0000004400 cinder-backup[101319]: DEBUG cinder.service [None req-5f770af2-e09b-483c-8da6-1399998bb49b None None] profiler.trace_sqlalchemy = False {{(pid=101319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 09:34:10.954849 np0000004400 cinder-backup[101319]: DEBUG cinder.service [None req-5f770af2-e09b-483c-8da6-1399998bb49b None None] profiler_jaeger.process_tags = {} {{(pid=101319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 09:34:10.954945 np0000004400 cinder-backup[101319]: DEBUG cinder.service [None req-5f770af2-e09b-483c-8da6-1399998bb49b None None] profiler_jaeger.service_name_prefix = None {{(pid=101319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 09:34:10.955053 np0000004400 cinder-backup[101319]: DEBUG cinder.service [None req-5f770af2-e09b-483c-8da6-1399998bb49b None None] profiler_otlp.service_name_prefix = None {{(pid=101319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 09:34:10.955168 np0000004400 cinder-backup[101319]: DEBUG cinder.service [None req-5f770af2-e09b-483c-8da6-1399998bb49b None None] oslo_policy.enforce_new_defaults = True {{(pid=101319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 09:34:10.955269 np0000004400 cinder-backup[101319]: DEBUG cinder.service [None req-5f770af2-e09b-483c-8da6-1399998bb49b None None] oslo_policy.enforce_scope = False {{(pid=101319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 09:34:10.955376 np0000004400 cinder-backup[101319]: DEBUG cinder.service [None req-5f770af2-e09b-483c-8da6-1399998bb49b None None] oslo_policy.policy_default_rule = default {{(pid=101319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 09:34:10.955520 np0000004400 cinder-backup[101319]: DEBUG cinder.service [None req-5f770af2-e09b-483c-8da6-1399998bb49b None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=101319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 09:34:10.955625 np0000004400 cinder-backup[101319]: DEBUG cinder.service [None req-5f770af2-e09b-483c-8da6-1399998bb49b None None] oslo_policy.policy_file = policy.yaml {{(pid=101319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 09:34:10.955729 np0000004400 cinder-backup[101319]: DEBUG cinder.service [None req-5f770af2-e09b-483c-8da6-1399998bb49b None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=101319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 09:34:10.955827 np0000004400 cinder-backup[101319]: DEBUG cinder.service [None req-5f770af2-e09b-483c-8da6-1399998bb49b None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=101319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 09:34:10.955924 np0000004400 cinder-backup[101319]: DEBUG cinder.service [None req-5f770af2-e09b-483c-8da6-1399998bb49b None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=101319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 09:34:10.956029 np0000004400 cinder-backup[101319]: DEBUG cinder.service [None req-5f770af2-e09b-483c-8da6-1399998bb49b None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=101319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 09:34:10.956129 np0000004400 cinder-backup[101319]: DEBUG cinder.service [None req-5f770af2-e09b-483c-8da6-1399998bb49b None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=101319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 09:34:10.956229 np0000004400 cinder-backup[101319]: DEBUG cinder.service [None req-5f770af2-e09b-483c-8da6-1399998bb49b None None] oslo_policy.remote_timeout = 60.0 {{(pid=101319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 09:34:10.956335 np0000004400 cinder-backup[101319]: DEBUG cinder.service [None req-5f770af2-e09b-483c-8da6-1399998bb49b None None] privsep_osbrick.capabilities = [21, 2] {{(pid=101319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 09:34:10.956468 np0000004400 cinder-backup[101319]: DEBUG cinder.service [None req-5f770af2-e09b-483c-8da6-1399998bb49b None None] privsep_osbrick.group = None {{(pid=101319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 09:34:10.956574 np0000004400 cinder-backup[101319]: DEBUG cinder.service [None req-5f770af2-e09b-483c-8da6-1399998bb49b None None] privsep_osbrick.helper_command = None {{(pid=101319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 09:34:10.956674 np0000004400 cinder-backup[101319]: DEBUG cinder.service [None req-5f770af2-e09b-483c-8da6-1399998bb49b None None] privsep_osbrick.log_daemon_traceback = False {{(pid=101319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 09:34:10.956779 np0000004400 cinder-backup[101319]: DEBUG cinder.service [None req-5f770af2-e09b-483c-8da6-1399998bb49b None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=101319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 09:34:10.956874 np0000004400 cinder-backup[101319]: DEBUG cinder.service [None req-5f770af2-e09b-483c-8da6-1399998bb49b None None] privsep_osbrick.thread_pool_size = 16 {{(pid=101319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 09:34:10.956972 np0000004400 cinder-backup[101319]: DEBUG cinder.service [None req-5f770af2-e09b-483c-8da6-1399998bb49b None None] privsep_osbrick.user = None {{(pid=101319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 09:34:10.957085 np0000004400 cinder-backup[101319]: DEBUG cinder.service [None req-5f770af2-e09b-483c-8da6-1399998bb49b None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=101319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 09:34:10.957182 np0000004400 cinder-backup[101319]: DEBUG cinder.service [None req-5f770af2-e09b-483c-8da6-1399998bb49b None None] cinder_sys_admin.group = None {{(pid=101319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 09:34:10.957276 np0000004400 cinder-backup[101319]: DEBUG cinder.service [None req-5f770af2-e09b-483c-8da6-1399998bb49b None None] cinder_sys_admin.helper_command = None {{(pid=101319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 09:34:10.957377 np0000004400 cinder-backup[101319]: DEBUG cinder.service [None req-5f770af2-e09b-483c-8da6-1399998bb49b None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=101319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 09:34:10.957508 np0000004400 cinder-backup[101319]: DEBUG cinder.service [None req-5f770af2-e09b-483c-8da6-1399998bb49b None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=101319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 09:34:10.957609 np0000004400 cinder-backup[101319]: DEBUG cinder.service [None req-5f770af2-e09b-483c-8da6-1399998bb49b None None] cinder_sys_admin.thread_pool_size = 16 {{(pid=101319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 09:34:10.957706 np0000004400 cinder-backup[101319]: DEBUG cinder.service [None req-5f770af2-e09b-483c-8da6-1399998bb49b None None] cinder_sys_admin.user = None {{(pid=101319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 09:34:10.957808 np0000004400 cinder-backup[101319]: DEBUG cinder.service [None req-5f770af2-e09b-483c-8da6-1399998bb49b None None] service_user.auth_section = None {{(pid=101319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 09:34:10.957913 np0000004400 cinder-backup[101319]: DEBUG cinder.service [None req-5f770af2-e09b-483c-8da6-1399998bb49b None None] service_user.auth_type = password {{(pid=101319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 09:34:10.958023 np0000004400 cinder-backup[101319]: DEBUG cinder.service [None req-5f770af2-e09b-483c-8da6-1399998bb49b None None] service_user.cafile = None {{(pid=101319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 09:34:10.958124 np0000004400 cinder-backup[101319]: DEBUG cinder.service [None req-5f770af2-e09b-483c-8da6-1399998bb49b None None] service_user.certfile = None {{(pid=101319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 09:34:10.958225 np0000004400 cinder-backup[101319]: DEBUG cinder.service [None req-5f770af2-e09b-483c-8da6-1399998bb49b None None] service_user.collect_timing = False {{(pid=101319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 09:34:10.958321 np0000004400 cinder-backup[101319]: DEBUG cinder.service [None req-5f770af2-e09b-483c-8da6-1399998bb49b None None] service_user.insecure = False {{(pid=101319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 09:34:10.958435 np0000004400 cinder-backup[101319]: DEBUG cinder.service [None req-5f770af2-e09b-483c-8da6-1399998bb49b None None] service_user.keyfile = None {{(pid=101319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 09:34:10.958557 np0000004400 cinder-backup[101319]: DEBUG cinder.service [None req-5f770af2-e09b-483c-8da6-1399998bb49b None None] service_user.send_service_user_token = True {{(pid=101319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 09:34:10.958658 np0000004400 cinder-backup[101319]: DEBUG cinder.service [None req-5f770af2-e09b-483c-8da6-1399998bb49b None None] service_user.split_loggers = False {{(pid=101319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 09:34:10.958757 np0000004400 cinder-backup[101319]: DEBUG cinder.service [None req-5f770af2-e09b-483c-8da6-1399998bb49b None None] service_user.timeout = None {{(pid=101319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 09:34:10.958859 np0000004400 cinder-backup[101319]: DEBUG cinder.service [None req-5f770af2-e09b-483c-8da6-1399998bb49b None None] glance.auth_section = None {{(pid=101319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 09:34:10.958965 np0000004400 cinder-backup[101319]: DEBUG cinder.service [None req-5f770af2-e09b-483c-8da6-1399998bb49b None None] glance.auth_type = password {{(pid=101319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 09:34:10.959077 np0000004400 cinder-backup[101319]: DEBUG cinder.service [None req-5f770af2-e09b-483c-8da6-1399998bb49b None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=101319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 09:34:10.959172 np0000004400 cinder-backup[101319]: DEBUG cinder.service [None req-5f770af2-e09b-483c-8da6-1399998bb49b None None] glance.certfile = None {{(pid=101319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 09:34:10.959270 np0000004400 cinder-backup[101319]: DEBUG cinder.service [None req-5f770af2-e09b-483c-8da6-1399998bb49b None None] glance.collect_timing = False {{(pid=101319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 09:34:10.959366 np0000004400 cinder-backup[101319]: DEBUG cinder.service [None req-5f770af2-e09b-483c-8da6-1399998bb49b None None] glance.insecure = False {{(pid=101319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 09:34:10.959497 np0000004400 cinder-backup[101319]: DEBUG cinder.service [None req-5f770af2-e09b-483c-8da6-1399998bb49b None None] glance.keyfile = None {{(pid=101319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 09:34:10.959599 np0000004400 cinder-backup[101319]: DEBUG cinder.service [None req-5f770af2-e09b-483c-8da6-1399998bb49b None None] glance.region_name = None {{(pid=101319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 09:34:10.959699 np0000004400 cinder-backup[101319]: DEBUG cinder.service [None req-5f770af2-e09b-483c-8da6-1399998bb49b None None] glance.split_loggers = False {{(pid=101319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 09:34:10.959795 np0000004400 cinder-backup[101319]: DEBUG cinder.service [None req-5f770af2-e09b-483c-8da6-1399998bb49b None None] glance.timeout = None {{(pid=101319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 09:34:10.959902 np0000004400 cinder-backup[101319]: DEBUG cinder.service [None req-5f770af2-e09b-483c-8da6-1399998bb49b None None] backend_defaults.backend_availability_zone = None {{(pid=101319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 09:34:10.960006 np0000004400 cinder-backup[101319]: DEBUG cinder.service [None req-5f770af2-e09b-483c-8da6-1399998bb49b None None] backend_defaults.chap_password = **** {{(pid=101319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 09:34:10.960118 np0000004400 cinder-backup[101319]: DEBUG cinder.service [None req-5f770af2-e09b-483c-8da6-1399998bb49b None None] backend_defaults.chap_username = {{(pid=101319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 09:34:10.960220 np0000004400 cinder-backup[101319]: DEBUG cinder.service [None req-5f770af2-e09b-483c-8da6-1399998bb49b None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=101319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 09:34:10.960317 np0000004400 cinder-backup[101319]: DEBUG cinder.service [None req-5f770af2-e09b-483c-8da6-1399998bb49b None None] backend_defaults.disk_geometry = None {{(pid=101319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 09:34:10.960428 np0000004400 cinder-backup[101319]: DEBUG cinder.service [None req-5f770af2-e09b-483c-8da6-1399998bb49b None None] backend_defaults.driver_client_cert = None {{(pid=101319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 09:34:10.960545 np0000004400 cinder-backup[101319]: DEBUG cinder.service [None req-5f770af2-e09b-483c-8da6-1399998bb49b None None] backend_defaults.driver_client_cert_key = None {{(pid=101319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 09:34:10.960643 np0000004400 cinder-backup[101319]: DEBUG cinder.service [None req-5f770af2-e09b-483c-8da6-1399998bb49b None None] backend_defaults.driver_data_namespace = None {{(pid=101319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 09:34:10.960740 np0000004400 cinder-backup[101319]: DEBUG cinder.service [None req-5f770af2-e09b-483c-8da6-1399998bb49b None None] backend_defaults.driver_ssl_cert_path = None {{(pid=101319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 09:34:10.960837 np0000004400 cinder-backup[101319]: DEBUG cinder.service [None req-5f770af2-e09b-483c-8da6-1399998bb49b None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=101319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 09:34:10.960934 np0000004400 cinder-backup[101319]: DEBUG cinder.service [None req-5f770af2-e09b-483c-8da6-1399998bb49b None None] backend_defaults.driver_use_ssl = False {{(pid=101319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 09:34:10.961041 np0000004400 cinder-backup[101319]: DEBUG cinder.service [None req-5f770af2-e09b-483c-8da6-1399998bb49b None None] backend_defaults.enable_unsupported_driver = False {{(pid=101319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 09:34:10.961140 np0000004400 cinder-backup[101319]: DEBUG cinder.service [None req-5f770af2-e09b-483c-8da6-1399998bb49b None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=101319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 09:34:10.961237 np0000004400 cinder-backup[101319]: DEBUG cinder.service [None req-5f770af2-e09b-483c-8da6-1399998bb49b None None] backend_defaults.filter_function = None {{(pid=101319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 09:34:10.961332 np0000004400 cinder-backup[101319]: DEBUG cinder.service [None req-5f770af2-e09b-483c-8da6-1399998bb49b None None] backend_defaults.goodness_function = None {{(pid=101319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 09:34:10.961448 np0000004400 cinder-backup[101319]: DEBUG cinder.service [None req-5f770af2-e09b-483c-8da6-1399998bb49b None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=101319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 09:34:10.961565 np0000004400 cinder-backup[101319]: DEBUG cinder.service [None req-5f770af2-e09b-483c-8da6-1399998bb49b None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=101319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 09:34:10.961664 np0000004400 cinder-backup[101319]: DEBUG cinder.service [None req-5f770af2-e09b-483c-8da6-1399998bb49b None None] backend_defaults.image_volume_cache_enabled = False {{(pid=101319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 09:34:10.961763 np0000004400 cinder-backup[101319]: DEBUG cinder.service [None req-5f770af2-e09b-483c-8da6-1399998bb49b None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=101319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 09:34:10.961859 np0000004400 cinder-backup[101319]: DEBUG cinder.service [None req-5f770af2-e09b-483c-8da6-1399998bb49b None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=101319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 09:34:10.961962 np0000004400 cinder-backup[101319]: DEBUG cinder.service [None req-5f770af2-e09b-483c-8da6-1399998bb49b None None] backend_defaults.iscsi_target_flags = {{(pid=101319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 09:34:10.962077 np0000004400 cinder-backup[101319]: DEBUG cinder.service [None req-5f770af2-e09b-483c-8da6-1399998bb49b None None] backend_defaults.iscsi_write_cache = on {{(pid=101319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 09:34:10.962181 np0000004400 cinder-backup[101319]: DEBUG cinder.service [None req-5f770af2-e09b-483c-8da6-1399998bb49b None None] backend_defaults.iser_helper = tgtadm {{(pid=101319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 09:34:10.962341 np0000004400 cinder-backup[101319]: DEBUG cinder.service [None req-5f770af2-e09b-483c-8da6-1399998bb49b None None] backend_defaults.iser_ip_address = 10.4.3.95 {{(pid=101319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 09:34:10.962465 np0000004400 cinder-backup[101319]: DEBUG cinder.service [None req-5f770af2-e09b-483c-8da6-1399998bb49b None None] backend_defaults.iser_port = 3260 {{(pid=101319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 09:34:10.962587 np0000004400 cinder-backup[101319]: DEBUG cinder.service [None req-5f770af2-e09b-483c-8da6-1399998bb49b None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=101319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 09:34:10.962694 np0000004400 cinder-backup[101319]: DEBUG cinder.service [None req-5f770af2-e09b-483c-8da6-1399998bb49b None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=101319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 09:34:10.962793 np0000004400 cinder-backup[101319]: DEBUG cinder.service [None req-5f770af2-e09b-483c-8da6-1399998bb49b None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=101319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 09:34:10.962892 np0000004400 cinder-backup[101319]: DEBUG cinder.service [None req-5f770af2-e09b-483c-8da6-1399998bb49b None None] backend_defaults.num_shell_tries = 3 {{(pid=101319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 09:34:10.962991 np0000004400 cinder-backup[101319]: DEBUG cinder.service [None req-5f770af2-e09b-483c-8da6-1399998bb49b None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=101319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 09:34:10.963100 np0000004400 cinder-backup[101319]: DEBUG cinder.service [None req-5f770af2-e09b-483c-8da6-1399998bb49b None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=101319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 09:34:10.963196 np0000004400 cinder-backup[101319]: DEBUG cinder.service [None req-5f770af2-e09b-483c-8da6-1399998bb49b None None] backend_defaults.nvmet_ns_id = 10 {{(pid=101319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 09:34:10.963295 np0000004400 cinder-backup[101319]: DEBUG cinder.service [None req-5f770af2-e09b-483c-8da6-1399998bb49b None None] backend_defaults.nvmet_port_id = 1 {{(pid=101319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 09:34:10.963394 np0000004400 cinder-backup[101319]: DEBUG cinder.service [None req-5f770af2-e09b-483c-8da6-1399998bb49b None None] backend_defaults.replication_device = **** {{(pid=101319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 09:34:10.963520 np0000004400 cinder-backup[101319]: DEBUG cinder.service [None req-5f770af2-e09b-483c-8da6-1399998bb49b None None] backend_defaults.report_discard_supported = False {{(pid=101319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 09:34:10.963630 np0000004400 cinder-backup[101319]: DEBUG cinder.service [None req-5f770af2-e09b-483c-8da6-1399998bb49b None None] backend_defaults.reserved_percentage = 0 {{(pid=101319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 09:34:10.963735 np0000004400 cinder-backup[101319]: DEBUG cinder.service [None req-5f770af2-e09b-483c-8da6-1399998bb49b None None] backend_defaults.scst_target_driver = iscsi {{(pid=101319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 09:34:10.963830 np0000004400 cinder-backup[101319]: DEBUG cinder.service [None req-5f770af2-e09b-483c-8da6-1399998bb49b None None] backend_defaults.scst_target_iqn_name = None {{(pid=101319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 09:34:10.963931 np0000004400 cinder-backup[101319]: DEBUG cinder.service [None req-5f770af2-e09b-483c-8da6-1399998bb49b None None] backend_defaults.storage_protocol = iSCSI {{(pid=101319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 09:34:10.964042 np0000004400 cinder-backup[101319]: DEBUG cinder.service [None req-5f770af2-e09b-483c-8da6-1399998bb49b None None] backend_defaults.target_helper = tgtadm {{(pid=101319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 09:34:10.964186 np0000004400 cinder-backup[101319]: DEBUG cinder.service [None req-5f770af2-e09b-483c-8da6-1399998bb49b None None] backend_defaults.target_ip_address = 10.4.3.95 {{(pid=101319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 09:34:10.964288 np0000004400 cinder-backup[101319]: DEBUG cinder.service [None req-5f770af2-e09b-483c-8da6-1399998bb49b None None] backend_defaults.target_port = 3260 {{(pid=101319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 09:34:10.964392 np0000004400 cinder-backup[101319]: DEBUG cinder.service [None req-5f770af2-e09b-483c-8da6-1399998bb49b None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=101319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 09:34:10.964517 np0000004400 cinder-backup[101319]: DEBUG cinder.service [None req-5f770af2-e09b-483c-8da6-1399998bb49b None None] backend_defaults.target_protocol = iscsi {{(pid=101319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 09:34:10.964637 np0000004400 cinder-backup[101319]: DEBUG cinder.service [None req-5f770af2-e09b-483c-8da6-1399998bb49b None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=101319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 09:34:10.964737 np0000004400 cinder-backup[101319]: DEBUG cinder.service [None req-5f770af2-e09b-483c-8da6-1399998bb49b None None] backend_defaults.trace_flags = None {{(pid=101319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 09:34:10.964834 np0000004400 cinder-backup[101319]: DEBUG cinder.service [None req-5f770af2-e09b-483c-8da6-1399998bb49b None None] backend_defaults.unique_fqdn_network = True {{(pid=101319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 09:34:10.964931 np0000004400 cinder-backup[101319]: DEBUG cinder.service [None req-5f770af2-e09b-483c-8da6-1399998bb49b None None] backend_defaults.use_chap_auth = False {{(pid=101319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 09:34:10.965037 np0000004400 cinder-backup[101319]: DEBUG cinder.service [None req-5f770af2-e09b-483c-8da6-1399998bb49b None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=101319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 09:34:10.965133 np0000004400 cinder-backup[101319]: DEBUG cinder.service [None req-5f770af2-e09b-483c-8da6-1399998bb49b None None] backend_defaults.volume_backend_name = None {{(pid=101319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 09:34:10.965236 np0000004400 cinder-backup[101319]: DEBUG cinder.service [None req-5f770af2-e09b-483c-8da6-1399998bb49b None None] backend_defaults.volume_clear = zero {{(pid=101319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 09:34:10.965332 np0000004400 cinder-backup[101319]: DEBUG cinder.service [None req-5f770af2-e09b-483c-8da6-1399998bb49b None None] backend_defaults.volume_clear_ionice = None {{(pid=101319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 09:34:10.965449 np0000004400 cinder-backup[101319]: DEBUG cinder.service [None req-5f770af2-e09b-483c-8da6-1399998bb49b None None] backend_defaults.volume_clear_size = 0 {{(pid=101319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 09:34:10.965567 np0000004400 cinder-backup[101319]: DEBUG cinder.service [None req-5f770af2-e09b-483c-8da6-1399998bb49b None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=101319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 09:34:10.965675 np0000004400 cinder-backup[101319]: DEBUG cinder.service [None req-5f770af2-e09b-483c-8da6-1399998bb49b None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=101319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 09:34:10.965776 np0000004400 cinder-backup[101319]: DEBUG cinder.service [None req-5f770af2-e09b-483c-8da6-1399998bb49b None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=101319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 09:34:10.965905 np0000004400 cinder-backup[101319]: DEBUG cinder.service [None req-5f770af2-e09b-483c-8da6-1399998bb49b None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=101319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 09:34:10.966016 np0000004400 cinder-backup[101319]: DEBUG cinder.service [None req-5f770af2-e09b-483c-8da6-1399998bb49b None None] oslo_reports.file_event_handler = None {{(pid=101319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 09:34:10.966121 np0000004400 cinder-backup[101319]: DEBUG cinder.service [None req-5f770af2-e09b-483c-8da6-1399998bb49b None None] oslo_reports.file_event_handler_interval = 1 {{(pid=101319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 09:34:10.966218 np0000004400 cinder-backup[101319]: DEBUG cinder.service [None req-5f770af2-e09b-483c-8da6-1399998bb49b None None] oslo_reports.log_dir = None {{(pid=101319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 09:34:10.966323 np0000004400 cinder-backup[101319]: DEBUG cinder.service [None req-5f770af2-e09b-483c-8da6-1399998bb49b None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=101319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 09:34:10.966440 np0000004400 cinder-backup[101319]: DEBUG cinder.service [None req-5f770af2-e09b-483c-8da6-1399998bb49b None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=101319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 09:34:10.966543 np0000004400 cinder-backup[101319]: DEBUG cinder.service [None req-5f770af2-e09b-483c-8da6-1399998bb49b None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=101319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 09:34:10.966657 np0000004400 cinder-backup[101319]: DEBUG cinder.service [None req-5f770af2-e09b-483c-8da6-1399998bb49b None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=101319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 09:34:10.966759 np0000004400 cinder-backup[101319]: DEBUG cinder.service [None req-5f770af2-e09b-483c-8da6-1399998bb49b None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=101319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 09:34:10.966855 np0000004400 cinder-backup[101319]: DEBUG cinder.service [None req-5f770af2-e09b-483c-8da6-1399998bb49b None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=101319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 09:34:10.966953 np0000004400 cinder-backup[101319]: DEBUG cinder.service [None req-5f770af2-e09b-483c-8da6-1399998bb49b None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=101319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 09:34:10.967063 np0000004400 cinder-backup[101319]: DEBUG cinder.service [None req-5f770af2-e09b-483c-8da6-1399998bb49b None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=101319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 09:34:10.967167 np0000004400 cinder-backup[101319]: DEBUG cinder.service [None req-5f770af2-e09b-483c-8da6-1399998bb49b None None] oslo_messaging_rabbit.hostname = np0000004400 {{(pid=101319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 09:34:10.967301 np0000004400 cinder-backup[101319]: DEBUG cinder.service [None req-5f770af2-e09b-483c-8da6-1399998bb49b None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=101319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 09:34:10.967432 np0000004400 cinder-backup[101319]: DEBUG cinder.service [None req-5f770af2-e09b-483c-8da6-1399998bb49b None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=101319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 09:34:10.967538 np0000004400 cinder-backup[101319]: DEBUG cinder.service [None req-5f770af2-e09b-483c-8da6-1399998bb49b None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=101319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 09:34:10.967655 np0000004400 cinder-backup[101319]: DEBUG cinder.service [None req-5f770af2-e09b-483c-8da6-1399998bb49b None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=101319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 09:34:10.967767 np0000004400 cinder-backup[101319]: DEBUG cinder.service [None req-5f770af2-e09b-483c-8da6-1399998bb49b None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=101319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 09:34:10.967916 np0000004400 cinder-backup[101319]: DEBUG cinder.service [None req-5f770af2-e09b-483c-8da6-1399998bb49b None None] oslo_messaging_rabbit.processname = cinder-backup {{(pid=101319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 09:34:10.968032 np0000004400 cinder-backup[101319]: DEBUG cinder.service [None req-5f770af2-e09b-483c-8da6-1399998bb49b None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=101319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 09:34:10.968132 np0000004400 cinder-backup[101319]: DEBUG cinder.service [None req-5f770af2-e09b-483c-8da6-1399998bb49b None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=101319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 09:34:10.968234 np0000004400 cinder-backup[101319]: DEBUG cinder.service [None req-5f770af2-e09b-483c-8da6-1399998bb49b None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=101319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 09:34:10.968332 np0000004400 cinder-backup[101319]: DEBUG cinder.service [None req-5f770af2-e09b-483c-8da6-1399998bb49b None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=101319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 09:34:10.968448 np0000004400 cinder-backup[101319]: DEBUG cinder.service [None req-5f770af2-e09b-483c-8da6-1399998bb49b None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=101319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 09:34:10.968550 np0000004400 cinder-backup[101319]: DEBUG cinder.service [None req-5f770af2-e09b-483c-8da6-1399998bb49b None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=101319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 09:34:10.968665 np0000004400 cinder-backup[101319]: DEBUG cinder.service [None req-5f770af2-e09b-483c-8da6-1399998bb49b None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=101319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 09:34:10.968766 np0000004400 cinder-backup[101319]: DEBUG cinder.service [None req-5f770af2-e09b-483c-8da6-1399998bb49b None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=101319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 09:34:10.968862 np0000004400 cinder-backup[101319]: DEBUG cinder.service [None req-5f770af2-e09b-483c-8da6-1399998bb49b None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=101319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 09:34:10.968958 np0000004400 cinder-backup[101319]: DEBUG cinder.service [None req-5f770af2-e09b-483c-8da6-1399998bb49b None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=101319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 09:34:10.969065 np0000004400 cinder-backup[101319]: DEBUG cinder.service [None req-5f770af2-e09b-483c-8da6-1399998bb49b None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=101319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 09:34:10.969164 np0000004400 cinder-backup[101319]: DEBUG cinder.service [None req-5f770af2-e09b-483c-8da6-1399998bb49b None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=101319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 09:34:10.969260 np0000004400 cinder-backup[101319]: DEBUG cinder.service [None req-5f770af2-e09b-483c-8da6-1399998bb49b None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=101319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 09:34:10.969358 np0000004400 cinder-backup[101319]: DEBUG cinder.service [None req-5f770af2-e09b-483c-8da6-1399998bb49b None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=101319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 09:34:10.969480 np0000004400 cinder-backup[101319]: DEBUG cinder.service [None req-5f770af2-e09b-483c-8da6-1399998bb49b None None] oslo_messaging_rabbit.ssl = False {{(pid=101319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 09:34:10.969587 np0000004400 cinder-backup[101319]: DEBUG cinder.service [None req-5f770af2-e09b-483c-8da6-1399998bb49b None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=101319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 09:34:10.969709 np0000004400 cinder-backup[101319]: DEBUG cinder.service [None req-5f770af2-e09b-483c-8da6-1399998bb49b None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=101319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 09:34:10.969808 np0000004400 cinder-backup[101319]: DEBUG cinder.service [None req-5f770af2-e09b-483c-8da6-1399998bb49b None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=101319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 09:34:10.969905 np0000004400 cinder-backup[101319]: DEBUG cinder.service [None req-5f770af2-e09b-483c-8da6-1399998bb49b None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=101319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 09:34:10.970016 np0000004400 cinder-backup[101319]: DEBUG cinder.service [None req-5f770af2-e09b-483c-8da6-1399998bb49b None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=101319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 09:34:10.970121 np0000004400 cinder-backup[101319]: DEBUG cinder.service [None req-5f770af2-e09b-483c-8da6-1399998bb49b None None] oslo_messaging_rabbit.ssl_version = {{(pid=101319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 09:34:10.970218 np0000004400 cinder-backup[101319]: DEBUG cinder.service [None req-5f770af2-e09b-483c-8da6-1399998bb49b None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=101319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 09:34:10.970326 np0000004400 cinder-backup[101319]: DEBUG cinder.service [None req-5f770af2-e09b-483c-8da6-1399998bb49b None None] oslo_messaging_notifications.driver = [] {{(pid=101319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 09:34:10.970444 np0000004400 cinder-backup[101319]: DEBUG cinder.service [None req-5f770af2-e09b-483c-8da6-1399998bb49b None None] oslo_messaging_notifications.retry = -1 {{(pid=101319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 09:34:10.970556 np0000004400 cinder-backup[101319]: DEBUG cinder.service [None req-5f770af2-e09b-483c-8da6-1399998bb49b None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=101319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 09:34:10.970669 np0000004400 cinder-backup[101319]: DEBUG cinder.service [None req-5f770af2-e09b-483c-8da6-1399998bb49b None None] oslo_messaging_notifications.transport_url = **** {{(pid=101319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 09:34:10.970785 np0000004400 cinder-backup[101319]: DEBUG cinder.service [None req-5f770af2-e09b-483c-8da6-1399998bb49b None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=101319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 09:34:10.970987 np0000004400 cinder-backup[101319]: DEBUG cinder.service [None req-5f770af2-e09b-483c-8da6-1399998bb49b None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=101319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 09:34:10.971101 np0000004400 cinder-backup[101319]: DEBUG cinder.service [None req-5f770af2-e09b-483c-8da6-1399998bb49b None None] barbican.barbican_api_version = None {{(pid=101319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 09:34:10.971203 np0000004400 cinder-backup[101319]: DEBUG cinder.service [None req-5f770af2-e09b-483c-8da6-1399998bb49b None None] barbican.barbican_endpoint = None {{(pid=101319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 09:34:10.971311 np0000004400 cinder-backup[101319]: DEBUG cinder.service [None req-5f770af2-e09b-483c-8da6-1399998bb49b None None] barbican.barbican_endpoint_type = public {{(pid=101319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 09:34:10.971422 np0000004400 cinder-backup[101319]: DEBUG cinder.service [None req-5f770af2-e09b-483c-8da6-1399998bb49b None None] barbican.barbican_region_name = None {{(pid=101319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 09:34:10.971528 np0000004400 cinder-backup[101319]: DEBUG cinder.service [None req-5f770af2-e09b-483c-8da6-1399998bb49b None None] barbican.cafile = None {{(pid=101319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 09:34:10.971626 np0000004400 cinder-backup[101319]: DEBUG cinder.service [None req-5f770af2-e09b-483c-8da6-1399998bb49b None None] barbican.certfile = None {{(pid=101319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 09:34:10.971743 np0000004400 cinder-backup[101319]: DEBUG cinder.service [None req-5f770af2-e09b-483c-8da6-1399998bb49b None None] barbican.collect_timing = False {{(pid=101319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 09:34:10.971868 np0000004400 cinder-backup[101319]: DEBUG cinder.service [None req-5f770af2-e09b-483c-8da6-1399998bb49b None None] barbican.insecure = False {{(pid=101319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 09:34:10.971968 np0000004400 cinder-backup[101319]: DEBUG cinder.service [None req-5f770af2-e09b-483c-8da6-1399998bb49b None None] barbican.keyfile = None {{(pid=101319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 09:34:10.972083 np0000004400 cinder-backup[101319]: DEBUG cinder.service [None req-5f770af2-e09b-483c-8da6-1399998bb49b None None] barbican.number_of_retries = 60 {{(pid=101319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 09:34:10.972180 np0000004400 cinder-backup[101319]: DEBUG cinder.service [None req-5f770af2-e09b-483c-8da6-1399998bb49b None None] barbican.retry_delay = 1 {{(pid=101319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 09:34:10.972278 np0000004400 cinder-backup[101319]: DEBUG cinder.service [None req-5f770af2-e09b-483c-8da6-1399998bb49b None None] barbican.send_service_user_token = False {{(pid=101319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 09:34:10.972377 np0000004400 cinder-backup[101319]: DEBUG cinder.service [None req-5f770af2-e09b-483c-8da6-1399998bb49b None None] barbican.split_loggers = False {{(pid=101319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 09:34:10.972497 np0000004400 cinder-backup[101319]: DEBUG cinder.service [None req-5f770af2-e09b-483c-8da6-1399998bb49b None None] barbican.timeout = None {{(pid=101319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 09:34:10.972596 np0000004400 cinder-backup[101319]: DEBUG cinder.service [None req-5f770af2-e09b-483c-8da6-1399998bb49b None None] barbican.verify_ssl = True {{(pid=101319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 09:34:10.972708 np0000004400 cinder-backup[101319]: DEBUG cinder.service [None req-5f770af2-e09b-483c-8da6-1399998bb49b None None] barbican.verify_ssl_path = None {{(pid=101319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 09:34:10.972812 np0000004400 cinder-backup[101319]: DEBUG cinder.service [None req-5f770af2-e09b-483c-8da6-1399998bb49b None None] barbican_service_user.auth_section = None {{(pid=101319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 09:34:10.972912 np0000004400 cinder-backup[101319]: DEBUG cinder.service [None req-5f770af2-e09b-483c-8da6-1399998bb49b None None] barbican_service_user.auth_type = None {{(pid=101319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 09:34:10.973016 np0000004400 cinder-backup[101319]: DEBUG cinder.service [None req-5f770af2-e09b-483c-8da6-1399998bb49b None None] barbican_service_user.cafile = None {{(pid=101319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 09:34:10.973117 np0000004400 cinder-backup[101319]: DEBUG cinder.service [None req-5f770af2-e09b-483c-8da6-1399998bb49b None None] barbican_service_user.certfile = None {{(pid=101319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 09:34:10.973216 np0000004400 cinder-backup[101319]: DEBUG cinder.service [None req-5f770af2-e09b-483c-8da6-1399998bb49b None None] barbican_service_user.collect_timing = False {{(pid=101319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 09:34:10.973315 np0000004400 cinder-backup[101319]: DEBUG cinder.service [None req-5f770af2-e09b-483c-8da6-1399998bb49b None None] barbican_service_user.insecure = False {{(pid=101319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 09:34:10.973428 np0000004400 cinder-backup[101319]: DEBUG cinder.service [None req-5f770af2-e09b-483c-8da6-1399998bb49b None None] barbican_service_user.keyfile = None {{(pid=101319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 09:34:10.973530 np0000004400 cinder-backup[101319]: DEBUG cinder.service [None req-5f770af2-e09b-483c-8da6-1399998bb49b None None] barbican_service_user.split_loggers = False {{(pid=101319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 09:34:10.973627 np0000004400 cinder-backup[101319]: DEBUG cinder.service [None req-5f770af2-e09b-483c-8da6-1399998bb49b None None] barbican_service_user.timeout = None {{(pid=101319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 09:34:10.973744 np0000004400 cinder-backup[101319]: DEBUG cinder.service [None req-5f770af2-e09b-483c-8da6-1399998bb49b None None] vault.approle_role_id = **** {{(pid=101319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 09:34:10.973846 np0000004400 cinder-backup[101319]: DEBUG cinder.service [None req-5f770af2-e09b-483c-8da6-1399998bb49b None None] vault.approle_secret_id = **** {{(pid=101319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 09:34:10.973949 np0000004400 cinder-backup[101319]: DEBUG cinder.service [None req-5f770af2-e09b-483c-8da6-1399998bb49b None None] vault.kv_mountpoint = secret {{(pid=101319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 09:34:10.974058 np0000004400 cinder-backup[101319]: DEBUG cinder.service [None req-5f770af2-e09b-483c-8da6-1399998bb49b None None] vault.kv_path = None {{(pid=101319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 09:34:10.974157 np0000004400 cinder-backup[101319]: DEBUG cinder.service [None req-5f770af2-e09b-483c-8da6-1399998bb49b None None] vault.kv_version = 2 {{(pid=101319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 09:34:10.974255 np0000004400 cinder-backup[101319]: DEBUG cinder.service [None req-5f770af2-e09b-483c-8da6-1399998bb49b None None] vault.namespace = None {{(pid=101319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 09:34:10.974351 np0000004400 cinder-backup[101319]: DEBUG cinder.service [None req-5f770af2-e09b-483c-8da6-1399998bb49b None None] vault.root_token_id = **** {{(pid=101319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 09:34:10.974468 np0000004400 cinder-backup[101319]: DEBUG cinder.service [None req-5f770af2-e09b-483c-8da6-1399998bb49b None None] vault.ssl_ca_crt_file = None {{(pid=101319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 09:34:10.974570 np0000004400 cinder-backup[101319]: DEBUG cinder.service [None req-5f770af2-e09b-483c-8da6-1399998bb49b None None] vault.timeout = 60.0 {{(pid=101319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 09:34:10.974669 np0000004400 cinder-backup[101319]: DEBUG cinder.service [None req-5f770af2-e09b-483c-8da6-1399998bb49b None None] vault.use_ssl = False {{(pid=101319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 09:34:10.974868 np0000004400 cinder-backup[101319]: DEBUG cinder.service [None req-5f770af2-e09b-483c-8da6-1399998bb49b None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=101319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 09:34:10.974953 np0000004400 cinder-backup[101319]: DEBUG cinder.service [None req-5f770af2-e09b-483c-8da6-1399998bb49b None None] ******************************************************************************** {{(pid=101319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3260}} Jul 03 09:34:10.975147 np0000004400 cinder-backup[101319]: DEBUG oslo_service.backend._eventlet.service [None req-5f770af2-e09b-483c-8da6-1399998bb49b None None] Full set of CONF: {{(pid=101319) _wait_for_exit_or_signal /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:275}} Jul 03 09:34:10.975229 np0000004400 cinder-backup[101319]: DEBUG oslo_service.backend._eventlet.service [None req-5f770af2-e09b-483c-8da6-1399998bb49b None None] ******************************************************************************** {{(pid=101319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3226}} Jul 03 09:34:10.975305 np0000004400 cinder-backup[101319]: DEBUG oslo_service.backend._eventlet.service [None req-5f770af2-e09b-483c-8da6-1399998bb49b None None] Configuration options gathered from: {{(pid=101319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3227}} Jul 03 09:34:10.975386 np0000004400 cinder-backup[101319]: DEBUG oslo_service.backend._eventlet.service [None req-5f770af2-e09b-483c-8da6-1399998bb49b None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=101319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3228}} Jul 03 09:34:10.975486 np0000004400 cinder-backup[101319]: DEBUG oslo_service.backend._eventlet.service [None req-5f770af2-e09b-483c-8da6-1399998bb49b None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=101319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3229}} Jul 03 09:34:10.975562 np0000004400 cinder-backup[101319]: DEBUG oslo_service.backend._eventlet.service [None req-5f770af2-e09b-483c-8da6-1399998bb49b None None] ================================================================================ {{(pid=101319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3234}} Jul 03 09:34:10.975674 np0000004400 cinder-backup[101319]: DEBUG oslo_service.backend._eventlet.service [None req-5f770af2-e09b-483c-8da6-1399998bb49b None None] allow_availability_zone_fallback = False {{(pid=101319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 09:34:10.975763 np0000004400 cinder-backup[101319]: DEBUG oslo_service.backend._eventlet.service [None req-5f770af2-e09b-483c-8da6-1399998bb49b None None] allow_compression_on_image_upload = False {{(pid=101319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 09:34:10.975842 np0000004400 cinder-backup[101319]: DEBUG oslo_service.backend._eventlet.service [None req-5f770af2-e09b-483c-8da6-1399998bb49b None None] allowed_direct_url_schemes = [] {{(pid=101319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 09:34:10.975915 np0000004400 cinder-backup[101319]: DEBUG oslo_service.backend._eventlet.service [None req-5f770af2-e09b-483c-8da6-1399998bb49b None None] api_rate_limit = True {{(pid=101319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 09:34:10.975992 np0000004400 cinder-backup[101319]: DEBUG oslo_service.backend._eventlet.service [None req-5f770af2-e09b-483c-8da6-1399998bb49b None None] auth_strategy = keystone {{(pid=101319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 09:34:10.976074 np0000004400 cinder-backup[101319]: DEBUG oslo_service.backend._eventlet.service [None req-5f770af2-e09b-483c-8da6-1399998bb49b None None] backdoor_port = None {{(pid=101319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 09:34:10.976148 np0000004400 cinder-backup[101319]: DEBUG oslo_service.backend._eventlet.service [None req-5f770af2-e09b-483c-8da6-1399998bb49b None None] backdoor_socket = None {{(pid=101319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 09:34:10.976221 np0000004400 cinder-backup[101319]: DEBUG oslo_service.backend._eventlet.service [None req-5f770af2-e09b-483c-8da6-1399998bb49b None None] backend_availability_zone = None {{(pid=101319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 09:34:10.976295 np0000004400 cinder-backup[101319]: DEBUG oslo_service.backend._eventlet.service [None req-5f770af2-e09b-483c-8da6-1399998bb49b None None] backup_api_class = cinder.backup.api.API {{(pid=101319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 09:34:10.976368 np0000004400 cinder-backup[101319]: DEBUG oslo_service.backend._eventlet.service [None req-5f770af2-e09b-483c-8da6-1399998bb49b None None] backup_compression_algorithm = zlib {{(pid=101319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 09:34:10.976485 np0000004400 cinder-backup[101319]: DEBUG oslo_service.backend._eventlet.service [None req-5f770af2-e09b-483c-8da6-1399998bb49b None None] backup_create_containers = True {{(pid=101319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 09:34:10.976605 np0000004400 cinder-backup[101319]: DEBUG oslo_service.backend._eventlet.service [None req-5f770af2-e09b-483c-8da6-1399998bb49b None None] backup_driver = cinder.backup.drivers.swift.SwiftBackupDriver {{(pid=101319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 09:34:10.976687 np0000004400 cinder-backup[101319]: DEBUG oslo_service.backend._eventlet.service [None req-5f770af2-e09b-483c-8da6-1399998bb49b None None] backup_driver_init_check_interval = 60 {{(pid=101319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 09:34:10.976776 np0000004400 cinder-backup[101319]: DEBUG oslo_service.backend._eventlet.service [None req-5f770af2-e09b-483c-8da6-1399998bb49b None None] backup_driver_stats_polling_interval = 60 {{(pid=101319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 09:34:10.976854 np0000004400 cinder-backup[101319]: DEBUG oslo_service.backend._eventlet.service [None req-5f770af2-e09b-483c-8da6-1399998bb49b None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=101319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 09:34:10.976939 np0000004400 cinder-backup[101319]: DEBUG oslo_service.backend._eventlet.service [None req-5f770af2-e09b-483c-8da6-1399998bb49b None None] backup_max_operations = 15 {{(pid=101319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 09:34:10.977022 np0000004400 cinder-backup[101319]: DEBUG oslo_service.backend._eventlet.service [None req-5f770af2-e09b-483c-8da6-1399998bb49b None None] backup_metadata_version = 2 {{(pid=101319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 09:34:10.977101 np0000004400 cinder-backup[101319]: DEBUG oslo_service.backend._eventlet.service [None req-5f770af2-e09b-483c-8da6-1399998bb49b None None] backup_name_template = backup-%s {{(pid=101319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 09:34:10.977173 np0000004400 cinder-backup[101319]: DEBUG oslo_service.backend._eventlet.service [None req-5f770af2-e09b-483c-8da6-1399998bb49b None None] backup_native_threads_pool_size = 60 {{(pid=101319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 09:34:10.977248 np0000004400 cinder-backup[101319]: DEBUG oslo_service.backend._eventlet.service [None req-5f770af2-e09b-483c-8da6-1399998bb49b None None] backup_object_number_per_notification = 10 {{(pid=101319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 09:34:10.977323 np0000004400 cinder-backup[101319]: DEBUG oslo_service.backend._eventlet.service [None req-5f770af2-e09b-483c-8da6-1399998bb49b None None] backup_service_inithost_offload = True {{(pid=101319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 09:34:10.977393 np0000004400 cinder-backup[101319]: DEBUG oslo_service.backend._eventlet.service [None req-5f770af2-e09b-483c-8da6-1399998bb49b None None] backup_swift_auth = per_user {{(pid=101319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 09:34:10.977490 np0000004400 cinder-backup[101319]: DEBUG oslo_service.backend._eventlet.service [None req-5f770af2-e09b-483c-8da6-1399998bb49b None None] backup_swift_auth_insecure = False {{(pid=101319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 09:34:10.977565 np0000004400 cinder-backup[101319]: DEBUG oslo_service.backend._eventlet.service [None req-5f770af2-e09b-483c-8da6-1399998bb49b None None] backup_swift_auth_url = None {{(pid=101319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 09:34:10.977637 np0000004400 cinder-backup[101319]: DEBUG oslo_service.backend._eventlet.service [None req-5f770af2-e09b-483c-8da6-1399998bb49b None None] backup_swift_auth_version = 1 {{(pid=101319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 09:34:10.977708 np0000004400 cinder-backup[101319]: DEBUG oslo_service.backend._eventlet.service [None req-5f770af2-e09b-483c-8da6-1399998bb49b None None] backup_swift_block_size = 32768 {{(pid=101319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 09:34:10.977805 np0000004400 cinder-backup[101319]: DEBUG oslo_service.backend._eventlet.service [None req-5f770af2-e09b-483c-8da6-1399998bb49b None None] backup_swift_ca_cert_file = /opt/stack/data/ca-bundle.pem {{(pid=101319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 09:34:10.977879 np0000004400 cinder-backup[101319]: DEBUG oslo_service.backend._eventlet.service [None req-5f770af2-e09b-483c-8da6-1399998bb49b None None] backup_swift_container = volumebackups {{(pid=101319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 09:34:10.977950 np0000004400 cinder-backup[101319]: DEBUG oslo_service.backend._eventlet.service [None req-5f770af2-e09b-483c-8da6-1399998bb49b None None] backup_swift_create_storage_policy = None {{(pid=101319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 09:34:10.978045 np0000004400 cinder-backup[101319]: DEBUG oslo_service.backend._eventlet.service [None req-5f770af2-e09b-483c-8da6-1399998bb49b None None] backup_swift_enable_progress_timer = True {{(pid=101319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 09:34:10.978109 np0000004400 cinder-backup[101319]: DEBUG oslo_service.backend._eventlet.service [None req-5f770af2-e09b-483c-8da6-1399998bb49b None None] backup_swift_key = **** {{(pid=101319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 09:34:10.978183 np0000004400 cinder-backup[101319]: DEBUG oslo_service.backend._eventlet.service [None req-5f770af2-e09b-483c-8da6-1399998bb49b None None] backup_swift_object_size = 52428800 {{(pid=101319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 09:34:10.978256 np0000004400 cinder-backup[101319]: DEBUG oslo_service.backend._eventlet.service [None req-5f770af2-e09b-483c-8da6-1399998bb49b None None] backup_swift_project = None {{(pid=101319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 09:34:10.978354 np0000004400 cinder-backup[101319]: DEBUG oslo_service.backend._eventlet.service [None req-5f770af2-e09b-483c-8da6-1399998bb49b None None] backup_swift_project_domain = None {{(pid=101319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 09:34:10.978420 np0000004400 cinder-backup[101319]: DEBUG oslo_service.backend._eventlet.service [None req-5f770af2-e09b-483c-8da6-1399998bb49b None None] backup_swift_region_name = None {{(pid=101319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 09:34:10.978497 np0000004400 cinder-backup[101319]: DEBUG oslo_service.backend._eventlet.service [None req-5f770af2-e09b-483c-8da6-1399998bb49b None None] backup_swift_retry_attempts = 3 {{(pid=101319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 09:34:10.978570 np0000004400 cinder-backup[101319]: DEBUG oslo_service.backend._eventlet.service [None req-5f770af2-e09b-483c-8da6-1399998bb49b None None] backup_swift_retry_backoff = 2 {{(pid=101319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 09:34:10.978642 np0000004400 cinder-backup[101319]: DEBUG oslo_service.backend._eventlet.service [None req-5f770af2-e09b-483c-8da6-1399998bb49b None None] backup_swift_service_auth = False {{(pid=101319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 09:34:10.978714 np0000004400 cinder-backup[101319]: DEBUG oslo_service.backend._eventlet.service [None req-5f770af2-e09b-483c-8da6-1399998bb49b None None] backup_swift_tenant = None {{(pid=101319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 09:34:10.978801 np0000004400 cinder-backup[101319]: DEBUG oslo_service.backend._eventlet.service [None req-5f770af2-e09b-483c-8da6-1399998bb49b None None] backup_swift_url = https://10.4.3.95:8080/v1/AUTH_ {{(pid=101319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 09:34:10.978891 np0000004400 cinder-backup[101319]: DEBUG oslo_service.backend._eventlet.service [None req-5f770af2-e09b-483c-8da6-1399998bb49b None None] backup_swift_user = None {{(pid=101319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 09:34:10.978945 np0000004400 cinder-backup[101319]: DEBUG oslo_service.backend._eventlet.service [None req-5f770af2-e09b-483c-8da6-1399998bb49b None None] backup_swift_user_domain = None {{(pid=101319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 09:34:10.979028 np0000004400 cinder-backup[101319]: DEBUG oslo_service.backend._eventlet.service [None req-5f770af2-e09b-483c-8da6-1399998bb49b None None] backup_timer_interval = 120 {{(pid=101319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 09:34:10.979098 np0000004400 cinder-backup[101319]: DEBUG oslo_service.backend._eventlet.service [None req-5f770af2-e09b-483c-8da6-1399998bb49b None None] backup_use_same_host = False {{(pid=101319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 09:34:10.979171 np0000004400 cinder-backup[101319]: DEBUG oslo_service.backend._eventlet.service [None req-5f770af2-e09b-483c-8da6-1399998bb49b None None] backup_use_temp_snapshot = False {{(pid=101319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 09:34:10.979243 np0000004400 cinder-backup[101319]: DEBUG oslo_service.backend._eventlet.service [None req-5f770af2-e09b-483c-8da6-1399998bb49b None None] backup_workers = 1 {{(pid=101319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 09:34:10.979318 np0000004400 cinder-backup[101319]: DEBUG oslo_service.backend._eventlet.service [None req-5f770af2-e09b-483c-8da6-1399998bb49b None None] chap_password = **** {{(pid=101319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 09:34:10.979386 np0000004400 cinder-backup[101319]: DEBUG oslo_service.backend._eventlet.service [None req-5f770af2-e09b-483c-8da6-1399998bb49b None None] chap_username = {{(pid=101319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 09:34:10.979475 np0000004400 cinder-backup[101319]: DEBUG oslo_service.backend._eventlet.service [None req-5f770af2-e09b-483c-8da6-1399998bb49b None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=101319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 09:34:10.979549 np0000004400 cinder-backup[101319]: DEBUG oslo_service.backend._eventlet.service [None req-5f770af2-e09b-483c-8da6-1399998bb49b None None] cinder_internal_tenant_project_id = 5ed3b4f0846842d78b8d7e1a1f248918 {{(pid=101319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 09:34:10.979655 np0000004400 cinder-backup[101319]: DEBUG oslo_service.backend._eventlet.service [None req-5f770af2-e09b-483c-8da6-1399998bb49b None None] cinder_internal_tenant_user_id = 7fad36d3087049eb9a952ab4e4322b37 {{(pid=101319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 09:34:10.979808 np0000004400 cinder-backup[101319]: DEBUG oslo_service.backend._eventlet.service [None req-5f770af2-e09b-483c-8da6-1399998bb49b None None] compression_format = gzip {{(pid=101319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 09:34:10.979808 np0000004400 cinder-backup[101319]: DEBUG oslo_service.backend._eventlet.service [None req-5f770af2-e09b-483c-8da6-1399998bb49b None None] config_dir = [] {{(pid=101319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 09:34:10.979860 np0000004400 cinder-backup[101319]: DEBUG oslo_service.backend._eventlet.service [None req-5f770af2-e09b-483c-8da6-1399998bb49b None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=101319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 09:34:10.979908 np0000004400 cinder-backup[101319]: DEBUG oslo_service.backend._eventlet.service [None req-5f770af2-e09b-483c-8da6-1399998bb49b None None] config_source = [] {{(pid=101319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 09:34:10.979977 np0000004400 cinder-backup[101319]: DEBUG oslo_service.backend._eventlet.service [None req-5f770af2-e09b-483c-8da6-1399998bb49b None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=101319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 09:34:10.980057 np0000004400 cinder-backup[101319]: DEBUG oslo_service.backend._eventlet.service [None req-5f770af2-e09b-483c-8da6-1399998bb49b None None] control_exchange = openstack {{(pid=101319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 09:34:10.980131 np0000004400 cinder-backup[101319]: DEBUG oslo_service.backend._eventlet.service [None req-5f770af2-e09b-483c-8da6-1399998bb49b None None] debug = True {{(pid=101319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 09:34:10.980203 np0000004400 cinder-backup[101319]: DEBUG oslo_service.backend._eventlet.service [None req-5f770af2-e09b-483c-8da6-1399998bb49b None None] default_availability_zone = None {{(pid=101319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 09:34:10.980275 np0000004400 cinder-backup[101319]: DEBUG oslo_service.backend._eventlet.service [None req-5f770af2-e09b-483c-8da6-1399998bb49b None None] default_group_type = None {{(pid=101319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 09:34:10.980354 np0000004400 cinder-backup[101319]: DEBUG oslo_service.backend._eventlet.service [None req-5f770af2-e09b-483c-8da6-1399998bb49b None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'swiftclient=WARN', 'botocore=WARN'] {{(pid=101319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 09:34:10.980495 np0000004400 cinder-backup[101319]: DEBUG oslo_service.backend._eventlet.service [None req-5f770af2-e09b-483c-8da6-1399998bb49b None None] default_volume_type = storpool {{(pid=101319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 09:34:10.980576 np0000004400 cinder-backup[101319]: DEBUG oslo_service.backend._eventlet.service [None req-5f770af2-e09b-483c-8da6-1399998bb49b None None] disk_geometry = None {{(pid=101319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 09:34:10.980576 np0000004400 cinder-backup[101319]: DEBUG oslo_service.backend._eventlet.service [None req-5f770af2-e09b-483c-8da6-1399998bb49b None None] driver_client_cert = None {{(pid=101319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 09:34:10.980654 np0000004400 cinder-backup[101319]: DEBUG oslo_service.backend._eventlet.service [None req-5f770af2-e09b-483c-8da6-1399998bb49b None None] driver_client_cert_key = None {{(pid=101319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 09:34:10.980724 np0000004400 cinder-backup[101319]: DEBUG oslo_service.backend._eventlet.service [None req-5f770af2-e09b-483c-8da6-1399998bb49b None None] driver_data_namespace = None {{(pid=101319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 09:34:10.980810 np0000004400 cinder-backup[101319]: DEBUG oslo_service.backend._eventlet.service [None req-5f770af2-e09b-483c-8da6-1399998bb49b None None] driver_ssl_cert_path = None {{(pid=101319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 09:34:10.980890 np0000004400 cinder-backup[101319]: DEBUG oslo_service.backend._eventlet.service [None req-5f770af2-e09b-483c-8da6-1399998bb49b None None] driver_ssl_cert_verify = False {{(pid=101319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 09:34:10.980959 np0000004400 cinder-backup[101319]: DEBUG oslo_service.backend._eventlet.service [None req-5f770af2-e09b-483c-8da6-1399998bb49b None None] driver_use_ssl = False {{(pid=101319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 09:34:10.981042 np0000004400 cinder-backup[101319]: DEBUG oslo_service.backend._eventlet.service [None req-5f770af2-e09b-483c-8da6-1399998bb49b None None] enable_new_services = True {{(pid=101319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 09:34:10.981115 np0000004400 cinder-backup[101319]: DEBUG oslo_service.backend._eventlet.service [None req-5f770af2-e09b-483c-8da6-1399998bb49b None None] enable_unsupported_driver = False {{(pid=101319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 09:34:10.981187 np0000004400 cinder-backup[101319]: DEBUG oslo_service.backend._eventlet.service [None req-5f770af2-e09b-483c-8da6-1399998bb49b None None] enabled_backends = ['storpool'] {{(pid=101319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 09:34:10.981258 np0000004400 cinder-backup[101319]: DEBUG oslo_service.backend._eventlet.service [None req-5f770af2-e09b-483c-8da6-1399998bb49b None None] enforce_multipath_for_image_xfer = False {{(pid=101319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 09:34:10.981332 np0000004400 cinder-backup[101319]: DEBUG oslo_service.backend._eventlet.service [None req-5f770af2-e09b-483c-8da6-1399998bb49b None None] filter_function = None {{(pid=101319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 09:34:10.981417 np0000004400 cinder-backup[101319]: DEBUG oslo_service.backend._eventlet.service [None req-5f770af2-e09b-483c-8da6-1399998bb49b None None] glance_api_insecure = False {{(pid=101319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 09:34:10.981493 np0000004400 cinder-backup[101319]: DEBUG oslo_service.backend._eventlet.service [None req-5f770af2-e09b-483c-8da6-1399998bb49b None None] glance_api_servers = ['https://10.4.3.95/image'] {{(pid=101319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 09:34:10.981565 np0000004400 cinder-backup[101319]: DEBUG oslo_service.backend._eventlet.service [None req-5f770af2-e09b-483c-8da6-1399998bb49b None None] glance_api_ssl_compression = False {{(pid=101319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 09:34:10.981636 np0000004400 cinder-backup[101319]: DEBUG oslo_service.backend._eventlet.service [None req-5f770af2-e09b-483c-8da6-1399998bb49b None None] glance_ca_certificates_file = /opt/stack/data/ca-bundle.pem {{(pid=101319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 09:34:10.981707 np0000004400 cinder-backup[101319]: DEBUG oslo_service.backend._eventlet.service [None req-5f770af2-e09b-483c-8da6-1399998bb49b None None] glance_catalog_info = image:glance:publicURL {{(pid=101319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 09:34:10.981778 np0000004400 cinder-backup[101319]: DEBUG oslo_service.backend._eventlet.service [None req-5f770af2-e09b-483c-8da6-1399998bb49b None None] glance_certfile = None {{(pid=101319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 09:34:10.981870 np0000004400 cinder-backup[101319]: DEBUG oslo_service.backend._eventlet.service [None req-5f770af2-e09b-483c-8da6-1399998bb49b None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=101319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 09:34:10.981946 np0000004400 cinder-backup[101319]: DEBUG oslo_service.backend._eventlet.service [None req-5f770af2-e09b-483c-8da6-1399998bb49b None None] glance_keyfile = None {{(pid=101319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 09:34:10.982031 np0000004400 cinder-backup[101319]: DEBUG oslo_service.backend._eventlet.service [None req-5f770af2-e09b-483c-8da6-1399998bb49b None None] glance_num_retries = 3 {{(pid=101319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 09:34:10.982106 np0000004400 cinder-backup[101319]: DEBUG oslo_service.backend._eventlet.service [None req-5f770af2-e09b-483c-8da6-1399998bb49b None None] glance_request_timeout = None {{(pid=101319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 09:34:10.982178 np0000004400 cinder-backup[101319]: DEBUG oslo_service.backend._eventlet.service [None req-5f770af2-e09b-483c-8da6-1399998bb49b None None] goodness_function = None {{(pid=101319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 09:34:10.982250 np0000004400 cinder-backup[101319]: DEBUG oslo_service.backend._eventlet.service [None req-5f770af2-e09b-483c-8da6-1399998bb49b None None] graceful_shutdown_timeout = 5 {{(pid=101319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 09:34:10.982320 np0000004400 cinder-backup[101319]: DEBUG oslo_service.backend._eventlet.service [None req-5f770af2-e09b-483c-8da6-1399998bb49b None None] group_api_class = cinder.group.api.API {{(pid=101319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 09:34:10.982391 np0000004400 cinder-backup[101319]: DEBUG oslo_service.backend._eventlet.service [None req-5f770af2-e09b-483c-8da6-1399998bb49b None None] host = np0000004400 {{(pid=101319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 09:34:10.982481 np0000004400 cinder-backup[101319]: DEBUG oslo_service.backend._eventlet.service [None req-5f770af2-e09b-483c-8da6-1399998bb49b None None] image_compress_on_upload = True {{(pid=101319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 09:34:10.982553 np0000004400 cinder-backup[101319]: DEBUG oslo_service.backend._eventlet.service [None req-5f770af2-e09b-483c-8da6-1399998bb49b None None] image_conversion_address_space_limit = 1 {{(pid=101319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 09:34:10.982625 np0000004400 cinder-backup[101319]: DEBUG oslo_service.backend._eventlet.service [None req-5f770af2-e09b-483c-8da6-1399998bb49b None None] image_conversion_cpu_limit = 60 {{(pid=101319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 09:34:10.982695 np0000004400 cinder-backup[101319]: DEBUG oslo_service.backend._eventlet.service [None req-5f770af2-e09b-483c-8da6-1399998bb49b None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=101319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 09:34:10.982769 np0000004400 cinder-backup[101319]: DEBUG oslo_service.backend._eventlet.service [None req-5f770af2-e09b-483c-8da6-1399998bb49b None None] image_conversion_disable = False {{(pid=101319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 09:34:10.982856 np0000004400 cinder-backup[101319]: DEBUG oslo_service.backend._eventlet.service [None req-5f770af2-e09b-483c-8da6-1399998bb49b None None] image_upload_use_cinder_backend = False {{(pid=101319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 09:34:10.982930 np0000004400 cinder-backup[101319]: DEBUG oslo_service.backend._eventlet.service [None req-5f770af2-e09b-483c-8da6-1399998bb49b None None] image_upload_use_internal_tenant = False {{(pid=101319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 09:34:10.983003 np0000004400 cinder-backup[101319]: DEBUG oslo_service.backend._eventlet.service [None req-5f770af2-e09b-483c-8da6-1399998bb49b None None] image_volume_cache_enabled = False {{(pid=101319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 09:34:10.983085 np0000004400 cinder-backup[101319]: DEBUG oslo_service.backend._eventlet.service [None req-5f770af2-e09b-483c-8da6-1399998bb49b None None] image_volume_cache_max_count = 0 {{(pid=101319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 09:34:10.983159 np0000004400 cinder-backup[101319]: DEBUG oslo_service.backend._eventlet.service [None req-5f770af2-e09b-483c-8da6-1399998bb49b None None] image_volume_cache_max_size_gb = 0 {{(pid=101319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 09:34:10.983228 np0000004400 cinder-backup[101319]: DEBUG oslo_service.backend._eventlet.service [None req-5f770af2-e09b-483c-8da6-1399998bb49b None None] instance_format = [instance: %(uuid)s] {{(pid=101319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 09:34:10.983298 np0000004400 cinder-backup[101319]: DEBUG oslo_service.backend._eventlet.service [None req-5f770af2-e09b-483c-8da6-1399998bb49b None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=101319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 09:34:10.983369 np0000004400 cinder-backup[101319]: DEBUG oslo_service.backend._eventlet.service [None req-5f770af2-e09b-483c-8da6-1399998bb49b None None] iscsi_target_flags = {{(pid=101319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 09:34:10.983457 np0000004400 cinder-backup[101319]: DEBUG oslo_service.backend._eventlet.service [None req-5f770af2-e09b-483c-8da6-1399998bb49b None None] iscsi_write_cache = on {{(pid=101319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 09:34:10.983531 np0000004400 cinder-backup[101319]: DEBUG oslo_service.backend._eventlet.service [None req-5f770af2-e09b-483c-8da6-1399998bb49b None None] iser_helper = tgtadm {{(pid=101319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 09:34:10.983603 np0000004400 cinder-backup[101319]: DEBUG oslo_service.backend._eventlet.service [None req-5f770af2-e09b-483c-8da6-1399998bb49b None None] iser_ip_address = 10.4.3.95 {{(pid=101319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 09:34:10.983675 np0000004400 cinder-backup[101319]: DEBUG oslo_service.backend._eventlet.service [None req-5f770af2-e09b-483c-8da6-1399998bb49b None None] iser_port = 3260 {{(pid=101319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 09:34:10.983746 np0000004400 cinder-backup[101319]: DEBUG oslo_service.backend._eventlet.service [None req-5f770af2-e09b-483c-8da6-1399998bb49b None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=101319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 09:34:10.983821 np0000004400 cinder-backup[101319]: DEBUG oslo_service.backend._eventlet.service [None req-5f770af2-e09b-483c-8da6-1399998bb49b None None] keystone_catalog_info = identity:Identity Service:publicURL {{(pid=101319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 09:34:10.983907 np0000004400 cinder-backup[101319]: DEBUG oslo_service.backend._eventlet.service [None req-5f770af2-e09b-483c-8da6-1399998bb49b None None] log_color = False {{(pid=101319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 09:34:10.983984 np0000004400 cinder-backup[101319]: DEBUG oslo_service.backend._eventlet.service [None req-5f770af2-e09b-483c-8da6-1399998bb49b None None] log_config_append = None {{(pid=101319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 09:34:10.984065 np0000004400 cinder-backup[101319]: DEBUG oslo_service.backend._eventlet.service [None req-5f770af2-e09b-483c-8da6-1399998bb49b None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=101319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 09:34:10.984138 np0000004400 cinder-backup[101319]: DEBUG oslo_service.backend._eventlet.service [None req-5f770af2-e09b-483c-8da6-1399998bb49b None None] log_dir = None {{(pid=101319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 09:34:10.984209 np0000004400 cinder-backup[101319]: DEBUG oslo_service.backend._eventlet.service [None req-5f770af2-e09b-483c-8da6-1399998bb49b None None] log_file = None {{(pid=101319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 09:34:10.984281 np0000004400 cinder-backup[101319]: DEBUG oslo_service.backend._eventlet.service [None req-5f770af2-e09b-483c-8da6-1399998bb49b None None] log_options = True {{(pid=101319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 09:34:10.984353 np0000004400 cinder-backup[101319]: DEBUG oslo_service.backend._eventlet.service [None req-5f770af2-e09b-483c-8da6-1399998bb49b None None] log_rotate_interval = 1 {{(pid=101319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 09:34:10.984445 np0000004400 cinder-backup[101319]: DEBUG oslo_service.backend._eventlet.service [None req-5f770af2-e09b-483c-8da6-1399998bb49b None None] log_rotate_interval_type = days {{(pid=101319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 09:34:10.984520 np0000004400 cinder-backup[101319]: DEBUG oslo_service.backend._eventlet.service [None req-5f770af2-e09b-483c-8da6-1399998bb49b None None] log_rotation_type = none {{(pid=101319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 09:34:10.984593 np0000004400 cinder-backup[101319]: DEBUG oslo_service.backend._eventlet.service [None req-5f770af2-e09b-483c-8da6-1399998bb49b None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=101319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 09:34:10.984667 np0000004400 cinder-backup[101319]: DEBUG oslo_service.backend._eventlet.service [None req-5f770af2-e09b-483c-8da6-1399998bb49b None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=101319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 09:34:10.984739 np0000004400 cinder-backup[101319]: DEBUG oslo_service.backend._eventlet.service [None req-5f770af2-e09b-483c-8da6-1399998bb49b None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=101319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 09:34:10.984810 np0000004400 cinder-backup[101319]: DEBUG oslo_service.backend._eventlet.service [None req-5f770af2-e09b-483c-8da6-1399998bb49b None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=101319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 09:34:10.984896 np0000004400 cinder-backup[101319]: DEBUG oslo_service.backend._eventlet.service [None req-5f770af2-e09b-483c-8da6-1399998bb49b None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=101319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 09:34:10.984972 np0000004400 cinder-backup[101319]: DEBUG oslo_service.backend._eventlet.service [None req-5f770af2-e09b-483c-8da6-1399998bb49b None None] max_age = 0 {{(pid=101319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 09:34:10.985054 np0000004400 cinder-backup[101319]: DEBUG oslo_service.backend._eventlet.service [None req-5f770af2-e09b-483c-8da6-1399998bb49b None None] max_logfile_count = 30 {{(pid=101319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 09:34:10.985128 np0000004400 cinder-backup[101319]: DEBUG oslo_service.backend._eventlet.service [None req-5f770af2-e09b-483c-8da6-1399998bb49b None None] max_logfile_size_mb = 200 {{(pid=101319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 09:34:10.985201 np0000004400 cinder-backup[101319]: DEBUG oslo_service.backend._eventlet.service [None req-5f770af2-e09b-483c-8da6-1399998bb49b None None] max_over_subscription_ratio = 20.0 {{(pid=101319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 09:34:10.985272 np0000004400 cinder-backup[101319]: DEBUG oslo_service.backend._eventlet.service [None req-5f770af2-e09b-483c-8da6-1399998bb49b None None] message_reap_interval = 86400 {{(pid=101319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 09:34:10.985348 np0000004400 cinder-backup[101319]: DEBUG oslo_service.backend._eventlet.service [None req-5f770af2-e09b-483c-8da6-1399998bb49b None None] message_ttl = 2592000 {{(pid=101319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 09:34:10.985434 np0000004400 cinder-backup[101319]: DEBUG oslo_service.backend._eventlet.service [None req-5f770af2-e09b-483c-8da6-1399998bb49b None None] monkey_patch = False {{(pid=101319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 09:34:10.985511 np0000004400 cinder-backup[101319]: DEBUG oslo_service.backend._eventlet.service [None req-5f770af2-e09b-483c-8da6-1399998bb49b None None] monkey_patch_modules = [] {{(pid=101319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 09:34:10.985584 np0000004400 cinder-backup[101319]: DEBUG oslo_service.backend._eventlet.service [None req-5f770af2-e09b-483c-8da6-1399998bb49b None None] my_ip = 10.4.3.95 {{(pid=101319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 09:34:10.985659 np0000004400 cinder-backup[101319]: DEBUG oslo_service.backend._eventlet.service [None req-5f770af2-e09b-483c-8da6-1399998bb49b None None] no_snapshot_gb_quota = False {{(pid=101319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 09:34:10.985727 np0000004400 cinder-backup[101319]: DEBUG oslo_service.backend._eventlet.service [None req-5f770af2-e09b-483c-8da6-1399998bb49b None None] num_iser_scan_tries = 3 {{(pid=101319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 09:34:10.985802 np0000004400 cinder-backup[101319]: DEBUG oslo_service.backend._eventlet.service [None req-5f770af2-e09b-483c-8da6-1399998bb49b None None] num_shell_tries = 3 {{(pid=101319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 09:34:10.985886 np0000004400 cinder-backup[101319]: DEBUG oslo_service.backend._eventlet.service [None req-5f770af2-e09b-483c-8da6-1399998bb49b None None] num_volume_device_scan_tries = 3 {{(pid=101319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 09:34:10.985965 np0000004400 cinder-backup[101319]: DEBUG oslo_service.backend._eventlet.service [None req-5f770af2-e09b-483c-8da6-1399998bb49b None None] nvmeof_conn_info_version = 1 {{(pid=101319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 09:34:10.986050 np0000004400 cinder-backup[101319]: DEBUG oslo_service.backend._eventlet.service [None req-5f770af2-e09b-483c-8da6-1399998bb49b None None] nvmet_ns_id = 10 {{(pid=101319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 09:34:10.986125 np0000004400 cinder-backup[101319]: DEBUG oslo_service.backend._eventlet.service [None req-5f770af2-e09b-483c-8da6-1399998bb49b None None] nvmet_port_id = 1 {{(pid=101319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 09:34:10.986199 np0000004400 cinder-backup[101319]: DEBUG oslo_service.backend._eventlet.service [None req-5f770af2-e09b-483c-8da6-1399998bb49b None None] osapi_max_limit = 1000 {{(pid=101319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 09:34:10.986270 np0000004400 cinder-backup[101319]: DEBUG oslo_service.backend._eventlet.service [None req-5f770af2-e09b-483c-8da6-1399998bb49b None None] osapi_volume_ext_list = [] {{(pid=101319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 09:34:10.986342 np0000004400 cinder-backup[101319]: DEBUG oslo_service.backend._eventlet.service [None req-5f770af2-e09b-483c-8da6-1399998bb49b None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=101319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 09:34:10.986432 np0000004400 cinder-backup[101319]: DEBUG oslo_service.backend._eventlet.service [None req-5f770af2-e09b-483c-8da6-1399998bb49b None None] osapi_volume_listen = 0.0.0.0 {{(pid=101319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 09:34:10.986509 np0000004400 cinder-backup[101319]: DEBUG oslo_service.backend._eventlet.service [None req-5f770af2-e09b-483c-8da6-1399998bb49b None None] osapi_volume_listen_port = 8776 {{(pid=101319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 09:34:10.986580 np0000004400 cinder-backup[101319]: DEBUG oslo_service.backend._eventlet.service [None req-5f770af2-e09b-483c-8da6-1399998bb49b None None] osapi_volume_use_ssl = False {{(pid=101319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 09:34:10.986651 np0000004400 cinder-backup[101319]: DEBUG oslo_service.backend._eventlet.service [None req-5f770af2-e09b-483c-8da6-1399998bb49b None None] osapi_volume_workers = None {{(pid=101319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 09:34:10.986724 np0000004400 cinder-backup[101319]: DEBUG oslo_service.backend._eventlet.service [None req-5f770af2-e09b-483c-8da6-1399998bb49b None None] per_volume_size_limit = -1 {{(pid=101319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 09:34:10.986796 np0000004400 cinder-backup[101319]: DEBUG oslo_service.backend._eventlet.service [None req-5f770af2-e09b-483c-8da6-1399998bb49b None None] periodic_fuzzy_delay = 60 {{(pid=101319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 09:34:10.986868 np0000004400 cinder-backup[101319]: DEBUG oslo_service.backend._eventlet.service [None req-5f770af2-e09b-483c-8da6-1399998bb49b None None] periodic_interval = 60 {{(pid=101319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 09:34:10.986954 np0000004400 cinder-backup[101319]: DEBUG oslo_service.backend._eventlet.service [None req-5f770af2-e09b-483c-8da6-1399998bb49b None None] project_id_regex = [0-9a-f\-]+ {{(pid=101319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 09:34:10.987040 np0000004400 cinder-backup[101319]: DEBUG oslo_service.backend._eventlet.service [None req-5f770af2-e09b-483c-8da6-1399998bb49b None None] public_endpoint = None {{(pid=101319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 09:34:10.987113 np0000004400 cinder-backup[101319]: DEBUG oslo_service.backend._eventlet.service [None req-5f770af2-e09b-483c-8da6-1399998bb49b None None] publish_errors = False {{(pid=101319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 09:34:10.987183 np0000004400 cinder-backup[101319]: DEBUG oslo_service.backend._eventlet.service [None req-5f770af2-e09b-483c-8da6-1399998bb49b None None] quota_backup_gigabytes = 1000 {{(pid=101319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 09:34:10.987253 np0000004400 cinder-backup[101319]: DEBUG oslo_service.backend._eventlet.service [None req-5f770af2-e09b-483c-8da6-1399998bb49b None None] quota_backups = 10 {{(pid=101319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 09:34:10.987329 np0000004400 cinder-backup[101319]: DEBUG oslo_service.backend._eventlet.service [None req-5f770af2-e09b-483c-8da6-1399998bb49b None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=101319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 09:34:10.987412 np0000004400 cinder-backup[101319]: DEBUG oslo_service.backend._eventlet.service [None req-5f770af2-e09b-483c-8da6-1399998bb49b None None] quota_gigabytes = 1000 {{(pid=101319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 09:34:10.987491 np0000004400 cinder-backup[101319]: DEBUG oslo_service.backend._eventlet.service [None req-5f770af2-e09b-483c-8da6-1399998bb49b None None] quota_groups = 10 {{(pid=101319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 09:34:10.987563 np0000004400 cinder-backup[101319]: DEBUG oslo_service.backend._eventlet.service [None req-5f770af2-e09b-483c-8da6-1399998bb49b None None] quota_snapshots = 10 {{(pid=101319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 09:34:10.987634 np0000004400 cinder-backup[101319]: DEBUG oslo_service.backend._eventlet.service [None req-5f770af2-e09b-483c-8da6-1399998bb49b None None] quota_volumes = 10 {{(pid=101319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 09:34:10.987705 np0000004400 cinder-backup[101319]: DEBUG oslo_service.backend._eventlet.service [None req-5f770af2-e09b-483c-8da6-1399998bb49b None None] rate_limit_burst = 0 {{(pid=101319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 09:34:10.987779 np0000004400 cinder-backup[101319]: DEBUG oslo_service.backend._eventlet.service [None req-5f770af2-e09b-483c-8da6-1399998bb49b None None] rate_limit_except_level = CRITICAL {{(pid=101319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 09:34:10.987849 np0000004400 cinder-backup[101319]: DEBUG oslo_service.backend._eventlet.service [None req-5f770af2-e09b-483c-8da6-1399998bb49b None None] rate_limit_interval = 0 {{(pid=101319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 09:34:10.987936 np0000004400 cinder-backup[101319]: DEBUG oslo_service.backend._eventlet.service [None req-5f770af2-e09b-483c-8da6-1399998bb49b None None] replication_device = **** {{(pid=101319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 09:34:10.988023 np0000004400 cinder-backup[101319]: DEBUG oslo_service.backend._eventlet.service [None req-5f770af2-e09b-483c-8da6-1399998bb49b None None] report_discard_supported = False {{(pid=101319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 09:34:10.988096 np0000004400 cinder-backup[101319]: DEBUG oslo_service.backend._eventlet.service [None req-5f770af2-e09b-483c-8da6-1399998bb49b None None] report_interval = 120 {{(pid=101319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 09:34:10.988168 np0000004400 cinder-backup[101319]: DEBUG oslo_service.backend._eventlet.service [None req-5f770af2-e09b-483c-8da6-1399998bb49b None None] reservation_clean_interval = 86400 {{(pid=101319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 09:34:10.988240 np0000004400 cinder-backup[101319]: DEBUG oslo_service.backend._eventlet.service [None req-5f770af2-e09b-483c-8da6-1399998bb49b None None] reservation_expire = 86400 {{(pid=101319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 09:34:10.988311 np0000004400 cinder-backup[101319]: DEBUG oslo_service.backend._eventlet.service [None req-5f770af2-e09b-483c-8da6-1399998bb49b None None] reserved_image_namespaces = [] {{(pid=101319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 09:34:10.988382 np0000004400 cinder-backup[101319]: DEBUG oslo_service.backend._eventlet.service [None req-5f770af2-e09b-483c-8da6-1399998bb49b None None] reserved_percentage = 0 {{(pid=101319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 09:34:10.988473 np0000004400 cinder-backup[101319]: DEBUG oslo_service.backend._eventlet.service [None req-5f770af2-e09b-483c-8da6-1399998bb49b None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=101319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 09:34:10.988545 np0000004400 cinder-backup[101319]: DEBUG oslo_service.backend._eventlet.service [None req-5f770af2-e09b-483c-8da6-1399998bb49b None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=101319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 09:34:10.988618 np0000004400 cinder-backup[101319]: DEBUG oslo_service.backend._eventlet.service [None req-5f770af2-e09b-483c-8da6-1399998bb49b None None] rpc_response_timeout = 120 {{(pid=101319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 09:34:10.988690 np0000004400 cinder-backup[101319]: DEBUG oslo_service.backend._eventlet.service [None req-5f770af2-e09b-483c-8da6-1399998bb49b None None] run_external_periodic_tasks = True {{(pid=101319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 09:34:10.988760 np0000004400 cinder-backup[101319]: DEBUG oslo_service.backend._eventlet.service [None req-5f770af2-e09b-483c-8da6-1399998bb49b None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=101319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 09:34:10.988831 np0000004400 cinder-backup[101319]: DEBUG oslo_service.backend._eventlet.service [None req-5f770af2-e09b-483c-8da6-1399998bb49b None None] scst_target_driver = iscsi {{(pid=101319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 09:34:10.988904 np0000004400 cinder-backup[101319]: DEBUG oslo_service.backend._eventlet.service [None req-5f770af2-e09b-483c-8da6-1399998bb49b None None] scst_target_iqn_name = None {{(pid=101319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 09:34:10.988990 np0000004400 cinder-backup[101319]: DEBUG oslo_service.backend._eventlet.service [None req-5f770af2-e09b-483c-8da6-1399998bb49b None None] service_down_time = 720 {{(pid=101319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 09:34:10.989072 np0000004400 cinder-backup[101319]: DEBUG oslo_service.backend._eventlet.service [None req-5f770af2-e09b-483c-8da6-1399998bb49b None None] shell_completion = None {{(pid=101319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 09:34:10.989144 np0000004400 cinder-backup[101319]: DEBUG oslo_service.backend._eventlet.service [None req-5f770af2-e09b-483c-8da6-1399998bb49b None None] snapshot_name_template = snapshot-%s {{(pid=101319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 09:34:10.989217 np0000004400 cinder-backup[101319]: DEBUG oslo_service.backend._eventlet.service [None req-5f770af2-e09b-483c-8da6-1399998bb49b None None] split_loggers = False {{(pid=101319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 09:34:10.989288 np0000004400 cinder-backup[101319]: DEBUG oslo_service.backend._eventlet.service [None req-5f770af2-e09b-483c-8da6-1399998bb49b None None] state_path = /opt/stack/data/cinder {{(pid=101319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 09:34:10.989361 np0000004400 cinder-backup[101319]: DEBUG oslo_service.backend._eventlet.service [None req-5f770af2-e09b-483c-8da6-1399998bb49b None None] storage_availability_zone = nova {{(pid=101319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 09:34:10.989452 np0000004400 cinder-backup[101319]: DEBUG oslo_service.backend._eventlet.service [None req-5f770af2-e09b-483c-8da6-1399998bb49b None None] storage_protocol = iSCSI {{(pid=101319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 09:34:10.989527 np0000004400 cinder-backup[101319]: DEBUG oslo_service.backend._eventlet.service [None req-5f770af2-e09b-483c-8da6-1399998bb49b None None] swift_catalog_info = object-store:swift:publicURL {{(pid=101319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 09:34:10.989599 np0000004400 cinder-backup[101319]: DEBUG oslo_service.backend._eventlet.service [None req-5f770af2-e09b-483c-8da6-1399998bb49b None None] syslog_log_facility = LOG_USER {{(pid=101319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 09:34:10.989670 np0000004400 cinder-backup[101319]: DEBUG oslo_service.backend._eventlet.service [None req-5f770af2-e09b-483c-8da6-1399998bb49b None None] target_helper = lioadm {{(pid=101319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 09:34:10.989742 np0000004400 cinder-backup[101319]: DEBUG oslo_service.backend._eventlet.service [None req-5f770af2-e09b-483c-8da6-1399998bb49b None None] target_ip_address = 10.4.3.95 {{(pid=101319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 09:34:10.989815 np0000004400 cinder-backup[101319]: DEBUG oslo_service.backend._eventlet.service [None req-5f770af2-e09b-483c-8da6-1399998bb49b None None] target_port = 3260 {{(pid=101319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 09:34:10.989887 np0000004400 cinder-backup[101319]: DEBUG oslo_service.backend._eventlet.service [None req-5f770af2-e09b-483c-8da6-1399998bb49b None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=101319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 09:34:10.989974 np0000004400 cinder-backup[101319]: DEBUG oslo_service.backend._eventlet.service [None req-5f770af2-e09b-483c-8da6-1399998bb49b None None] target_protocol = iscsi {{(pid=101319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 09:34:10.990061 np0000004400 cinder-backup[101319]: DEBUG oslo_service.backend._eventlet.service [None req-5f770af2-e09b-483c-8da6-1399998bb49b None None] target_secondary_ip_addresses = [] {{(pid=101319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 09:34:10.990135 np0000004400 cinder-backup[101319]: DEBUG oslo_service.backend._eventlet.service [None req-5f770af2-e09b-483c-8da6-1399998bb49b None None] trace_flags = None {{(pid=101319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 09:34:10.990206 np0000004400 cinder-backup[101319]: DEBUG oslo_service.backend._eventlet.service [None req-5f770af2-e09b-483c-8da6-1399998bb49b None None] transfer_api_class = cinder.transfer.api.API {{(pid=101319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 09:34:10.990277 np0000004400 cinder-backup[101319]: DEBUG oslo_service.backend._eventlet.service [None req-5f770af2-e09b-483c-8da6-1399998bb49b None None] transport_url = **** {{(pid=101319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 09:34:10.990351 np0000004400 cinder-backup[101319]: DEBUG oslo_service.backend._eventlet.service [None req-5f770af2-e09b-483c-8da6-1399998bb49b None None] until_refresh = 0 {{(pid=101319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 09:34:10.990439 np0000004400 cinder-backup[101319]: DEBUG oslo_service.backend._eventlet.service [None req-5f770af2-e09b-483c-8da6-1399998bb49b None None] use_chap_auth = False {{(pid=101319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 09:34:10.990513 np0000004400 cinder-backup[101319]: DEBUG oslo_service.backend._eventlet.service [None req-5f770af2-e09b-483c-8da6-1399998bb49b None None] use_default_quota_class = True {{(pid=101319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 09:34:10.990584 np0000004400 cinder-backup[101319]: DEBUG oslo_service.backend._eventlet.service [None req-5f770af2-e09b-483c-8da6-1399998bb49b None None] use_journal = False {{(pid=101319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 09:34:10.990655 np0000004400 cinder-backup[101319]: DEBUG oslo_service.backend._eventlet.service [None req-5f770af2-e09b-483c-8da6-1399998bb49b None None] use_json = False {{(pid=101319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 09:34:10.990727 np0000004400 cinder-backup[101319]: DEBUG oslo_service.backend._eventlet.service [None req-5f770af2-e09b-483c-8da6-1399998bb49b None None] use_multipath_for_image_xfer = False {{(pid=101319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 09:34:10.990798 np0000004400 cinder-backup[101319]: DEBUG oslo_service.backend._eventlet.service [None req-5f770af2-e09b-483c-8da6-1399998bb49b None None] use_stderr = False {{(pid=101319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 09:34:10.990870 np0000004400 cinder-backup[101319]: DEBUG oslo_service.backend._eventlet.service [None req-5f770af2-e09b-483c-8da6-1399998bb49b None None] use_syslog = False {{(pid=101319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 09:34:10.990955 np0000004400 cinder-backup[101319]: DEBUG oslo_service.backend._eventlet.service [None req-5f770af2-e09b-483c-8da6-1399998bb49b None None] verify_glance_signatures = enabled {{(pid=101319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 09:34:10.991042 np0000004400 cinder-backup[101319]: DEBUG oslo_service.backend._eventlet.service [None req-5f770af2-e09b-483c-8da6-1399998bb49b None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=101319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 09:34:10.991117 np0000004400 cinder-backup[101319]: DEBUG oslo_service.backend._eventlet.service [None req-5f770af2-e09b-483c-8da6-1399998bb49b None None] volume_api_class = cinder.volume.api.API {{(pid=101319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 09:34:10.991192 np0000004400 cinder-backup[101319]: DEBUG oslo_service.backend._eventlet.service [None req-5f770af2-e09b-483c-8da6-1399998bb49b None None] volume_backend_name = None {{(pid=101319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 09:34:10.991263 np0000004400 cinder-backup[101319]: DEBUG oslo_service.backend._eventlet.service [None req-5f770af2-e09b-483c-8da6-1399998bb49b None None] volume_clear = zero {{(pid=101319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 09:34:10.991335 np0000004400 cinder-backup[101319]: DEBUG oslo_service.backend._eventlet.service [None req-5f770af2-e09b-483c-8da6-1399998bb49b None None] volume_clear_ionice = None {{(pid=101319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 09:34:10.991420 np0000004400 cinder-backup[101319]: DEBUG oslo_service.backend._eventlet.service [None req-5f770af2-e09b-483c-8da6-1399998bb49b None None] volume_clear_size = 0 {{(pid=101319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 09:34:10.991497 np0000004400 cinder-backup[101319]: DEBUG oslo_service.backend._eventlet.service [None req-5f770af2-e09b-483c-8da6-1399998bb49b None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=101319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 09:34:10.991569 np0000004400 cinder-backup[101319]: DEBUG oslo_service.backend._eventlet.service [None req-5f770af2-e09b-483c-8da6-1399998bb49b None None] volume_copy_bps_limit = 0 {{(pid=101319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 09:34:10.991639 np0000004400 cinder-backup[101319]: DEBUG oslo_service.backend._eventlet.service [None req-5f770af2-e09b-483c-8da6-1399998bb49b None None] volume_dd_blocksize = 1M {{(pid=101319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 09:34:10.991711 np0000004400 cinder-backup[101319]: DEBUG oslo_service.backend._eventlet.service [None req-5f770af2-e09b-483c-8da6-1399998bb49b None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=101319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 09:34:10.991783 np0000004400 cinder-backup[101319]: DEBUG oslo_service.backend._eventlet.service [None req-5f770af2-e09b-483c-8da6-1399998bb49b None None] volume_name_template = volume-%s {{(pid=101319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 09:34:10.991853 np0000004400 cinder-backup[101319]: DEBUG oslo_service.backend._eventlet.service [None req-5f770af2-e09b-483c-8da6-1399998bb49b None None] volume_usage_audit_period = month {{(pid=101319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 09:34:10.991923 np0000004400 cinder-backup[101319]: DEBUG oslo_service.backend._eventlet.service [None req-5f770af2-e09b-483c-8da6-1399998bb49b None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=101319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 09:34:10.992033 np0000004400 cinder-backup[101319]: DEBUG oslo_service.backend._eventlet.service [None req-5f770af2-e09b-483c-8da6-1399998bb49b None None] oslo_concurrency.disable_process_locking = False {{(pid=101319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 09:34:10.992112 np0000004400 cinder-backup[101319]: DEBUG oslo_service.backend._eventlet.service [None req-5f770af2-e09b-483c-8da6-1399998bb49b None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=101319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 09:34:10.992191 np0000004400 cinder-backup[101319]: DEBUG oslo_service.backend._eventlet.service [None req-5f770af2-e09b-483c-8da6-1399998bb49b None None] os_brick.lightos_discovery_client_address = localhost {{(pid=101319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 09:34:10.992266 np0000004400 cinder-backup[101319]: DEBUG oslo_service.backend._eventlet.service [None req-5f770af2-e09b-483c-8da6-1399998bb49b None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=101319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 09:34:10.992339 np0000004400 cinder-backup[101319]: DEBUG oslo_service.backend._eventlet.service [None req-5f770af2-e09b-483c-8da6-1399998bb49b None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=101319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 09:34:10.992428 np0000004400 cinder-backup[101319]: DEBUG oslo_service.backend._eventlet.service [None req-5f770af2-e09b-483c-8da6-1399998bb49b None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=101319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 09:34:10.992504 np0000004400 cinder-backup[101319]: DEBUG oslo_service.backend._eventlet.service [None req-5f770af2-e09b-483c-8da6-1399998bb49b None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=101319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 09:34:10.992581 np0000004400 cinder-backup[101319]: DEBUG oslo_service.backend._eventlet.service [None req-5f770af2-e09b-483c-8da6-1399998bb49b None None] os_brick.wait_mpath_device_interval = 1 {{(pid=101319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 09:34:10.992657 np0000004400 cinder-backup[101319]: DEBUG oslo_service.backend._eventlet.service [None req-5f770af2-e09b-483c-8da6-1399998bb49b None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=101319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 09:34:10.992735 np0000004400 cinder-backup[101319]: DEBUG oslo_service.backend._eventlet.service [None req-5f770af2-e09b-483c-8da6-1399998bb49b None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=101319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 09:34:10.992816 np0000004400 cinder-backup[101319]: DEBUG oslo_service.backend._eventlet.service [None req-5f770af2-e09b-483c-8da6-1399998bb49b None None] keystone_authtoken.auth_section = None {{(pid=101319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 09:34:10.992888 np0000004400 cinder-backup[101319]: DEBUG oslo_service.backend._eventlet.service [None req-5f770af2-e09b-483c-8da6-1399998bb49b None None] keystone_authtoken.auth_type = password {{(pid=101319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 09:34:10.992965 np0000004400 cinder-backup[101319]: DEBUG oslo_service.backend._eventlet.service [None req-5f770af2-e09b-483c-8da6-1399998bb49b None None] keystone_authtoken.auth_version = None {{(pid=101319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 09:34:10.993063 np0000004400 cinder-backup[101319]: DEBUG oslo_service.backend._eventlet.service [None req-5f770af2-e09b-483c-8da6-1399998bb49b None None] keystone_authtoken.cache = None {{(pid=101319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 09:34:10.993139 np0000004400 cinder-backup[101319]: DEBUG oslo_service.backend._eventlet.service [None req-5f770af2-e09b-483c-8da6-1399998bb49b None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=101319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 09:34:10.993211 np0000004400 cinder-backup[101319]: DEBUG oslo_service.backend._eventlet.service [None req-5f770af2-e09b-483c-8da6-1399998bb49b None None] keystone_authtoken.certfile = None {{(pid=101319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 09:34:10.993284 np0000004400 cinder-backup[101319]: DEBUG oslo_service.backend._eventlet.service [None req-5f770af2-e09b-483c-8da6-1399998bb49b None None] keystone_authtoken.delay_auth_decision = False {{(pid=101319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 09:34:10.993355 np0000004400 cinder-backup[101319]: DEBUG oslo_service.backend._eventlet.service [None req-5f770af2-e09b-483c-8da6-1399998bb49b None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=101319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 09:34:10.993447 np0000004400 cinder-backup[101319]: DEBUG oslo_service.backend._eventlet.service [None req-5f770af2-e09b-483c-8da6-1399998bb49b None None] keystone_authtoken.http_connect_timeout = None {{(pid=101319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 09:34:10.993522 np0000004400 cinder-backup[101319]: DEBUG oslo_service.backend._eventlet.service [None req-5f770af2-e09b-483c-8da6-1399998bb49b None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=101319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 09:34:10.993595 np0000004400 cinder-backup[101319]: DEBUG oslo_service.backend._eventlet.service [None req-5f770af2-e09b-483c-8da6-1399998bb49b None None] keystone_authtoken.include_service_catalog = True {{(pid=101319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 09:34:10.993668 np0000004400 cinder-backup[101319]: DEBUG oslo_service.backend._eventlet.service [None req-5f770af2-e09b-483c-8da6-1399998bb49b None None] keystone_authtoken.insecure = False {{(pid=101319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 09:34:10.993739 np0000004400 cinder-backup[101319]: DEBUG oslo_service.backend._eventlet.service [None req-5f770af2-e09b-483c-8da6-1399998bb49b None None] keystone_authtoken.interface = public {{(pid=101319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 09:34:10.993812 np0000004400 cinder-backup[101319]: DEBUG oslo_service.backend._eventlet.service [None req-5f770af2-e09b-483c-8da6-1399998bb49b None None] keystone_authtoken.keyfile = None {{(pid=101319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 09:34:10.993885 np0000004400 cinder-backup[101319]: DEBUG oslo_service.backend._eventlet.service [None req-5f770af2-e09b-483c-8da6-1399998bb49b None None] keystone_authtoken.memcache_password = {{(pid=101319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 09:34:10.993957 np0000004400 cinder-backup[101319]: DEBUG oslo_service.backend._eventlet.service [None req-5f770af2-e09b-483c-8da6-1399998bb49b None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=101319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 09:34:10.994060 np0000004400 cinder-backup[101319]: DEBUG oslo_service.backend._eventlet.service [None req-5f770af2-e09b-483c-8da6-1399998bb49b None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=101319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 09:34:10.994138 np0000004400 cinder-backup[101319]: DEBUG oslo_service.backend._eventlet.service [None req-5f770af2-e09b-483c-8da6-1399998bb49b None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=101319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 09:34:10.994207 np0000004400 cinder-backup[101319]: DEBUG oslo_service.backend._eventlet.service [None req-5f770af2-e09b-483c-8da6-1399998bb49b None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=101319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 09:34:10.994279 np0000004400 cinder-backup[101319]: DEBUG oslo_service.backend._eventlet.service [None req-5f770af2-e09b-483c-8da6-1399998bb49b None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=101319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 09:34:10.994351 np0000004400 cinder-backup[101319]: DEBUG oslo_service.backend._eventlet.service [None req-5f770af2-e09b-483c-8da6-1399998bb49b None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=101319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 09:34:10.994444 np0000004400 cinder-backup[101319]: DEBUG oslo_service.backend._eventlet.service [None req-5f770af2-e09b-483c-8da6-1399998bb49b None None] keystone_authtoken.memcache_secret_key = **** {{(pid=101319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 09:34:10.994520 np0000004400 cinder-backup[101319]: DEBUG oslo_service.backend._eventlet.service [None req-5f770af2-e09b-483c-8da6-1399998bb49b None None] keystone_authtoken.memcache_security_strategy = None {{(pid=101319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 09:34:10.994592 np0000004400 cinder-backup[101319]: DEBUG oslo_service.backend._eventlet.service [None req-5f770af2-e09b-483c-8da6-1399998bb49b None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=101319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 09:34:10.994665 np0000004400 cinder-backup[101319]: DEBUG oslo_service.backend._eventlet.service [None req-5f770af2-e09b-483c-8da6-1399998bb49b None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=101319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 09:34:10.994739 np0000004400 cinder-backup[101319]: DEBUG oslo_service.backend._eventlet.service [None req-5f770af2-e09b-483c-8da6-1399998bb49b None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=101319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 09:34:10.994810 np0000004400 cinder-backup[101319]: DEBUG oslo_service.backend._eventlet.service [None req-5f770af2-e09b-483c-8da6-1399998bb49b None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=101319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 09:34:10.994881 np0000004400 cinder-backup[101319]: DEBUG oslo_service.backend._eventlet.service [None req-5f770af2-e09b-483c-8da6-1399998bb49b None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=101319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 09:34:10.994952 np0000004400 cinder-backup[101319]: DEBUG oslo_service.backend._eventlet.service [None req-5f770af2-e09b-483c-8da6-1399998bb49b None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=101319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 09:34:10.995054 np0000004400 cinder-backup[101319]: DEBUG oslo_service.backend._eventlet.service [None req-5f770af2-e09b-483c-8da6-1399998bb49b None None] keystone_authtoken.memcache_username = {{(pid=101319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 09:34:10.995133 np0000004400 cinder-backup[101319]: DEBUG oslo_service.backend._eventlet.service [None req-5f770af2-e09b-483c-8da6-1399998bb49b None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=101319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 09:34:10.995206 np0000004400 cinder-backup[101319]: DEBUG oslo_service.backend._eventlet.service [None req-5f770af2-e09b-483c-8da6-1399998bb49b None None] keystone_authtoken.region_name = None {{(pid=101319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 09:34:10.995280 np0000004400 cinder-backup[101319]: DEBUG oslo_service.backend._eventlet.service [None req-5f770af2-e09b-483c-8da6-1399998bb49b None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=101319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 09:34:10.995352 np0000004400 cinder-backup[101319]: DEBUG oslo_service.backend._eventlet.service [None req-5f770af2-e09b-483c-8da6-1399998bb49b None None] keystone_authtoken.service_token_roles_required = True {{(pid=101319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 09:34:10.995445 np0000004400 cinder-backup[101319]: DEBUG oslo_service.backend._eventlet.service [None req-5f770af2-e09b-483c-8da6-1399998bb49b None None] keystone_authtoken.service_type = None {{(pid=101319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 09:34:10.995523 np0000004400 cinder-backup[101319]: DEBUG oslo_service.backend._eventlet.service [None req-5f770af2-e09b-483c-8da6-1399998bb49b None None] keystone_authtoken.token_cache_time = 300 {{(pid=101319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 09:34:10.995598 np0000004400 cinder-backup[101319]: DEBUG oslo_service.backend._eventlet.service [None req-5f770af2-e09b-483c-8da6-1399998bb49b None None] keystone_authtoken.www_authenticate_uri = https://10.4.3.95/identity {{(pid=101319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 09:34:10.995680 np0000004400 cinder-backup[101319]: DEBUG oslo_service.backend._eventlet.service [None req-5f770af2-e09b-483c-8da6-1399998bb49b None None] cache.backend = dogpile.cache.null {{(pid=101319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 09:34:10.995756 np0000004400 cinder-backup[101319]: DEBUG oslo_service.backend._eventlet.service [None req-5f770af2-e09b-483c-8da6-1399998bb49b None None] cache.backend_argument = **** {{(pid=101319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 09:34:10.995829 np0000004400 cinder-backup[101319]: DEBUG oslo_service.backend._eventlet.service [None req-5f770af2-e09b-483c-8da6-1399998bb49b None None] cache.backend_expiration_time = None {{(pid=101319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 09:34:10.995903 np0000004400 cinder-backup[101319]: DEBUG oslo_service.backend._eventlet.service [None req-5f770af2-e09b-483c-8da6-1399998bb49b None None] cache.config_prefix = cache.oslo {{(pid=101319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 09:34:10.995976 np0000004400 cinder-backup[101319]: DEBUG oslo_service.backend._eventlet.service [None req-5f770af2-e09b-483c-8da6-1399998bb49b None None] cache.debug_cache_backend = False {{(pid=101319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 09:34:10.996074 np0000004400 cinder-backup[101319]: DEBUG oslo_service.backend._eventlet.service [None req-5f770af2-e09b-483c-8da6-1399998bb49b None None] cache.enable_retry_client = False {{(pid=101319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 09:34:10.996150 np0000004400 cinder-backup[101319]: DEBUG oslo_service.backend._eventlet.service [None req-5f770af2-e09b-483c-8da6-1399998bb49b None None] cache.enable_socket_keepalive = False {{(pid=101319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 09:34:10.996225 np0000004400 cinder-backup[101319]: DEBUG oslo_service.backend._eventlet.service [None req-5f770af2-e09b-483c-8da6-1399998bb49b None None] cache.enabled = False {{(pid=101319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 09:34:10.996298 np0000004400 cinder-backup[101319]: DEBUG oslo_service.backend._eventlet.service [None req-5f770af2-e09b-483c-8da6-1399998bb49b None None] cache.expiration_time = 600 {{(pid=101319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 09:34:10.996374 np0000004400 cinder-backup[101319]: DEBUG oslo_service.backend._eventlet.service [None req-5f770af2-e09b-483c-8da6-1399998bb49b None None] cache.hashclient_dead_timeout = 60.0 {{(pid=101319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 09:34:10.996465 np0000004400 cinder-backup[101319]: DEBUG oslo_service.backend._eventlet.service [None req-5f770af2-e09b-483c-8da6-1399998bb49b None None] cache.hashclient_retry_attempts = 2 {{(pid=101319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 09:34:10.996540 np0000004400 cinder-backup[101319]: DEBUG oslo_service.backend._eventlet.service [None req-5f770af2-e09b-483c-8da6-1399998bb49b None None] cache.hashclient_retry_timeout = 1.0 {{(pid=101319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 09:34:10.996613 np0000004400 cinder-backup[101319]: DEBUG oslo_service.backend._eventlet.service [None req-5f770af2-e09b-483c-8da6-1399998bb49b None None] cache.memcache_dead_retry = 300 {{(pid=101319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 09:34:10.996685 np0000004400 cinder-backup[101319]: DEBUG oslo_service.backend._eventlet.service [None req-5f770af2-e09b-483c-8da6-1399998bb49b None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=101319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 09:34:10.996759 np0000004400 cinder-backup[101319]: DEBUG oslo_service.backend._eventlet.service [None req-5f770af2-e09b-483c-8da6-1399998bb49b None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=101319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 09:34:10.996828 np0000004400 cinder-backup[101319]: DEBUG oslo_service.backend._eventlet.service [None req-5f770af2-e09b-483c-8da6-1399998bb49b None None] cache.memcache_pool_maxsize = 10 {{(pid=101319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 09:34:10.996899 np0000004400 cinder-backup[101319]: DEBUG oslo_service.backend._eventlet.service [None req-5f770af2-e09b-483c-8da6-1399998bb49b None None] cache.memcache_pool_unused_timeout = 60 {{(pid=101319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 09:34:10.996971 np0000004400 cinder-backup[101319]: DEBUG oslo_service.backend._eventlet.service [None req-5f770af2-e09b-483c-8da6-1399998bb49b None None] cache.memcache_sasl_enabled = False {{(pid=101319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 09:34:10.997064 np0000004400 cinder-backup[101319]: DEBUG oslo_service.backend._eventlet.service [None req-5f770af2-e09b-483c-8da6-1399998bb49b None None] cache.memcache_servers = ['localhost:11211'] {{(pid=101319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 09:34:10.997142 np0000004400 cinder-backup[101319]: DEBUG oslo_service.backend._eventlet.service [None req-5f770af2-e09b-483c-8da6-1399998bb49b None None] cache.password = **** {{(pid=101319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 09:34:10.997217 np0000004400 cinder-backup[101319]: DEBUG oslo_service.backend._eventlet.service [None req-5f770af2-e09b-483c-8da6-1399998bb49b None None] cache.proxies = [] {{(pid=101319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 09:34:10.997293 np0000004400 cinder-backup[101319]: DEBUG oslo_service.backend._eventlet.service [None req-5f770af2-e09b-483c-8da6-1399998bb49b None None] cache.redis_db = 0 {{(pid=101319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 09:34:10.997362 np0000004400 cinder-backup[101319]: DEBUG oslo_service.backend._eventlet.service [None req-5f770af2-e09b-483c-8da6-1399998bb49b None None] cache.redis_sentinel_service_name = mymaster {{(pid=101319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 09:34:10.997454 np0000004400 cinder-backup[101319]: DEBUG oslo_service.backend._eventlet.service [None req-5f770af2-e09b-483c-8da6-1399998bb49b None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=101319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 09:34:10.997530 np0000004400 cinder-backup[101319]: DEBUG oslo_service.backend._eventlet.service [None req-5f770af2-e09b-483c-8da6-1399998bb49b None None] cache.redis_server = localhost:6379 {{(pid=101319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 09:34:10.997603 np0000004400 cinder-backup[101319]: DEBUG oslo_service.backend._eventlet.service [None req-5f770af2-e09b-483c-8da6-1399998bb49b None None] cache.retry_attempts = 2 {{(pid=101319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 09:34:10.997682 np0000004400 cinder-backup[101319]: DEBUG oslo_service.backend._eventlet.service [None req-5f770af2-e09b-483c-8da6-1399998bb49b None None] cache.retry_delay = 0.0 {{(pid=101319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 09:34:10.997753 np0000004400 cinder-backup[101319]: DEBUG oslo_service.backend._eventlet.service [None req-5f770af2-e09b-483c-8da6-1399998bb49b None None] cache.socket_keepalive_count = 1 {{(pid=101319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 09:34:10.997823 np0000004400 cinder-backup[101319]: DEBUG oslo_service.backend._eventlet.service [None req-5f770af2-e09b-483c-8da6-1399998bb49b None None] cache.socket_keepalive_idle = 1 {{(pid=101319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 09:34:10.997895 np0000004400 cinder-backup[101319]: DEBUG oslo_service.backend._eventlet.service [None req-5f770af2-e09b-483c-8da6-1399998bb49b None None] cache.socket_keepalive_interval = 1 {{(pid=101319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 09:34:10.997969 np0000004400 cinder-backup[101319]: DEBUG oslo_service.backend._eventlet.service [None req-5f770af2-e09b-483c-8da6-1399998bb49b None None] cache.socket_timeout = 1.0 {{(pid=101319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 09:34:10.998065 np0000004400 cinder-backup[101319]: DEBUG oslo_service.backend._eventlet.service [None req-5f770af2-e09b-483c-8da6-1399998bb49b None None] cache.tls_allowed_ciphers = None {{(pid=101319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 09:34:10.998143 np0000004400 cinder-backup[101319]: DEBUG oslo_service.backend._eventlet.service [None req-5f770af2-e09b-483c-8da6-1399998bb49b None None] cache.tls_cafile = None {{(pid=101319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 09:34:10.998216 np0000004400 cinder-backup[101319]: DEBUG oslo_service.backend._eventlet.service [None req-5f770af2-e09b-483c-8da6-1399998bb49b None None] cache.tls_certfile = None {{(pid=101319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 09:34:10.998288 np0000004400 cinder-backup[101319]: DEBUG oslo_service.backend._eventlet.service [None req-5f770af2-e09b-483c-8da6-1399998bb49b None None] cache.tls_enabled = False {{(pid=101319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 09:34:10.998360 np0000004400 cinder-backup[101319]: DEBUG oslo_service.backend._eventlet.service [None req-5f770af2-e09b-483c-8da6-1399998bb49b None None] cache.tls_keyfile = None {{(pid=101319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 09:34:10.998455 np0000004400 cinder-backup[101319]: DEBUG oslo_service.backend._eventlet.service [None req-5f770af2-e09b-483c-8da6-1399998bb49b None None] cache.username = None {{(pid=101319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 09:34:10.998535 np0000004400 cinder-backup[101319]: DEBUG oslo_service.backend._eventlet.service [None req-5f770af2-e09b-483c-8da6-1399998bb49b None None] coordination.backend_url = **** {{(pid=101319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 09:34:10.998614 np0000004400 cinder-backup[101319]: DEBUG oslo_service.backend._eventlet.service [None req-5f770af2-e09b-483c-8da6-1399998bb49b None None] database.asyncio_connection = **** {{(pid=101319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 09:34:10.998687 np0000004400 cinder-backup[101319]: DEBUG oslo_service.backend._eventlet.service [None req-5f770af2-e09b-483c-8da6-1399998bb49b None None] database.asyncio_slave_connection = **** {{(pid=101319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 09:34:10.998758 np0000004400 cinder-backup[101319]: DEBUG oslo_service.backend._eventlet.service [None req-5f770af2-e09b-483c-8da6-1399998bb49b None None] database.backend = sqlalchemy {{(pid=101319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 09:34:10.998832 np0000004400 cinder-backup[101319]: DEBUG oslo_service.backend._eventlet.service [None req-5f770af2-e09b-483c-8da6-1399998bb49b None None] database.connection = **** {{(pid=101319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 09:34:10.998902 np0000004400 cinder-backup[101319]: DEBUG oslo_service.backend._eventlet.service [None req-5f770af2-e09b-483c-8da6-1399998bb49b None None] database.connection_debug = 0 {{(pid=101319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 09:34:10.998973 np0000004400 cinder-backup[101319]: DEBUG oslo_service.backend._eventlet.service [None req-5f770af2-e09b-483c-8da6-1399998bb49b None None] database.connection_parameters = {{(pid=101319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 09:34:10.999062 np0000004400 cinder-backup[101319]: DEBUG oslo_service.backend._eventlet.service [None req-5f770af2-e09b-483c-8da6-1399998bb49b None None] database.connection_recycle_time = 3600 {{(pid=101319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 09:34:10.999146 np0000004400 cinder-backup[101319]: DEBUG oslo_service.backend._eventlet.service [None req-5f770af2-e09b-483c-8da6-1399998bb49b None None] database.connection_trace = False {{(pid=101319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 09:34:10.999222 np0000004400 cinder-backup[101319]: DEBUG oslo_service.backend._eventlet.service [None req-5f770af2-e09b-483c-8da6-1399998bb49b None None] database.db_inc_retry_interval = True {{(pid=101319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 09:34:10.999308 np0000004400 cinder-backup[101319]: DEBUG oslo_service.backend._eventlet.service [None req-5f770af2-e09b-483c-8da6-1399998bb49b None None] database.db_max_retries = 20 {{(pid=101319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 09:34:10.999363 np0000004400 cinder-backup[101319]: DEBUG oslo_service.backend._eventlet.service [None req-5f770af2-e09b-483c-8da6-1399998bb49b None None] database.db_max_retry_interval = 10 {{(pid=101319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 09:34:10.999458 np0000004400 cinder-backup[101319]: DEBUG oslo_service.backend._eventlet.service [None req-5f770af2-e09b-483c-8da6-1399998bb49b None None] database.db_retry_interval = 1 {{(pid=101319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 09:34:10.999533 np0000004400 cinder-backup[101319]: DEBUG oslo_service.backend._eventlet.service [None req-5f770af2-e09b-483c-8da6-1399998bb49b None None] database.max_overflow = 50 {{(pid=101319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 09:34:10.999605 np0000004400 cinder-backup[101319]: DEBUG oslo_service.backend._eventlet.service [None req-5f770af2-e09b-483c-8da6-1399998bb49b None None] database.max_pool_size = 5 {{(pid=101319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 09:34:10.999678 np0000004400 cinder-backup[101319]: DEBUG oslo_service.backend._eventlet.service [None req-5f770af2-e09b-483c-8da6-1399998bb49b None None] database.max_retries = 10 {{(pid=101319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 09:34:10.999751 np0000004400 cinder-backup[101319]: DEBUG oslo_service.backend._eventlet.service [None req-5f770af2-e09b-483c-8da6-1399998bb49b None None] database.mysql_sql_mode = TRADITIONAL {{(pid=101319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 09:34:10.999823 np0000004400 cinder-backup[101319]: DEBUG oslo_service.backend._eventlet.service [None req-5f770af2-e09b-483c-8da6-1399998bb49b None None] database.mysql_wsrep_sync_wait = None {{(pid=101319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 09:34:10.999895 np0000004400 cinder-backup[101319]: DEBUG oslo_service.backend._eventlet.service [None req-5f770af2-e09b-483c-8da6-1399998bb49b None None] database.pool_timeout = None {{(pid=101319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 09:34:10.999966 np0000004400 cinder-backup[101319]: DEBUG oslo_service.backend._eventlet.service [None req-5f770af2-e09b-483c-8da6-1399998bb49b None None] database.retry_interval = 10 {{(pid=101319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 09:34:11.000048 np0000004400 cinder-backup[101319]: DEBUG oslo_service.backend._eventlet.service [None req-5f770af2-e09b-483c-8da6-1399998bb49b None None] database.slave_connection = **** {{(pid=101319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 09:34:11.000135 np0000004400 cinder-backup[101319]: DEBUG oslo_service.backend._eventlet.service [None req-5f770af2-e09b-483c-8da6-1399998bb49b None None] database.sqlite_synchronous = True {{(pid=101319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 09:34:11.000208 np0000004400 cinder-backup[101319]: DEBUG oslo_service.backend._eventlet.service [None req-5f770af2-e09b-483c-8da6-1399998bb49b None None] database.synchronous_reader = True {{(pid=101319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 09:34:11.000283 np0000004400 cinder-backup[101319]: DEBUG oslo_service.backend._eventlet.service [None req-5f770af2-e09b-483c-8da6-1399998bb49b None None] database.use_db_reconnect = False {{(pid=101319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 09:34:11.000360 np0000004400 cinder-backup[101319]: DEBUG oslo_service.backend._eventlet.service [None req-5f770af2-e09b-483c-8da6-1399998bb49b None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=101319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 09:34:11.000451 np0000004400 cinder-backup[101319]: DEBUG oslo_service.backend._eventlet.service [None req-5f770af2-e09b-483c-8da6-1399998bb49b None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=101319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 09:34:11.000524 np0000004400 cinder-backup[101319]: DEBUG oslo_service.backend._eventlet.service [None req-5f770af2-e09b-483c-8da6-1399998bb49b None None] oslo_messaging_metrics.metrics_process_name = {{(pid=101319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 09:34:11.000596 np0000004400 cinder-backup[101319]: DEBUG oslo_service.backend._eventlet.service [None req-5f770af2-e09b-483c-8da6-1399998bb49b None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=101319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 09:34:11.000668 np0000004400 cinder-backup[101319]: DEBUG oslo_service.backend._eventlet.service [None req-5f770af2-e09b-483c-8da6-1399998bb49b None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=101319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 09:34:11.000745 np0000004400 cinder-backup[101319]: DEBUG oslo_service.backend._eventlet.service [None req-5f770af2-e09b-483c-8da6-1399998bb49b None None] profiler.connection_string = messaging:// {{(pid=101319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 09:34:11.000819 np0000004400 cinder-backup[101319]: DEBUG oslo_service.backend._eventlet.service [None req-5f770af2-e09b-483c-8da6-1399998bb49b None None] profiler.enabled = False {{(pid=101319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 09:34:11.000892 np0000004400 cinder-backup[101319]: DEBUG oslo_service.backend._eventlet.service [None req-5f770af2-e09b-483c-8da6-1399998bb49b None None] profiler.es_doc_type = notification {{(pid=101319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 09:34:11.000965 np0000004400 cinder-backup[101319]: DEBUG oslo_service.backend._eventlet.service [None req-5f770af2-e09b-483c-8da6-1399998bb49b None None] profiler.es_scroll_size = 10000 {{(pid=101319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 09:34:11.001047 np0000004400 cinder-backup[101319]: DEBUG oslo_service.backend._eventlet.service [None req-5f770af2-e09b-483c-8da6-1399998bb49b None None] profiler.es_scroll_time = 2m {{(pid=101319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 09:34:11.001137 np0000004400 cinder-backup[101319]: DEBUG oslo_service.backend._eventlet.service [None req-5f770af2-e09b-483c-8da6-1399998bb49b None None] profiler.filter_error_trace = False {{(pid=101319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 09:34:11.001213 np0000004400 cinder-backup[101319]: DEBUG oslo_service.backend._eventlet.service [None req-5f770af2-e09b-483c-8da6-1399998bb49b None None] profiler.hmac_keys = **** {{(pid=101319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 09:34:11.001286 np0000004400 cinder-backup[101319]: DEBUG oslo_service.backend._eventlet.service [None req-5f770af2-e09b-483c-8da6-1399998bb49b None None] profiler.sentinel_service_name = mymaster {{(pid=101319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 09:34:11.001361 np0000004400 cinder-backup[101319]: DEBUG oslo_service.backend._eventlet.service [None req-5f770af2-e09b-483c-8da6-1399998bb49b None None] profiler.socket_timeout = 0.1 {{(pid=101319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 09:34:11.001454 np0000004400 cinder-backup[101319]: DEBUG oslo_service.backend._eventlet.service [None req-5f770af2-e09b-483c-8da6-1399998bb49b None None] profiler.trace_requests = False {{(pid=101319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 09:34:11.001529 np0000004400 cinder-backup[101319]: DEBUG oslo_service.backend._eventlet.service [None req-5f770af2-e09b-483c-8da6-1399998bb49b None None] profiler.trace_sqlalchemy = False {{(pid=101319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 09:34:11.001605 np0000004400 cinder-backup[101319]: DEBUG oslo_service.backend._eventlet.service [None req-5f770af2-e09b-483c-8da6-1399998bb49b None None] profiler_jaeger.process_tags = {} {{(pid=101319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 09:34:11.001679 np0000004400 cinder-backup[101319]: DEBUG oslo_service.backend._eventlet.service [None req-5f770af2-e09b-483c-8da6-1399998bb49b None None] profiler_jaeger.service_name_prefix = None {{(pid=101319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 09:34:11.001753 np0000004400 cinder-backup[101319]: DEBUG oslo_service.backend._eventlet.service [None req-5f770af2-e09b-483c-8da6-1399998bb49b None None] profiler_otlp.service_name_prefix = None {{(pid=101319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 09:34:11.001829 np0000004400 cinder-backup[101319]: DEBUG oslo_service.backend._eventlet.service [None req-5f770af2-e09b-483c-8da6-1399998bb49b None None] oslo_policy.enforce_new_defaults = True {{(pid=101319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 09:34:11.001902 np0000004400 cinder-backup[101319]: DEBUG oslo_service.backend._eventlet.service [None req-5f770af2-e09b-483c-8da6-1399998bb49b None None] oslo_policy.enforce_scope = False {{(pid=101319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 09:34:11.001974 np0000004400 cinder-backup[101319]: DEBUG oslo_service.backend._eventlet.service [None req-5f770af2-e09b-483c-8da6-1399998bb49b None None] oslo_policy.policy_default_rule = default {{(pid=101319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 09:34:11.002061 np0000004400 cinder-backup[101319]: DEBUG oslo_service.backend._eventlet.service [None req-5f770af2-e09b-483c-8da6-1399998bb49b None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=101319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 09:34:11.002150 np0000004400 cinder-backup[101319]: DEBUG oslo_service.backend._eventlet.service [None req-5f770af2-e09b-483c-8da6-1399998bb49b None None] oslo_policy.policy_file = policy.yaml {{(pid=101319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 09:34:11.002227 np0000004400 cinder-backup[101319]: DEBUG oslo_service.backend._eventlet.service [None req-5f770af2-e09b-483c-8da6-1399998bb49b None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=101319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 09:34:11.002299 np0000004400 cinder-backup[101319]: DEBUG oslo_service.backend._eventlet.service [None req-5f770af2-e09b-483c-8da6-1399998bb49b None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=101319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 09:34:11.002371 np0000004400 cinder-backup[101319]: DEBUG oslo_service.backend._eventlet.service [None req-5f770af2-e09b-483c-8da6-1399998bb49b None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=101319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 09:34:11.002461 np0000004400 cinder-backup[101319]: DEBUG oslo_service.backend._eventlet.service [None req-5f770af2-e09b-483c-8da6-1399998bb49b None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=101319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 09:34:11.002539 np0000004400 cinder-backup[101319]: DEBUG oslo_service.backend._eventlet.service [None req-5f770af2-e09b-483c-8da6-1399998bb49b None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=101319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 09:34:11.002613 np0000004400 cinder-backup[101319]: DEBUG oslo_service.backend._eventlet.service [None req-5f770af2-e09b-483c-8da6-1399998bb49b None None] oslo_policy.remote_timeout = 60.0 {{(pid=101319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 09:34:11.002693 np0000004400 cinder-backup[101319]: DEBUG oslo_service.backend._eventlet.service [None req-5f770af2-e09b-483c-8da6-1399998bb49b None None] privsep_osbrick.capabilities = [21, 2] {{(pid=101319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 09:34:11.002767 np0000004400 cinder-backup[101319]: DEBUG oslo_service.backend._eventlet.service [None req-5f770af2-e09b-483c-8da6-1399998bb49b None None] privsep_osbrick.group = None {{(pid=101319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 09:34:11.002841 np0000004400 cinder-backup[101319]: DEBUG oslo_service.backend._eventlet.service [None req-5f770af2-e09b-483c-8da6-1399998bb49b None None] privsep_osbrick.helper_command = None {{(pid=101319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 09:34:11.002914 np0000004400 cinder-backup[101319]: DEBUG oslo_service.backend._eventlet.service [None req-5f770af2-e09b-483c-8da6-1399998bb49b None None] privsep_osbrick.log_daemon_traceback = False {{(pid=101319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 09:34:11.002987 np0000004400 cinder-backup[101319]: DEBUG oslo_service.backend._eventlet.service [None req-5f770af2-e09b-483c-8da6-1399998bb49b None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=101319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 09:34:11.003070 np0000004400 cinder-backup[101319]: DEBUG oslo_service.backend._eventlet.service [None req-5f770af2-e09b-483c-8da6-1399998bb49b None None] privsep_osbrick.thread_pool_size = 16 {{(pid=101319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 09:34:11.003160 np0000004400 cinder-backup[101319]: DEBUG oslo_service.backend._eventlet.service [None req-5f770af2-e09b-483c-8da6-1399998bb49b None None] privsep_osbrick.user = None {{(pid=101319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 09:34:11.003243 np0000004400 cinder-backup[101319]: DEBUG oslo_service.backend._eventlet.service [None req-5f770af2-e09b-483c-8da6-1399998bb49b None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=101319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 09:34:11.003317 np0000004400 cinder-backup[101319]: DEBUG oslo_service.backend._eventlet.service [None req-5f770af2-e09b-483c-8da6-1399998bb49b None None] cinder_sys_admin.group = None {{(pid=101319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 09:34:11.003389 np0000004400 cinder-backup[101319]: DEBUG oslo_service.backend._eventlet.service [None req-5f770af2-e09b-483c-8da6-1399998bb49b None None] cinder_sys_admin.helper_command = None {{(pid=101319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 09:34:11.003483 np0000004400 cinder-backup[101319]: DEBUG oslo_service.backend._eventlet.service [None req-5f770af2-e09b-483c-8da6-1399998bb49b None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=101319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 09:34:11.003556 np0000004400 cinder-backup[101319]: DEBUG oslo_service.backend._eventlet.service [None req-5f770af2-e09b-483c-8da6-1399998bb49b None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=101319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 09:34:11.003628 np0000004400 cinder-backup[101319]: DEBUG oslo_service.backend._eventlet.service [None req-5f770af2-e09b-483c-8da6-1399998bb49b None None] cinder_sys_admin.thread_pool_size = 16 {{(pid=101319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 09:34:11.003700 np0000004400 cinder-backup[101319]: DEBUG oslo_service.backend._eventlet.service [None req-5f770af2-e09b-483c-8da6-1399998bb49b None None] cinder_sys_admin.user = None {{(pid=101319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 09:34:11.003777 np0000004400 cinder-backup[101319]: DEBUG oslo_service.backend._eventlet.service [None req-5f770af2-e09b-483c-8da6-1399998bb49b None None] service_user.auth_section = None {{(pid=101319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 09:34:11.003850 np0000004400 cinder-backup[101319]: DEBUG oslo_service.backend._eventlet.service [None req-5f770af2-e09b-483c-8da6-1399998bb49b None None] service_user.auth_type = password {{(pid=101319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 09:34:11.003922 np0000004400 cinder-backup[101319]: DEBUG oslo_service.backend._eventlet.service [None req-5f770af2-e09b-483c-8da6-1399998bb49b None None] service_user.cafile = None {{(pid=101319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 09:34:11.003994 np0000004400 cinder-backup[101319]: DEBUG oslo_service.backend._eventlet.service [None req-5f770af2-e09b-483c-8da6-1399998bb49b None None] service_user.certfile = None {{(pid=101319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 09:34:11.004080 np0000004400 cinder-backup[101319]: DEBUG oslo_service.backend._eventlet.service [None req-5f770af2-e09b-483c-8da6-1399998bb49b None None] service_user.collect_timing = False {{(pid=101319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 09:34:11.004172 np0000004400 cinder-backup[101319]: DEBUG oslo_service.backend._eventlet.service [None req-5f770af2-e09b-483c-8da6-1399998bb49b None None] service_user.insecure = False {{(pid=101319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 09:34:11.004251 np0000004400 cinder-backup[101319]: DEBUG oslo_service.backend._eventlet.service [None req-5f770af2-e09b-483c-8da6-1399998bb49b None None] service_user.keyfile = None {{(pid=101319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 09:34:11.004321 np0000004400 cinder-backup[101319]: DEBUG oslo_service.backend._eventlet.service [None req-5f770af2-e09b-483c-8da6-1399998bb49b None None] service_user.send_service_user_token = True {{(pid=101319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 09:34:11.004393 np0000004400 cinder-backup[101319]: DEBUG oslo_service.backend._eventlet.service [None req-5f770af2-e09b-483c-8da6-1399998bb49b None None] service_user.split_loggers = False {{(pid=101319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 09:34:11.004485 np0000004400 cinder-backup[101319]: DEBUG oslo_service.backend._eventlet.service [None req-5f770af2-e09b-483c-8da6-1399998bb49b None None] service_user.timeout = None {{(pid=101319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 09:34:11.004564 np0000004400 cinder-backup[101319]: DEBUG oslo_service.backend._eventlet.service [None req-5f770af2-e09b-483c-8da6-1399998bb49b None None] glance.auth_section = None {{(pid=101319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 09:34:11.004637 np0000004400 cinder-backup[101319]: DEBUG oslo_service.backend._eventlet.service [None req-5f770af2-e09b-483c-8da6-1399998bb49b None None] glance.auth_type = password {{(pid=101319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 09:34:11.004711 np0000004400 cinder-backup[101319]: DEBUG oslo_service.backend._eventlet.service [None req-5f770af2-e09b-483c-8da6-1399998bb49b None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=101319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 09:34:11.004782 np0000004400 cinder-backup[101319]: DEBUG oslo_service.backend._eventlet.service [None req-5f770af2-e09b-483c-8da6-1399998bb49b None None] glance.certfile = None {{(pid=101319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 09:34:11.004854 np0000004400 cinder-backup[101319]: DEBUG oslo_service.backend._eventlet.service [None req-5f770af2-e09b-483c-8da6-1399998bb49b None None] glance.collect_timing = False {{(pid=101319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 09:34:11.004926 np0000004400 cinder-backup[101319]: DEBUG oslo_service.backend._eventlet.service [None req-5f770af2-e09b-483c-8da6-1399998bb49b None None] glance.insecure = False {{(pid=101319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 09:34:11.004998 np0000004400 cinder-backup[101319]: DEBUG oslo_service.backend._eventlet.service [None req-5f770af2-e09b-483c-8da6-1399998bb49b None None] glance.keyfile = None {{(pid=101319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 09:34:11.005080 np0000004400 cinder-backup[101319]: DEBUG oslo_service.backend._eventlet.service [None req-5f770af2-e09b-483c-8da6-1399998bb49b None None] glance.region_name = None {{(pid=101319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 09:34:11.005165 np0000004400 cinder-backup[101319]: DEBUG oslo_service.backend._eventlet.service [None req-5f770af2-e09b-483c-8da6-1399998bb49b None None] glance.split_loggers = False {{(pid=101319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 09:34:11.005244 np0000004400 cinder-backup[101319]: DEBUG oslo_service.backend._eventlet.service [None req-5f770af2-e09b-483c-8da6-1399998bb49b None None] glance.timeout = None {{(pid=101319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 09:34:11.005327 np0000004400 cinder-backup[101319]: DEBUG oslo_service.backend._eventlet.service [None req-5f770af2-e09b-483c-8da6-1399998bb49b None None] backend_defaults.backend_availability_zone = None {{(pid=101319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 09:34:11.005415 np0000004400 cinder-backup[101319]: DEBUG oslo_service.backend._eventlet.service [None req-5f770af2-e09b-483c-8da6-1399998bb49b None None] backend_defaults.chap_password = **** {{(pid=101319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 09:34:11.005493 np0000004400 cinder-backup[101319]: DEBUG oslo_service.backend._eventlet.service [None req-5f770af2-e09b-483c-8da6-1399998bb49b None None] backend_defaults.chap_username = {{(pid=101319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 09:34:11.005566 np0000004400 cinder-backup[101319]: DEBUG oslo_service.backend._eventlet.service [None req-5f770af2-e09b-483c-8da6-1399998bb49b None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=101319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 09:34:11.005641 np0000004400 cinder-backup[101319]: DEBUG oslo_service.backend._eventlet.service [None req-5f770af2-e09b-483c-8da6-1399998bb49b None None] backend_defaults.disk_geometry = None {{(pid=101319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 09:34:11.005711 np0000004400 cinder-backup[101319]: DEBUG oslo_service.backend._eventlet.service [None req-5f770af2-e09b-483c-8da6-1399998bb49b None None] backend_defaults.driver_client_cert = None {{(pid=101319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 09:34:11.005782 np0000004400 cinder-backup[101319]: DEBUG oslo_service.backend._eventlet.service [None req-5f770af2-e09b-483c-8da6-1399998bb49b None None] backend_defaults.driver_client_cert_key = None {{(pid=101319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 09:34:11.005853 np0000004400 cinder-backup[101319]: DEBUG oslo_service.backend._eventlet.service [None req-5f770af2-e09b-483c-8da6-1399998bb49b None None] backend_defaults.driver_data_namespace = None {{(pid=101319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 09:34:11.005927 np0000004400 cinder-backup[101319]: DEBUG oslo_service.backend._eventlet.service [None req-5f770af2-e09b-483c-8da6-1399998bb49b None None] backend_defaults.driver_ssl_cert_path = None {{(pid=101319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 09:34:11.005997 np0000004400 cinder-backup[101319]: DEBUG oslo_service.backend._eventlet.service [None req-5f770af2-e09b-483c-8da6-1399998bb49b None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=101319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 09:34:11.006081 np0000004400 cinder-backup[101319]: DEBUG oslo_service.backend._eventlet.service [None req-5f770af2-e09b-483c-8da6-1399998bb49b None None] backend_defaults.driver_use_ssl = False {{(pid=101319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 09:34:11.006155 np0000004400 cinder-backup[101319]: DEBUG oslo_service.backend._eventlet.service [None req-5f770af2-e09b-483c-8da6-1399998bb49b None None] backend_defaults.enable_unsupported_driver = False {{(pid=101319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 09:34:11.006244 np0000004400 cinder-backup[101319]: DEBUG oslo_service.backend._eventlet.service [None req-5f770af2-e09b-483c-8da6-1399998bb49b None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=101319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 09:34:11.006317 np0000004400 cinder-backup[101319]: DEBUG oslo_service.backend._eventlet.service [None req-5f770af2-e09b-483c-8da6-1399998bb49b None None] backend_defaults.filter_function = None {{(pid=101319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 09:34:11.006391 np0000004400 cinder-backup[101319]: DEBUG oslo_service.backend._eventlet.service [None req-5f770af2-e09b-483c-8da6-1399998bb49b None None] backend_defaults.goodness_function = None {{(pid=101319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 09:34:11.006484 np0000004400 cinder-backup[101319]: DEBUG oslo_service.backend._eventlet.service [None req-5f770af2-e09b-483c-8da6-1399998bb49b None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=101319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 09:34:11.006557 np0000004400 cinder-backup[101319]: DEBUG oslo_service.backend._eventlet.service [None req-5f770af2-e09b-483c-8da6-1399998bb49b None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=101319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 09:34:11.006628 np0000004400 cinder-backup[101319]: DEBUG oslo_service.backend._eventlet.service [None req-5f770af2-e09b-483c-8da6-1399998bb49b None None] backend_defaults.image_volume_cache_enabled = False {{(pid=101319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 09:34:11.006700 np0000004400 cinder-backup[101319]: DEBUG oslo_service.backend._eventlet.service [None req-5f770af2-e09b-483c-8da6-1399998bb49b None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=101319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 09:34:11.006772 np0000004400 cinder-backup[101319]: DEBUG oslo_service.backend._eventlet.service [None req-5f770af2-e09b-483c-8da6-1399998bb49b None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=101319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 09:34:11.006844 np0000004400 cinder-backup[101319]: DEBUG oslo_service.backend._eventlet.service [None req-5f770af2-e09b-483c-8da6-1399998bb49b None None] backend_defaults.iscsi_target_flags = {{(pid=101319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 09:34:11.006915 np0000004400 cinder-backup[101319]: DEBUG oslo_service.backend._eventlet.service [None req-5f770af2-e09b-483c-8da6-1399998bb49b None None] backend_defaults.iscsi_write_cache = on {{(pid=101319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 09:34:11.006987 np0000004400 cinder-backup[101319]: DEBUG oslo_service.backend._eventlet.service [None req-5f770af2-e09b-483c-8da6-1399998bb49b None None] backend_defaults.iser_helper = tgtadm {{(pid=101319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 09:34:11.007068 np0000004400 cinder-backup[101319]: DEBUG oslo_service.backend._eventlet.service [None req-5f770af2-e09b-483c-8da6-1399998bb49b None None] backend_defaults.iser_ip_address = 10.4.3.95 {{(pid=101319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 09:34:11.007141 np0000004400 cinder-backup[101319]: DEBUG oslo_service.backend._eventlet.service [None req-5f770af2-e09b-483c-8da6-1399998bb49b None None] backend_defaults.iser_port = 3260 {{(pid=101319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 09:34:11.007228 np0000004400 cinder-backup[101319]: DEBUG oslo_service.backend._eventlet.service [None req-5f770af2-e09b-483c-8da6-1399998bb49b None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=101319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 09:34:11.007305 np0000004400 cinder-backup[101319]: DEBUG oslo_service.backend._eventlet.service [None req-5f770af2-e09b-483c-8da6-1399998bb49b None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=101319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 09:34:11.007376 np0000004400 cinder-backup[101319]: DEBUG oslo_service.backend._eventlet.service [None req-5f770af2-e09b-483c-8da6-1399998bb49b None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=101319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 09:34:11.007463 np0000004400 cinder-backup[101319]: DEBUG oslo_service.backend._eventlet.service [None req-5f770af2-e09b-483c-8da6-1399998bb49b None None] backend_defaults.num_shell_tries = 3 {{(pid=101319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 09:34:11.007537 np0000004400 cinder-backup[101319]: DEBUG oslo_service.backend._eventlet.service [None req-5f770af2-e09b-483c-8da6-1399998bb49b None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=101319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 09:34:11.007609 np0000004400 cinder-backup[101319]: DEBUG oslo_service.backend._eventlet.service [None req-5f770af2-e09b-483c-8da6-1399998bb49b None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=101319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 09:34:11.007682 np0000004400 cinder-backup[101319]: DEBUG oslo_service.backend._eventlet.service [None req-5f770af2-e09b-483c-8da6-1399998bb49b None None] backend_defaults.nvmet_ns_id = 10 {{(pid=101319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 09:34:11.007754 np0000004400 cinder-backup[101319]: DEBUG oslo_service.backend._eventlet.service [None req-5f770af2-e09b-483c-8da6-1399998bb49b None None] backend_defaults.nvmet_port_id = 1 {{(pid=101319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 09:34:11.007826 np0000004400 cinder-backup[101319]: DEBUG oslo_service.backend._eventlet.service [None req-5f770af2-e09b-483c-8da6-1399998bb49b None None] backend_defaults.replication_device = **** {{(pid=101319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 09:34:11.007898 np0000004400 cinder-backup[101319]: DEBUG oslo_service.backend._eventlet.service [None req-5f770af2-e09b-483c-8da6-1399998bb49b None None] backend_defaults.report_discard_supported = False {{(pid=101319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 09:34:11.007971 np0000004400 cinder-backup[101319]: DEBUG oslo_service.backend._eventlet.service [None req-5f770af2-e09b-483c-8da6-1399998bb49b None None] backend_defaults.reserved_percentage = 0 {{(pid=101319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 09:34:11.008050 np0000004400 cinder-backup[101319]: DEBUG oslo_service.backend._eventlet.service [None req-5f770af2-e09b-483c-8da6-1399998bb49b None None] backend_defaults.scst_target_driver = iscsi {{(pid=101319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 09:34:11.008123 np0000004400 cinder-backup[101319]: DEBUG oslo_service.backend._eventlet.service [None req-5f770af2-e09b-483c-8da6-1399998bb49b None None] backend_defaults.scst_target_iqn_name = None {{(pid=101319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 09:34:11.008205 np0000004400 cinder-backup[101319]: DEBUG oslo_service.backend._eventlet.service [None req-5f770af2-e09b-483c-8da6-1399998bb49b None None] backend_defaults.storage_protocol = iSCSI {{(pid=101319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 09:34:11.008284 np0000004400 cinder-backup[101319]: DEBUG oslo_service.backend._eventlet.service [None req-5f770af2-e09b-483c-8da6-1399998bb49b None None] backend_defaults.target_helper = tgtadm {{(pid=101319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 09:34:11.008356 np0000004400 cinder-backup[101319]: DEBUG oslo_service.backend._eventlet.service [None req-5f770af2-e09b-483c-8da6-1399998bb49b None None] backend_defaults.target_ip_address = 10.4.3.95 {{(pid=101319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 09:34:11.008447 np0000004400 cinder-backup[101319]: DEBUG oslo_service.backend._eventlet.service [None req-5f770af2-e09b-483c-8da6-1399998bb49b None None] backend_defaults.target_port = 3260 {{(pid=101319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 09:34:11.008523 np0000004400 cinder-backup[101319]: DEBUG oslo_service.backend._eventlet.service [None req-5f770af2-e09b-483c-8da6-1399998bb49b None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=101319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 09:34:11.008596 np0000004400 cinder-backup[101319]: DEBUG oslo_service.backend._eventlet.service [None req-5f770af2-e09b-483c-8da6-1399998bb49b None None] backend_defaults.target_protocol = iscsi {{(pid=101319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 09:34:11.008668 np0000004400 cinder-backup[101319]: DEBUG oslo_service.backend._eventlet.service [None req-5f770af2-e09b-483c-8da6-1399998bb49b None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=101319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 09:34:11.008740 np0000004400 cinder-backup[101319]: DEBUG oslo_service.backend._eventlet.service [None req-5f770af2-e09b-483c-8da6-1399998bb49b None None] backend_defaults.trace_flags = None {{(pid=101319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 09:34:11.008812 np0000004400 cinder-backup[101319]: DEBUG oslo_service.backend._eventlet.service [None req-5f770af2-e09b-483c-8da6-1399998bb49b None None] backend_defaults.unique_fqdn_network = True {{(pid=101319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 09:34:11.008883 np0000004400 cinder-backup[101319]: DEBUG oslo_service.backend._eventlet.service [None req-5f770af2-e09b-483c-8da6-1399998bb49b None None] backend_defaults.use_chap_auth = False {{(pid=101319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 09:34:11.008956 np0000004400 cinder-backup[101319]: DEBUG oslo_service.backend._eventlet.service [None req-5f770af2-e09b-483c-8da6-1399998bb49b None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=101319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 09:34:11.009037 np0000004400 cinder-backup[101319]: DEBUG oslo_service.backend._eventlet.service [None req-5f770af2-e09b-483c-8da6-1399998bb49b None None] backend_defaults.volume_backend_name = None {{(pid=101319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 09:34:11.009114 np0000004400 cinder-backup[101319]: DEBUG oslo_service.backend._eventlet.service [None req-5f770af2-e09b-483c-8da6-1399998bb49b None None] backend_defaults.volume_clear = zero {{(pid=101319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 09:34:11.009185 np0000004400 cinder-backup[101319]: DEBUG oslo_service.backend._eventlet.service [None req-5f770af2-e09b-483c-8da6-1399998bb49b None None] backend_defaults.volume_clear_ionice = None {{(pid=101319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 09:34:11.009273 np0000004400 cinder-backup[101319]: DEBUG oslo_service.backend._eventlet.service [None req-5f770af2-e09b-483c-8da6-1399998bb49b None None] backend_defaults.volume_clear_size = 0 {{(pid=101319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 09:34:11.009352 np0000004400 cinder-backup[101319]: DEBUG oslo_service.backend._eventlet.service [None req-5f770af2-e09b-483c-8da6-1399998bb49b None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=101319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 09:34:11.009432 np0000004400 cinder-backup[101319]: DEBUG oslo_service.backend._eventlet.service [None req-5f770af2-e09b-483c-8da6-1399998bb49b None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=101319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 09:34:11.009509 np0000004400 cinder-backup[101319]: DEBUG oslo_service.backend._eventlet.service [None req-5f770af2-e09b-483c-8da6-1399998bb49b None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=101319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 09:34:11.009583 np0000004400 cinder-backup[101319]: DEBUG oslo_service.backend._eventlet.service [None req-5f770af2-e09b-483c-8da6-1399998bb49b None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=101319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 09:34:11.009662 np0000004400 cinder-backup[101319]: DEBUG oslo_service.backend._eventlet.service [None req-5f770af2-e09b-483c-8da6-1399998bb49b None None] oslo_reports.file_event_handler = None {{(pid=101319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 09:34:11.009736 np0000004400 cinder-backup[101319]: DEBUG oslo_service.backend._eventlet.service [None req-5f770af2-e09b-483c-8da6-1399998bb49b None None] oslo_reports.file_event_handler_interval = 1 {{(pid=101319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 09:34:11.009809 np0000004400 cinder-backup[101319]: DEBUG oslo_service.backend._eventlet.service [None req-5f770af2-e09b-483c-8da6-1399998bb49b None None] oslo_reports.log_dir = None {{(pid=101319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 09:34:11.009894 np0000004400 cinder-backup[101319]: DEBUG oslo_service.backend._eventlet.service [None req-5f770af2-e09b-483c-8da6-1399998bb49b None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=101319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 09:34:11.009959 np0000004400 cinder-backup[101319]: DEBUG oslo_service.backend._eventlet.service [None req-5f770af2-e09b-483c-8da6-1399998bb49b None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=101319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 09:34:11.010043 np0000004400 cinder-backup[101319]: DEBUG oslo_service.backend._eventlet.service [None req-5f770af2-e09b-483c-8da6-1399998bb49b None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=101319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 09:34:11.010117 np0000004400 cinder-backup[101319]: DEBUG oslo_service.backend._eventlet.service [None req-5f770af2-e09b-483c-8da6-1399998bb49b None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=101319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 09:34:11.010190 np0000004400 cinder-backup[101319]: DEBUG oslo_service.backend._eventlet.service [None req-5f770af2-e09b-483c-8da6-1399998bb49b None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=101319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 09:34:11.010279 np0000004400 cinder-backup[101319]: DEBUG oslo_service.backend._eventlet.service [None req-5f770af2-e09b-483c-8da6-1399998bb49b None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=101319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 09:34:11.010356 np0000004400 cinder-backup[101319]: DEBUG oslo_service.backend._eventlet.service [None req-5f770af2-e09b-483c-8da6-1399998bb49b None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=101319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 09:34:11.010448 np0000004400 cinder-backup[101319]: DEBUG oslo_service.backend._eventlet.service [None req-5f770af2-e09b-483c-8da6-1399998bb49b None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=101319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 09:34:11.010524 np0000004400 cinder-backup[101319]: DEBUG oslo_service.backend._eventlet.service [None req-5f770af2-e09b-483c-8da6-1399998bb49b None None] oslo_messaging_rabbit.hostname = np0000004400 {{(pid=101319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 09:34:11.010597 np0000004400 cinder-backup[101319]: DEBUG oslo_service.backend._eventlet.service [None req-5f770af2-e09b-483c-8da6-1399998bb49b None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=101319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 09:34:11.010670 np0000004400 cinder-backup[101319]: DEBUG oslo_service.backend._eventlet.service [None req-5f770af2-e09b-483c-8da6-1399998bb49b None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=101319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 09:34:11.010743 np0000004400 cinder-backup[101319]: DEBUG oslo_service.backend._eventlet.service [None req-5f770af2-e09b-483c-8da6-1399998bb49b None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=101319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 09:34:11.010815 np0000004400 cinder-backup[101319]: DEBUG oslo_service.backend._eventlet.service [None req-5f770af2-e09b-483c-8da6-1399998bb49b None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=101319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 09:34:11.010890 np0000004400 cinder-backup[101319]: DEBUG oslo_service.backend._eventlet.service [None req-5f770af2-e09b-483c-8da6-1399998bb49b None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=101319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 09:34:11.010961 np0000004400 cinder-backup[101319]: DEBUG oslo_service.backend._eventlet.service [None req-5f770af2-e09b-483c-8da6-1399998bb49b None None] oslo_messaging_rabbit.processname = cinder-backup {{(pid=101319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 09:34:11.011042 np0000004400 cinder-backup[101319]: DEBUG oslo_service.backend._eventlet.service [None req-5f770af2-e09b-483c-8da6-1399998bb49b None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=101319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 09:34:11.011120 np0000004400 cinder-backup[101319]: DEBUG oslo_service.backend._eventlet.service [None req-5f770af2-e09b-483c-8da6-1399998bb49b None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=101319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 09:34:11.011193 np0000004400 cinder-backup[101319]: DEBUG oslo_service.backend._eventlet.service [None req-5f770af2-e09b-483c-8da6-1399998bb49b None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=101319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 09:34:11.011281 np0000004400 cinder-backup[101319]: DEBUG oslo_service.backend._eventlet.service [None req-5f770af2-e09b-483c-8da6-1399998bb49b None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=101319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 09:34:11.011361 np0000004400 cinder-backup[101319]: DEBUG oslo_service.backend._eventlet.service [None req-5f770af2-e09b-483c-8da6-1399998bb49b None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=101319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 09:34:11.011446 np0000004400 cinder-backup[101319]: DEBUG oslo_service.backend._eventlet.service [None req-5f770af2-e09b-483c-8da6-1399998bb49b None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=101319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 09:34:11.011530 np0000004400 cinder-backup[101319]: DEBUG oslo_service.backend._eventlet.service [None req-5f770af2-e09b-483c-8da6-1399998bb49b None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=101319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 09:34:11.011597 np0000004400 cinder-backup[101319]: DEBUG oslo_service.backend._eventlet.service [None req-5f770af2-e09b-483c-8da6-1399998bb49b None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=101319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 09:34:11.011671 np0000004400 cinder-backup[101319]: DEBUG oslo_service.backend._eventlet.service [None req-5f770af2-e09b-483c-8da6-1399998bb49b None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=101319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 09:34:11.011747 np0000004400 cinder-backup[101319]: DEBUG oslo_service.backend._eventlet.service [None req-5f770af2-e09b-483c-8da6-1399998bb49b None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=101319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 09:34:11.011816 np0000004400 cinder-backup[101319]: DEBUG oslo_service.backend._eventlet.service [None req-5f770af2-e09b-483c-8da6-1399998bb49b None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=101319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 09:34:11.011887 np0000004400 cinder-backup[101319]: DEBUG oslo_service.backend._eventlet.service [None req-5f770af2-e09b-483c-8da6-1399998bb49b None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=101319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 09:34:11.011959 np0000004400 cinder-backup[101319]: DEBUG oslo_service.backend._eventlet.service [None req-5f770af2-e09b-483c-8da6-1399998bb49b None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=101319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 09:34:11.012040 np0000004400 cinder-backup[101319]: DEBUG oslo_service.backend._eventlet.service [None req-5f770af2-e09b-483c-8da6-1399998bb49b None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=101319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 09:34:11.012114 np0000004400 cinder-backup[101319]: DEBUG oslo_service.backend._eventlet.service [None req-5f770af2-e09b-483c-8da6-1399998bb49b None None] oslo_messaging_rabbit.ssl = False {{(pid=101319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 09:34:11.012186 np0000004400 cinder-backup[101319]: DEBUG oslo_service.backend._eventlet.service [None req-5f770af2-e09b-483c-8da6-1399998bb49b None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=101319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 09:34:11.012268 np0000004400 cinder-backup[101319]: DEBUG oslo_service.backend._eventlet.service [None req-5f770af2-e09b-483c-8da6-1399998bb49b None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=101319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 09:34:11.012349 np0000004400 cinder-backup[101319]: DEBUG oslo_service.backend._eventlet.service [None req-5f770af2-e09b-483c-8da6-1399998bb49b None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=101319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 09:34:11.012438 np0000004400 cinder-backup[101319]: DEBUG oslo_service.backend._eventlet.service [None req-5f770af2-e09b-483c-8da6-1399998bb49b None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=101319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 09:34:11.012515 np0000004400 cinder-backup[101319]: DEBUG oslo_service.backend._eventlet.service [None req-5f770af2-e09b-483c-8da6-1399998bb49b None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=101319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 09:34:11.012589 np0000004400 cinder-backup[101319]: DEBUG oslo_service.backend._eventlet.service [None req-5f770af2-e09b-483c-8da6-1399998bb49b None None] oslo_messaging_rabbit.ssl_version = {{(pid=101319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 09:34:11.012659 np0000004400 cinder-backup[101319]: DEBUG oslo_service.backend._eventlet.service [None req-5f770af2-e09b-483c-8da6-1399998bb49b None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=101319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 09:34:11.012737 np0000004400 cinder-backup[101319]: DEBUG oslo_service.backend._eventlet.service [None req-5f770af2-e09b-483c-8da6-1399998bb49b None None] oslo_messaging_notifications.driver = [] {{(pid=101319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 09:34:11.012810 np0000004400 cinder-backup[101319]: DEBUG oslo_service.backend._eventlet.service [None req-5f770af2-e09b-483c-8da6-1399998bb49b None None] oslo_messaging_notifications.retry = -1 {{(pid=101319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 09:34:11.012883 np0000004400 cinder-backup[101319]: DEBUG oslo_service.backend._eventlet.service [None req-5f770af2-e09b-483c-8da6-1399998bb49b None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=101319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 09:34:11.012958 np0000004400 cinder-backup[101319]: DEBUG oslo_service.backend._eventlet.service [None req-5f770af2-e09b-483c-8da6-1399998bb49b None None] oslo_messaging_notifications.transport_url = **** {{(pid=101319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 09:34:11.013042 np0000004400 cinder-backup[101319]: DEBUG oslo_service.backend._eventlet.service [None req-5f770af2-e09b-483c-8da6-1399998bb49b None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=101319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 09:34:11.013123 np0000004400 cinder-backup[101319]: DEBUG oslo_service.backend._eventlet.service [None req-5f770af2-e09b-483c-8da6-1399998bb49b None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=101319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 09:34:11.013195 np0000004400 cinder-backup[101319]: DEBUG oslo_service.backend._eventlet.service [None req-5f770af2-e09b-483c-8da6-1399998bb49b None None] barbican.barbican_api_version = None {{(pid=101319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 09:34:11.013278 np0000004400 cinder-backup[101319]: DEBUG oslo_service.backend._eventlet.service [None req-5f770af2-e09b-483c-8da6-1399998bb49b None None] barbican.barbican_endpoint = None {{(pid=101319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 09:34:11.013363 np0000004400 cinder-backup[101319]: DEBUG oslo_service.backend._eventlet.service [None req-5f770af2-e09b-483c-8da6-1399998bb49b None None] barbican.barbican_endpoint_type = public {{(pid=101319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 09:34:11.013454 np0000004400 cinder-backup[101319]: DEBUG oslo_service.backend._eventlet.service [None req-5f770af2-e09b-483c-8da6-1399998bb49b None None] barbican.barbican_region_name = None {{(pid=101319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 09:34:11.013529 np0000004400 cinder-backup[101319]: DEBUG oslo_service.backend._eventlet.service [None req-5f770af2-e09b-483c-8da6-1399998bb49b None None] barbican.cafile = None {{(pid=101319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 09:34:11.013603 np0000004400 cinder-backup[101319]: DEBUG oslo_service.backend._eventlet.service [None req-5f770af2-e09b-483c-8da6-1399998bb49b None None] barbican.certfile = None {{(pid=101319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 09:34:11.013675 np0000004400 cinder-backup[101319]: DEBUG oslo_service.backend._eventlet.service [None req-5f770af2-e09b-483c-8da6-1399998bb49b None None] barbican.collect_timing = False {{(pid=101319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 09:34:11.013788 np0000004400 cinder-backup[101319]: DEBUG oslo_service.backend._eventlet.service [None req-5f770af2-e09b-483c-8da6-1399998bb49b None None] barbican.insecure = False {{(pid=101319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 09:34:11.013831 np0000004400 cinder-backup[101319]: DEBUG oslo_service.backend._eventlet.service [None req-5f770af2-e09b-483c-8da6-1399998bb49b None None] barbican.keyfile = None {{(pid=101319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 09:34:11.013885 np0000004400 cinder-backup[101319]: DEBUG oslo_service.backend._eventlet.service [None req-5f770af2-e09b-483c-8da6-1399998bb49b None None] barbican.number_of_retries = 60 {{(pid=101319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 09:34:11.013958 np0000004400 cinder-backup[101319]: DEBUG oslo_service.backend._eventlet.service [None req-5f770af2-e09b-483c-8da6-1399998bb49b None None] barbican.retry_delay = 1 {{(pid=101319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 09:34:11.014039 np0000004400 cinder-backup[101319]: DEBUG oslo_service.backend._eventlet.service [None req-5f770af2-e09b-483c-8da6-1399998bb49b None None] barbican.send_service_user_token = False {{(pid=101319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 09:34:11.014114 np0000004400 cinder-backup[101319]: DEBUG oslo_service.backend._eventlet.service [None req-5f770af2-e09b-483c-8da6-1399998bb49b None None] barbican.split_loggers = False {{(pid=101319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 09:34:11.014186 np0000004400 cinder-backup[101319]: DEBUG oslo_service.backend._eventlet.service [None req-5f770af2-e09b-483c-8da6-1399998bb49b None None] barbican.timeout = None {{(pid=101319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 09:34:11.014257 np0000004400 cinder-backup[101319]: DEBUG oslo_service.backend._eventlet.service [None req-5f770af2-e09b-483c-8da6-1399998bb49b None None] barbican.verify_ssl = True {{(pid=101319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 09:34:11.014345 np0000004400 cinder-backup[101319]: DEBUG oslo_service.backend._eventlet.service [None req-5f770af2-e09b-483c-8da6-1399998bb49b None None] barbican.verify_ssl_path = None {{(pid=101319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 09:34:11.014442 np0000004400 cinder-backup[101319]: DEBUG oslo_service.backend._eventlet.service [None req-5f770af2-e09b-483c-8da6-1399998bb49b None None] barbican_service_user.auth_section = None {{(pid=101319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 09:34:11.014521 np0000004400 cinder-backup[101319]: DEBUG oslo_service.backend._eventlet.service [None req-5f770af2-e09b-483c-8da6-1399998bb49b None None] barbican_service_user.auth_type = None {{(pid=101319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 09:34:11.014595 np0000004400 cinder-backup[101319]: DEBUG oslo_service.backend._eventlet.service [None req-5f770af2-e09b-483c-8da6-1399998bb49b None None] barbican_service_user.cafile = None {{(pid=101319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 09:34:11.014667 np0000004400 cinder-backup[101319]: DEBUG oslo_service.backend._eventlet.service [None req-5f770af2-e09b-483c-8da6-1399998bb49b None None] barbican_service_user.certfile = None {{(pid=101319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 09:34:11.014742 np0000004400 cinder-backup[101319]: DEBUG oslo_service.backend._eventlet.service [None req-5f770af2-e09b-483c-8da6-1399998bb49b None None] barbican_service_user.collect_timing = False {{(pid=101319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 09:34:11.014814 np0000004400 cinder-backup[101319]: DEBUG oslo_service.backend._eventlet.service [None req-5f770af2-e09b-483c-8da6-1399998bb49b None None] barbican_service_user.insecure = False {{(pid=101319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 09:34:11.014885 np0000004400 cinder-backup[101319]: DEBUG oslo_service.backend._eventlet.service [None req-5f770af2-e09b-483c-8da6-1399998bb49b None None] barbican_service_user.keyfile = None {{(pid=101319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 09:34:11.014963 np0000004400 cinder-backup[101319]: DEBUG oslo_service.backend._eventlet.service [None req-5f770af2-e09b-483c-8da6-1399998bb49b None None] barbican_service_user.split_loggers = False {{(pid=101319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 09:34:11.015038 np0000004400 cinder-backup[101319]: DEBUG oslo_service.backend._eventlet.service [None req-5f770af2-e09b-483c-8da6-1399998bb49b None None] barbican_service_user.timeout = None {{(pid=101319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 09:34:11.015116 np0000004400 cinder-backup[101319]: DEBUG oslo_service.backend._eventlet.service [None req-5f770af2-e09b-483c-8da6-1399998bb49b None None] vault.approle_role_id = **** {{(pid=101319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 09:34:11.015189 np0000004400 cinder-backup[101319]: DEBUG oslo_service.backend._eventlet.service [None req-5f770af2-e09b-483c-8da6-1399998bb49b None None] vault.approle_secret_id = **** {{(pid=101319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 09:34:11.015262 np0000004400 cinder-backup[101319]: DEBUG oslo_service.backend._eventlet.service [None req-5f770af2-e09b-483c-8da6-1399998bb49b None None] vault.kv_mountpoint = secret {{(pid=101319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 09:34:11.015354 np0000004400 cinder-backup[101319]: DEBUG oslo_service.backend._eventlet.service [None req-5f770af2-e09b-483c-8da6-1399998bb49b None None] vault.kv_path = None {{(pid=101319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 09:34:11.015444 np0000004400 cinder-backup[101319]: DEBUG oslo_service.backend._eventlet.service [None req-5f770af2-e09b-483c-8da6-1399998bb49b None None] vault.kv_version = 2 {{(pid=101319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 09:34:11.015521 np0000004400 cinder-backup[101319]: DEBUG oslo_service.backend._eventlet.service [None req-5f770af2-e09b-483c-8da6-1399998bb49b None None] vault.namespace = None {{(pid=101319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 09:34:11.015593 np0000004400 cinder-backup[101319]: DEBUG oslo_service.backend._eventlet.service [None req-5f770af2-e09b-483c-8da6-1399998bb49b None None] vault.root_token_id = **** {{(pid=101319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 09:34:11.015665 np0000004400 cinder-backup[101319]: DEBUG oslo_service.backend._eventlet.service [None req-5f770af2-e09b-483c-8da6-1399998bb49b None None] vault.ssl_ca_crt_file = None {{(pid=101319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 09:34:11.015738 np0000004400 cinder-backup[101319]: DEBUG oslo_service.backend._eventlet.service [None req-5f770af2-e09b-483c-8da6-1399998bb49b None None] vault.timeout = 60.0 {{(pid=101319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 09:34:11.015810 np0000004400 cinder-backup[101319]: DEBUG oslo_service.backend._eventlet.service [None req-5f770af2-e09b-483c-8da6-1399998bb49b None None] vault.use_ssl = False {{(pid=101319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 09:34:11.015884 np0000004400 cinder-backup[101319]: DEBUG oslo_service.backend._eventlet.service [None req-5f770af2-e09b-483c-8da6-1399998bb49b None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=101319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 09:34:11.015958 np0000004400 cinder-backup[101319]: DEBUG oslo_service.backend._eventlet.service [None req-5f770af2-e09b-483c-8da6-1399998bb49b None None] ******************************************************************************** {{(pid=101319) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3260}} Jul 03 09:34:11.016199 np0000004400 cinder-backup[101319]: INFO cinder.service [-] Starting cinder-backup node (version 28.1.0) Jul 03 09:34:11.023850 np0000004400 cinder-backup[101319]: DEBUG oslo_concurrency.lockutils [None req-cf1d8ae2-ce07-4cdc-b109-b008715a394c None None] Acquiring lock "cleanup_incomplete_backups_101319" by "cinder.backup.manager.BackupManager._cleanup_incomplete_backup_operations" {{(pid=101319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 09:34:11.024164 np0000004400 cinder-backup[101319]: DEBUG oslo_concurrency.lockutils [None req-cf1d8ae2-ce07-4cdc-b109-b008715a394c None None] Lock "cleanup_incomplete_backups_101319" acquired by "cinder.backup.manager.BackupManager._cleanup_incomplete_backup_operations" :: waited 0.000s {{(pid=101319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 09:34:11.024262 np0000004400 cinder-backup[101319]: INFO cinder.backup.manager [None req-cf1d8ae2-ce07-4cdc-b109-b008715a394c None None] Cleaning up incomplete backup operations. Jul 03 09:34:11.036474 np0000004400 cinder-backup[101319]: DEBUG oslo_concurrency.lockutils [None req-cf1d8ae2-ce07-4cdc-b109-b008715a394c None None] Lock "cleanup_incomplete_backups_101319" "released" by "cinder.backup.manager.BackupManager._cleanup_incomplete_backup_operations" :: held 0.012s {{(pid=101319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 09:34:11.066959 np0000004400 cinder-backup[101319]: DEBUG oslo_db.sqlalchemy.engines [None req-cf1d8ae2-ce07-4cdc-b109-b008715a394c None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=101319) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 03 09:34:11.072222 np0000004400 cinder-backup[101319]: DEBUG cinder.manager [None req-cf1d8ae2-ce07-4cdc-b109-b008715a394c None None] Notifying Schedulers of capabilities ... {{(pid=101319) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 03 09:34:11.077469 np0000004400 cinder-backup[101319]: INFO cinder.keymgr.migration [None req-af89ee87-e9e2-4008-8069-93e7fd094397 None None] Not migrating encryption keys because the ConfKeyManager is still in use. Jul 03 09:34:11.084537 np0000004400 cinder-backup[101319]: DEBUG cinder.service [None req-cf1d8ae2-ce07-4cdc-b109-b008715a394c None None] Creating RPC server for service cinder-backup {{(pid=101319) start /opt/stack/cinder/cinder/service.py:231}} Jul 03 09:34:11.091870 np0000004400 cinder-backup[101319]: DEBUG cinder.service [None req-cf1d8ae2-ce07-4cdc-b109-b008715a394c None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=101319) start /opt/stack/cinder/cinder/service.py:237}} Jul 03 09:34:21.088067 np0000004400 cinder-backup[101319]: DEBUG dbcounter [-] [101319] Writing DB stats cinder:SELECT=11,cinder:INSERT=1 {{(pid=101319) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 03 09:35:40.113583 np0000004400 cinder-backup[101319]: DEBUG oslo_service.periodic_task [None req-ffd932d2-122c-4e68-b5ba-628aff7ae7b8 None None] Running periodic task BackupManager.publish_service_capabilities {{(pid=101319) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 03 09:35:40.114088 np0000004400 cinder-backup[101319]: DEBUG cinder.manager [None req-ffd932d2-122c-4e68-b5ba-628aff7ae7b8 None None] Notifying Schedulers of capabilities ... {{(pid=101319) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 03 09:36:21.122637 np0000004400 cinder-backup[101319]: DEBUG dbcounter [-] [101319] Writing DB stats cinder:SELECT=1,cinder:UPDATE=1 {{(pid=101319) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 03 09:36:40.119458 np0000004400 cinder-backup[101319]: DEBUG oslo_service.periodic_task [None req-ffd932d2-122c-4e68-b5ba-628aff7ae7b8 None None] Running periodic task BackupManager.publish_service_capabilities {{(pid=101319) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 03 09:36:40.119978 np0000004400 cinder-backup[101319]: DEBUG cinder.manager [None req-ffd932d2-122c-4e68-b5ba-628aff7ae7b8 None None] Notifying Schedulers of capabilities ... {{(pid=101319) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 03 09:37:40.125105 np0000004400 cinder-backup[101319]: DEBUG oslo_service.periodic_task [None req-ffd932d2-122c-4e68-b5ba-628aff7ae7b8 None None] Running periodic task BackupManager.publish_service_capabilities {{(pid=101319) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 03 09:37:40.125586 np0000004400 cinder-backup[101319]: DEBUG cinder.manager [None req-ffd932d2-122c-4e68-b5ba-628aff7ae7b8 None None] Notifying Schedulers of capabilities ... {{(pid=101319) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 03 09:38:21.130774 np0000004400 cinder-backup[101319]: DEBUG dbcounter [-] [101319] Writing DB stats cinder:SELECT=1,cinder:UPDATE=1 {{(pid=101319) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 03 09:38:40.131875 np0000004400 cinder-backup[101319]: DEBUG oslo_service.periodic_task [None req-ffd932d2-122c-4e68-b5ba-628aff7ae7b8 None None] Running periodic task BackupManager.publish_service_capabilities {{(pid=101319) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 03 09:38:40.132393 np0000004400 cinder-backup[101319]: DEBUG cinder.manager [None req-ffd932d2-122c-4e68-b5ba-628aff7ae7b8 None None] Notifying Schedulers of capabilities ... {{(pid=101319) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 03 09:39:40.137336 np0000004400 cinder-backup[101319]: DEBUG oslo_service.periodic_task [None req-ffd932d2-122c-4e68-b5ba-628aff7ae7b8 None None] Running periodic task BackupManager.publish_service_capabilities {{(pid=101319) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 03 09:39:40.137782 np0000004400 cinder-backup[101319]: DEBUG cinder.manager [None req-ffd932d2-122c-4e68-b5ba-628aff7ae7b8 None None] Notifying Schedulers of capabilities ... {{(pid=101319) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 03 09:39:44.589773 np0000004400 cinder-backup[101319]: INFO cinder.backup.manager [None req-dcff4a2c-207a-42ac-9e25-189c0c3dac27 tempest-VolumesBackupsAdminTest-1500745506 None] Create backup started, backup: fe9dd1c3-699a-4fc3-ae7f-2830334a957c volume: 6b682bae-d2d2-49c0-8a1c-8f9a74831d6c. Jul 03 09:39:44.598094 np0000004400 cinder-backup[101319]: INFO cinder.backup.manager [None req-dcff4a2c-207a-42ac-9e25-189c0c3dac27 tempest-VolumesBackupsAdminTest-1500745506 None] Call Volume Manager to get_backup_device for Backup(availability_zone='nova',container='tempest-volumesbackupsadmintest-backup-container-31762394',created_at=2026-07-03T09:39:44Z,data_timestamp=2026-07-03T09:39:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesBackupsAdminTest-Backup-77258928',encryption_key_id=None,fail_reason=None,host='np0000004400',id=fe9dd1c3-699a-4fc3-ae7f-2830334a957c,metadata={},num_dependent_backups=0,object_count=0,parent=None,parent_id=None,project_id='b25712a6deba4237b3d9f8f02bb54ed6',restore_volume_id=None,service='cinder.backup.drivers.swift.SwiftBackupDriver',service_metadata=None,size=1,snapshot_id=None,status='creating',temp_snapshot_id=None,temp_volume_id=None,updated_at=None,user_id='356a534952b84c0680fa3b9655a0fc13',volume_id=6b682bae-d2d2-49c0-8a1c-8f9a74831d6c) Jul 03 09:39:44.641303 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.drivers.swift [None req-dcff4a2c-207a-42ac-9e25-189c0c3dac27 tempest-VolumesBackupsAdminTest-1500745506 None] Using swift URL https://10.4.3.95:8080/v1/AUTH_b25712a6deba4237b3d9f8f02bb54ed6 {{(pid=101319) initialize /opt/stack/cinder/cinder/backup/drivers/swift.py:300}} Jul 03 09:39:44.641539 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.drivers.swift [None req-dcff4a2c-207a-42ac-9e25-189c0c3dac27 tempest-VolumesBackupsAdminTest-1500745506 None] Connect to https://10.4.3.95:8080/v1/AUTH_ in "per_user" mode {{(pid=101319) initialize /opt/stack/cinder/cinder/backup/drivers/swift.py:301}} Jul 03 09:39:44.642044 np0000004400 cinder-backup[101319]: DEBUG os_brick.utils [None req-dcff4a2c-207a-42ac-9e25-189c0c3dac27 tempest-VolumesBackupsAdminTest-1500745506 None] ==> get_connector_properties: call "{'root_helper': 'sudo cinder-rootwrap /etc/cinder/rootwrap.conf', 'my_ip': '10.4.3.95', 'multipath': False, 'enforce_multipath': False, 'host': None, 'execute': None}" {{(pid=101319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}} Jul 03 09:39:44.643799 np0000004400 cinder-backup[101319]: INFO oslo.privsep.daemon [None req-dcff4a2c-207a-42ac-9e25-189c0c3dac27 tempest-VolumesBackupsAdminTest-1500745506 None] Running privsep helper: ['sudo', 'cinder-rootwrap', '/etc/cinder/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/cinder/cinder.conf', '--privsep_context', 'os_brick.privileged.default', '--privsep_sock_path', '/tmp/tmpnprzg21p/privsep.sock'] Jul 03 09:39:44.651562 np0000004400 sudo[120311]: stack : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf privsep-helper --config-file /etc/cinder/cinder.conf --privsep_context os_brick.privileged.default --privsep_sock_path /tmp/tmpnprzg21p/privsep.sock Jul 03 09:39:44.652177 np0000004400 sudo[120311]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1002) Jul 03 09:39:44.900485 np0000004400 cinder-backup[101319]: WARNING oslo.privsep.daemon [-] privsep log: /opt/stack/data/venv/lib/python3.12/site-packages/oslo_rootwrap/__init__.py:25: EventletDeprecationWarning: Jul 03 09:39:44.900578 np0000004400 cinder-backup[101319]: WARNING oslo.privsep.daemon [-] privsep log: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Jul 03 09:39:44.900699 np0000004400 cinder-backup[101319]: WARNING oslo.privsep.daemon [-] privsep log: we strongly recommend against using it for new projects. Jul 03 09:39:44.900793 np0000004400 cinder-backup[101319]: WARNING oslo.privsep.daemon [-] privsep log: Jul 03 09:39:44.900895 np0000004400 cinder-backup[101319]: WARNING oslo.privsep.daemon [-] privsep log: If you are already using Eventlet, we recommend migrating to a different Jul 03 09:39:44.901008 np0000004400 cinder-backup[101319]: WARNING oslo.privsep.daemon [-] privsep log: framework. For more detail see Jul 03 09:39:44.901097 np0000004400 cinder-backup[101319]: WARNING oslo.privsep.daemon [-] privsep log: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Jul 03 09:39:44.901191 np0000004400 cinder-backup[101319]: WARNING oslo.privsep.daemon [-] privsep log: Jul 03 09:39:44.901283 np0000004400 cinder-backup[101319]: WARNING oslo.privsep.daemon [-] privsep log: import eventlet.patcher Jul 03 09:39:45.255955 np0000004400 cinder-backup[101319]: WARNING oslo.privsep.daemon [-] privsep log: /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/importutils.py:77: EventletDeprecationWarning: Jul 03 09:39:45.256150 np0000004400 cinder-backup[101319]: WARNING oslo.privsep.daemon [-] privsep log: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Jul 03 09:39:45.256198 np0000004400 cinder-backup[101319]: WARNING oslo.privsep.daemon [-] privsep log: we strongly recommend against using it for new projects. Jul 03 09:39:45.256559 np0000004400 cinder-backup[101319]: WARNING oslo.privsep.daemon [-] privsep log: Jul 03 09:39:45.256559 np0000004400 cinder-backup[101319]: WARNING oslo.privsep.daemon [-] privsep log: If you are already using Eventlet, we recommend migrating to a different Jul 03 09:39:45.256559 np0000004400 cinder-backup[101319]: WARNING oslo.privsep.daemon [-] privsep log: framework. For more detail see Jul 03 09:39:45.256559 np0000004400 cinder-backup[101319]: WARNING oslo.privsep.daemon [-] privsep log: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Jul 03 09:39:45.256559 np0000004400 cinder-backup[101319]: WARNING oslo.privsep.daemon [-] privsep log: Jul 03 09:39:45.256739 np0000004400 cinder-backup[101319]: WARNING oslo.privsep.daemon [-] privsep log: __import__(import_str) Jul 03 09:39:45.479718 np0000004400 sudo[120311]: pam_unix(sudo:session): session closed for user root Jul 03 09:39:45.487550 np0000004400 cinder-backup[101319]: INFO oslo.privsep.daemon [None req-dcff4a2c-207a-42ac-9e25-189c0c3dac27 tempest-VolumesBackupsAdminTest-1500745506 None] Spawned new privsep daemon via rootwrap Jul 03 09:39:45.487871 np0000004400 cinder-backup[101319]: DEBUG oslo.privsep.daemon [None req-dcff4a2c-207a-42ac-9e25-189c0c3dac27 tempest-VolumesBackupsAdminTest-1500745506 None] Accepted privsep connection to /tmp/tmpnprzg21p/privsep.sock {{(pid=101319) __init__ /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:425}} Jul 03 09:39:45.629341 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.scaleio [None req-dcff4a2c-207a-42ac-9e25-189c0c3dac27 tempest-VolumesBackupsAdminTest-1500745506 None] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=101319) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}} Jul 03 09:39:45.629831 np0000004400 cinder-backup[101319]: WARNING os_brick.initiator.connectors.nvmeof [None req-dcff4a2c-207a-42ac-9e25-189c0c3dac27 tempest-VolumesBackupsAdminTest-1500745506 None] Could not find nvme_core/parameters/multipath: FileNotFoundError: [Errno 2] No such file or directory: '/sys/module/nvme_core/parameters/multipath' Jul 03 09:39:45.651369 np0000004400 cinder-backup[101319]: DEBUG oslo_concurrency.processutils [None req-dcff4a2c-207a-42ac-9e25-189c0c3dac27 tempest-VolumesBackupsAdminTest-1500745506 None] Running cmd (subprocess): nvme version {{(pid=101319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 09:39:45.659593 np0000004400 cinder-backup[101319]: DEBUG oslo_concurrency.processutils [None req-dcff4a2c-207a-42ac-9e25-189c0c3dac27 tempest-VolumesBackupsAdminTest-1500745506 None] 'nvme version' failed. Not Retrying. {{(pid=101319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 03 09:39:45.659593 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.nvmeof [None req-dcff4a2c-207a-42ac-9e25-189c0c3dac27 tempest-VolumesBackupsAdminTest-1500745506 None] nvme not present on system {{(pid=101319) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}} Jul 03 09:39:45.668730 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.lightos [None req-dcff4a2c-207a-42ac-9e25-189c0c3dac27 tempest-VolumesBackupsAdminTest-1500745506 None] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=101319) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}} Jul 03 09:39:45.670049 np0000004400 cinder-backup[101319]: INFO os_brick.initiator.connectors.lightos [None req-dcff4a2c-207a-42ac-9e25-189c0c3dac27 tempest-VolumesBackupsAdminTest-1500745506 None] Current host hostNQN and IP(s) are ['10.4.3.95', 'fe80::f816:3eff:fe47:268c', '192.168.40.6', 'fe80::f816:3eff:febf:7be2', '192.168.50.6', 'fe80::f816:3eff:fe99:8914', '192.168.10.6', 'fe80::f816:3eff:fe2f:e696', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::bc9d:84ff:fec2:6b49', 'fe80::fc16:3eff:fe72:8d5f', 'fe80::48a4:5fff:fedc:623c', 'fe80::fc16:3eff:fe7d:3947', 'fe80::18ab:2bff:fec0:3e86', 'fe80::fc16:3eff:fe33:5bf4', 'fe80::c02:d7ff:fedc:51d1', 'fe80::fc16:3eff:fe4d:ac92', 'fe80::447e:c9ff:fe51:ed86', 'fe80::fc16:3eff:fef6:2138', 'fe80::fc16:3eff:fe32:7456', 'fe80::5c7b:e3ff:fe91:4d8f'] Jul 03 09:39:45.670178 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.lightos [None req-dcff4a2c-207a-42ac-9e25-189c0c3dac27 tempest-VolumesBackupsAdminTest-1500745506 None] LIGHTOS: did not find dsc, continuing anyway. {{(pid=101319) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}} Jul 03 09:39:45.670287 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.lightos [None req-dcff4a2c-207a-42ac-9e25-189c0c3dac27 tempest-VolumesBackupsAdminTest-1500745506 None] LIGHTOS: no hostnqn found. {{(pid=101319) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}} Jul 03 09:39:45.672917 np0000004400 cinder-backup[101319]: DEBUG os_brick.utils [None req-dcff4a2c-207a-42ac-9e25-189c0c3dac27 tempest-VolumesBackupsAdminTest-1500745506 None] <== get_connector_properties: return (1027ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.95', 'host': 'np0000004400', 'multipath': False, 'enforce_multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:ae7e5bb0ebe6', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': '6b284368-d0ba-4d18-af6f-4998d3955c52', 'nvme_native_multipath': False} {{(pid=101319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}} Jul 03 09:39:46.183127 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connector [None req-dcff4a2c-207a-42ac-9e25-189c0c3dac27 tempest-VolumesBackupsAdminTest-1500745506 None] Factory for iscsi on None {{(pid=101319) factory /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connector.py:243}} Jul 03 09:39:46.183637 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-dcff4a2c-207a-42ac-9e25-189c0c3dac27 tempest-VolumesBackupsAdminTest-1500745506 None] ==> connect_volume: call "{'self': , 'connection_properties': {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-6b682bae-d2d2-49c0-8a1c-8f9a74831d6c', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '6b682bae-d2d2-49c0-8a1c-8f9a74831d6c', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': False}}" {{(pid=101319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}} Jul 03 09:39:46.183902 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.base [None req-dcff4a2c-207a-42ac-9e25-189c0c3dac27 tempest-VolumesBackupsAdminTest-1500745506 None] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=101319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jul 03 09:39:46.184573 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.base [None req-dcff4a2c-207a-42ac-9e25-189c0c3dac27 tempest-VolumesBackupsAdminTest-1500745506 None] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=101319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jul 03 09:39:46.185671 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.base [None req-dcff4a2c-207a-42ac-9e25-189c0c3dac27 tempest-VolumesBackupsAdminTest-1500745506 None] Connection properties {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-6b682bae-d2d2-49c0-8a1c-8f9a74831d6c', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '6b682bae-d2d2-49c0-8a1c-8f9a74831d6c', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': False} {{(pid=101319) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}} Jul 03 09:39:46.201575 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.base [None req-dcff4a2c-207a-42ac-9e25-189c0c3dac27 tempest-VolumesBackupsAdminTest-1500745506 None] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-6b682bae-d2d2-49c0-8a1c-8f9a74831d6c" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=101319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jul 03 09:39:46.201950 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.base [None req-dcff4a2c-207a-42ac-9e25-189c0c3dac27 tempest-VolumesBackupsAdminTest-1500745506 None] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-6b682bae-d2d2-49c0-8a1c-8f9a74831d6c" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=101319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jul 03 09:39:46.202152 np0000004400 cinder-backup[101319]: INFO os_brick.initiator.connectors.iscsi [None req-dcff4a2c-207a-42ac-9e25-189c0c3dac27 tempest-VolumesBackupsAdminTest-1500745506 None] Trying to connect to iSCSI portal 192.168.40.100:3260 Jul 03 09:39:46.217077 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-dcff4a2c-207a-42ac-9e25-189c0c3dac27 tempest-VolumesBackupsAdminTest-1500745506 None] iscsiadm (): stdout= stderr=iscsiadm: No records found Jul 03 09:39:46.217077 np0000004400 cinder-backup[101319]: {{(pid=101319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 03 09:39:46.226968 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-dcff4a2c-207a-42ac-9e25-189c0c3dac27 tempest-VolumesBackupsAdminTest-1500745506 None] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-6b682bae-d2d2-49c0-8a1c-8f9a74831d6c] added Jul 03 09:39:46.226968 np0000004400 cinder-backup[101319]: stderr=iscsiadm: Config file line 363 does not have value Jul 03 09:39:46.226968 np0000004400 cinder-backup[101319]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs' Jul 03 09:39:46.226968 np0000004400 cinder-backup[101319]: iscsiadm: Config file line 363 does not have value Jul 03 09:39:46.226968 np0000004400 cinder-backup[101319]: iscsiadm: Config file line 363 does not have value Jul 03 09:39:46.226968 np0000004400 cinder-backup[101319]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs' Jul 03 09:39:46.226968 np0000004400 cinder-backup[101319]: {{(pid=101319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 03 09:39:46.227224 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-dcff4a2c-207a-42ac-9e25-189c0c3dac27 tempest-VolumesBackupsAdminTest-1500745506 None] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=101319) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}} Jul 03 09:39:46.227641 np0000004400 cinder-backup[101319]: DEBUG os_brick.utils [None req-dcff4a2c-207a-42ac-9e25-189c0c3dac27 tempest-VolumesBackupsAdminTest-1500745506 None] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0253(s), this was the 1st time calling it. {{(pid=101319) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}} Jul 03 09:39:46.227713 np0000004400 cinder-backup[101319]: DEBUG os_brick.utils [None req-dcff4a2c-207a-42ac-9e25-189c0c3dac27 tempest-VolumesBackupsAdminTest-1500745506 None] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=101319) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}} Jul 03 09:39:47.228685 np0000004400 cinder-backup[101319]: INFO os_brick.initiator.connectors.iscsi [None req-dcff4a2c-207a-42ac-9e25-189c0c3dac27 tempest-VolumesBackupsAdminTest-1500745506 None] Trying to connect to iSCSI portal 192.168.40.100:3260 Jul 03 09:39:47.242038 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-dcff4a2c-207a-42ac-9e25-189c0c3dac27 tempest-VolumesBackupsAdminTest-1500745506 None] iscsiadm (): stdout=# BEGIN RECORD 2.1.9 Jul 03 09:39:47.242038 np0000004400 cinder-backup[101319]: node.name = iqn.2023-03.storpool.com:os--volume-6b682bae-d2d2-49c0-8a1c-8f9a74831d6c Jul 03 09:39:47.242038 np0000004400 cinder-backup[101319]: node.tpgt = -1 Jul 03 09:39:47.242038 np0000004400 cinder-backup[101319]: node.startup = manual Jul 03 09:39:47.242038 np0000004400 cinder-backup[101319]: node.leading_login = No Jul 03 09:39:47.242038 np0000004400 cinder-backup[101319]: iface.iscsi_ifacename = default Jul 03 09:39:47.242038 np0000004400 cinder-backup[101319]: iface.net_ifacename = Jul 03 09:39:47.242038 np0000004400 cinder-backup[101319]: iface.ipaddress = Jul 03 09:39:47.242038 np0000004400 cinder-backup[101319]: iface.prefix_len = 0 Jul 03 09:39:47.242038 np0000004400 cinder-backup[101319]: iface.hwaddress = Jul 03 09:39:47.242038 np0000004400 cinder-backup[101319]: iface.transport_name = tcp Jul 03 09:39:47.242038 np0000004400 cinder-backup[101319]: iface.initiatorname = Jul 03 09:39:47.242038 np0000004400 cinder-backup[101319]: iface.state = Jul 03 09:39:47.242038 np0000004400 cinder-backup[101319]: iface.vlan_id = 0 Jul 03 09:39:47.242038 np0000004400 cinder-backup[101319]: iface.vlan_priority = 0 Jul 03 09:39:47.242038 np0000004400 cinder-backup[101319]: iface.vlan_state = Jul 03 09:39:47.242038 np0000004400 cinder-backup[101319]: iface.iface_num = 0 Jul 03 09:39:47.242038 np0000004400 cinder-backup[101319]: iface.mtu = 0 Jul 03 09:39:47.242038 np0000004400 cinder-backup[101319]: iface.port = 0 Jul 03 09:39:47.242038 np0000004400 cinder-backup[101319]: iface.bootproto = Jul 03 09:39:47.242038 np0000004400 cinder-backup[101319]: iface.subnet_mask = Jul 03 09:39:47.242038 np0000004400 cinder-backup[101319]: iface.gateway = Jul 03 09:39:47.242038 np0000004400 cinder-backup[101319]: iface.dhcp_alt_client_id_state = Jul 03 09:39:47.242038 np0000004400 cinder-backup[101319]: iface.dhcp_alt_client_id = Jul 03 09:39:47.242038 np0000004400 cinder-backup[101319]: iface.dhcp_dns = Jul 03 09:39:47.242038 np0000004400 cinder-backup[101319]: iface.dhcp_learn_iqn = Jul 03 09:39:47.242038 np0000004400 cinder-backup[101319]: iface.dhcp_req_vendor_id_state = Jul 03 09:39:47.242038 np0000004400 cinder-backup[101319]: iface.dhcp_vendor_id_state = Jul 03 09:39:47.242038 np0000004400 cinder-backup[101319]: iface.dhcp_vendor_id = Jul 03 09:39:47.242038 np0000004400 cinder-backup[101319]: iface.dhcp_slp_da = Jul 03 09:39:47.242038 np0000004400 cinder-backup[101319]: iface.fragmentation = Jul 03 09:39:47.242038 np0000004400 cinder-backup[101319]: iface.gratuitous_arp = Jul 03 09:39:47.242038 np0000004400 cinder-backup[101319]: iface.incoming_forwarding = Jul 03 09:39:47.242038 np0000004400 cinder-backup[101319]: iface.tos_state = Jul 03 09:39:47.242038 np0000004400 cinder-backup[101319]: iface.tos = 0 Jul 03 09:39:47.242038 np0000004400 cinder-backup[101319]: iface.ttl = 0 Jul 03 09:39:47.242038 np0000004400 cinder-backup[101319]: iface.delayed_ack = Jul 03 09:39:47.242038 np0000004400 cinder-backup[101319]: iface.tcp_nagle = Jul 03 09:39:47.242038 np0000004400 cinder-backup[101319]: iface.tcp_wsf_state = Jul 03 09:39:47.242038 np0000004400 cinder-backup[101319]: iface.tcp_wsf = 0 Jul 03 09:39:47.242038 np0000004400 cinder-backup[101319]: iface.tcp_timer_scale = 0 Jul 03 09:39:47.242038 np0000004400 cinder-backup[101319]: iface.tcp_timestamp = Jul 03 09:39:47.242038 np0000004400 cinder-backup[101319]: iface.redirect = Jul 03 09:39:47.242038 np0000004400 cinder-backup[101319]: iface.def_task_mgmt_timeout = 0 Jul 03 09:39:47.242038 np0000004400 cinder-backup[101319]: iface.header_digest = Jul 03 09:39:47.242038 np0000004400 cinder-backup[101319]: iface.data_digest = Jul 03 09:39:47.242038 np0000004400 cinder-backup[101319]: iface.immediate_data = Jul 03 09:39:47.242038 np0000004400 cinder-backup[101319]: iface.initial_r2t = Jul 03 09:39:47.242038 np0000004400 cinder-backup[101319]: iface.data_seq_inorder = Jul 03 09:39:47.242038 np0000004400 cinder-backup[101319]: iface.data_pdu_inorder = Jul 03 09:39:47.242038 np0000004400 cinder-backup[101319]: iface.erl = 0 Jul 03 09:39:47.242038 np0000004400 cinder-backup[101319]: iface.max_receive_data_len = 0 Jul 03 09:39:47.242038 np0000004400 cinder-backup[101319]: iface.first_burst_len = 0 Jul 03 09:39:47.242038 np0000004400 cinder-backup[101319]: iface.max_outstanding_r2t = 0 Jul 03 09:39:47.242038 np0000004400 cinder-backup[101319]: iface.max_burst_len = 0 Jul 03 09:39:47.242038 np0000004400 cinder-backup[101319]: iface.chap_auth = Jul 03 09:39:47.242038 np0000004400 cinder-backup[101319]: iface.bidi_chap = Jul 03 09:39:47.242038 np0000004400 cinder-backup[101319]: iface.strict_login_compliance = Jul 03 09:39:47.242038 np0000004400 cinder-backup[101319]: iface.discovery_auth = Jul 03 09:39:47.242038 np0000004400 cinder-backup[101319]: iface.discovery_logout = Jul 03 09:39:47.242038 np0000004400 cinder-backup[101319]: node.discovery_address = Jul 03 09:39:47.242038 np0000004400 cinder-backup[101319]: node.discovery_port = 0 Jul 03 09:39:47.242038 np0000004400 cinder-backup[101319]: node.discovery_type = fw Jul 03 09:39:47.242038 np0000004400 cinder-backup[101319]: node.session.initial_cmdsn = 0 Jul 03 09:39:47.242038 np0000004400 cinder-backup[101319]: node.session.initial_login_retry_max = 8 Jul 03 09:39:47.242038 np0000004400 cinder-backup[101319]: node.session.xmit_thread_priority = 0 Jul 03 09:39:47.244144 np0000004400 cinder-backup[101319]: node.session.cmds_max = 128 Jul 03 09:39:47.244144 np0000004400 cinder-backup[101319]: node.session.queue_depth = 32 Jul 03 09:39:47.244144 np0000004400 cinder-backup[101319]: node.session.nr_sessions = 1 Jul 03 09:39:47.244144 np0000004400 cinder-backup[101319]: node.session.auth.authmethod = None Jul 03 09:39:47.244144 np0000004400 cinder-backup[101319]: node.session.auth.username = Jul 03 09:39:47.244144 np0000004400 cinder-backup[101319]: node.session.auth.password = *** Jul 03 09:39:47.244144 np0000004400 cinder-backup[101319]: node.session.auth.username_in = Jul 03 09:39:47.244144 np0000004400 cinder-backup[101319]: node.session.auth.password_in = Jul 03 09:39:47.244144 np0000004400 cinder-backup[101319]: node.session.auth.chap_algs = SHA256 Jul 03 09:39:47.244144 np0000004400 cinder-backup[101319]: node.session.timeo.replacement_timeout = 120 Jul 03 09:39:47.244144 np0000004400 cinder-backup[101319]: node.session.err_timeo.abort_timeout = 15 Jul 03 09:39:47.244144 np0000004400 cinder-backup[101319]: node.session.err_timeo.lu_reset_timeout = 30 Jul 03 09:39:47.244144 np0000004400 cinder-backup[101319]: node.session.err_timeo.tgt_reset_timeout = 30 Jul 03 09:39:47.244144 np0000004400 cinder-backup[101319]: node.session.err_timeo.host_reset_timeout = 60 Jul 03 09:39:47.244144 np0000004400 cinder-backup[101319]: node.session.iscsi.FastAbort = Yes Jul 03 09:39:47.244144 np0000004400 cinder-backup[101319]: node.session.iscsi.InitialR2T = No Jul 03 09:39:47.244144 np0000004400 cinder-backup[101319]: node.session.iscsi.ImmediateData = Yes Jul 03 09:39:47.244144 np0000004400 cinder-backup[101319]: node.session.iscsi.FirstBurstLength = 262144 Jul 03 09:39:47.244144 np0000004400 cinder-backup[101319]: node.session.iscsi.MaxBurstLength = 16776192 Jul 03 09:39:47.244144 np0000004400 cinder-backup[101319]: node.session.iscsi.DefaultTime2Retain = 0 Jul 03 09:39:47.244144 np0000004400 cinder-backup[101319]: node.session.iscsi.DefaultTime2Wait = 2 Jul 03 09:39:47.244144 np0000004400 cinder-backup[101319]: node.session.iscsi.MaxConnections = 1 Jul 03 09:39:47.244144 np0000004400 cinder-backup[101319]: node.session.iscsi.MaxOutstandingR2T = 1 Jul 03 09:39:47.244144 np0000004400 cinder-backup[101319]: node.session.iscsi.ERL = 0 Jul 03 09:39:47.244144 np0000004400 cinder-backup[101319]: node.session.scan = auto Jul 03 09:39:47.244144 np0000004400 cinder-backup[101319]: node.session.reopen_max = 0 Jul 03 09:39:47.244144 np0000004400 cinder-backup[101319]: node.conn[0].address = 192.168.40.100 Jul 03 09:39:47.244144 np0000004400 cinder-backup[101319]: node.conn[0].port = 3260 Jul 03 09:39:47.244144 np0000004400 cinder-backup[101319]: node.conn[0].startup = manual Jul 03 09:39:47.244144 np0000004400 cinder-backup[101319]: node.conn[0].tcp.window_size = 524288 Jul 03 09:39:47.244144 np0000004400 cinder-backup[101319]: node.conn[0].tcp.type_of_service = 0 Jul 03 09:39:47.244144 np0000004400 cinder-backup[101319]: node.conn[0].timeo.logout_timeout = 15 Jul 03 09:39:47.244144 np0000004400 cinder-backup[101319]: node.conn[0].timeo.login_timeout = 15 Jul 03 09:39:47.244144 np0000004400 cinder-backup[101319]: node.conn[0].timeo.auth_timeout = 45 Jul 03 09:39:47.244144 np0000004400 cinder-backup[101319]: node.conn[0].timeo.noop_out_interval = 5 Jul 03 09:39:47.244144 np0000004400 cinder-backup[101319]: node.conn[0].timeo.noop_out_timeout = 5 Jul 03 09:39:47.244144 np0000004400 cinder-backup[101319]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0 Jul 03 09:39:47.244144 np0000004400 cinder-backup[101319]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144 Jul 03 09:39:47.244144 np0000004400 cinder-backup[101319]: node.conn[0].iscsi.HeaderDigest = None Jul 03 09:39:47.244144 np0000004400 cinder-backup[101319]: node.conn[0].iscsi.DataDigest = None Jul 03 09:39:47.244144 np0000004400 cinder-backup[101319]: node.conn[0].iscsi.IFMarker = No Jul 03 09:39:47.244144 np0000004400 cinder-backup[101319]: node.conn[0].iscsi.OFMarker = No Jul 03 09:39:47.244144 np0000004400 cinder-backup[101319]: # END RECORD Jul 03 09:39:47.244144 np0000004400 cinder-backup[101319]: stderr= {{(pid=101319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 03 09:39:47.253034 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-dcff4a2c-207a-42ac-9e25-189c0c3dac27 tempest-VolumesBackupsAdminTest-1500745506 None] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=101319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 03 09:39:47.267001 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-dcff4a2c-207a-42ac-9e25-189c0c3dac27 tempest-VolumesBackupsAdminTest-1500745506 None] iscsiadm ('-m', 'session'): stdout=tcp: [33] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2cb23c9f-fd1d-4ffa-b027-28faa3d99f1d (non-flash) Jul 03 09:39:47.267001 np0000004400 cinder-backup[101319]: tcp: [34] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2cb23c9f-fd1d-4ffa-b027-28faa3d99f1d (non-flash) Jul 03 09:39:47.267001 np0000004400 cinder-backup[101319]: tcp: [35] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e2580fe0-9b9f-48e5-b77e-51a2b22f14fb (non-flash) Jul 03 09:39:47.267001 np0000004400 cinder-backup[101319]: tcp: [36] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e2580fe0-9b9f-48e5-b77e-51a2b22f14fb (non-flash) Jul 03 09:39:47.267001 np0000004400 cinder-backup[101319]: stderr= {{(pid=101319) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jul 03 09:39:47.267298 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-dcff4a2c-207a-42ac-9e25-189c0c3dac27 tempest-VolumesBackupsAdminTest-1500745506 None] iscsi session list stdout=tcp: [33] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2cb23c9f-fd1d-4ffa-b027-28faa3d99f1d (non-flash) Jul 03 09:39:47.267298 np0000004400 cinder-backup[101319]: tcp: [34] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2cb23c9f-fd1d-4ffa-b027-28faa3d99f1d (non-flash) Jul 03 09:39:47.267298 np0000004400 cinder-backup[101319]: tcp: [35] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e2580fe0-9b9f-48e5-b77e-51a2b22f14fb (non-flash) Jul 03 09:39:47.267298 np0000004400 cinder-backup[101319]: tcp: [36] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e2580fe0-9b9f-48e5-b77e-51a2b22f14fb (non-flash) Jul 03 09:39:47.267298 np0000004400 cinder-backup[101319]: stderr= {{(pid=101319) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jul 03 09:39:47.303208 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-dcff4a2c-207a-42ac-9e25-189c0c3dac27 tempest-VolumesBackupsAdminTest-1500745506 None] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-6b682bae-d2d2-49c0-8a1c-8f9a74831d6c, portal: 192.168.40.100,3260] Jul 03 09:39:47.303208 np0000004400 cinder-backup[101319]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-6b682bae-d2d2-49c0-8a1c-8f9a74831d6c, portal: 192.168.40.100,3260] successful. Jul 03 09:39:47.303208 np0000004400 cinder-backup[101319]: stderr= {{(pid=101319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 03 09:39:47.318091 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-dcff4a2c-207a-42ac-9e25-189c0c3dac27 tempest-VolumesBackupsAdminTest-1500745506 None] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=101319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 03 09:39:47.333927 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-dcff4a2c-207a-42ac-9e25-189c0c3dac27 tempest-VolumesBackupsAdminTest-1500745506 None] iscsiadm ('-m', 'session'): stdout=tcp: [33] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2cb23c9f-fd1d-4ffa-b027-28faa3d99f1d (non-flash) Jul 03 09:39:47.333927 np0000004400 cinder-backup[101319]: tcp: [34] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2cb23c9f-fd1d-4ffa-b027-28faa3d99f1d (non-flash) Jul 03 09:39:47.333927 np0000004400 cinder-backup[101319]: tcp: [35] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e2580fe0-9b9f-48e5-b77e-51a2b22f14fb (non-flash) Jul 03 09:39:47.333927 np0000004400 cinder-backup[101319]: tcp: [36] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e2580fe0-9b9f-48e5-b77e-51a2b22f14fb (non-flash) Jul 03 09:39:47.333927 np0000004400 cinder-backup[101319]: tcp: [37] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6b682bae-d2d2-49c0-8a1c-8f9a74831d6c (non-flash) Jul 03 09:39:47.333927 np0000004400 cinder-backup[101319]: stderr= {{(pid=101319) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jul 03 09:39:47.334226 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-dcff4a2c-207a-42ac-9e25-189c0c3dac27 tempest-VolumesBackupsAdminTest-1500745506 None] iscsi session list stdout=tcp: [33] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2cb23c9f-fd1d-4ffa-b027-28faa3d99f1d (non-flash) Jul 03 09:39:47.334226 np0000004400 cinder-backup[101319]: tcp: [34] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2cb23c9f-fd1d-4ffa-b027-28faa3d99f1d (non-flash) Jul 03 09:39:47.334226 np0000004400 cinder-backup[101319]: tcp: [35] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e2580fe0-9b9f-48e5-b77e-51a2b22f14fb (non-flash) Jul 03 09:39:47.334226 np0000004400 cinder-backup[101319]: tcp: [36] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e2580fe0-9b9f-48e5-b77e-51a2b22f14fb (non-flash) Jul 03 09:39:47.334226 np0000004400 cinder-backup[101319]: tcp: [37] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6b682bae-d2d2-49c0-8a1c-8f9a74831d6c (non-flash) Jul 03 09:39:47.334226 np0000004400 cinder-backup[101319]: stderr= {{(pid=101319) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jul 03 09:39:47.334508 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.base [None req-dcff4a2c-207a-42ac-9e25-189c0c3dac27 tempest-VolumesBackupsAdminTest-1500745506 None] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-6b682bae-d2d2-49c0-8a1c-8f9a74831d6c" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.132s {{(pid=101319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jul 03 09:39:47.338431 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-dcff4a2c-207a-42ac-9e25-189c0c3dac27 tempest-VolumesBackupsAdminTest-1500745506 None] Connected to 192.168.40.100:3260 {{(pid=101319) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}} Jul 03 09:39:47.338431 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.linuxscsi [None req-dcff4a2c-207a-42ac-9e25-189c0c3dac27 tempest-VolumesBackupsAdminTest-1500745506 None] HCTL ('9', '-', '-', 0) found on session 37 with lun 0 {{(pid=101319) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}} Jul 03 09:39:47.338431 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.linuxscsi [None req-dcff4a2c-207a-42ac-9e25-189c0c3dac27 tempest-VolumesBackupsAdminTest-1500745506 None] Scanning host 9 c: -, t: -, l: 0) {{(pid=101319) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}} Jul 03 09:39:47.350149 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.linuxscsi [None req-dcff4a2c-207a-42ac-9e25-189c0c3dac27 tempest-VolumesBackupsAdminTest-1500745506 None] Searching for a device in session 37 and hctl ['9', '*', '*', 0] yield: sdd {{(pid=101319) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}} Jul 03 09:39:47.350325 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-dcff4a2c-207a-42ac-9e25-189c0c3dac27 tempest-VolumesBackupsAdminTest-1500745506 None] Connected to sdd using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-6b682bae-d2d2-49c0-8a1c-8f9a74831d6c', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '6b682bae-d2d2-49c0-8a1c-8f9a74831d6c', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': False} {{(pid=101319) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}} Jul 03 09:39:48.353992 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.base [None req-dcff4a2c-207a-42ac-9e25-189c0c3dac27 tempest-VolumesBackupsAdminTest-1500745506 None] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 2.169s {{(pid=101319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jul 03 09:39:48.354357 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-dcff4a2c-207a-42ac-9e25-189c0c3dac27 tempest-VolumesBackupsAdminTest-1500745506 None] <== connect_volume: return (2170ms) {'type': 'block', 'scsi_wwn': '330000000d3cbeb73', 'path': '/dev/sdd'} {{(pid=101319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}} Jul 03 09:39:48.354496 np0000004400 cinder-backup[101319]: DEBUG oslo_concurrency.processutils [None req-dcff4a2c-207a-42ac-9e25-189c0c3dac27 tempest-VolumesBackupsAdminTest-1500745506 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chown 1002 /dev/sdd {{(pid=101319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 09:39:48.373319 np0000004400 sudo[120458]: stack : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chown 1002 /dev/sdd Jul 03 09:39:48.374198 np0000004400 sudo[120458]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1002) Jul 03 09:39:48.736099 np0000004400 sudo[120458]: pam_unix(sudo:session): session closed for user root Jul 03 09:39:48.738111 np0000004400 cinder-backup[101319]: DEBUG oslo_concurrency.processutils [None req-dcff4a2c-207a-42ac-9e25-189c0c3dac27 tempest-VolumesBackupsAdminTest-1500745506 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chown 1002 /dev/sdd" returned: 0 in 0.383s {{(pid=101319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 09:39:48.782168 np0000004400 cinder-backup[101319]: DEBUG oslo_db.sqlalchemy.engines [None req-dcff4a2c-207a-42ac-9e25-189c0c3dac27 tempest-VolumesBackupsAdminTest-1500745506 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=101319) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 03 09:39:48.786378 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-dcff4a2c-207a-42ac-9e25-189c0c3dac27 tempest-VolumesBackupsAdminTest-1500745506 None] _create_container started, container: tempest-volumesbackupsadmintest-backup-container-31762394,backup: fe9dd1c3-699a-4fc3-ae7f-2830334a957c. {{(pid=101319) _create_container /opt/stack/cinder/cinder/backup/chunkeddriver.py:249}} Jul 03 09:39:48.889675 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.drivers.swift [None req-dcff4a2c-207a-42ac-9e25-189c0c3dac27 tempest-VolumesBackupsAdminTest-1500745506 None] generate_object_name_prefix: volume_6b682bae-d2d2-49c0-8a1c-8f9a74831d6c/20260703093948/az_nova_backup_fe9dd1c3-699a-4fc3-ae7f-2830334a957c {{(pid=101319) _generate_object_name_prefix /opt/stack/cinder/cinder/backup/drivers/swift.py:452}} Jul 03 09:39:48.896038 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-dcff4a2c-207a-42ac-9e25-189c0c3dac27 tempest-VolumesBackupsAdminTest-1500745506 None] starting backup of volume: 6b682bae-d2d2-49c0-8a1c-8f9a74831d6c, volume size: 1073741824, object names prefix volume_6b682bae-d2d2-49c0-8a1c-8f9a74831d6c/20260703093948/az_nova_backup_fe9dd1c3-699a-4fc3-ae7f-2830334a957c, availability zone: nova {{(pid=101319) _prepare_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:359}} Jul 03 09:39:49.116008 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-dcff4a2c-207a-42ac-9e25-189c0c3dac27 tempest-VolumesBackupsAdminTest-1500745506 None] Backing up chunk of data from volume. {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 09:39:49.373594 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-dcff4a2c-207a-42ac-9e25-189c0c3dac27 tempest-VolumesBackupsAdminTest-1500745506 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101319) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 09:39:49.374059 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-dcff4a2c-207a-42ac-9e25-189c0c3dac27 tempest-VolumesBackupsAdminTest-1500745506 None] About to put_object {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 09:39:49.478390 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-dcff4a2c-207a-42ac-9e25-189c0c3dac27 tempest-VolumesBackupsAdminTest-1500745506 None] backup MD5 for volume_6b682bae-d2d2-49c0-8a1c-8f9a74831d6c/20260703093948/az_nova_backup_fe9dd1c3-699a-4fc3-ae7f-2830334a957c-00001: 25e317773f308e446cc84c503a6d1f85 {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 09:39:49.478390 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-dcff4a2c-207a-42ac-9e25-189c0c3dac27 tempest-VolumesBackupsAdminTest-1500745506 None] Calling eventlet.sleep(0) {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 09:39:49.681183 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-dcff4a2c-207a-42ac-9e25-189c0c3dac27 tempest-VolumesBackupsAdminTest-1500745506 None] Backing up chunk of data from volume. {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 09:39:49.920770 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-dcff4a2c-207a-42ac-9e25-189c0c3dac27 tempest-VolumesBackupsAdminTest-1500745506 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101319) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 09:39:49.920870 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-dcff4a2c-207a-42ac-9e25-189c0c3dac27 tempest-VolumesBackupsAdminTest-1500745506 None] About to put_object {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 09:39:50.043916 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-dcff4a2c-207a-42ac-9e25-189c0c3dac27 tempest-VolumesBackupsAdminTest-1500745506 None] backup MD5 for volume_6b682bae-d2d2-49c0-8a1c-8f9a74831d6c/20260703093948/az_nova_backup_fe9dd1c3-699a-4fc3-ae7f-2830334a957c-00002: 25e317773f308e446cc84c503a6d1f85 {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 09:39:50.044143 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-dcff4a2c-207a-42ac-9e25-189c0c3dac27 tempest-VolumesBackupsAdminTest-1500745506 None] Calling eventlet.sleep(0) {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 09:39:50.252320 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-dcff4a2c-207a-42ac-9e25-189c0c3dac27 tempest-VolumesBackupsAdminTest-1500745506 None] Backing up chunk of data from volume. {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 09:39:50.528117 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-dcff4a2c-207a-42ac-9e25-189c0c3dac27 tempest-VolumesBackupsAdminTest-1500745506 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101319) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 09:39:50.528601 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-dcff4a2c-207a-42ac-9e25-189c0c3dac27 tempest-VolumesBackupsAdminTest-1500745506 None] About to put_object {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 09:39:50.628315 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-dcff4a2c-207a-42ac-9e25-189c0c3dac27 tempest-VolumesBackupsAdminTest-1500745506 None] backup MD5 for volume_6b682bae-d2d2-49c0-8a1c-8f9a74831d6c/20260703093948/az_nova_backup_fe9dd1c3-699a-4fc3-ae7f-2830334a957c-00003: 25e317773f308e446cc84c503a6d1f85 {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 09:39:50.628514 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-dcff4a2c-207a-42ac-9e25-189c0c3dac27 tempest-VolumesBackupsAdminTest-1500745506 None] Calling eventlet.sleep(0) {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 09:39:50.836355 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-dcff4a2c-207a-42ac-9e25-189c0c3dac27 tempest-VolumesBackupsAdminTest-1500745506 None] Backing up chunk of data from volume. {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 09:39:51.099563 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-dcff4a2c-207a-42ac-9e25-189c0c3dac27 tempest-VolumesBackupsAdminTest-1500745506 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101319) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 09:39:51.099747 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-dcff4a2c-207a-42ac-9e25-189c0c3dac27 tempest-VolumesBackupsAdminTest-1500745506 None] About to put_object {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 09:39:51.221161 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-dcff4a2c-207a-42ac-9e25-189c0c3dac27 tempest-VolumesBackupsAdminTest-1500745506 None] backup MD5 for volume_6b682bae-d2d2-49c0-8a1c-8f9a74831d6c/20260703093948/az_nova_backup_fe9dd1c3-699a-4fc3-ae7f-2830334a957c-00004: 25e317773f308e446cc84c503a6d1f85 {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 09:39:51.221265 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-dcff4a2c-207a-42ac-9e25-189c0c3dac27 tempest-VolumesBackupsAdminTest-1500745506 None] Calling eventlet.sleep(0) {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 09:39:51.447322 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-dcff4a2c-207a-42ac-9e25-189c0c3dac27 tempest-VolumesBackupsAdminTest-1500745506 None] Backing up chunk of data from volume. {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 09:39:51.689729 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-dcff4a2c-207a-42ac-9e25-189c0c3dac27 tempest-VolumesBackupsAdminTest-1500745506 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101319) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 09:39:51.690131 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-dcff4a2c-207a-42ac-9e25-189c0c3dac27 tempest-VolumesBackupsAdminTest-1500745506 None] About to put_object {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 09:39:51.801563 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-dcff4a2c-207a-42ac-9e25-189c0c3dac27 tempest-VolumesBackupsAdminTest-1500745506 None] backup MD5 for volume_6b682bae-d2d2-49c0-8a1c-8f9a74831d6c/20260703093948/az_nova_backup_fe9dd1c3-699a-4fc3-ae7f-2830334a957c-00005: 25e317773f308e446cc84c503a6d1f85 {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 09:39:51.801710 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-dcff4a2c-207a-42ac-9e25-189c0c3dac27 tempest-VolumesBackupsAdminTest-1500745506 None] Calling eventlet.sleep(0) {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 09:39:51.989752 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-dcff4a2c-207a-42ac-9e25-189c0c3dac27 tempest-VolumesBackupsAdminTest-1500745506 None] Backing up chunk of data from volume. {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 09:39:52.233717 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-dcff4a2c-207a-42ac-9e25-189c0c3dac27 tempest-VolumesBackupsAdminTest-1500745506 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101319) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 09:39:52.233874 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-dcff4a2c-207a-42ac-9e25-189c0c3dac27 tempest-VolumesBackupsAdminTest-1500745506 None] About to put_object {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 09:39:52.344762 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-dcff4a2c-207a-42ac-9e25-189c0c3dac27 tempest-VolumesBackupsAdminTest-1500745506 None] backup MD5 for volume_6b682bae-d2d2-49c0-8a1c-8f9a74831d6c/20260703093948/az_nova_backup_fe9dd1c3-699a-4fc3-ae7f-2830334a957c-00006: 25e317773f308e446cc84c503a6d1f85 {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 09:39:52.344762 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-dcff4a2c-207a-42ac-9e25-189c0c3dac27 tempest-VolumesBackupsAdminTest-1500745506 None] Calling eventlet.sleep(0) {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 09:39:52.558954 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-dcff4a2c-207a-42ac-9e25-189c0c3dac27 tempest-VolumesBackupsAdminTest-1500745506 None] Backing up chunk of data from volume. {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 09:39:53.099219 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-dcff4a2c-207a-42ac-9e25-189c0c3dac27 tempest-VolumesBackupsAdminTest-1500745506 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101319) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 09:39:53.099544 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-dcff4a2c-207a-42ac-9e25-189c0c3dac27 tempest-VolumesBackupsAdminTest-1500745506 None] About to put_object {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 09:39:53.204037 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-dcff4a2c-207a-42ac-9e25-189c0c3dac27 tempest-VolumesBackupsAdminTest-1500745506 None] backup MD5 for volume_6b682bae-d2d2-49c0-8a1c-8f9a74831d6c/20260703093948/az_nova_backup_fe9dd1c3-699a-4fc3-ae7f-2830334a957c-00007: 25e317773f308e446cc84c503a6d1f85 {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 09:39:53.204194 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-dcff4a2c-207a-42ac-9e25-189c0c3dac27 tempest-VolumesBackupsAdminTest-1500745506 None] Calling eventlet.sleep(0) {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 09:39:53.445025 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-dcff4a2c-207a-42ac-9e25-189c0c3dac27 tempest-VolumesBackupsAdminTest-1500745506 None] Backing up chunk of data from volume. {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 09:39:53.705118 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-dcff4a2c-207a-42ac-9e25-189c0c3dac27 tempest-VolumesBackupsAdminTest-1500745506 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101319) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 09:39:53.705292 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-dcff4a2c-207a-42ac-9e25-189c0c3dac27 tempest-VolumesBackupsAdminTest-1500745506 None] About to put_object {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 09:39:53.825166 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-dcff4a2c-207a-42ac-9e25-189c0c3dac27 tempest-VolumesBackupsAdminTest-1500745506 None] backup MD5 for volume_6b682bae-d2d2-49c0-8a1c-8f9a74831d6c/20260703093948/az_nova_backup_fe9dd1c3-699a-4fc3-ae7f-2830334a957c-00008: 25e317773f308e446cc84c503a6d1f85 {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 09:39:53.825319 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-dcff4a2c-207a-42ac-9e25-189c0c3dac27 tempest-VolumesBackupsAdminTest-1500745506 None] Calling eventlet.sleep(0) {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 09:39:54.030629 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-dcff4a2c-207a-42ac-9e25-189c0c3dac27 tempest-VolumesBackupsAdminTest-1500745506 None] Backing up chunk of data from volume. {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 09:39:54.287186 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-dcff4a2c-207a-42ac-9e25-189c0c3dac27 tempest-VolumesBackupsAdminTest-1500745506 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101319) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 09:39:54.287186 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-dcff4a2c-207a-42ac-9e25-189c0c3dac27 tempest-VolumesBackupsAdminTest-1500745506 None] About to put_object {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 09:39:54.392654 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-dcff4a2c-207a-42ac-9e25-189c0c3dac27 tempest-VolumesBackupsAdminTest-1500745506 None] backup MD5 for volume_6b682bae-d2d2-49c0-8a1c-8f9a74831d6c/20260703093948/az_nova_backup_fe9dd1c3-699a-4fc3-ae7f-2830334a957c-00009: 25e317773f308e446cc84c503a6d1f85 {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 09:39:54.392804 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-dcff4a2c-207a-42ac-9e25-189c0c3dac27 tempest-VolumesBackupsAdminTest-1500745506 None] Calling eventlet.sleep(0) {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 09:39:54.622601 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-dcff4a2c-207a-42ac-9e25-189c0c3dac27 tempest-VolumesBackupsAdminTest-1500745506 None] Backing up chunk of data from volume. {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 09:39:54.877660 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-dcff4a2c-207a-42ac-9e25-189c0c3dac27 tempest-VolumesBackupsAdminTest-1500745506 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101319) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 09:39:54.878067 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-dcff4a2c-207a-42ac-9e25-189c0c3dac27 tempest-VolumesBackupsAdminTest-1500745506 None] About to put_object {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 09:39:54.996478 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-dcff4a2c-207a-42ac-9e25-189c0c3dac27 tempest-VolumesBackupsAdminTest-1500745506 None] backup MD5 for volume_6b682bae-d2d2-49c0-8a1c-8f9a74831d6c/20260703093948/az_nova_backup_fe9dd1c3-699a-4fc3-ae7f-2830334a957c-00010: 25e317773f308e446cc84c503a6d1f85 {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 09:39:54.996687 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-dcff4a2c-207a-42ac-9e25-189c0c3dac27 tempest-VolumesBackupsAdminTest-1500745506 None] Calling eventlet.sleep(0) {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 09:39:55.246268 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-dcff4a2c-207a-42ac-9e25-189c0c3dac27 tempest-VolumesBackupsAdminTest-1500745506 None] Backing up chunk of data from volume. {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 09:39:55.500240 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-dcff4a2c-207a-42ac-9e25-189c0c3dac27 tempest-VolumesBackupsAdminTest-1500745506 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101319) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 09:39:55.500240 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-dcff4a2c-207a-42ac-9e25-189c0c3dac27 tempest-VolumesBackupsAdminTest-1500745506 None] About to put_object {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 09:39:55.640417 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-dcff4a2c-207a-42ac-9e25-189c0c3dac27 tempest-VolumesBackupsAdminTest-1500745506 None] backup MD5 for volume_6b682bae-d2d2-49c0-8a1c-8f9a74831d6c/20260703093948/az_nova_backup_fe9dd1c3-699a-4fc3-ae7f-2830334a957c-00011: 25e317773f308e446cc84c503a6d1f85 {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 09:39:55.640606 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-dcff4a2c-207a-42ac-9e25-189c0c3dac27 tempest-VolumesBackupsAdminTest-1500745506 None] Calling eventlet.sleep(0) {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 09:39:55.895711 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-dcff4a2c-207a-42ac-9e25-189c0c3dac27 tempest-VolumesBackupsAdminTest-1500745506 None] Backing up chunk of data from volume. {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 09:39:56.176703 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-dcff4a2c-207a-42ac-9e25-189c0c3dac27 tempest-VolumesBackupsAdminTest-1500745506 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101319) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 09:39:56.176897 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-dcff4a2c-207a-42ac-9e25-189c0c3dac27 tempest-VolumesBackupsAdminTest-1500745506 None] About to put_object {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 09:39:56.305367 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-dcff4a2c-207a-42ac-9e25-189c0c3dac27 tempest-VolumesBackupsAdminTest-1500745506 None] backup MD5 for volume_6b682bae-d2d2-49c0-8a1c-8f9a74831d6c/20260703093948/az_nova_backup_fe9dd1c3-699a-4fc3-ae7f-2830334a957c-00012: 25e317773f308e446cc84c503a6d1f85 {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 09:39:56.305675 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-dcff4a2c-207a-42ac-9e25-189c0c3dac27 tempest-VolumesBackupsAdminTest-1500745506 None] Calling eventlet.sleep(0) {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 09:39:56.567875 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-dcff4a2c-207a-42ac-9e25-189c0c3dac27 tempest-VolumesBackupsAdminTest-1500745506 None] Backing up chunk of data from volume. {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 09:39:56.845225 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-dcff4a2c-207a-42ac-9e25-189c0c3dac27 tempest-VolumesBackupsAdminTest-1500745506 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101319) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 09:39:56.845380 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-dcff4a2c-207a-42ac-9e25-189c0c3dac27 tempest-VolumesBackupsAdminTest-1500745506 None] About to put_object {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 09:39:56.944089 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-dcff4a2c-207a-42ac-9e25-189c0c3dac27 tempest-VolumesBackupsAdminTest-1500745506 None] backup MD5 for volume_6b682bae-d2d2-49c0-8a1c-8f9a74831d6c/20260703093948/az_nova_backup_fe9dd1c3-699a-4fc3-ae7f-2830334a957c-00013: 25e317773f308e446cc84c503a6d1f85 {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 09:39:56.944236 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-dcff4a2c-207a-42ac-9e25-189c0c3dac27 tempest-VolumesBackupsAdminTest-1500745506 None] Calling eventlet.sleep(0) {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 09:39:57.159503 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-dcff4a2c-207a-42ac-9e25-189c0c3dac27 tempest-VolumesBackupsAdminTest-1500745506 None] Backing up chunk of data from volume. {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 09:39:57.414767 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-dcff4a2c-207a-42ac-9e25-189c0c3dac27 tempest-VolumesBackupsAdminTest-1500745506 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101319) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 09:39:57.414933 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-dcff4a2c-207a-42ac-9e25-189c0c3dac27 tempest-VolumesBackupsAdminTest-1500745506 None] About to put_object {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 09:39:57.537555 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-dcff4a2c-207a-42ac-9e25-189c0c3dac27 tempest-VolumesBackupsAdminTest-1500745506 None] backup MD5 for volume_6b682bae-d2d2-49c0-8a1c-8f9a74831d6c/20260703093948/az_nova_backup_fe9dd1c3-699a-4fc3-ae7f-2830334a957c-00014: 25e317773f308e446cc84c503a6d1f85 {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 09:39:57.537781 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-dcff4a2c-207a-42ac-9e25-189c0c3dac27 tempest-VolumesBackupsAdminTest-1500745506 None] Calling eventlet.sleep(0) {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 09:39:57.761610 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-dcff4a2c-207a-42ac-9e25-189c0c3dac27 tempest-VolumesBackupsAdminTest-1500745506 None] Backing up chunk of data from volume. {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 09:39:58.058962 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-dcff4a2c-207a-42ac-9e25-189c0c3dac27 tempest-VolumesBackupsAdminTest-1500745506 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101319) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 09:39:58.059182 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-dcff4a2c-207a-42ac-9e25-189c0c3dac27 tempest-VolumesBackupsAdminTest-1500745506 None] About to put_object {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 09:39:58.172957 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-dcff4a2c-207a-42ac-9e25-189c0c3dac27 tempest-VolumesBackupsAdminTest-1500745506 None] backup MD5 for volume_6b682bae-d2d2-49c0-8a1c-8f9a74831d6c/20260703093948/az_nova_backup_fe9dd1c3-699a-4fc3-ae7f-2830334a957c-00015: 25e317773f308e446cc84c503a6d1f85 {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 09:39:58.173097 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-dcff4a2c-207a-42ac-9e25-189c0c3dac27 tempest-VolumesBackupsAdminTest-1500745506 None] Calling eventlet.sleep(0) {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 09:39:58.371005 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-dcff4a2c-207a-42ac-9e25-189c0c3dac27 tempest-VolumesBackupsAdminTest-1500745506 None] Backing up chunk of data from volume. {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 09:39:58.628200 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-dcff4a2c-207a-42ac-9e25-189c0c3dac27 tempest-VolumesBackupsAdminTest-1500745506 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101319) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 09:39:58.628462 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-dcff4a2c-207a-42ac-9e25-189c0c3dac27 tempest-VolumesBackupsAdminTest-1500745506 None] About to put_object {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 09:39:58.753061 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-dcff4a2c-207a-42ac-9e25-189c0c3dac27 tempest-VolumesBackupsAdminTest-1500745506 None] backup MD5 for volume_6b682bae-d2d2-49c0-8a1c-8f9a74831d6c/20260703093948/az_nova_backup_fe9dd1c3-699a-4fc3-ae7f-2830334a957c-00016: 25e317773f308e446cc84c503a6d1f85 {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 09:39:58.753221 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-dcff4a2c-207a-42ac-9e25-189c0c3dac27 tempest-VolumesBackupsAdminTest-1500745506 None] Calling eventlet.sleep(0) {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 09:39:58.973869 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-dcff4a2c-207a-42ac-9e25-189c0c3dac27 tempest-VolumesBackupsAdminTest-1500745506 None] Backing up chunk of data from volume. {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 09:39:59.222473 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-dcff4a2c-207a-42ac-9e25-189c0c3dac27 tempest-VolumesBackupsAdminTest-1500745506 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101319) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 09:39:59.222638 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-dcff4a2c-207a-42ac-9e25-189c0c3dac27 tempest-VolumesBackupsAdminTest-1500745506 None] About to put_object {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 09:39:59.349173 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-dcff4a2c-207a-42ac-9e25-189c0c3dac27 tempest-VolumesBackupsAdminTest-1500745506 None] backup MD5 for volume_6b682bae-d2d2-49c0-8a1c-8f9a74831d6c/20260703093948/az_nova_backup_fe9dd1c3-699a-4fc3-ae7f-2830334a957c-00017: 25e317773f308e446cc84c503a6d1f85 {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 09:39:59.349304 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-dcff4a2c-207a-42ac-9e25-189c0c3dac27 tempest-VolumesBackupsAdminTest-1500745506 None] Calling eventlet.sleep(0) {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 09:39:59.567189 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-dcff4a2c-207a-42ac-9e25-189c0c3dac27 tempest-VolumesBackupsAdminTest-1500745506 None] Backing up chunk of data from volume. {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 09:39:59.817881 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-dcff4a2c-207a-42ac-9e25-189c0c3dac27 tempest-VolumesBackupsAdminTest-1500745506 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101319) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 09:39:59.818025 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-dcff4a2c-207a-42ac-9e25-189c0c3dac27 tempest-VolumesBackupsAdminTest-1500745506 None] About to put_object {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 09:39:59.929141 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-dcff4a2c-207a-42ac-9e25-189c0c3dac27 tempest-VolumesBackupsAdminTest-1500745506 None] backup MD5 for volume_6b682bae-d2d2-49c0-8a1c-8f9a74831d6c/20260703093948/az_nova_backup_fe9dd1c3-699a-4fc3-ae7f-2830334a957c-00018: 25e317773f308e446cc84c503a6d1f85 {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 09:39:59.929141 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-dcff4a2c-207a-42ac-9e25-189c0c3dac27 tempest-VolumesBackupsAdminTest-1500745506 None] Calling eventlet.sleep(0) {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 09:40:00.164324 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-dcff4a2c-207a-42ac-9e25-189c0c3dac27 tempest-VolumesBackupsAdminTest-1500745506 None] Backing up chunk of data from volume. {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 09:40:00.430652 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-dcff4a2c-207a-42ac-9e25-189c0c3dac27 tempest-VolumesBackupsAdminTest-1500745506 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101319) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 09:40:00.430826 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-dcff4a2c-207a-42ac-9e25-189c0c3dac27 tempest-VolumesBackupsAdminTest-1500745506 None] About to put_object {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 09:40:00.560422 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-dcff4a2c-207a-42ac-9e25-189c0c3dac27 tempest-VolumesBackupsAdminTest-1500745506 None] backup MD5 for volume_6b682bae-d2d2-49c0-8a1c-8f9a74831d6c/20260703093948/az_nova_backup_fe9dd1c3-699a-4fc3-ae7f-2830334a957c-00019: 25e317773f308e446cc84c503a6d1f85 {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 09:40:00.560422 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-dcff4a2c-207a-42ac-9e25-189c0c3dac27 tempest-VolumesBackupsAdminTest-1500745506 None] Calling eventlet.sleep(0) {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 09:40:00.773668 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-dcff4a2c-207a-42ac-9e25-189c0c3dac27 tempest-VolumesBackupsAdminTest-1500745506 None] Backing up chunk of data from volume. {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 09:40:01.028784 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-dcff4a2c-207a-42ac-9e25-189c0c3dac27 tempest-VolumesBackupsAdminTest-1500745506 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101319) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 09:40:01.028784 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-dcff4a2c-207a-42ac-9e25-189c0c3dac27 tempest-VolumesBackupsAdminTest-1500745506 None] About to put_object {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 09:40:01.149291 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-dcff4a2c-207a-42ac-9e25-189c0c3dac27 tempest-VolumesBackupsAdminTest-1500745506 None] backup MD5 for volume_6b682bae-d2d2-49c0-8a1c-8f9a74831d6c/20260703093948/az_nova_backup_fe9dd1c3-699a-4fc3-ae7f-2830334a957c-00020: 25e317773f308e446cc84c503a6d1f85 {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 09:40:01.149291 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-dcff4a2c-207a-42ac-9e25-189c0c3dac27 tempest-VolumesBackupsAdminTest-1500745506 None] Calling eventlet.sleep(0) {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 09:40:01.264933 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-dcff4a2c-207a-42ac-9e25-189c0c3dac27 tempest-VolumesBackupsAdminTest-1500745506 None] Backing up chunk of data from volume. {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 09:40:01.412964 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-dcff4a2c-207a-42ac-9e25-189c0c3dac27 tempest-VolumesBackupsAdminTest-1500745506 None] Compressed 25165824 bytes of data to 24470 bytes using zlib. {{(pid=101319) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 09:40:01.412964 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-dcff4a2c-207a-42ac-9e25-189c0c3dac27 tempest-VolumesBackupsAdminTest-1500745506 None] About to put_object {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 09:40:01.503299 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-dcff4a2c-207a-42ac-9e25-189c0c3dac27 tempest-VolumesBackupsAdminTest-1500745506 None] backup MD5 for volume_6b682bae-d2d2-49c0-8a1c-8f9a74831d6c/20260703093948/az_nova_backup_fe9dd1c3-699a-4fc3-ae7f-2830334a957c-00021: 77377273b0a4b61febdbf7bbf52b9db9 {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 09:40:01.503299 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-dcff4a2c-207a-42ac-9e25-189c0c3dac27 tempest-VolumesBackupsAdminTest-1500745506 None] Calling eventlet.sleep(0) {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 09:40:01.511362 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.driver [None req-dcff4a2c-207a-42ac-9e25-189c0c3dac27 tempest-VolumesBackupsAdminTest-1500745506 None] Getting metadata type 'volume-base-metadata' {{(pid=101319) _save_vol_base_meta /opt/stack/cinder/cinder/backup/driver.py:79}} Jul 03 09:40:01.521133 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.driver [None req-dcff4a2c-207a-42ac-9e25-189c0c3dac27 tempest-VolumesBackupsAdminTest-1500745506 None] Completed fetching metadata type 'volume-base-metadata' {{(pid=101319) _save_vol_base_meta /opt/stack/cinder/cinder/backup/driver.py:98}} Jul 03 09:40:01.521778 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.driver [None req-dcff4a2c-207a-42ac-9e25-189c0c3dac27 tempest-VolumesBackupsAdminTest-1500745506 None] Getting metadata type 'volume-metadata' {{(pid=101319) _save_vol_meta /opt/stack/cinder/cinder/backup/driver.py:109}} Jul 03 09:40:01.533768 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.driver [None req-dcff4a2c-207a-42ac-9e25-189c0c3dac27 tempest-VolumesBackupsAdminTest-1500745506 None] No metadata type 'volume-metadata' available {{(pid=101319) _save_vol_meta /opt/stack/cinder/cinder/backup/driver.py:123}} Jul 03 09:40:01.533768 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.driver [None req-dcff4a2c-207a-42ac-9e25-189c0c3dac27 tempest-VolumesBackupsAdminTest-1500745506 None] Getting metadata type 'volume-glance-metadata' {{(pid=101319) _save_vol_glance_meta /opt/stack/cinder/cinder/backup/driver.py:132}} Jul 03 09:40:01.542578 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.driver [None req-dcff4a2c-207a-42ac-9e25-189c0c3dac27 tempest-VolumesBackupsAdminTest-1500745506 None] No metadata type 'volume-glance-metadata' available {{(pid=101319) _save_vol_glance_meta /opt/stack/cinder/cinder/backup/driver.py:147}} Jul 03 09:40:01.542578 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-dcff4a2c-207a-42ac-9e25-189c0c3dac27 tempest-VolumesBackupsAdminTest-1500745506 None] _write_sha256file started, container name: tempest-volumesbackupsadmintest-backup-container-31762394, sha256file filename: volume_6b682bae-d2d2-49c0-8a1c-8f9a74831d6c/20260703093948/az_nova_backup_fe9dd1c3-699a-4fc3-ae7f-2830334a957c_sha256file. {{(pid=101319) _write_sha256file /opt/stack/cinder/cinder/backup/chunkeddriver.py:299}} Jul 03 09:40:01.623001 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-dcff4a2c-207a-42ac-9e25-189c0c3dac27 tempest-VolumesBackupsAdminTest-1500745506 None] _write_sha256file finished. {{(pid=101319) _write_sha256file /opt/stack/cinder/cinder/backup/chunkeddriver.py:315}} Jul 03 09:40:01.623846 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-dcff4a2c-207a-42ac-9e25-189c0c3dac27 tempest-VolumesBackupsAdminTest-1500745506 None] _write_metadata started, container name: tempest-volumesbackupsadmintest-backup-container-31762394, metadata filename: volume_6b682bae-d2d2-49c0-8a1c-8f9a74831d6c/20260703093948/az_nova_backup_fe9dd1c3-699a-4fc3-ae7f-2830334a957c_metadata. {{(pid=101319) _write_metadata /opt/stack/cinder/cinder/backup/chunkeddriver.py:276}} Jul 03 09:40:01.666396 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-dcff4a2c-207a-42ac-9e25-189c0c3dac27 tempest-VolumesBackupsAdminTest-1500745506 None] _write_metadata finished. Metadata: b'{\n "backup_description": null,\n "backup_id": "fe9dd1c3-699a-4fc3-ae7f-2830334a957c",\n "backup_name": "tempest-VolumesBackupsAdminTest-Backup-77258928",\n "created_at": "2026-07-03 09:39:44+00:00",\n "objects": [\n {\n "volume_6b682bae-d2d2-49c0-8a1c-8f9a74831d6c/20260703093948/az_nova_backup_fe9dd1c3-699a-4fc3-ae7f-2830334a957c-00001": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 0\n }\n },\n {\n "volume_6b682bae-d2d2-49c0-8a1c-8f9a74831d6c/20260703093948/az_nova_backup_fe9dd1c3-699a-4fc3-ae7f-2830334a957c-00002": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 52428800\n }\n },\n {\n "volume_6b682bae-d2d2-49c0-8a1c-8f9a74831d6c/20260703093948/az_nova_backup_fe9dd1c3-699a-4fc3-ae7f-2830334a957c-00003": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 104857600\n }\n },\n {\n "volume_6b682bae-d2d2-49c0-8a1c-8f9a74831d6c/20260703093948/az_nova_backup_fe9dd1c3-699a-4fc3-ae7f-2830334a957c-00004": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 157286400\n }\n },\n {\n "volume_6b682bae-d2d2-49c0-8a1c-8f9a74831d6c/20260703093948/az_nova_backup_fe9dd1c3-699a-4fc3-ae7f-2830334a957c-00005": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 209715200\n }\n },\n {\n "volume_6b682bae-d2d2-49c0-8a1c-8f9a74831d6c/20260703093948/az_nova_backup_fe9dd1c3-699a-4fc3-ae7f-2830334a957c-00006": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 262144000\n }\n },\n {\n "volume_6b682bae-d2d2-49c0-8a1c-8f9a74831d6c/20260703093948/az_nova_backup_fe9dd1c3-699a-4fc3-ae7f-2830334a957c-00007": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 314572800\n }\n },\n {\n "volume_6b682bae-d2d2-49c0-8a1c-8f9a74831d6c/20260703093948/az_nova_backup_fe9dd1c3-699a-4fc3-ae7f-2830334a957c-00008": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 367001600\n }\n },\n {\n "volume_6b682bae-d2d2-49c0-8a1c-8f9a74831d6c/20260703093948/az_nova_backup_fe9dd1c3-699a-4fc3-ae7f-2830334a957c-00009": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 419430400\n }\n },\n {\n "volume_6b682bae-d2d2-49c0-8a1c-8f9a74831d6c/20260703093948/az_nova_backup_fe9dd1c3-699a-4fc3-ae7f-2830334a957c-00010": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 471859200\n }\n },\n {\n "volume_6b682bae-d2d2-49c0-8a1c-8f9a74831d6c/20260703093948/az_nova_backup_fe9dd1c3-699a-4fc3-ae7f-2830334a957c-00011": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 524288000\n }\n },\n {\n "volume_6b682bae-d2d2-49c0-8a1c-8f9a74831d6c/20260703093948/az_nova_backup_fe9dd1c3-699a-4fc3-ae7f-2830334a957c-00012": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 576716800\n }\n },\n {\n "volume_6b682bae-d2d2-49c0-8a1c-8f9a74831d6c/20260703093948/az_nova_backup_fe9dd1c3-699a-4fc3-ae7f-2830334a957c-00013": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 629145600\n }\n },\n {\n "volume_6b682bae-d2d2-49c0-8a1c-8f9a74831d6c/20260703093948/az_nova_backup_fe9dd1c3-699a-4fc3-ae7f-2830334a957c-00014": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 681574400\n }\n },\n {\n "volume_6b682bae-d2d2-49c0-8a1c-8f9a74831d6c/20260703093948/az_nova_backup_fe9dd1c3-699a-4fc3-ae7f-2830334a957c-00015": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 734003200\n }\n },\n {\n "volume_6b682bae-d2d2-49c0-8a1c-8f9a74831d6c/20260703093948/az_nova_backup_fe9dd1c3-699a-4fc3-ae7f-2830334a957c-00016": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 786432000\n }\n },\n {\n "volume_6b682bae-d2d2-49c0-8a1c-8f9a74831d6c/20260703093948/az_nova_backup_fe9dd1c3-699a-4fc3-ae7f-2830334a957c-00017": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 838860800\n }\n },\n {\n "volume_6b682bae-d2d2-49c0-8a1c-8f9a74831d6c/20260703093948/az_nova_backup_fe9dd1c3-699a-4fc3-ae7f-2830334a957c-00018": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 891289600\n }\n },\n {\n "volume_6b682bae-d2d2-49c0-8a1c-8f9a74831d6c/20260703093948/az_nova_backup_fe9dd1c3-699a-4fc3-ae7f-2830334a957c-00019": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 943718400\n }\n },\n {\n "volume_6b682bae-d2d2-49c0-8a1c-8f9a74831d6c/20260703093948/az_nova_backup_fe9dd1c3-699a-4fc3-ae7f-2830334a957c-00020": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 996147200\n }\n },\n {\n "volume_6b682bae-d2d2-49c0-8a1c-8f9a74831d6c/20260703093948/az_nova_backup_fe9dd1c3-699a-4fc3-ae7f-2830334a957c-00021": {\n "compression": "zlib",\n "length": 25165824,\n "md5": "77377273b0a4b61febdbf7bbf52b9db9",\n "offset": 1048576000\n }\n }\n ],\n "parent_id": null,\n "version": "1.0.0",\n "volume_id": "6b682bae-d2d2-49c0-8a1c-8f9a74831d6c",\n "volume_meta": "{\\"version\\": 2, \\"volume-base-metadata\\": {\\"id\\": \\"6b682bae-d2d2-49c0-8a1c-8f9a74831d6c\\", \\"_name_id\\": null, \\"use_quota\\": true, \\"ec2_id\\": null, \\"user_id\\": \\"356a534952b84c0680fa3b9655a0fc13\\", \\"project_id\\": \\"b25712a6deba4237b3d9f8f02bb54ed6\\", \\"snapshot_id\\": null, \\"cluster_name\\": null, \\"host\\": \\"np0000004400@storpool#default\\", \\"size\\": 1, \\"availability_zone\\": \\"nova\\", \\"status\\": \\"backing-up\\", \\"attach_status\\": \\"detached\\", \\"migration_status\\": null, \\"scheduled_at\\": \\"2026-07-03T09:39:43.000000\\", \\"launched_at\\": \\"2026-07-03T09:39:43.000000\\", \\"terminated_at\\": null, \\"display_name\\": \\"tempest-VolumesBackupsAdminTest-Volume-1413318068\\", \\"display_description\\": null, \\"provider_location\\": null, \\"provider_auth\\": null, \\"provider_geometry\\": null, \\"provider_id\\": null, \\"volume_type_id\\": \\"03e13fe6-0e30-4803-ace0-725d38e6dc24\\", \\"source_volid\\": null, \\"encryption_key_id\\": null, \\"consistencygroup_id\\": null, \\"group_id\\": null, \\"bootable\\": false, \\"multiattach\\": false, \\"replication_status\\": null, \\"replication_extended_status\\": null, \\"replication_driver_data\\": null, \\"previous_status\\": \\"available\\", \\"service_uuid\\": \\"6d4b0e79-fefe-4744-b25f-34be05095200\\", \\"shared_targets\\": true, \\"deleted_at\\": null, \\"deleted\\": false, \\"created_at\\": \\"2026-07-03T09:39:43.000000\\", \\"updated_at\\": \\"2026-07-03T09:39:44.000000\\"}}"\n}'. {{(pid=101319) _write_metadata /opt/stack/cinder/cinder/backup/chunkeddriver.py:295}} Jul 03 09:40:01.674932 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-dcff4a2c-207a-42ac-9e25-189c0c3dac27 tempest-VolumesBackupsAdminTest-1500745506 None] backup fe9dd1c3-699a-4fc3-ae7f-2830334a957c finished. {{(pid=101319) _finalize_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:462}} Jul 03 09:40:01.831438 np0000004400 cinder-backup[101319]: DEBUG oslo_concurrency.processutils [None req-dcff4a2c-207a-42ac-9e25-189c0c3dac27 tempest-VolumesBackupsAdminTest-1500745506 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chown 0 /dev/sdd {{(pid=101319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 09:40:01.850520 np0000004400 sudo[120812]: stack : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chown 0 /dev/sdd Jul 03 09:40:01.851350 np0000004400 sudo[120812]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1002) Jul 03 09:40:02.244632 np0000004400 sudo[120812]: pam_unix(sudo:session): session closed for user root Jul 03 09:40:02.247284 np0000004400 cinder-backup[101319]: DEBUG oslo_concurrency.processutils [None req-dcff4a2c-207a-42ac-9e25-189c0c3dac27 tempest-VolumesBackupsAdminTest-1500745506 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chown 0 /dev/sdd" returned: 0 in 0.416s {{(pid=101319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 09:40:02.248212 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-dcff4a2c-207a-42ac-9e25-189c0c3dac27 tempest-VolumesBackupsAdminTest-1500745506 None] ==> disconnect_volume: call "{'args': (, {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-6b682bae-d2d2-49c0-8a1c-8f9a74831d6c', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '6b682bae-d2d2-49c0-8a1c-8f9a74831d6c', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': False}, {'type': 'block', 'scsi_wwn': '330000000d3cbeb73', 'path': '/dev/sdd'}), 'kwargs': {'force': True, 'ignore_errors': True}}" {{(pid=101319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}} Jul 03 09:40:02.248553 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.base [None req-dcff4a2c-207a-42ac-9e25-189c0c3dac27 tempest-VolumesBackupsAdminTest-1500745506 None] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=101319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jul 03 09:40:04.311156 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.base [None req-dcff4a2c-207a-42ac-9e25-189c0c3dac27 tempest-VolumesBackupsAdminTest-1500745506 None] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 2.063s {{(pid=101319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jul 03 09:40:04.311704 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-dcff4a2c-207a-42ac-9e25-189c0c3dac27 tempest-VolumesBackupsAdminTest-1500745506 None] _get_connection_devices called with parameters: connection_properties={'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-6b682bae-d2d2-49c0-8a1c-8f9a74831d6c', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '6b682bae-d2d2-49c0-8a1c-8f9a74831d6c', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': False}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=101319) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:847}} Jul 03 09:40:04.322428 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-dcff4a2c-207a-42ac-9e25-189c0c3dac27 tempest-VolumesBackupsAdminTest-1500745506 None] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS: Jul 03 09:40:04.322428 np0000004400 cinder-backup[101319]: No targets found. Jul 03 09:40:04.322428 np0000004400 cinder-backup[101319]: iSNS: Jul 03 09:40:04.322428 np0000004400 cinder-backup[101319]: No targets found. Jul 03 09:40:04.322428 np0000004400 cinder-backup[101319]: STATIC: Jul 03 09:40:04.322428 np0000004400 cinder-backup[101319]: Target: iqn.2023-03.storpool.com:os--volume-6b682bae-d2d2-49c0-8a1c-8f9a74831d6c Jul 03 09:40:04.322428 np0000004400 cinder-backup[101319]: Portal: 192.168.40.100:3260,-1 Jul 03 09:40:04.322428 np0000004400 cinder-backup[101319]: Iface Name: default Jul 03 09:40:04.322428 np0000004400 cinder-backup[101319]: Target: iqn.2023-03.storpool.com:os--volume-e2580fe0-9b9f-48e5-b77e-51a2b22f14fb Jul 03 09:40:04.322428 np0000004400 cinder-backup[101319]: Portal: 192.168.50.100:3260,-1 Jul 03 09:40:04.322428 np0000004400 cinder-backup[101319]: Iface Name: default Jul 03 09:40:04.322428 np0000004400 cinder-backup[101319]: Portal: 192.168.40.100:3260,-1 Jul 03 09:40:04.322428 np0000004400 cinder-backup[101319]: Iface Name: default Jul 03 09:40:04.322428 np0000004400 cinder-backup[101319]: Target: iqn.2023-03.storpool.com:os--volume-2cb23c9f-fd1d-4ffa-b027-28faa3d99f1d Jul 03 09:40:04.322428 np0000004400 cinder-backup[101319]: Portal: 192.168.50.100:3260,-1 Jul 03 09:40:04.322428 np0000004400 cinder-backup[101319]: Iface Name: default Jul 03 09:40:04.322428 np0000004400 cinder-backup[101319]: Portal: 192.168.40.100:3260,-1 Jul 03 09:40:04.322428 np0000004400 cinder-backup[101319]: Iface Name: default Jul 03 09:40:04.322428 np0000004400 cinder-backup[101319]: Target: iqn.2023-03.storpool.com:os--volume-7efaaf27-40a2-430b-9938-502e44790539 Jul 03 09:40:04.322428 np0000004400 cinder-backup[101319]: Portal: 192.168.50.100:3260,-1 Jul 03 09:40:04.322428 np0000004400 cinder-backup[101319]: Iface Name: default Jul 03 09:40:04.322428 np0000004400 cinder-backup[101319]: Portal: 192.168.40.100:3260,-1 Jul 03 09:40:04.322428 np0000004400 cinder-backup[101319]: Iface Name: default Jul 03 09:40:04.322428 np0000004400 cinder-backup[101319]: FIRMWARE: Jul 03 09:40:04.322428 np0000004400 cinder-backup[101319]: No targets found. Jul 03 09:40:04.322428 np0000004400 cinder-backup[101319]: stderr= {{(pid=101319) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jul 03 09:40:04.324287 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-dcff4a2c-207a-42ac-9e25-189c0c3dac27 tempest-VolumesBackupsAdminTest-1500745506 None] Regex to get portals from discoverydb: ^SENDTARGETS: Jul 03 09:40:04.324287 np0000004400 cinder-backup[101319]: .*?^DiscoveryAddress: 192.168.40.100,3260.*? Jul 03 09:40:04.324287 np0000004400 cinder-backup[101319]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=101319) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:390}} Jul 03 09:40:04.324287 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-dcff4a2c-207a-42ac-9e25-189c0c3dac27 tempest-VolumesBackupsAdminTest-1500745506 None] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-6b682bae-d2d2-49c0-8a1c-8f9a74831d6c', 0)] {{(pid=101319) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:858}} Jul 03 09:40:04.347204 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-dcff4a2c-207a-42ac-9e25-189c0c3dac27 tempest-VolumesBackupsAdminTest-1500745506 None] iscsiadm ('-m', 'session'): stdout=tcp: [33] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2cb23c9f-fd1d-4ffa-b027-28faa3d99f1d (non-flash) Jul 03 09:40:04.347204 np0000004400 cinder-backup[101319]: tcp: [34] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2cb23c9f-fd1d-4ffa-b027-28faa3d99f1d (non-flash) Jul 03 09:40:04.347204 np0000004400 cinder-backup[101319]: tcp: [35] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e2580fe0-9b9f-48e5-b77e-51a2b22f14fb (non-flash) Jul 03 09:40:04.347204 np0000004400 cinder-backup[101319]: tcp: [36] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e2580fe0-9b9f-48e5-b77e-51a2b22f14fb (non-flash) Jul 03 09:40:04.347204 np0000004400 cinder-backup[101319]: tcp: [37] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6b682bae-d2d2-49c0-8a1c-8f9a74831d6c (non-flash) Jul 03 09:40:04.347204 np0000004400 cinder-backup[101319]: tcp: [38] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7efaaf27-40a2-430b-9938-502e44790539 (non-flash) Jul 03 09:40:04.347204 np0000004400 cinder-backup[101319]: tcp: [39] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7efaaf27-40a2-430b-9938-502e44790539 (non-flash) Jul 03 09:40:04.347204 np0000004400 cinder-backup[101319]: stderr= {{(pid=101319) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jul 03 09:40:04.347562 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-dcff4a2c-207a-42ac-9e25-189c0c3dac27 tempest-VolumesBackupsAdminTest-1500745506 None] iscsi session list stdout=tcp: [33] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2cb23c9f-fd1d-4ffa-b027-28faa3d99f1d (non-flash) Jul 03 09:40:04.347562 np0000004400 cinder-backup[101319]: tcp: [34] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2cb23c9f-fd1d-4ffa-b027-28faa3d99f1d (non-flash) Jul 03 09:40:04.347562 np0000004400 cinder-backup[101319]: tcp: [35] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e2580fe0-9b9f-48e5-b77e-51a2b22f14fb (non-flash) Jul 03 09:40:04.347562 np0000004400 cinder-backup[101319]: tcp: [36] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e2580fe0-9b9f-48e5-b77e-51a2b22f14fb (non-flash) Jul 03 09:40:04.347562 np0000004400 cinder-backup[101319]: tcp: [37] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6b682bae-d2d2-49c0-8a1c-8f9a74831d6c (non-flash) Jul 03 09:40:04.347562 np0000004400 cinder-backup[101319]: tcp: [38] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7efaaf27-40a2-430b-9938-502e44790539 (non-flash) Jul 03 09:40:04.347562 np0000004400 cinder-backup[101319]: tcp: [39] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7efaaf27-40a2-430b-9938-502e44790539 (non-flash) Jul 03 09:40:04.347562 np0000004400 cinder-backup[101319]: stderr= {{(pid=101319) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jul 03 09:40:04.347562 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-dcff4a2c-207a-42ac-9e25-189c0c3dac27 tempest-VolumesBackupsAdminTest-1500745506 None] Sessions list: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-2cb23c9f-fd1d-4ffa-b027-28faa3d99f1d', '33'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-2cb23c9f-fd1d-4ffa-b027-28faa3d99f1d', '34'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-e2580fe0-9b9f-48e5-b77e-51a2b22f14fb', '35'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-e2580fe0-9b9f-48e5-b77e-51a2b22f14fb', '36'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-6b682bae-d2d2-49c0-8a1c-8f9a74831d6c', '37'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-7efaaf27-40a2-430b-9938-502e44790539', '38'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-7efaaf27-40a2-430b-9938-502e44790539', '39')] {{(pid=101319) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:866}} Jul 03 09:40:04.347562 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-dcff4a2c-207a-42ac-9e25-189c0c3dac27 tempest-VolumesBackupsAdminTest-1500745506 None] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-6b682bae-d2d2-49c0-8a1c-8f9a74831d6c, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-6b682bae-d2d2-49c0-8a1c-8f9a74831d6c', '37')] {{(pid=101319) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}} Jul 03 09:40:04.349302 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-dcff4a2c-207a-42ac-9e25-189c0c3dac27 tempest-VolumesBackupsAdminTest-1500745506 None] Resulting device map defaultdict(. at 0x7e76e7585260>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-6b682bae-d2d2-49c0-8a1c-8f9a74831d6c'): ({'sdd'}, set())}) {{(pid=101319) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:912}} Jul 03 09:40:04.349615 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.linuxscsi [None req-dcff4a2c-207a-42ac-9e25-189c0c3dac27 tempest-VolumesBackupsAdminTest-1500745506 None] Removing single pathed devices sdd {{(pid=101319) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}} Jul 03 09:40:04.363026 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.linuxscsi [None req-dcff4a2c-207a-42ac-9e25-189c0c3dac27 tempest-VolumesBackupsAdminTest-1500745506 None] Flushing IO for device /dev/sdd {{(pid=101319) flush_device_io /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:461}} Jul 03 09:40:04.375200 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.linuxscsi [None req-dcff4a2c-207a-42ac-9e25-189c0c3dac27 tempest-VolumesBackupsAdminTest-1500745506 None] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=101319) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}} Jul 03 09:40:04.434529 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.linuxscsi [None req-dcff4a2c-207a-42ac-9e25-189c0c3dac27 tempest-VolumesBackupsAdminTest-1500745506 None] Checking to see if SCSI volumes sdd have been removed. {{(pid=101319) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}} Jul 03 09:40:04.434605 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.linuxscsi [None req-dcff4a2c-207a-42ac-9e25-189c0c3dac27 tempest-VolumesBackupsAdminTest-1500745506 None] SCSI volumes sdd have been removed. {{(pid=101319) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}} Jul 03 09:40:04.436294 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.linuxscsi [None req-dcff4a2c-207a-42ac-9e25-189c0c3dac27 tempest-VolumesBackupsAdminTest-1500745506 None] Checking to see if device paths {'sdd'} are still under multipathd monitoring {{(pid=101319) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}} Jul 03 09:40:04.447160 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.linuxscsi [None req-dcff4a2c-207a-42ac-9e25-189c0c3dac27 tempest-VolumesBackupsAdminTest-1500745506 None] Device paths {'sdd'} have been removed from multipathd monitoring. {{(pid=101319) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}} Jul 03 09:40:04.447543 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-dcff4a2c-207a-42ac-9e25-189c0c3dac27 tempest-VolumesBackupsAdminTest-1500745506 None] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-6b682bae-d2d2-49c0-8a1c-8f9a74831d6c')] {{(pid=101319) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1225}} Jul 03 09:40:04.459456 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-dcff4a2c-207a-42ac-9e25-189c0c3dac27 tempest-VolumesBackupsAdminTest-1500745506 None] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=101319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 03 09:40:04.493433 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-dcff4a2c-207a-42ac-9e25-189c0c3dac27 tempest-VolumesBackupsAdminTest-1500745506 None] iscsiadm ('--logout',): stdout=Logging out of session [sid: 37, target: iqn.2023-03.storpool.com:os--volume-6b682bae-d2d2-49c0-8a1c-8f9a74831d6c, portal: 192.168.40.100,3260] Jul 03 09:40:04.493433 np0000004400 cinder-backup[101319]: Logout of [sid: 37, target: iqn.2023-03.storpool.com:os--volume-6b682bae-d2d2-49c0-8a1c-8f9a74831d6c, portal: 192.168.40.100,3260] successful. Jul 03 09:40:04.493433 np0000004400 cinder-backup[101319]: stderr= {{(pid=101319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 03 09:40:04.511243 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-dcff4a2c-207a-42ac-9e25-189c0c3dac27 tempest-VolumesBackupsAdminTest-1500745506 None] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=101319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 03 09:40:04.511243 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.base [None req-dcff4a2c-207a-42ac-9e25-189c0c3dac27 tempest-VolumesBackupsAdminTest-1500745506 None] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.200s {{(pid=101319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jul 03 09:40:04.511243 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-dcff4a2c-207a-42ac-9e25-189c0c3dac27 tempest-VolumesBackupsAdminTest-1500745506 None] <== disconnect_volume: return (2262ms) None {{(pid=101319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}} Jul 03 09:40:05.540274 np0000004400 cinder-backup[101319]: INFO cinder.backup.manager [None req-dcff4a2c-207a-42ac-9e25-189c0c3dac27 tempest-VolumesBackupsAdminTest-1500745506 None] Create backup finished. backup: fe9dd1c3-699a-4fc3-ae7f-2830334a957c. Jul 03 09:40:06.238123 np0000004400 cinder-backup[101319]: INFO cinder.backup.manager [None req-e948be99-44bb-489b-a5ba-e76ebb7388ba tempest-VolumesBackupsAdminTest-895628463 None] Export record started, backup: fe9dd1c3-699a-4fc3-ae7f-2830334a957c. Jul 03 09:40:06.240979 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.drivers.swift [None req-e948be99-44bb-489b-a5ba-e76ebb7388ba tempest-VolumesBackupsAdminTest-895628463 None] Using swift URL https://10.4.3.95:8080/v1/AUTH_ef7088f3bf6f417fab0f06c3c66bfb29 {{(pid=101319) initialize /opt/stack/cinder/cinder/backup/drivers/swift.py:300}} Jul 03 09:40:06.241176 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.drivers.swift [None req-e948be99-44bb-489b-a5ba-e76ebb7388ba tempest-VolumesBackupsAdminTest-895628463 None] Connect to https://10.4.3.95:8080/v1/AUTH_ in "per_user" mode {{(pid=101319) initialize /opt/stack/cinder/cinder/backup/drivers/swift.py:301}} Jul 03 09:40:06.241573 np0000004400 cinder-backup[101319]: INFO cinder.backup.manager [None req-e948be99-44bb-489b-a5ba-e76ebb7388ba tempest-VolumesBackupsAdminTest-895628463 None] Export record finished, backup fe9dd1c3-699a-4fc3-ae7f-2830334a957c exported. Jul 03 09:40:06.810601 np0000004400 cinder-backup[101319]: INFO cinder.backup.manager [None req-66cd029d-0585-469b-bb91-2c792ff5f065 tempest-VolumesBackupsAdminTest-895628463 None] Import record started, backup_url: eyJkcml2ZXJfaW5mbyI6IHt9LCAiaWQiOiAiNDJlODRkNGYtYzdmOC00OGQ5LTgyZDgtNjc2NGI5NDJlMTMxIiwgInVzZXJfaWQiOiAiMzU2YTUzNDk1MmI4NGMwNjgwZmEzYjk2NTVhMGZjMTMiLCAicHJvamVjdF9pZCI6ICJiMjU3MTJhNmRlYmE0MjM3YjNkOWY4ZjAyYmI1NGVkNiIsICJ2b2x1bWVfaWQiOiAiNmI2ODJiYWUtZDJkMi00OWMwLThhMWMtOGY5YTc0ODMxZDZjIiwgImhvc3QiOiAibnAwMDAwMDA0NDAwIiwgImF2YWlsYWJpbGl0eV96b25lIjogIm5vdmEiLCAiY29udGFpbmVyIjogInRlbXBlc3Qtdm9sdW1lc2JhY2t1cHNhZG1pbnRlc3QtYmFja3VwLWNvbnRhaW5lci0zMTc2MjM5NCIsICJwYXJlbnRfaWQiOiBudWxsLCAic3RhdHVzIjogImF2YWlsYWJsZSIsICJmYWlsX3JlYXNvbiI6IG51bGwsICJzaXplIjogMSwgImRpc3BsYXlfbmFtZSI6ICJ0ZW1wZXN0LVZvbHVtZXNCYWNrdXBzQWRtaW5UZXN0LUJhY2t1cC03NzI1ODkyOCIsICJkaXNwbGF5X2Rlc2NyaXB0aW9uIjogbnVsbCwgInNlcnZpY2VfbWV0YWRhdGEiOiAidm9sdW1lXzZiNjgyYmFlLWQyZDItNDljMC04YTFjLThmOWE3NDgzMWQ2Yy8yMDI2MDcwMzA5Mzk0OC9hel9ub3ZhX2JhY2t1cF9mZTlkZDFjMy02OTlhLTRmYzMtYWU3Zi0yODMwMzM0YTk1N2MiLCAic2VydmljZSI6ICJjaW5kZXIuYmFja3VwLmRyaXZlcnMuc3dpZnQuU3dpZnRCYWNrdXBEcml2ZXIiLCAib2JqZWN0X2NvdW50IjogMjEsICJ0ZW1wX3ZvbHVtZV9pZCI6IG51bGwsICJ0ZW1wX3NuYXBzaG90X2lkIjogbnVsbCwgIm51bV9kZXBlbmRlbnRfYmFja3VwcyI6IDAsICJzbmFwc2hvdF9pZCI6IG51bGwsICJkYXRhX3RpbWVzdGFtcCI6ICIyMDI2LTA3LTAzVDA5OjM5OjQ0WiIsICJyZXN0b3JlX3ZvbHVtZV9pZCI6IG51bGwsICJtZXRhZGF0YSI6IHt9LCAiZW5jcnlwdGlvbl9rZXlfaWQiOiBudWxsLCAiY3JlYXRlZF9hdCI6ICIyMDI2LTA3LTAzVDA5OjM5OjQ0WiIsICJ1cGRhdGVkX2F0IjogIjIwMjYtMDctMDNUMDk6NDA6MDZaIiwgImRlbGV0ZWRfYXQiOiBudWxsLCAiZGVsZXRlZCI6IGZhbHNlfQ==. Jul 03 09:40:06.812312 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.drivers.swift [None req-66cd029d-0585-469b-bb91-2c792ff5f065 tempest-VolumesBackupsAdminTest-895628463 None] Using swift URL https://10.4.3.95:8080/v1/AUTH_ef7088f3bf6f417fab0f06c3c66bfb29 {{(pid=101319) initialize /opt/stack/cinder/cinder/backup/drivers/swift.py:300}} Jul 03 09:40:06.812312 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.drivers.swift [None req-66cd029d-0585-469b-bb91-2c792ff5f065 tempest-VolumesBackupsAdminTest-895628463 None] Connect to https://10.4.3.95:8080/v1/AUTH_ in "per_user" mode {{(pid=101319) initialize /opt/stack/cinder/cinder/backup/drivers/swift.py:301}} Jul 03 09:40:06.854599 np0000004400 cinder-backup[101319]: DEBUG oslo_db.sqlalchemy.engines [None req-66cd029d-0585-469b-bb91-2c792ff5f065 tempest-VolumesBackupsAdminTest-895628463 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=101319) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 03 09:40:06.877425 np0000004400 cinder-backup[101319]: INFO cinder.backup.manager [None req-66cd029d-0585-469b-bb91-2c792ff5f065 tempest-VolumesBackupsAdminTest-895628463 None] Import record id 42e84d4f-c7f8-48d9-82d8-6764b942e131 metadata from driver finished. Jul 03 09:40:09.094551 np0000004400 cinder-backup[101319]: INFO cinder.backup.manager [None req-e9aff13f-76c8-49a6-bd16-080f44143496 tempest-VolumesBackupsAdminTest-1500745506 None] Restore backup started, backup: fe9dd1c3-699a-4fc3-ae7f-2830334a957c volume: 71248f04-8364-4267-8b8a-a95f390c6126. Jul 03 09:40:09.103562 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.drivers.swift [None req-e9aff13f-76c8-49a6-bd16-080f44143496 tempest-VolumesBackupsAdminTest-1500745506 None] Using swift URL https://10.4.3.95:8080/v1/AUTH_b25712a6deba4237b3d9f8f02bb54ed6 {{(pid=101319) initialize /opt/stack/cinder/cinder/backup/drivers/swift.py:300}} Jul 03 09:40:09.103768 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.drivers.swift [None req-e9aff13f-76c8-49a6-bd16-080f44143496 tempest-VolumesBackupsAdminTest-1500745506 None] Connect to https://10.4.3.95:8080/v1/AUTH_ in "per_user" mode {{(pid=101319) initialize /opt/stack/cinder/cinder/backup/drivers/swift.py:301}} Jul 03 09:40:09.104085 np0000004400 cinder-backup[101319]: DEBUG os_brick.utils [None req-e9aff13f-76c8-49a6-bd16-080f44143496 tempest-VolumesBackupsAdminTest-1500745506 None] ==> get_connector_properties: call "{'root_helper': 'sudo cinder-rootwrap /etc/cinder/rootwrap.conf', 'my_ip': '10.4.3.95', 'multipath': False, 'enforce_multipath': False, 'host': None, 'execute': None}" {{(pid=101319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}} Jul 03 09:40:09.113333 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.scaleio [None req-e9aff13f-76c8-49a6-bd16-080f44143496 tempest-VolumesBackupsAdminTest-1500745506 None] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=101319) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}} Jul 03 09:40:09.129703 np0000004400 cinder-backup[101319]: DEBUG oslo_concurrency.processutils [None req-e9aff13f-76c8-49a6-bd16-080f44143496 tempest-VolumesBackupsAdminTest-1500745506 None] Running cmd (subprocess): nvme version {{(pid=101319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 09:40:09.141863 np0000004400 cinder-backup[101319]: DEBUG oslo_concurrency.processutils [None req-e9aff13f-76c8-49a6-bd16-080f44143496 tempest-VolumesBackupsAdminTest-1500745506 None] 'nvme version' failed. Not Retrying. {{(pid=101319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 03 09:40:09.142125 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.nvmeof [None req-e9aff13f-76c8-49a6-bd16-080f44143496 tempest-VolumesBackupsAdminTest-1500745506 None] nvme not present on system {{(pid=101319) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}} Jul 03 09:40:09.148634 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.lightos [None req-e9aff13f-76c8-49a6-bd16-080f44143496 tempest-VolumesBackupsAdminTest-1500745506 None] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=101319) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}} Jul 03 09:40:09.149990 np0000004400 cinder-backup[101319]: INFO os_brick.initiator.connectors.lightos [None req-e9aff13f-76c8-49a6-bd16-080f44143496 tempest-VolumesBackupsAdminTest-1500745506 None] Current host hostNQN and IP(s) are ['10.4.3.95', 'fe80::f816:3eff:fe47:268c', '192.168.40.6', 'fe80::f816:3eff:febf:7be2', '192.168.50.6', 'fe80::f816:3eff:fe99:8914', '192.168.10.6', 'fe80::f816:3eff:fe2f:e696', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::bc9d:84ff:fec2:6b49', 'fe80::fc16:3eff:fe72:8d5f', 'fe80::48a4:5fff:fedc:623c', 'fe80::fc16:3eff:fe7d:3947', 'fe80::18ab:2bff:fec0:3e86', 'fe80::fc16:3eff:fe4d:ac92', 'fe80::447e:c9ff:fe51:ed86', 'fe80::fc16:3eff:fef6:2138', 'fe80::fc16:3eff:fe32:7456', 'fe80::5c7b:e3ff:fe91:4d8f', 'fe80::fc16:3eff:fe07:4fd3'] Jul 03 09:40:09.150165 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.lightos [None req-e9aff13f-76c8-49a6-bd16-080f44143496 tempest-VolumesBackupsAdminTest-1500745506 None] LIGHTOS: did not find dsc, continuing anyway. {{(pid=101319) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}} Jul 03 09:40:09.150311 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.lightos [None req-e9aff13f-76c8-49a6-bd16-080f44143496 tempest-VolumesBackupsAdminTest-1500745506 None] LIGHTOS: no hostnqn found. {{(pid=101319) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}} Jul 03 09:40:09.150642 np0000004400 cinder-backup[101319]: DEBUG os_brick.utils [None req-e9aff13f-76c8-49a6-bd16-080f44143496 tempest-VolumesBackupsAdminTest-1500745506 None] <== get_connector_properties: return (45ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.95', 'host': 'np0000004400', 'multipath': False, 'enforce_multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:ae7e5bb0ebe6', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': '6b284368-d0ba-4d18-af6f-4998d3955c52', 'nvme_native_multipath': False} {{(pid=101319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}} Jul 03 09:40:10.159119 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connector [None req-e9aff13f-76c8-49a6-bd16-080f44143496 tempest-VolumesBackupsAdminTest-1500745506 None] Factory for iscsi on None {{(pid=101319) factory /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connector.py:243}} Jul 03 09:40:10.159708 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-e9aff13f-76c8-49a6-bd16-080f44143496 tempest-VolumesBackupsAdminTest-1500745506 None] ==> connect_volume: call "{'self': , 'connection_properties': {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-71248f04-8364-4267-8b8a-a95f390c6126', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '71248f04-8364-4267-8b8a-a95f390c6126', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': False}}" {{(pid=101319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}} Jul 03 09:40:10.159708 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.base [None req-e9aff13f-76c8-49a6-bd16-080f44143496 tempest-VolumesBackupsAdminTest-1500745506 None] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=101319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jul 03 09:40:11.142094 np0000004400 cinder-backup[101319]: DEBUG oslo_db.sqlalchemy.engines [None req-c3c8d3a9-3541-41d7-9916-9ce1f91f0d1c None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=101319) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 03 09:40:12.139640 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.base [None req-e9aff13f-76c8-49a6-bd16-080f44143496 tempest-VolumesBackupsAdminTest-1500745506 None] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 1.980s {{(pid=101319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jul 03 09:40:12.140004 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.base [None req-e9aff13f-76c8-49a6-bd16-080f44143496 tempest-VolumesBackupsAdminTest-1500745506 None] Connection properties {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-71248f04-8364-4267-8b8a-a95f390c6126', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '71248f04-8364-4267-8b8a-a95f390c6126', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': False} {{(pid=101319) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}} Jul 03 09:40:12.156600 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.base [None req-e9aff13f-76c8-49a6-bd16-080f44143496 tempest-VolumesBackupsAdminTest-1500745506 None] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-71248f04-8364-4267-8b8a-a95f390c6126" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=101319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jul 03 09:40:12.157285 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.base [None req-e9aff13f-76c8-49a6-bd16-080f44143496 tempest-VolumesBackupsAdminTest-1500745506 None] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-71248f04-8364-4267-8b8a-a95f390c6126" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=101319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jul 03 09:40:12.157359 np0000004400 cinder-backup[101319]: INFO os_brick.initiator.connectors.iscsi [None req-e9aff13f-76c8-49a6-bd16-080f44143496 tempest-VolumesBackupsAdminTest-1500745506 None] Trying to connect to iSCSI portal 192.168.40.100:3260 Jul 03 09:40:12.168005 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-e9aff13f-76c8-49a6-bd16-080f44143496 tempest-VolumesBackupsAdminTest-1500745506 None] iscsiadm (): stdout= stderr=iscsiadm: No records found Jul 03 09:40:12.168005 np0000004400 cinder-backup[101319]: {{(pid=101319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 03 09:40:12.180639 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-e9aff13f-76c8-49a6-bd16-080f44143496 tempest-VolumesBackupsAdminTest-1500745506 None] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-71248f04-8364-4267-8b8a-a95f390c6126] added Jul 03 09:40:12.180639 np0000004400 cinder-backup[101319]: stderr=iscsiadm: Config file line 363 does not have value Jul 03 09:40:12.180639 np0000004400 cinder-backup[101319]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs' Jul 03 09:40:12.180639 np0000004400 cinder-backup[101319]: iscsiadm: Config file line 363 does not have value Jul 03 09:40:12.180639 np0000004400 cinder-backup[101319]: iscsiadm: Config file line 363 does not have value Jul 03 09:40:12.180639 np0000004400 cinder-backup[101319]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs' Jul 03 09:40:12.180639 np0000004400 cinder-backup[101319]: {{(pid=101319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 03 09:40:12.181011 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-e9aff13f-76c8-49a6-bd16-080f44143496 tempest-VolumesBackupsAdminTest-1500745506 None] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=101319) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}} Jul 03 09:40:12.181201 np0000004400 cinder-backup[101319]: DEBUG os_brick.utils [None req-e9aff13f-76c8-49a6-bd16-080f44143496 tempest-VolumesBackupsAdminTest-1500745506 None] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0238(s), this was the 1st time calling it. {{(pid=101319) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}} Jul 03 09:40:12.181433 np0000004400 cinder-backup[101319]: DEBUG os_brick.utils [None req-e9aff13f-76c8-49a6-bd16-080f44143496 tempest-VolumesBackupsAdminTest-1500745506 None] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=101319) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}} Jul 03 09:40:13.182858 np0000004400 cinder-backup[101319]: INFO os_brick.initiator.connectors.iscsi [None req-e9aff13f-76c8-49a6-bd16-080f44143496 tempest-VolumesBackupsAdminTest-1500745506 None] Trying to connect to iSCSI portal 192.168.40.100:3260 Jul 03 09:40:13.195295 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-e9aff13f-76c8-49a6-bd16-080f44143496 tempest-VolumesBackupsAdminTest-1500745506 None] iscsiadm (): stdout=# BEGIN RECORD 2.1.9 Jul 03 09:40:13.195295 np0000004400 cinder-backup[101319]: node.name = iqn.2023-03.storpool.com:os--volume-71248f04-8364-4267-8b8a-a95f390c6126 Jul 03 09:40:13.195295 np0000004400 cinder-backup[101319]: node.tpgt = -1 Jul 03 09:40:13.195295 np0000004400 cinder-backup[101319]: node.startup = manual Jul 03 09:40:13.195295 np0000004400 cinder-backup[101319]: node.leading_login = No Jul 03 09:40:13.195295 np0000004400 cinder-backup[101319]: iface.iscsi_ifacename = default Jul 03 09:40:13.195295 np0000004400 cinder-backup[101319]: iface.net_ifacename = Jul 03 09:40:13.195295 np0000004400 cinder-backup[101319]: iface.ipaddress = Jul 03 09:40:13.195295 np0000004400 cinder-backup[101319]: iface.prefix_len = 0 Jul 03 09:40:13.195295 np0000004400 cinder-backup[101319]: iface.hwaddress = Jul 03 09:40:13.195295 np0000004400 cinder-backup[101319]: iface.transport_name = tcp Jul 03 09:40:13.195295 np0000004400 cinder-backup[101319]: iface.initiatorname = Jul 03 09:40:13.195295 np0000004400 cinder-backup[101319]: iface.state = Jul 03 09:40:13.195295 np0000004400 cinder-backup[101319]: iface.vlan_id = 0 Jul 03 09:40:13.195295 np0000004400 cinder-backup[101319]: iface.vlan_priority = 0 Jul 03 09:40:13.195295 np0000004400 cinder-backup[101319]: iface.vlan_state = Jul 03 09:40:13.195295 np0000004400 cinder-backup[101319]: iface.iface_num = 0 Jul 03 09:40:13.195295 np0000004400 cinder-backup[101319]: iface.mtu = 0 Jul 03 09:40:13.195295 np0000004400 cinder-backup[101319]: iface.port = 0 Jul 03 09:40:13.195295 np0000004400 cinder-backup[101319]: iface.bootproto = Jul 03 09:40:13.195295 np0000004400 cinder-backup[101319]: iface.subnet_mask = Jul 03 09:40:13.195295 np0000004400 cinder-backup[101319]: iface.gateway = Jul 03 09:40:13.195295 np0000004400 cinder-backup[101319]: iface.dhcp_alt_client_id_state = Jul 03 09:40:13.195295 np0000004400 cinder-backup[101319]: iface.dhcp_alt_client_id = Jul 03 09:40:13.195295 np0000004400 cinder-backup[101319]: iface.dhcp_dns = Jul 03 09:40:13.195295 np0000004400 cinder-backup[101319]: iface.dhcp_learn_iqn = Jul 03 09:40:13.195295 np0000004400 cinder-backup[101319]: iface.dhcp_req_vendor_id_state = Jul 03 09:40:13.195295 np0000004400 cinder-backup[101319]: iface.dhcp_vendor_id_state = Jul 03 09:40:13.195295 np0000004400 cinder-backup[101319]: iface.dhcp_vendor_id = Jul 03 09:40:13.195295 np0000004400 cinder-backup[101319]: iface.dhcp_slp_da = Jul 03 09:40:13.195295 np0000004400 cinder-backup[101319]: iface.fragmentation = Jul 03 09:40:13.195295 np0000004400 cinder-backup[101319]: iface.gratuitous_arp = Jul 03 09:40:13.195295 np0000004400 cinder-backup[101319]: iface.incoming_forwarding = Jul 03 09:40:13.195295 np0000004400 cinder-backup[101319]: iface.tos_state = Jul 03 09:40:13.195295 np0000004400 cinder-backup[101319]: iface.tos = 0 Jul 03 09:40:13.195295 np0000004400 cinder-backup[101319]: iface.ttl = 0 Jul 03 09:40:13.195295 np0000004400 cinder-backup[101319]: iface.delayed_ack = Jul 03 09:40:13.195295 np0000004400 cinder-backup[101319]: iface.tcp_nagle = Jul 03 09:40:13.195295 np0000004400 cinder-backup[101319]: iface.tcp_wsf_state = Jul 03 09:40:13.195295 np0000004400 cinder-backup[101319]: iface.tcp_wsf = 0 Jul 03 09:40:13.195295 np0000004400 cinder-backup[101319]: iface.tcp_timer_scale = 0 Jul 03 09:40:13.195295 np0000004400 cinder-backup[101319]: iface.tcp_timestamp = Jul 03 09:40:13.195295 np0000004400 cinder-backup[101319]: iface.redirect = Jul 03 09:40:13.195295 np0000004400 cinder-backup[101319]: iface.def_task_mgmt_timeout = 0 Jul 03 09:40:13.195295 np0000004400 cinder-backup[101319]: iface.header_digest = Jul 03 09:40:13.195295 np0000004400 cinder-backup[101319]: iface.data_digest = Jul 03 09:40:13.195295 np0000004400 cinder-backup[101319]: iface.immediate_data = Jul 03 09:40:13.195295 np0000004400 cinder-backup[101319]: iface.initial_r2t = Jul 03 09:40:13.195295 np0000004400 cinder-backup[101319]: iface.data_seq_inorder = Jul 03 09:40:13.195295 np0000004400 cinder-backup[101319]: iface.data_pdu_inorder = Jul 03 09:40:13.195295 np0000004400 cinder-backup[101319]: iface.erl = 0 Jul 03 09:40:13.195295 np0000004400 cinder-backup[101319]: iface.max_receive_data_len = 0 Jul 03 09:40:13.195295 np0000004400 cinder-backup[101319]: iface.first_burst_len = 0 Jul 03 09:40:13.195295 np0000004400 cinder-backup[101319]: iface.max_outstanding_r2t = 0 Jul 03 09:40:13.195295 np0000004400 cinder-backup[101319]: iface.max_burst_len = 0 Jul 03 09:40:13.195295 np0000004400 cinder-backup[101319]: iface.chap_auth = Jul 03 09:40:13.195295 np0000004400 cinder-backup[101319]: iface.bidi_chap = Jul 03 09:40:13.195295 np0000004400 cinder-backup[101319]: iface.strict_login_compliance = Jul 03 09:40:13.195295 np0000004400 cinder-backup[101319]: iface.discovery_auth = Jul 03 09:40:13.195295 np0000004400 cinder-backup[101319]: iface.discovery_logout = Jul 03 09:40:13.195295 np0000004400 cinder-backup[101319]: node.discovery_address = Jul 03 09:40:13.195295 np0000004400 cinder-backup[101319]: node.discovery_port = 0 Jul 03 09:40:13.195295 np0000004400 cinder-backup[101319]: node.discovery_type = fw Jul 03 09:40:13.195295 np0000004400 cinder-backup[101319]: node.session.initial_cmdsn = 0 Jul 03 09:40:13.195295 np0000004400 cinder-backup[101319]: node.session.initial_login_retry_max = 8 Jul 03 09:40:13.195295 np0000004400 cinder-backup[101319]: node.session.xmit_thread_priority = 0 Jul 03 09:40:13.195295 np0000004400 cinder-backup[101319]: node.session.cmds_max = 128 Jul 03 09:40:13.195295 np0000004400 cinder-backup[101319]: node.session.queue_depth = 32 Jul 03 09:40:13.195295 np0000004400 cinder-backup[101319]: node.session.nr_sessions = 1 Jul 03 09:40:13.195295 np0000004400 cinder-backup[101319]: node.session.auth.authmethod = None Jul 03 09:40:13.195295 np0000004400 cinder-backup[101319]: node.session.auth.username = Jul 03 09:40:13.195295 np0000004400 cinder-backup[101319]: node.session.auth.password = *** Jul 03 09:40:13.195295 np0000004400 cinder-backup[101319]: node.session.auth.username_in = Jul 03 09:40:13.195295 np0000004400 cinder-backup[101319]: node.session.auth.password_in = Jul 03 09:40:13.195295 np0000004400 cinder-backup[101319]: node.session.auth.chap_algs = SHA256 Jul 03 09:40:13.195295 np0000004400 cinder-backup[101319]: node.session.timeo.replacement_timeout = 120 Jul 03 09:40:13.195295 np0000004400 cinder-backup[101319]: node.session.err_timeo.abort_timeout = 15 Jul 03 09:40:13.195295 np0000004400 cinder-backup[101319]: node.session.err_timeo.lu_reset_timeout = 30 Jul 03 09:40:13.195295 np0000004400 cinder-backup[101319]: node.session.err_timeo.tgt_reset_timeout = 30 Jul 03 09:40:13.195295 np0000004400 cinder-backup[101319]: node.session.err_timeo.host_reset_timeout = 60 Jul 03 09:40:13.195295 np0000004400 cinder-backup[101319]: node.session.iscsi.FastAbort = Yes Jul 03 09:40:13.195295 np0000004400 cinder-backup[101319]: node.session.iscsi.InitialR2T = No Jul 03 09:40:13.195295 np0000004400 cinder-backup[101319]: node.session.iscsi.ImmediateData = Yes Jul 03 09:40:13.195295 np0000004400 cinder-backup[101319]: node.session.iscsi.FirstBurstLength = 262144 Jul 03 09:40:13.195295 np0000004400 cinder-backup[101319]: node.session.iscsi.MaxBurstLength = 16776192 Jul 03 09:40:13.195295 np0000004400 cinder-backup[101319]: node.session.iscsi.DefaultTime2Retain = 0 Jul 03 09:40:13.195295 np0000004400 cinder-backup[101319]: node.session.iscsi.DefaultTime2Wait = 2 Jul 03 09:40:13.195295 np0000004400 cinder-backup[101319]: node.session.iscsi.MaxConnections = 1 Jul 03 09:40:13.195295 np0000004400 cinder-backup[101319]: node.session.iscsi.MaxOutstandingR2T = 1 Jul 03 09:40:13.195295 np0000004400 cinder-backup[101319]: node.session.iscsi.ERL = 0 Jul 03 09:40:13.195295 np0000004400 cinder-backup[101319]: node.session.scan = auto Jul 03 09:40:13.195295 np0000004400 cinder-backup[101319]: node.session.reopen_max = 0 Jul 03 09:40:13.195295 np0000004400 cinder-backup[101319]: node.conn[0].address = 192.168.40.100 Jul 03 09:40:13.195295 np0000004400 cinder-backup[101319]: node.conn[0].port = 3260 Jul 03 09:40:13.195295 np0000004400 cinder-backup[101319]: node.conn[0].startup = manual Jul 03 09:40:13.195295 np0000004400 cinder-backup[101319]: node.conn[0].tcp.window_size = 524288 Jul 03 09:40:13.195295 np0000004400 cinder-backup[101319]: node.conn[0].tcp.type_of_service = 0 Jul 03 09:40:13.195295 np0000004400 cinder-backup[101319]: node.conn[0].timeo.logout_timeout = 15 Jul 03 09:40:13.195295 np0000004400 cinder-backup[101319]: node.conn[0].timeo.login_timeout = 15 Jul 03 09:40:13.195295 np0000004400 cinder-backup[101319]: node.conn[0].timeo.auth_timeout = 45 Jul 03 09:40:13.195295 np0000004400 cinder-backup[101319]: node.conn[0].timeo.noop_out_interval = 5 Jul 03 09:40:13.195295 np0000004400 cinder-backup[101319]: node.conn[0].timeo.noop_out_timeout = 5 Jul 03 09:40:13.195295 np0000004400 cinder-backup[101319]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0 Jul 03 09:40:13.195295 np0000004400 cinder-backup[101319]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144 Jul 03 09:40:13.195295 np0000004400 cinder-backup[101319]: node.conn[0].iscsi.HeaderDigest = None Jul 03 09:40:13.195295 np0000004400 cinder-backup[101319]: node.conn[0].iscsi.DataDigest = None Jul 03 09:40:13.195295 np0000004400 cinder-backup[101319]: node.conn[0].iscsi.IFMarker = No Jul 03 09:40:13.195295 np0000004400 cinder-backup[101319]: node.conn[0].iscsi.OFMarker = No Jul 03 09:40:13.195295 np0000004400 cinder-backup[101319]: # END RECORD Jul 03 09:40:13.195295 np0000004400 cinder-backup[101319]: stderr= {{(pid=101319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 03 09:40:13.204820 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-e9aff13f-76c8-49a6-bd16-080f44143496 tempest-VolumesBackupsAdminTest-1500745506 None] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=101319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 03 09:40:13.219846 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-e9aff13f-76c8-49a6-bd16-080f44143496 tempest-VolumesBackupsAdminTest-1500745506 None] iscsiadm ('-m', 'session'): stdout=tcp: [33] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2cb23c9f-fd1d-4ffa-b027-28faa3d99f1d (non-flash) Jul 03 09:40:13.219846 np0000004400 cinder-backup[101319]: tcp: [34] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2cb23c9f-fd1d-4ffa-b027-28faa3d99f1d (non-flash) Jul 03 09:40:13.219846 np0000004400 cinder-backup[101319]: tcp: [35] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e2580fe0-9b9f-48e5-b77e-51a2b22f14fb (non-flash) Jul 03 09:40:13.219846 np0000004400 cinder-backup[101319]: tcp: [36] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e2580fe0-9b9f-48e5-b77e-51a2b22f14fb (non-flash) Jul 03 09:40:13.219846 np0000004400 cinder-backup[101319]: tcp: [40] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b5c70aaf-10ec-45f7-bd9f-756a91fe1d65 (non-flash) Jul 03 09:40:13.219846 np0000004400 cinder-backup[101319]: tcp: [41] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b5c70aaf-10ec-45f7-bd9f-756a91fe1d65 (non-flash) Jul 03 09:40:13.219846 np0000004400 cinder-backup[101319]: tcp: [42] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ef51248d-f155-43cd-afa0-8b0f72368a43 (non-flash) Jul 03 09:40:13.219846 np0000004400 cinder-backup[101319]: tcp: [43] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ef51248d-f155-43cd-afa0-8b0f72368a43 (non-flash) Jul 03 09:40:13.219846 np0000004400 cinder-backup[101319]: stderr= {{(pid=101319) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jul 03 09:40:13.220138 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-e9aff13f-76c8-49a6-bd16-080f44143496 tempest-VolumesBackupsAdminTest-1500745506 None] iscsi session list stdout=tcp: [33] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2cb23c9f-fd1d-4ffa-b027-28faa3d99f1d (non-flash) Jul 03 09:40:13.220138 np0000004400 cinder-backup[101319]: tcp: [34] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2cb23c9f-fd1d-4ffa-b027-28faa3d99f1d (non-flash) Jul 03 09:40:13.220138 np0000004400 cinder-backup[101319]: tcp: [35] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e2580fe0-9b9f-48e5-b77e-51a2b22f14fb (non-flash) Jul 03 09:40:13.220138 np0000004400 cinder-backup[101319]: tcp: [36] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e2580fe0-9b9f-48e5-b77e-51a2b22f14fb (non-flash) Jul 03 09:40:13.220138 np0000004400 cinder-backup[101319]: tcp: [40] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b5c70aaf-10ec-45f7-bd9f-756a91fe1d65 (non-flash) Jul 03 09:40:13.220138 np0000004400 cinder-backup[101319]: tcp: [41] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b5c70aaf-10ec-45f7-bd9f-756a91fe1d65 (non-flash) Jul 03 09:40:13.220138 np0000004400 cinder-backup[101319]: tcp: [42] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ef51248d-f155-43cd-afa0-8b0f72368a43 (non-flash) Jul 03 09:40:13.220138 np0000004400 cinder-backup[101319]: tcp: [43] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ef51248d-f155-43cd-afa0-8b0f72368a43 (non-flash) Jul 03 09:40:13.220138 np0000004400 cinder-backup[101319]: stderr= {{(pid=101319) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jul 03 09:40:13.263180 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-e9aff13f-76c8-49a6-bd16-080f44143496 tempest-VolumesBackupsAdminTest-1500745506 None] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-71248f04-8364-4267-8b8a-a95f390c6126, portal: 192.168.40.100,3260] Jul 03 09:40:13.263180 np0000004400 cinder-backup[101319]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-71248f04-8364-4267-8b8a-a95f390c6126, portal: 192.168.40.100,3260] successful. Jul 03 09:40:13.263180 np0000004400 cinder-backup[101319]: stderr= {{(pid=101319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 03 09:40:13.279991 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-e9aff13f-76c8-49a6-bd16-080f44143496 tempest-VolumesBackupsAdminTest-1500745506 None] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=101319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 03 09:40:13.299601 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-e9aff13f-76c8-49a6-bd16-080f44143496 tempest-VolumesBackupsAdminTest-1500745506 None] iscsiadm ('-m', 'session'): stdout=tcp: [33] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2cb23c9f-fd1d-4ffa-b027-28faa3d99f1d (non-flash) Jul 03 09:40:13.299601 np0000004400 cinder-backup[101319]: tcp: [34] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2cb23c9f-fd1d-4ffa-b027-28faa3d99f1d (non-flash) Jul 03 09:40:13.299601 np0000004400 cinder-backup[101319]: tcp: [35] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e2580fe0-9b9f-48e5-b77e-51a2b22f14fb (non-flash) Jul 03 09:40:13.299601 np0000004400 cinder-backup[101319]: tcp: [36] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e2580fe0-9b9f-48e5-b77e-51a2b22f14fb (non-flash) Jul 03 09:40:13.299601 np0000004400 cinder-backup[101319]: tcp: [40] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b5c70aaf-10ec-45f7-bd9f-756a91fe1d65 (non-flash) Jul 03 09:40:13.299601 np0000004400 cinder-backup[101319]: tcp: [41] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b5c70aaf-10ec-45f7-bd9f-756a91fe1d65 (non-flash) Jul 03 09:40:13.299601 np0000004400 cinder-backup[101319]: tcp: [42] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ef51248d-f155-43cd-afa0-8b0f72368a43 (non-flash) Jul 03 09:40:13.299601 np0000004400 cinder-backup[101319]: tcp: [43] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ef51248d-f155-43cd-afa0-8b0f72368a43 (non-flash) Jul 03 09:40:13.299601 np0000004400 cinder-backup[101319]: tcp: [44] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-71248f04-8364-4267-8b8a-a95f390c6126 (non-flash) Jul 03 09:40:13.299601 np0000004400 cinder-backup[101319]: stderr= {{(pid=101319) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jul 03 09:40:13.299895 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-e9aff13f-76c8-49a6-bd16-080f44143496 tempest-VolumesBackupsAdminTest-1500745506 None] iscsi session list stdout=tcp: [33] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2cb23c9f-fd1d-4ffa-b027-28faa3d99f1d (non-flash) Jul 03 09:40:13.299895 np0000004400 cinder-backup[101319]: tcp: [34] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2cb23c9f-fd1d-4ffa-b027-28faa3d99f1d (non-flash) Jul 03 09:40:13.299895 np0000004400 cinder-backup[101319]: tcp: [35] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e2580fe0-9b9f-48e5-b77e-51a2b22f14fb (non-flash) Jul 03 09:40:13.299895 np0000004400 cinder-backup[101319]: tcp: [36] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e2580fe0-9b9f-48e5-b77e-51a2b22f14fb (non-flash) Jul 03 09:40:13.299895 np0000004400 cinder-backup[101319]: tcp: [40] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b5c70aaf-10ec-45f7-bd9f-756a91fe1d65 (non-flash) Jul 03 09:40:13.299895 np0000004400 cinder-backup[101319]: tcp: [41] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b5c70aaf-10ec-45f7-bd9f-756a91fe1d65 (non-flash) Jul 03 09:40:13.299895 np0000004400 cinder-backup[101319]: tcp: [42] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ef51248d-f155-43cd-afa0-8b0f72368a43 (non-flash) Jul 03 09:40:13.299895 np0000004400 cinder-backup[101319]: tcp: [43] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ef51248d-f155-43cd-afa0-8b0f72368a43 (non-flash) Jul 03 09:40:13.299895 np0000004400 cinder-backup[101319]: tcp: [44] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-71248f04-8364-4267-8b8a-a95f390c6126 (non-flash) Jul 03 09:40:13.299895 np0000004400 cinder-backup[101319]: stderr= {{(pid=101319) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jul 03 09:40:13.300259 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.base [None req-e9aff13f-76c8-49a6-bd16-080f44143496 tempest-VolumesBackupsAdminTest-1500745506 None] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-71248f04-8364-4267-8b8a-a95f390c6126" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.143s {{(pid=101319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jul 03 09:40:13.300555 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-e9aff13f-76c8-49a6-bd16-080f44143496 tempest-VolumesBackupsAdminTest-1500745506 None] Connected to 192.168.40.100:3260 {{(pid=101319) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}} Jul 03 09:40:13.301700 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.linuxscsi [None req-e9aff13f-76c8-49a6-bd16-080f44143496 tempest-VolumesBackupsAdminTest-1500745506 None] HCTL ('10', '-', '-', 0) found on session 44 with lun 0 {{(pid=101319) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}} Jul 03 09:40:13.301925 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.linuxscsi [None req-e9aff13f-76c8-49a6-bd16-080f44143496 tempest-VolumesBackupsAdminTest-1500745506 None] Scanning host 10 c: -, t: -, l: 0) {{(pid=101319) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}} Jul 03 09:40:13.317506 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.linuxscsi [None req-e9aff13f-76c8-49a6-bd16-080f44143496 tempest-VolumesBackupsAdminTest-1500745506 None] Searching for a device in session 44 and hctl ['10', '*', '*', 0] yield: sde {{(pid=101319) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}} Jul 03 09:40:13.317867 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-e9aff13f-76c8-49a6-bd16-080f44143496 tempest-VolumesBackupsAdminTest-1500745506 None] Connected to sde using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-71248f04-8364-4267-8b8a-a95f390c6126', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '71248f04-8364-4267-8b8a-a95f390c6126', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': False} {{(pid=101319) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}} Jul 03 09:40:14.322378 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.base [None req-e9aff13f-76c8-49a6-bd16-080f44143496 tempest-VolumesBackupsAdminTest-1500745506 None] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 2.183s {{(pid=101319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jul 03 09:40:14.322715 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-e9aff13f-76c8-49a6-bd16-080f44143496 tempest-VolumesBackupsAdminTest-1500745506 None] <== connect_volume: return (4162ms) {'type': 'block', 'scsi_wwn': '33000000088d239f4', 'path': '/dev/sde'} {{(pid=101319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}} Jul 03 09:40:14.322934 np0000004400 cinder-backup[101319]: DEBUG oslo_concurrency.processutils [None req-e9aff13f-76c8-49a6-bd16-080f44143496 tempest-VolumesBackupsAdminTest-1500745506 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chown 1002 /dev/sde {{(pid=101319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 09:40:14.339534 np0000004400 sudo[121531]: stack : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chown 1002 /dev/sde Jul 03 09:40:14.340148 np0000004400 sudo[121531]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1002) Jul 03 09:40:14.695111 np0000004400 cinder-backup[101319]: DEBUG oslo_concurrency.processutils [None req-e9aff13f-76c8-49a6-bd16-080f44143496 tempest-VolumesBackupsAdminTest-1500745506 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chown 1002 /dev/sde" returned: 0 in 0.371s {{(pid=101319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 09:40:14.696490 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-e9aff13f-76c8-49a6-bd16-080f44143496 tempest-VolumesBackupsAdminTest-1500745506 None] starting restore of backup volume_6b682bae-d2d2-49c0-8a1c-8f9a74831d6c/20260703093948/az_nova_backup_fe9dd1c3-699a-4fc3-ae7f-2830334a957c container: tempest-volumesbackupsadmintest-backup-container-31762394, to new volume 71248f04-8364-4267-8b8a-a95f390c6126, backup: fe9dd1c3-699a-4fc3-ae7f-2830334a957c. {{(pid=101319) restore /opt/stack/cinder/cinder/backup/chunkeddriver.py:761}} Jul 03 09:40:14.696490 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-e9aff13f-76c8-49a6-bd16-080f44143496 tempest-VolumesBackupsAdminTest-1500745506 None] _read_metadata started, container name: tempest-volumesbackupsadmintest-backup-container-31762394, metadata filename: volume_6b682bae-d2d2-49c0-8a1c-8f9a74831d6c/20260703093948/az_nova_backup_fe9dd1c3-699a-4fc3-ae7f-2830334a957c_metadata. {{(pid=101319) _read_metadata /opt/stack/cinder/cinder/backup/chunkeddriver.py:320}} Jul 03 09:40:14.689829 np0000004400 sudo[121531]: pam_unix(sudo:session): session closed for user root Jul 03 09:40:14.725642 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-e9aff13f-76c8-49a6-bd16-080f44143496 tempest-VolumesBackupsAdminTest-1500745506 None] _read_metadata finished. Metadata: { Jul 03 09:40:14.725642 np0000004400 cinder-backup[101319]: "backup_description": null, Jul 03 09:40:14.725642 np0000004400 cinder-backup[101319]: "backup_id": "fe9dd1c3-699a-4fc3-ae7f-2830334a957c", Jul 03 09:40:14.725642 np0000004400 cinder-backup[101319]: "backup_name": "tempest-VolumesBackupsAdminTest-Backup-77258928", Jul 03 09:40:14.725642 np0000004400 cinder-backup[101319]: "created_at": "2026-07-03 09:39:44+00:00", Jul 03 09:40:14.725642 np0000004400 cinder-backup[101319]: "objects": [ Jul 03 09:40:14.725642 np0000004400 cinder-backup[101319]: { Jul 03 09:40:14.725642 np0000004400 cinder-backup[101319]: "volume_6b682bae-d2d2-49c0-8a1c-8f9a74831d6c/20260703093948/az_nova_backup_fe9dd1c3-699a-4fc3-ae7f-2830334a957c-00001": { Jul 03 09:40:14.725642 np0000004400 cinder-backup[101319]: "compression": "zlib", Jul 03 09:40:14.725642 np0000004400 cinder-backup[101319]: "length": 52428800, Jul 03 09:40:14.725642 np0000004400 cinder-backup[101319]: "md5": "25e317773f308e446cc84c503a6d1f85", Jul 03 09:40:14.725642 np0000004400 cinder-backup[101319]: "offset": 0 Jul 03 09:40:14.725642 np0000004400 cinder-backup[101319]: } Jul 03 09:40:14.725642 np0000004400 cinder-backup[101319]: }, Jul 03 09:40:14.725642 np0000004400 cinder-backup[101319]: { Jul 03 09:40:14.725642 np0000004400 cinder-backup[101319]: "volume_6b682bae-d2d2-49c0-8a1c-8f9a74831d6c/20260703093948/az_nova_backup_fe9dd1c3-699a-4fc3-ae7f-2830334a957c-00002": { Jul 03 09:40:14.725642 np0000004400 cinder-backup[101319]: "compression": "zlib", Jul 03 09:40:14.725642 np0000004400 cinder-backup[101319]: "length": 52428800, Jul 03 09:40:14.725642 np0000004400 cinder-backup[101319]: "md5": "25e317773f308e446cc84c503a6d1f85", Jul 03 09:40:14.725642 np0000004400 cinder-backup[101319]: "offset": 52428800 Jul 03 09:40:14.725642 np0000004400 cinder-backup[101319]: } Jul 03 09:40:14.725642 np0000004400 cinder-backup[101319]: }, Jul 03 09:40:14.725642 np0000004400 cinder-backup[101319]: { Jul 03 09:40:14.725642 np0000004400 cinder-backup[101319]: "volume_6b682bae-d2d2-49c0-8a1c-8f9a74831d6c/20260703093948/az_nova_backup_fe9dd1c3-699a-4fc3-ae7f-2830334a957c-00003": { Jul 03 09:40:14.725642 np0000004400 cinder-backup[101319]: "compression": "zlib", Jul 03 09:40:14.725642 np0000004400 cinder-backup[101319]: "length": 52428800, Jul 03 09:40:14.725642 np0000004400 cinder-backup[101319]: "md5": "25e317773f308e446cc84c503a6d1f85", Jul 03 09:40:14.725642 np0000004400 cinder-backup[101319]: "offset": 104857600 Jul 03 09:40:14.725642 np0000004400 cinder-backup[101319]: } Jul 03 09:40:14.725642 np0000004400 cinder-backup[101319]: }, Jul 03 09:40:14.725642 np0000004400 cinder-backup[101319]: { Jul 03 09:40:14.725642 np0000004400 cinder-backup[101319]: "volume_6b682bae-d2d2-49c0-8a1c-8f9a74831d6c/20260703093948/az_nova_backup_fe9dd1c3-699a-4fc3-ae7f-2830334a957c-00004": { Jul 03 09:40:14.725642 np0000004400 cinder-backup[101319]: "compression": "zlib", Jul 03 09:40:14.725642 np0000004400 cinder-backup[101319]: "length": 52428800, Jul 03 09:40:14.725642 np0000004400 cinder-backup[101319]: "md5": "25e317773f308e446cc84c503a6d1f85", Jul 03 09:40:14.725642 np0000004400 cinder-backup[101319]: "offset": 157286400 Jul 03 09:40:14.725642 np0000004400 cinder-backup[101319]: } Jul 03 09:40:14.725642 np0000004400 cinder-backup[101319]: }, Jul 03 09:40:14.725642 np0000004400 cinder-backup[101319]: { Jul 03 09:40:14.725642 np0000004400 cinder-backup[101319]: "volume_6b682bae-d2d2-49c0-8a1c-8f9a74831d6c/20260703093948/az_nova_backup_fe9dd1c3-699a-4fc3-ae7f-2830334a957c-00005": { Jul 03 09:40:14.725642 np0000004400 cinder-backup[101319]: "compression": "zlib", Jul 03 09:40:14.725642 np0000004400 cinder-backup[101319]: "length": 52428800, Jul 03 09:40:14.725642 np0000004400 cinder-backup[101319]: "md5": "25e317773f308e446cc84c503a6d1f85", Jul 03 09:40:14.725642 np0000004400 cinder-backup[101319]: "offset": 209715200 Jul 03 09:40:14.725642 np0000004400 cinder-backup[101319]: } Jul 03 09:40:14.725642 np0000004400 cinder-backup[101319]: }, Jul 03 09:40:14.725642 np0000004400 cinder-backup[101319]: { Jul 03 09:40:14.725642 np0000004400 cinder-backup[101319]: "volume_6b682bae-d2d2-49c0-8a1c-8f9a74831d6c/20260703093948/az_nova_backup_fe9dd1c3-699a-4fc3-ae7f-2830334a957c-00006": { Jul 03 09:40:14.725642 np0000004400 cinder-backup[101319]: "compression": "zlib", Jul 03 09:40:14.725642 np0000004400 cinder-backup[101319]: "length": 52428800, Jul 03 09:40:14.725642 np0000004400 cinder-backup[101319]: "md5": "25e317773f308e446cc84c503a6d1f85", Jul 03 09:40:14.725642 np0000004400 cinder-backup[101319]: "offset": 262144000 Jul 03 09:40:14.725642 np0000004400 cinder-backup[101319]: } Jul 03 09:40:14.725642 np0000004400 cinder-backup[101319]: }, Jul 03 09:40:14.725642 np0000004400 cinder-backup[101319]: { Jul 03 09:40:14.725642 np0000004400 cinder-backup[101319]: "volume_6b682bae-d2d2-49c0-8a1c-8f9a74831d6c/20260703093948/az_nova_backup_fe9dd1c3-699a-4fc3-ae7f-2830334a957c-00007": { Jul 03 09:40:14.725642 np0000004400 cinder-backup[101319]: "compression": "zlib", Jul 03 09:40:14.725642 np0000004400 cinder-backup[101319]: "length": 52428800, Jul 03 09:40:14.725642 np0000004400 cinder-backup[101319]: "md5": "25e317773f308e446cc84c503a6d1f85", Jul 03 09:40:14.725642 np0000004400 cinder-backup[101319]: "offset": 314572800 Jul 03 09:40:14.725642 np0000004400 cinder-backup[101319]: } Jul 03 09:40:14.725642 np0000004400 cinder-backup[101319]: }, Jul 03 09:40:14.725642 np0000004400 cinder-backup[101319]: { Jul 03 09:40:14.725642 np0000004400 cinder-backup[101319]: "volume_6b682bae-d2d2-49c0-8a1c-8f9a74831d6c/20260703093948/az_nova_backup_fe9dd1c3-699a-4fc3-ae7f-2830334a957c-00008": { Jul 03 09:40:14.725642 np0000004400 cinder-backup[101319]: "compression": "zlib", Jul 03 09:40:14.725642 np0000004400 cinder-backup[101319]: "length": 52428800, Jul 03 09:40:14.725642 np0000004400 cinder-backup[101319]: "md5": "25e317773f308e446cc84c503a6d1f85", Jul 03 09:40:14.725642 np0000004400 cinder-backup[101319]: "offset": 367001600 Jul 03 09:40:14.725642 np0000004400 cinder-backup[101319]: } Jul 03 09:40:14.725642 np0000004400 cinder-backup[101319]: }, Jul 03 09:40:14.725642 np0000004400 cinder-backup[101319]: { Jul 03 09:40:14.725642 np0000004400 cinder-backup[101319]: "volume_6b682bae-d2d2-49c0-8a1c-8f9a74831d6c/20260703093948/az_nova_backup_fe9dd1c3-699a-4fc3-ae7f-2830334a957c-00009": { Jul 03 09:40:14.725642 np0000004400 cinder-backup[101319]: "compression": "zlib", Jul 03 09:40:14.725642 np0000004400 cinder-backup[101319]: "length": 52428800, Jul 03 09:40:14.725642 np0000004400 cinder-backup[101319]: "md5": "25e317773f308e446cc84c503a6d1f85", Jul 03 09:40:14.725642 np0000004400 cinder-backup[101319]: "offset": 419430400 Jul 03 09:40:14.725642 np0000004400 cinder-backup[101319]: } Jul 03 09:40:14.725642 np0000004400 cinder-backup[101319]: }, Jul 03 09:40:14.725642 np0000004400 cinder-backup[101319]: { Jul 03 09:40:14.725642 np0000004400 cinder-backup[101319]: "volume_6b682bae-d2d2-49c0-8a1c-8f9a74831d6c/20260703093948/az_nova_backup_fe9dd1c3-699a-4fc3-ae7f-2830334a957c-00010": { Jul 03 09:40:14.725642 np0000004400 cinder-backup[101319]: "compression": "zlib", Jul 03 09:40:14.725642 np0000004400 cinder-backup[101319]: "length": 52428800, Jul 03 09:40:14.725642 np0000004400 cinder-backup[101319]: "md5": "25e317773f308e446cc84c503a6d1f85", Jul 03 09:40:14.725642 np0000004400 cinder-backup[101319]: "offset": 471859200 Jul 03 09:40:14.725642 np0000004400 cinder-backup[101319]: } Jul 03 09:40:14.725642 np0000004400 cinder-backup[101319]: }, Jul 03 09:40:14.725642 np0000004400 cinder-backup[101319]: { Jul 03 09:40:14.725642 np0000004400 cinder-backup[101319]: "volume_6b682bae-d2d2-49c0-8a1c-8f9a74831d6c/20260703093948/az_nova_backup_fe9dd1c3-699a-4fc3-ae7f-2830334a957c-00011": { Jul 03 09:40:14.725642 np0000004400 cinder-backup[101319]: "compression": "zlib", Jul 03 09:40:14.725642 np0000004400 cinder-backup[101319]: "length": 52428800, Jul 03 09:40:14.725642 np0000004400 cinder-backup[101319]: "md5": "25e317773f308e446cc84c503a6d1f85", Jul 03 09:40:14.725642 np0000004400 cinder-backup[101319]: "offset": 524288000 Jul 03 09:40:14.725642 np0000004400 cinder-backup[101319]: } Jul 03 09:40:14.725642 np0000004400 cinder-backup[101319]: }, Jul 03 09:40:14.725642 np0000004400 cinder-backup[101319]: { Jul 03 09:40:14.725642 np0000004400 cinder-backup[101319]: "volume_6b682bae-d2d2-49c0-8a1c-8f9a74831d6c/20260703093948/az_nova_backup_fe9dd1c3-699a-4fc3-ae7f-2830334a957c-00012": { Jul 03 09:40:14.725642 np0000004400 cinder-backup[101319]: "compression": "zlib", Jul 03 09:40:14.725642 np0000004400 cinder-backup[101319]: "length": 52428800, Jul 03 09:40:14.725642 np0000004400 cinder-backup[101319]: "md5": "25e317773f308e446cc84c503a6d1f85", Jul 03 09:40:14.725642 np0000004400 cinder-backup[101319]: "offset": 576716800 Jul 03 09:40:14.725642 np0000004400 cinder-backup[101319]: } Jul 03 09:40:14.725642 np0000004400 cinder-backup[101319]: }, Jul 03 09:40:14.725642 np0000004400 cinder-backup[101319]: { Jul 03 09:40:14.725642 np0000004400 cinder-backup[101319]: "volume_6b682bae-d2d2-49c0-8a1c-8f9a74831d6c/20260703093948/az_nova_backup_fe9dd1c3-699a-4fc3-ae7f-2830334a957c-00013": { Jul 03 09:40:14.725642 np0000004400 cinder-backup[101319]: "compression": "zlib", Jul 03 09:40:14.725642 np0000004400 cinder-backup[101319]: "length": 52428800, Jul 03 09:40:14.725642 np0000004400 cinder-backup[101319]: "md5": "25e317773f308e446cc84c503a6d1f85", Jul 03 09:40:14.725642 np0000004400 cinder-backup[101319]: "offset": 629145600 Jul 03 09:40:14.725642 np0000004400 cinder-backup[101319]: } Jul 03 09:40:14.725642 np0000004400 cinder-backup[101319]: }, Jul 03 09:40:14.725642 np0000004400 cinder-backup[101319]: { Jul 03 09:40:14.725642 np0000004400 cinder-backup[101319]: "volume_6b682bae-d2d2-49c0-8a1c-8f9a74831d6c/20260703093948/az_nova_backup_fe9dd1c3-699a-4fc3-ae7f-2830334a957c-00014": { Jul 03 09:40:14.725642 np0000004400 cinder-backup[101319]: "compression": "zlib", Jul 03 09:40:14.725642 np0000004400 cinder-backup[101319]: "length": 52428800, Jul 03 09:40:14.725642 np0000004400 cinder-backup[101319]: "md5": "25e317773f308e446cc84c503a6d1f85", Jul 03 09:40:14.725642 np0000004400 cinder-backup[101319]: "offset": 681574400 Jul 03 09:40:14.725642 np0000004400 cinder-backup[101319]: } Jul 03 09:40:14.725642 np0000004400 cinder-backup[101319]: }, Jul 03 09:40:14.725642 np0000004400 cinder-backup[101319]: { Jul 03 09:40:14.725642 np0000004400 cinder-backup[101319]: "volume_6b682bae-d2d2-49c0-8a1c-8f9a74831d6c/20260703093948/az_nova_backup_fe9dd1c3-699a-4fc3-ae7f-2830334a957c-00015": { Jul 03 09:40:14.725642 np0000004400 cinder-backup[101319]: "compression": "zlib", Jul 03 09:40:14.725642 np0000004400 cinder-backup[101319]: "length": 52428800, Jul 03 09:40:14.725642 np0000004400 cinder-backup[101319]: "md5": "25e317773f308e446cc84c503a6d1f85", Jul 03 09:40:14.725642 np0000004400 cinder-backup[101319]: "offset": 734003200 Jul 03 09:40:14.725642 np0000004400 cinder-backup[101319]: } Jul 03 09:40:14.725642 np0000004400 cinder-backup[101319]: }, Jul 03 09:40:14.725642 np0000004400 cinder-backup[101319]: { Jul 03 09:40:14.725642 np0000004400 cinder-backup[101319]: "volume_6b682bae-d2d2-49c0-8a1c-8f9a74831d6c/20260703093948/az_nova_backup_fe9dd1c3-699a-4fc3-ae7f-2830334a957c-00016": { Jul 03 09:40:14.725642 np0000004400 cinder-backup[101319]: "compression": "zlib", Jul 03 09:40:14.725642 np0000004400 cinder-backup[101319]: "length": 52428800, Jul 03 09:40:14.725642 np0000004400 cinder-backup[101319]: "md5": "25e317773f308e446cc84c503a6d1f85", Jul 03 09:40:14.725642 np0000004400 cinder-backup[101319]: "offset": 786432000 Jul 03 09:40:14.725642 np0000004400 cinder-backup[101319]: } Jul 03 09:40:14.725642 np0000004400 cinder-backup[101319]: }, Jul 03 09:40:14.725642 np0000004400 cinder-backup[101319]: { Jul 03 09:40:14.725642 np0000004400 cinder-backup[101319]: "volume_6b682bae-d2d2-49c0-8a1c-8f9a74831d6c/20260703093948/az_nova_backup_fe9dd1c3-699a-4fc3-ae7f-2830334a957c-00017": { Jul 03 09:40:14.725642 np0000004400 cinder-backup[101319]: "compression": "zlib", Jul 03 09:40:14.725642 np0000004400 cinder-backup[101319]: "length": 52428800, Jul 03 09:40:14.725642 np0000004400 cinder-backup[101319]: "md5": "25e317773f308e446cc84c503a6d1f85", Jul 03 09:40:14.725642 np0000004400 cinder-backup[101319]: "offset": 838860800 Jul 03 09:40:14.725642 np0000004400 cinder-backup[101319]: } Jul 03 09:40:14.725642 np0000004400 cinder-backup[101319]: }, Jul 03 09:40:14.725642 np0000004400 cinder-backup[101319]: { Jul 03 09:40:14.725642 np0000004400 cinder-backup[101319]: "volume_6b682bae-d2d2-49c0-8a1c-8f9a74831d6c/20260703093948/az_nova_backup_fe9dd1c3-699a-4fc3-ae7f-2830334a957c-00018": { Jul 03 09:40:14.725642 np0000004400 cinder-backup[101319]: "compression": "zlib", Jul 03 09:40:14.725642 np0000004400 cinder-backup[101319]: "length": 52428800, Jul 03 09:40:14.725642 np0000004400 cinder-backup[101319]: "md5": "25e317773f308e446cc84c503a6d1f85", Jul 03 09:40:14.725642 np0000004400 cinder-backup[101319]: "offset": 891289600 Jul 03 09:40:14.725642 np0000004400 cinder-backup[101319]: } Jul 03 09:40:14.725642 np0000004400 cinder-backup[101319]: }, Jul 03 09:40:14.725642 np0000004400 cinder-backup[101319]: { Jul 03 09:40:14.725642 np0000004400 cinder-backup[101319]: "volume_6b682bae-d2d2-49c0-8a1c-8f9a74831d6c/20260703093948/az_nova_backup_fe9dd1c3-699a-4fc3-ae7f-2830334a957c-00019": { Jul 03 09:40:14.725642 np0000004400 cinder-backup[101319]: "compression": "zlib", Jul 03 09:40:14.725642 np0000004400 cinder-backup[101319]: "length": 52428800, Jul 03 09:40:14.725642 np0000004400 cinder-backup[101319]: "md5": "25e317773f308e446cc84c503a6d1f85", Jul 03 09:40:14.725642 np0000004400 cinder-backup[101319]: "offset": 943718400 Jul 03 09:40:14.725642 np0000004400 cinder-backup[101319]: } Jul 03 09:40:14.725642 np0000004400 cinder-backup[101319]: }, Jul 03 09:40:14.725642 np0000004400 cinder-backup[101319]: { Jul 03 09:40:14.725642 np0000004400 cinder-backup[101319]: "volume_6b682bae-d2d2-49c0-8a1c-8f9a74831d6c/20260703093948/az_nova_backup_fe9dd1c3-699a-4fc3-ae7f-2830334a957c-00020": { Jul 03 09:40:14.725642 np0000004400 cinder-backup[101319]: "compression": "zlib", Jul 03 09:40:14.725642 np0000004400 cinder-backup[101319]: "length": 52428800, Jul 03 09:40:14.725642 np0000004400 cinder-backup[101319]: "md5": "25e317773f308e446cc84c503a6d1f85", Jul 03 09:40:14.725642 np0000004400 cinder-backup[101319]: "offset": 996147200 Jul 03 09:40:14.725642 np0000004400 cinder-backup[101319]: } Jul 03 09:40:14.725642 np0000004400 cinder-backup[101319]: }, Jul 03 09:40:14.725642 np0000004400 cinder-backup[101319]: { Jul 03 09:40:14.725642 np0000004400 cinder-backup[101319]: "volume_6b682bae-d2d2-49c0-8a1c-8f9a74831d6c/20260703093948/az_nova_backup_fe9dd1c3-699a-4fc3-ae7f-2830334a957c-00021": { Jul 03 09:40:14.725642 np0000004400 cinder-backup[101319]: "compression": "zlib", Jul 03 09:40:14.725642 np0000004400 cinder-backup[101319]: "length": 25165824, Jul 03 09:40:14.725642 np0000004400 cinder-backup[101319]: "md5": "77377273b0a4b61febdbf7bbf52b9db9", Jul 03 09:40:14.725642 np0000004400 cinder-backup[101319]: "offset": 1048576000 Jul 03 09:40:14.725642 np0000004400 cinder-backup[101319]: } Jul 03 09:40:14.725642 np0000004400 cinder-backup[101319]: } Jul 03 09:40:14.725642 np0000004400 cinder-backup[101319]: ], Jul 03 09:40:14.725642 np0000004400 cinder-backup[101319]: "parent_id": null, Jul 03 09:40:14.725642 np0000004400 cinder-backup[101319]: "version": "1.0.0", Jul 03 09:40:14.725642 np0000004400 cinder-backup[101319]: "volume_id": "6b682bae-d2d2-49c0-8a1c-8f9a74831d6c", Jul 03 09:40:14.725642 np0000004400 cinder-backup[101319]: "volume_meta": "{\"version\": 2, \"volume-base-metadata\": {\"id\": \"6b682bae-d2d2-49c0-8a1c-8f9a74831d6c\", \"_name_id\": null, \"use_quota\": true, \"ec2_id\": null, \"user_id\": \"356a534952b84c0680fa3b9655a0fc13\", \"project_id\": \"b25712a6deba4237b3d9f8f02bb54ed6\", \"snapshot_id\": null, \"cluster_name\": null, \"host\": \"np0000004400@storpool#default\", \"size\": 1, \"availability_zone\": \"nova\", \"status\": \"backing-up\", \"attach_status\": \"detached\", \"migration_status\": null, \"scheduled_at\": \"2026-07-03T09:39:43.000000\", \"launched_at\": \"2026-07-03T09:39:43.000000\", \"terminated_at\": null, \"display_name\": \"tempest-VolumesBackupsAdminTest-Volume-1413318068\", \"display_description\": null, \"provider_location\": null, \"provider_auth\": null, \"provider_geometry\": null, \"provider_id\": null, \"volume_type_id\": \"03e13fe6-0e30-4803-ace0-725d38e6dc24\", \"source_volid\": null, \"encryption_key_id\": null, \"consistencygroup_id\": null, \"group_id\": null, \"bootable\": false, \"multiattach\": false, \"replication_status\": null, \"replication_extended_status\": null, \"replication_driver_data\": null, \"previous_status\": \"available\", \"service_uuid\": \"6d4b0e79-fefe-4744-b25f-34be05095200\", \"shared_targets\": true, \"deleted_at\": null, \"deleted\": false, \"created_at\": \"2026-07-03T09:39:43.000000\", \"updated_at\": \"2026-07-03T09:39:44.000000\"}}" Jul 03 09:40:14.725642 np0000004400 cinder-backup[101319]: }. {{(pid=101319) _read_metadata /opt/stack/cinder/cinder/backup/chunkeddriver.py:327}} Jul 03 09:40:14.730103 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-e9aff13f-76c8-49a6-bd16-080f44143496 tempest-VolumesBackupsAdminTest-1500745506 None] Restoring backup version 1.0.0 {{(pid=101319) restore /opt/stack/cinder/cinder/backup/chunkeddriver.py:774}} Jul 03 09:40:14.730103 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-e9aff13f-76c8-49a6-bd16-080f44143496 tempest-VolumesBackupsAdminTest-1500745506 None] _read_metadata started, container name: tempest-volumesbackupsadmintest-backup-container-31762394, metadata filename: volume_6b682bae-d2d2-49c0-8a1c-8f9a74831d6c/20260703093948/az_nova_backup_fe9dd1c3-699a-4fc3-ae7f-2830334a957c_metadata. {{(pid=101319) _read_metadata /opt/stack/cinder/cinder/backup/chunkeddriver.py:320}} Jul 03 09:40:14.744045 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-e9aff13f-76c8-49a6-bd16-080f44143496 tempest-VolumesBackupsAdminTest-1500745506 None] _read_metadata finished. Metadata: { Jul 03 09:40:14.744045 np0000004400 cinder-backup[101319]: "backup_description": null, Jul 03 09:40:14.744045 np0000004400 cinder-backup[101319]: "backup_id": "fe9dd1c3-699a-4fc3-ae7f-2830334a957c", Jul 03 09:40:14.744045 np0000004400 cinder-backup[101319]: "backup_name": "tempest-VolumesBackupsAdminTest-Backup-77258928", Jul 03 09:40:14.744045 np0000004400 cinder-backup[101319]: "created_at": "2026-07-03 09:39:44+00:00", Jul 03 09:40:14.744045 np0000004400 cinder-backup[101319]: "objects": [ Jul 03 09:40:14.744045 np0000004400 cinder-backup[101319]: { Jul 03 09:40:14.744045 np0000004400 cinder-backup[101319]: "volume_6b682bae-d2d2-49c0-8a1c-8f9a74831d6c/20260703093948/az_nova_backup_fe9dd1c3-699a-4fc3-ae7f-2830334a957c-00001": { Jul 03 09:40:14.744045 np0000004400 cinder-backup[101319]: "compression": "zlib", Jul 03 09:40:14.744045 np0000004400 cinder-backup[101319]: "length": 52428800, Jul 03 09:40:14.744045 np0000004400 cinder-backup[101319]: "md5": "25e317773f308e446cc84c503a6d1f85", Jul 03 09:40:14.744045 np0000004400 cinder-backup[101319]: "offset": 0 Jul 03 09:40:14.744045 np0000004400 cinder-backup[101319]: } Jul 03 09:40:14.744045 np0000004400 cinder-backup[101319]: }, Jul 03 09:40:14.744045 np0000004400 cinder-backup[101319]: { Jul 03 09:40:14.744045 np0000004400 cinder-backup[101319]: "volume_6b682bae-d2d2-49c0-8a1c-8f9a74831d6c/20260703093948/az_nova_backup_fe9dd1c3-699a-4fc3-ae7f-2830334a957c-00002": { Jul 03 09:40:14.744045 np0000004400 cinder-backup[101319]: "compression": "zlib", Jul 03 09:40:14.744045 np0000004400 cinder-backup[101319]: "length": 52428800, Jul 03 09:40:14.744045 np0000004400 cinder-backup[101319]: "md5": "25e317773f308e446cc84c503a6d1f85", Jul 03 09:40:14.744045 np0000004400 cinder-backup[101319]: "offset": 52428800 Jul 03 09:40:14.744045 np0000004400 cinder-backup[101319]: } Jul 03 09:40:14.744045 np0000004400 cinder-backup[101319]: }, Jul 03 09:40:14.744045 np0000004400 cinder-backup[101319]: { Jul 03 09:40:14.744045 np0000004400 cinder-backup[101319]: "volume_6b682bae-d2d2-49c0-8a1c-8f9a74831d6c/20260703093948/az_nova_backup_fe9dd1c3-699a-4fc3-ae7f-2830334a957c-00003": { Jul 03 09:40:14.744045 np0000004400 cinder-backup[101319]: "compression": "zlib", Jul 03 09:40:14.744045 np0000004400 cinder-backup[101319]: "length": 52428800, Jul 03 09:40:14.744045 np0000004400 cinder-backup[101319]: "md5": "25e317773f308e446cc84c503a6d1f85", Jul 03 09:40:14.744045 np0000004400 cinder-backup[101319]: "offset": 104857600 Jul 03 09:40:14.744045 np0000004400 cinder-backup[101319]: } Jul 03 09:40:14.744045 np0000004400 cinder-backup[101319]: }, Jul 03 09:40:14.744045 np0000004400 cinder-backup[101319]: { Jul 03 09:40:14.744045 np0000004400 cinder-backup[101319]: "volume_6b682bae-d2d2-49c0-8a1c-8f9a74831d6c/20260703093948/az_nova_backup_fe9dd1c3-699a-4fc3-ae7f-2830334a957c-00004": { Jul 03 09:40:14.744045 np0000004400 cinder-backup[101319]: "compression": "zlib", Jul 03 09:40:14.744045 np0000004400 cinder-backup[101319]: "length": 52428800, Jul 03 09:40:14.744045 np0000004400 cinder-backup[101319]: "md5": "25e317773f308e446cc84c503a6d1f85", Jul 03 09:40:14.744045 np0000004400 cinder-backup[101319]: "offset": 157286400 Jul 03 09:40:14.744045 np0000004400 cinder-backup[101319]: } Jul 03 09:40:14.744045 np0000004400 cinder-backup[101319]: }, Jul 03 09:40:14.744045 np0000004400 cinder-backup[101319]: { Jul 03 09:40:14.744045 np0000004400 cinder-backup[101319]: "volume_6b682bae-d2d2-49c0-8a1c-8f9a74831d6c/20260703093948/az_nova_backup_fe9dd1c3-699a-4fc3-ae7f-2830334a957c-00005": { Jul 03 09:40:14.744045 np0000004400 cinder-backup[101319]: "compression": "zlib", Jul 03 09:40:14.744045 np0000004400 cinder-backup[101319]: "length": 52428800, Jul 03 09:40:14.744045 np0000004400 cinder-backup[101319]: "md5": "25e317773f308e446cc84c503a6d1f85", Jul 03 09:40:14.744045 np0000004400 cinder-backup[101319]: "offset": 209715200 Jul 03 09:40:14.744045 np0000004400 cinder-backup[101319]: } Jul 03 09:40:14.744045 np0000004400 cinder-backup[101319]: }, Jul 03 09:40:14.744045 np0000004400 cinder-backup[101319]: { Jul 03 09:40:14.744045 np0000004400 cinder-backup[101319]: "volume_6b682bae-d2d2-49c0-8a1c-8f9a74831d6c/20260703093948/az_nova_backup_fe9dd1c3-699a-4fc3-ae7f-2830334a957c-00006": { Jul 03 09:40:14.744045 np0000004400 cinder-backup[101319]: "compression": "zlib", Jul 03 09:40:14.744045 np0000004400 cinder-backup[101319]: "length": 52428800, Jul 03 09:40:14.744045 np0000004400 cinder-backup[101319]: "md5": "25e317773f308e446cc84c503a6d1f85", Jul 03 09:40:14.744045 np0000004400 cinder-backup[101319]: "offset": 262144000 Jul 03 09:40:14.744045 np0000004400 cinder-backup[101319]: } Jul 03 09:40:14.744045 np0000004400 cinder-backup[101319]: }, Jul 03 09:40:14.744045 np0000004400 cinder-backup[101319]: { Jul 03 09:40:14.744045 np0000004400 cinder-backup[101319]: "volume_6b682bae-d2d2-49c0-8a1c-8f9a74831d6c/20260703093948/az_nova_backup_fe9dd1c3-699a-4fc3-ae7f-2830334a957c-00007": { Jul 03 09:40:14.744045 np0000004400 cinder-backup[101319]: "compression": "zlib", Jul 03 09:40:14.744045 np0000004400 cinder-backup[101319]: "length": 52428800, Jul 03 09:40:14.744045 np0000004400 cinder-backup[101319]: "md5": "25e317773f308e446cc84c503a6d1f85", Jul 03 09:40:14.744045 np0000004400 cinder-backup[101319]: "offset": 314572800 Jul 03 09:40:14.744045 np0000004400 cinder-backup[101319]: } Jul 03 09:40:14.744045 np0000004400 cinder-backup[101319]: }, Jul 03 09:40:14.744045 np0000004400 cinder-backup[101319]: { Jul 03 09:40:14.744045 np0000004400 cinder-backup[101319]: "volume_6b682bae-d2d2-49c0-8a1c-8f9a74831d6c/20260703093948/az_nova_backup_fe9dd1c3-699a-4fc3-ae7f-2830334a957c-00008": { Jul 03 09:40:14.744045 np0000004400 cinder-backup[101319]: "compression": "zlib", Jul 03 09:40:14.744045 np0000004400 cinder-backup[101319]: "length": 52428800, Jul 03 09:40:14.744045 np0000004400 cinder-backup[101319]: "md5": "25e317773f308e446cc84c503a6d1f85", Jul 03 09:40:14.744045 np0000004400 cinder-backup[101319]: "offset": 367001600 Jul 03 09:40:14.744045 np0000004400 cinder-backup[101319]: } Jul 03 09:40:14.744045 np0000004400 cinder-backup[101319]: }, Jul 03 09:40:14.744045 np0000004400 cinder-backup[101319]: { Jul 03 09:40:14.744045 np0000004400 cinder-backup[101319]: "volume_6b682bae-d2d2-49c0-8a1c-8f9a74831d6c/20260703093948/az_nova_backup_fe9dd1c3-699a-4fc3-ae7f-2830334a957c-00009": { Jul 03 09:40:14.744045 np0000004400 cinder-backup[101319]: "compression": "zlib", Jul 03 09:40:14.744045 np0000004400 cinder-backup[101319]: "length": 52428800, Jul 03 09:40:14.744045 np0000004400 cinder-backup[101319]: "md5": "25e317773f308e446cc84c503a6d1f85", Jul 03 09:40:14.744045 np0000004400 cinder-backup[101319]: "offset": 419430400 Jul 03 09:40:14.744045 np0000004400 cinder-backup[101319]: } Jul 03 09:40:14.744045 np0000004400 cinder-backup[101319]: }, Jul 03 09:40:14.744045 np0000004400 cinder-backup[101319]: { Jul 03 09:40:14.744045 np0000004400 cinder-backup[101319]: "volume_6b682bae-d2d2-49c0-8a1c-8f9a74831d6c/20260703093948/az_nova_backup_fe9dd1c3-699a-4fc3-ae7f-2830334a957c-00010": { Jul 03 09:40:14.744045 np0000004400 cinder-backup[101319]: "compression": "zlib", Jul 03 09:40:14.744045 np0000004400 cinder-backup[101319]: "length": 52428800, Jul 03 09:40:14.744045 np0000004400 cinder-backup[101319]: "md5": "25e317773f308e446cc84c503a6d1f85", Jul 03 09:40:14.744045 np0000004400 cinder-backup[101319]: "offset": 471859200 Jul 03 09:40:14.744045 np0000004400 cinder-backup[101319]: } Jul 03 09:40:14.744045 np0000004400 cinder-backup[101319]: }, Jul 03 09:40:14.744045 np0000004400 cinder-backup[101319]: { Jul 03 09:40:14.744045 np0000004400 cinder-backup[101319]: "volume_6b682bae-d2d2-49c0-8a1c-8f9a74831d6c/20260703093948/az_nova_backup_fe9dd1c3-699a-4fc3-ae7f-2830334a957c-00011": { Jul 03 09:40:14.744045 np0000004400 cinder-backup[101319]: "compression": "zlib", Jul 03 09:40:14.744045 np0000004400 cinder-backup[101319]: "length": 52428800, Jul 03 09:40:14.744045 np0000004400 cinder-backup[101319]: "md5": "25e317773f308e446cc84c503a6d1f85", Jul 03 09:40:14.744045 np0000004400 cinder-backup[101319]: "offset": 524288000 Jul 03 09:40:14.744045 np0000004400 cinder-backup[101319]: } Jul 03 09:40:14.744045 np0000004400 cinder-backup[101319]: }, Jul 03 09:40:14.744045 np0000004400 cinder-backup[101319]: { Jul 03 09:40:14.744045 np0000004400 cinder-backup[101319]: "volume_6b682bae-d2d2-49c0-8a1c-8f9a74831d6c/20260703093948/az_nova_backup_fe9dd1c3-699a-4fc3-ae7f-2830334a957c-00012": { Jul 03 09:40:14.744045 np0000004400 cinder-backup[101319]: "compression": "zlib", Jul 03 09:40:14.744045 np0000004400 cinder-backup[101319]: "length": 52428800, Jul 03 09:40:14.744045 np0000004400 cinder-backup[101319]: "md5": "25e317773f308e446cc84c503a6d1f85", Jul 03 09:40:14.744045 np0000004400 cinder-backup[101319]: "offset": 576716800 Jul 03 09:40:14.744045 np0000004400 cinder-backup[101319]: } Jul 03 09:40:14.744045 np0000004400 cinder-backup[101319]: }, Jul 03 09:40:14.744045 np0000004400 cinder-backup[101319]: { Jul 03 09:40:14.744045 np0000004400 cinder-backup[101319]: "volume_6b682bae-d2d2-49c0-8a1c-8f9a74831d6c/20260703093948/az_nova_backup_fe9dd1c3-699a-4fc3-ae7f-2830334a957c-00013": { Jul 03 09:40:14.744045 np0000004400 cinder-backup[101319]: "compression": "zlib", Jul 03 09:40:14.744045 np0000004400 cinder-backup[101319]: "length": 52428800, Jul 03 09:40:14.744045 np0000004400 cinder-backup[101319]: "md5": "25e317773f308e446cc84c503a6d1f85", Jul 03 09:40:14.744045 np0000004400 cinder-backup[101319]: "offset": 629145600 Jul 03 09:40:14.744045 np0000004400 cinder-backup[101319]: } Jul 03 09:40:14.744045 np0000004400 cinder-backup[101319]: }, Jul 03 09:40:14.744045 np0000004400 cinder-backup[101319]: { Jul 03 09:40:14.744045 np0000004400 cinder-backup[101319]: "volume_6b682bae-d2d2-49c0-8a1c-8f9a74831d6c/20260703093948/az_nova_backup_fe9dd1c3-699a-4fc3-ae7f-2830334a957c-00014": { Jul 03 09:40:14.744045 np0000004400 cinder-backup[101319]: "compression": "zlib", Jul 03 09:40:14.744045 np0000004400 cinder-backup[101319]: "length": 52428800, Jul 03 09:40:14.744045 np0000004400 cinder-backup[101319]: "md5": "25e317773f308e446cc84c503a6d1f85", Jul 03 09:40:14.744045 np0000004400 cinder-backup[101319]: "offset": 681574400 Jul 03 09:40:14.744045 np0000004400 cinder-backup[101319]: } Jul 03 09:40:14.744045 np0000004400 cinder-backup[101319]: }, Jul 03 09:40:14.744045 np0000004400 cinder-backup[101319]: { Jul 03 09:40:14.744045 np0000004400 cinder-backup[101319]: "volume_6b682bae-d2d2-49c0-8a1c-8f9a74831d6c/20260703093948/az_nova_backup_fe9dd1c3-699a-4fc3-ae7f-2830334a957c-00015": { Jul 03 09:40:14.744045 np0000004400 cinder-backup[101319]: "compression": "zlib", Jul 03 09:40:14.744045 np0000004400 cinder-backup[101319]: "length": 52428800, Jul 03 09:40:14.744045 np0000004400 cinder-backup[101319]: "md5": "25e317773f308e446cc84c503a6d1f85", Jul 03 09:40:14.744045 np0000004400 cinder-backup[101319]: "offset": 734003200 Jul 03 09:40:14.744045 np0000004400 cinder-backup[101319]: } Jul 03 09:40:14.744045 np0000004400 cinder-backup[101319]: }, Jul 03 09:40:14.744045 np0000004400 cinder-backup[101319]: { Jul 03 09:40:14.744045 np0000004400 cinder-backup[101319]: "volume_6b682bae-d2d2-49c0-8a1c-8f9a74831d6c/20260703093948/az_nova_backup_fe9dd1c3-699a-4fc3-ae7f-2830334a957c-00016": { Jul 03 09:40:14.744045 np0000004400 cinder-backup[101319]: "compression": "zlib", Jul 03 09:40:14.744045 np0000004400 cinder-backup[101319]: "length": 52428800, Jul 03 09:40:14.744045 np0000004400 cinder-backup[101319]: "md5": "25e317773f308e446cc84c503a6d1f85", Jul 03 09:40:14.744045 np0000004400 cinder-backup[101319]: "offset": 786432000 Jul 03 09:40:14.744045 np0000004400 cinder-backup[101319]: } Jul 03 09:40:14.744045 np0000004400 cinder-backup[101319]: }, Jul 03 09:40:14.744045 np0000004400 cinder-backup[101319]: { Jul 03 09:40:14.744045 np0000004400 cinder-backup[101319]: "volume_6b682bae-d2d2-49c0-8a1c-8f9a74831d6c/20260703093948/az_nova_backup_fe9dd1c3-699a-4fc3-ae7f-2830334a957c-00017": { Jul 03 09:40:14.744045 np0000004400 cinder-backup[101319]: "compression": "zlib", Jul 03 09:40:14.744045 np0000004400 cinder-backup[101319]: "length": 52428800, Jul 03 09:40:14.744045 np0000004400 cinder-backup[101319]: "md5": "25e317773f308e446cc84c503a6d1f85", Jul 03 09:40:14.744045 np0000004400 cinder-backup[101319]: "offset": 838860800 Jul 03 09:40:14.744045 np0000004400 cinder-backup[101319]: } Jul 03 09:40:14.744045 np0000004400 cinder-backup[101319]: }, Jul 03 09:40:14.744045 np0000004400 cinder-backup[101319]: { Jul 03 09:40:14.744045 np0000004400 cinder-backup[101319]: "volume_6b682bae-d2d2-49c0-8a1c-8f9a74831d6c/20260703093948/az_nova_backup_fe9dd1c3-699a-4fc3-ae7f-2830334a957c-00018": { Jul 03 09:40:14.744045 np0000004400 cinder-backup[101319]: "compression": "zlib", Jul 03 09:40:14.744045 np0000004400 cinder-backup[101319]: "length": 52428800, Jul 03 09:40:14.744045 np0000004400 cinder-backup[101319]: "md5": "25e317773f308e446cc84c503a6d1f85", Jul 03 09:40:14.744045 np0000004400 cinder-backup[101319]: "offset": 891289600 Jul 03 09:40:14.744045 np0000004400 cinder-backup[101319]: } Jul 03 09:40:14.744045 np0000004400 cinder-backup[101319]: }, Jul 03 09:40:14.744045 np0000004400 cinder-backup[101319]: { Jul 03 09:40:14.744045 np0000004400 cinder-backup[101319]: "volume_6b682bae-d2d2-49c0-8a1c-8f9a74831d6c/20260703093948/az_nova_backup_fe9dd1c3-699a-4fc3-ae7f-2830334a957c-00019": { Jul 03 09:40:14.744045 np0000004400 cinder-backup[101319]: "compression": "zlib", Jul 03 09:40:14.744045 np0000004400 cinder-backup[101319]: "length": 52428800, Jul 03 09:40:14.744045 np0000004400 cinder-backup[101319]: "md5": "25e317773f308e446cc84c503a6d1f85", Jul 03 09:40:14.744045 np0000004400 cinder-backup[101319]: "offset": 943718400 Jul 03 09:40:14.744045 np0000004400 cinder-backup[101319]: } Jul 03 09:40:14.744045 np0000004400 cinder-backup[101319]: }, Jul 03 09:40:14.744045 np0000004400 cinder-backup[101319]: { Jul 03 09:40:14.744045 np0000004400 cinder-backup[101319]: "volume_6b682bae-d2d2-49c0-8a1c-8f9a74831d6c/20260703093948/az_nova_backup_fe9dd1c3-699a-4fc3-ae7f-2830334a957c-00020": { Jul 03 09:40:14.744045 np0000004400 cinder-backup[101319]: "compression": "zlib", Jul 03 09:40:14.744045 np0000004400 cinder-backup[101319]: "length": 52428800, Jul 03 09:40:14.744045 np0000004400 cinder-backup[101319]: "md5": "25e317773f308e446cc84c503a6d1f85", Jul 03 09:40:14.744045 np0000004400 cinder-backup[101319]: "offset": 996147200 Jul 03 09:40:14.744045 np0000004400 cinder-backup[101319]: } Jul 03 09:40:14.744045 np0000004400 cinder-backup[101319]: }, Jul 03 09:40:14.744045 np0000004400 cinder-backup[101319]: { Jul 03 09:40:14.744045 np0000004400 cinder-backup[101319]: "volume_6b682bae-d2d2-49c0-8a1c-8f9a74831d6c/20260703093948/az_nova_backup_fe9dd1c3-699a-4fc3-ae7f-2830334a957c-00021": { Jul 03 09:40:14.744045 np0000004400 cinder-backup[101319]: "compression": "zlib", Jul 03 09:40:14.744045 np0000004400 cinder-backup[101319]: "length": 25165824, Jul 03 09:40:14.744045 np0000004400 cinder-backup[101319]: "md5": "77377273b0a4b61febdbf7bbf52b9db9", Jul 03 09:40:14.744045 np0000004400 cinder-backup[101319]: "offset": 1048576000 Jul 03 09:40:14.744045 np0000004400 cinder-backup[101319]: } Jul 03 09:40:14.744045 np0000004400 cinder-backup[101319]: } Jul 03 09:40:14.744045 np0000004400 cinder-backup[101319]: ], Jul 03 09:40:14.744045 np0000004400 cinder-backup[101319]: "parent_id": null, Jul 03 09:40:14.744045 np0000004400 cinder-backup[101319]: "version": "1.0.0", Jul 03 09:40:14.744045 np0000004400 cinder-backup[101319]: "volume_id": "6b682bae-d2d2-49c0-8a1c-8f9a74831d6c", Jul 03 09:40:14.744045 np0000004400 cinder-backup[101319]: "volume_meta": "{\"version\": 2, \"volume-base-metadata\": {\"id\": \"6b682bae-d2d2-49c0-8a1c-8f9a74831d6c\", \"_name_id\": null, \"use_quota\": true, \"ec2_id\": null, \"user_id\": \"356a534952b84c0680fa3b9655a0fc13\", \"project_id\": \"b25712a6deba4237b3d9f8f02bb54ed6\", \"snapshot_id\": null, \"cluster_name\": null, \"host\": \"np0000004400@storpool#default\", \"size\": 1, \"availability_zone\": \"nova\", \"status\": \"backing-up\", \"attach_status\": \"detached\", \"migration_status\": null, \"scheduled_at\": \"2026-07-03T09:39:43.000000\", \"launched_at\": \"2026-07-03T09:39:43.000000\", \"terminated_at\": null, \"display_name\": \"tempest-VolumesBackupsAdminTest-Volume-1413318068\", \"display_description\": null, \"provider_location\": null, \"provider_auth\": null, \"provider_geometry\": null, \"provider_id\": null, \"volume_type_id\": \"03e13fe6-0e30-4803-ace0-725d38e6dc24\", \"source_volid\": null, \"encryption_key_id\": null, \"consistencygroup_id\": null, \"group_id\": null, \"bootable\": false, \"multiattach\": false, \"replication_status\": null, \"replication_extended_status\": null, \"replication_driver_data\": null, \"previous_status\": \"available\", \"service_uuid\": \"6d4b0e79-fefe-4744-b25f-34be05095200\", \"shared_targets\": true, \"deleted_at\": null, \"deleted\": false, \"created_at\": \"2026-07-03T09:39:43.000000\", \"updated_at\": \"2026-07-03T09:39:44.000000\"}}" Jul 03 09:40:14.744045 np0000004400 cinder-backup[101319]: }. {{(pid=101319) _read_metadata /opt/stack/cinder/cinder/backup/chunkeddriver.py:327}} Jul 03 09:40:14.747569 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-e9aff13f-76c8-49a6-bd16-080f44143496 tempest-VolumesBackupsAdminTest-1500745506 None] v1 volume backup restore of fe9dd1c3-699a-4fc3-ae7f-2830334a957c started. {{(pid=101319) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:678}} Jul 03 09:40:14.747569 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-e9aff13f-76c8-49a6-bd16-080f44143496 tempest-VolumesBackupsAdminTest-1500745506 None] metadata_object_names = ['volume_6b682bae-d2d2-49c0-8a1c-8f9a74831d6c/20260703093948/az_nova_backup_fe9dd1c3-699a-4fc3-ae7f-2830334a957c-00001', 'volume_6b682bae-d2d2-49c0-8a1c-8f9a74831d6c/20260703093948/az_nova_backup_fe9dd1c3-699a-4fc3-ae7f-2830334a957c-00002', 'volume_6b682bae-d2d2-49c0-8a1c-8f9a74831d6c/20260703093948/az_nova_backup_fe9dd1c3-699a-4fc3-ae7f-2830334a957c-00003', 'volume_6b682bae-d2d2-49c0-8a1c-8f9a74831d6c/20260703093948/az_nova_backup_fe9dd1c3-699a-4fc3-ae7f-2830334a957c-00004', 'volume_6b682bae-d2d2-49c0-8a1c-8f9a74831d6c/20260703093948/az_nova_backup_fe9dd1c3-699a-4fc3-ae7f-2830334a957c-00005', 'volume_6b682bae-d2d2-49c0-8a1c-8f9a74831d6c/20260703093948/az_nova_backup_fe9dd1c3-699a-4fc3-ae7f-2830334a957c-00006', 'volume_6b682bae-d2d2-49c0-8a1c-8f9a74831d6c/20260703093948/az_nova_backup_fe9dd1c3-699a-4fc3-ae7f-2830334a957c-00007', 'volume_6b682bae-d2d2-49c0-8a1c-8f9a74831d6c/20260703093948/az_nova_backup_fe9dd1c3-699a-4fc3-ae7f-2830334a957c-00008', 'volume_6b682bae-d2d2-49c0-8a1c-8f9a74831d6c/20260703093948/az_nova_backup_fe9dd1c3-699a-4fc3-ae7f-2830334a957c-00009', 'volume_6b682bae-d2d2-49c0-8a1c-8f9a74831d6c/20260703093948/az_nova_backup_fe9dd1c3-699a-4fc3-ae7f-2830334a957c-00010', 'volume_6b682bae-d2d2-49c0-8a1c-8f9a74831d6c/20260703093948/az_nova_backup_fe9dd1c3-699a-4fc3-ae7f-2830334a957c-00011', 'volume_6b682bae-d2d2-49c0-8a1c-8f9a74831d6c/20260703093948/az_nova_backup_fe9dd1c3-699a-4fc3-ae7f-2830334a957c-00012', 'volume_6b682bae-d2d2-49c0-8a1c-8f9a74831d6c/20260703093948/az_nova_backup_fe9dd1c3-699a-4fc3-ae7f-2830334a957c-00013', 'volume_6b682bae-d2d2-49c0-8a1c-8f9a74831d6c/20260703093948/az_nova_backup_fe9dd1c3-699a-4fc3-ae7f-2830334a957c-00014', 'volume_6b682bae-d2d2-49c0-8a1c-8f9a74831d6c/20260703093948/az_nova_backup_fe9dd1c3-699a-4fc3-ae7f-2830334a957c-00015', 'volume_6b682bae-d2d2-49c0-8a1c-8f9a74831d6c/20260703093948/az_nova_backup_fe9dd1c3-699a-4fc3-ae7f-2830334a957c-00016', 'volume_6b682bae-d2d2-49c0-8a1c-8f9a74831d6c/20260703093948/az_nova_backup_fe9dd1c3-699a-4fc3-ae7f-2830334a957c-00017', 'volume_6b682bae-d2d2-49c0-8a1c-8f9a74831d6c/20260703093948/az_nova_backup_fe9dd1c3-699a-4fc3-ae7f-2830334a957c-00018', 'volume_6b682bae-d2d2-49c0-8a1c-8f9a74831d6c/20260703093948/az_nova_backup_fe9dd1c3-699a-4fc3-ae7f-2830334a957c-00019', 'volume_6b682bae-d2d2-49c0-8a1c-8f9a74831d6c/20260703093948/az_nova_backup_fe9dd1c3-699a-4fc3-ae7f-2830334a957c-00020', 'volume_6b682bae-d2d2-49c0-8a1c-8f9a74831d6c/20260703093948/az_nova_backup_fe9dd1c3-699a-4fc3-ae7f-2830334a957c-00021']. {{(pid=101319) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:685}} Jul 03 09:40:14.798015 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-e9aff13f-76c8-49a6-bd16-080f44143496 tempest-VolumesBackupsAdminTest-1500745506 None] generated object list: ['volume_6b682bae-d2d2-49c0-8a1c-8f9a74831d6c/20260703093948/az_nova_backup_fe9dd1c3-699a-4fc3-ae7f-2830334a957c-00001', 'volume_6b682bae-d2d2-49c0-8a1c-8f9a74831d6c/20260703093948/az_nova_backup_fe9dd1c3-699a-4fc3-ae7f-2830334a957c-00002', 'volume_6b682bae-d2d2-49c0-8a1c-8f9a74831d6c/20260703093948/az_nova_backup_fe9dd1c3-699a-4fc3-ae7f-2830334a957c-00003', 'volume_6b682bae-d2d2-49c0-8a1c-8f9a74831d6c/20260703093948/az_nova_backup_fe9dd1c3-699a-4fc3-ae7f-2830334a957c-00004', 'volume_6b682bae-d2d2-49c0-8a1c-8f9a74831d6c/20260703093948/az_nova_backup_fe9dd1c3-699a-4fc3-ae7f-2830334a957c-00005', 'volume_6b682bae-d2d2-49c0-8a1c-8f9a74831d6c/20260703093948/az_nova_backup_fe9dd1c3-699a-4fc3-ae7f-2830334a957c-00006', 'volume_6b682bae-d2d2-49c0-8a1c-8f9a74831d6c/20260703093948/az_nova_backup_fe9dd1c3-699a-4fc3-ae7f-2830334a957c-00007', 'volume_6b682bae-d2d2-49c0-8a1c-8f9a74831d6c/20260703093948/az_nova_backup_fe9dd1c3-699a-4fc3-ae7f-2830334a957c-00008', 'volume_6b682bae-d2d2-49c0-8a1c-8f9a74831d6c/20260703093948/az_nova_backup_fe9dd1c3-699a-4fc3-ae7f-2830334a957c-00009', 'volume_6b682bae-d2d2-49c0-8a1c-8f9a74831d6c/20260703093948/az_nova_backup_fe9dd1c3-699a-4fc3-ae7f-2830334a957c-00010', 'volume_6b682bae-d2d2-49c0-8a1c-8f9a74831d6c/20260703093948/az_nova_backup_fe9dd1c3-699a-4fc3-ae7f-2830334a957c-00011', 'volume_6b682bae-d2d2-49c0-8a1c-8f9a74831d6c/20260703093948/az_nova_backup_fe9dd1c3-699a-4fc3-ae7f-2830334a957c-00012', 'volume_6b682bae-d2d2-49c0-8a1c-8f9a74831d6c/20260703093948/az_nova_backup_fe9dd1c3-699a-4fc3-ae7f-2830334a957c-00013', 'volume_6b682bae-d2d2-49c0-8a1c-8f9a74831d6c/20260703093948/az_nova_backup_fe9dd1c3-699a-4fc3-ae7f-2830334a957c-00014', 'volume_6b682bae-d2d2-49c0-8a1c-8f9a74831d6c/20260703093948/az_nova_backup_fe9dd1c3-699a-4fc3-ae7f-2830334a957c-00015', 'volume_6b682bae-d2d2-49c0-8a1c-8f9a74831d6c/20260703093948/az_nova_backup_fe9dd1c3-699a-4fc3-ae7f-2830334a957c-00016', 'volume_6b682bae-d2d2-49c0-8a1c-8f9a74831d6c/20260703093948/az_nova_backup_fe9dd1c3-699a-4fc3-ae7f-2830334a957c-00017', 'volume_6b682bae-d2d2-49c0-8a1c-8f9a74831d6c/20260703093948/az_nova_backup_fe9dd1c3-699a-4fc3-ae7f-2830334a957c-00018', 'volume_6b682bae-d2d2-49c0-8a1c-8f9a74831d6c/20260703093948/az_nova_backup_fe9dd1c3-699a-4fc3-ae7f-2830334a957c-00019', 'volume_6b682bae-d2d2-49c0-8a1c-8f9a74831d6c/20260703093948/az_nova_backup_fe9dd1c3-699a-4fc3-ae7f-2830334a957c-00020', 'volume_6b682bae-d2d2-49c0-8a1c-8f9a74831d6c/20260703093948/az_nova_backup_fe9dd1c3-699a-4fc3-ae7f-2830334a957c-00021', 'volume_6b682bae-d2d2-49c0-8a1c-8f9a74831d6c/20260703093948/az_nova_backup_fe9dd1c3-699a-4fc3-ae7f-2830334a957c_metadata', 'volume_6b682bae-d2d2-49c0-8a1c-8f9a74831d6c/20260703093948/az_nova_backup_fe9dd1c3-699a-4fc3-ae7f-2830334a957c_sha256file']. {{(pid=101319) _generate_object_names /opt/stack/cinder/cinder/backup/chunkeddriver.py:260}} Jul 03 09:40:14.803302 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-e9aff13f-76c8-49a6-bd16-080f44143496 tempest-VolumesBackupsAdminTest-1500745506 None] restoring object. backup: fe9dd1c3-699a-4fc3-ae7f-2830334a957c, container: tempest-volumesbackupsadmintest-backup-container-31762394, object name: volume_6b682bae-d2d2-49c0-8a1c-8f9a74831d6c/20260703093948/az_nova_backup_fe9dd1c3-699a-4fc3-ae7f-2830334a957c-00001, volume: 71248f04-8364-4267-8b8a-a95f390c6126. {{(pid=101319) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:705}} Jul 03 09:40:14.822866 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-e9aff13f-76c8-49a6-bd16-080f44143496 tempest-VolumesBackupsAdminTest-1500745506 None] decompressing data using zlib algorithm {{(pid=101319) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:722}} Jul 03 09:40:15.180357 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-e9aff13f-76c8-49a6-bd16-080f44143496 tempest-VolumesBackupsAdminTest-1500745506 None] restoring object. backup: fe9dd1c3-699a-4fc3-ae7f-2830334a957c, container: tempest-volumesbackupsadmintest-backup-container-31762394, object name: volume_6b682bae-d2d2-49c0-8a1c-8f9a74831d6c/20260703093948/az_nova_backup_fe9dd1c3-699a-4fc3-ae7f-2830334a957c-00002, volume: 71248f04-8364-4267-8b8a-a95f390c6126. {{(pid=101319) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:705}} Jul 03 09:40:15.195838 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-e9aff13f-76c8-49a6-bd16-080f44143496 tempest-VolumesBackupsAdminTest-1500745506 None] decompressing data using zlib algorithm {{(pid=101319) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:722}} Jul 03 09:40:15.530946 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-e9aff13f-76c8-49a6-bd16-080f44143496 tempest-VolumesBackupsAdminTest-1500745506 None] restoring object. backup: fe9dd1c3-699a-4fc3-ae7f-2830334a957c, container: tempest-volumesbackupsadmintest-backup-container-31762394, object name: volume_6b682bae-d2d2-49c0-8a1c-8f9a74831d6c/20260703093948/az_nova_backup_fe9dd1c3-699a-4fc3-ae7f-2830334a957c-00003, volume: 71248f04-8364-4267-8b8a-a95f390c6126. {{(pid=101319) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:705}} Jul 03 09:40:15.547318 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-e9aff13f-76c8-49a6-bd16-080f44143496 tempest-VolumesBackupsAdminTest-1500745506 None] decompressing data using zlib algorithm {{(pid=101319) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:722}} Jul 03 09:40:15.875004 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-e9aff13f-76c8-49a6-bd16-080f44143496 tempest-VolumesBackupsAdminTest-1500745506 None] restoring object. backup: fe9dd1c3-699a-4fc3-ae7f-2830334a957c, container: tempest-volumesbackupsadmintest-backup-container-31762394, object name: volume_6b682bae-d2d2-49c0-8a1c-8f9a74831d6c/20260703093948/az_nova_backup_fe9dd1c3-699a-4fc3-ae7f-2830334a957c-00004, volume: 71248f04-8364-4267-8b8a-a95f390c6126. {{(pid=101319) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:705}} Jul 03 09:40:15.888075 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-e9aff13f-76c8-49a6-bd16-080f44143496 tempest-VolumesBackupsAdminTest-1500745506 None] decompressing data using zlib algorithm {{(pid=101319) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:722}} Jul 03 09:40:16.210038 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-e9aff13f-76c8-49a6-bd16-080f44143496 tempest-VolumesBackupsAdminTest-1500745506 None] restoring object. backup: fe9dd1c3-699a-4fc3-ae7f-2830334a957c, container: tempest-volumesbackupsadmintest-backup-container-31762394, object name: volume_6b682bae-d2d2-49c0-8a1c-8f9a74831d6c/20260703093948/az_nova_backup_fe9dd1c3-699a-4fc3-ae7f-2830334a957c-00005, volume: 71248f04-8364-4267-8b8a-a95f390c6126. {{(pid=101319) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:705}} Jul 03 09:40:16.224464 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-e9aff13f-76c8-49a6-bd16-080f44143496 tempest-VolumesBackupsAdminTest-1500745506 None] decompressing data using zlib algorithm {{(pid=101319) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:722}} Jul 03 09:40:16.548199 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-e9aff13f-76c8-49a6-bd16-080f44143496 tempest-VolumesBackupsAdminTest-1500745506 None] restoring object. backup: fe9dd1c3-699a-4fc3-ae7f-2830334a957c, container: tempest-volumesbackupsadmintest-backup-container-31762394, object name: volume_6b682bae-d2d2-49c0-8a1c-8f9a74831d6c/20260703093948/az_nova_backup_fe9dd1c3-699a-4fc3-ae7f-2830334a957c-00006, volume: 71248f04-8364-4267-8b8a-a95f390c6126. {{(pid=101319) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:705}} Jul 03 09:40:16.562191 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-e9aff13f-76c8-49a6-bd16-080f44143496 tempest-VolumesBackupsAdminTest-1500745506 None] decompressing data using zlib algorithm {{(pid=101319) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:722}} Jul 03 09:40:16.889183 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-e9aff13f-76c8-49a6-bd16-080f44143496 tempest-VolumesBackupsAdminTest-1500745506 None] restoring object. backup: fe9dd1c3-699a-4fc3-ae7f-2830334a957c, container: tempest-volumesbackupsadmintest-backup-container-31762394, object name: volume_6b682bae-d2d2-49c0-8a1c-8f9a74831d6c/20260703093948/az_nova_backup_fe9dd1c3-699a-4fc3-ae7f-2830334a957c-00007, volume: 71248f04-8364-4267-8b8a-a95f390c6126. {{(pid=101319) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:705}} Jul 03 09:40:16.902605 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-e9aff13f-76c8-49a6-bd16-080f44143496 tempest-VolumesBackupsAdminTest-1500745506 None] decompressing data using zlib algorithm {{(pid=101319) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:722}} Jul 03 09:40:17.233658 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-e9aff13f-76c8-49a6-bd16-080f44143496 tempest-VolumesBackupsAdminTest-1500745506 None] restoring object. backup: fe9dd1c3-699a-4fc3-ae7f-2830334a957c, container: tempest-volumesbackupsadmintest-backup-container-31762394, object name: volume_6b682bae-d2d2-49c0-8a1c-8f9a74831d6c/20260703093948/az_nova_backup_fe9dd1c3-699a-4fc3-ae7f-2830334a957c-00008, volume: 71248f04-8364-4267-8b8a-a95f390c6126. {{(pid=101319) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:705}} Jul 03 09:40:17.248712 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-e9aff13f-76c8-49a6-bd16-080f44143496 tempest-VolumesBackupsAdminTest-1500745506 None] decompressing data using zlib algorithm {{(pid=101319) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:722}} Jul 03 09:40:17.590519 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-e9aff13f-76c8-49a6-bd16-080f44143496 tempest-VolumesBackupsAdminTest-1500745506 None] restoring object. backup: fe9dd1c3-699a-4fc3-ae7f-2830334a957c, container: tempest-volumesbackupsadmintest-backup-container-31762394, object name: volume_6b682bae-d2d2-49c0-8a1c-8f9a74831d6c/20260703093948/az_nova_backup_fe9dd1c3-699a-4fc3-ae7f-2830334a957c-00009, volume: 71248f04-8364-4267-8b8a-a95f390c6126. {{(pid=101319) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:705}} Jul 03 09:40:17.604059 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-e9aff13f-76c8-49a6-bd16-080f44143496 tempest-VolumesBackupsAdminTest-1500745506 None] decompressing data using zlib algorithm {{(pid=101319) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:722}} Jul 03 09:40:17.923342 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-e9aff13f-76c8-49a6-bd16-080f44143496 tempest-VolumesBackupsAdminTest-1500745506 None] restoring object. backup: fe9dd1c3-699a-4fc3-ae7f-2830334a957c, container: tempest-volumesbackupsadmintest-backup-container-31762394, object name: volume_6b682bae-d2d2-49c0-8a1c-8f9a74831d6c/20260703093948/az_nova_backup_fe9dd1c3-699a-4fc3-ae7f-2830334a957c-00010, volume: 71248f04-8364-4267-8b8a-a95f390c6126. {{(pid=101319) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:705}} Jul 03 09:40:17.936009 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-e9aff13f-76c8-49a6-bd16-080f44143496 tempest-VolumesBackupsAdminTest-1500745506 None] decompressing data using zlib algorithm {{(pid=101319) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:722}} Jul 03 09:40:18.268636 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-e9aff13f-76c8-49a6-bd16-080f44143496 tempest-VolumesBackupsAdminTest-1500745506 None] restoring object. backup: fe9dd1c3-699a-4fc3-ae7f-2830334a957c, container: tempest-volumesbackupsadmintest-backup-container-31762394, object name: volume_6b682bae-d2d2-49c0-8a1c-8f9a74831d6c/20260703093948/az_nova_backup_fe9dd1c3-699a-4fc3-ae7f-2830334a957c-00011, volume: 71248f04-8364-4267-8b8a-a95f390c6126. {{(pid=101319) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:705}} Jul 03 09:40:18.282819 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-e9aff13f-76c8-49a6-bd16-080f44143496 tempest-VolumesBackupsAdminTest-1500745506 None] decompressing data using zlib algorithm {{(pid=101319) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:722}} Jul 03 09:40:18.610664 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-e9aff13f-76c8-49a6-bd16-080f44143496 tempest-VolumesBackupsAdminTest-1500745506 None] restoring object. backup: fe9dd1c3-699a-4fc3-ae7f-2830334a957c, container: tempest-volumesbackupsadmintest-backup-container-31762394, object name: volume_6b682bae-d2d2-49c0-8a1c-8f9a74831d6c/20260703093948/az_nova_backup_fe9dd1c3-699a-4fc3-ae7f-2830334a957c-00012, volume: 71248f04-8364-4267-8b8a-a95f390c6126. {{(pid=101319) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:705}} Jul 03 09:40:18.629324 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-e9aff13f-76c8-49a6-bd16-080f44143496 tempest-VolumesBackupsAdminTest-1500745506 None] decompressing data using zlib algorithm {{(pid=101319) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:722}} Jul 03 09:40:18.965015 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-e9aff13f-76c8-49a6-bd16-080f44143496 tempest-VolumesBackupsAdminTest-1500745506 None] restoring object. backup: fe9dd1c3-699a-4fc3-ae7f-2830334a957c, container: tempest-volumesbackupsadmintest-backup-container-31762394, object name: volume_6b682bae-d2d2-49c0-8a1c-8f9a74831d6c/20260703093948/az_nova_backup_fe9dd1c3-699a-4fc3-ae7f-2830334a957c-00013, volume: 71248f04-8364-4267-8b8a-a95f390c6126. {{(pid=101319) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:705}} Jul 03 09:40:18.983586 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-e9aff13f-76c8-49a6-bd16-080f44143496 tempest-VolumesBackupsAdminTest-1500745506 None] decompressing data using zlib algorithm {{(pid=101319) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:722}} Jul 03 09:40:19.320292 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-e9aff13f-76c8-49a6-bd16-080f44143496 tempest-VolumesBackupsAdminTest-1500745506 None] restoring object. backup: fe9dd1c3-699a-4fc3-ae7f-2830334a957c, container: tempest-volumesbackupsadmintest-backup-container-31762394, object name: volume_6b682bae-d2d2-49c0-8a1c-8f9a74831d6c/20260703093948/az_nova_backup_fe9dd1c3-699a-4fc3-ae7f-2830334a957c-00014, volume: 71248f04-8364-4267-8b8a-a95f390c6126. {{(pid=101319) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:705}} Jul 03 09:40:19.333365 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-e9aff13f-76c8-49a6-bd16-080f44143496 tempest-VolumesBackupsAdminTest-1500745506 None] decompressing data using zlib algorithm {{(pid=101319) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:722}} Jul 03 09:40:19.662220 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-e9aff13f-76c8-49a6-bd16-080f44143496 tempest-VolumesBackupsAdminTest-1500745506 None] restoring object. backup: fe9dd1c3-699a-4fc3-ae7f-2830334a957c, container: tempest-volumesbackupsadmintest-backup-container-31762394, object name: volume_6b682bae-d2d2-49c0-8a1c-8f9a74831d6c/20260703093948/az_nova_backup_fe9dd1c3-699a-4fc3-ae7f-2830334a957c-00015, volume: 71248f04-8364-4267-8b8a-a95f390c6126. {{(pid=101319) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:705}} Jul 03 09:40:19.676571 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-e9aff13f-76c8-49a6-bd16-080f44143496 tempest-VolumesBackupsAdminTest-1500745506 None] decompressing data using zlib algorithm {{(pid=101319) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:722}} Jul 03 09:40:19.997932 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-e9aff13f-76c8-49a6-bd16-080f44143496 tempest-VolumesBackupsAdminTest-1500745506 None] restoring object. backup: fe9dd1c3-699a-4fc3-ae7f-2830334a957c, container: tempest-volumesbackupsadmintest-backup-container-31762394, object name: volume_6b682bae-d2d2-49c0-8a1c-8f9a74831d6c/20260703093948/az_nova_backup_fe9dd1c3-699a-4fc3-ae7f-2830334a957c-00016, volume: 71248f04-8364-4267-8b8a-a95f390c6126. {{(pid=101319) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:705}} Jul 03 09:40:20.010675 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-e9aff13f-76c8-49a6-bd16-080f44143496 tempest-VolumesBackupsAdminTest-1500745506 None] decompressing data using zlib algorithm {{(pid=101319) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:722}} Jul 03 09:40:20.347927 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-e9aff13f-76c8-49a6-bd16-080f44143496 tempest-VolumesBackupsAdminTest-1500745506 None] restoring object. backup: fe9dd1c3-699a-4fc3-ae7f-2830334a957c, container: tempest-volumesbackupsadmintest-backup-container-31762394, object name: volume_6b682bae-d2d2-49c0-8a1c-8f9a74831d6c/20260703093948/az_nova_backup_fe9dd1c3-699a-4fc3-ae7f-2830334a957c-00017, volume: 71248f04-8364-4267-8b8a-a95f390c6126. {{(pid=101319) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:705}} Jul 03 09:40:20.362516 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-e9aff13f-76c8-49a6-bd16-080f44143496 tempest-VolumesBackupsAdminTest-1500745506 None] decompressing data using zlib algorithm {{(pid=101319) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:722}} Jul 03 09:40:20.708763 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-e9aff13f-76c8-49a6-bd16-080f44143496 tempest-VolumesBackupsAdminTest-1500745506 None] restoring object. backup: fe9dd1c3-699a-4fc3-ae7f-2830334a957c, container: tempest-volumesbackupsadmintest-backup-container-31762394, object name: volume_6b682bae-d2d2-49c0-8a1c-8f9a74831d6c/20260703093948/az_nova_backup_fe9dd1c3-699a-4fc3-ae7f-2830334a957c-00018, volume: 71248f04-8364-4267-8b8a-a95f390c6126. {{(pid=101319) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:705}} Jul 03 09:40:20.723214 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-e9aff13f-76c8-49a6-bd16-080f44143496 tempest-VolumesBackupsAdminTest-1500745506 None] decompressing data using zlib algorithm {{(pid=101319) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:722}} Jul 03 09:40:21.060034 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-e9aff13f-76c8-49a6-bd16-080f44143496 tempest-VolumesBackupsAdminTest-1500745506 None] restoring object. backup: fe9dd1c3-699a-4fc3-ae7f-2830334a957c, container: tempest-volumesbackupsadmintest-backup-container-31762394, object name: volume_6b682bae-d2d2-49c0-8a1c-8f9a74831d6c/20260703093948/az_nova_backup_fe9dd1c3-699a-4fc3-ae7f-2830334a957c-00019, volume: 71248f04-8364-4267-8b8a-a95f390c6126. {{(pid=101319) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:705}} Jul 03 09:40:21.077565 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-e9aff13f-76c8-49a6-bd16-080f44143496 tempest-VolumesBackupsAdminTest-1500745506 None] decompressing data using zlib algorithm {{(pid=101319) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:722}} Jul 03 09:40:21.414693 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-e9aff13f-76c8-49a6-bd16-080f44143496 tempest-VolumesBackupsAdminTest-1500745506 None] restoring object. backup: fe9dd1c3-699a-4fc3-ae7f-2830334a957c, container: tempest-volumesbackupsadmintest-backup-container-31762394, object name: volume_6b682bae-d2d2-49c0-8a1c-8f9a74831d6c/20260703093948/az_nova_backup_fe9dd1c3-699a-4fc3-ae7f-2830334a957c-00020, volume: 71248f04-8364-4267-8b8a-a95f390c6126. {{(pid=101319) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:705}} Jul 03 09:40:21.431917 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-e9aff13f-76c8-49a6-bd16-080f44143496 tempest-VolumesBackupsAdminTest-1500745506 None] decompressing data using zlib algorithm {{(pid=101319) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:722}} Jul 03 09:40:21.806763 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-e9aff13f-76c8-49a6-bd16-080f44143496 tempest-VolumesBackupsAdminTest-1500745506 None] restoring object. backup: fe9dd1c3-699a-4fc3-ae7f-2830334a957c, container: tempest-volumesbackupsadmintest-backup-container-31762394, object name: volume_6b682bae-d2d2-49c0-8a1c-8f9a74831d6c/20260703093948/az_nova_backup_fe9dd1c3-699a-4fc3-ae7f-2830334a957c-00021, volume: 71248f04-8364-4267-8b8a-a95f390c6126. {{(pid=101319) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:705}} Jul 03 09:40:21.834660 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-e9aff13f-76c8-49a6-bd16-080f44143496 tempest-VolumesBackupsAdminTest-1500745506 None] decompressing data using zlib algorithm {{(pid=101319) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:722}} Jul 03 09:40:22.010736 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-e9aff13f-76c8-49a6-bd16-080f44143496 tempest-VolumesBackupsAdminTest-1500745506 None] v1 volume backup restore of fe9dd1c3-699a-4fc3-ae7f-2830334a957c finished. {{(pid=101319) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:750}} Jul 03 09:40:22.010736 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.driver [None req-e9aff13f-76c8-49a6-bd16-080f44143496 tempest-VolumesBackupsAdminTest-1500745506 None] Restoring volume base metadata {{(pid=101319) _restore_vol_base_meta /opt/stack/cinder/cinder/backup/driver.py:177}} Jul 03 09:40:22.028743 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.driver [None req-e9aff13f-76c8-49a6-bd16-080f44143496 tempest-VolumesBackupsAdminTest-1500745506 None] No metadata of type 'volume-metadata' to restore {{(pid=101319) put /opt/stack/cinder/cinder/backup/driver.py:345}} Jul 03 09:40:22.028928 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.driver [None req-e9aff13f-76c8-49a6-bd16-080f44143496 tempest-VolumesBackupsAdminTest-1500745506 None] No metadata of type 'volume-glance-metadata' to restore {{(pid=101319) put /opt/stack/cinder/cinder/backup/driver.py:345}} Jul 03 09:40:22.029122 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-e9aff13f-76c8-49a6-bd16-080f44143496 tempest-VolumesBackupsAdminTest-1500745506 None] restore fe9dd1c3-699a-4fc3-ae7f-2830334a957c to 71248f04-8364-4267-8b8a-a95f390c6126 finished. {{(pid=101319) restore /opt/stack/cinder/cinder/backup/chunkeddriver.py:815}} Jul 03 09:40:22.029706 np0000004400 cinder-backup[101319]: DEBUG oslo_concurrency.processutils [None req-e9aff13f-76c8-49a6-bd16-080f44143496 tempest-VolumesBackupsAdminTest-1500745506 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chown 0 /dev/sde {{(pid=101319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 09:40:22.050811 np0000004400 sudo[122666]: stack : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chown 0 /dev/sde Jul 03 09:40:22.051557 np0000004400 sudo[122666]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1002) Jul 03 09:40:22.471620 np0000004400 sudo[122666]: pam_unix(sudo:session): session closed for user root Jul 03 09:40:22.474133 np0000004400 cinder-backup[101319]: DEBUG oslo_concurrency.processutils [None req-e9aff13f-76c8-49a6-bd16-080f44143496 tempest-VolumesBackupsAdminTest-1500745506 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chown 0 /dev/sde" returned: 0 in 0.444s {{(pid=101319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 09:40:22.474684 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-e9aff13f-76c8-49a6-bd16-080f44143496 tempest-VolumesBackupsAdminTest-1500745506 None] ==> disconnect_volume: call "{'args': (, {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-71248f04-8364-4267-8b8a-a95f390c6126', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '71248f04-8364-4267-8b8a-a95f390c6126', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': False}, {'type': 'block', 'scsi_wwn': '33000000088d239f4', 'path': '/dev/sde'}), 'kwargs': {'force': True, 'ignore_errors': False}}" {{(pid=101319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}} Jul 03 09:40:22.474871 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.base [None req-e9aff13f-76c8-49a6-bd16-080f44143496 tempest-VolumesBackupsAdminTest-1500745506 None] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=101319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jul 03 09:40:23.531732 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.base [None req-e9aff13f-76c8-49a6-bd16-080f44143496 tempest-VolumesBackupsAdminTest-1500745506 None] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 1.057s {{(pid=101319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jul 03 09:40:23.532365 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-e9aff13f-76c8-49a6-bd16-080f44143496 tempest-VolumesBackupsAdminTest-1500745506 None] _get_connection_devices called with parameters: connection_properties={'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-71248f04-8364-4267-8b8a-a95f390c6126', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '71248f04-8364-4267-8b8a-a95f390c6126', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': False}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=101319) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:847}} Jul 03 09:40:23.545959 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-e9aff13f-76c8-49a6-bd16-080f44143496 tempest-VolumesBackupsAdminTest-1500745506 None] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS: Jul 03 09:40:23.545959 np0000004400 cinder-backup[101319]: No targets found. Jul 03 09:40:23.545959 np0000004400 cinder-backup[101319]: iSNS: Jul 03 09:40:23.545959 np0000004400 cinder-backup[101319]: No targets found. Jul 03 09:40:23.545959 np0000004400 cinder-backup[101319]: STATIC: Jul 03 09:40:23.545959 np0000004400 cinder-backup[101319]: Target: iqn.2023-03.storpool.com:os--volume-e2580fe0-9b9f-48e5-b77e-51a2b22f14fb Jul 03 09:40:23.545959 np0000004400 cinder-backup[101319]: Portal: 192.168.50.100:3260,-1 Jul 03 09:40:23.545959 np0000004400 cinder-backup[101319]: Iface Name: default Jul 03 09:40:23.545959 np0000004400 cinder-backup[101319]: Portal: 192.168.40.100:3260,-1 Jul 03 09:40:23.545959 np0000004400 cinder-backup[101319]: Iface Name: default Jul 03 09:40:23.545959 np0000004400 cinder-backup[101319]: Target: iqn.2023-03.storpool.com:os--volume-1b2d367e-5e69-4f28-ba33-80946ae8636f Jul 03 09:40:23.545959 np0000004400 cinder-backup[101319]: Portal: 192.168.50.100:3260,-1 Jul 03 09:40:23.545959 np0000004400 cinder-backup[101319]: Iface Name: default Jul 03 09:40:23.545959 np0000004400 cinder-backup[101319]: Portal: 192.168.40.100:3260,-1 Jul 03 09:40:23.545959 np0000004400 cinder-backup[101319]: Iface Name: default Jul 03 09:40:23.545959 np0000004400 cinder-backup[101319]: Target: iqn.2023-03.storpool.com:os--volume-b2e4f10c-8033-4c54-95a1-dfe45d6357a3 Jul 03 09:40:23.545959 np0000004400 cinder-backup[101319]: Portal: 192.168.50.100:3260,-1 Jul 03 09:40:23.545959 np0000004400 cinder-backup[101319]: Iface Name: default Jul 03 09:40:23.545959 np0000004400 cinder-backup[101319]: Portal: 192.168.40.100:3260,-1 Jul 03 09:40:23.545959 np0000004400 cinder-backup[101319]: Iface Name: default Jul 03 09:40:23.545959 np0000004400 cinder-backup[101319]: Target: iqn.2023-03.storpool.com:os--volume-e2d07ea9-be35-48a4-9ec8-3736abeaba3e Jul 03 09:40:23.545959 np0000004400 cinder-backup[101319]: Portal: 192.168.50.100:3260,-1 Jul 03 09:40:23.545959 np0000004400 cinder-backup[101319]: Iface Name: default Jul 03 09:40:23.545959 np0000004400 cinder-backup[101319]: Portal: 192.168.40.100:3260,-1 Jul 03 09:40:23.545959 np0000004400 cinder-backup[101319]: Iface Name: default Jul 03 09:40:23.545959 np0000004400 cinder-backup[101319]: Target: iqn.2023-03.storpool.com:os--volume-2cb23c9f-fd1d-4ffa-b027-28faa3d99f1d Jul 03 09:40:23.545959 np0000004400 cinder-backup[101319]: Portal: 192.168.50.100:3260,-1 Jul 03 09:40:23.545959 np0000004400 cinder-backup[101319]: Iface Name: default Jul 03 09:40:23.545959 np0000004400 cinder-backup[101319]: Portal: 192.168.40.100:3260,-1 Jul 03 09:40:23.545959 np0000004400 cinder-backup[101319]: Iface Name: default Jul 03 09:40:23.545959 np0000004400 cinder-backup[101319]: Target: iqn.2023-03.storpool.com:os--volume-71248f04-8364-4267-8b8a-a95f390c6126 Jul 03 09:40:23.545959 np0000004400 cinder-backup[101319]: Portal: 192.168.40.100:3260,-1 Jul 03 09:40:23.545959 np0000004400 cinder-backup[101319]: Iface Name: default Jul 03 09:40:23.545959 np0000004400 cinder-backup[101319]: Target: iqn.2023-03.storpool.com:os--volume-ef51248d-f155-43cd-afa0-8b0f72368a43 Jul 03 09:40:23.545959 np0000004400 cinder-backup[101319]: Portal: 192.168.50.100:3260,-1 Jul 03 09:40:23.545959 np0000004400 cinder-backup[101319]: Iface Name: default Jul 03 09:40:23.545959 np0000004400 cinder-backup[101319]: Portal: 192.168.40.100:3260,-1 Jul 03 09:40:23.545959 np0000004400 cinder-backup[101319]: Iface Name: default Jul 03 09:40:23.545959 np0000004400 cinder-backup[101319]: Target: iqn.2023-03.storpool.com:os--volume-b5c70aaf-10ec-45f7-bd9f-756a91fe1d65 Jul 03 09:40:23.545959 np0000004400 cinder-backup[101319]: Portal: 192.168.50.100:3260,-1 Jul 03 09:40:23.545959 np0000004400 cinder-backup[101319]: Iface Name: default Jul 03 09:40:23.545959 np0000004400 cinder-backup[101319]: Portal: 192.168.40.100:3260,-1 Jul 03 09:40:23.545959 np0000004400 cinder-backup[101319]: Iface Name: default Jul 03 09:40:23.545959 np0000004400 cinder-backup[101319]: FIRMWARE: Jul 03 09:40:23.545959 np0000004400 cinder-backup[101319]: No targets found. Jul 03 09:40:23.545959 np0000004400 cinder-backup[101319]: stderr= {{(pid=101319) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jul 03 09:40:23.546901 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-e9aff13f-76c8-49a6-bd16-080f44143496 tempest-VolumesBackupsAdminTest-1500745506 None] Regex to get portals from discoverydb: ^SENDTARGETS: Jul 03 09:40:23.546901 np0000004400 cinder-backup[101319]: .*?^DiscoveryAddress: 192.168.40.100,3260.*? Jul 03 09:40:23.546901 np0000004400 cinder-backup[101319]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=101319) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:390}} Jul 03 09:40:23.547230 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-e9aff13f-76c8-49a6-bd16-080f44143496 tempest-VolumesBackupsAdminTest-1500745506 None] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-71248f04-8364-4267-8b8a-a95f390c6126', 0)] {{(pid=101319) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:858}} Jul 03 09:40:23.576185 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-e9aff13f-76c8-49a6-bd16-080f44143496 tempest-VolumesBackupsAdminTest-1500745506 None] iscsiadm ('-m', 'session'): stdout=tcp: [33] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2cb23c9f-fd1d-4ffa-b027-28faa3d99f1d (non-flash) Jul 03 09:40:23.576185 np0000004400 cinder-backup[101319]: tcp: [34] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2cb23c9f-fd1d-4ffa-b027-28faa3d99f1d (non-flash) Jul 03 09:40:23.576185 np0000004400 cinder-backup[101319]: tcp: [35] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e2580fe0-9b9f-48e5-b77e-51a2b22f14fb (non-flash) Jul 03 09:40:23.576185 np0000004400 cinder-backup[101319]: tcp: [36] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e2580fe0-9b9f-48e5-b77e-51a2b22f14fb (non-flash) Jul 03 09:40:23.576185 np0000004400 cinder-backup[101319]: tcp: [40] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b5c70aaf-10ec-45f7-bd9f-756a91fe1d65 (non-flash) Jul 03 09:40:23.576185 np0000004400 cinder-backup[101319]: tcp: [41] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b5c70aaf-10ec-45f7-bd9f-756a91fe1d65 (non-flash) Jul 03 09:40:23.576185 np0000004400 cinder-backup[101319]: tcp: [42] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ef51248d-f155-43cd-afa0-8b0f72368a43 (non-flash) Jul 03 09:40:23.576185 np0000004400 cinder-backup[101319]: tcp: [43] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ef51248d-f155-43cd-afa0-8b0f72368a43 (non-flash) Jul 03 09:40:23.576185 np0000004400 cinder-backup[101319]: tcp: [44] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-71248f04-8364-4267-8b8a-a95f390c6126 (non-flash) Jul 03 09:40:23.576185 np0000004400 cinder-backup[101319]: tcp: [45] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1b2d367e-5e69-4f28-ba33-80946ae8636f (non-flash) Jul 03 09:40:23.576185 np0000004400 cinder-backup[101319]: tcp: [46] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1b2d367e-5e69-4f28-ba33-80946ae8636f (non-flash) Jul 03 09:40:23.576185 np0000004400 cinder-backup[101319]: tcp: [47] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e2d07ea9-be35-48a4-9ec8-3736abeaba3e (non-flash) Jul 03 09:40:23.576185 np0000004400 cinder-backup[101319]: tcp: [48] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e2d07ea9-be35-48a4-9ec8-3736abeaba3e (non-flash) Jul 03 09:40:23.576185 np0000004400 cinder-backup[101319]: tcp: [49] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b2e4f10c-8033-4c54-95a1-dfe45d6357a3 (non-flash) Jul 03 09:40:23.576185 np0000004400 cinder-backup[101319]: tcp: [50] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b2e4f10c-8033-4c54-95a1-dfe45d6357a3 (non-flash) Jul 03 09:40:23.576185 np0000004400 cinder-backup[101319]: stderr= {{(pid=101319) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jul 03 09:40:23.576738 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-e9aff13f-76c8-49a6-bd16-080f44143496 tempest-VolumesBackupsAdminTest-1500745506 None] iscsi session list stdout=tcp: [33] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2cb23c9f-fd1d-4ffa-b027-28faa3d99f1d (non-flash) Jul 03 09:40:23.576738 np0000004400 cinder-backup[101319]: tcp: [34] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2cb23c9f-fd1d-4ffa-b027-28faa3d99f1d (non-flash) Jul 03 09:40:23.576738 np0000004400 cinder-backup[101319]: tcp: [35] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e2580fe0-9b9f-48e5-b77e-51a2b22f14fb (non-flash) Jul 03 09:40:23.576738 np0000004400 cinder-backup[101319]: tcp: [36] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e2580fe0-9b9f-48e5-b77e-51a2b22f14fb (non-flash) Jul 03 09:40:23.576738 np0000004400 cinder-backup[101319]: tcp: [40] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b5c70aaf-10ec-45f7-bd9f-756a91fe1d65 (non-flash) Jul 03 09:40:23.576738 np0000004400 cinder-backup[101319]: tcp: [41] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b5c70aaf-10ec-45f7-bd9f-756a91fe1d65 (non-flash) Jul 03 09:40:23.576738 np0000004400 cinder-backup[101319]: tcp: [42] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ef51248d-f155-43cd-afa0-8b0f72368a43 (non-flash) Jul 03 09:40:23.576738 np0000004400 cinder-backup[101319]: tcp: [43] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ef51248d-f155-43cd-afa0-8b0f72368a43 (non-flash) Jul 03 09:40:23.576738 np0000004400 cinder-backup[101319]: tcp: [44] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-71248f04-8364-4267-8b8a-a95f390c6126 (non-flash) Jul 03 09:40:23.576738 np0000004400 cinder-backup[101319]: tcp: [45] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1b2d367e-5e69-4f28-ba33-80946ae8636f (non-flash) Jul 03 09:40:23.576738 np0000004400 cinder-backup[101319]: tcp: [46] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1b2d367e-5e69-4f28-ba33-80946ae8636f (non-flash) Jul 03 09:40:23.576738 np0000004400 cinder-backup[101319]: tcp: [47] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e2d07ea9-be35-48a4-9ec8-3736abeaba3e (non-flash) Jul 03 09:40:23.576738 np0000004400 cinder-backup[101319]: tcp: [48] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e2d07ea9-be35-48a4-9ec8-3736abeaba3e (non-flash) Jul 03 09:40:23.576738 np0000004400 cinder-backup[101319]: tcp: [49] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b2e4f10c-8033-4c54-95a1-dfe45d6357a3 (non-flash) Jul 03 09:40:23.576738 np0000004400 cinder-backup[101319]: tcp: [50] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b2e4f10c-8033-4c54-95a1-dfe45d6357a3 (non-flash) Jul 03 09:40:23.576738 np0000004400 cinder-backup[101319]: stderr= {{(pid=101319) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jul 03 09:40:23.576738 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-e9aff13f-76c8-49a6-bd16-080f44143496 tempest-VolumesBackupsAdminTest-1500745506 None] Sessions list: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-2cb23c9f-fd1d-4ffa-b027-28faa3d99f1d', '33'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-2cb23c9f-fd1d-4ffa-b027-28faa3d99f1d', '34'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-e2580fe0-9b9f-48e5-b77e-51a2b22f14fb', '35'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-e2580fe0-9b9f-48e5-b77e-51a2b22f14fb', '36'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-b5c70aaf-10ec-45f7-bd9f-756a91fe1d65', '40'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-b5c70aaf-10ec-45f7-bd9f-756a91fe1d65', '41'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-ef51248d-f155-43cd-afa0-8b0f72368a43', '42'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-ef51248d-f155-43cd-afa0-8b0f72368a43', '43'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-71248f04-8364-4267-8b8a-a95f390c6126', '44'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-1b2d367e-5e69-4f28-ba33-80946ae8636f', '45'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-1b2d367e-5e69-4f28-ba33-80946ae8636f', '46'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-e2d07ea9-be35-48a4-9ec8-3736abeaba3e', '47'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-e2d07ea9-be35-48a4-9ec8-3736abeaba3e', '48'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-b2e4f10c-8033-4c54-95a1-dfe45d6357a3', '49'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-b2e4f10c-8033-4c54-95a1-dfe45d6357a3', '50')] {{(pid=101319) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:866}} Jul 03 09:40:23.576738 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-e9aff13f-76c8-49a6-bd16-080f44143496 tempest-VolumesBackupsAdminTest-1500745506 None] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-71248f04-8364-4267-8b8a-a95f390c6126, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-71248f04-8364-4267-8b8a-a95f390c6126', '44')] {{(pid=101319) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}} Jul 03 09:40:23.577816 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-e9aff13f-76c8-49a6-bd16-080f44143496 tempest-VolumesBackupsAdminTest-1500745506 None] Resulting device map defaultdict(. at 0x7e77060953a0>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-71248f04-8364-4267-8b8a-a95f390c6126'): ({'sde'}, set())}) {{(pid=101319) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:912}} Jul 03 09:40:23.578041 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.linuxscsi [None req-e9aff13f-76c8-49a6-bd16-080f44143496 tempest-VolumesBackupsAdminTest-1500745506 None] Removing single pathed devices sde {{(pid=101319) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}} Jul 03 09:40:23.596178 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.linuxscsi [None req-e9aff13f-76c8-49a6-bd16-080f44143496 tempest-VolumesBackupsAdminTest-1500745506 None] Flushing IO for device /dev/sde {{(pid=101319) flush_device_io /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:461}} Jul 03 09:40:23.604231 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.linuxscsi [None req-e9aff13f-76c8-49a6-bd16-080f44143496 tempest-VolumesBackupsAdminTest-1500745506 None] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=101319) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}} Jul 03 09:40:23.644929 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.linuxscsi [None req-e9aff13f-76c8-49a6-bd16-080f44143496 tempest-VolumesBackupsAdminTest-1500745506 None] Checking to see if SCSI volumes sde have been removed. {{(pid=101319) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}} Jul 03 09:40:23.645200 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.linuxscsi [None req-e9aff13f-76c8-49a6-bd16-080f44143496 tempest-VolumesBackupsAdminTest-1500745506 None] SCSI volumes sde have been removed. {{(pid=101319) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}} Jul 03 09:40:23.647931 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.linuxscsi [None req-e9aff13f-76c8-49a6-bd16-080f44143496 tempest-VolumesBackupsAdminTest-1500745506 None] Checking to see if device paths {'sde'} are still under multipathd monitoring {{(pid=101319) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}} Jul 03 09:40:23.658844 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.linuxscsi [None req-e9aff13f-76c8-49a6-bd16-080f44143496 tempest-VolumesBackupsAdminTest-1500745506 None] Device paths {'sde'} have been removed from multipathd monitoring. {{(pid=101319) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}} Jul 03 09:40:23.659119 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-e9aff13f-76c8-49a6-bd16-080f44143496 tempest-VolumesBackupsAdminTest-1500745506 None] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-71248f04-8364-4267-8b8a-a95f390c6126')] {{(pid=101319) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1225}} Jul 03 09:40:23.672311 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-e9aff13f-76c8-49a6-bd16-080f44143496 tempest-VolumesBackupsAdminTest-1500745506 None] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=101319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 03 09:40:23.713101 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-e9aff13f-76c8-49a6-bd16-080f44143496 tempest-VolumesBackupsAdminTest-1500745506 None] iscsiadm ('--logout',): stdout=Logging out of session [sid: 44, target: iqn.2023-03.storpool.com:os--volume-71248f04-8364-4267-8b8a-a95f390c6126, portal: 192.168.40.100,3260] Jul 03 09:40:23.713101 np0000004400 cinder-backup[101319]: Logout of [sid: 44, target: iqn.2023-03.storpool.com:os--volume-71248f04-8364-4267-8b8a-a95f390c6126, portal: 192.168.40.100,3260] successful. Jul 03 09:40:23.713101 np0000004400 cinder-backup[101319]: stderr= {{(pid=101319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 03 09:40:23.741654 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-e9aff13f-76c8-49a6-bd16-080f44143496 tempest-VolumesBackupsAdminTest-1500745506 None] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=101319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 03 09:40:23.741977 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.base [None req-e9aff13f-76c8-49a6-bd16-080f44143496 tempest-VolumesBackupsAdminTest-1500745506 None] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.211s {{(pid=101319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jul 03 09:40:23.742176 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-e9aff13f-76c8-49a6-bd16-080f44143496 tempest-VolumesBackupsAdminTest-1500745506 None] <== disconnect_volume: return (1267ms) None {{(pid=101319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}} Jul 03 09:40:24.759514 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.manager [None req-e9aff13f-76c8-49a6-bd16-080f44143496 tempest-VolumesBackupsAdminTest-1500745506 None] Encryption key ID for volume 71248f04-8364-4267-8b8a-a95f390c6126 already matches encryption key ID in backup fe9dd1c3-699a-4fc3-ae7f-2830334a957c. {{(pid=101319) _run_restore /opt/stack/cinder/cinder/backup/manager.py:873}} Jul 03 09:40:24.791206 np0000004400 cinder-backup[101319]: INFO cinder.backup.manager [None req-e9aff13f-76c8-49a6-bd16-080f44143496 tempest-VolumesBackupsAdminTest-1500745506 None] Finished restoring backup fe9dd1c3-699a-4fc3-ae7f-2830334a957c to volume 71248f04-8364-4267-8b8a-a95f390c6126. Jul 03 09:40:25.639146 np0000004400 cinder-backup[101319]: INFO cinder.backup.manager [None req-f7dcd981-3701-40e1-8a51-7b944b5ea59d tempest-VolumesBackupsAdminTest-895628463 None] Delete backup started, backup: 42e84d4f-c7f8-48d9-82d8-6764b942e131. Jul 03 09:40:25.642582 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.drivers.swift [None req-f7dcd981-3701-40e1-8a51-7b944b5ea59d tempest-VolumesBackupsAdminTest-895628463 None] Using swift URL https://10.4.3.95:8080/v1/AUTH_ef7088f3bf6f417fab0f06c3c66bfb29 {{(pid=101319) initialize /opt/stack/cinder/cinder/backup/drivers/swift.py:300}} Jul 03 09:40:25.642766 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.drivers.swift [None req-f7dcd981-3701-40e1-8a51-7b944b5ea59d tempest-VolumesBackupsAdminTest-895628463 None] Connect to https://10.4.3.95:8080/v1/AUTH_ in "per_user" mode {{(pid=101319) initialize /opt/stack/cinder/cinder/backup/drivers/swift.py:301}} Jul 03 09:40:25.643037 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-f7dcd981-3701-40e1-8a51-7b944b5ea59d tempest-VolumesBackupsAdminTest-895628463 None] delete started, backup: 42e84d4f-c7f8-48d9-82d8-6764b942e131, container: tempest-volumesbackupsadmintest-backup-container-31762394, prefix: volume_6b682bae-d2d2-49c0-8a1c-8f9a74831d6c/20260703093948/az_nova_backup_fe9dd1c3-699a-4fc3-ae7f-2830334a957c. {{(pid=101319) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:822}} Jul 03 09:40:25.789588 np0000004400 cinder-backup[101319]: WARNING cinder.backup.chunkeddriver [None req-f7dcd981-3701-40e1-8a51-7b944b5ea59d tempest-VolumesBackupsAdminTest-895628463 None] Error while listing objects, continuing with delete.: swiftclient.exceptions.ClientException: Container GET failed: https://10.4.3.95:8080/v1/AUTH_ef7088f3bf6f417fab0f06c3c66bfb29/tempest-volumesbackupsadmintest-backup-container-31762394?format=json&prefix=volume_6b682bae-d2d2-49c0-8a1c-8f9a74831d6c/20260703093948/az_nova_backup_fe9dd1c3-699a-4fc3-ae7f-2830334a957c 404 Not Found [first 60 chars of response] b'

Not Found

The resource could not be found.<' (txn: tx357d7855a6594e9b9ebea-006a478389) Jul 03 09:40:25.790071 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-f7dcd981-3701-40e1-8a51-7b944b5ea59d tempest-VolumesBackupsAdminTest-895628463 None] delete 42e84d4f-c7f8-48d9-82d8-6764b942e131 finished. {{(pid=101319) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:848}} Jul 03 09:40:25.827636 np0000004400 cinder-backup[101319]: DEBUG oslo_db.sqlalchemy.engines [None req-f7dcd981-3701-40e1-8a51-7b944b5ea59d tempest-VolumesBackupsAdminTest-895628463 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=101319) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 03 09:40:25.852297 np0000004400 cinder-backup[101319]: DEBUG cinder.quota [None req-f7dcd981-3701-40e1-8a51-7b944b5ea59d tempest-VolumesBackupsAdminTest-895628463 None] Created reservations ['2da66f8f-b5bd-4e78-b457-0a4b5f614d94', '4ac1949d-32a2-46be-96b1-f39527dfdb90'] {{(pid=101319) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 09:40:25.876615 np0000004400 cinder-backup[101319]: INFO cinder.backup.manager [None req-f7dcd981-3701-40e1-8a51-7b944b5ea59d tempest-VolumesBackupsAdminTest-895628463 None] Delete backup finished, backup 42e84d4f-c7f8-48d9-82d8-6764b942e131 deleted. Jul 03 09:40:26.722461 np0000004400 cinder-backup[101319]: INFO cinder.backup.manager [None req-adafb35b-f5c8-4c46-bed6-d85b493bee3d tempest-VolumesBackupsAdminTest-1500745506 None] Delete backup started, backup: fe9dd1c3-699a-4fc3-ae7f-2830334a957c. Jul 03 09:40:26.727427 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.drivers.swift [None req-adafb35b-f5c8-4c46-bed6-d85b493bee3d tempest-VolumesBackupsAdminTest-1500745506 None] Using swift URL https://10.4.3.95:8080/v1/AUTH_b25712a6deba4237b3d9f8f02bb54ed6 {{(pid=101319) initialize /opt/stack/cinder/cinder/backup/drivers/swift.py:300}} Jul 03 09:40:26.727547 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.drivers.swift [None req-adafb35b-f5c8-4c46-bed6-d85b493bee3d tempest-VolumesBackupsAdminTest-1500745506 None] Connect to https://10.4.3.95:8080/v1/AUTH_ in "per_user" mode {{(pid=101319) initialize /opt/stack/cinder/cinder/backup/drivers/swift.py:301}} Jul 03 09:40:26.727762 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-adafb35b-f5c8-4c46-bed6-d85b493bee3d tempest-VolumesBackupsAdminTest-1500745506 None] delete started, backup: fe9dd1c3-699a-4fc3-ae7f-2830334a957c, container: tempest-volumesbackupsadmintest-backup-container-31762394, prefix: volume_6b682bae-d2d2-49c0-8a1c-8f9a74831d6c/20260703093948/az_nova_backup_fe9dd1c3-699a-4fc3-ae7f-2830334a957c. {{(pid=101319) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:822}} Jul 03 09:40:26.784545 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-adafb35b-f5c8-4c46-bed6-d85b493bee3d tempest-VolumesBackupsAdminTest-1500745506 None] generated object list: ['volume_6b682bae-d2d2-49c0-8a1c-8f9a74831d6c/20260703093948/az_nova_backup_fe9dd1c3-699a-4fc3-ae7f-2830334a957c-00001', 'volume_6b682bae-d2d2-49c0-8a1c-8f9a74831d6c/20260703093948/az_nova_backup_fe9dd1c3-699a-4fc3-ae7f-2830334a957c-00002', 'volume_6b682bae-d2d2-49c0-8a1c-8f9a74831d6c/20260703093948/az_nova_backup_fe9dd1c3-699a-4fc3-ae7f-2830334a957c-00003', 'volume_6b682bae-d2d2-49c0-8a1c-8f9a74831d6c/20260703093948/az_nova_backup_fe9dd1c3-699a-4fc3-ae7f-2830334a957c-00004', 'volume_6b682bae-d2d2-49c0-8a1c-8f9a74831d6c/20260703093948/az_nova_backup_fe9dd1c3-699a-4fc3-ae7f-2830334a957c-00005', 'volume_6b682bae-d2d2-49c0-8a1c-8f9a74831d6c/20260703093948/az_nova_backup_fe9dd1c3-699a-4fc3-ae7f-2830334a957c-00006', 'volume_6b682bae-d2d2-49c0-8a1c-8f9a74831d6c/20260703093948/az_nova_backup_fe9dd1c3-699a-4fc3-ae7f-2830334a957c-00007', 'volume_6b682bae-d2d2-49c0-8a1c-8f9a74831d6c/20260703093948/az_nova_backup_fe9dd1c3-699a-4fc3-ae7f-2830334a957c-00008', 'volume_6b682bae-d2d2-49c0-8a1c-8f9a74831d6c/20260703093948/az_nova_backup_fe9dd1c3-699a-4fc3-ae7f-2830334a957c-00009', 'volume_6b682bae-d2d2-49c0-8a1c-8f9a74831d6c/20260703093948/az_nova_backup_fe9dd1c3-699a-4fc3-ae7f-2830334a957c-00010', 'volume_6b682bae-d2d2-49c0-8a1c-8f9a74831d6c/20260703093948/az_nova_backup_fe9dd1c3-699a-4fc3-ae7f-2830334a957c-00011', 'volume_6b682bae-d2d2-49c0-8a1c-8f9a74831d6c/20260703093948/az_nova_backup_fe9dd1c3-699a-4fc3-ae7f-2830334a957c-00012', 'volume_6b682bae-d2d2-49c0-8a1c-8f9a74831d6c/20260703093948/az_nova_backup_fe9dd1c3-699a-4fc3-ae7f-2830334a957c-00013', 'volume_6b682bae-d2d2-49c0-8a1c-8f9a74831d6c/20260703093948/az_nova_backup_fe9dd1c3-699a-4fc3-ae7f-2830334a957c-00014', 'volume_6b682bae-d2d2-49c0-8a1c-8f9a74831d6c/20260703093948/az_nova_backup_fe9dd1c3-699a-4fc3-ae7f-2830334a957c-00015', 'volume_6b682bae-d2d2-49c0-8a1c-8f9a74831d6c/20260703093948/az_nova_backup_fe9dd1c3-699a-4fc3-ae7f-2830334a957c-00016', 'volume_6b682bae-d2d2-49c0-8a1c-8f9a74831d6c/20260703093948/az_nova_backup_fe9dd1c3-699a-4fc3-ae7f-2830334a957c-00017', 'volume_6b682bae-d2d2-49c0-8a1c-8f9a74831d6c/20260703093948/az_nova_backup_fe9dd1c3-699a-4fc3-ae7f-2830334a957c-00018', 'volume_6b682bae-d2d2-49c0-8a1c-8f9a74831d6c/20260703093948/az_nova_backup_fe9dd1c3-699a-4fc3-ae7f-2830334a957c-00019', 'volume_6b682bae-d2d2-49c0-8a1c-8f9a74831d6c/20260703093948/az_nova_backup_fe9dd1c3-699a-4fc3-ae7f-2830334a957c-00020', 'volume_6b682bae-d2d2-49c0-8a1c-8f9a74831d6c/20260703093948/az_nova_backup_fe9dd1c3-699a-4fc3-ae7f-2830334a957c-00021', 'volume_6b682bae-d2d2-49c0-8a1c-8f9a74831d6c/20260703093948/az_nova_backup_fe9dd1c3-699a-4fc3-ae7f-2830334a957c_metadata', 'volume_6b682bae-d2d2-49c0-8a1c-8f9a74831d6c/20260703093948/az_nova_backup_fe9dd1c3-699a-4fc3-ae7f-2830334a957c_sha256file']. {{(pid=101319) _generate_object_names /opt/stack/cinder/cinder/backup/chunkeddriver.py:260}} Jul 03 09:40:26.807965 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-adafb35b-f5c8-4c46-bed6-d85b493bee3d tempest-VolumesBackupsAdminTest-1500745506 None] deleted object: volume_6b682bae-d2d2-49c0-8a1c-8f9a74831d6c/20260703093948/az_nova_backup_fe9dd1c3-699a-4fc3-ae7f-2830334a957c-00001 in container: tempest-volumesbackupsadmintest-backup-container-31762394. {{(pid=101319) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 09:40:26.828485 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-adafb35b-f5c8-4c46-bed6-d85b493bee3d tempest-VolumesBackupsAdminTest-1500745506 None] deleted object: volume_6b682bae-d2d2-49c0-8a1c-8f9a74831d6c/20260703093948/az_nova_backup_fe9dd1c3-699a-4fc3-ae7f-2830334a957c-00002 in container: tempest-volumesbackupsadmintest-backup-container-31762394. {{(pid=101319) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 09:40:26.854777 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-adafb35b-f5c8-4c46-bed6-d85b493bee3d tempest-VolumesBackupsAdminTest-1500745506 None] deleted object: volume_6b682bae-d2d2-49c0-8a1c-8f9a74831d6c/20260703093948/az_nova_backup_fe9dd1c3-699a-4fc3-ae7f-2830334a957c-00003 in container: tempest-volumesbackupsadmintest-backup-container-31762394. {{(pid=101319) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 09:40:26.876572 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-adafb35b-f5c8-4c46-bed6-d85b493bee3d tempest-VolumesBackupsAdminTest-1500745506 None] deleted object: volume_6b682bae-d2d2-49c0-8a1c-8f9a74831d6c/20260703093948/az_nova_backup_fe9dd1c3-699a-4fc3-ae7f-2830334a957c-00004 in container: tempest-volumesbackupsadmintest-backup-container-31762394. {{(pid=101319) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 09:40:26.897309 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-adafb35b-f5c8-4c46-bed6-d85b493bee3d tempest-VolumesBackupsAdminTest-1500745506 None] deleted object: volume_6b682bae-d2d2-49c0-8a1c-8f9a74831d6c/20260703093948/az_nova_backup_fe9dd1c3-699a-4fc3-ae7f-2830334a957c-00005 in container: tempest-volumesbackupsadmintest-backup-container-31762394. {{(pid=101319) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 09:40:26.916518 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-adafb35b-f5c8-4c46-bed6-d85b493bee3d tempest-VolumesBackupsAdminTest-1500745506 None] deleted object: volume_6b682bae-d2d2-49c0-8a1c-8f9a74831d6c/20260703093948/az_nova_backup_fe9dd1c3-699a-4fc3-ae7f-2830334a957c-00006 in container: tempest-volumesbackupsadmintest-backup-container-31762394. {{(pid=101319) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 09:40:26.939746 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-adafb35b-f5c8-4c46-bed6-d85b493bee3d tempest-VolumesBackupsAdminTest-1500745506 None] deleted object: volume_6b682bae-d2d2-49c0-8a1c-8f9a74831d6c/20260703093948/az_nova_backup_fe9dd1c3-699a-4fc3-ae7f-2830334a957c-00007 in container: tempest-volumesbackupsadmintest-backup-container-31762394. {{(pid=101319) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 09:40:26.962126 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-adafb35b-f5c8-4c46-bed6-d85b493bee3d tempest-VolumesBackupsAdminTest-1500745506 None] deleted object: volume_6b682bae-d2d2-49c0-8a1c-8f9a74831d6c/20260703093948/az_nova_backup_fe9dd1c3-699a-4fc3-ae7f-2830334a957c-00008 in container: tempest-volumesbackupsadmintest-backup-container-31762394. {{(pid=101319) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 09:40:26.985155 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-adafb35b-f5c8-4c46-bed6-d85b493bee3d tempest-VolumesBackupsAdminTest-1500745506 None] deleted object: volume_6b682bae-d2d2-49c0-8a1c-8f9a74831d6c/20260703093948/az_nova_backup_fe9dd1c3-699a-4fc3-ae7f-2830334a957c-00009 in container: tempest-volumesbackupsadmintest-backup-container-31762394. {{(pid=101319) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 09:40:27.010736 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-adafb35b-f5c8-4c46-bed6-d85b493bee3d tempest-VolumesBackupsAdminTest-1500745506 None] deleted object: volume_6b682bae-d2d2-49c0-8a1c-8f9a74831d6c/20260703093948/az_nova_backup_fe9dd1c3-699a-4fc3-ae7f-2830334a957c-00010 in container: tempest-volumesbackupsadmintest-backup-container-31762394. {{(pid=101319) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 09:40:27.035132 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-adafb35b-f5c8-4c46-bed6-d85b493bee3d tempest-VolumesBackupsAdminTest-1500745506 None] deleted object: volume_6b682bae-d2d2-49c0-8a1c-8f9a74831d6c/20260703093948/az_nova_backup_fe9dd1c3-699a-4fc3-ae7f-2830334a957c-00011 in container: tempest-volumesbackupsadmintest-backup-container-31762394. {{(pid=101319) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 09:40:27.073486 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-adafb35b-f5c8-4c46-bed6-d85b493bee3d tempest-VolumesBackupsAdminTest-1500745506 None] deleted object: volume_6b682bae-d2d2-49c0-8a1c-8f9a74831d6c/20260703093948/az_nova_backup_fe9dd1c3-699a-4fc3-ae7f-2830334a957c-00012 in container: tempest-volumesbackupsadmintest-backup-container-31762394. {{(pid=101319) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 09:40:27.102640 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-adafb35b-f5c8-4c46-bed6-d85b493bee3d tempest-VolumesBackupsAdminTest-1500745506 None] deleted object: volume_6b682bae-d2d2-49c0-8a1c-8f9a74831d6c/20260703093948/az_nova_backup_fe9dd1c3-699a-4fc3-ae7f-2830334a957c-00013 in container: tempest-volumesbackupsadmintest-backup-container-31762394. {{(pid=101319) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 09:40:27.124695 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-adafb35b-f5c8-4c46-bed6-d85b493bee3d tempest-VolumesBackupsAdminTest-1500745506 None] deleted object: volume_6b682bae-d2d2-49c0-8a1c-8f9a74831d6c/20260703093948/az_nova_backup_fe9dd1c3-699a-4fc3-ae7f-2830334a957c-00014 in container: tempest-volumesbackupsadmintest-backup-container-31762394. {{(pid=101319) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 09:40:27.146255 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-adafb35b-f5c8-4c46-bed6-d85b493bee3d tempest-VolumesBackupsAdminTest-1500745506 None] deleted object: volume_6b682bae-d2d2-49c0-8a1c-8f9a74831d6c/20260703093948/az_nova_backup_fe9dd1c3-699a-4fc3-ae7f-2830334a957c-00015 in container: tempest-volumesbackupsadmintest-backup-container-31762394. {{(pid=101319) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 09:40:27.168042 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-adafb35b-f5c8-4c46-bed6-d85b493bee3d tempest-VolumesBackupsAdminTest-1500745506 None] deleted object: volume_6b682bae-d2d2-49c0-8a1c-8f9a74831d6c/20260703093948/az_nova_backup_fe9dd1c3-699a-4fc3-ae7f-2830334a957c-00016 in container: tempest-volumesbackupsadmintest-backup-container-31762394. {{(pid=101319) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 09:40:27.189511 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-adafb35b-f5c8-4c46-bed6-d85b493bee3d tempest-VolumesBackupsAdminTest-1500745506 None] deleted object: volume_6b682bae-d2d2-49c0-8a1c-8f9a74831d6c/20260703093948/az_nova_backup_fe9dd1c3-699a-4fc3-ae7f-2830334a957c-00017 in container: tempest-volumesbackupsadmintest-backup-container-31762394. {{(pid=101319) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 09:40:27.209820 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-adafb35b-f5c8-4c46-bed6-d85b493bee3d tempest-VolumesBackupsAdminTest-1500745506 None] deleted object: volume_6b682bae-d2d2-49c0-8a1c-8f9a74831d6c/20260703093948/az_nova_backup_fe9dd1c3-699a-4fc3-ae7f-2830334a957c-00018 in container: tempest-volumesbackupsadmintest-backup-container-31762394. {{(pid=101319) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 09:40:27.229290 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-adafb35b-f5c8-4c46-bed6-d85b493bee3d tempest-VolumesBackupsAdminTest-1500745506 None] deleted object: volume_6b682bae-d2d2-49c0-8a1c-8f9a74831d6c/20260703093948/az_nova_backup_fe9dd1c3-699a-4fc3-ae7f-2830334a957c-00019 in container: tempest-volumesbackupsadmintest-backup-container-31762394. {{(pid=101319) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 09:40:27.260476 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-adafb35b-f5c8-4c46-bed6-d85b493bee3d tempest-VolumesBackupsAdminTest-1500745506 None] deleted object: volume_6b682bae-d2d2-49c0-8a1c-8f9a74831d6c/20260703093948/az_nova_backup_fe9dd1c3-699a-4fc3-ae7f-2830334a957c-00020 in container: tempest-volumesbackupsadmintest-backup-container-31762394. {{(pid=101319) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 09:40:27.290205 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-adafb35b-f5c8-4c46-bed6-d85b493bee3d tempest-VolumesBackupsAdminTest-1500745506 None] deleted object: volume_6b682bae-d2d2-49c0-8a1c-8f9a74831d6c/20260703093948/az_nova_backup_fe9dd1c3-699a-4fc3-ae7f-2830334a957c-00021 in container: tempest-volumesbackupsadmintest-backup-container-31762394. {{(pid=101319) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 09:40:27.315334 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-adafb35b-f5c8-4c46-bed6-d85b493bee3d tempest-VolumesBackupsAdminTest-1500745506 None] deleted object: volume_6b682bae-d2d2-49c0-8a1c-8f9a74831d6c/20260703093948/az_nova_backup_fe9dd1c3-699a-4fc3-ae7f-2830334a957c_metadata in container: tempest-volumesbackupsadmintest-backup-container-31762394. {{(pid=101319) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 09:40:27.335887 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-adafb35b-f5c8-4c46-bed6-d85b493bee3d tempest-VolumesBackupsAdminTest-1500745506 None] deleted object: volume_6b682bae-d2d2-49c0-8a1c-8f9a74831d6c/20260703093948/az_nova_backup_fe9dd1c3-699a-4fc3-ae7f-2830334a957c_sha256file in container: tempest-volumesbackupsadmintest-backup-container-31762394. {{(pid=101319) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 09:40:27.336220 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-adafb35b-f5c8-4c46-bed6-d85b493bee3d tempest-VolumesBackupsAdminTest-1500745506 None] delete fe9dd1c3-699a-4fc3-ae7f-2830334a957c finished. {{(pid=101319) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:848}} Jul 03 09:40:27.369618 np0000004400 cinder-backup[101319]: DEBUG oslo_db.sqlalchemy.engines [None req-adafb35b-f5c8-4c46-bed6-d85b493bee3d tempest-VolumesBackupsAdminTest-1500745506 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=101319) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 03 09:40:27.385423 np0000004400 cinder-backup[101319]: DEBUG cinder.quota [None req-adafb35b-f5c8-4c46-bed6-d85b493bee3d tempest-VolumesBackupsAdminTest-1500745506 None] Created reservations ['4d1d6049-0c9e-4e30-85de-6972598fb09f', '827fb968-0e11-4cfa-8f65-8e276f4a3c71'] {{(pid=101319) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 09:40:27.405221 np0000004400 cinder-backup[101319]: INFO cinder.backup.manager [None req-adafb35b-f5c8-4c46-bed6-d85b493bee3d tempest-VolumesBackupsAdminTest-1500745506 None] Delete backup finished, backup fe9dd1c3-699a-4fc3-ae7f-2830334a957c deleted. Jul 03 09:40:30.445202 np0000004400 cinder-backup[101319]: INFO cinder.backup.manager [None req-cbe01d26-c2ec-4bcc-9c76-1eea6e84e3a5 tempest-VolumesBackupsAdminTest-1500745506 None] Create backup started, backup: 3b72dd02-bc01-459e-878b-586ab492372f volume: 43d877b9-de99-46f9-9e3b-e0fb13a3b4d7. Jul 03 09:40:30.453325 np0000004400 cinder-backup[101319]: INFO cinder.backup.manager [None req-cbe01d26-c2ec-4bcc-9c76-1eea6e84e3a5 tempest-VolumesBackupsAdminTest-1500745506 None] Call Volume Manager to get_backup_device for Backup(availability_zone='nova',container='tempest-volumesbackupsadmintest-backup-container-1481520206',created_at=2026-07-03T09:40:30Z,data_timestamp=2026-07-03T09:40:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesBackupsAdminTest-Backup-1353460869',encryption_key_id=None,fail_reason=None,host='np0000004400',id=3b72dd02-bc01-459e-878b-586ab492372f,metadata={},num_dependent_backups=0,object_count=0,parent=None,parent_id=None,project_id='b25712a6deba4237b3d9f8f02bb54ed6',restore_volume_id=None,service='cinder.backup.drivers.swift.SwiftBackupDriver',service_metadata=None,size=1,snapshot_id=None,status='creating',temp_snapshot_id=None,temp_volume_id=None,updated_at=None,user_id='356a534952b84c0680fa3b9655a0fc13',volume_id=43d877b9-de99-46f9-9e3b-e0fb13a3b4d7) Jul 03 09:40:30.497075 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.drivers.swift [None req-cbe01d26-c2ec-4bcc-9c76-1eea6e84e3a5 tempest-VolumesBackupsAdminTest-1500745506 None] Using swift URL https://10.4.3.95:8080/v1/AUTH_b25712a6deba4237b3d9f8f02bb54ed6 {{(pid=101319) initialize /opt/stack/cinder/cinder/backup/drivers/swift.py:300}} Jul 03 09:40:30.497567 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.drivers.swift [None req-cbe01d26-c2ec-4bcc-9c76-1eea6e84e3a5 tempest-VolumesBackupsAdminTest-1500745506 None] Connect to https://10.4.3.95:8080/v1/AUTH_ in "per_user" mode {{(pid=101319) initialize /opt/stack/cinder/cinder/backup/drivers/swift.py:301}} Jul 03 09:40:30.498705 np0000004400 cinder-backup[101319]: DEBUG os_brick.utils [None req-cbe01d26-c2ec-4bcc-9c76-1eea6e84e3a5 tempest-VolumesBackupsAdminTest-1500745506 None] ==> get_connector_properties: call "{'root_helper': 'sudo cinder-rootwrap /etc/cinder/rootwrap.conf', 'my_ip': '10.4.3.95', 'multipath': False, 'enforce_multipath': False, 'host': None, 'execute': None}" {{(pid=101319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}} Jul 03 09:40:30.512766 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.scaleio [None req-cbe01d26-c2ec-4bcc-9c76-1eea6e84e3a5 tempest-VolumesBackupsAdminTest-1500745506 None] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=101319) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}} Jul 03 09:40:30.540521 np0000004400 cinder-backup[101319]: DEBUG oslo_concurrency.processutils [None req-cbe01d26-c2ec-4bcc-9c76-1eea6e84e3a5 tempest-VolumesBackupsAdminTest-1500745506 None] Running cmd (subprocess): nvme version {{(pid=101319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 09:40:30.555537 np0000004400 cinder-backup[101319]: DEBUG oslo_concurrency.processutils [None req-cbe01d26-c2ec-4bcc-9c76-1eea6e84e3a5 tempest-VolumesBackupsAdminTest-1500745506 None] 'nvme version' failed. Not Retrying. {{(pid=101319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 03 09:40:30.555971 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.nvmeof [None req-cbe01d26-c2ec-4bcc-9c76-1eea6e84e3a5 tempest-VolumesBackupsAdminTest-1500745506 None] nvme not present on system {{(pid=101319) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}} Jul 03 09:40:30.564822 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.lightos [None req-cbe01d26-c2ec-4bcc-9c76-1eea6e84e3a5 tempest-VolumesBackupsAdminTest-1500745506 None] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=101319) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}} Jul 03 09:40:30.567114 np0000004400 cinder-backup[101319]: INFO os_brick.initiator.connectors.lightos [None req-cbe01d26-c2ec-4bcc-9c76-1eea6e84e3a5 tempest-VolumesBackupsAdminTest-1500745506 None] Current host hostNQN and IP(s) are ['10.4.3.95', 'fe80::f816:3eff:fe47:268c', '192.168.40.6', 'fe80::f816:3eff:febf:7be2', '192.168.50.6', 'fe80::f816:3eff:fe99:8914', '192.168.10.6', 'fe80::f816:3eff:fe2f:e696', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::bc9d:84ff:fec2:6b49', 'fe80::fc16:3eff:fe72:8d5f', 'fe80::48a4:5fff:fedc:623c', 'fe80::fc16:3eff:fe7d:3947', 'fe80::18ab:2bff:fec0:3e86', 'fe80::fc16:3eff:fe07:4fd3', 'fe80::fc16:3eff:fe55:ab5a', 'fe80::fc16:3eff:fe40:d27f', 'fe80::d40d:ceff:fe9a:c68', 'fe80::fc16:3eff:fe79:c063', 'fe80::fc16:3eff:feb1:3877', 'fe80::fc16:3eff:fe3b:aadc', 'fe80::fc16:3eff:fed1:b48d', 'fe80::fc16:3eff:feaf:44b9', 'fe80::fc16:3eff:feb2:bae', 'fe80::409f:6eff:fe5d:a18f', 'fe80::fc16:3eff:fe8b:b39b', 'fe80::f01e:65ff:febf:f9f6', 'fe80::a1:38ff:fe3d:434b', 'fe80::fc16:3eff:fe36:77bf', 'fe80::4c47:1ff:fe64:1879'] Jul 03 09:40:30.567267 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.lightos [None req-cbe01d26-c2ec-4bcc-9c76-1eea6e84e3a5 tempest-VolumesBackupsAdminTest-1500745506 None] LIGHTOS: did not find dsc, continuing anyway. {{(pid=101319) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}} Jul 03 09:40:30.567431 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.lightos [None req-cbe01d26-c2ec-4bcc-9c76-1eea6e84e3a5 tempest-VolumesBackupsAdminTest-1500745506 None] LIGHTOS: no hostnqn found. {{(pid=101319) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}} Jul 03 09:40:30.567739 np0000004400 cinder-backup[101319]: DEBUG os_brick.utils [None req-cbe01d26-c2ec-4bcc-9c76-1eea6e84e3a5 tempest-VolumesBackupsAdminTest-1500745506 None] <== get_connector_properties: return (68ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.95', 'host': 'np0000004400', 'multipath': False, 'enforce_multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:ae7e5bb0ebe6', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': '6b284368-d0ba-4d18-af6f-4998d3955c52', 'nvme_native_multipath': False} {{(pid=101319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}} Jul 03 09:40:31.072490 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connector [None req-cbe01d26-c2ec-4bcc-9c76-1eea6e84e3a5 tempest-VolumesBackupsAdminTest-1500745506 None] Factory for iscsi on None {{(pid=101319) factory /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connector.py:243}} Jul 03 09:40:31.072964 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-cbe01d26-c2ec-4bcc-9c76-1eea6e84e3a5 tempest-VolumesBackupsAdminTest-1500745506 None] ==> connect_volume: call "{'self': , 'connection_properties': {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-43d877b9-de99-46f9-9e3b-e0fb13a3b4d7', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '43d877b9-de99-46f9-9e3b-e0fb13a3b4d7', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': False}}" {{(pid=101319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}} Jul 03 09:40:31.073141 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.base [None req-cbe01d26-c2ec-4bcc-9c76-1eea6e84e3a5 tempest-VolumesBackupsAdminTest-1500745506 None] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=101319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jul 03 09:40:31.073705 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.base [None req-cbe01d26-c2ec-4bcc-9c76-1eea6e84e3a5 tempest-VolumesBackupsAdminTest-1500745506 None] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=101319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jul 03 09:40:31.073996 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.base [None req-cbe01d26-c2ec-4bcc-9c76-1eea6e84e3a5 tempest-VolumesBackupsAdminTest-1500745506 None] Connection properties {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-43d877b9-de99-46f9-9e3b-e0fb13a3b4d7', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '43d877b9-de99-46f9-9e3b-e0fb13a3b4d7', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': False} {{(pid=101319) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}} Jul 03 09:40:31.086233 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.base [None req-cbe01d26-c2ec-4bcc-9c76-1eea6e84e3a5 tempest-VolumesBackupsAdminTest-1500745506 None] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-43d877b9-de99-46f9-9e3b-e0fb13a3b4d7" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=101319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jul 03 09:40:31.086706 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.base [None req-cbe01d26-c2ec-4bcc-9c76-1eea6e84e3a5 tempest-VolumesBackupsAdminTest-1500745506 None] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-43d877b9-de99-46f9-9e3b-e0fb13a3b4d7" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=101319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jul 03 09:40:31.086919 np0000004400 cinder-backup[101319]: INFO os_brick.initiator.connectors.iscsi [None req-cbe01d26-c2ec-4bcc-9c76-1eea6e84e3a5 tempest-VolumesBackupsAdminTest-1500745506 None] Trying to connect to iSCSI portal 192.168.40.100:3260 Jul 03 09:40:31.100514 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-cbe01d26-c2ec-4bcc-9c76-1eea6e84e3a5 tempest-VolumesBackupsAdminTest-1500745506 None] iscsiadm (): stdout= stderr=iscsiadm: No records found Jul 03 09:40:31.100514 np0000004400 cinder-backup[101319]: {{(pid=101319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 03 09:40:31.113080 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-cbe01d26-c2ec-4bcc-9c76-1eea6e84e3a5 tempest-VolumesBackupsAdminTest-1500745506 None] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-43d877b9-de99-46f9-9e3b-e0fb13a3b4d7] added Jul 03 09:40:31.113080 np0000004400 cinder-backup[101319]: stderr=iscsiadm: Config file line 363 does not have value Jul 03 09:40:31.113080 np0000004400 cinder-backup[101319]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs' Jul 03 09:40:31.113080 np0000004400 cinder-backup[101319]: iscsiadm: Config file line 363 does not have value Jul 03 09:40:31.113080 np0000004400 cinder-backup[101319]: iscsiadm: Config file line 363 does not have value Jul 03 09:40:31.113080 np0000004400 cinder-backup[101319]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs' Jul 03 09:40:31.113080 np0000004400 cinder-backup[101319]: {{(pid=101319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 03 09:40:31.113294 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-cbe01d26-c2ec-4bcc-9c76-1eea6e84e3a5 tempest-VolumesBackupsAdminTest-1500745506 None] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=101319) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}} Jul 03 09:40:31.113854 np0000004400 cinder-backup[101319]: DEBUG os_brick.utils [None req-cbe01d26-c2ec-4bcc-9c76-1eea6e84e3a5 tempest-VolumesBackupsAdminTest-1500745506 None] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0267(s), this was the 1st time calling it. {{(pid=101319) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}} Jul 03 09:40:31.114152 np0000004400 cinder-backup[101319]: DEBUG os_brick.utils [None req-cbe01d26-c2ec-4bcc-9c76-1eea6e84e3a5 tempest-VolumesBackupsAdminTest-1500745506 None] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=101319) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}} Jul 03 09:40:32.115106 np0000004400 cinder-backup[101319]: INFO os_brick.initiator.connectors.iscsi [None req-cbe01d26-c2ec-4bcc-9c76-1eea6e84e3a5 tempest-VolumesBackupsAdminTest-1500745506 None] Trying to connect to iSCSI portal 192.168.40.100:3260 Jul 03 09:40:32.128584 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-cbe01d26-c2ec-4bcc-9c76-1eea6e84e3a5 tempest-VolumesBackupsAdminTest-1500745506 None] iscsiadm (): stdout=# BEGIN RECORD 2.1.9 Jul 03 09:40:32.128584 np0000004400 cinder-backup[101319]: node.name = iqn.2023-03.storpool.com:os--volume-43d877b9-de99-46f9-9e3b-e0fb13a3b4d7 Jul 03 09:40:32.128584 np0000004400 cinder-backup[101319]: node.tpgt = -1 Jul 03 09:40:32.128584 np0000004400 cinder-backup[101319]: node.startup = manual Jul 03 09:40:32.128584 np0000004400 cinder-backup[101319]: node.leading_login = No Jul 03 09:40:32.128584 np0000004400 cinder-backup[101319]: iface.iscsi_ifacename = default Jul 03 09:40:32.128584 np0000004400 cinder-backup[101319]: iface.net_ifacename = Jul 03 09:40:32.128584 np0000004400 cinder-backup[101319]: iface.ipaddress = Jul 03 09:40:32.128584 np0000004400 cinder-backup[101319]: iface.prefix_len = 0 Jul 03 09:40:32.128584 np0000004400 cinder-backup[101319]: iface.hwaddress = Jul 03 09:40:32.128584 np0000004400 cinder-backup[101319]: iface.transport_name = tcp Jul 03 09:40:32.128584 np0000004400 cinder-backup[101319]: iface.initiatorname = Jul 03 09:40:32.128584 np0000004400 cinder-backup[101319]: iface.state = Jul 03 09:40:32.128584 np0000004400 cinder-backup[101319]: iface.vlan_id = 0 Jul 03 09:40:32.128584 np0000004400 cinder-backup[101319]: iface.vlan_priority = 0 Jul 03 09:40:32.128584 np0000004400 cinder-backup[101319]: iface.vlan_state = Jul 03 09:40:32.128584 np0000004400 cinder-backup[101319]: iface.iface_num = 0 Jul 03 09:40:32.128584 np0000004400 cinder-backup[101319]: iface.mtu = 0 Jul 03 09:40:32.128584 np0000004400 cinder-backup[101319]: iface.port = 0 Jul 03 09:40:32.128584 np0000004400 cinder-backup[101319]: iface.bootproto = Jul 03 09:40:32.128584 np0000004400 cinder-backup[101319]: iface.subnet_mask = Jul 03 09:40:32.128584 np0000004400 cinder-backup[101319]: iface.gateway = Jul 03 09:40:32.128584 np0000004400 cinder-backup[101319]: iface.dhcp_alt_client_id_state = Jul 03 09:40:32.128584 np0000004400 cinder-backup[101319]: iface.dhcp_alt_client_id = Jul 03 09:40:32.128584 np0000004400 cinder-backup[101319]: iface.dhcp_dns = Jul 03 09:40:32.128584 np0000004400 cinder-backup[101319]: iface.dhcp_learn_iqn = Jul 03 09:40:32.128584 np0000004400 cinder-backup[101319]: iface.dhcp_req_vendor_id_state = Jul 03 09:40:32.128584 np0000004400 cinder-backup[101319]: iface.dhcp_vendor_id_state = Jul 03 09:40:32.128584 np0000004400 cinder-backup[101319]: iface.dhcp_vendor_id = Jul 03 09:40:32.128584 np0000004400 cinder-backup[101319]: iface.dhcp_slp_da = Jul 03 09:40:32.128584 np0000004400 cinder-backup[101319]: iface.fragmentation = Jul 03 09:40:32.128584 np0000004400 cinder-backup[101319]: iface.gratuitous_arp = Jul 03 09:40:32.128584 np0000004400 cinder-backup[101319]: iface.incoming_forwarding = Jul 03 09:40:32.128584 np0000004400 cinder-backup[101319]: iface.tos_state = Jul 03 09:40:32.128584 np0000004400 cinder-backup[101319]: iface.tos = 0 Jul 03 09:40:32.128584 np0000004400 cinder-backup[101319]: iface.ttl = 0 Jul 03 09:40:32.128584 np0000004400 cinder-backup[101319]: iface.delayed_ack = Jul 03 09:40:32.128584 np0000004400 cinder-backup[101319]: iface.tcp_nagle = Jul 03 09:40:32.128584 np0000004400 cinder-backup[101319]: iface.tcp_wsf_state = Jul 03 09:40:32.128584 np0000004400 cinder-backup[101319]: iface.tcp_wsf = 0 Jul 03 09:40:32.128584 np0000004400 cinder-backup[101319]: iface.tcp_timer_scale = 0 Jul 03 09:40:32.128584 np0000004400 cinder-backup[101319]: iface.tcp_timestamp = Jul 03 09:40:32.128584 np0000004400 cinder-backup[101319]: iface.redirect = Jul 03 09:40:32.128584 np0000004400 cinder-backup[101319]: iface.def_task_mgmt_timeout = 0 Jul 03 09:40:32.128584 np0000004400 cinder-backup[101319]: iface.header_digest = Jul 03 09:40:32.128584 np0000004400 cinder-backup[101319]: iface.data_digest = Jul 03 09:40:32.128584 np0000004400 cinder-backup[101319]: iface.immediate_data = Jul 03 09:40:32.128584 np0000004400 cinder-backup[101319]: iface.initial_r2t = Jul 03 09:40:32.128584 np0000004400 cinder-backup[101319]: iface.data_seq_inorder = Jul 03 09:40:32.128584 np0000004400 cinder-backup[101319]: iface.data_pdu_inorder = Jul 03 09:40:32.128584 np0000004400 cinder-backup[101319]: iface.erl = 0 Jul 03 09:40:32.128584 np0000004400 cinder-backup[101319]: iface.max_receive_data_len = 0 Jul 03 09:40:32.128584 np0000004400 cinder-backup[101319]: iface.first_burst_len = 0 Jul 03 09:40:32.128584 np0000004400 cinder-backup[101319]: iface.max_outstanding_r2t = 0 Jul 03 09:40:32.128584 np0000004400 cinder-backup[101319]: iface.max_burst_len = 0 Jul 03 09:40:32.128584 np0000004400 cinder-backup[101319]: iface.chap_auth = Jul 03 09:40:32.128584 np0000004400 cinder-backup[101319]: iface.bidi_chap = Jul 03 09:40:32.128584 np0000004400 cinder-backup[101319]: iface.strict_login_compliance = Jul 03 09:40:32.128584 np0000004400 cinder-backup[101319]: iface.discovery_auth = Jul 03 09:40:32.128584 np0000004400 cinder-backup[101319]: iface.discovery_logout = Jul 03 09:40:32.128584 np0000004400 cinder-backup[101319]: node.discovery_address = Jul 03 09:40:32.128584 np0000004400 cinder-backup[101319]: node.discovery_port = 0 Jul 03 09:40:32.128584 np0000004400 cinder-backup[101319]: node.discovery_type = fw Jul 03 09:40:32.128584 np0000004400 cinder-backup[101319]: node.session.initial_cmdsn = 0 Jul 03 09:40:32.128584 np0000004400 cinder-backup[101319]: node.session.initial_login_retry_max = 8 Jul 03 09:40:32.128584 np0000004400 cinder-backup[101319]: node.session.xmit_thread_priority = 0 Jul 03 09:40:32.128584 np0000004400 cinder-backup[101319]: node.session.cmds_max = 128 Jul 03 09:40:32.128584 np0000004400 cinder-backup[101319]: node.session.queue_depth = 32 Jul 03 09:40:32.128584 np0000004400 cinder-backup[101319]: node.session.nr_sessions = 1 Jul 03 09:40:32.128584 np0000004400 cinder-backup[101319]: node.session.auth.authmethod = None Jul 03 09:40:32.128584 np0000004400 cinder-backup[101319]: node.session.auth.username = Jul 03 09:40:32.128584 np0000004400 cinder-backup[101319]: node.session.auth.password = *** Jul 03 09:40:32.128584 np0000004400 cinder-backup[101319]: node.session.auth.username_in = Jul 03 09:40:32.128584 np0000004400 cinder-backup[101319]: node.session.auth.password_in = Jul 03 09:40:32.128584 np0000004400 cinder-backup[101319]: node.session.auth.chap_algs = SHA256 Jul 03 09:40:32.128584 np0000004400 cinder-backup[101319]: node.session.timeo.replacement_timeout = 120 Jul 03 09:40:32.128584 np0000004400 cinder-backup[101319]: node.session.err_timeo.abort_timeout = 15 Jul 03 09:40:32.128584 np0000004400 cinder-backup[101319]: node.session.err_timeo.lu_reset_timeout = 30 Jul 03 09:40:32.128584 np0000004400 cinder-backup[101319]: node.session.err_timeo.tgt_reset_timeout = 30 Jul 03 09:40:32.128584 np0000004400 cinder-backup[101319]: node.session.err_timeo.host_reset_timeout = 60 Jul 03 09:40:32.128584 np0000004400 cinder-backup[101319]: node.session.iscsi.FastAbort = Yes Jul 03 09:40:32.128584 np0000004400 cinder-backup[101319]: node.session.iscsi.InitialR2T = No Jul 03 09:40:32.128584 np0000004400 cinder-backup[101319]: node.session.iscsi.ImmediateData = Yes Jul 03 09:40:32.128584 np0000004400 cinder-backup[101319]: node.session.iscsi.FirstBurstLength = 262144 Jul 03 09:40:32.128584 np0000004400 cinder-backup[101319]: node.session.iscsi.MaxBurstLength = 16776192 Jul 03 09:40:32.128584 np0000004400 cinder-backup[101319]: node.session.iscsi.DefaultTime2Retain = 0 Jul 03 09:40:32.128584 np0000004400 cinder-backup[101319]: node.session.iscsi.DefaultTime2Wait = 2 Jul 03 09:40:32.128584 np0000004400 cinder-backup[101319]: node.session.iscsi.MaxConnections = 1 Jul 03 09:40:32.128584 np0000004400 cinder-backup[101319]: node.session.iscsi.MaxOutstandingR2T = 1 Jul 03 09:40:32.128584 np0000004400 cinder-backup[101319]: node.session.iscsi.ERL = 0 Jul 03 09:40:32.128584 np0000004400 cinder-backup[101319]: node.session.scan = auto Jul 03 09:40:32.128584 np0000004400 cinder-backup[101319]: node.session.reopen_max = 0 Jul 03 09:40:32.128584 np0000004400 cinder-backup[101319]: node.conn[0].address = 192.168.40.100 Jul 03 09:40:32.128584 np0000004400 cinder-backup[101319]: node.conn[0].port = 3260 Jul 03 09:40:32.128584 np0000004400 cinder-backup[101319]: node.conn[0].startup = manual Jul 03 09:40:32.128584 np0000004400 cinder-backup[101319]: node.conn[0].tcp.window_size = 524288 Jul 03 09:40:32.128584 np0000004400 cinder-backup[101319]: node.conn[0].tcp.type_of_service = 0 Jul 03 09:40:32.128584 np0000004400 cinder-backup[101319]: node.conn[0].timeo.logout_timeout = 15 Jul 03 09:40:32.128584 np0000004400 cinder-backup[101319]: node.conn[0].timeo.login_timeout = 15 Jul 03 09:40:32.128584 np0000004400 cinder-backup[101319]: node.conn[0].timeo.auth_timeout = 45 Jul 03 09:40:32.128584 np0000004400 cinder-backup[101319]: node.conn[0].timeo.noop_out_interval = 5 Jul 03 09:40:32.128584 np0000004400 cinder-backup[101319]: node.conn[0].timeo.noop_out_timeout = 5 Jul 03 09:40:32.128584 np0000004400 cinder-backup[101319]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0 Jul 03 09:40:32.128584 np0000004400 cinder-backup[101319]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144 Jul 03 09:40:32.128584 np0000004400 cinder-backup[101319]: node.conn[0].iscsi.HeaderDigest = None Jul 03 09:40:32.128584 np0000004400 cinder-backup[101319]: node.conn[0].iscsi.DataDigest = None Jul 03 09:40:32.128584 np0000004400 cinder-backup[101319]: node.conn[0].iscsi.IFMarker = No Jul 03 09:40:32.128584 np0000004400 cinder-backup[101319]: node.conn[0].iscsi.OFMarker = No Jul 03 09:40:32.128584 np0000004400 cinder-backup[101319]: # END RECORD Jul 03 09:40:32.128584 np0000004400 cinder-backup[101319]: stderr= {{(pid=101319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 03 09:40:32.144896 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-cbe01d26-c2ec-4bcc-9c76-1eea6e84e3a5 tempest-VolumesBackupsAdminTest-1500745506 None] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=101319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 03 09:40:32.164495 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-cbe01d26-c2ec-4bcc-9c76-1eea6e84e3a5 tempest-VolumesBackupsAdminTest-1500745506 None] iscsiadm ('-m', 'session'): stdout=tcp: [33] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2cb23c9f-fd1d-4ffa-b027-28faa3d99f1d (non-flash) Jul 03 09:40:32.164495 np0000004400 cinder-backup[101319]: tcp: [34] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2cb23c9f-fd1d-4ffa-b027-28faa3d99f1d (non-flash) Jul 03 09:40:32.164495 np0000004400 cinder-backup[101319]: tcp: [40] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b5c70aaf-10ec-45f7-bd9f-756a91fe1d65 (non-flash) Jul 03 09:40:32.164495 np0000004400 cinder-backup[101319]: tcp: [41] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b5c70aaf-10ec-45f7-bd9f-756a91fe1d65 (non-flash) Jul 03 09:40:32.164495 np0000004400 cinder-backup[101319]: tcp: [42] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ef51248d-f155-43cd-afa0-8b0f72368a43 (non-flash) Jul 03 09:40:32.164495 np0000004400 cinder-backup[101319]: tcp: [43] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ef51248d-f155-43cd-afa0-8b0f72368a43 (non-flash) Jul 03 09:40:32.164495 np0000004400 cinder-backup[101319]: tcp: [45] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1b2d367e-5e69-4f28-ba33-80946ae8636f (non-flash) Jul 03 09:40:32.164495 np0000004400 cinder-backup[101319]: tcp: [46] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1b2d367e-5e69-4f28-ba33-80946ae8636f (non-flash) Jul 03 09:40:32.164495 np0000004400 cinder-backup[101319]: tcp: [49] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b2e4f10c-8033-4c54-95a1-dfe45d6357a3 (non-flash) Jul 03 09:40:32.164495 np0000004400 cinder-backup[101319]: tcp: [50] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b2e4f10c-8033-4c54-95a1-dfe45d6357a3 (non-flash) Jul 03 09:40:32.164495 np0000004400 cinder-backup[101319]: stderr= {{(pid=101319) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jul 03 09:40:32.165118 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-cbe01d26-c2ec-4bcc-9c76-1eea6e84e3a5 tempest-VolumesBackupsAdminTest-1500745506 None] iscsi session list stdout=tcp: [33] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2cb23c9f-fd1d-4ffa-b027-28faa3d99f1d (non-flash) Jul 03 09:40:32.165118 np0000004400 cinder-backup[101319]: tcp: [34] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2cb23c9f-fd1d-4ffa-b027-28faa3d99f1d (non-flash) Jul 03 09:40:32.165118 np0000004400 cinder-backup[101319]: tcp: [40] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b5c70aaf-10ec-45f7-bd9f-756a91fe1d65 (non-flash) Jul 03 09:40:32.165118 np0000004400 cinder-backup[101319]: tcp: [41] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b5c70aaf-10ec-45f7-bd9f-756a91fe1d65 (non-flash) Jul 03 09:40:32.165118 np0000004400 cinder-backup[101319]: tcp: [42] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ef51248d-f155-43cd-afa0-8b0f72368a43 (non-flash) Jul 03 09:40:32.165118 np0000004400 cinder-backup[101319]: tcp: [43] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ef51248d-f155-43cd-afa0-8b0f72368a43 (non-flash) Jul 03 09:40:32.165118 np0000004400 cinder-backup[101319]: tcp: [45] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1b2d367e-5e69-4f28-ba33-80946ae8636f (non-flash) Jul 03 09:40:32.165118 np0000004400 cinder-backup[101319]: tcp: [46] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1b2d367e-5e69-4f28-ba33-80946ae8636f (non-flash) Jul 03 09:40:32.165118 np0000004400 cinder-backup[101319]: tcp: [49] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b2e4f10c-8033-4c54-95a1-dfe45d6357a3 (non-flash) Jul 03 09:40:32.165118 np0000004400 cinder-backup[101319]: tcp: [50] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b2e4f10c-8033-4c54-95a1-dfe45d6357a3 (non-flash) Jul 03 09:40:32.165118 np0000004400 cinder-backup[101319]: stderr= {{(pid=101319) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jul 03 09:40:32.227394 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-cbe01d26-c2ec-4bcc-9c76-1eea6e84e3a5 tempest-VolumesBackupsAdminTest-1500745506 None] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-43d877b9-de99-46f9-9e3b-e0fb13a3b4d7, portal: 192.168.40.100,3260] Jul 03 09:40:32.227394 np0000004400 cinder-backup[101319]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-43d877b9-de99-46f9-9e3b-e0fb13a3b4d7, portal: 192.168.40.100,3260] successful. Jul 03 09:40:32.227394 np0000004400 cinder-backup[101319]: stderr= {{(pid=101319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 03 09:40:32.240962 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-cbe01d26-c2ec-4bcc-9c76-1eea6e84e3a5 tempest-VolumesBackupsAdminTest-1500745506 None] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=101319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 03 09:40:32.263462 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-cbe01d26-c2ec-4bcc-9c76-1eea6e84e3a5 tempest-VolumesBackupsAdminTest-1500745506 None] iscsiadm ('-m', 'session'): stdout=tcp: [33] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2cb23c9f-fd1d-4ffa-b027-28faa3d99f1d (non-flash) Jul 03 09:40:32.263462 np0000004400 cinder-backup[101319]: tcp: [34] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2cb23c9f-fd1d-4ffa-b027-28faa3d99f1d (non-flash) Jul 03 09:40:32.263462 np0000004400 cinder-backup[101319]: tcp: [40] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b5c70aaf-10ec-45f7-bd9f-756a91fe1d65 (non-flash) Jul 03 09:40:32.263462 np0000004400 cinder-backup[101319]: tcp: [41] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b5c70aaf-10ec-45f7-bd9f-756a91fe1d65 (non-flash) Jul 03 09:40:32.263462 np0000004400 cinder-backup[101319]: tcp: [42] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ef51248d-f155-43cd-afa0-8b0f72368a43 (non-flash) Jul 03 09:40:32.263462 np0000004400 cinder-backup[101319]: tcp: [43] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ef51248d-f155-43cd-afa0-8b0f72368a43 (non-flash) Jul 03 09:40:32.263462 np0000004400 cinder-backup[101319]: tcp: [45] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1b2d367e-5e69-4f28-ba33-80946ae8636f (non-flash) Jul 03 09:40:32.263462 np0000004400 cinder-backup[101319]: tcp: [46] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1b2d367e-5e69-4f28-ba33-80946ae8636f (non-flash) Jul 03 09:40:32.263462 np0000004400 cinder-backup[101319]: tcp: [49] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b2e4f10c-8033-4c54-95a1-dfe45d6357a3 (non-flash) Jul 03 09:40:32.263462 np0000004400 cinder-backup[101319]: tcp: [50] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b2e4f10c-8033-4c54-95a1-dfe45d6357a3 (non-flash) Jul 03 09:40:32.263462 np0000004400 cinder-backup[101319]: tcp: [51] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-43d877b9-de99-46f9-9e3b-e0fb13a3b4d7 (non-flash) Jul 03 09:40:32.263462 np0000004400 cinder-backup[101319]: stderr= {{(pid=101319) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jul 03 09:40:32.263462 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-cbe01d26-c2ec-4bcc-9c76-1eea6e84e3a5 tempest-VolumesBackupsAdminTest-1500745506 None] iscsi session list stdout=tcp: [33] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2cb23c9f-fd1d-4ffa-b027-28faa3d99f1d (non-flash) Jul 03 09:40:32.263462 np0000004400 cinder-backup[101319]: tcp: [34] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2cb23c9f-fd1d-4ffa-b027-28faa3d99f1d (non-flash) Jul 03 09:40:32.263462 np0000004400 cinder-backup[101319]: tcp: [40] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b5c70aaf-10ec-45f7-bd9f-756a91fe1d65 (non-flash) Jul 03 09:40:32.263462 np0000004400 cinder-backup[101319]: tcp: [41] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b5c70aaf-10ec-45f7-bd9f-756a91fe1d65 (non-flash) Jul 03 09:40:32.263462 np0000004400 cinder-backup[101319]: tcp: [42] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ef51248d-f155-43cd-afa0-8b0f72368a43 (non-flash) Jul 03 09:40:32.263462 np0000004400 cinder-backup[101319]: tcp: [43] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ef51248d-f155-43cd-afa0-8b0f72368a43 (non-flash) Jul 03 09:40:32.263462 np0000004400 cinder-backup[101319]: tcp: [45] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1b2d367e-5e69-4f28-ba33-80946ae8636f (non-flash) Jul 03 09:40:32.263462 np0000004400 cinder-backup[101319]: tcp: [46] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1b2d367e-5e69-4f28-ba33-80946ae8636f (non-flash) Jul 03 09:40:32.263462 np0000004400 cinder-backup[101319]: tcp: [49] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b2e4f10c-8033-4c54-95a1-dfe45d6357a3 (non-flash) Jul 03 09:40:32.263462 np0000004400 cinder-backup[101319]: tcp: [50] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b2e4f10c-8033-4c54-95a1-dfe45d6357a3 (non-flash) Jul 03 09:40:32.263462 np0000004400 cinder-backup[101319]: tcp: [51] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-43d877b9-de99-46f9-9e3b-e0fb13a3b4d7 (non-flash) Jul 03 09:40:32.263462 np0000004400 cinder-backup[101319]: stderr= {{(pid=101319) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jul 03 09:40:32.263462 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.base [None req-cbe01d26-c2ec-4bcc-9c76-1eea6e84e3a5 tempest-VolumesBackupsAdminTest-1500745506 None] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-43d877b9-de99-46f9-9e3b-e0fb13a3b4d7" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.176s {{(pid=101319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jul 03 09:40:32.263462 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-cbe01d26-c2ec-4bcc-9c76-1eea6e84e3a5 tempest-VolumesBackupsAdminTest-1500745506 None] Connected to 192.168.40.100:3260 {{(pid=101319) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}} Jul 03 09:40:32.265423 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.linuxscsi [None req-cbe01d26-c2ec-4bcc-9c76-1eea6e84e3a5 tempest-VolumesBackupsAdminTest-1500745506 None] HCTL ('7', '-', '-', 0) found on session 51 with lun 0 {{(pid=101319) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}} Jul 03 09:40:32.265618 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.linuxscsi [None req-cbe01d26-c2ec-4bcc-9c76-1eea6e84e3a5 tempest-VolumesBackupsAdminTest-1500745506 None] Scanning host 7 c: -, t: -, l: 0) {{(pid=101319) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}} Jul 03 09:40:32.284703 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.linuxscsi [None req-cbe01d26-c2ec-4bcc-9c76-1eea6e84e3a5 tempest-VolumesBackupsAdminTest-1500745506 None] Searching for a device in session 51 and hctl ['7', '*', '*', 0] yield: sdb {{(pid=101319) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}} Jul 03 09:40:32.284703 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-cbe01d26-c2ec-4bcc-9c76-1eea6e84e3a5 tempest-VolumesBackupsAdminTest-1500745506 None] Connected to sdb using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-43d877b9-de99-46f9-9e3b-e0fb13a3b4d7', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '43d877b9-de99-46f9-9e3b-e0fb13a3b4d7', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': False} {{(pid=101319) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}} Jul 03 09:40:33.288515 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.base [None req-cbe01d26-c2ec-4bcc-9c76-1eea6e84e3a5 tempest-VolumesBackupsAdminTest-1500745506 None] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 2.215s {{(pid=101319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jul 03 09:40:33.288986 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-cbe01d26-c2ec-4bcc-9c76-1eea6e84e3a5 tempest-VolumesBackupsAdminTest-1500745506 None] <== connect_volume: return (2215ms) {'type': 'block', 'scsi_wwn': '330000000424f9820', 'path': '/dev/sdb'} {{(pid=101319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}} Jul 03 09:40:33.289139 np0000004400 cinder-backup[101319]: DEBUG oslo_concurrency.processutils [None req-cbe01d26-c2ec-4bcc-9c76-1eea6e84e3a5 tempest-VolumesBackupsAdminTest-1500745506 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chown 1002 /dev/sdb {{(pid=101319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 09:40:33.306302 np0000004400 sudo[123458]: stack : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chown 1002 /dev/sdb Jul 03 09:40:33.306976 np0000004400 sudo[123458]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1002) Jul 03 09:40:33.676290 np0000004400 sudo[123458]: pam_unix(sudo:session): session closed for user root Jul 03 09:40:33.678944 np0000004400 cinder-backup[101319]: DEBUG oslo_concurrency.processutils [None req-cbe01d26-c2ec-4bcc-9c76-1eea6e84e3a5 tempest-VolumesBackupsAdminTest-1500745506 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chown 1002 /dev/sdb" returned: 0 in 0.389s {{(pid=101319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 09:40:33.743267 np0000004400 cinder-backup[101319]: DEBUG oslo_db.sqlalchemy.engines [None req-cbe01d26-c2ec-4bcc-9c76-1eea6e84e3a5 tempest-VolumesBackupsAdminTest-1500745506 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=101319) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 03 09:40:33.750955 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-cbe01d26-c2ec-4bcc-9c76-1eea6e84e3a5 tempest-VolumesBackupsAdminTest-1500745506 None] _create_container started, container: tempest-volumesbackupsadmintest-backup-container-1481520206,backup: 3b72dd02-bc01-459e-878b-586ab492372f. {{(pid=101319) _create_container /opt/stack/cinder/cinder/backup/chunkeddriver.py:249}} Jul 03 09:40:33.817926 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.drivers.swift [None req-cbe01d26-c2ec-4bcc-9c76-1eea6e84e3a5 tempest-VolumesBackupsAdminTest-1500745506 None] generate_object_name_prefix: volume_43d877b9-de99-46f9-9e3b-e0fb13a3b4d7/20260703094033/az_nova_backup_3b72dd02-bc01-459e-878b-586ab492372f {{(pid=101319) _generate_object_name_prefix /opt/stack/cinder/cinder/backup/drivers/swift.py:452}} Jul 03 09:40:33.824736 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-cbe01d26-c2ec-4bcc-9c76-1eea6e84e3a5 tempest-VolumesBackupsAdminTest-1500745506 None] starting backup of volume: 43d877b9-de99-46f9-9e3b-e0fb13a3b4d7, volume size: 1073741824, object names prefix volume_43d877b9-de99-46f9-9e3b-e0fb13a3b4d7/20260703094033/az_nova_backup_3b72dd02-bc01-459e-878b-586ab492372f, availability zone: nova {{(pid=101319) _prepare_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:359}} Jul 03 09:40:34.052996 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-cbe01d26-c2ec-4bcc-9c76-1eea6e84e3a5 tempest-VolumesBackupsAdminTest-1500745506 None] Backing up chunk of data from volume. {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 09:40:34.330794 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-cbe01d26-c2ec-4bcc-9c76-1eea6e84e3a5 tempest-VolumesBackupsAdminTest-1500745506 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101319) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 09:40:34.330794 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-cbe01d26-c2ec-4bcc-9c76-1eea6e84e3a5 tempest-VolumesBackupsAdminTest-1500745506 None] About to put_object {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 09:40:34.442989 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-cbe01d26-c2ec-4bcc-9c76-1eea6e84e3a5 tempest-VolumesBackupsAdminTest-1500745506 None] backup MD5 for volume_43d877b9-de99-46f9-9e3b-e0fb13a3b4d7/20260703094033/az_nova_backup_3b72dd02-bc01-459e-878b-586ab492372f-00001: 25e317773f308e446cc84c503a6d1f85 {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 09:40:34.444164 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-cbe01d26-c2ec-4bcc-9c76-1eea6e84e3a5 tempest-VolumesBackupsAdminTest-1500745506 None] Calling eventlet.sleep(0) {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 09:40:34.667619 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-cbe01d26-c2ec-4bcc-9c76-1eea6e84e3a5 tempest-VolumesBackupsAdminTest-1500745506 None] Backing up chunk of data from volume. {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 09:40:34.969731 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-cbe01d26-c2ec-4bcc-9c76-1eea6e84e3a5 tempest-VolumesBackupsAdminTest-1500745506 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101319) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 09:40:34.969858 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-cbe01d26-c2ec-4bcc-9c76-1eea6e84e3a5 tempest-VolumesBackupsAdminTest-1500745506 None] About to put_object {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 09:40:35.101085 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-cbe01d26-c2ec-4bcc-9c76-1eea6e84e3a5 tempest-VolumesBackupsAdminTest-1500745506 None] backup MD5 for volume_43d877b9-de99-46f9-9e3b-e0fb13a3b4d7/20260703094033/az_nova_backup_3b72dd02-bc01-459e-878b-586ab492372f-00002: 25e317773f308e446cc84c503a6d1f85 {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 09:40:35.101085 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-cbe01d26-c2ec-4bcc-9c76-1eea6e84e3a5 tempest-VolumesBackupsAdminTest-1500745506 None] Calling eventlet.sleep(0) {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 09:40:35.337301 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-cbe01d26-c2ec-4bcc-9c76-1eea6e84e3a5 tempest-VolumesBackupsAdminTest-1500745506 None] Backing up chunk of data from volume. {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 09:40:35.590318 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-cbe01d26-c2ec-4bcc-9c76-1eea6e84e3a5 tempest-VolumesBackupsAdminTest-1500745506 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101319) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 09:40:35.590318 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-cbe01d26-c2ec-4bcc-9c76-1eea6e84e3a5 tempest-VolumesBackupsAdminTest-1500745506 None] About to put_object {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 09:40:35.704334 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-cbe01d26-c2ec-4bcc-9c76-1eea6e84e3a5 tempest-VolumesBackupsAdminTest-1500745506 None] backup MD5 for volume_43d877b9-de99-46f9-9e3b-e0fb13a3b4d7/20260703094033/az_nova_backup_3b72dd02-bc01-459e-878b-586ab492372f-00003: 25e317773f308e446cc84c503a6d1f85 {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 09:40:35.705763 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-cbe01d26-c2ec-4bcc-9c76-1eea6e84e3a5 tempest-VolumesBackupsAdminTest-1500745506 None] Calling eventlet.sleep(0) {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 09:40:35.935787 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-cbe01d26-c2ec-4bcc-9c76-1eea6e84e3a5 tempest-VolumesBackupsAdminTest-1500745506 None] Backing up chunk of data from volume. {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 09:40:36.196981 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-cbe01d26-c2ec-4bcc-9c76-1eea6e84e3a5 tempest-VolumesBackupsAdminTest-1500745506 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101319) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 09:40:36.196981 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-cbe01d26-c2ec-4bcc-9c76-1eea6e84e3a5 tempest-VolumesBackupsAdminTest-1500745506 None] About to put_object {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 09:40:36.373717 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-cbe01d26-c2ec-4bcc-9c76-1eea6e84e3a5 tempest-VolumesBackupsAdminTest-1500745506 None] backup MD5 for volume_43d877b9-de99-46f9-9e3b-e0fb13a3b4d7/20260703094033/az_nova_backup_3b72dd02-bc01-459e-878b-586ab492372f-00004: 25e317773f308e446cc84c503a6d1f85 {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 09:40:36.374137 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-cbe01d26-c2ec-4bcc-9c76-1eea6e84e3a5 tempest-VolumesBackupsAdminTest-1500745506 None] Calling eventlet.sleep(0) {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 09:40:36.622817 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-cbe01d26-c2ec-4bcc-9c76-1eea6e84e3a5 tempest-VolumesBackupsAdminTest-1500745506 None] Backing up chunk of data from volume. {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 09:40:36.891123 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-cbe01d26-c2ec-4bcc-9c76-1eea6e84e3a5 tempest-VolumesBackupsAdminTest-1500745506 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101319) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 09:40:36.891359 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-cbe01d26-c2ec-4bcc-9c76-1eea6e84e3a5 tempest-VolumesBackupsAdminTest-1500745506 None] About to put_object {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 09:40:37.006441 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-cbe01d26-c2ec-4bcc-9c76-1eea6e84e3a5 tempest-VolumesBackupsAdminTest-1500745506 None] backup MD5 for volume_43d877b9-de99-46f9-9e3b-e0fb13a3b4d7/20260703094033/az_nova_backup_3b72dd02-bc01-459e-878b-586ab492372f-00005: 25e317773f308e446cc84c503a6d1f85 {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 09:40:37.006685 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-cbe01d26-c2ec-4bcc-9c76-1eea6e84e3a5 tempest-VolumesBackupsAdminTest-1500745506 None] Calling eventlet.sleep(0) {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 09:40:37.206428 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-cbe01d26-c2ec-4bcc-9c76-1eea6e84e3a5 tempest-VolumesBackupsAdminTest-1500745506 None] Backing up chunk of data from volume. {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 09:40:37.483328 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-cbe01d26-c2ec-4bcc-9c76-1eea6e84e3a5 tempest-VolumesBackupsAdminTest-1500745506 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101319) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 09:40:37.483676 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-cbe01d26-c2ec-4bcc-9c76-1eea6e84e3a5 tempest-VolumesBackupsAdminTest-1500745506 None] About to put_object {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 09:40:37.601431 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-cbe01d26-c2ec-4bcc-9c76-1eea6e84e3a5 tempest-VolumesBackupsAdminTest-1500745506 None] backup MD5 for volume_43d877b9-de99-46f9-9e3b-e0fb13a3b4d7/20260703094033/az_nova_backup_3b72dd02-bc01-459e-878b-586ab492372f-00006: 25e317773f308e446cc84c503a6d1f85 {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 09:40:37.601644 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-cbe01d26-c2ec-4bcc-9c76-1eea6e84e3a5 tempest-VolumesBackupsAdminTest-1500745506 None] Calling eventlet.sleep(0) {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 09:40:37.854122 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-cbe01d26-c2ec-4bcc-9c76-1eea6e84e3a5 tempest-VolumesBackupsAdminTest-1500745506 None] Backing up chunk of data from volume. {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 09:40:38.149381 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-cbe01d26-c2ec-4bcc-9c76-1eea6e84e3a5 tempest-VolumesBackupsAdminTest-1500745506 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101319) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 09:40:38.149615 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-cbe01d26-c2ec-4bcc-9c76-1eea6e84e3a5 tempest-VolumesBackupsAdminTest-1500745506 None] About to put_object {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 09:40:38.249050 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-cbe01d26-c2ec-4bcc-9c76-1eea6e84e3a5 tempest-VolumesBackupsAdminTest-1500745506 None] backup MD5 for volume_43d877b9-de99-46f9-9e3b-e0fb13a3b4d7/20260703094033/az_nova_backup_3b72dd02-bc01-459e-878b-586ab492372f-00007: 25e317773f308e446cc84c503a6d1f85 {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 09:40:38.249281 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-cbe01d26-c2ec-4bcc-9c76-1eea6e84e3a5 tempest-VolumesBackupsAdminTest-1500745506 None] Calling eventlet.sleep(0) {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 09:40:38.488758 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-cbe01d26-c2ec-4bcc-9c76-1eea6e84e3a5 tempest-VolumesBackupsAdminTest-1500745506 None] Backing up chunk of data from volume. {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 09:40:38.758055 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-cbe01d26-c2ec-4bcc-9c76-1eea6e84e3a5 tempest-VolumesBackupsAdminTest-1500745506 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101319) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 09:40:38.758327 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-cbe01d26-c2ec-4bcc-9c76-1eea6e84e3a5 tempest-VolumesBackupsAdminTest-1500745506 None] About to put_object {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 09:40:38.892038 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-cbe01d26-c2ec-4bcc-9c76-1eea6e84e3a5 tempest-VolumesBackupsAdminTest-1500745506 None] backup MD5 for volume_43d877b9-de99-46f9-9e3b-e0fb13a3b4d7/20260703094033/az_nova_backup_3b72dd02-bc01-459e-878b-586ab492372f-00008: 25e317773f308e446cc84c503a6d1f85 {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 09:40:38.892038 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-cbe01d26-c2ec-4bcc-9c76-1eea6e84e3a5 tempest-VolumesBackupsAdminTest-1500745506 None] Calling eventlet.sleep(0) {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 09:40:39.131450 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-cbe01d26-c2ec-4bcc-9c76-1eea6e84e3a5 tempest-VolumesBackupsAdminTest-1500745506 None] Backing up chunk of data from volume. {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 09:40:39.380061 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-cbe01d26-c2ec-4bcc-9c76-1eea6e84e3a5 tempest-VolumesBackupsAdminTest-1500745506 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101319) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 09:40:39.380061 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-cbe01d26-c2ec-4bcc-9c76-1eea6e84e3a5 tempest-VolumesBackupsAdminTest-1500745506 None] About to put_object {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 09:40:39.506640 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-cbe01d26-c2ec-4bcc-9c76-1eea6e84e3a5 tempest-VolumesBackupsAdminTest-1500745506 None] backup MD5 for volume_43d877b9-de99-46f9-9e3b-e0fb13a3b4d7/20260703094033/az_nova_backup_3b72dd02-bc01-459e-878b-586ab492372f-00009: 25e317773f308e446cc84c503a6d1f85 {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 09:40:39.506640 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-cbe01d26-c2ec-4bcc-9c76-1eea6e84e3a5 tempest-VolumesBackupsAdminTest-1500745506 None] Calling eventlet.sleep(0) {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 09:40:39.744706 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-cbe01d26-c2ec-4bcc-9c76-1eea6e84e3a5 tempest-VolumesBackupsAdminTest-1500745506 None] Backing up chunk of data from volume. {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 09:40:40.006697 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-cbe01d26-c2ec-4bcc-9c76-1eea6e84e3a5 tempest-VolumesBackupsAdminTest-1500745506 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101319) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 09:40:40.006909 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-cbe01d26-c2ec-4bcc-9c76-1eea6e84e3a5 tempest-VolumesBackupsAdminTest-1500745506 None] About to put_object {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 09:40:40.133941 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-cbe01d26-c2ec-4bcc-9c76-1eea6e84e3a5 tempest-VolumesBackupsAdminTest-1500745506 None] backup MD5 for volume_43d877b9-de99-46f9-9e3b-e0fb13a3b4d7/20260703094033/az_nova_backup_3b72dd02-bc01-459e-878b-586ab492372f-00010: 25e317773f308e446cc84c503a6d1f85 {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 09:40:40.134199 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-cbe01d26-c2ec-4bcc-9c76-1eea6e84e3a5 tempest-VolumesBackupsAdminTest-1500745506 None] Calling eventlet.sleep(0) {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 09:40:40.140679 np0000004400 cinder-backup[101319]: DEBUG oslo_service.periodic_task [None req-ffd932d2-122c-4e68-b5ba-628aff7ae7b8 None None] Running periodic task BackupManager.publish_service_capabilities {{(pid=101319) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 03 09:40:40.141330 np0000004400 cinder-backup[101319]: DEBUG cinder.manager [None req-ffd932d2-122c-4e68-b5ba-628aff7ae7b8 None None] Notifying Schedulers of capabilities ... {{(pid=101319) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 03 09:40:40.395665 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-cbe01d26-c2ec-4bcc-9c76-1eea6e84e3a5 tempest-VolumesBackupsAdminTest-1500745506 None] Backing up chunk of data from volume. {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 09:40:40.663177 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-cbe01d26-c2ec-4bcc-9c76-1eea6e84e3a5 tempest-VolumesBackupsAdminTest-1500745506 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101319) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 09:40:40.663746 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-cbe01d26-c2ec-4bcc-9c76-1eea6e84e3a5 tempest-VolumesBackupsAdminTest-1500745506 None] About to put_object {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 09:40:40.803696 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-cbe01d26-c2ec-4bcc-9c76-1eea6e84e3a5 tempest-VolumesBackupsAdminTest-1500745506 None] backup MD5 for volume_43d877b9-de99-46f9-9e3b-e0fb13a3b4d7/20260703094033/az_nova_backup_3b72dd02-bc01-459e-878b-586ab492372f-00011: 25e317773f308e446cc84c503a6d1f85 {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 09:40:40.803931 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-cbe01d26-c2ec-4bcc-9c76-1eea6e84e3a5 tempest-VolumesBackupsAdminTest-1500745506 None] Calling eventlet.sleep(0) {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 09:40:41.116154 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-cbe01d26-c2ec-4bcc-9c76-1eea6e84e3a5 tempest-VolumesBackupsAdminTest-1500745506 None] Backing up chunk of data from volume. {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 09:40:41.361903 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-cbe01d26-c2ec-4bcc-9c76-1eea6e84e3a5 tempest-VolumesBackupsAdminTest-1500745506 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101319) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 09:40:41.362060 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-cbe01d26-c2ec-4bcc-9c76-1eea6e84e3a5 tempest-VolumesBackupsAdminTest-1500745506 None] About to put_object {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 09:40:41.466906 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-cbe01d26-c2ec-4bcc-9c76-1eea6e84e3a5 tempest-VolumesBackupsAdminTest-1500745506 None] backup MD5 for volume_43d877b9-de99-46f9-9e3b-e0fb13a3b4d7/20260703094033/az_nova_backup_3b72dd02-bc01-459e-878b-586ab492372f-00012: 25e317773f308e446cc84c503a6d1f85 {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 09:40:41.467088 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-cbe01d26-c2ec-4bcc-9c76-1eea6e84e3a5 tempest-VolumesBackupsAdminTest-1500745506 None] Calling eventlet.sleep(0) {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 09:40:41.470753 np0000004400 cinder-backup[101319]: DEBUG dbcounter [-] [101319] Writing DB stats cinder:SELECT=94,cinder:UPDATE=25,cinder:INSERT=5 {{(pid=101319) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 03 09:40:41.691759 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-cbe01d26-c2ec-4bcc-9c76-1eea6e84e3a5 tempest-VolumesBackupsAdminTest-1500745506 None] Backing up chunk of data from volume. {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 09:40:41.946006 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-cbe01d26-c2ec-4bcc-9c76-1eea6e84e3a5 tempest-VolumesBackupsAdminTest-1500745506 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101319) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 09:40:41.946270 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-cbe01d26-c2ec-4bcc-9c76-1eea6e84e3a5 tempest-VolumesBackupsAdminTest-1500745506 None] About to put_object {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 09:40:42.055547 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-cbe01d26-c2ec-4bcc-9c76-1eea6e84e3a5 tempest-VolumesBackupsAdminTest-1500745506 None] backup MD5 for volume_43d877b9-de99-46f9-9e3b-e0fb13a3b4d7/20260703094033/az_nova_backup_3b72dd02-bc01-459e-878b-586ab492372f-00013: 25e317773f308e446cc84c503a6d1f85 {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 09:40:42.055788 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-cbe01d26-c2ec-4bcc-9c76-1eea6e84e3a5 tempest-VolumesBackupsAdminTest-1500745506 None] Calling eventlet.sleep(0) {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 09:40:42.323216 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-cbe01d26-c2ec-4bcc-9c76-1eea6e84e3a5 tempest-VolumesBackupsAdminTest-1500745506 None] Backing up chunk of data from volume. {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 09:40:42.589992 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-cbe01d26-c2ec-4bcc-9c76-1eea6e84e3a5 tempest-VolumesBackupsAdminTest-1500745506 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101319) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 09:40:42.591580 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-cbe01d26-c2ec-4bcc-9c76-1eea6e84e3a5 tempest-VolumesBackupsAdminTest-1500745506 None] About to put_object {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 09:40:42.699752 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-cbe01d26-c2ec-4bcc-9c76-1eea6e84e3a5 tempest-VolumesBackupsAdminTest-1500745506 None] backup MD5 for volume_43d877b9-de99-46f9-9e3b-e0fb13a3b4d7/20260703094033/az_nova_backup_3b72dd02-bc01-459e-878b-586ab492372f-00014: 25e317773f308e446cc84c503a6d1f85 {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 09:40:42.700134 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-cbe01d26-c2ec-4bcc-9c76-1eea6e84e3a5 tempest-VolumesBackupsAdminTest-1500745506 None] Calling eventlet.sleep(0) {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 09:40:42.919526 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-cbe01d26-c2ec-4bcc-9c76-1eea6e84e3a5 tempest-VolumesBackupsAdminTest-1500745506 None] Backing up chunk of data from volume. {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 09:40:43.444225 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-cbe01d26-c2ec-4bcc-9c76-1eea6e84e3a5 tempest-VolumesBackupsAdminTest-1500745506 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101319) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 09:40:43.444455 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-cbe01d26-c2ec-4bcc-9c76-1eea6e84e3a5 tempest-VolumesBackupsAdminTest-1500745506 None] About to put_object {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 09:40:43.548351 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-cbe01d26-c2ec-4bcc-9c76-1eea6e84e3a5 tempest-VolumesBackupsAdminTest-1500745506 None] backup MD5 for volume_43d877b9-de99-46f9-9e3b-e0fb13a3b4d7/20260703094033/az_nova_backup_3b72dd02-bc01-459e-878b-586ab492372f-00015: 25e317773f308e446cc84c503a6d1f85 {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 09:40:43.548514 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-cbe01d26-c2ec-4bcc-9c76-1eea6e84e3a5 tempest-VolumesBackupsAdminTest-1500745506 None] Calling eventlet.sleep(0) {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 09:40:43.790476 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-cbe01d26-c2ec-4bcc-9c76-1eea6e84e3a5 tempest-VolumesBackupsAdminTest-1500745506 None] Backing up chunk of data from volume. {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 09:40:44.311839 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-cbe01d26-c2ec-4bcc-9c76-1eea6e84e3a5 tempest-VolumesBackupsAdminTest-1500745506 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101319) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 09:40:44.312058 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-cbe01d26-c2ec-4bcc-9c76-1eea6e84e3a5 tempest-VolumesBackupsAdminTest-1500745506 None] About to put_object {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 09:40:44.418223 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-cbe01d26-c2ec-4bcc-9c76-1eea6e84e3a5 tempest-VolumesBackupsAdminTest-1500745506 None] backup MD5 for volume_43d877b9-de99-46f9-9e3b-e0fb13a3b4d7/20260703094033/az_nova_backup_3b72dd02-bc01-459e-878b-586ab492372f-00016: 25e317773f308e446cc84c503a6d1f85 {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 09:40:44.418387 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-cbe01d26-c2ec-4bcc-9c76-1eea6e84e3a5 tempest-VolumesBackupsAdminTest-1500745506 None] Calling eventlet.sleep(0) {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 09:40:44.626587 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-cbe01d26-c2ec-4bcc-9c76-1eea6e84e3a5 tempest-VolumesBackupsAdminTest-1500745506 None] Backing up chunk of data from volume. {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 09:40:44.886219 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-cbe01d26-c2ec-4bcc-9c76-1eea6e84e3a5 tempest-VolumesBackupsAdminTest-1500745506 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101319) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 09:40:44.886669 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-cbe01d26-c2ec-4bcc-9c76-1eea6e84e3a5 tempest-VolumesBackupsAdminTest-1500745506 None] About to put_object {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 09:40:44.990018 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-cbe01d26-c2ec-4bcc-9c76-1eea6e84e3a5 tempest-VolumesBackupsAdminTest-1500745506 None] backup MD5 for volume_43d877b9-de99-46f9-9e3b-e0fb13a3b4d7/20260703094033/az_nova_backup_3b72dd02-bc01-459e-878b-586ab492372f-00017: 25e317773f308e446cc84c503a6d1f85 {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 09:40:44.990163 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-cbe01d26-c2ec-4bcc-9c76-1eea6e84e3a5 tempest-VolumesBackupsAdminTest-1500745506 None] Calling eventlet.sleep(0) {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 09:40:45.213000 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-cbe01d26-c2ec-4bcc-9c76-1eea6e84e3a5 tempest-VolumesBackupsAdminTest-1500745506 None] Backing up chunk of data from volume. {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 09:40:45.468376 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-cbe01d26-c2ec-4bcc-9c76-1eea6e84e3a5 tempest-VolumesBackupsAdminTest-1500745506 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101319) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 09:40:45.468813 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-cbe01d26-c2ec-4bcc-9c76-1eea6e84e3a5 tempest-VolumesBackupsAdminTest-1500745506 None] About to put_object {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 09:40:45.596394 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-cbe01d26-c2ec-4bcc-9c76-1eea6e84e3a5 tempest-VolumesBackupsAdminTest-1500745506 None] backup MD5 for volume_43d877b9-de99-46f9-9e3b-e0fb13a3b4d7/20260703094033/az_nova_backup_3b72dd02-bc01-459e-878b-586ab492372f-00018: 25e317773f308e446cc84c503a6d1f85 {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 09:40:45.596609 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-cbe01d26-c2ec-4bcc-9c76-1eea6e84e3a5 tempest-VolumesBackupsAdminTest-1500745506 None] Calling eventlet.sleep(0) {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 09:40:45.808166 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-cbe01d26-c2ec-4bcc-9c76-1eea6e84e3a5 tempest-VolumesBackupsAdminTest-1500745506 None] Backing up chunk of data from volume. {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 09:40:46.075788 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-cbe01d26-c2ec-4bcc-9c76-1eea6e84e3a5 tempest-VolumesBackupsAdminTest-1500745506 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101319) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 09:40:46.076246 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-cbe01d26-c2ec-4bcc-9c76-1eea6e84e3a5 tempest-VolumesBackupsAdminTest-1500745506 None] About to put_object {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 09:40:46.200570 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-cbe01d26-c2ec-4bcc-9c76-1eea6e84e3a5 tempest-VolumesBackupsAdminTest-1500745506 None] backup MD5 for volume_43d877b9-de99-46f9-9e3b-e0fb13a3b4d7/20260703094033/az_nova_backup_3b72dd02-bc01-459e-878b-586ab492372f-00019: 25e317773f308e446cc84c503a6d1f85 {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 09:40:46.200727 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-cbe01d26-c2ec-4bcc-9c76-1eea6e84e3a5 tempest-VolumesBackupsAdminTest-1500745506 None] Calling eventlet.sleep(0) {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 09:40:46.426036 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-cbe01d26-c2ec-4bcc-9c76-1eea6e84e3a5 tempest-VolumesBackupsAdminTest-1500745506 None] Backing up chunk of data from volume. {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 09:40:46.702314 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-cbe01d26-c2ec-4bcc-9c76-1eea6e84e3a5 tempest-VolumesBackupsAdminTest-1500745506 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101319) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 09:40:46.702512 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-cbe01d26-c2ec-4bcc-9c76-1eea6e84e3a5 tempest-VolumesBackupsAdminTest-1500745506 None] About to put_object {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 09:40:46.821126 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-cbe01d26-c2ec-4bcc-9c76-1eea6e84e3a5 tempest-VolumesBackupsAdminTest-1500745506 None] backup MD5 for volume_43d877b9-de99-46f9-9e3b-e0fb13a3b4d7/20260703094033/az_nova_backup_3b72dd02-bc01-459e-878b-586ab492372f-00020: 25e317773f308e446cc84c503a6d1f85 {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 09:40:46.821363 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-cbe01d26-c2ec-4bcc-9c76-1eea6e84e3a5 tempest-VolumesBackupsAdminTest-1500745506 None] Calling eventlet.sleep(0) {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 09:40:46.956531 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-cbe01d26-c2ec-4bcc-9c76-1eea6e84e3a5 tempest-VolumesBackupsAdminTest-1500745506 None] Backing up chunk of data from volume. {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 09:40:47.110705 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-cbe01d26-c2ec-4bcc-9c76-1eea6e84e3a5 tempest-VolumesBackupsAdminTest-1500745506 None] Compressed 25165824 bytes of data to 24470 bytes using zlib. {{(pid=101319) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 09:40:47.111138 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-cbe01d26-c2ec-4bcc-9c76-1eea6e84e3a5 tempest-VolumesBackupsAdminTest-1500745506 None] About to put_object {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 09:40:47.209316 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-cbe01d26-c2ec-4bcc-9c76-1eea6e84e3a5 tempest-VolumesBackupsAdminTest-1500745506 None] backup MD5 for volume_43d877b9-de99-46f9-9e3b-e0fb13a3b4d7/20260703094033/az_nova_backup_3b72dd02-bc01-459e-878b-586ab492372f-00021: 77377273b0a4b61febdbf7bbf52b9db9 {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 09:40:47.209591 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-cbe01d26-c2ec-4bcc-9c76-1eea6e84e3a5 tempest-VolumesBackupsAdminTest-1500745506 None] Calling eventlet.sleep(0) {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 09:40:47.221220 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.driver [None req-cbe01d26-c2ec-4bcc-9c76-1eea6e84e3a5 tempest-VolumesBackupsAdminTest-1500745506 None] Getting metadata type 'volume-base-metadata' {{(pid=101319) _save_vol_base_meta /opt/stack/cinder/cinder/backup/driver.py:79}} Jul 03 09:40:47.228505 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.driver [None req-cbe01d26-c2ec-4bcc-9c76-1eea6e84e3a5 tempest-VolumesBackupsAdminTest-1500745506 None] Completed fetching metadata type 'volume-base-metadata' {{(pid=101319) _save_vol_base_meta /opt/stack/cinder/cinder/backup/driver.py:98}} Jul 03 09:40:47.228715 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.driver [None req-cbe01d26-c2ec-4bcc-9c76-1eea6e84e3a5 tempest-VolumesBackupsAdminTest-1500745506 None] Getting metadata type 'volume-metadata' {{(pid=101319) _save_vol_meta /opt/stack/cinder/cinder/backup/driver.py:109}} Jul 03 09:40:47.234256 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.driver [None req-cbe01d26-c2ec-4bcc-9c76-1eea6e84e3a5 tempest-VolumesBackupsAdminTest-1500745506 None] No metadata type 'volume-metadata' available {{(pid=101319) _save_vol_meta /opt/stack/cinder/cinder/backup/driver.py:123}} Jul 03 09:40:47.234596 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.driver [None req-cbe01d26-c2ec-4bcc-9c76-1eea6e84e3a5 tempest-VolumesBackupsAdminTest-1500745506 None] Getting metadata type 'volume-glance-metadata' {{(pid=101319) _save_vol_glance_meta /opt/stack/cinder/cinder/backup/driver.py:132}} Jul 03 09:40:47.239373 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.driver [None req-cbe01d26-c2ec-4bcc-9c76-1eea6e84e3a5 tempest-VolumesBackupsAdminTest-1500745506 None] No metadata type 'volume-glance-metadata' available {{(pid=101319) _save_vol_glance_meta /opt/stack/cinder/cinder/backup/driver.py:147}} Jul 03 09:40:47.239703 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-cbe01d26-c2ec-4bcc-9c76-1eea6e84e3a5 tempest-VolumesBackupsAdminTest-1500745506 None] _write_sha256file started, container name: tempest-volumesbackupsadmintest-backup-container-1481520206, sha256file filename: volume_43d877b9-de99-46f9-9e3b-e0fb13a3b4d7/20260703094033/az_nova_backup_3b72dd02-bc01-459e-878b-586ab492372f_sha256file. {{(pid=101319) _write_sha256file /opt/stack/cinder/cinder/backup/chunkeddriver.py:299}} Jul 03 09:40:47.341725 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-cbe01d26-c2ec-4bcc-9c76-1eea6e84e3a5 tempest-VolumesBackupsAdminTest-1500745506 None] _write_sha256file finished. {{(pid=101319) _write_sha256file /opt/stack/cinder/cinder/backup/chunkeddriver.py:315}} Jul 03 09:40:47.342470 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-cbe01d26-c2ec-4bcc-9c76-1eea6e84e3a5 tempest-VolumesBackupsAdminTest-1500745506 None] _write_metadata started, container name: tempest-volumesbackupsadmintest-backup-container-1481520206, metadata filename: volume_43d877b9-de99-46f9-9e3b-e0fb13a3b4d7/20260703094033/az_nova_backup_3b72dd02-bc01-459e-878b-586ab492372f_metadata. {{(pid=101319) _write_metadata /opt/stack/cinder/cinder/backup/chunkeddriver.py:276}} Jul 03 09:40:47.392766 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-cbe01d26-c2ec-4bcc-9c76-1eea6e84e3a5 tempest-VolumesBackupsAdminTest-1500745506 None] _write_metadata finished. Metadata: b'{\n "backup_description": null,\n "backup_id": "3b72dd02-bc01-459e-878b-586ab492372f",\n "backup_name": "tempest-VolumesBackupsAdminTest-Backup-1353460869",\n "created_at": "2026-07-03 09:40:30+00:00",\n "objects": [\n {\n "volume_43d877b9-de99-46f9-9e3b-e0fb13a3b4d7/20260703094033/az_nova_backup_3b72dd02-bc01-459e-878b-586ab492372f-00001": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 0\n }\n },\n {\n "volume_43d877b9-de99-46f9-9e3b-e0fb13a3b4d7/20260703094033/az_nova_backup_3b72dd02-bc01-459e-878b-586ab492372f-00002": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 52428800\n }\n },\n {\n "volume_43d877b9-de99-46f9-9e3b-e0fb13a3b4d7/20260703094033/az_nova_backup_3b72dd02-bc01-459e-878b-586ab492372f-00003": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 104857600\n }\n },\n {\n "volume_43d877b9-de99-46f9-9e3b-e0fb13a3b4d7/20260703094033/az_nova_backup_3b72dd02-bc01-459e-878b-586ab492372f-00004": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 157286400\n }\n },\n {\n "volume_43d877b9-de99-46f9-9e3b-e0fb13a3b4d7/20260703094033/az_nova_backup_3b72dd02-bc01-459e-878b-586ab492372f-00005": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 209715200\n }\n },\n {\n "volume_43d877b9-de99-46f9-9e3b-e0fb13a3b4d7/20260703094033/az_nova_backup_3b72dd02-bc01-459e-878b-586ab492372f-00006": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 262144000\n }\n },\n {\n "volume_43d877b9-de99-46f9-9e3b-e0fb13a3b4d7/20260703094033/az_nova_backup_3b72dd02-bc01-459e-878b-586ab492372f-00007": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 314572800\n }\n },\n {\n "volume_43d877b9-de99-46f9-9e3b-e0fb13a3b4d7/20260703094033/az_nova_backup_3b72dd02-bc01-459e-878b-586ab492372f-00008": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 367001600\n }\n },\n {\n "volume_43d877b9-de99-46f9-9e3b-e0fb13a3b4d7/20260703094033/az_nova_backup_3b72dd02-bc01-459e-878b-586ab492372f-00009": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 419430400\n }\n },\n {\n "volume_43d877b9-de99-46f9-9e3b-e0fb13a3b4d7/20260703094033/az_nova_backup_3b72dd02-bc01-459e-878b-586ab492372f-00010": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 471859200\n }\n },\n {\n "volume_43d877b9-de99-46f9-9e3b-e0fb13a3b4d7/20260703094033/az_nova_backup_3b72dd02-bc01-459e-878b-586ab492372f-00011": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 524288000\n }\n },\n {\n "volume_43d877b9-de99-46f9-9e3b-e0fb13a3b4d7/20260703094033/az_nova_backup_3b72dd02-bc01-459e-878b-586ab492372f-00012": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 576716800\n }\n },\n {\n "volume_43d877b9-de99-46f9-9e3b-e0fb13a3b4d7/20260703094033/az_nova_backup_3b72dd02-bc01-459e-878b-586ab492372f-00013": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 629145600\n }\n },\n {\n "volume_43d877b9-de99-46f9-9e3b-e0fb13a3b4d7/20260703094033/az_nova_backup_3b72dd02-bc01-459e-878b-586ab492372f-00014": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 681574400\n }\n },\n {\n "volume_43d877b9-de99-46f9-9e3b-e0fb13a3b4d7/20260703094033/az_nova_backup_3b72dd02-bc01-459e-878b-586ab492372f-00015": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 734003200\n }\n },\n {\n "volume_43d877b9-de99-46f9-9e3b-e0fb13a3b4d7/20260703094033/az_nova_backup_3b72dd02-bc01-459e-878b-586ab492372f-00016": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 786432000\n }\n },\n {\n "volume_43d877b9-de99-46f9-9e3b-e0fb13a3b4d7/20260703094033/az_nova_backup_3b72dd02-bc01-459e-878b-586ab492372f-00017": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 838860800\n }\n },\n {\n "volume_43d877b9-de99-46f9-9e3b-e0fb13a3b4d7/20260703094033/az_nova_backup_3b72dd02-bc01-459e-878b-586ab492372f-00018": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 891289600\n }\n },\n {\n "volume_43d877b9-de99-46f9-9e3b-e0fb13a3b4d7/20260703094033/az_nova_backup_3b72dd02-bc01-459e-878b-586ab492372f-00019": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 943718400\n }\n },\n {\n "volume_43d877b9-de99-46f9-9e3b-e0fb13a3b4d7/20260703094033/az_nova_backup_3b72dd02-bc01-459e-878b-586ab492372f-00020": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 996147200\n }\n },\n {\n "volume_43d877b9-de99-46f9-9e3b-e0fb13a3b4d7/20260703094033/az_nova_backup_3b72dd02-bc01-459e-878b-586ab492372f-00021": {\n "compression": "zlib",\n "length": 25165824,\n "md5": "77377273b0a4b61febdbf7bbf52b9db9",\n "offset": 1048576000\n }\n }\n ],\n "parent_id": null,\n "version": "1.0.0",\n "volume_id": "43d877b9-de99-46f9-9e3b-e0fb13a3b4d7",\n "volume_meta": "{\\"version\\": 2, \\"volume-base-metadata\\": {\\"id\\": \\"43d877b9-de99-46f9-9e3b-e0fb13a3b4d7\\", \\"_name_id\\": null, \\"use_quota\\": true, \\"ec2_id\\": null, \\"user_id\\": \\"356a534952b84c0680fa3b9655a0fc13\\", \\"project_id\\": \\"b25712a6deba4237b3d9f8f02bb54ed6\\", \\"snapshot_id\\": null, \\"cluster_name\\": null, \\"host\\": \\"np0000004400@storpool#default\\", \\"size\\": 1, \\"availability_zone\\": \\"nova\\", \\"status\\": \\"backing-up\\", \\"attach_status\\": \\"detached\\", \\"migration_status\\": null, \\"scheduled_at\\": \\"2026-07-03T09:40:29.000000\\", \\"launched_at\\": \\"2026-07-03T09:40:29.000000\\", \\"terminated_at\\": null, \\"display_name\\": \\"tempest-VolumesBackupsAdminTest-Volume-1319270691\\", \\"display_description\\": null, \\"provider_location\\": null, \\"provider_auth\\": null, \\"provider_geometry\\": null, \\"provider_id\\": null, \\"volume_type_id\\": \\"03e13fe6-0e30-4803-ace0-725d38e6dc24\\", \\"source_volid\\": null, \\"encryption_key_id\\": null, \\"consistencygroup_id\\": null, \\"group_id\\": null, \\"bootable\\": false, \\"multiattach\\": false, \\"replication_status\\": null, \\"replication_extended_status\\": null, \\"replication_driver_data\\": null, \\"previous_status\\": \\"available\\", \\"service_uuid\\": \\"6d4b0e79-fefe-4744-b25f-34be05095200\\", \\"shared_targets\\": true, \\"deleted_at\\": null, \\"deleted\\": false, \\"created_at\\": \\"2026-07-03T09:40:29.000000\\", \\"updated_at\\": \\"2026-07-03T09:40:30.000000\\"}}"\n}'. {{(pid=101319) _write_metadata /opt/stack/cinder/cinder/backup/chunkeddriver.py:295}} Jul 03 09:40:47.416028 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-cbe01d26-c2ec-4bcc-9c76-1eea6e84e3a5 tempest-VolumesBackupsAdminTest-1500745506 None] backup 3b72dd02-bc01-459e-878b-586ab492372f finished. {{(pid=101319) _finalize_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:462}} Jul 03 09:40:47.542844 np0000004400 cinder-backup[101319]: DEBUG oslo_concurrency.processutils [None req-cbe01d26-c2ec-4bcc-9c76-1eea6e84e3a5 tempest-VolumesBackupsAdminTest-1500745506 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chown 0 /dev/sdb {{(pid=101319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 09:40:47.564867 np0000004400 sudo[124218]: stack : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chown 0 /dev/sdb Jul 03 09:40:47.566029 np0000004400 sudo[124218]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1002) Jul 03 09:40:47.885396 np0000004400 sudo[124218]: pam_unix(sudo:session): session closed for user root Jul 03 09:40:47.888011 np0000004400 cinder-backup[101319]: DEBUG oslo_concurrency.processutils [None req-cbe01d26-c2ec-4bcc-9c76-1eea6e84e3a5 tempest-VolumesBackupsAdminTest-1500745506 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chown 0 /dev/sdb" returned: 0 in 0.345s {{(pid=101319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 09:40:47.888773 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-cbe01d26-c2ec-4bcc-9c76-1eea6e84e3a5 tempest-VolumesBackupsAdminTest-1500745506 None] ==> disconnect_volume: call "{'args': (, {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-43d877b9-de99-46f9-9e3b-e0fb13a3b4d7', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '43d877b9-de99-46f9-9e3b-e0fb13a3b4d7', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': False}, {'type': 'block', 'scsi_wwn': '330000000424f9820', 'path': '/dev/sdb'}), 'kwargs': {'force': True, 'ignore_errors': True}}" {{(pid=101319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}} Jul 03 09:40:47.888999 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.base [None req-cbe01d26-c2ec-4bcc-9c76-1eea6e84e3a5 tempest-VolumesBackupsAdminTest-1500745506 None] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=101319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jul 03 09:40:47.889610 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.base [None req-cbe01d26-c2ec-4bcc-9c76-1eea6e84e3a5 tempest-VolumesBackupsAdminTest-1500745506 None] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=101319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jul 03 09:40:47.890106 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-cbe01d26-c2ec-4bcc-9c76-1eea6e84e3a5 tempest-VolumesBackupsAdminTest-1500745506 None] _get_connection_devices called with parameters: connection_properties={'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-43d877b9-de99-46f9-9e3b-e0fb13a3b4d7', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '43d877b9-de99-46f9-9e3b-e0fb13a3b4d7', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': False}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=101319) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:847}} Jul 03 09:40:47.902505 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-cbe01d26-c2ec-4bcc-9c76-1eea6e84e3a5 tempest-VolumesBackupsAdminTest-1500745506 None] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS: Jul 03 09:40:47.902505 np0000004400 cinder-backup[101319]: No targets found. Jul 03 09:40:47.902505 np0000004400 cinder-backup[101319]: iSNS: Jul 03 09:40:47.902505 np0000004400 cinder-backup[101319]: No targets found. Jul 03 09:40:47.902505 np0000004400 cinder-backup[101319]: STATIC: Jul 03 09:40:47.902505 np0000004400 cinder-backup[101319]: Target: iqn.2023-03.storpool.com:os--volume-1b2d367e-5e69-4f28-ba33-80946ae8636f Jul 03 09:40:47.902505 np0000004400 cinder-backup[101319]: Portal: 192.168.50.100:3260,-1 Jul 03 09:40:47.902505 np0000004400 cinder-backup[101319]: Iface Name: default Jul 03 09:40:47.902505 np0000004400 cinder-backup[101319]: Portal: 192.168.40.100:3260,-1 Jul 03 09:40:47.902505 np0000004400 cinder-backup[101319]: Iface Name: default Jul 03 09:40:47.902505 np0000004400 cinder-backup[101319]: Target: iqn.2023-03.storpool.com:os--volume-b2e4f10c-8033-4c54-95a1-dfe45d6357a3 Jul 03 09:40:47.902505 np0000004400 cinder-backup[101319]: Portal: 192.168.50.100:3260,-1 Jul 03 09:40:47.902505 np0000004400 cinder-backup[101319]: Iface Name: default Jul 03 09:40:47.902505 np0000004400 cinder-backup[101319]: Portal: 192.168.40.100:3260,-1 Jul 03 09:40:47.902505 np0000004400 cinder-backup[101319]: Iface Name: default Jul 03 09:40:47.902505 np0000004400 cinder-backup[101319]: Target: iqn.2023-03.storpool.com:os--volume-e2d07ea9-be35-48a4-9ec8-3736abeaba3e Jul 03 09:40:47.902505 np0000004400 cinder-backup[101319]: Portal: 192.168.50.100:3260,-1 Jul 03 09:40:47.902505 np0000004400 cinder-backup[101319]: Iface Name: default Jul 03 09:40:47.902505 np0000004400 cinder-backup[101319]: Portal: 192.168.40.100:3260,-1 Jul 03 09:40:47.902505 np0000004400 cinder-backup[101319]: Iface Name: default Jul 03 09:40:47.902505 np0000004400 cinder-backup[101319]: Target: iqn.2023-03.storpool.com:os--volume-dc2b03ce-cc0b-451c-97bc-46875efe14a0 Jul 03 09:40:47.902505 np0000004400 cinder-backup[101319]: Portal: 192.168.50.100:3260,-1 Jul 03 09:40:47.902505 np0000004400 cinder-backup[101319]: Iface Name: default Jul 03 09:40:47.902505 np0000004400 cinder-backup[101319]: Portal: 192.168.40.100:3260,-1 Jul 03 09:40:47.902505 np0000004400 cinder-backup[101319]: Iface Name: default Jul 03 09:40:47.902505 np0000004400 cinder-backup[101319]: Target: iqn.2023-03.storpool.com:os--volume-2cb23c9f-fd1d-4ffa-b027-28faa3d99f1d Jul 03 09:40:47.902505 np0000004400 cinder-backup[101319]: Portal: 192.168.50.100:3260,-1 Jul 03 09:40:47.902505 np0000004400 cinder-backup[101319]: Iface Name: default Jul 03 09:40:47.902505 np0000004400 cinder-backup[101319]: Portal: 192.168.40.100:3260,-1 Jul 03 09:40:47.902505 np0000004400 cinder-backup[101319]: Iface Name: default Jul 03 09:40:47.902505 np0000004400 cinder-backup[101319]: Target: iqn.2023-03.storpool.com:os--volume-43d877b9-de99-46f9-9e3b-e0fb13a3b4d7 Jul 03 09:40:47.902505 np0000004400 cinder-backup[101319]: Portal: 192.168.40.100:3260,-1 Jul 03 09:40:47.902505 np0000004400 cinder-backup[101319]: Iface Name: default Jul 03 09:40:47.902505 np0000004400 cinder-backup[101319]: Target: iqn.2023-03.storpool.com:os--volume-ef51248d-f155-43cd-afa0-8b0f72368a43 Jul 03 09:40:47.902505 np0000004400 cinder-backup[101319]: Portal: 192.168.50.100:3260,-1 Jul 03 09:40:47.902505 np0000004400 cinder-backup[101319]: Iface Name: default Jul 03 09:40:47.902505 np0000004400 cinder-backup[101319]: Portal: 192.168.40.100:3260,-1 Jul 03 09:40:47.902505 np0000004400 cinder-backup[101319]: Iface Name: default Jul 03 09:40:47.902505 np0000004400 cinder-backup[101319]: Target: iqn.2023-03.storpool.com:os--volume-b5c70aaf-10ec-45f7-bd9f-756a91fe1d65 Jul 03 09:40:47.902505 np0000004400 cinder-backup[101319]: Portal: 192.168.50.100:3260,-1 Jul 03 09:40:47.902505 np0000004400 cinder-backup[101319]: Iface Name: default Jul 03 09:40:47.902505 np0000004400 cinder-backup[101319]: Portal: 192.168.40.100:3260,-1 Jul 03 09:40:47.902505 np0000004400 cinder-backup[101319]: Iface Name: default Jul 03 09:40:47.902505 np0000004400 cinder-backup[101319]: FIRMWARE: Jul 03 09:40:47.902505 np0000004400 cinder-backup[101319]: No targets found. Jul 03 09:40:47.902505 np0000004400 cinder-backup[101319]: stderr= {{(pid=101319) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jul 03 09:40:47.903448 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-cbe01d26-c2ec-4bcc-9c76-1eea6e84e3a5 tempest-VolumesBackupsAdminTest-1500745506 None] Regex to get portals from discoverydb: ^SENDTARGETS: Jul 03 09:40:47.903448 np0000004400 cinder-backup[101319]: .*?^DiscoveryAddress: 192.168.40.100,3260.*? Jul 03 09:40:47.903448 np0000004400 cinder-backup[101319]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=101319) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:390}} Jul 03 09:40:47.903448 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-cbe01d26-c2ec-4bcc-9c76-1eea6e84e3a5 tempest-VolumesBackupsAdminTest-1500745506 None] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-43d877b9-de99-46f9-9e3b-e0fb13a3b4d7', 0)] {{(pid=101319) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:858}} Jul 03 09:40:47.943481 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-cbe01d26-c2ec-4bcc-9c76-1eea6e84e3a5 tempest-VolumesBackupsAdminTest-1500745506 None] iscsiadm ('-m', 'session'): stdout=tcp: [33] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2cb23c9f-fd1d-4ffa-b027-28faa3d99f1d (non-flash) Jul 03 09:40:47.943481 np0000004400 cinder-backup[101319]: tcp: [34] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2cb23c9f-fd1d-4ffa-b027-28faa3d99f1d (non-flash) Jul 03 09:40:47.943481 np0000004400 cinder-backup[101319]: tcp: [40] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b5c70aaf-10ec-45f7-bd9f-756a91fe1d65 (non-flash) Jul 03 09:40:47.943481 np0000004400 cinder-backup[101319]: tcp: [41] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b5c70aaf-10ec-45f7-bd9f-756a91fe1d65 (non-flash) Jul 03 09:40:47.943481 np0000004400 cinder-backup[101319]: tcp: [42] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ef51248d-f155-43cd-afa0-8b0f72368a43 (non-flash) Jul 03 09:40:47.943481 np0000004400 cinder-backup[101319]: tcp: [43] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ef51248d-f155-43cd-afa0-8b0f72368a43 (non-flash) Jul 03 09:40:47.943481 np0000004400 cinder-backup[101319]: tcp: [45] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1b2d367e-5e69-4f28-ba33-80946ae8636f (non-flash) Jul 03 09:40:47.943481 np0000004400 cinder-backup[101319]: tcp: [46] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1b2d367e-5e69-4f28-ba33-80946ae8636f (non-flash) Jul 03 09:40:47.943481 np0000004400 cinder-backup[101319]: tcp: [49] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b2e4f10c-8033-4c54-95a1-dfe45d6357a3 (non-flash) Jul 03 09:40:47.943481 np0000004400 cinder-backup[101319]: tcp: [50] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b2e4f10c-8033-4c54-95a1-dfe45d6357a3 (non-flash) Jul 03 09:40:47.943481 np0000004400 cinder-backup[101319]: tcp: [51] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-43d877b9-de99-46f9-9e3b-e0fb13a3b4d7 (non-flash) Jul 03 09:40:47.943481 np0000004400 cinder-backup[101319]: tcp: [52] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e2d07ea9-be35-48a4-9ec8-3736abeaba3e (non-flash) Jul 03 09:40:47.943481 np0000004400 cinder-backup[101319]: tcp: [53] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e2d07ea9-be35-48a4-9ec8-3736abeaba3e (non-flash) Jul 03 09:40:47.943481 np0000004400 cinder-backup[101319]: tcp: [54] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-dc2b03ce-cc0b-451c-97bc-46875efe14a0 (non-flash) Jul 03 09:40:47.943481 np0000004400 cinder-backup[101319]: tcp: [55] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-dc2b03ce-cc0b-451c-97bc-46875efe14a0 (non-flash) Jul 03 09:40:47.943481 np0000004400 cinder-backup[101319]: stderr= {{(pid=101319) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jul 03 09:40:47.944065 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-cbe01d26-c2ec-4bcc-9c76-1eea6e84e3a5 tempest-VolumesBackupsAdminTest-1500745506 None] iscsi session list stdout=tcp: [33] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2cb23c9f-fd1d-4ffa-b027-28faa3d99f1d (non-flash) Jul 03 09:40:47.944065 np0000004400 cinder-backup[101319]: tcp: [34] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2cb23c9f-fd1d-4ffa-b027-28faa3d99f1d (non-flash) Jul 03 09:40:47.944065 np0000004400 cinder-backup[101319]: tcp: [40] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b5c70aaf-10ec-45f7-bd9f-756a91fe1d65 (non-flash) Jul 03 09:40:47.944065 np0000004400 cinder-backup[101319]: tcp: [41] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b5c70aaf-10ec-45f7-bd9f-756a91fe1d65 (non-flash) Jul 03 09:40:47.944065 np0000004400 cinder-backup[101319]: tcp: [42] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ef51248d-f155-43cd-afa0-8b0f72368a43 (non-flash) Jul 03 09:40:47.944065 np0000004400 cinder-backup[101319]: tcp: [43] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ef51248d-f155-43cd-afa0-8b0f72368a43 (non-flash) Jul 03 09:40:47.944065 np0000004400 cinder-backup[101319]: tcp: [45] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1b2d367e-5e69-4f28-ba33-80946ae8636f (non-flash) Jul 03 09:40:47.944065 np0000004400 cinder-backup[101319]: tcp: [46] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1b2d367e-5e69-4f28-ba33-80946ae8636f (non-flash) Jul 03 09:40:47.944065 np0000004400 cinder-backup[101319]: tcp: [49] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b2e4f10c-8033-4c54-95a1-dfe45d6357a3 (non-flash) Jul 03 09:40:47.944065 np0000004400 cinder-backup[101319]: tcp: [50] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b2e4f10c-8033-4c54-95a1-dfe45d6357a3 (non-flash) Jul 03 09:40:47.944065 np0000004400 cinder-backup[101319]: tcp: [51] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-43d877b9-de99-46f9-9e3b-e0fb13a3b4d7 (non-flash) Jul 03 09:40:47.944065 np0000004400 cinder-backup[101319]: tcp: [52] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e2d07ea9-be35-48a4-9ec8-3736abeaba3e (non-flash) Jul 03 09:40:47.944065 np0000004400 cinder-backup[101319]: tcp: [53] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e2d07ea9-be35-48a4-9ec8-3736abeaba3e (non-flash) Jul 03 09:40:47.944065 np0000004400 cinder-backup[101319]: tcp: [54] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-dc2b03ce-cc0b-451c-97bc-46875efe14a0 (non-flash) Jul 03 09:40:47.944065 np0000004400 cinder-backup[101319]: tcp: [55] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-dc2b03ce-cc0b-451c-97bc-46875efe14a0 (non-flash) Jul 03 09:40:47.944065 np0000004400 cinder-backup[101319]: stderr= {{(pid=101319) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jul 03 09:40:47.944065 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-cbe01d26-c2ec-4bcc-9c76-1eea6e84e3a5 tempest-VolumesBackupsAdminTest-1500745506 None] Sessions list: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-2cb23c9f-fd1d-4ffa-b027-28faa3d99f1d', '33'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-2cb23c9f-fd1d-4ffa-b027-28faa3d99f1d', '34'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-b5c70aaf-10ec-45f7-bd9f-756a91fe1d65', '40'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-b5c70aaf-10ec-45f7-bd9f-756a91fe1d65', '41'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-ef51248d-f155-43cd-afa0-8b0f72368a43', '42'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-ef51248d-f155-43cd-afa0-8b0f72368a43', '43'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-1b2d367e-5e69-4f28-ba33-80946ae8636f', '45'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-1b2d367e-5e69-4f28-ba33-80946ae8636f', '46'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-b2e4f10c-8033-4c54-95a1-dfe45d6357a3', '49'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-b2e4f10c-8033-4c54-95a1-dfe45d6357a3', '50'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-43d877b9-de99-46f9-9e3b-e0fb13a3b4d7', '51'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-e2d07ea9-be35-48a4-9ec8-3736abeaba3e', '52'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-e2d07ea9-be35-48a4-9ec8-3736abeaba3e', '53'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-dc2b03ce-cc0b-451c-97bc-46875efe14a0', '54'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-dc2b03ce-cc0b-451c-97bc-46875efe14a0', '55')] {{(pid=101319) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:866}} Jul 03 09:40:47.944623 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-cbe01d26-c2ec-4bcc-9c76-1eea6e84e3a5 tempest-VolumesBackupsAdminTest-1500745506 None] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-43d877b9-de99-46f9-9e3b-e0fb13a3b4d7, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-43d877b9-de99-46f9-9e3b-e0fb13a3b4d7', '51')] {{(pid=101319) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}} Jul 03 09:40:47.946064 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-cbe01d26-c2ec-4bcc-9c76-1eea6e84e3a5 tempest-VolumesBackupsAdminTest-1500745506 None] Resulting device map defaultdict(. at 0x7e76e7130ea0>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-43d877b9-de99-46f9-9e3b-e0fb13a3b4d7'): ({'sdb'}, set())}) {{(pid=101319) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:912}} Jul 03 09:40:47.946165 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.linuxscsi [None req-cbe01d26-c2ec-4bcc-9c76-1eea6e84e3a5 tempest-VolumesBackupsAdminTest-1500745506 None] Removing single pathed devices sdb {{(pid=101319) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}} Jul 03 09:40:47.957354 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.linuxscsi [None req-cbe01d26-c2ec-4bcc-9c76-1eea6e84e3a5 tempest-VolumesBackupsAdminTest-1500745506 None] Flushing IO for device /dev/sdb {{(pid=101319) flush_device_io /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:461}} Jul 03 09:40:47.965797 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.linuxscsi [None req-cbe01d26-c2ec-4bcc-9c76-1eea6e84e3a5 tempest-VolumesBackupsAdminTest-1500745506 None] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=101319) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}} Jul 03 09:40:48.020226 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.linuxscsi [None req-cbe01d26-c2ec-4bcc-9c76-1eea6e84e3a5 tempest-VolumesBackupsAdminTest-1500745506 None] Checking to see if SCSI volumes sdb have been removed. {{(pid=101319) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}} Jul 03 09:40:48.020459 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.linuxscsi [None req-cbe01d26-c2ec-4bcc-9c76-1eea6e84e3a5 tempest-VolumesBackupsAdminTest-1500745506 None] SCSI volumes sdb have been removed. {{(pid=101319) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}} Jul 03 09:40:48.022531 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.linuxscsi [None req-cbe01d26-c2ec-4bcc-9c76-1eea6e84e3a5 tempest-VolumesBackupsAdminTest-1500745506 None] Checking to see if device paths {'sdb'} are still under multipathd monitoring {{(pid=101319) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}} Jul 03 09:40:48.042651 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.linuxscsi [None req-cbe01d26-c2ec-4bcc-9c76-1eea6e84e3a5 tempest-VolumesBackupsAdminTest-1500745506 None] Device paths {'sdb'} have been removed from multipathd monitoring. {{(pid=101319) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}} Jul 03 09:40:48.042651 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-cbe01d26-c2ec-4bcc-9c76-1eea6e84e3a5 tempest-VolumesBackupsAdminTest-1500745506 None] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-43d877b9-de99-46f9-9e3b-e0fb13a3b4d7')] {{(pid=101319) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1225}} Jul 03 09:40:48.057285 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-cbe01d26-c2ec-4bcc-9c76-1eea6e84e3a5 tempest-VolumesBackupsAdminTest-1500745506 None] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=101319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 03 09:40:48.100340 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-cbe01d26-c2ec-4bcc-9c76-1eea6e84e3a5 tempest-VolumesBackupsAdminTest-1500745506 None] iscsiadm ('--logout',): stdout=Logging out of session [sid: 51, target: iqn.2023-03.storpool.com:os--volume-43d877b9-de99-46f9-9e3b-e0fb13a3b4d7, portal: 192.168.40.100,3260] Jul 03 09:40:48.100340 np0000004400 cinder-backup[101319]: Logout of [sid: 51, target: iqn.2023-03.storpool.com:os--volume-43d877b9-de99-46f9-9e3b-e0fb13a3b4d7, portal: 192.168.40.100,3260] successful. Jul 03 09:40:48.100340 np0000004400 cinder-backup[101319]: stderr= {{(pid=101319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 03 09:40:48.124399 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-cbe01d26-c2ec-4bcc-9c76-1eea6e84e3a5 tempest-VolumesBackupsAdminTest-1500745506 None] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=101319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 03 09:40:48.124807 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.base [None req-cbe01d26-c2ec-4bcc-9c76-1eea6e84e3a5 tempest-VolumesBackupsAdminTest-1500745506 None] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.235s {{(pid=101319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jul 03 09:40:48.124907 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-cbe01d26-c2ec-4bcc-9c76-1eea6e84e3a5 tempest-VolumesBackupsAdminTest-1500745506 None] <== disconnect_volume: return (236ms) None {{(pid=101319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}} Jul 03 09:40:49.176227 np0000004400 cinder-backup[101319]: INFO cinder.backup.manager [None req-cbe01d26-c2ec-4bcc-9c76-1eea6e84e3a5 tempest-VolumesBackupsAdminTest-1500745506 None] Create backup finished. backup: 3b72dd02-bc01-459e-878b-586ab492372f. Jul 03 09:40:50.006802 np0000004400 cinder-backup[101319]: INFO cinder.backup.manager [None req-9204b02a-0df7-42cc-9441-510b1fbfe7a7 tempest-VolumesBackupsAdminTest-895628463 None] Reset backup status started, backup_id: 3b72dd02-bc01-459e-878b-586ab492372f, status: error. Jul 03 09:40:50.006802 np0000004400 cinder-backup[101319]: INFO cinder.backup.manager [None req-9204b02a-0df7-42cc-9441-510b1fbfe7a7 tempest-VolumesBackupsAdminTest-895628463 None] Backup service: cinder.backup.drivers.swift.SwiftBackupDriver. Jul 03 09:40:51.145384 np0000004400 cinder-backup[101319]: INFO cinder.backup.manager [None req-67614d58-4285-4094-a37e-14940f36c808 tempest-VolumesBackupsAdminTest-1500745506 None] Delete backup started, backup: 3b72dd02-bc01-459e-878b-586ab492372f. Jul 03 09:40:51.156884 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.drivers.swift [None req-67614d58-4285-4094-a37e-14940f36c808 tempest-VolumesBackupsAdminTest-1500745506 None] Using swift URL https://10.4.3.95:8080/v1/AUTH_b25712a6deba4237b3d9f8f02bb54ed6 {{(pid=101319) initialize /opt/stack/cinder/cinder/backup/drivers/swift.py:300}} Jul 03 09:40:51.156884 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.drivers.swift [None req-67614d58-4285-4094-a37e-14940f36c808 tempest-VolumesBackupsAdminTest-1500745506 None] Connect to https://10.4.3.95:8080/v1/AUTH_ in "per_user" mode {{(pid=101319) initialize /opt/stack/cinder/cinder/backup/drivers/swift.py:301}} Jul 03 09:40:51.157235 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-67614d58-4285-4094-a37e-14940f36c808 tempest-VolumesBackupsAdminTest-1500745506 None] delete started, backup: 3b72dd02-bc01-459e-878b-586ab492372f, container: tempest-volumesbackupsadmintest-backup-container-1481520206, prefix: volume_43d877b9-de99-46f9-9e3b-e0fb13a3b4d7/20260703094033/az_nova_backup_3b72dd02-bc01-459e-878b-586ab492372f. {{(pid=101319) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:822}} Jul 03 09:40:51.292359 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-67614d58-4285-4094-a37e-14940f36c808 tempest-VolumesBackupsAdminTest-1500745506 None] generated object list: ['volume_43d877b9-de99-46f9-9e3b-e0fb13a3b4d7/20260703094033/az_nova_backup_3b72dd02-bc01-459e-878b-586ab492372f-00001', 'volume_43d877b9-de99-46f9-9e3b-e0fb13a3b4d7/20260703094033/az_nova_backup_3b72dd02-bc01-459e-878b-586ab492372f-00002', 'volume_43d877b9-de99-46f9-9e3b-e0fb13a3b4d7/20260703094033/az_nova_backup_3b72dd02-bc01-459e-878b-586ab492372f-00003', 'volume_43d877b9-de99-46f9-9e3b-e0fb13a3b4d7/20260703094033/az_nova_backup_3b72dd02-bc01-459e-878b-586ab492372f-00004', 'volume_43d877b9-de99-46f9-9e3b-e0fb13a3b4d7/20260703094033/az_nova_backup_3b72dd02-bc01-459e-878b-586ab492372f-00005', 'volume_43d877b9-de99-46f9-9e3b-e0fb13a3b4d7/20260703094033/az_nova_backup_3b72dd02-bc01-459e-878b-586ab492372f-00006', 'volume_43d877b9-de99-46f9-9e3b-e0fb13a3b4d7/20260703094033/az_nova_backup_3b72dd02-bc01-459e-878b-586ab492372f-00007', 'volume_43d877b9-de99-46f9-9e3b-e0fb13a3b4d7/20260703094033/az_nova_backup_3b72dd02-bc01-459e-878b-586ab492372f-00008', 'volume_43d877b9-de99-46f9-9e3b-e0fb13a3b4d7/20260703094033/az_nova_backup_3b72dd02-bc01-459e-878b-586ab492372f-00009', 'volume_43d877b9-de99-46f9-9e3b-e0fb13a3b4d7/20260703094033/az_nova_backup_3b72dd02-bc01-459e-878b-586ab492372f-00010', 'volume_43d877b9-de99-46f9-9e3b-e0fb13a3b4d7/20260703094033/az_nova_backup_3b72dd02-bc01-459e-878b-586ab492372f-00011', 'volume_43d877b9-de99-46f9-9e3b-e0fb13a3b4d7/20260703094033/az_nova_backup_3b72dd02-bc01-459e-878b-586ab492372f-00012', 'volume_43d877b9-de99-46f9-9e3b-e0fb13a3b4d7/20260703094033/az_nova_backup_3b72dd02-bc01-459e-878b-586ab492372f-00013', 'volume_43d877b9-de99-46f9-9e3b-e0fb13a3b4d7/20260703094033/az_nova_backup_3b72dd02-bc01-459e-878b-586ab492372f-00014', 'volume_43d877b9-de99-46f9-9e3b-e0fb13a3b4d7/20260703094033/az_nova_backup_3b72dd02-bc01-459e-878b-586ab492372f-00015', 'volume_43d877b9-de99-46f9-9e3b-e0fb13a3b4d7/20260703094033/az_nova_backup_3b72dd02-bc01-459e-878b-586ab492372f-00016', 'volume_43d877b9-de99-46f9-9e3b-e0fb13a3b4d7/20260703094033/az_nova_backup_3b72dd02-bc01-459e-878b-586ab492372f-00017', 'volume_43d877b9-de99-46f9-9e3b-e0fb13a3b4d7/20260703094033/az_nova_backup_3b72dd02-bc01-459e-878b-586ab492372f-00018', 'volume_43d877b9-de99-46f9-9e3b-e0fb13a3b4d7/20260703094033/az_nova_backup_3b72dd02-bc01-459e-878b-586ab492372f-00019', 'volume_43d877b9-de99-46f9-9e3b-e0fb13a3b4d7/20260703094033/az_nova_backup_3b72dd02-bc01-459e-878b-586ab492372f-00020', 'volume_43d877b9-de99-46f9-9e3b-e0fb13a3b4d7/20260703094033/az_nova_backup_3b72dd02-bc01-459e-878b-586ab492372f-00021', 'volume_43d877b9-de99-46f9-9e3b-e0fb13a3b4d7/20260703094033/az_nova_backup_3b72dd02-bc01-459e-878b-586ab492372f_metadata', 'volume_43d877b9-de99-46f9-9e3b-e0fb13a3b4d7/20260703094033/az_nova_backup_3b72dd02-bc01-459e-878b-586ab492372f_sha256file']. {{(pid=101319) _generate_object_names /opt/stack/cinder/cinder/backup/chunkeddriver.py:260}} Jul 03 09:40:51.333291 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-67614d58-4285-4094-a37e-14940f36c808 tempest-VolumesBackupsAdminTest-1500745506 None] deleted object: volume_43d877b9-de99-46f9-9e3b-e0fb13a3b4d7/20260703094033/az_nova_backup_3b72dd02-bc01-459e-878b-586ab492372f-00001 in container: tempest-volumesbackupsadmintest-backup-container-1481520206. {{(pid=101319) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 09:40:51.375899 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-67614d58-4285-4094-a37e-14940f36c808 tempest-VolumesBackupsAdminTest-1500745506 None] deleted object: volume_43d877b9-de99-46f9-9e3b-e0fb13a3b4d7/20260703094033/az_nova_backup_3b72dd02-bc01-459e-878b-586ab492372f-00002 in container: tempest-volumesbackupsadmintest-backup-container-1481520206. {{(pid=101319) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 09:40:51.412424 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-67614d58-4285-4094-a37e-14940f36c808 tempest-VolumesBackupsAdminTest-1500745506 None] deleted object: volume_43d877b9-de99-46f9-9e3b-e0fb13a3b4d7/20260703094033/az_nova_backup_3b72dd02-bc01-459e-878b-586ab492372f-00003 in container: tempest-volumesbackupsadmintest-backup-container-1481520206. {{(pid=101319) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 09:40:51.444589 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-67614d58-4285-4094-a37e-14940f36c808 tempest-VolumesBackupsAdminTest-1500745506 None] deleted object: volume_43d877b9-de99-46f9-9e3b-e0fb13a3b4d7/20260703094033/az_nova_backup_3b72dd02-bc01-459e-878b-586ab492372f-00004 in container: tempest-volumesbackupsadmintest-backup-container-1481520206. {{(pid=101319) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 09:40:51.479473 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-67614d58-4285-4094-a37e-14940f36c808 tempest-VolumesBackupsAdminTest-1500745506 None] deleted object: volume_43d877b9-de99-46f9-9e3b-e0fb13a3b4d7/20260703094033/az_nova_backup_3b72dd02-bc01-459e-878b-586ab492372f-00005 in container: tempest-volumesbackupsadmintest-backup-container-1481520206. {{(pid=101319) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 09:40:51.519351 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-67614d58-4285-4094-a37e-14940f36c808 tempest-VolumesBackupsAdminTest-1500745506 None] deleted object: volume_43d877b9-de99-46f9-9e3b-e0fb13a3b4d7/20260703094033/az_nova_backup_3b72dd02-bc01-459e-878b-586ab492372f-00006 in container: tempest-volumesbackupsadmintest-backup-container-1481520206. {{(pid=101319) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 09:40:51.553981 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-67614d58-4285-4094-a37e-14940f36c808 tempest-VolumesBackupsAdminTest-1500745506 None] deleted object: volume_43d877b9-de99-46f9-9e3b-e0fb13a3b4d7/20260703094033/az_nova_backup_3b72dd02-bc01-459e-878b-586ab492372f-00007 in container: tempest-volumesbackupsadmintest-backup-container-1481520206. {{(pid=101319) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 09:40:51.590244 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-67614d58-4285-4094-a37e-14940f36c808 tempest-VolumesBackupsAdminTest-1500745506 None] deleted object: volume_43d877b9-de99-46f9-9e3b-e0fb13a3b4d7/20260703094033/az_nova_backup_3b72dd02-bc01-459e-878b-586ab492372f-00008 in container: tempest-volumesbackupsadmintest-backup-container-1481520206. {{(pid=101319) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 09:40:51.636436 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-67614d58-4285-4094-a37e-14940f36c808 tempest-VolumesBackupsAdminTest-1500745506 None] deleted object: volume_43d877b9-de99-46f9-9e3b-e0fb13a3b4d7/20260703094033/az_nova_backup_3b72dd02-bc01-459e-878b-586ab492372f-00009 in container: tempest-volumesbackupsadmintest-backup-container-1481520206. {{(pid=101319) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 09:40:51.674449 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-67614d58-4285-4094-a37e-14940f36c808 tempest-VolumesBackupsAdminTest-1500745506 None] deleted object: volume_43d877b9-de99-46f9-9e3b-e0fb13a3b4d7/20260703094033/az_nova_backup_3b72dd02-bc01-459e-878b-586ab492372f-00010 in container: tempest-volumesbackupsadmintest-backup-container-1481520206. {{(pid=101319) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 09:40:51.705684 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-67614d58-4285-4094-a37e-14940f36c808 tempest-VolumesBackupsAdminTest-1500745506 None] deleted object: volume_43d877b9-de99-46f9-9e3b-e0fb13a3b4d7/20260703094033/az_nova_backup_3b72dd02-bc01-459e-878b-586ab492372f-00011 in container: tempest-volumesbackupsadmintest-backup-container-1481520206. {{(pid=101319) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 09:40:51.736670 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-67614d58-4285-4094-a37e-14940f36c808 tempest-VolumesBackupsAdminTest-1500745506 None] deleted object: volume_43d877b9-de99-46f9-9e3b-e0fb13a3b4d7/20260703094033/az_nova_backup_3b72dd02-bc01-459e-878b-586ab492372f-00012 in container: tempest-volumesbackupsadmintest-backup-container-1481520206. {{(pid=101319) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 09:40:51.764946 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-67614d58-4285-4094-a37e-14940f36c808 tempest-VolumesBackupsAdminTest-1500745506 None] deleted object: volume_43d877b9-de99-46f9-9e3b-e0fb13a3b4d7/20260703094033/az_nova_backup_3b72dd02-bc01-459e-878b-586ab492372f-00013 in container: tempest-volumesbackupsadmintest-backup-container-1481520206. {{(pid=101319) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 09:40:51.793851 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-67614d58-4285-4094-a37e-14940f36c808 tempest-VolumesBackupsAdminTest-1500745506 None] deleted object: volume_43d877b9-de99-46f9-9e3b-e0fb13a3b4d7/20260703094033/az_nova_backup_3b72dd02-bc01-459e-878b-586ab492372f-00014 in container: tempest-volumesbackupsadmintest-backup-container-1481520206. {{(pid=101319) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 09:40:51.829569 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-67614d58-4285-4094-a37e-14940f36c808 tempest-VolumesBackupsAdminTest-1500745506 None] deleted object: volume_43d877b9-de99-46f9-9e3b-e0fb13a3b4d7/20260703094033/az_nova_backup_3b72dd02-bc01-459e-878b-586ab492372f-00015 in container: tempest-volumesbackupsadmintest-backup-container-1481520206. {{(pid=101319) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 09:40:51.863279 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-67614d58-4285-4094-a37e-14940f36c808 tempest-VolumesBackupsAdminTest-1500745506 None] deleted object: volume_43d877b9-de99-46f9-9e3b-e0fb13a3b4d7/20260703094033/az_nova_backup_3b72dd02-bc01-459e-878b-586ab492372f-00016 in container: tempest-volumesbackupsadmintest-backup-container-1481520206. {{(pid=101319) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 09:40:51.903219 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-67614d58-4285-4094-a37e-14940f36c808 tempest-VolumesBackupsAdminTest-1500745506 None] deleted object: volume_43d877b9-de99-46f9-9e3b-e0fb13a3b4d7/20260703094033/az_nova_backup_3b72dd02-bc01-459e-878b-586ab492372f-00017 in container: tempest-volumesbackupsadmintest-backup-container-1481520206. {{(pid=101319) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 09:40:51.949725 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-67614d58-4285-4094-a37e-14940f36c808 tempest-VolumesBackupsAdminTest-1500745506 None] deleted object: volume_43d877b9-de99-46f9-9e3b-e0fb13a3b4d7/20260703094033/az_nova_backup_3b72dd02-bc01-459e-878b-586ab492372f-00018 in container: tempest-volumesbackupsadmintest-backup-container-1481520206. {{(pid=101319) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 09:40:51.983967 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-67614d58-4285-4094-a37e-14940f36c808 tempest-VolumesBackupsAdminTest-1500745506 None] deleted object: volume_43d877b9-de99-46f9-9e3b-e0fb13a3b4d7/20260703094033/az_nova_backup_3b72dd02-bc01-459e-878b-586ab492372f-00019 in container: tempest-volumesbackupsadmintest-backup-container-1481520206. {{(pid=101319) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 09:40:52.018088 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-67614d58-4285-4094-a37e-14940f36c808 tempest-VolumesBackupsAdminTest-1500745506 None] deleted object: volume_43d877b9-de99-46f9-9e3b-e0fb13a3b4d7/20260703094033/az_nova_backup_3b72dd02-bc01-459e-878b-586ab492372f-00020 in container: tempest-volumesbackupsadmintest-backup-container-1481520206. {{(pid=101319) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 09:40:52.050600 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-67614d58-4285-4094-a37e-14940f36c808 tempest-VolumesBackupsAdminTest-1500745506 None] deleted object: volume_43d877b9-de99-46f9-9e3b-e0fb13a3b4d7/20260703094033/az_nova_backup_3b72dd02-bc01-459e-878b-586ab492372f-00021 in container: tempest-volumesbackupsadmintest-backup-container-1481520206. {{(pid=101319) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 09:40:52.083289 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-67614d58-4285-4094-a37e-14940f36c808 tempest-VolumesBackupsAdminTest-1500745506 None] deleted object: volume_43d877b9-de99-46f9-9e3b-e0fb13a3b4d7/20260703094033/az_nova_backup_3b72dd02-bc01-459e-878b-586ab492372f_metadata in container: tempest-volumesbackupsadmintest-backup-container-1481520206. {{(pid=101319) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 09:40:52.116922 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-67614d58-4285-4094-a37e-14940f36c808 tempest-VolumesBackupsAdminTest-1500745506 None] deleted object: volume_43d877b9-de99-46f9-9e3b-e0fb13a3b4d7/20260703094033/az_nova_backup_3b72dd02-bc01-459e-878b-586ab492372f_sha256file in container: tempest-volumesbackupsadmintest-backup-container-1481520206. {{(pid=101319) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 09:40:52.117236 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-67614d58-4285-4094-a37e-14940f36c808 tempest-VolumesBackupsAdminTest-1500745506 None] delete 3b72dd02-bc01-459e-878b-586ab492372f finished. {{(pid=101319) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:848}} Jul 03 09:40:52.178545 np0000004400 cinder-backup[101319]: DEBUG oslo_db.sqlalchemy.engines [None req-67614d58-4285-4094-a37e-14940f36c808 tempest-VolumesBackupsAdminTest-1500745506 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=101319) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 03 09:40:52.208352 np0000004400 cinder-backup[101319]: DEBUG cinder.quota [None req-67614d58-4285-4094-a37e-14940f36c808 tempest-VolumesBackupsAdminTest-1500745506 None] Created reservations ['68f93c1b-0b5f-4849-b0c1-5a9e5a06d94e', '55adfe33-cda1-4bbd-b08b-2fe998abe961'] {{(pid=101319) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 09:40:52.264368 np0000004400 cinder-backup[101319]: INFO cinder.backup.manager [None req-67614d58-4285-4094-a37e-14940f36c808 tempest-VolumesBackupsAdminTest-1500745506 None] Delete backup finished, backup 3b72dd02-bc01-459e-878b-586ab492372f deleted. Jul 03 09:41:02.244211 np0000004400 cinder-backup[101319]: DEBUG dbcounter [-] [101319] Writing DB stats cinder:SELECT=22,cinder:UPDATE=10,cinder:INSERT=2 {{(pid=101319) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 03 09:41:40.139954 np0000004400 cinder-backup[101319]: DEBUG oslo_service.periodic_task [None req-ffd932d2-122c-4e68-b5ba-628aff7ae7b8 None None] Running periodic task BackupManager.publish_service_capabilities {{(pid=101319) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 03 09:41:40.140378 np0000004400 cinder-backup[101319]: DEBUG cinder.manager [None req-ffd932d2-122c-4e68-b5ba-628aff7ae7b8 None None] Notifying Schedulers of capabilities ... {{(pid=101319) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 03 09:42:21.115214 np0000004400 cinder-backup[101319]: DEBUG dbcounter [-] [101319] Writing DB stats cinder:SELECT=1,cinder:UPDATE=1 {{(pid=101319) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 03 09:42:40.138973 np0000004400 cinder-backup[101319]: DEBUG oslo_service.periodic_task [None req-ffd932d2-122c-4e68-b5ba-628aff7ae7b8 None None] Running periodic task BackupManager.publish_service_capabilities {{(pid=101319) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 03 09:42:40.139294 np0000004400 cinder-backup[101319]: DEBUG cinder.manager [None req-ffd932d2-122c-4e68-b5ba-628aff7ae7b8 None None] Notifying Schedulers of capabilities ... {{(pid=101319) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 03 09:43:09.357177 np0000004400 cinder-backup[101319]: INFO cinder.backup.manager [None req-433493bb-8256-4f55-9f6e-59e2c4c4dc9d tempest-TestVolumeBackupRestore-997771116 None] Create backup started, backup: 8727aa2b-db7a-4559-b380-bc6d983ed688 volume: 1c366dd9-1a3c-4cb8-8f7c-4fdabf6fb81e. Jul 03 09:43:09.367528 np0000004400 cinder-backup[101319]: INFO cinder.backup.manager [None req-433493bb-8256-4f55-9f6e-59e2c4c4dc9d tempest-TestVolumeBackupRestore-997771116 None] Call Volume Manager to get_backup_device for Backup(availability_zone='nova',container=None,created_at=2026-07-03T09:43:09Z,data_timestamp=2026-07-03T09:43:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestVolumeBackupRestore-backup-21470280',encryption_key_id=None,fail_reason=None,host='np0000004400',id=8727aa2b-db7a-4559-b380-bc6d983ed688,metadata={},num_dependent_backups=0,object_count=0,parent=None,parent_id=None,project_id='8a91a271598c49e1b52c4e2c3a0f4413',restore_volume_id=None,service='cinder.backup.drivers.swift.SwiftBackupDriver',service_metadata=None,size=1,snapshot_id=None,status='creating',temp_snapshot_id=None,temp_volume_id=None,updated_at=None,user_id='291d5b00365c48af818ae26172e33eae',volume_id=1c366dd9-1a3c-4cb8-8f7c-4fdabf6fb81e) Jul 03 09:43:09.393183 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.drivers.swift [None req-433493bb-8256-4f55-9f6e-59e2c4c4dc9d tempest-TestVolumeBackupRestore-997771116 None] Using swift URL https://10.4.3.95:8080/v1/AUTH_8a91a271598c49e1b52c4e2c3a0f4413 {{(pid=101319) initialize /opt/stack/cinder/cinder/backup/drivers/swift.py:300}} Jul 03 09:43:09.393348 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.drivers.swift [None req-433493bb-8256-4f55-9f6e-59e2c4c4dc9d tempest-TestVolumeBackupRestore-997771116 None] Connect to https://10.4.3.95:8080/v1/AUTH_ in "per_user" mode {{(pid=101319) initialize /opt/stack/cinder/cinder/backup/drivers/swift.py:301}} Jul 03 09:43:09.393699 np0000004400 cinder-backup[101319]: DEBUG os_brick.utils [None req-433493bb-8256-4f55-9f6e-59e2c4c4dc9d tempest-TestVolumeBackupRestore-997771116 None] ==> get_connector_properties: call "{'root_helper': 'sudo cinder-rootwrap /etc/cinder/rootwrap.conf', 'my_ip': '10.4.3.95', 'multipath': False, 'enforce_multipath': False, 'host': None, 'execute': None}" {{(pid=101319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}} Jul 03 09:43:09.404840 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.scaleio [None req-433493bb-8256-4f55-9f6e-59e2c4c4dc9d tempest-TestVolumeBackupRestore-997771116 None] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=101319) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}} Jul 03 09:43:09.424012 np0000004400 cinder-backup[101319]: DEBUG oslo_concurrency.processutils [None req-433493bb-8256-4f55-9f6e-59e2c4c4dc9d tempest-TestVolumeBackupRestore-997771116 None] Running cmd (subprocess): nvme version {{(pid=101319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 09:43:09.441755 np0000004400 cinder-backup[101319]: DEBUG oslo_concurrency.processutils [None req-433493bb-8256-4f55-9f6e-59e2c4c4dc9d tempest-TestVolumeBackupRestore-997771116 None] 'nvme version' failed. Not Retrying. {{(pid=101319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 03 09:43:09.441755 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.nvmeof [None req-433493bb-8256-4f55-9f6e-59e2c4c4dc9d tempest-TestVolumeBackupRestore-997771116 None] nvme not present on system {{(pid=101319) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}} Jul 03 09:43:09.445454 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.lightos [None req-433493bb-8256-4f55-9f6e-59e2c4c4dc9d tempest-TestVolumeBackupRestore-997771116 None] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=101319) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}} Jul 03 09:43:09.446968 np0000004400 cinder-backup[101319]: INFO os_brick.initiator.connectors.lightos [None req-433493bb-8256-4f55-9f6e-59e2c4c4dc9d tempest-TestVolumeBackupRestore-997771116 None] Current host hostNQN and IP(s) are ['10.4.3.95', 'fe80::f816:3eff:fe47:268c', '192.168.40.6', 'fe80::f816:3eff:febf:7be2', '192.168.50.6', 'fe80::f816:3eff:fe99:8914', '192.168.10.6', 'fe80::f816:3eff:fe2f:e696', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::bc9d:84ff:fec2:6b49', 'fe80::fc16:3eff:fe72:8d5f', 'fe80::48a4:5fff:fedc:623c', 'fe80::fc16:3eff:fe36:77bf', 'fe80::4c47:1ff:fe64:1879', 'fe80::fc16:3eff:fec6:c223', 'fe80::fc16:3eff:fef5:5e6e', 'fe80::fc16:3eff:fedf:37a6', 'fe80::94d0:62ff:fec5:3886', 'fe80::fc16:3eff:fe48:c24e', 'fe80::fc16:3eff:feec:2e14', 'fe80::a1:38ff:fe3d:434b', 'fe80::fc16:3eff:fea8:bf8b', 'fe80::fc16:3eff:fe1e:8450', 'fe80::8435:18ff:feb9:798c'] Jul 03 09:43:09.447319 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.lightos [None req-433493bb-8256-4f55-9f6e-59e2c4c4dc9d tempest-TestVolumeBackupRestore-997771116 None] LIGHTOS: did not find dsc, continuing anyway. {{(pid=101319) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}} Jul 03 09:43:09.447580 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.lightos [None req-433493bb-8256-4f55-9f6e-59e2c4c4dc9d tempest-TestVolumeBackupRestore-997771116 None] LIGHTOS: no hostnqn found. {{(pid=101319) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}} Jul 03 09:43:09.449428 np0000004400 cinder-backup[101319]: DEBUG os_brick.utils [None req-433493bb-8256-4f55-9f6e-59e2c4c4dc9d tempest-TestVolumeBackupRestore-997771116 None] <== get_connector_properties: return (54ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.95', 'host': 'np0000004400', 'multipath': False, 'enforce_multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:ae7e5bb0ebe6', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': '6b284368-d0ba-4d18-af6f-4998d3955c52', 'nvme_native_multipath': False} {{(pid=101319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}} Jul 03 09:43:09.952147 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connector [None req-433493bb-8256-4f55-9f6e-59e2c4c4dc9d tempest-TestVolumeBackupRestore-997771116 None] Factory for iscsi on None {{(pid=101319) factory /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connector.py:243}} Jul 03 09:43:09.952147 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-433493bb-8256-4f55-9f6e-59e2c4c4dc9d tempest-TestVolumeBackupRestore-997771116 None] ==> connect_volume: call "{'self': , 'connection_properties': {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-1c366dd9-1a3c-4cb8-8f7c-4fdabf6fb81e', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '1c366dd9-1a3c-4cb8-8f7c-4fdabf6fb81e', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': False}}" {{(pid=101319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}} Jul 03 09:43:09.952371 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.base [None req-433493bb-8256-4f55-9f6e-59e2c4c4dc9d tempest-TestVolumeBackupRestore-997771116 None] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=101319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jul 03 09:43:12.424211 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.base [None req-433493bb-8256-4f55-9f6e-59e2c4c4dc9d tempest-TestVolumeBackupRestore-997771116 None] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 2.471s {{(pid=101319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jul 03 09:43:12.424211 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.base [None req-433493bb-8256-4f55-9f6e-59e2c4c4dc9d tempest-TestVolumeBackupRestore-997771116 None] Connection properties {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-1c366dd9-1a3c-4cb8-8f7c-4fdabf6fb81e', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '1c366dd9-1a3c-4cb8-8f7c-4fdabf6fb81e', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': False} {{(pid=101319) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}} Jul 03 09:43:12.434456 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.base [None req-433493bb-8256-4f55-9f6e-59e2c4c4dc9d tempest-TestVolumeBackupRestore-997771116 None] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-1c366dd9-1a3c-4cb8-8f7c-4fdabf6fb81e" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=101319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jul 03 09:43:12.438772 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.base [None req-433493bb-8256-4f55-9f6e-59e2c4c4dc9d tempest-TestVolumeBackupRestore-997771116 None] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-1c366dd9-1a3c-4cb8-8f7c-4fdabf6fb81e" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.003s {{(pid=101319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jul 03 09:43:12.438772 np0000004400 cinder-backup[101319]: INFO os_brick.initiator.connectors.iscsi [None req-433493bb-8256-4f55-9f6e-59e2c4c4dc9d tempest-TestVolumeBackupRestore-997771116 None] Trying to connect to iSCSI portal 192.168.40.100:3260 Jul 03 09:43:12.452629 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-433493bb-8256-4f55-9f6e-59e2c4c4dc9d tempest-TestVolumeBackupRestore-997771116 None] iscsiadm (): stdout= stderr=iscsiadm: No records found Jul 03 09:43:12.452629 np0000004400 cinder-backup[101319]: {{(pid=101319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 03 09:43:12.465676 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-433493bb-8256-4f55-9f6e-59e2c4c4dc9d tempest-TestVolumeBackupRestore-997771116 None] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-1c366dd9-1a3c-4cb8-8f7c-4fdabf6fb81e] added Jul 03 09:43:12.465676 np0000004400 cinder-backup[101319]: stderr=iscsiadm: Config file line 363 does not have value Jul 03 09:43:12.465676 np0000004400 cinder-backup[101319]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs' Jul 03 09:43:12.465676 np0000004400 cinder-backup[101319]: iscsiadm: Config file line 363 does not have value Jul 03 09:43:12.465676 np0000004400 cinder-backup[101319]: iscsiadm: Config file line 363 does not have value Jul 03 09:43:12.465676 np0000004400 cinder-backup[101319]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs' Jul 03 09:43:12.465676 np0000004400 cinder-backup[101319]: {{(pid=101319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 03 09:43:12.465676 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-433493bb-8256-4f55-9f6e-59e2c4c4dc9d tempest-TestVolumeBackupRestore-997771116 None] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=101319) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}} Jul 03 09:43:12.466083 np0000004400 cinder-backup[101319]: DEBUG os_brick.utils [None req-433493bb-8256-4f55-9f6e-59e2c4c4dc9d tempest-TestVolumeBackupRestore-997771116 None] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0279(s), this was the 1st time calling it. {{(pid=101319) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}} Jul 03 09:43:12.466313 np0000004400 cinder-backup[101319]: DEBUG os_brick.utils [None req-433493bb-8256-4f55-9f6e-59e2c4c4dc9d tempest-TestVolumeBackupRestore-997771116 None] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=101319) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}} Jul 03 09:43:13.467105 np0000004400 cinder-backup[101319]: INFO os_brick.initiator.connectors.iscsi [None req-433493bb-8256-4f55-9f6e-59e2c4c4dc9d tempest-TestVolumeBackupRestore-997771116 None] Trying to connect to iSCSI portal 192.168.40.100:3260 Jul 03 09:43:13.481681 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-433493bb-8256-4f55-9f6e-59e2c4c4dc9d tempest-TestVolumeBackupRestore-997771116 None] iscsiadm (): stdout=# BEGIN RECORD 2.1.9 Jul 03 09:43:13.481681 np0000004400 cinder-backup[101319]: node.name = iqn.2023-03.storpool.com:os--volume-1c366dd9-1a3c-4cb8-8f7c-4fdabf6fb81e Jul 03 09:43:13.481681 np0000004400 cinder-backup[101319]: node.tpgt = -1 Jul 03 09:43:13.481681 np0000004400 cinder-backup[101319]: node.startup = manual Jul 03 09:43:13.481681 np0000004400 cinder-backup[101319]: node.leading_login = No Jul 03 09:43:13.481681 np0000004400 cinder-backup[101319]: iface.iscsi_ifacename = default Jul 03 09:43:13.481681 np0000004400 cinder-backup[101319]: iface.net_ifacename = Jul 03 09:43:13.481681 np0000004400 cinder-backup[101319]: iface.ipaddress = Jul 03 09:43:13.481681 np0000004400 cinder-backup[101319]: iface.prefix_len = 0 Jul 03 09:43:13.481681 np0000004400 cinder-backup[101319]: iface.hwaddress = Jul 03 09:43:13.481681 np0000004400 cinder-backup[101319]: iface.transport_name = tcp Jul 03 09:43:13.481681 np0000004400 cinder-backup[101319]: iface.initiatorname = Jul 03 09:43:13.481681 np0000004400 cinder-backup[101319]: iface.state = Jul 03 09:43:13.481681 np0000004400 cinder-backup[101319]: iface.vlan_id = 0 Jul 03 09:43:13.481681 np0000004400 cinder-backup[101319]: iface.vlan_priority = 0 Jul 03 09:43:13.481681 np0000004400 cinder-backup[101319]: iface.vlan_state = Jul 03 09:43:13.481681 np0000004400 cinder-backup[101319]: iface.iface_num = 0 Jul 03 09:43:13.481681 np0000004400 cinder-backup[101319]: iface.mtu = 0 Jul 03 09:43:13.481681 np0000004400 cinder-backup[101319]: iface.port = 0 Jul 03 09:43:13.481681 np0000004400 cinder-backup[101319]: iface.bootproto = Jul 03 09:43:13.481681 np0000004400 cinder-backup[101319]: iface.subnet_mask = Jul 03 09:43:13.481681 np0000004400 cinder-backup[101319]: iface.gateway = Jul 03 09:43:13.481681 np0000004400 cinder-backup[101319]: iface.dhcp_alt_client_id_state = Jul 03 09:43:13.481681 np0000004400 cinder-backup[101319]: iface.dhcp_alt_client_id = Jul 03 09:43:13.481681 np0000004400 cinder-backup[101319]: iface.dhcp_dns = Jul 03 09:43:13.481681 np0000004400 cinder-backup[101319]: iface.dhcp_learn_iqn = Jul 03 09:43:13.481681 np0000004400 cinder-backup[101319]: iface.dhcp_req_vendor_id_state = Jul 03 09:43:13.481681 np0000004400 cinder-backup[101319]: iface.dhcp_vendor_id_state = Jul 03 09:43:13.481681 np0000004400 cinder-backup[101319]: iface.dhcp_vendor_id = Jul 03 09:43:13.481681 np0000004400 cinder-backup[101319]: iface.dhcp_slp_da = Jul 03 09:43:13.481681 np0000004400 cinder-backup[101319]: iface.fragmentation = Jul 03 09:43:13.481681 np0000004400 cinder-backup[101319]: iface.gratuitous_arp = Jul 03 09:43:13.481681 np0000004400 cinder-backup[101319]: iface.incoming_forwarding = Jul 03 09:43:13.481681 np0000004400 cinder-backup[101319]: iface.tos_state = Jul 03 09:43:13.481681 np0000004400 cinder-backup[101319]: iface.tos = 0 Jul 03 09:43:13.481681 np0000004400 cinder-backup[101319]: iface.ttl = 0 Jul 03 09:43:13.481681 np0000004400 cinder-backup[101319]: iface.delayed_ack = Jul 03 09:43:13.481681 np0000004400 cinder-backup[101319]: iface.tcp_nagle = Jul 03 09:43:13.481681 np0000004400 cinder-backup[101319]: iface.tcp_wsf_state = Jul 03 09:43:13.481681 np0000004400 cinder-backup[101319]: iface.tcp_wsf = 0 Jul 03 09:43:13.481681 np0000004400 cinder-backup[101319]: iface.tcp_timer_scale = 0 Jul 03 09:43:13.481681 np0000004400 cinder-backup[101319]: iface.tcp_timestamp = Jul 03 09:43:13.481681 np0000004400 cinder-backup[101319]: iface.redirect = Jul 03 09:43:13.481681 np0000004400 cinder-backup[101319]: iface.def_task_mgmt_timeout = 0 Jul 03 09:43:13.481681 np0000004400 cinder-backup[101319]: iface.header_digest = Jul 03 09:43:13.481681 np0000004400 cinder-backup[101319]: iface.data_digest = Jul 03 09:43:13.481681 np0000004400 cinder-backup[101319]: iface.immediate_data = Jul 03 09:43:13.481681 np0000004400 cinder-backup[101319]: iface.initial_r2t = Jul 03 09:43:13.481681 np0000004400 cinder-backup[101319]: iface.data_seq_inorder = Jul 03 09:43:13.481681 np0000004400 cinder-backup[101319]: iface.data_pdu_inorder = Jul 03 09:43:13.481681 np0000004400 cinder-backup[101319]: iface.erl = 0 Jul 03 09:43:13.481681 np0000004400 cinder-backup[101319]: iface.max_receive_data_len = 0 Jul 03 09:43:13.481681 np0000004400 cinder-backup[101319]: iface.first_burst_len = 0 Jul 03 09:43:13.481681 np0000004400 cinder-backup[101319]: iface.max_outstanding_r2t = 0 Jul 03 09:43:13.481681 np0000004400 cinder-backup[101319]: iface.max_burst_len = 0 Jul 03 09:43:13.481681 np0000004400 cinder-backup[101319]: iface.chap_auth = Jul 03 09:43:13.481681 np0000004400 cinder-backup[101319]: iface.bidi_chap = Jul 03 09:43:13.481681 np0000004400 cinder-backup[101319]: iface.strict_login_compliance = Jul 03 09:43:13.481681 np0000004400 cinder-backup[101319]: iface.discovery_auth = Jul 03 09:43:13.481681 np0000004400 cinder-backup[101319]: iface.discovery_logout = Jul 03 09:43:13.481681 np0000004400 cinder-backup[101319]: node.discovery_address = Jul 03 09:43:13.481681 np0000004400 cinder-backup[101319]: node.discovery_port = 0 Jul 03 09:43:13.481681 np0000004400 cinder-backup[101319]: node.discovery_type = fw Jul 03 09:43:13.481681 np0000004400 cinder-backup[101319]: node.session.initial_cmdsn = 0 Jul 03 09:43:13.481681 np0000004400 cinder-backup[101319]: node.session.initial_login_retry_max = 8 Jul 03 09:43:13.481681 np0000004400 cinder-backup[101319]: node.session.xmit_thread_priority = 0 Jul 03 09:43:13.481681 np0000004400 cinder-backup[101319]: node.session.cmds_max = 128 Jul 03 09:43:13.481681 np0000004400 cinder-backup[101319]: node.session.queue_depth = 32 Jul 03 09:43:13.481681 np0000004400 cinder-backup[101319]: node.session.nr_sessions = 1 Jul 03 09:43:13.481681 np0000004400 cinder-backup[101319]: node.session.auth.authmethod = None Jul 03 09:43:13.481681 np0000004400 cinder-backup[101319]: node.session.auth.username = Jul 03 09:43:13.481681 np0000004400 cinder-backup[101319]: node.session.auth.password = *** Jul 03 09:43:13.481681 np0000004400 cinder-backup[101319]: node.session.auth.username_in = Jul 03 09:43:13.481681 np0000004400 cinder-backup[101319]: node.session.auth.password_in = Jul 03 09:43:13.481681 np0000004400 cinder-backup[101319]: node.session.auth.chap_algs = SHA256 Jul 03 09:43:13.481681 np0000004400 cinder-backup[101319]: node.session.timeo.replacement_timeout = 120 Jul 03 09:43:13.481681 np0000004400 cinder-backup[101319]: node.session.err_timeo.abort_timeout = 15 Jul 03 09:43:13.481681 np0000004400 cinder-backup[101319]: node.session.err_timeo.lu_reset_timeout = 30 Jul 03 09:43:13.481681 np0000004400 cinder-backup[101319]: node.session.err_timeo.tgt_reset_timeout = 30 Jul 03 09:43:13.481681 np0000004400 cinder-backup[101319]: node.session.err_timeo.host_reset_timeout = 60 Jul 03 09:43:13.481681 np0000004400 cinder-backup[101319]: node.session.iscsi.FastAbort = Yes Jul 03 09:43:13.481681 np0000004400 cinder-backup[101319]: node.session.iscsi.InitialR2T = No Jul 03 09:43:13.481681 np0000004400 cinder-backup[101319]: node.session.iscsi.ImmediateData = Yes Jul 03 09:43:13.481681 np0000004400 cinder-backup[101319]: node.session.iscsi.FirstBurstLength = 262144 Jul 03 09:43:13.481681 np0000004400 cinder-backup[101319]: node.session.iscsi.MaxBurstLength = 16776192 Jul 03 09:43:13.481681 np0000004400 cinder-backup[101319]: node.session.iscsi.DefaultTime2Retain = 0 Jul 03 09:43:13.481681 np0000004400 cinder-backup[101319]: node.session.iscsi.DefaultTime2Wait = 2 Jul 03 09:43:13.481681 np0000004400 cinder-backup[101319]: node.session.iscsi.MaxConnections = 1 Jul 03 09:43:13.481681 np0000004400 cinder-backup[101319]: node.session.iscsi.MaxOutstandingR2T = 1 Jul 03 09:43:13.481681 np0000004400 cinder-backup[101319]: node.session.iscsi.ERL = 0 Jul 03 09:43:13.481681 np0000004400 cinder-backup[101319]: node.session.scan = auto Jul 03 09:43:13.481681 np0000004400 cinder-backup[101319]: node.session.reopen_max = 0 Jul 03 09:43:13.481681 np0000004400 cinder-backup[101319]: node.conn[0].address = 192.168.40.100 Jul 03 09:43:13.481681 np0000004400 cinder-backup[101319]: node.conn[0].port = 3260 Jul 03 09:43:13.481681 np0000004400 cinder-backup[101319]: node.conn[0].startup = manual Jul 03 09:43:13.481681 np0000004400 cinder-backup[101319]: node.conn[0].tcp.window_size = 524288 Jul 03 09:43:13.481681 np0000004400 cinder-backup[101319]: node.conn[0].tcp.type_of_service = 0 Jul 03 09:43:13.481681 np0000004400 cinder-backup[101319]: node.conn[0].timeo.logout_timeout = 15 Jul 03 09:43:13.481681 np0000004400 cinder-backup[101319]: node.conn[0].timeo.login_timeout = 15 Jul 03 09:43:13.481681 np0000004400 cinder-backup[101319]: node.conn[0].timeo.auth_timeout = 45 Jul 03 09:43:13.481681 np0000004400 cinder-backup[101319]: node.conn[0].timeo.noop_out_interval = 5 Jul 03 09:43:13.481681 np0000004400 cinder-backup[101319]: node.conn[0].timeo.noop_out_timeout = 5 Jul 03 09:43:13.481681 np0000004400 cinder-backup[101319]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0 Jul 03 09:43:13.481681 np0000004400 cinder-backup[101319]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144 Jul 03 09:43:13.481681 np0000004400 cinder-backup[101319]: node.conn[0].iscsi.HeaderDigest = None Jul 03 09:43:13.481681 np0000004400 cinder-backup[101319]: node.conn[0].iscsi.DataDigest = None Jul 03 09:43:13.481681 np0000004400 cinder-backup[101319]: node.conn[0].iscsi.IFMarker = No Jul 03 09:43:13.481681 np0000004400 cinder-backup[101319]: node.conn[0].iscsi.OFMarker = No Jul 03 09:43:13.481681 np0000004400 cinder-backup[101319]: # END RECORD Jul 03 09:43:13.481681 np0000004400 cinder-backup[101319]: stderr= {{(pid=101319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 03 09:43:13.494702 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-433493bb-8256-4f55-9f6e-59e2c4c4dc9d tempest-TestVolumeBackupRestore-997771116 None] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=101319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 03 09:43:13.511519 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-433493bb-8256-4f55-9f6e-59e2c4c4dc9d tempest-TestVolumeBackupRestore-997771116 None] iscsiadm ('-m', 'session'): stdout=tcp: [49] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b2e4f10c-8033-4c54-95a1-dfe45d6357a3 (non-flash) Jul 03 09:43:13.511519 np0000004400 cinder-backup[101319]: tcp: [50] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b2e4f10c-8033-4c54-95a1-dfe45d6357a3 (non-flash) Jul 03 09:43:13.511519 np0000004400 cinder-backup[101319]: tcp: [72] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e9e3f386-d923-4ae1-a6ce-8dd2091673ac (non-flash) Jul 03 09:43:13.511519 np0000004400 cinder-backup[101319]: tcp: [73] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e9e3f386-d923-4ae1-a6ce-8dd2091673ac (non-flash) Jul 03 09:43:13.511519 np0000004400 cinder-backup[101319]: tcp: [76] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f1c2bb03-f1f4-4186-9466-3b699bca16e6 (non-flash) Jul 03 09:43:13.511519 np0000004400 cinder-backup[101319]: tcp: [77] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f1c2bb03-f1f4-4186-9466-3b699bca16e6 (non-flash) Jul 03 09:43:13.511519 np0000004400 cinder-backup[101319]: stderr= {{(pid=101319) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jul 03 09:43:13.511519 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-433493bb-8256-4f55-9f6e-59e2c4c4dc9d tempest-TestVolumeBackupRestore-997771116 None] iscsi session list stdout=tcp: [49] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b2e4f10c-8033-4c54-95a1-dfe45d6357a3 (non-flash) Jul 03 09:43:13.511519 np0000004400 cinder-backup[101319]: tcp: [50] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b2e4f10c-8033-4c54-95a1-dfe45d6357a3 (non-flash) Jul 03 09:43:13.511519 np0000004400 cinder-backup[101319]: tcp: [72] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e9e3f386-d923-4ae1-a6ce-8dd2091673ac (non-flash) Jul 03 09:43:13.511519 np0000004400 cinder-backup[101319]: tcp: [73] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e9e3f386-d923-4ae1-a6ce-8dd2091673ac (non-flash) Jul 03 09:43:13.511519 np0000004400 cinder-backup[101319]: tcp: [76] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f1c2bb03-f1f4-4186-9466-3b699bca16e6 (non-flash) Jul 03 09:43:13.511519 np0000004400 cinder-backup[101319]: tcp: [77] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f1c2bb03-f1f4-4186-9466-3b699bca16e6 (non-flash) Jul 03 09:43:13.511519 np0000004400 cinder-backup[101319]: stderr= {{(pid=101319) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jul 03 09:43:13.551346 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-433493bb-8256-4f55-9f6e-59e2c4c4dc9d tempest-TestVolumeBackupRestore-997771116 None] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-1c366dd9-1a3c-4cb8-8f7c-4fdabf6fb81e, portal: 192.168.40.100,3260] Jul 03 09:43:13.551346 np0000004400 cinder-backup[101319]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-1c366dd9-1a3c-4cb8-8f7c-4fdabf6fb81e, portal: 192.168.40.100,3260] successful. Jul 03 09:43:13.551346 np0000004400 cinder-backup[101319]: stderr= {{(pid=101319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 03 09:43:13.563630 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-433493bb-8256-4f55-9f6e-59e2c4c4dc9d tempest-TestVolumeBackupRestore-997771116 None] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=101319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 03 09:43:13.579575 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-433493bb-8256-4f55-9f6e-59e2c4c4dc9d tempest-TestVolumeBackupRestore-997771116 None] iscsiadm ('-m', 'session'): stdout=tcp: [49] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b2e4f10c-8033-4c54-95a1-dfe45d6357a3 (non-flash) Jul 03 09:43:13.579575 np0000004400 cinder-backup[101319]: tcp: [50] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b2e4f10c-8033-4c54-95a1-dfe45d6357a3 (non-flash) Jul 03 09:43:13.579575 np0000004400 cinder-backup[101319]: tcp: [72] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e9e3f386-d923-4ae1-a6ce-8dd2091673ac (non-flash) Jul 03 09:43:13.579575 np0000004400 cinder-backup[101319]: tcp: [73] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e9e3f386-d923-4ae1-a6ce-8dd2091673ac (non-flash) Jul 03 09:43:13.579575 np0000004400 cinder-backup[101319]: tcp: [76] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f1c2bb03-f1f4-4186-9466-3b699bca16e6 (non-flash) Jul 03 09:43:13.579575 np0000004400 cinder-backup[101319]: tcp: [77] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f1c2bb03-f1f4-4186-9466-3b699bca16e6 (non-flash) Jul 03 09:43:13.579575 np0000004400 cinder-backup[101319]: tcp: [78] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1c366dd9-1a3c-4cb8-8f7c-4fdabf6fb81e (non-flash) Jul 03 09:43:13.579575 np0000004400 cinder-backup[101319]: stderr= {{(pid=101319) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jul 03 09:43:13.580118 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-433493bb-8256-4f55-9f6e-59e2c4c4dc9d tempest-TestVolumeBackupRestore-997771116 None] iscsi session list stdout=tcp: [49] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b2e4f10c-8033-4c54-95a1-dfe45d6357a3 (non-flash) Jul 03 09:43:13.580118 np0000004400 cinder-backup[101319]: tcp: [50] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b2e4f10c-8033-4c54-95a1-dfe45d6357a3 (non-flash) Jul 03 09:43:13.580118 np0000004400 cinder-backup[101319]: tcp: [72] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e9e3f386-d923-4ae1-a6ce-8dd2091673ac (non-flash) Jul 03 09:43:13.580118 np0000004400 cinder-backup[101319]: tcp: [73] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e9e3f386-d923-4ae1-a6ce-8dd2091673ac (non-flash) Jul 03 09:43:13.580118 np0000004400 cinder-backup[101319]: tcp: [76] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f1c2bb03-f1f4-4186-9466-3b699bca16e6 (non-flash) Jul 03 09:43:13.580118 np0000004400 cinder-backup[101319]: tcp: [77] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f1c2bb03-f1f4-4186-9466-3b699bca16e6 (non-flash) Jul 03 09:43:13.580118 np0000004400 cinder-backup[101319]: tcp: [78] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1c366dd9-1a3c-4cb8-8f7c-4fdabf6fb81e (non-flash) Jul 03 09:43:13.580118 np0000004400 cinder-backup[101319]: stderr= {{(pid=101319) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jul 03 09:43:13.580625 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.base [None req-433493bb-8256-4f55-9f6e-59e2c4c4dc9d tempest-TestVolumeBackupRestore-997771116 None] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-1c366dd9-1a3c-4cb8-8f7c-4fdabf6fb81e" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.142s {{(pid=101319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jul 03 09:43:13.580625 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-433493bb-8256-4f55-9f6e-59e2c4c4dc9d tempest-TestVolumeBackupRestore-997771116 None] Connected to 192.168.40.100:3260 {{(pid=101319) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}} Jul 03 09:43:13.581348 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.linuxscsi [None req-433493bb-8256-4f55-9f6e-59e2c4c4dc9d tempest-TestVolumeBackupRestore-997771116 None] HCTL ('7', '-', '-', 0) found on session 78 with lun 0 {{(pid=101319) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}} Jul 03 09:43:13.581566 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.linuxscsi [None req-433493bb-8256-4f55-9f6e-59e2c4c4dc9d tempest-TestVolumeBackupRestore-997771116 None] Scanning host 7 c: -, t: -, l: 0) {{(pid=101319) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}} Jul 03 09:43:13.595777 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.linuxscsi [None req-433493bb-8256-4f55-9f6e-59e2c4c4dc9d tempest-TestVolumeBackupRestore-997771116 None] Searching for a device in session 78 and hctl ['7', '*', '*', 0] yield: sdb {{(pid=101319) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}} Jul 03 09:43:13.595979 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-433493bb-8256-4f55-9f6e-59e2c4c4dc9d tempest-TestVolumeBackupRestore-997771116 None] Connected to sdb using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-1c366dd9-1a3c-4cb8-8f7c-4fdabf6fb81e', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '1c366dd9-1a3c-4cb8-8f7c-4fdabf6fb81e', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': False} {{(pid=101319) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}} Jul 03 09:43:14.599578 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.base [None req-433493bb-8256-4f55-9f6e-59e2c4c4dc9d tempest-TestVolumeBackupRestore-997771116 None] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 2.176s {{(pid=101319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jul 03 09:43:14.599962 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-433493bb-8256-4f55-9f6e-59e2c4c4dc9d tempest-TestVolumeBackupRestore-997771116 None] <== connect_volume: return (4647ms) {'type': 'block', 'scsi_wwn': '1StorPooliSCSI_DISK_1034578903445798998', 'path': '/dev/sdb'} {{(pid=101319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}} Jul 03 09:43:14.600167 np0000004400 cinder-backup[101319]: DEBUG oslo_concurrency.processutils [None req-433493bb-8256-4f55-9f6e-59e2c4c4dc9d tempest-TestVolumeBackupRestore-997771116 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chown 1002 /dev/sdb {{(pid=101319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 09:43:14.616234 np0000004400 sudo[131472]: stack : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chown 1002 /dev/sdb Jul 03 09:43:14.616905 np0000004400 sudo[131472]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1002) Jul 03 09:43:14.930069 np0000004400 sudo[131472]: pam_unix(sudo:session): session closed for user root Jul 03 09:43:14.931992 np0000004400 cinder-backup[101319]: DEBUG oslo_concurrency.processutils [None req-433493bb-8256-4f55-9f6e-59e2c4c4dc9d tempest-TestVolumeBackupRestore-997771116 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chown 1002 /dev/sdb" returned: 0 in 0.331s {{(pid=101319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 09:43:14.967216 np0000004400 cinder-backup[101319]: DEBUG oslo_db.sqlalchemy.engines [None req-433493bb-8256-4f55-9f6e-59e2c4c4dc9d tempest-TestVolumeBackupRestore-997771116 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=101319) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 03 09:43:14.972621 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-433493bb-8256-4f55-9f6e-59e2c4c4dc9d tempest-TestVolumeBackupRestore-997771116 None] _create_container started, container: volumebackups,backup: 8727aa2b-db7a-4559-b380-bc6d983ed688. {{(pid=101319) _create_container /opt/stack/cinder/cinder/backup/chunkeddriver.py:249}} Jul 03 09:43:15.204656 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.drivers.swift [None req-433493bb-8256-4f55-9f6e-59e2c4c4dc9d tempest-TestVolumeBackupRestore-997771116 None] generate_object_name_prefix: volume_1c366dd9-1a3c-4cb8-8f7c-4fdabf6fb81e/20260703094315/az_nova_backup_8727aa2b-db7a-4559-b380-bc6d983ed688 {{(pid=101319) _generate_object_name_prefix /opt/stack/cinder/cinder/backup/drivers/swift.py:452}} Jul 03 09:43:15.217236 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-433493bb-8256-4f55-9f6e-59e2c4c4dc9d tempest-TestVolumeBackupRestore-997771116 None] starting backup of volume: 1c366dd9-1a3c-4cb8-8f7c-4fdabf6fb81e, volume size: 1073741824, object names prefix volume_1c366dd9-1a3c-4cb8-8f7c-4fdabf6fb81e/20260703094315/az_nova_backup_8727aa2b-db7a-4559-b380-bc6d983ed688, availability zone: nova {{(pid=101319) _prepare_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:359}} Jul 03 09:43:15.440999 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-433493bb-8256-4f55-9f6e-59e2c4c4dc9d tempest-TestVolumeBackupRestore-997771116 None] Backing up chunk of data from volume. {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 09:43:16.189582 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-433493bb-8256-4f55-9f6e-59e2c4c4dc9d tempest-TestVolumeBackupRestore-997771116 None] Compressed 52428800 bytes of data to 19825286 bytes using zlib. {{(pid=101319) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 09:43:16.190136 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-433493bb-8256-4f55-9f6e-59e2c4c4dc9d tempest-TestVolumeBackupRestore-997771116 None] About to put_object {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 09:43:16.465270 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-433493bb-8256-4f55-9f6e-59e2c4c4dc9d tempest-TestVolumeBackupRestore-997771116 None] backup MD5 for volume_1c366dd9-1a3c-4cb8-8f7c-4fdabf6fb81e/20260703094315/az_nova_backup_8727aa2b-db7a-4559-b380-bc6d983ed688-00001: 82571f7121cb9475563edde615e4e4df {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 09:43:16.465562 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-433493bb-8256-4f55-9f6e-59e2c4c4dc9d tempest-TestVolumeBackupRestore-997771116 None] Calling eventlet.sleep(0) {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 09:43:16.719304 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-433493bb-8256-4f55-9f6e-59e2c4c4dc9d tempest-TestVolumeBackupRestore-997771116 None] Backing up chunk of data from volume. {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 09:43:16.976056 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-433493bb-8256-4f55-9f6e-59e2c4c4dc9d tempest-TestVolumeBackupRestore-997771116 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101319) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 09:43:16.976209 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-433493bb-8256-4f55-9f6e-59e2c4c4dc9d tempest-TestVolumeBackupRestore-997771116 None] About to put_object {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 09:43:17.082597 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-433493bb-8256-4f55-9f6e-59e2c4c4dc9d tempest-TestVolumeBackupRestore-997771116 None] backup MD5 for volume_1c366dd9-1a3c-4cb8-8f7c-4fdabf6fb81e/20260703094315/az_nova_backup_8727aa2b-db7a-4559-b380-bc6d983ed688-00002: 25e317773f308e446cc84c503a6d1f85 {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 09:43:17.082787 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-433493bb-8256-4f55-9f6e-59e2c4c4dc9d tempest-TestVolumeBackupRestore-997771116 None] Calling eventlet.sleep(0) {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 09:43:17.286900 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-433493bb-8256-4f55-9f6e-59e2c4c4dc9d tempest-TestVolumeBackupRestore-997771116 None] Backing up chunk of data from volume. {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 09:43:17.582719 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-433493bb-8256-4f55-9f6e-59e2c4c4dc9d tempest-TestVolumeBackupRestore-997771116 None] Compressed 52428800 bytes of data to 1362154 bytes using zlib. {{(pid=101319) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 09:43:17.582719 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-433493bb-8256-4f55-9f6e-59e2c4c4dc9d tempest-TestVolumeBackupRestore-997771116 None] About to put_object {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 09:43:17.717296 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-433493bb-8256-4f55-9f6e-59e2c4c4dc9d tempest-TestVolumeBackupRestore-997771116 None] backup MD5 for volume_1c366dd9-1a3c-4cb8-8f7c-4fdabf6fb81e/20260703094315/az_nova_backup_8727aa2b-db7a-4559-b380-bc6d983ed688-00003: a35891500449df17e893f84bd88472fb {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 09:43:17.717513 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-433493bb-8256-4f55-9f6e-59e2c4c4dc9d tempest-TestVolumeBackupRestore-997771116 None] Calling eventlet.sleep(0) {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 09:43:17.939428 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-433493bb-8256-4f55-9f6e-59e2c4c4dc9d tempest-TestVolumeBackupRestore-997771116 None] Backing up chunk of data from volume. {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 09:43:18.239322 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-433493bb-8256-4f55-9f6e-59e2c4c4dc9d tempest-TestVolumeBackupRestore-997771116 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101319) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 09:43:18.239538 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-433493bb-8256-4f55-9f6e-59e2c4c4dc9d tempest-TestVolumeBackupRestore-997771116 None] About to put_object {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 09:43:18.351622 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-433493bb-8256-4f55-9f6e-59e2c4c4dc9d tempest-TestVolumeBackupRestore-997771116 None] backup MD5 for volume_1c366dd9-1a3c-4cb8-8f7c-4fdabf6fb81e/20260703094315/az_nova_backup_8727aa2b-db7a-4559-b380-bc6d983ed688-00004: 25e317773f308e446cc84c503a6d1f85 {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 09:43:18.352136 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-433493bb-8256-4f55-9f6e-59e2c4c4dc9d tempest-TestVolumeBackupRestore-997771116 None] Calling eventlet.sleep(0) {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 09:43:18.565958 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-433493bb-8256-4f55-9f6e-59e2c4c4dc9d tempest-TestVolumeBackupRestore-997771116 None] Backing up chunk of data from volume. {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 09:43:18.840007 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-433493bb-8256-4f55-9f6e-59e2c4c4dc9d tempest-TestVolumeBackupRestore-997771116 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101319) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 09:43:18.840156 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-433493bb-8256-4f55-9f6e-59e2c4c4dc9d tempest-TestVolumeBackupRestore-997771116 None] About to put_object {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 09:43:18.954959 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-433493bb-8256-4f55-9f6e-59e2c4c4dc9d tempest-TestVolumeBackupRestore-997771116 None] backup MD5 for volume_1c366dd9-1a3c-4cb8-8f7c-4fdabf6fb81e/20260703094315/az_nova_backup_8727aa2b-db7a-4559-b380-bc6d983ed688-00005: 25e317773f308e446cc84c503a6d1f85 {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 09:43:18.955115 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-433493bb-8256-4f55-9f6e-59e2c4c4dc9d tempest-TestVolumeBackupRestore-997771116 None] Calling eventlet.sleep(0) {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 09:43:19.189510 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-433493bb-8256-4f55-9f6e-59e2c4c4dc9d tempest-TestVolumeBackupRestore-997771116 None] Backing up chunk of data from volume. {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 09:43:19.447486 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-433493bb-8256-4f55-9f6e-59e2c4c4dc9d tempest-TestVolumeBackupRestore-997771116 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101319) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 09:43:19.447894 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-433493bb-8256-4f55-9f6e-59e2c4c4dc9d tempest-TestVolumeBackupRestore-997771116 None] About to put_object {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 09:43:19.562143 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-433493bb-8256-4f55-9f6e-59e2c4c4dc9d tempest-TestVolumeBackupRestore-997771116 None] backup MD5 for volume_1c366dd9-1a3c-4cb8-8f7c-4fdabf6fb81e/20260703094315/az_nova_backup_8727aa2b-db7a-4559-b380-bc6d983ed688-00006: 25e317773f308e446cc84c503a6d1f85 {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 09:43:19.562287 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-433493bb-8256-4f55-9f6e-59e2c4c4dc9d tempest-TestVolumeBackupRestore-997771116 None] Calling eventlet.sleep(0) {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 09:43:19.745582 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-433493bb-8256-4f55-9f6e-59e2c4c4dc9d tempest-TestVolumeBackupRestore-997771116 None] Backing up chunk of data from volume. {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 09:43:20.013835 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-433493bb-8256-4f55-9f6e-59e2c4c4dc9d tempest-TestVolumeBackupRestore-997771116 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101319) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 09:43:20.014003 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-433493bb-8256-4f55-9f6e-59e2c4c4dc9d tempest-TestVolumeBackupRestore-997771116 None] About to put_object {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 09:43:20.121478 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-433493bb-8256-4f55-9f6e-59e2c4c4dc9d tempest-TestVolumeBackupRestore-997771116 None] backup MD5 for volume_1c366dd9-1a3c-4cb8-8f7c-4fdabf6fb81e/20260703094315/az_nova_backup_8727aa2b-db7a-4559-b380-bc6d983ed688-00007: 25e317773f308e446cc84c503a6d1f85 {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 09:43:20.121808 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-433493bb-8256-4f55-9f6e-59e2c4c4dc9d tempest-TestVolumeBackupRestore-997771116 None] Calling eventlet.sleep(0) {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 09:43:20.329162 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-433493bb-8256-4f55-9f6e-59e2c4c4dc9d tempest-TestVolumeBackupRestore-997771116 None] Backing up chunk of data from volume. {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 09:43:20.576177 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-433493bb-8256-4f55-9f6e-59e2c4c4dc9d tempest-TestVolumeBackupRestore-997771116 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101319) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 09:43:20.576599 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-433493bb-8256-4f55-9f6e-59e2c4c4dc9d tempest-TestVolumeBackupRestore-997771116 None] About to put_object {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 09:43:20.698611 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-433493bb-8256-4f55-9f6e-59e2c4c4dc9d tempest-TestVolumeBackupRestore-997771116 None] backup MD5 for volume_1c366dd9-1a3c-4cb8-8f7c-4fdabf6fb81e/20260703094315/az_nova_backup_8727aa2b-db7a-4559-b380-bc6d983ed688-00008: 25e317773f308e446cc84c503a6d1f85 {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 09:43:20.698892 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-433493bb-8256-4f55-9f6e-59e2c4c4dc9d tempest-TestVolumeBackupRestore-997771116 None] Calling eventlet.sleep(0) {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 09:43:20.951317 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-433493bb-8256-4f55-9f6e-59e2c4c4dc9d tempest-TestVolumeBackupRestore-997771116 None] Backing up chunk of data from volume. {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 09:43:21.254599 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-433493bb-8256-4f55-9f6e-59e2c4c4dc9d tempest-TestVolumeBackupRestore-997771116 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101319) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 09:43:21.254710 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-433493bb-8256-4f55-9f6e-59e2c4c4dc9d tempest-TestVolumeBackupRestore-997771116 None] About to put_object {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 09:43:21.386973 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-433493bb-8256-4f55-9f6e-59e2c4c4dc9d tempest-TestVolumeBackupRestore-997771116 None] backup MD5 for volume_1c366dd9-1a3c-4cb8-8f7c-4fdabf6fb81e/20260703094315/az_nova_backup_8727aa2b-db7a-4559-b380-bc6d983ed688-00009: 25e317773f308e446cc84c503a6d1f85 {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 09:43:21.386973 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-433493bb-8256-4f55-9f6e-59e2c4c4dc9d tempest-TestVolumeBackupRestore-997771116 None] Calling eventlet.sleep(0) {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 09:43:21.632744 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-433493bb-8256-4f55-9f6e-59e2c4c4dc9d tempest-TestVolumeBackupRestore-997771116 None] Backing up chunk of data from volume. {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 09:43:21.892548 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-433493bb-8256-4f55-9f6e-59e2c4c4dc9d tempest-TestVolumeBackupRestore-997771116 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101319) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 09:43:21.892548 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-433493bb-8256-4f55-9f6e-59e2c4c4dc9d tempest-TestVolumeBackupRestore-997771116 None] About to put_object {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 09:43:22.013948 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-433493bb-8256-4f55-9f6e-59e2c4c4dc9d tempest-TestVolumeBackupRestore-997771116 None] backup MD5 for volume_1c366dd9-1a3c-4cb8-8f7c-4fdabf6fb81e/20260703094315/az_nova_backup_8727aa2b-db7a-4559-b380-bc6d983ed688-00010: 25e317773f308e446cc84c503a6d1f85 {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 09:43:22.014198 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-433493bb-8256-4f55-9f6e-59e2c4c4dc9d tempest-TestVolumeBackupRestore-997771116 None] Calling eventlet.sleep(0) {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 09:43:22.267287 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-433493bb-8256-4f55-9f6e-59e2c4c4dc9d tempest-TestVolumeBackupRestore-997771116 None] Backing up chunk of data from volume. {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 09:43:22.546260 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-433493bb-8256-4f55-9f6e-59e2c4c4dc9d tempest-TestVolumeBackupRestore-997771116 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101319) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 09:43:22.546260 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-433493bb-8256-4f55-9f6e-59e2c4c4dc9d tempest-TestVolumeBackupRestore-997771116 None] About to put_object {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 09:43:22.661362 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-433493bb-8256-4f55-9f6e-59e2c4c4dc9d tempest-TestVolumeBackupRestore-997771116 None] backup MD5 for volume_1c366dd9-1a3c-4cb8-8f7c-4fdabf6fb81e/20260703094315/az_nova_backup_8727aa2b-db7a-4559-b380-bc6d983ed688-00011: 25e317773f308e446cc84c503a6d1f85 {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 09:43:22.661935 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-433493bb-8256-4f55-9f6e-59e2c4c4dc9d tempest-TestVolumeBackupRestore-997771116 None] Calling eventlet.sleep(0) {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 09:43:22.868333 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-433493bb-8256-4f55-9f6e-59e2c4c4dc9d tempest-TestVolumeBackupRestore-997771116 None] Backing up chunk of data from volume. {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 09:43:23.125906 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-433493bb-8256-4f55-9f6e-59e2c4c4dc9d tempest-TestVolumeBackupRestore-997771116 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101319) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 09:43:23.126103 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-433493bb-8256-4f55-9f6e-59e2c4c4dc9d tempest-TestVolumeBackupRestore-997771116 None] About to put_object {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 09:43:23.237399 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-433493bb-8256-4f55-9f6e-59e2c4c4dc9d tempest-TestVolumeBackupRestore-997771116 None] backup MD5 for volume_1c366dd9-1a3c-4cb8-8f7c-4fdabf6fb81e/20260703094315/az_nova_backup_8727aa2b-db7a-4559-b380-bc6d983ed688-00012: 25e317773f308e446cc84c503a6d1f85 {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 09:43:23.237544 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-433493bb-8256-4f55-9f6e-59e2c4c4dc9d tempest-TestVolumeBackupRestore-997771116 None] Calling eventlet.sleep(0) {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 09:43:23.487138 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-433493bb-8256-4f55-9f6e-59e2c4c4dc9d tempest-TestVolumeBackupRestore-997771116 None] Backing up chunk of data from volume. {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 09:43:23.754202 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-433493bb-8256-4f55-9f6e-59e2c4c4dc9d tempest-TestVolumeBackupRestore-997771116 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101319) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 09:43:23.754594 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-433493bb-8256-4f55-9f6e-59e2c4c4dc9d tempest-TestVolumeBackupRestore-997771116 None] About to put_object {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 09:43:23.864904 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-433493bb-8256-4f55-9f6e-59e2c4c4dc9d tempest-TestVolumeBackupRestore-997771116 None] backup MD5 for volume_1c366dd9-1a3c-4cb8-8f7c-4fdabf6fb81e/20260703094315/az_nova_backup_8727aa2b-db7a-4559-b380-bc6d983ed688-00013: 25e317773f308e446cc84c503a6d1f85 {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 09:43:23.865052 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-433493bb-8256-4f55-9f6e-59e2c4c4dc9d tempest-TestVolumeBackupRestore-997771116 None] Calling eventlet.sleep(0) {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 09:43:24.087191 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-433493bb-8256-4f55-9f6e-59e2c4c4dc9d tempest-TestVolumeBackupRestore-997771116 None] Backing up chunk of data from volume. {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 09:43:24.340283 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-433493bb-8256-4f55-9f6e-59e2c4c4dc9d tempest-TestVolumeBackupRestore-997771116 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101319) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 09:43:24.340449 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-433493bb-8256-4f55-9f6e-59e2c4c4dc9d tempest-TestVolumeBackupRestore-997771116 None] About to put_object {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 09:43:24.449888 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-433493bb-8256-4f55-9f6e-59e2c4c4dc9d tempest-TestVolumeBackupRestore-997771116 None] backup MD5 for volume_1c366dd9-1a3c-4cb8-8f7c-4fdabf6fb81e/20260703094315/az_nova_backup_8727aa2b-db7a-4559-b380-bc6d983ed688-00014: 25e317773f308e446cc84c503a6d1f85 {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 09:43:24.450068 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-433493bb-8256-4f55-9f6e-59e2c4c4dc9d tempest-TestVolumeBackupRestore-997771116 None] Calling eventlet.sleep(0) {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 09:43:24.669742 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-433493bb-8256-4f55-9f6e-59e2c4c4dc9d tempest-TestVolumeBackupRestore-997771116 None] Backing up chunk of data from volume. {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 09:43:24.930708 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-433493bb-8256-4f55-9f6e-59e2c4c4dc9d tempest-TestVolumeBackupRestore-997771116 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101319) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 09:43:24.931146 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-433493bb-8256-4f55-9f6e-59e2c4c4dc9d tempest-TestVolumeBackupRestore-997771116 None] About to put_object {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 09:43:25.044601 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-433493bb-8256-4f55-9f6e-59e2c4c4dc9d tempest-TestVolumeBackupRestore-997771116 None] backup MD5 for volume_1c366dd9-1a3c-4cb8-8f7c-4fdabf6fb81e/20260703094315/az_nova_backup_8727aa2b-db7a-4559-b380-bc6d983ed688-00015: 25e317773f308e446cc84c503a6d1f85 {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 09:43:25.044751 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-433493bb-8256-4f55-9f6e-59e2c4c4dc9d tempest-TestVolumeBackupRestore-997771116 None] Calling eventlet.sleep(0) {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 09:43:25.252450 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-433493bb-8256-4f55-9f6e-59e2c4c4dc9d tempest-TestVolumeBackupRestore-997771116 None] Backing up chunk of data from volume. {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 09:43:25.500954 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-433493bb-8256-4f55-9f6e-59e2c4c4dc9d tempest-TestVolumeBackupRestore-997771116 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101319) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 09:43:25.501123 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-433493bb-8256-4f55-9f6e-59e2c4c4dc9d tempest-TestVolumeBackupRestore-997771116 None] About to put_object {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 09:43:25.616840 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-433493bb-8256-4f55-9f6e-59e2c4c4dc9d tempest-TestVolumeBackupRestore-997771116 None] backup MD5 for volume_1c366dd9-1a3c-4cb8-8f7c-4fdabf6fb81e/20260703094315/az_nova_backup_8727aa2b-db7a-4559-b380-bc6d983ed688-00016: 25e317773f308e446cc84c503a6d1f85 {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 09:43:25.617137 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-433493bb-8256-4f55-9f6e-59e2c4c4dc9d tempest-TestVolumeBackupRestore-997771116 None] Calling eventlet.sleep(0) {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 09:43:25.828998 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-433493bb-8256-4f55-9f6e-59e2c4c4dc9d tempest-TestVolumeBackupRestore-997771116 None] Backing up chunk of data from volume. {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 09:43:26.079505 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-433493bb-8256-4f55-9f6e-59e2c4c4dc9d tempest-TestVolumeBackupRestore-997771116 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101319) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 09:43:26.080096 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-433493bb-8256-4f55-9f6e-59e2c4c4dc9d tempest-TestVolumeBackupRestore-997771116 None] About to put_object {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 09:43:26.182768 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-433493bb-8256-4f55-9f6e-59e2c4c4dc9d tempest-TestVolumeBackupRestore-997771116 None] backup MD5 for volume_1c366dd9-1a3c-4cb8-8f7c-4fdabf6fb81e/20260703094315/az_nova_backup_8727aa2b-db7a-4559-b380-bc6d983ed688-00017: 25e317773f308e446cc84c503a6d1f85 {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 09:43:26.182768 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-433493bb-8256-4f55-9f6e-59e2c4c4dc9d tempest-TestVolumeBackupRestore-997771116 None] Calling eventlet.sleep(0) {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 09:43:26.420155 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-433493bb-8256-4f55-9f6e-59e2c4c4dc9d tempest-TestVolumeBackupRestore-997771116 None] Backing up chunk of data from volume. {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 09:43:26.660106 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-433493bb-8256-4f55-9f6e-59e2c4c4dc9d tempest-TestVolumeBackupRestore-997771116 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101319) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 09:43:26.660106 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-433493bb-8256-4f55-9f6e-59e2c4c4dc9d tempest-TestVolumeBackupRestore-997771116 None] About to put_object {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 09:43:26.760109 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-433493bb-8256-4f55-9f6e-59e2c4c4dc9d tempest-TestVolumeBackupRestore-997771116 None] backup MD5 for volume_1c366dd9-1a3c-4cb8-8f7c-4fdabf6fb81e/20260703094315/az_nova_backup_8727aa2b-db7a-4559-b380-bc6d983ed688-00018: 25e317773f308e446cc84c503a6d1f85 {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 09:43:26.760109 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-433493bb-8256-4f55-9f6e-59e2c4c4dc9d tempest-TestVolumeBackupRestore-997771116 None] Calling eventlet.sleep(0) {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 09:43:26.965259 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-433493bb-8256-4f55-9f6e-59e2c4c4dc9d tempest-TestVolumeBackupRestore-997771116 None] Backing up chunk of data from volume. {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 09:43:27.219641 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-433493bb-8256-4f55-9f6e-59e2c4c4dc9d tempest-TestVolumeBackupRestore-997771116 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101319) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 09:43:27.219641 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-433493bb-8256-4f55-9f6e-59e2c4c4dc9d tempest-TestVolumeBackupRestore-997771116 None] About to put_object {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 09:43:27.346572 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-433493bb-8256-4f55-9f6e-59e2c4c4dc9d tempest-TestVolumeBackupRestore-997771116 None] backup MD5 for volume_1c366dd9-1a3c-4cb8-8f7c-4fdabf6fb81e/20260703094315/az_nova_backup_8727aa2b-db7a-4559-b380-bc6d983ed688-00019: 25e317773f308e446cc84c503a6d1f85 {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 09:43:27.346572 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-433493bb-8256-4f55-9f6e-59e2c4c4dc9d tempest-TestVolumeBackupRestore-997771116 None] Calling eventlet.sleep(0) {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 09:43:27.546734 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-433493bb-8256-4f55-9f6e-59e2c4c4dc9d tempest-TestVolumeBackupRestore-997771116 None] Backing up chunk of data from volume. {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 09:43:27.809601 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-433493bb-8256-4f55-9f6e-59e2c4c4dc9d tempest-TestVolumeBackupRestore-997771116 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101319) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 09:43:27.809601 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-433493bb-8256-4f55-9f6e-59e2c4c4dc9d tempest-TestVolumeBackupRestore-997771116 None] About to put_object {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 09:43:27.914281 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-433493bb-8256-4f55-9f6e-59e2c4c4dc9d tempest-TestVolumeBackupRestore-997771116 None] backup MD5 for volume_1c366dd9-1a3c-4cb8-8f7c-4fdabf6fb81e/20260703094315/az_nova_backup_8727aa2b-db7a-4559-b380-bc6d983ed688-00020: 25e317773f308e446cc84c503a6d1f85 {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 09:43:27.914281 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-433493bb-8256-4f55-9f6e-59e2c4c4dc9d tempest-TestVolumeBackupRestore-997771116 None] Calling eventlet.sleep(0) {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 09:43:28.006432 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-433493bb-8256-4f55-9f6e-59e2c4c4dc9d tempest-TestVolumeBackupRestore-997771116 None] Backing up chunk of data from volume. {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 09:43:28.133195 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-433493bb-8256-4f55-9f6e-59e2c4c4dc9d tempest-TestVolumeBackupRestore-997771116 None] Compressed 25165824 bytes of data to 24470 bytes using zlib. {{(pid=101319) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 09:43:28.133588 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-433493bb-8256-4f55-9f6e-59e2c4c4dc9d tempest-TestVolumeBackupRestore-997771116 None] About to put_object {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 09:43:28.193182 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-433493bb-8256-4f55-9f6e-59e2c4c4dc9d tempest-TestVolumeBackupRestore-997771116 None] backup MD5 for volume_1c366dd9-1a3c-4cb8-8f7c-4fdabf6fb81e/20260703094315/az_nova_backup_8727aa2b-db7a-4559-b380-bc6d983ed688-00021: 77377273b0a4b61febdbf7bbf52b9db9 {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 09:43:28.194810 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-433493bb-8256-4f55-9f6e-59e2c4c4dc9d tempest-TestVolumeBackupRestore-997771116 None] Calling eventlet.sleep(0) {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 09:43:28.201019 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.driver [None req-433493bb-8256-4f55-9f6e-59e2c4c4dc9d tempest-TestVolumeBackupRestore-997771116 None] Getting metadata type 'volume-base-metadata' {{(pid=101319) _save_vol_base_meta /opt/stack/cinder/cinder/backup/driver.py:79}} Jul 03 09:43:28.206463 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.driver [None req-433493bb-8256-4f55-9f6e-59e2c4c4dc9d tempest-TestVolumeBackupRestore-997771116 None] Completed fetching metadata type 'volume-base-metadata' {{(pid=101319) _save_vol_base_meta /opt/stack/cinder/cinder/backup/driver.py:98}} Jul 03 09:43:28.206804 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.driver [None req-433493bb-8256-4f55-9f6e-59e2c4c4dc9d tempest-TestVolumeBackupRestore-997771116 None] Getting metadata type 'volume-metadata' {{(pid=101319) _save_vol_meta /opt/stack/cinder/cinder/backup/driver.py:109}} Jul 03 09:43:28.211308 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.driver [None req-433493bb-8256-4f55-9f6e-59e2c4c4dc9d tempest-TestVolumeBackupRestore-997771116 None] No metadata type 'volume-metadata' available {{(pid=101319) _save_vol_meta /opt/stack/cinder/cinder/backup/driver.py:123}} Jul 03 09:43:28.211646 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.driver [None req-433493bb-8256-4f55-9f6e-59e2c4c4dc9d tempest-TestVolumeBackupRestore-997771116 None] Getting metadata type 'volume-glance-metadata' {{(pid=101319) _save_vol_glance_meta /opt/stack/cinder/cinder/backup/driver.py:132}} Jul 03 09:43:28.215200 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.driver [None req-433493bb-8256-4f55-9f6e-59e2c4c4dc9d tempest-TestVolumeBackupRestore-997771116 None] Completed fetching metadata type 'volume-glance-metadata' {{(pid=101319) _save_vol_glance_meta /opt/stack/cinder/cinder/backup/driver.py:145}} Jul 03 09:43:28.215624 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-433493bb-8256-4f55-9f6e-59e2c4c4dc9d tempest-TestVolumeBackupRestore-997771116 None] _write_sha256file started, container name: volumebackups, sha256file filename: volume_1c366dd9-1a3c-4cb8-8f7c-4fdabf6fb81e/20260703094315/az_nova_backup_8727aa2b-db7a-4559-b380-bc6d983ed688_sha256file. {{(pid=101319) _write_sha256file /opt/stack/cinder/cinder/backup/chunkeddriver.py:299}} Jul 03 09:43:28.273933 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-433493bb-8256-4f55-9f6e-59e2c4c4dc9d tempest-TestVolumeBackupRestore-997771116 None] _write_sha256file finished. {{(pid=101319) _write_sha256file /opt/stack/cinder/cinder/backup/chunkeddriver.py:315}} Jul 03 09:43:28.273933 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-433493bb-8256-4f55-9f6e-59e2c4c4dc9d tempest-TestVolumeBackupRestore-997771116 None] _write_metadata started, container name: volumebackups, metadata filename: volume_1c366dd9-1a3c-4cb8-8f7c-4fdabf6fb81e/20260703094315/az_nova_backup_8727aa2b-db7a-4559-b380-bc6d983ed688_metadata. {{(pid=101319) _write_metadata /opt/stack/cinder/cinder/backup/chunkeddriver.py:276}} Jul 03 09:43:28.299361 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-433493bb-8256-4f55-9f6e-59e2c4c4dc9d tempest-TestVolumeBackupRestore-997771116 None] _write_metadata finished. Metadata: b'{\n "backup_description": null,\n "backup_id": "8727aa2b-db7a-4559-b380-bc6d983ed688",\n "backup_name": "tempest-TestVolumeBackupRestore-backup-21470280",\n "created_at": "2026-07-03 09:43:09+00:00",\n "objects": [\n {\n "volume_1c366dd9-1a3c-4cb8-8f7c-4fdabf6fb81e/20260703094315/az_nova_backup_8727aa2b-db7a-4559-b380-bc6d983ed688-00001": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "82571f7121cb9475563edde615e4e4df",\n "offset": 0\n }\n },\n {\n "volume_1c366dd9-1a3c-4cb8-8f7c-4fdabf6fb81e/20260703094315/az_nova_backup_8727aa2b-db7a-4559-b380-bc6d983ed688-00002": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 52428800\n }\n },\n {\n "volume_1c366dd9-1a3c-4cb8-8f7c-4fdabf6fb81e/20260703094315/az_nova_backup_8727aa2b-db7a-4559-b380-bc6d983ed688-00003": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "a35891500449df17e893f84bd88472fb",\n "offset": 104857600\n }\n },\n {\n "volume_1c366dd9-1a3c-4cb8-8f7c-4fdabf6fb81e/20260703094315/az_nova_backup_8727aa2b-db7a-4559-b380-bc6d983ed688-00004": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 157286400\n }\n },\n {\n "volume_1c366dd9-1a3c-4cb8-8f7c-4fdabf6fb81e/20260703094315/az_nova_backup_8727aa2b-db7a-4559-b380-bc6d983ed688-00005": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 209715200\n }\n },\n {\n "volume_1c366dd9-1a3c-4cb8-8f7c-4fdabf6fb81e/20260703094315/az_nova_backup_8727aa2b-db7a-4559-b380-bc6d983ed688-00006": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 262144000\n }\n },\n {\n "volume_1c366dd9-1a3c-4cb8-8f7c-4fdabf6fb81e/20260703094315/az_nova_backup_8727aa2b-db7a-4559-b380-bc6d983ed688-00007": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 314572800\n }\n },\n {\n "volume_1c366dd9-1a3c-4cb8-8f7c-4fdabf6fb81e/20260703094315/az_nova_backup_8727aa2b-db7a-4559-b380-bc6d983ed688-00008": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 367001600\n }\n },\n {\n "volume_1c366dd9-1a3c-4cb8-8f7c-4fdabf6fb81e/20260703094315/az_nova_backup_8727aa2b-db7a-4559-b380-bc6d983ed688-00009": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 419430400\n }\n },\n {\n "volume_1c366dd9-1a3c-4cb8-8f7c-4fdabf6fb81e/20260703094315/az_nova_backup_8727aa2b-db7a-4559-b380-bc6d983ed688-00010": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 471859200\n }\n },\n {\n "volume_1c366dd9-1a3c-4cb8-8f7c-4fdabf6fb81e/20260703094315/az_nova_backup_8727aa2b-db7a-4559-b380-bc6d983ed688-00011": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 524288000\n }\n },\n {\n "volume_1c366dd9-1a3c-4cb8-8f7c-4fdabf6fb81e/20260703094315/az_nova_backup_8727aa2b-db7a-4559-b380-bc6d983ed688-00012": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 576716800\n }\n },\n {\n "volume_1c366dd9-1a3c-4cb8-8f7c-4fdabf6fb81e/20260703094315/az_nova_backup_8727aa2b-db7a-4559-b380-bc6d983ed688-00013": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 629145600\n }\n },\n {\n "volume_1c366dd9-1a3c-4cb8-8f7c-4fdabf6fb81e/20260703094315/az_nova_backup_8727aa2b-db7a-4559-b380-bc6d983ed688-00014": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 681574400\n }\n },\n {\n "volume_1c366dd9-1a3c-4cb8-8f7c-4fdabf6fb81e/20260703094315/az_nova_backup_8727aa2b-db7a-4559-b380-bc6d983ed688-00015": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 734003200\n }\n },\n {\n "volume_1c366dd9-1a3c-4cb8-8f7c-4fdabf6fb81e/20260703094315/az_nova_backup_8727aa2b-db7a-4559-b380-bc6d983ed688-00016": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 786432000\n }\n },\n {\n "volume_1c366dd9-1a3c-4cb8-8f7c-4fdabf6fb81e/20260703094315/az_nova_backup_8727aa2b-db7a-4559-b380-bc6d983ed688-00017": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 838860800\n }\n },\n {\n "volume_1c366dd9-1a3c-4cb8-8f7c-4fdabf6fb81e/20260703094315/az_nova_backup_8727aa2b-db7a-4559-b380-bc6d983ed688-00018": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 891289600\n }\n },\n {\n "volume_1c366dd9-1a3c-4cb8-8f7c-4fdabf6fb81e/20260703094315/az_nova_backup_8727aa2b-db7a-4559-b380-bc6d983ed688-00019": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 943718400\n }\n },\n {\n "volume_1c366dd9-1a3c-4cb8-8f7c-4fdabf6fb81e/20260703094315/az_nova_backup_8727aa2b-db7a-4559-b380-bc6d983ed688-00020": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 996147200\n }\n },\n {\n "volume_1c366dd9-1a3c-4cb8-8f7c-4fdabf6fb81e/20260703094315/az_nova_backup_8727aa2b-db7a-4559-b380-bc6d983ed688-00021": {\n "compression": "zlib",\n "length": 25165824,\n "md5": "77377273b0a4b61febdbf7bbf52b9db9",\n "offset": 1048576000\n }\n }\n ],\n "parent_id": null,\n "version": "1.0.0",\n "volume_id": "1c366dd9-1a3c-4cb8-8f7c-4fdabf6fb81e",\n "volume_meta": "{\\"version\\": 2, \\"volume-base-metadata\\": {\\"id\\": \\"1c366dd9-1a3c-4cb8-8f7c-4fdabf6fb81e\\", \\"_name_id\\": null, \\"use_quota\\": true, \\"ec2_id\\": null, \\"user_id\\": \\"291d5b00365c48af818ae26172e33eae\\", \\"project_id\\": \\"8a91a271598c49e1b52c4e2c3a0f4413\\", \\"snapshot_id\\": null, \\"cluster_name\\": null, \\"host\\": \\"np0000004400@storpool#default\\", \\"size\\": 1, \\"availability_zone\\": \\"nova\\", \\"status\\": \\"backing-up\\", \\"attach_status\\": \\"detached\\", \\"migration_status\\": null, \\"scheduled_at\\": \\"2026-07-03T09:43:08.000000\\", \\"launched_at\\": \\"2026-07-03T09:43:09.000000\\", \\"terminated_at\\": null, \\"display_name\\": \\"tempest-TestVolumeBackupRestore-volume-978809464\\", \\"display_description\\": null, \\"provider_location\\": null, \\"provider_auth\\": null, \\"provider_geometry\\": null, \\"provider_id\\": null, \\"volume_type_id\\": \\"03e13fe6-0e30-4803-ace0-725d38e6dc24\\", \\"source_volid\\": null, \\"encryption_key_id\\": null, \\"consistencygroup_id\\": null, \\"group_id\\": null, \\"bootable\\": true, \\"multiattach\\": false, \\"replication_status\\": null, \\"replication_extended_status\\": null, \\"replication_driver_data\\": null, \\"previous_status\\": \\"available\\", \\"service_uuid\\": \\"6d4b0e79-fefe-4744-b25f-34be05095200\\", \\"shared_targets\\": true, \\"deleted_at\\": null, \\"deleted\\": false, \\"created_at\\": \\"2026-07-03T09:43:08.000000\\", \\"updated_at\\": \\"2026-07-03T09:43:09.000000\\"}, \\"volume-glance-metadata\\": {\\"hw_rng_model\\": \\"virtio\\", \\"os_glance_failed_import\\": \\"\\", \\"os_glance_importing_to_stores\\": \\"\\", \\"owner_specified.openstack.md5\\": \\"\\", \\"owner_specified.openstack.object\\": \\"images/cirros-0.6.3-x86_64-disk\\", \\"owner_specified.openstack.sha256\\": \\"\\", \\"image_id\\": \\"c1946dda-7935-4a75-a25a-cf65d1d25617\\", \\"image_name\\": \\"cirros-0.6.3-x86_64-disk\\", \\"checksum\\": \\"87617e24a5e30cb3b87fda8c0764838f\\", \\"container_format\\": \\"bare\\", \\"disk_format\\": \\"qcow2\\", \\"min_disk\\": \\"0\\", \\"min_ram\\": \\"0\\", \\"size\\": \\"21692416\\"}}"\n}'. {{(pid=101319) _write_metadata /opt/stack/cinder/cinder/backup/chunkeddriver.py:295}} Jul 03 09:43:28.306960 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-433493bb-8256-4f55-9f6e-59e2c4c4dc9d tempest-TestVolumeBackupRestore-997771116 None] backup 8727aa2b-db7a-4559-b380-bc6d983ed688 finished. {{(pid=101319) _finalize_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:462}} Jul 03 09:43:28.444849 np0000004400 cinder-backup[101319]: DEBUG oslo_concurrency.processutils [None req-433493bb-8256-4f55-9f6e-59e2c4c4dc9d tempest-TestVolumeBackupRestore-997771116 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chown 0 /dev/sdb {{(pid=101319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 09:43:28.465139 np0000004400 sudo[131754]: stack : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chown 0 /dev/sdb Jul 03 09:43:28.465996 np0000004400 sudo[131754]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1002) Jul 03 09:43:28.827532 np0000004400 sudo[131754]: pam_unix(sudo:session): session closed for user root Jul 03 09:43:28.829672 np0000004400 cinder-backup[101319]: DEBUG oslo_concurrency.processutils [None req-433493bb-8256-4f55-9f6e-59e2c4c4dc9d tempest-TestVolumeBackupRestore-997771116 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chown 0 /dev/sdb" returned: 0 in 0.385s {{(pid=101319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 09:43:28.830295 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-433493bb-8256-4f55-9f6e-59e2c4c4dc9d tempest-TestVolumeBackupRestore-997771116 None] ==> disconnect_volume: call "{'args': (, {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-1c366dd9-1a3c-4cb8-8f7c-4fdabf6fb81e', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '1c366dd9-1a3c-4cb8-8f7c-4fdabf6fb81e', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': False}, {'type': 'block', 'scsi_wwn': '1StorPooliSCSI_DISK_1034578903445798998', 'path': '/dev/sdb'}), 'kwargs': {'force': True, 'ignore_errors': True}}" {{(pid=101319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}} Jul 03 09:43:28.830460 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.base [None req-433493bb-8256-4f55-9f6e-59e2c4c4dc9d tempest-TestVolumeBackupRestore-997771116 None] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=101319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jul 03 09:43:28.830937 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.base [None req-433493bb-8256-4f55-9f6e-59e2c4c4dc9d tempest-TestVolumeBackupRestore-997771116 None] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.000s {{(pid=101319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jul 03 09:43:28.831273 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-433493bb-8256-4f55-9f6e-59e2c4c4dc9d tempest-TestVolumeBackupRestore-997771116 None] _get_connection_devices called with parameters: connection_properties={'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-1c366dd9-1a3c-4cb8-8f7c-4fdabf6fb81e', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '1c366dd9-1a3c-4cb8-8f7c-4fdabf6fb81e', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': False}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=101319) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:847}} Jul 03 09:43:28.843351 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-433493bb-8256-4f55-9f6e-59e2c4c4dc9d tempest-TestVolumeBackupRestore-997771116 None] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS: Jul 03 09:43:28.843351 np0000004400 cinder-backup[101319]: No targets found. Jul 03 09:43:28.843351 np0000004400 cinder-backup[101319]: iSNS: Jul 03 09:43:28.843351 np0000004400 cinder-backup[101319]: No targets found. Jul 03 09:43:28.843351 np0000004400 cinder-backup[101319]: STATIC: Jul 03 09:43:28.843351 np0000004400 cinder-backup[101319]: Target: iqn.2023-03.storpool.com:os--volume-b2e4f10c-8033-4c54-95a1-dfe45d6357a3 Jul 03 09:43:28.843351 np0000004400 cinder-backup[101319]: Portal: 192.168.50.100:3260,-1 Jul 03 09:43:28.843351 np0000004400 cinder-backup[101319]: Iface Name: default Jul 03 09:43:28.843351 np0000004400 cinder-backup[101319]: Portal: 192.168.40.100:3260,-1 Jul 03 09:43:28.843351 np0000004400 cinder-backup[101319]: Iface Name: default Jul 03 09:43:28.843351 np0000004400 cinder-backup[101319]: Target: iqn.2023-03.storpool.com:os--volume-f1c2bb03-f1f4-4186-9466-3b699bca16e6 Jul 03 09:43:28.843351 np0000004400 cinder-backup[101319]: Portal: 192.168.50.100:3260,-1 Jul 03 09:43:28.843351 np0000004400 cinder-backup[101319]: Iface Name: default Jul 03 09:43:28.843351 np0000004400 cinder-backup[101319]: Portal: 192.168.40.100:3260,-1 Jul 03 09:43:28.843351 np0000004400 cinder-backup[101319]: Iface Name: default Jul 03 09:43:28.843351 np0000004400 cinder-backup[101319]: Target: iqn.2023-03.storpool.com:os--volume-e9e3f386-d923-4ae1-a6ce-8dd2091673ac Jul 03 09:43:28.843351 np0000004400 cinder-backup[101319]: Portal: 192.168.50.100:3260,-1 Jul 03 09:43:28.843351 np0000004400 cinder-backup[101319]: Iface Name: default Jul 03 09:43:28.843351 np0000004400 cinder-backup[101319]: Portal: 192.168.40.100:3260,-1 Jul 03 09:43:28.843351 np0000004400 cinder-backup[101319]: Iface Name: default Jul 03 09:43:28.843351 np0000004400 cinder-backup[101319]: Target: iqn.2023-03.storpool.com:os--volume-1c366dd9-1a3c-4cb8-8f7c-4fdabf6fb81e Jul 03 09:43:28.843351 np0000004400 cinder-backup[101319]: Portal: 192.168.40.100:3260,-1 Jul 03 09:43:28.843351 np0000004400 cinder-backup[101319]: Iface Name: default Jul 03 09:43:28.843351 np0000004400 cinder-backup[101319]: FIRMWARE: Jul 03 09:43:28.843351 np0000004400 cinder-backup[101319]: No targets found. Jul 03 09:43:28.843351 np0000004400 cinder-backup[101319]: stderr= {{(pid=101319) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jul 03 09:43:28.846462 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-433493bb-8256-4f55-9f6e-59e2c4c4dc9d tempest-TestVolumeBackupRestore-997771116 None] Regex to get portals from discoverydb: ^SENDTARGETS: Jul 03 09:43:28.846462 np0000004400 cinder-backup[101319]: .*?^DiscoveryAddress: 192.168.40.100,3260.*? Jul 03 09:43:28.846462 np0000004400 cinder-backup[101319]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=101319) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:390}} Jul 03 09:43:28.846462 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-433493bb-8256-4f55-9f6e-59e2c4c4dc9d tempest-TestVolumeBackupRestore-997771116 None] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-1c366dd9-1a3c-4cb8-8f7c-4fdabf6fb81e', 0)] {{(pid=101319) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:858}} Jul 03 09:43:28.870950 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-433493bb-8256-4f55-9f6e-59e2c4c4dc9d tempest-TestVolumeBackupRestore-997771116 None] iscsiadm ('-m', 'session'): stdout=tcp: [49] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b2e4f10c-8033-4c54-95a1-dfe45d6357a3 (non-flash) Jul 03 09:43:28.870950 np0000004400 cinder-backup[101319]: tcp: [50] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b2e4f10c-8033-4c54-95a1-dfe45d6357a3 (non-flash) Jul 03 09:43:28.870950 np0000004400 cinder-backup[101319]: tcp: [72] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e9e3f386-d923-4ae1-a6ce-8dd2091673ac (non-flash) Jul 03 09:43:28.870950 np0000004400 cinder-backup[101319]: tcp: [73] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e9e3f386-d923-4ae1-a6ce-8dd2091673ac (non-flash) Jul 03 09:43:28.870950 np0000004400 cinder-backup[101319]: tcp: [76] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f1c2bb03-f1f4-4186-9466-3b699bca16e6 (non-flash) Jul 03 09:43:28.870950 np0000004400 cinder-backup[101319]: tcp: [77] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f1c2bb03-f1f4-4186-9466-3b699bca16e6 (non-flash) Jul 03 09:43:28.870950 np0000004400 cinder-backup[101319]: tcp: [78] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1c366dd9-1a3c-4cb8-8f7c-4fdabf6fb81e (non-flash) Jul 03 09:43:28.870950 np0000004400 cinder-backup[101319]: stderr= {{(pid=101319) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jul 03 09:43:28.871417 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-433493bb-8256-4f55-9f6e-59e2c4c4dc9d tempest-TestVolumeBackupRestore-997771116 None] iscsi session list stdout=tcp: [49] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b2e4f10c-8033-4c54-95a1-dfe45d6357a3 (non-flash) Jul 03 09:43:28.871417 np0000004400 cinder-backup[101319]: tcp: [50] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b2e4f10c-8033-4c54-95a1-dfe45d6357a3 (non-flash) Jul 03 09:43:28.871417 np0000004400 cinder-backup[101319]: tcp: [72] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e9e3f386-d923-4ae1-a6ce-8dd2091673ac (non-flash) Jul 03 09:43:28.871417 np0000004400 cinder-backup[101319]: tcp: [73] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e9e3f386-d923-4ae1-a6ce-8dd2091673ac (non-flash) Jul 03 09:43:28.871417 np0000004400 cinder-backup[101319]: tcp: [76] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f1c2bb03-f1f4-4186-9466-3b699bca16e6 (non-flash) Jul 03 09:43:28.871417 np0000004400 cinder-backup[101319]: tcp: [77] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f1c2bb03-f1f4-4186-9466-3b699bca16e6 (non-flash) Jul 03 09:43:28.871417 np0000004400 cinder-backup[101319]: tcp: [78] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1c366dd9-1a3c-4cb8-8f7c-4fdabf6fb81e (non-flash) Jul 03 09:43:28.871417 np0000004400 cinder-backup[101319]: stderr= {{(pid=101319) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jul 03 09:43:28.871417 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-433493bb-8256-4f55-9f6e-59e2c4c4dc9d tempest-TestVolumeBackupRestore-997771116 None] Sessions list: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-b2e4f10c-8033-4c54-95a1-dfe45d6357a3', '49'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-b2e4f10c-8033-4c54-95a1-dfe45d6357a3', '50'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-e9e3f386-d923-4ae1-a6ce-8dd2091673ac', '72'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-e9e3f386-d923-4ae1-a6ce-8dd2091673ac', '73'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-f1c2bb03-f1f4-4186-9466-3b699bca16e6', '76'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-f1c2bb03-f1f4-4186-9466-3b699bca16e6', '77'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-1c366dd9-1a3c-4cb8-8f7c-4fdabf6fb81e', '78')] {{(pid=101319) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:866}} Jul 03 09:43:28.871417 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-433493bb-8256-4f55-9f6e-59e2c4c4dc9d tempest-TestVolumeBackupRestore-997771116 None] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-1c366dd9-1a3c-4cb8-8f7c-4fdabf6fb81e, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-1c366dd9-1a3c-4cb8-8f7c-4fdabf6fb81e', '78')] {{(pid=101319) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}} Jul 03 09:43:28.872372 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-433493bb-8256-4f55-9f6e-59e2c4c4dc9d tempest-TestVolumeBackupRestore-997771116 None] Resulting device map defaultdict(. at 0x7e76e7132d40>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-1c366dd9-1a3c-4cb8-8f7c-4fdabf6fb81e'): ({'sdb'}, set())}) {{(pid=101319) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:912}} Jul 03 09:43:28.872589 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.linuxscsi [None req-433493bb-8256-4f55-9f6e-59e2c4c4dc9d tempest-TestVolumeBackupRestore-997771116 None] Removing single pathed devices sdb {{(pid=101319) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}} Jul 03 09:43:28.883208 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.linuxscsi [None req-433493bb-8256-4f55-9f6e-59e2c4c4dc9d tempest-TestVolumeBackupRestore-997771116 None] Flushing IO for device /dev/sdb {{(pid=101319) flush_device_io /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:461}} Jul 03 09:43:28.893532 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.linuxscsi [None req-433493bb-8256-4f55-9f6e-59e2c4c4dc9d tempest-TestVolumeBackupRestore-997771116 None] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=101319) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}} Jul 03 09:43:28.939883 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.linuxscsi [None req-433493bb-8256-4f55-9f6e-59e2c4c4dc9d tempest-TestVolumeBackupRestore-997771116 None] Checking to see if SCSI volumes sdb have been removed. {{(pid=101319) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}} Jul 03 09:43:28.939991 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.linuxscsi [None req-433493bb-8256-4f55-9f6e-59e2c4c4dc9d tempest-TestVolumeBackupRestore-997771116 None] SCSI volumes sdb have been removed. {{(pid=101319) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}} Jul 03 09:43:28.941080 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.linuxscsi [None req-433493bb-8256-4f55-9f6e-59e2c4c4dc9d tempest-TestVolumeBackupRestore-997771116 None] Checking to see if device paths {'sdb'} are still under multipathd monitoring {{(pid=101319) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}} Jul 03 09:43:28.952869 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.linuxscsi [None req-433493bb-8256-4f55-9f6e-59e2c4c4dc9d tempest-TestVolumeBackupRestore-997771116 None] Device paths {'sdb'} have been removed from multipathd monitoring. {{(pid=101319) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}} Jul 03 09:43:28.953078 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-433493bb-8256-4f55-9f6e-59e2c4c4dc9d tempest-TestVolumeBackupRestore-997771116 None] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-1c366dd9-1a3c-4cb8-8f7c-4fdabf6fb81e')] {{(pid=101319) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1225}} Jul 03 09:43:28.964055 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-433493bb-8256-4f55-9f6e-59e2c4c4dc9d tempest-TestVolumeBackupRestore-997771116 None] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=101319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 03 09:43:29.000708 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-433493bb-8256-4f55-9f6e-59e2c4c4dc9d tempest-TestVolumeBackupRestore-997771116 None] iscsiadm ('--logout',): stdout=Logging out of session [sid: 78, target: iqn.2023-03.storpool.com:os--volume-1c366dd9-1a3c-4cb8-8f7c-4fdabf6fb81e, portal: 192.168.40.100,3260] Jul 03 09:43:29.000708 np0000004400 cinder-backup[101319]: Logout of [sid: 78, target: iqn.2023-03.storpool.com:os--volume-1c366dd9-1a3c-4cb8-8f7c-4fdabf6fb81e, portal: 192.168.40.100,3260] successful. Jul 03 09:43:29.000708 np0000004400 cinder-backup[101319]: stderr= {{(pid=101319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 03 09:43:29.015386 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-433493bb-8256-4f55-9f6e-59e2c4c4dc9d tempest-TestVolumeBackupRestore-997771116 None] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=101319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 03 09:43:29.015790 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.base [None req-433493bb-8256-4f55-9f6e-59e2c4c4dc9d tempest-TestVolumeBackupRestore-997771116 None] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.185s {{(pid=101319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jul 03 09:43:29.015965 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-433493bb-8256-4f55-9f6e-59e2c4c4dc9d tempest-TestVolumeBackupRestore-997771116 None] <== disconnect_volume: return (185ms) None {{(pid=101319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}} Jul 03 09:43:30.035609 np0000004400 cinder-backup[101319]: INFO cinder.backup.manager [None req-433493bb-8256-4f55-9f6e-59e2c4c4dc9d tempest-TestVolumeBackupRestore-997771116 None] Create backup finished. backup: 8727aa2b-db7a-4559-b380-bc6d983ed688. Jul 03 09:43:32.175534 np0000004400 cinder-backup[101319]: INFO cinder.backup.manager [None req-44b0aacb-2564-4929-a850-d3de5c4c76bc tempest-TestVolumeBackupRestore-997771116 None] Restore backup started, backup: 8727aa2b-db7a-4559-b380-bc6d983ed688 volume: 12c3303b-9d75-4de7-bffd-31f22f904503. Jul 03 09:43:32.190148 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.drivers.swift [None req-44b0aacb-2564-4929-a850-d3de5c4c76bc tempest-TestVolumeBackupRestore-997771116 None] Using swift URL https://10.4.3.95:8080/v1/AUTH_8a91a271598c49e1b52c4e2c3a0f4413 {{(pid=101319) initialize /opt/stack/cinder/cinder/backup/drivers/swift.py:300}} Jul 03 09:43:32.191029 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.drivers.swift [None req-44b0aacb-2564-4929-a850-d3de5c4c76bc tempest-TestVolumeBackupRestore-997771116 None] Connect to https://10.4.3.95:8080/v1/AUTH_ in "per_user" mode {{(pid=101319) initialize /opt/stack/cinder/cinder/backup/drivers/swift.py:301}} Jul 03 09:43:32.191029 np0000004400 cinder-backup[101319]: DEBUG os_brick.utils [None req-44b0aacb-2564-4929-a850-d3de5c4c76bc tempest-TestVolumeBackupRestore-997771116 None] ==> get_connector_properties: call "{'root_helper': 'sudo cinder-rootwrap /etc/cinder/rootwrap.conf', 'my_ip': '10.4.3.95', 'multipath': False, 'enforce_multipath': False, 'host': None, 'execute': None}" {{(pid=101319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}} Jul 03 09:43:32.204173 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.scaleio [None req-44b0aacb-2564-4929-a850-d3de5c4c76bc tempest-TestVolumeBackupRestore-997771116 None] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=101319) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}} Jul 03 09:43:32.225892 np0000004400 cinder-backup[101319]: DEBUG oslo_concurrency.processutils [None req-44b0aacb-2564-4929-a850-d3de5c4c76bc tempest-TestVolumeBackupRestore-997771116 None] Running cmd (subprocess): nvme version {{(pid=101319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 09:43:32.236952 np0000004400 cinder-backup[101319]: DEBUG oslo_concurrency.processutils [None req-44b0aacb-2564-4929-a850-d3de5c4c76bc tempest-TestVolumeBackupRestore-997771116 None] 'nvme version' failed. Not Retrying. {{(pid=101319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 03 09:43:32.237230 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.nvmeof [None req-44b0aacb-2564-4929-a850-d3de5c4c76bc tempest-TestVolumeBackupRestore-997771116 None] nvme not present on system {{(pid=101319) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}} Jul 03 09:43:32.245534 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.lightos [None req-44b0aacb-2564-4929-a850-d3de5c4c76bc tempest-TestVolumeBackupRestore-997771116 None] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=101319) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}} Jul 03 09:43:32.247631 np0000004400 cinder-backup[101319]: INFO os_brick.initiator.connectors.lightos [None req-44b0aacb-2564-4929-a850-d3de5c4c76bc tempest-TestVolumeBackupRestore-997771116 None] Current host hostNQN and IP(s) are ['10.4.3.95', 'fe80::f816:3eff:fe47:268c', '192.168.40.6', 'fe80::f816:3eff:febf:7be2', '192.168.50.6', 'fe80::f816:3eff:fe99:8914', '192.168.10.6', 'fe80::f816:3eff:fe2f:e696', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::bc9d:84ff:fec2:6b49', 'fe80::fc16:3eff:fe36:77bf', 'fe80::4c47:1ff:fe64:1879', 'fe80::fc16:3eff:fec6:c223', 'fe80::fc16:3eff:fef5:5e6e', 'fe80::fc16:3eff:fedf:37a6', 'fe80::94d0:62ff:fec5:3886', 'fe80::fc16:3eff:fe48:c24e', 'fe80::fc16:3eff:feec:2e14', 'fe80::a1:38ff:fe3d:434b', 'fe80::fc16:3eff:fea8:bf8b', 'fe80::fc16:3eff:fe1e:8450', 'fe80::8435:18ff:feb9:798c', 'fe80::fc16:3eff:fe42:afa1', 'fe80::fc16:3eff:fe3c:b815', 'fe80::805e:f3ff:feed:d24e', 'fe80::fc16:3eff:fe63:d9db'] Jul 03 09:43:32.247906 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.lightos [None req-44b0aacb-2564-4929-a850-d3de5c4c76bc tempest-TestVolumeBackupRestore-997771116 None] LIGHTOS: did not find dsc, continuing anyway. {{(pid=101319) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}} Jul 03 09:43:32.248102 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.lightos [None req-44b0aacb-2564-4929-a850-d3de5c4c76bc tempest-TestVolumeBackupRestore-997771116 None] LIGHTOS: no hostnqn found. {{(pid=101319) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}} Jul 03 09:43:32.248807 np0000004400 cinder-backup[101319]: DEBUG os_brick.utils [None req-44b0aacb-2564-4929-a850-d3de5c4c76bc tempest-TestVolumeBackupRestore-997771116 None] <== get_connector_properties: return (57ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.95', 'host': 'np0000004400', 'multipath': False, 'enforce_multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:ae7e5bb0ebe6', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': '6b284368-d0ba-4d18-af6f-4998d3955c52', 'nvme_native_multipath': False} {{(pid=101319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}} Jul 03 09:43:33.267260 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connector [None req-44b0aacb-2564-4929-a850-d3de5c4c76bc tempest-TestVolumeBackupRestore-997771116 None] Factory for iscsi on None {{(pid=101319) factory /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connector.py:243}} Jul 03 09:43:33.268421 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-44b0aacb-2564-4929-a850-d3de5c4c76bc tempest-TestVolumeBackupRestore-997771116 None] ==> connect_volume: call "{'self': , 'connection_properties': {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-12c3303b-9d75-4de7-bffd-31f22f904503', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '12c3303b-9d75-4de7-bffd-31f22f904503', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': False}}" {{(pid=101319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}} Jul 03 09:43:33.268421 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.base [None req-44b0aacb-2564-4929-a850-d3de5c4c76bc tempest-TestVolumeBackupRestore-997771116 None] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=101319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jul 03 09:43:33.268421 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.base [None req-44b0aacb-2564-4929-a850-d3de5c4c76bc tempest-TestVolumeBackupRestore-997771116 None] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.000s {{(pid=101319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jul 03 09:43:33.268669 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.base [None req-44b0aacb-2564-4929-a850-d3de5c4c76bc tempest-TestVolumeBackupRestore-997771116 None] Connection properties {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-12c3303b-9d75-4de7-bffd-31f22f904503', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '12c3303b-9d75-4de7-bffd-31f22f904503', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': False} {{(pid=101319) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}} Jul 03 09:43:33.279310 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.base [None req-44b0aacb-2564-4929-a850-d3de5c4c76bc tempest-TestVolumeBackupRestore-997771116 None] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-12c3303b-9d75-4de7-bffd-31f22f904503" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=101319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jul 03 09:43:33.279807 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.base [None req-44b0aacb-2564-4929-a850-d3de5c4c76bc tempest-TestVolumeBackupRestore-997771116 None] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-12c3303b-9d75-4de7-bffd-31f22f904503" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=101319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jul 03 09:43:33.280085 np0000004400 cinder-backup[101319]: INFO os_brick.initiator.connectors.iscsi [None req-44b0aacb-2564-4929-a850-d3de5c4c76bc tempest-TestVolumeBackupRestore-997771116 None] Trying to connect to iSCSI portal 192.168.40.100:3260 Jul 03 09:43:33.291231 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-44b0aacb-2564-4929-a850-d3de5c4c76bc tempest-TestVolumeBackupRestore-997771116 None] iscsiadm (): stdout= stderr=iscsiadm: No records found Jul 03 09:43:33.291231 np0000004400 cinder-backup[101319]: {{(pid=101319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 03 09:43:33.303663 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-44b0aacb-2564-4929-a850-d3de5c4c76bc tempest-TestVolumeBackupRestore-997771116 None] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-12c3303b-9d75-4de7-bffd-31f22f904503] added Jul 03 09:43:33.303663 np0000004400 cinder-backup[101319]: stderr=iscsiadm: Config file line 363 does not have value Jul 03 09:43:33.303663 np0000004400 cinder-backup[101319]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs' Jul 03 09:43:33.303663 np0000004400 cinder-backup[101319]: iscsiadm: Config file line 363 does not have value Jul 03 09:43:33.303663 np0000004400 cinder-backup[101319]: iscsiadm: Config file line 363 does not have value Jul 03 09:43:33.303663 np0000004400 cinder-backup[101319]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs' Jul 03 09:43:33.303663 np0000004400 cinder-backup[101319]: {{(pid=101319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 03 09:43:33.304085 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-44b0aacb-2564-4929-a850-d3de5c4c76bc tempest-TestVolumeBackupRestore-997771116 None] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=101319) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}} Jul 03 09:43:33.304567 np0000004400 cinder-backup[101319]: DEBUG os_brick.utils [None req-44b0aacb-2564-4929-a850-d3de5c4c76bc tempest-TestVolumeBackupRestore-997771116 None] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0244(s), this was the 1st time calling it. {{(pid=101319) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}} Jul 03 09:43:33.304763 np0000004400 cinder-backup[101319]: DEBUG os_brick.utils [None req-44b0aacb-2564-4929-a850-d3de5c4c76bc tempest-TestVolumeBackupRestore-997771116 None] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=101319) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}} Jul 03 09:43:34.308365 np0000004400 cinder-backup[101319]: INFO os_brick.initiator.connectors.iscsi [None req-44b0aacb-2564-4929-a850-d3de5c4c76bc tempest-TestVolumeBackupRestore-997771116 None] Trying to connect to iSCSI portal 192.168.40.100:3260 Jul 03 09:43:34.322627 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-44b0aacb-2564-4929-a850-d3de5c4c76bc tempest-TestVolumeBackupRestore-997771116 None] iscsiadm (): stdout=# BEGIN RECORD 2.1.9 Jul 03 09:43:34.322627 np0000004400 cinder-backup[101319]: node.name = iqn.2023-03.storpool.com:os--volume-12c3303b-9d75-4de7-bffd-31f22f904503 Jul 03 09:43:34.322627 np0000004400 cinder-backup[101319]: node.tpgt = -1 Jul 03 09:43:34.322627 np0000004400 cinder-backup[101319]: node.startup = manual Jul 03 09:43:34.322627 np0000004400 cinder-backup[101319]: node.leading_login = No Jul 03 09:43:34.322627 np0000004400 cinder-backup[101319]: iface.iscsi_ifacename = default Jul 03 09:43:34.322627 np0000004400 cinder-backup[101319]: iface.net_ifacename = Jul 03 09:43:34.322627 np0000004400 cinder-backup[101319]: iface.ipaddress = Jul 03 09:43:34.322627 np0000004400 cinder-backup[101319]: iface.prefix_len = 0 Jul 03 09:43:34.322627 np0000004400 cinder-backup[101319]: iface.hwaddress = Jul 03 09:43:34.322627 np0000004400 cinder-backup[101319]: iface.transport_name = tcp Jul 03 09:43:34.322627 np0000004400 cinder-backup[101319]: iface.initiatorname = Jul 03 09:43:34.322627 np0000004400 cinder-backup[101319]: iface.state = Jul 03 09:43:34.322627 np0000004400 cinder-backup[101319]: iface.vlan_id = 0 Jul 03 09:43:34.322627 np0000004400 cinder-backup[101319]: iface.vlan_priority = 0 Jul 03 09:43:34.322627 np0000004400 cinder-backup[101319]: iface.vlan_state = Jul 03 09:43:34.322627 np0000004400 cinder-backup[101319]: iface.iface_num = 0 Jul 03 09:43:34.322627 np0000004400 cinder-backup[101319]: iface.mtu = 0 Jul 03 09:43:34.322627 np0000004400 cinder-backup[101319]: iface.port = 0 Jul 03 09:43:34.322627 np0000004400 cinder-backup[101319]: iface.bootproto = Jul 03 09:43:34.322627 np0000004400 cinder-backup[101319]: iface.subnet_mask = Jul 03 09:43:34.322627 np0000004400 cinder-backup[101319]: iface.gateway = Jul 03 09:43:34.322627 np0000004400 cinder-backup[101319]: iface.dhcp_alt_client_id_state = Jul 03 09:43:34.322627 np0000004400 cinder-backup[101319]: iface.dhcp_alt_client_id = Jul 03 09:43:34.322627 np0000004400 cinder-backup[101319]: iface.dhcp_dns = Jul 03 09:43:34.322627 np0000004400 cinder-backup[101319]: iface.dhcp_learn_iqn = Jul 03 09:43:34.322627 np0000004400 cinder-backup[101319]: iface.dhcp_req_vendor_id_state = Jul 03 09:43:34.322627 np0000004400 cinder-backup[101319]: iface.dhcp_vendor_id_state = Jul 03 09:43:34.322627 np0000004400 cinder-backup[101319]: iface.dhcp_vendor_id = Jul 03 09:43:34.322627 np0000004400 cinder-backup[101319]: iface.dhcp_slp_da = Jul 03 09:43:34.322627 np0000004400 cinder-backup[101319]: iface.fragmentation = Jul 03 09:43:34.322627 np0000004400 cinder-backup[101319]: iface.gratuitous_arp = Jul 03 09:43:34.322627 np0000004400 cinder-backup[101319]: iface.incoming_forwarding = Jul 03 09:43:34.322627 np0000004400 cinder-backup[101319]: iface.tos_state = Jul 03 09:43:34.322627 np0000004400 cinder-backup[101319]: iface.tos = 0 Jul 03 09:43:34.322627 np0000004400 cinder-backup[101319]: iface.ttl = 0 Jul 03 09:43:34.322627 np0000004400 cinder-backup[101319]: iface.delayed_ack = Jul 03 09:43:34.322627 np0000004400 cinder-backup[101319]: iface.tcp_nagle = Jul 03 09:43:34.322627 np0000004400 cinder-backup[101319]: iface.tcp_wsf_state = Jul 03 09:43:34.322627 np0000004400 cinder-backup[101319]: iface.tcp_wsf = 0 Jul 03 09:43:34.322627 np0000004400 cinder-backup[101319]: iface.tcp_timer_scale = 0 Jul 03 09:43:34.322627 np0000004400 cinder-backup[101319]: iface.tcp_timestamp = Jul 03 09:43:34.322627 np0000004400 cinder-backup[101319]: iface.redirect = Jul 03 09:43:34.322627 np0000004400 cinder-backup[101319]: iface.def_task_mgmt_timeout = 0 Jul 03 09:43:34.322627 np0000004400 cinder-backup[101319]: iface.header_digest = Jul 03 09:43:34.322627 np0000004400 cinder-backup[101319]: iface.data_digest = Jul 03 09:43:34.322627 np0000004400 cinder-backup[101319]: iface.immediate_data = Jul 03 09:43:34.322627 np0000004400 cinder-backup[101319]: iface.initial_r2t = Jul 03 09:43:34.322627 np0000004400 cinder-backup[101319]: iface.data_seq_inorder = Jul 03 09:43:34.322627 np0000004400 cinder-backup[101319]: iface.data_pdu_inorder = Jul 03 09:43:34.322627 np0000004400 cinder-backup[101319]: iface.erl = 0 Jul 03 09:43:34.322627 np0000004400 cinder-backup[101319]: iface.max_receive_data_len = 0 Jul 03 09:43:34.322627 np0000004400 cinder-backup[101319]: iface.first_burst_len = 0 Jul 03 09:43:34.322627 np0000004400 cinder-backup[101319]: iface.max_outstanding_r2t = 0 Jul 03 09:43:34.322627 np0000004400 cinder-backup[101319]: iface.max_burst_len = 0 Jul 03 09:43:34.322627 np0000004400 cinder-backup[101319]: iface.chap_auth = Jul 03 09:43:34.322627 np0000004400 cinder-backup[101319]: iface.bidi_chap = Jul 03 09:43:34.322627 np0000004400 cinder-backup[101319]: iface.strict_login_compliance = Jul 03 09:43:34.322627 np0000004400 cinder-backup[101319]: iface.discovery_auth = Jul 03 09:43:34.322627 np0000004400 cinder-backup[101319]: iface.discovery_logout = Jul 03 09:43:34.322627 np0000004400 cinder-backup[101319]: node.discovery_address = Jul 03 09:43:34.322627 np0000004400 cinder-backup[101319]: node.discovery_port = 0 Jul 03 09:43:34.322627 np0000004400 cinder-backup[101319]: node.discovery_type = fw Jul 03 09:43:34.322627 np0000004400 cinder-backup[101319]: node.session.initial_cmdsn = 0 Jul 03 09:43:34.322627 np0000004400 cinder-backup[101319]: node.session.initial_login_retry_max = 8 Jul 03 09:43:34.322627 np0000004400 cinder-backup[101319]: node.session.xmit_thread_priority = 0 Jul 03 09:43:34.322627 np0000004400 cinder-backup[101319]: node.session.cmds_max = 128 Jul 03 09:43:34.322627 np0000004400 cinder-backup[101319]: node.session.queue_depth = 32 Jul 03 09:43:34.322627 np0000004400 cinder-backup[101319]: node.session.nr_sessions = 1 Jul 03 09:43:34.322627 np0000004400 cinder-backup[101319]: node.session.auth.authmethod = None Jul 03 09:43:34.322627 np0000004400 cinder-backup[101319]: node.session.auth.username = Jul 03 09:43:34.322627 np0000004400 cinder-backup[101319]: node.session.auth.password = *** Jul 03 09:43:34.322627 np0000004400 cinder-backup[101319]: node.session.auth.username_in = Jul 03 09:43:34.322627 np0000004400 cinder-backup[101319]: node.session.auth.password_in = Jul 03 09:43:34.322627 np0000004400 cinder-backup[101319]: node.session.auth.chap_algs = SHA256 Jul 03 09:43:34.322627 np0000004400 cinder-backup[101319]: node.session.timeo.replacement_timeout = 120 Jul 03 09:43:34.322627 np0000004400 cinder-backup[101319]: node.session.err_timeo.abort_timeout = 15 Jul 03 09:43:34.322627 np0000004400 cinder-backup[101319]: node.session.err_timeo.lu_reset_timeout = 30 Jul 03 09:43:34.322627 np0000004400 cinder-backup[101319]: node.session.err_timeo.tgt_reset_timeout = 30 Jul 03 09:43:34.322627 np0000004400 cinder-backup[101319]: node.session.err_timeo.host_reset_timeout = 60 Jul 03 09:43:34.322627 np0000004400 cinder-backup[101319]: node.session.iscsi.FastAbort = Yes Jul 03 09:43:34.322627 np0000004400 cinder-backup[101319]: node.session.iscsi.InitialR2T = No Jul 03 09:43:34.322627 np0000004400 cinder-backup[101319]: node.session.iscsi.ImmediateData = Yes Jul 03 09:43:34.322627 np0000004400 cinder-backup[101319]: node.session.iscsi.FirstBurstLength = 262144 Jul 03 09:43:34.322627 np0000004400 cinder-backup[101319]: node.session.iscsi.MaxBurstLength = 16776192 Jul 03 09:43:34.322627 np0000004400 cinder-backup[101319]: node.session.iscsi.DefaultTime2Retain = 0 Jul 03 09:43:34.322627 np0000004400 cinder-backup[101319]: node.session.iscsi.DefaultTime2Wait = 2 Jul 03 09:43:34.322627 np0000004400 cinder-backup[101319]: node.session.iscsi.MaxConnections = 1 Jul 03 09:43:34.322627 np0000004400 cinder-backup[101319]: node.session.iscsi.MaxOutstandingR2T = 1 Jul 03 09:43:34.322627 np0000004400 cinder-backup[101319]: node.session.iscsi.ERL = 0 Jul 03 09:43:34.322627 np0000004400 cinder-backup[101319]: node.session.scan = auto Jul 03 09:43:34.322627 np0000004400 cinder-backup[101319]: node.session.reopen_max = 0 Jul 03 09:43:34.322627 np0000004400 cinder-backup[101319]: node.conn[0].address = 192.168.40.100 Jul 03 09:43:34.322627 np0000004400 cinder-backup[101319]: node.conn[0].port = 3260 Jul 03 09:43:34.322627 np0000004400 cinder-backup[101319]: node.conn[0].startup = manual Jul 03 09:43:34.322627 np0000004400 cinder-backup[101319]: node.conn[0].tcp.window_size = 524288 Jul 03 09:43:34.322627 np0000004400 cinder-backup[101319]: node.conn[0].tcp.type_of_service = 0 Jul 03 09:43:34.322627 np0000004400 cinder-backup[101319]: node.conn[0].timeo.logout_timeout = 15 Jul 03 09:43:34.322627 np0000004400 cinder-backup[101319]: node.conn[0].timeo.login_timeout = 15 Jul 03 09:43:34.322627 np0000004400 cinder-backup[101319]: node.conn[0].timeo.auth_timeout = 45 Jul 03 09:43:34.322627 np0000004400 cinder-backup[101319]: node.conn[0].timeo.noop_out_interval = 5 Jul 03 09:43:34.322627 np0000004400 cinder-backup[101319]: node.conn[0].timeo.noop_out_timeout = 5 Jul 03 09:43:34.322627 np0000004400 cinder-backup[101319]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0 Jul 03 09:43:34.322627 np0000004400 cinder-backup[101319]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144 Jul 03 09:43:34.322627 np0000004400 cinder-backup[101319]: node.conn[0].iscsi.HeaderDigest = None Jul 03 09:43:34.322627 np0000004400 cinder-backup[101319]: node.conn[0].iscsi.DataDigest = None Jul 03 09:43:34.322627 np0000004400 cinder-backup[101319]: node.conn[0].iscsi.IFMarker = No Jul 03 09:43:34.322627 np0000004400 cinder-backup[101319]: node.conn[0].iscsi.OFMarker = No Jul 03 09:43:34.322627 np0000004400 cinder-backup[101319]: # END RECORD Jul 03 09:43:34.322627 np0000004400 cinder-backup[101319]: stderr= {{(pid=101319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 03 09:43:34.333121 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-44b0aacb-2564-4929-a850-d3de5c4c76bc tempest-TestVolumeBackupRestore-997771116 None] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=101319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 03 09:43:34.349782 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-44b0aacb-2564-4929-a850-d3de5c4c76bc tempest-TestVolumeBackupRestore-997771116 None] iscsiadm ('-m', 'session'): stdout=tcp: [49] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b2e4f10c-8033-4c54-95a1-dfe45d6357a3 (non-flash) Jul 03 09:43:34.349782 np0000004400 cinder-backup[101319]: tcp: [50] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b2e4f10c-8033-4c54-95a1-dfe45d6357a3 (non-flash) Jul 03 09:43:34.349782 np0000004400 cinder-backup[101319]: tcp: [72] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e9e3f386-d923-4ae1-a6ce-8dd2091673ac (non-flash) Jul 03 09:43:34.349782 np0000004400 cinder-backup[101319]: tcp: [73] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e9e3f386-d923-4ae1-a6ce-8dd2091673ac (non-flash) Jul 03 09:43:34.349782 np0000004400 cinder-backup[101319]: tcp: [76] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f1c2bb03-f1f4-4186-9466-3b699bca16e6 (non-flash) Jul 03 09:43:34.349782 np0000004400 cinder-backup[101319]: tcp: [77] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f1c2bb03-f1f4-4186-9466-3b699bca16e6 (non-flash) Jul 03 09:43:34.349782 np0000004400 cinder-backup[101319]: stderr= {{(pid=101319) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jul 03 09:43:34.350881 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-44b0aacb-2564-4929-a850-d3de5c4c76bc tempest-TestVolumeBackupRestore-997771116 None] iscsi session list stdout=tcp: [49] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b2e4f10c-8033-4c54-95a1-dfe45d6357a3 (non-flash) Jul 03 09:43:34.350881 np0000004400 cinder-backup[101319]: tcp: [50] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b2e4f10c-8033-4c54-95a1-dfe45d6357a3 (non-flash) Jul 03 09:43:34.350881 np0000004400 cinder-backup[101319]: tcp: [72] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e9e3f386-d923-4ae1-a6ce-8dd2091673ac (non-flash) Jul 03 09:43:34.350881 np0000004400 cinder-backup[101319]: tcp: [73] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e9e3f386-d923-4ae1-a6ce-8dd2091673ac (non-flash) Jul 03 09:43:34.350881 np0000004400 cinder-backup[101319]: tcp: [76] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f1c2bb03-f1f4-4186-9466-3b699bca16e6 (non-flash) Jul 03 09:43:34.350881 np0000004400 cinder-backup[101319]: tcp: [77] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f1c2bb03-f1f4-4186-9466-3b699bca16e6 (non-flash) Jul 03 09:43:34.350881 np0000004400 cinder-backup[101319]: stderr= {{(pid=101319) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jul 03 09:43:34.391160 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-44b0aacb-2564-4929-a850-d3de5c4c76bc tempest-TestVolumeBackupRestore-997771116 None] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-12c3303b-9d75-4de7-bffd-31f22f904503, portal: 192.168.40.100,3260] Jul 03 09:43:34.391160 np0000004400 cinder-backup[101319]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-12c3303b-9d75-4de7-bffd-31f22f904503, portal: 192.168.40.100,3260] successful. Jul 03 09:43:34.391160 np0000004400 cinder-backup[101319]: stderr= {{(pid=101319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 03 09:43:34.402257 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-44b0aacb-2564-4929-a850-d3de5c4c76bc tempest-TestVolumeBackupRestore-997771116 None] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=101319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 03 09:43:34.416563 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-44b0aacb-2564-4929-a850-d3de5c4c76bc tempest-TestVolumeBackupRestore-997771116 None] iscsiadm ('-m', 'session'): stdout=tcp: [49] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b2e4f10c-8033-4c54-95a1-dfe45d6357a3 (non-flash) Jul 03 09:43:34.416563 np0000004400 cinder-backup[101319]: tcp: [50] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b2e4f10c-8033-4c54-95a1-dfe45d6357a3 (non-flash) Jul 03 09:43:34.416563 np0000004400 cinder-backup[101319]: tcp: [72] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e9e3f386-d923-4ae1-a6ce-8dd2091673ac (non-flash) Jul 03 09:43:34.416563 np0000004400 cinder-backup[101319]: tcp: [73] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e9e3f386-d923-4ae1-a6ce-8dd2091673ac (non-flash) Jul 03 09:43:34.416563 np0000004400 cinder-backup[101319]: tcp: [76] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f1c2bb03-f1f4-4186-9466-3b699bca16e6 (non-flash) Jul 03 09:43:34.416563 np0000004400 cinder-backup[101319]: tcp: [77] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f1c2bb03-f1f4-4186-9466-3b699bca16e6 (non-flash) Jul 03 09:43:34.416563 np0000004400 cinder-backup[101319]: tcp: [79] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-12c3303b-9d75-4de7-bffd-31f22f904503 (non-flash) Jul 03 09:43:34.416563 np0000004400 cinder-backup[101319]: stderr= {{(pid=101319) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jul 03 09:43:34.416826 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-44b0aacb-2564-4929-a850-d3de5c4c76bc tempest-TestVolumeBackupRestore-997771116 None] iscsi session list stdout=tcp: [49] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b2e4f10c-8033-4c54-95a1-dfe45d6357a3 (non-flash) Jul 03 09:43:34.416826 np0000004400 cinder-backup[101319]: tcp: [50] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b2e4f10c-8033-4c54-95a1-dfe45d6357a3 (non-flash) Jul 03 09:43:34.416826 np0000004400 cinder-backup[101319]: tcp: [72] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e9e3f386-d923-4ae1-a6ce-8dd2091673ac (non-flash) Jul 03 09:43:34.416826 np0000004400 cinder-backup[101319]: tcp: [73] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e9e3f386-d923-4ae1-a6ce-8dd2091673ac (non-flash) Jul 03 09:43:34.416826 np0000004400 cinder-backup[101319]: tcp: [76] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f1c2bb03-f1f4-4186-9466-3b699bca16e6 (non-flash) Jul 03 09:43:34.416826 np0000004400 cinder-backup[101319]: tcp: [77] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f1c2bb03-f1f4-4186-9466-3b699bca16e6 (non-flash) Jul 03 09:43:34.416826 np0000004400 cinder-backup[101319]: tcp: [79] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-12c3303b-9d75-4de7-bffd-31f22f904503 (non-flash) Jul 03 09:43:34.416826 np0000004400 cinder-backup[101319]: stderr= {{(pid=101319) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jul 03 09:43:34.417084 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.base [None req-44b0aacb-2564-4929-a850-d3de5c4c76bc tempest-TestVolumeBackupRestore-997771116 None] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-12c3303b-9d75-4de7-bffd-31f22f904503" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.137s {{(pid=101319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jul 03 09:43:34.417295 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-44b0aacb-2564-4929-a850-d3de5c4c76bc tempest-TestVolumeBackupRestore-997771116 None] Connected to 192.168.40.100:3260 {{(pid=101319) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}} Jul 03 09:43:34.418026 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.linuxscsi [None req-44b0aacb-2564-4929-a850-d3de5c4c76bc tempest-TestVolumeBackupRestore-997771116 None] HCTL ('7', '-', '-', 0) found on session 79 with lun 0 {{(pid=101319) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}} Jul 03 09:43:34.418151 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.linuxscsi [None req-44b0aacb-2564-4929-a850-d3de5c4c76bc tempest-TestVolumeBackupRestore-997771116 None] Scanning host 7 c: -, t: -, l: 0) {{(pid=101319) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}} Jul 03 09:43:34.430889 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.linuxscsi [None req-44b0aacb-2564-4929-a850-d3de5c4c76bc tempest-TestVolumeBackupRestore-997771116 None] Searching for a device in session 79 and hctl ['7', '*', '*', 0] yield: sdb {{(pid=101319) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}} Jul 03 09:43:34.430889 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-44b0aacb-2564-4929-a850-d3de5c4c76bc tempest-TestVolumeBackupRestore-997771116 None] Connected to sdb using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-12c3303b-9d75-4de7-bffd-31f22f904503', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '12c3303b-9d75-4de7-bffd-31f22f904503', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': False} {{(pid=101319) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}} Jul 03 09:43:35.433817 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.base [None req-44b0aacb-2564-4929-a850-d3de5c4c76bc tempest-TestVolumeBackupRestore-997771116 None] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 2.165s {{(pid=101319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jul 03 09:43:35.433817 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-44b0aacb-2564-4929-a850-d3de5c4c76bc tempest-TestVolumeBackupRestore-997771116 None] <== connect_volume: return (2165ms) {'type': 'block', 'scsi_wwn': 'SStorPool_iSCSI_DISK_1034578903445799004', 'path': '/dev/sdb'} {{(pid=101319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}} Jul 03 09:43:35.433817 np0000004400 cinder-backup[101319]: DEBUG oslo_concurrency.processutils [None req-44b0aacb-2564-4929-a850-d3de5c4c76bc tempest-TestVolumeBackupRestore-997771116 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chown 1002 /dev/sdb {{(pid=101319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 09:43:35.453817 np0000004400 sudo[131887]: stack : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chown 1002 /dev/sdb Jul 03 09:43:35.454466 np0000004400 sudo[131887]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1002) Jul 03 09:43:35.791292 np0000004400 sudo[131887]: pam_unix(sudo:session): session closed for user root Jul 03 09:43:35.793901 np0000004400 cinder-backup[101319]: DEBUG oslo_concurrency.processutils [None req-44b0aacb-2564-4929-a850-d3de5c4c76bc tempest-TestVolumeBackupRestore-997771116 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chown 1002 /dev/sdb" returned: 0 in 0.359s {{(pid=101319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 09:43:35.794461 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-44b0aacb-2564-4929-a850-d3de5c4c76bc tempest-TestVolumeBackupRestore-997771116 None] starting restore of backup volume_1c366dd9-1a3c-4cb8-8f7c-4fdabf6fb81e/20260703094315/az_nova_backup_8727aa2b-db7a-4559-b380-bc6d983ed688 container: volumebackups, to new volume 12c3303b-9d75-4de7-bffd-31f22f904503, backup: 8727aa2b-db7a-4559-b380-bc6d983ed688. {{(pid=101319) restore /opt/stack/cinder/cinder/backup/chunkeddriver.py:761}} Jul 03 09:43:35.794676 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-44b0aacb-2564-4929-a850-d3de5c4c76bc tempest-TestVolumeBackupRestore-997771116 None] _read_metadata started, container name: volumebackups, metadata filename: volume_1c366dd9-1a3c-4cb8-8f7c-4fdabf6fb81e/20260703094315/az_nova_backup_8727aa2b-db7a-4559-b380-bc6d983ed688_metadata. {{(pid=101319) _read_metadata /opt/stack/cinder/cinder/backup/chunkeddriver.py:320}} Jul 03 09:43:35.818840 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-44b0aacb-2564-4929-a850-d3de5c4c76bc tempest-TestVolumeBackupRestore-997771116 None] _read_metadata finished. Metadata: { Jul 03 09:43:35.818840 np0000004400 cinder-backup[101319]: "backup_description": null, Jul 03 09:43:35.818840 np0000004400 cinder-backup[101319]: "backup_id": "8727aa2b-db7a-4559-b380-bc6d983ed688", Jul 03 09:43:35.818840 np0000004400 cinder-backup[101319]: "backup_name": "tempest-TestVolumeBackupRestore-backup-21470280", Jul 03 09:43:35.818840 np0000004400 cinder-backup[101319]: "created_at": "2026-07-03 09:43:09+00:00", Jul 03 09:43:35.818840 np0000004400 cinder-backup[101319]: "objects": [ Jul 03 09:43:35.818840 np0000004400 cinder-backup[101319]: { Jul 03 09:43:35.818840 np0000004400 cinder-backup[101319]: "volume_1c366dd9-1a3c-4cb8-8f7c-4fdabf6fb81e/20260703094315/az_nova_backup_8727aa2b-db7a-4559-b380-bc6d983ed688-00001": { Jul 03 09:43:35.818840 np0000004400 cinder-backup[101319]: "compression": "zlib", Jul 03 09:43:35.818840 np0000004400 cinder-backup[101319]: "length": 52428800, Jul 03 09:43:35.818840 np0000004400 cinder-backup[101319]: "md5": "82571f7121cb9475563edde615e4e4df", Jul 03 09:43:35.818840 np0000004400 cinder-backup[101319]: "offset": 0 Jul 03 09:43:35.818840 np0000004400 cinder-backup[101319]: } Jul 03 09:43:35.818840 np0000004400 cinder-backup[101319]: }, Jul 03 09:43:35.818840 np0000004400 cinder-backup[101319]: { Jul 03 09:43:35.818840 np0000004400 cinder-backup[101319]: "volume_1c366dd9-1a3c-4cb8-8f7c-4fdabf6fb81e/20260703094315/az_nova_backup_8727aa2b-db7a-4559-b380-bc6d983ed688-00002": { Jul 03 09:43:35.818840 np0000004400 cinder-backup[101319]: "compression": "zlib", Jul 03 09:43:35.818840 np0000004400 cinder-backup[101319]: "length": 52428800, Jul 03 09:43:35.818840 np0000004400 cinder-backup[101319]: "md5": "25e317773f308e446cc84c503a6d1f85", Jul 03 09:43:35.818840 np0000004400 cinder-backup[101319]: "offset": 52428800 Jul 03 09:43:35.818840 np0000004400 cinder-backup[101319]: } Jul 03 09:43:35.818840 np0000004400 cinder-backup[101319]: }, Jul 03 09:43:35.818840 np0000004400 cinder-backup[101319]: { Jul 03 09:43:35.818840 np0000004400 cinder-backup[101319]: "volume_1c366dd9-1a3c-4cb8-8f7c-4fdabf6fb81e/20260703094315/az_nova_backup_8727aa2b-db7a-4559-b380-bc6d983ed688-00003": { Jul 03 09:43:35.818840 np0000004400 cinder-backup[101319]: "compression": "zlib", Jul 03 09:43:35.818840 np0000004400 cinder-backup[101319]: "length": 52428800, Jul 03 09:43:35.818840 np0000004400 cinder-backup[101319]: "md5": "a35891500449df17e893f84bd88472fb", Jul 03 09:43:35.818840 np0000004400 cinder-backup[101319]: "offset": 104857600 Jul 03 09:43:35.818840 np0000004400 cinder-backup[101319]: } Jul 03 09:43:35.818840 np0000004400 cinder-backup[101319]: }, Jul 03 09:43:35.818840 np0000004400 cinder-backup[101319]: { Jul 03 09:43:35.818840 np0000004400 cinder-backup[101319]: "volume_1c366dd9-1a3c-4cb8-8f7c-4fdabf6fb81e/20260703094315/az_nova_backup_8727aa2b-db7a-4559-b380-bc6d983ed688-00004": { Jul 03 09:43:35.818840 np0000004400 cinder-backup[101319]: "compression": "zlib", Jul 03 09:43:35.818840 np0000004400 cinder-backup[101319]: "length": 52428800, Jul 03 09:43:35.818840 np0000004400 cinder-backup[101319]: "md5": "25e317773f308e446cc84c503a6d1f85", Jul 03 09:43:35.818840 np0000004400 cinder-backup[101319]: "offset": 157286400 Jul 03 09:43:35.818840 np0000004400 cinder-backup[101319]: } Jul 03 09:43:35.818840 np0000004400 cinder-backup[101319]: }, Jul 03 09:43:35.818840 np0000004400 cinder-backup[101319]: { Jul 03 09:43:35.818840 np0000004400 cinder-backup[101319]: "volume_1c366dd9-1a3c-4cb8-8f7c-4fdabf6fb81e/20260703094315/az_nova_backup_8727aa2b-db7a-4559-b380-bc6d983ed688-00005": { Jul 03 09:43:35.818840 np0000004400 cinder-backup[101319]: "compression": "zlib", Jul 03 09:43:35.818840 np0000004400 cinder-backup[101319]: "length": 52428800, Jul 03 09:43:35.818840 np0000004400 cinder-backup[101319]: "md5": "25e317773f308e446cc84c503a6d1f85", Jul 03 09:43:35.818840 np0000004400 cinder-backup[101319]: "offset": 209715200 Jul 03 09:43:35.818840 np0000004400 cinder-backup[101319]: } Jul 03 09:43:35.818840 np0000004400 cinder-backup[101319]: }, Jul 03 09:43:35.818840 np0000004400 cinder-backup[101319]: { Jul 03 09:43:35.818840 np0000004400 cinder-backup[101319]: "volume_1c366dd9-1a3c-4cb8-8f7c-4fdabf6fb81e/20260703094315/az_nova_backup_8727aa2b-db7a-4559-b380-bc6d983ed688-00006": { Jul 03 09:43:35.818840 np0000004400 cinder-backup[101319]: "compression": "zlib", Jul 03 09:43:35.818840 np0000004400 cinder-backup[101319]: "length": 52428800, Jul 03 09:43:35.818840 np0000004400 cinder-backup[101319]: "md5": "25e317773f308e446cc84c503a6d1f85", Jul 03 09:43:35.818840 np0000004400 cinder-backup[101319]: "offset": 262144000 Jul 03 09:43:35.818840 np0000004400 cinder-backup[101319]: } Jul 03 09:43:35.818840 np0000004400 cinder-backup[101319]: }, Jul 03 09:43:35.818840 np0000004400 cinder-backup[101319]: { Jul 03 09:43:35.818840 np0000004400 cinder-backup[101319]: "volume_1c366dd9-1a3c-4cb8-8f7c-4fdabf6fb81e/20260703094315/az_nova_backup_8727aa2b-db7a-4559-b380-bc6d983ed688-00007": { Jul 03 09:43:35.818840 np0000004400 cinder-backup[101319]: "compression": "zlib", Jul 03 09:43:35.818840 np0000004400 cinder-backup[101319]: "length": 52428800, Jul 03 09:43:35.818840 np0000004400 cinder-backup[101319]: "md5": "25e317773f308e446cc84c503a6d1f85", Jul 03 09:43:35.818840 np0000004400 cinder-backup[101319]: "offset": 314572800 Jul 03 09:43:35.818840 np0000004400 cinder-backup[101319]: } Jul 03 09:43:35.818840 np0000004400 cinder-backup[101319]: }, Jul 03 09:43:35.818840 np0000004400 cinder-backup[101319]: { Jul 03 09:43:35.818840 np0000004400 cinder-backup[101319]: "volume_1c366dd9-1a3c-4cb8-8f7c-4fdabf6fb81e/20260703094315/az_nova_backup_8727aa2b-db7a-4559-b380-bc6d983ed688-00008": { Jul 03 09:43:35.818840 np0000004400 cinder-backup[101319]: "compression": "zlib", Jul 03 09:43:35.818840 np0000004400 cinder-backup[101319]: "length": 52428800, Jul 03 09:43:35.818840 np0000004400 cinder-backup[101319]: "md5": "25e317773f308e446cc84c503a6d1f85", Jul 03 09:43:35.818840 np0000004400 cinder-backup[101319]: "offset": 367001600 Jul 03 09:43:35.818840 np0000004400 cinder-backup[101319]: } Jul 03 09:43:35.818840 np0000004400 cinder-backup[101319]: }, Jul 03 09:43:35.818840 np0000004400 cinder-backup[101319]: { Jul 03 09:43:35.818840 np0000004400 cinder-backup[101319]: "volume_1c366dd9-1a3c-4cb8-8f7c-4fdabf6fb81e/20260703094315/az_nova_backup_8727aa2b-db7a-4559-b380-bc6d983ed688-00009": { Jul 03 09:43:35.818840 np0000004400 cinder-backup[101319]: "compression": "zlib", Jul 03 09:43:35.818840 np0000004400 cinder-backup[101319]: "length": 52428800, Jul 03 09:43:35.818840 np0000004400 cinder-backup[101319]: "md5": "25e317773f308e446cc84c503a6d1f85", Jul 03 09:43:35.818840 np0000004400 cinder-backup[101319]: "offset": 419430400 Jul 03 09:43:35.818840 np0000004400 cinder-backup[101319]: } Jul 03 09:43:35.818840 np0000004400 cinder-backup[101319]: }, Jul 03 09:43:35.818840 np0000004400 cinder-backup[101319]: { Jul 03 09:43:35.818840 np0000004400 cinder-backup[101319]: "volume_1c366dd9-1a3c-4cb8-8f7c-4fdabf6fb81e/20260703094315/az_nova_backup_8727aa2b-db7a-4559-b380-bc6d983ed688-00010": { Jul 03 09:43:35.818840 np0000004400 cinder-backup[101319]: "compression": "zlib", Jul 03 09:43:35.818840 np0000004400 cinder-backup[101319]: "length": 52428800, Jul 03 09:43:35.818840 np0000004400 cinder-backup[101319]: "md5": "25e317773f308e446cc84c503a6d1f85", Jul 03 09:43:35.818840 np0000004400 cinder-backup[101319]: "offset": 471859200 Jul 03 09:43:35.818840 np0000004400 cinder-backup[101319]: } Jul 03 09:43:35.818840 np0000004400 cinder-backup[101319]: }, Jul 03 09:43:35.818840 np0000004400 cinder-backup[101319]: { Jul 03 09:43:35.818840 np0000004400 cinder-backup[101319]: "volume_1c366dd9-1a3c-4cb8-8f7c-4fdabf6fb81e/20260703094315/az_nova_backup_8727aa2b-db7a-4559-b380-bc6d983ed688-00011": { Jul 03 09:43:35.818840 np0000004400 cinder-backup[101319]: "compression": "zlib", Jul 03 09:43:35.818840 np0000004400 cinder-backup[101319]: "length": 52428800, Jul 03 09:43:35.818840 np0000004400 cinder-backup[101319]: "md5": "25e317773f308e446cc84c503a6d1f85", Jul 03 09:43:35.818840 np0000004400 cinder-backup[101319]: "offset": 524288000 Jul 03 09:43:35.818840 np0000004400 cinder-backup[101319]: } Jul 03 09:43:35.818840 np0000004400 cinder-backup[101319]: }, Jul 03 09:43:35.818840 np0000004400 cinder-backup[101319]: { Jul 03 09:43:35.818840 np0000004400 cinder-backup[101319]: "volume_1c366dd9-1a3c-4cb8-8f7c-4fdabf6fb81e/20260703094315/az_nova_backup_8727aa2b-db7a-4559-b380-bc6d983ed688-00012": { Jul 03 09:43:35.818840 np0000004400 cinder-backup[101319]: "compression": "zlib", Jul 03 09:43:35.818840 np0000004400 cinder-backup[101319]: "length": 52428800, Jul 03 09:43:35.818840 np0000004400 cinder-backup[101319]: "md5": "25e317773f308e446cc84c503a6d1f85", Jul 03 09:43:35.818840 np0000004400 cinder-backup[101319]: "offset": 576716800 Jul 03 09:43:35.818840 np0000004400 cinder-backup[101319]: } Jul 03 09:43:35.818840 np0000004400 cinder-backup[101319]: }, Jul 03 09:43:35.818840 np0000004400 cinder-backup[101319]: { Jul 03 09:43:35.818840 np0000004400 cinder-backup[101319]: "volume_1c366dd9-1a3c-4cb8-8f7c-4fdabf6fb81e/20260703094315/az_nova_backup_8727aa2b-db7a-4559-b380-bc6d983ed688-00013": { Jul 03 09:43:35.818840 np0000004400 cinder-backup[101319]: "compression": "zlib", Jul 03 09:43:35.818840 np0000004400 cinder-backup[101319]: "length": 52428800, Jul 03 09:43:35.818840 np0000004400 cinder-backup[101319]: "md5": "25e317773f308e446cc84c503a6d1f85", Jul 03 09:43:35.818840 np0000004400 cinder-backup[101319]: "offset": 629145600 Jul 03 09:43:35.818840 np0000004400 cinder-backup[101319]: } Jul 03 09:43:35.818840 np0000004400 cinder-backup[101319]: }, Jul 03 09:43:35.818840 np0000004400 cinder-backup[101319]: { Jul 03 09:43:35.818840 np0000004400 cinder-backup[101319]: "volume_1c366dd9-1a3c-4cb8-8f7c-4fdabf6fb81e/20260703094315/az_nova_backup_8727aa2b-db7a-4559-b380-bc6d983ed688-00014": { Jul 03 09:43:35.818840 np0000004400 cinder-backup[101319]: "compression": "zlib", Jul 03 09:43:35.818840 np0000004400 cinder-backup[101319]: "length": 52428800, Jul 03 09:43:35.818840 np0000004400 cinder-backup[101319]: "md5": "25e317773f308e446cc84c503a6d1f85", Jul 03 09:43:35.818840 np0000004400 cinder-backup[101319]: "offset": 681574400 Jul 03 09:43:35.818840 np0000004400 cinder-backup[101319]: } Jul 03 09:43:35.818840 np0000004400 cinder-backup[101319]: }, Jul 03 09:43:35.818840 np0000004400 cinder-backup[101319]: { Jul 03 09:43:35.818840 np0000004400 cinder-backup[101319]: "volume_1c366dd9-1a3c-4cb8-8f7c-4fdabf6fb81e/20260703094315/az_nova_backup_8727aa2b-db7a-4559-b380-bc6d983ed688-00015": { Jul 03 09:43:35.818840 np0000004400 cinder-backup[101319]: "compression": "zlib", Jul 03 09:43:35.818840 np0000004400 cinder-backup[101319]: "length": 52428800, Jul 03 09:43:35.818840 np0000004400 cinder-backup[101319]: "md5": "25e317773f308e446cc84c503a6d1f85", Jul 03 09:43:35.818840 np0000004400 cinder-backup[101319]: "offset": 734003200 Jul 03 09:43:35.818840 np0000004400 cinder-backup[101319]: } Jul 03 09:43:35.818840 np0000004400 cinder-backup[101319]: }, Jul 03 09:43:35.818840 np0000004400 cinder-backup[101319]: { Jul 03 09:43:35.818840 np0000004400 cinder-backup[101319]: "volume_1c366dd9-1a3c-4cb8-8f7c-4fdabf6fb81e/20260703094315/az_nova_backup_8727aa2b-db7a-4559-b380-bc6d983ed688-00016": { Jul 03 09:43:35.818840 np0000004400 cinder-backup[101319]: "compression": "zlib", Jul 03 09:43:35.818840 np0000004400 cinder-backup[101319]: "length": 52428800, Jul 03 09:43:35.818840 np0000004400 cinder-backup[101319]: "md5": "25e317773f308e446cc84c503a6d1f85", Jul 03 09:43:35.818840 np0000004400 cinder-backup[101319]: "offset": 786432000 Jul 03 09:43:35.818840 np0000004400 cinder-backup[101319]: } Jul 03 09:43:35.818840 np0000004400 cinder-backup[101319]: }, Jul 03 09:43:35.818840 np0000004400 cinder-backup[101319]: { Jul 03 09:43:35.818840 np0000004400 cinder-backup[101319]: "volume_1c366dd9-1a3c-4cb8-8f7c-4fdabf6fb81e/20260703094315/az_nova_backup_8727aa2b-db7a-4559-b380-bc6d983ed688-00017": { Jul 03 09:43:35.818840 np0000004400 cinder-backup[101319]: "compression": "zlib", Jul 03 09:43:35.818840 np0000004400 cinder-backup[101319]: "length": 52428800, Jul 03 09:43:35.818840 np0000004400 cinder-backup[101319]: "md5": "25e317773f308e446cc84c503a6d1f85", Jul 03 09:43:35.818840 np0000004400 cinder-backup[101319]: "offset": 838860800 Jul 03 09:43:35.818840 np0000004400 cinder-backup[101319]: } Jul 03 09:43:35.818840 np0000004400 cinder-backup[101319]: }, Jul 03 09:43:35.818840 np0000004400 cinder-backup[101319]: { Jul 03 09:43:35.818840 np0000004400 cinder-backup[101319]: "volume_1c366dd9-1a3c-4cb8-8f7c-4fdabf6fb81e/20260703094315/az_nova_backup_8727aa2b-db7a-4559-b380-bc6d983ed688-00018": { Jul 03 09:43:35.818840 np0000004400 cinder-backup[101319]: "compression": "zlib", Jul 03 09:43:35.818840 np0000004400 cinder-backup[101319]: "length": 52428800, Jul 03 09:43:35.818840 np0000004400 cinder-backup[101319]: "md5": "25e317773f308e446cc84c503a6d1f85", Jul 03 09:43:35.818840 np0000004400 cinder-backup[101319]: "offset": 891289600 Jul 03 09:43:35.818840 np0000004400 cinder-backup[101319]: } Jul 03 09:43:35.818840 np0000004400 cinder-backup[101319]: }, Jul 03 09:43:35.818840 np0000004400 cinder-backup[101319]: { Jul 03 09:43:35.818840 np0000004400 cinder-backup[101319]: "volume_1c366dd9-1a3c-4cb8-8f7c-4fdabf6fb81e/20260703094315/az_nova_backup_8727aa2b-db7a-4559-b380-bc6d983ed688-00019": { Jul 03 09:43:35.818840 np0000004400 cinder-backup[101319]: "compression": "zlib", Jul 03 09:43:35.818840 np0000004400 cinder-backup[101319]: "length": 52428800, Jul 03 09:43:35.818840 np0000004400 cinder-backup[101319]: "md5": "25e317773f308e446cc84c503a6d1f85", Jul 03 09:43:35.818840 np0000004400 cinder-backup[101319]: "offset": 943718400 Jul 03 09:43:35.818840 np0000004400 cinder-backup[101319]: } Jul 03 09:43:35.818840 np0000004400 cinder-backup[101319]: }, Jul 03 09:43:35.818840 np0000004400 cinder-backup[101319]: { Jul 03 09:43:35.818840 np0000004400 cinder-backup[101319]: "volume_1c366dd9-1a3c-4cb8-8f7c-4fdabf6fb81e/20260703094315/az_nova_backup_8727aa2b-db7a-4559-b380-bc6d983ed688-00020": { Jul 03 09:43:35.818840 np0000004400 cinder-backup[101319]: "compression": "zlib", Jul 03 09:43:35.818840 np0000004400 cinder-backup[101319]: "length": 52428800, Jul 03 09:43:35.818840 np0000004400 cinder-backup[101319]: "md5": "25e317773f308e446cc84c503a6d1f85", Jul 03 09:43:35.818840 np0000004400 cinder-backup[101319]: "offset": 996147200 Jul 03 09:43:35.818840 np0000004400 cinder-backup[101319]: } Jul 03 09:43:35.818840 np0000004400 cinder-backup[101319]: }, Jul 03 09:43:35.818840 np0000004400 cinder-backup[101319]: { Jul 03 09:43:35.818840 np0000004400 cinder-backup[101319]: "volume_1c366dd9-1a3c-4cb8-8f7c-4fdabf6fb81e/20260703094315/az_nova_backup_8727aa2b-db7a-4559-b380-bc6d983ed688-00021": { Jul 03 09:43:35.818840 np0000004400 cinder-backup[101319]: "compression": "zlib", Jul 03 09:43:35.818840 np0000004400 cinder-backup[101319]: "length": 25165824, Jul 03 09:43:35.818840 np0000004400 cinder-backup[101319]: "md5": "77377273b0a4b61febdbf7bbf52b9db9", Jul 03 09:43:35.818840 np0000004400 cinder-backup[101319]: "offset": 1048576000 Jul 03 09:43:35.818840 np0000004400 cinder-backup[101319]: } Jul 03 09:43:35.818840 np0000004400 cinder-backup[101319]: } Jul 03 09:43:35.818840 np0000004400 cinder-backup[101319]: ], Jul 03 09:43:35.818840 np0000004400 cinder-backup[101319]: "parent_id": null, Jul 03 09:43:35.818840 np0000004400 cinder-backup[101319]: "version": "1.0.0", Jul 03 09:43:35.818840 np0000004400 cinder-backup[101319]: "volume_id": "1c366dd9-1a3c-4cb8-8f7c-4fdabf6fb81e", Jul 03 09:43:35.818840 np0000004400 cinder-backup[101319]: "volume_meta": "{\"version\": 2, \"volume-base-metadata\": {\"id\": \"1c366dd9-1a3c-4cb8-8f7c-4fdabf6fb81e\", \"_name_id\": null, \"use_quota\": true, \"ec2_id\": null, \"user_id\": \"291d5b00365c48af818ae26172e33eae\", \"project_id\": \"8a91a271598c49e1b52c4e2c3a0f4413\", \"snapshot_id\": null, \"cluster_name\": null, \"host\": \"np0000004400@storpool#default\", \"size\": 1, \"availability_zone\": \"nova\", \"status\": \"backing-up\", \"attach_status\": \"detached\", \"migration_status\": null, \"scheduled_at\": \"2026-07-03T09:43:08.000000\", \"launched_at\": \"2026-07-03T09:43:09.000000\", \"terminated_at\": null, \"display_name\": \"tempest-TestVolumeBackupRestore-volume-978809464\", \"display_description\": null, \"provider_location\": null, \"provider_auth\": null, \"provider_geometry\": null, \"provider_id\": null, \"volume_type_id\": \"03e13fe6-0e30-4803-ace0-725d38e6dc24\", \"source_volid\": null, \"encryption_key_id\": null, \"consistencygroup_id\": null, \"group_id\": null, \"bootable\": true, \"multiattach\": false, \"replication_status\": null, \"replication_extended_status\": null, \"replication_driver_data\": null, \"previous_status\": \"available\", \"service_uuid\": \"6d4b0e79-fefe-4744-b25f-34be05095200\", \"shared_targets\": true, \"deleted_at\": null, \"deleted\": false, \"created_at\": \"2026-07-03T09:43:08.000000\", \"updated_at\": \"2026-07-03T09:43:09.000000\"}, \"volume-glance-metadata\": {\"hw_rng_model\": \"virtio\", \"os_glance_failed_import\": \"\", \"os_glance_importing_to_stores\": \"\", \"owner_specified.openstack.md5\": \"\", \"owner_specified.openstack.object\": \"images/cirros-0.6.3-x86_64-disk\", \"owner_specified.openstack.sha256\": \"\", \"image_id\": \"c1946dda-7935-4a75-a25a-cf65d1d25617\", \"image_name\": \"cirros-0.6.3-x86_64-disk\", \"checksum\": \"87617e24a5e30cb3b87fda8c0764838f\", \"container_format\": \"bare\", \"disk_format\": \"qcow2\", \"min_disk\": \"0\", \"min_ram\": \"0\", \"size\": \"21692416\"}}" Jul 03 09:43:35.818840 np0000004400 cinder-backup[101319]: }. {{(pid=101319) _read_metadata /opt/stack/cinder/cinder/backup/chunkeddriver.py:327}} Jul 03 09:43:35.822237 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-44b0aacb-2564-4929-a850-d3de5c4c76bc tempest-TestVolumeBackupRestore-997771116 None] Restoring backup version 1.0.0 {{(pid=101319) restore /opt/stack/cinder/cinder/backup/chunkeddriver.py:774}} Jul 03 09:43:35.822237 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-44b0aacb-2564-4929-a850-d3de5c4c76bc tempest-TestVolumeBackupRestore-997771116 None] _read_metadata started, container name: volumebackups, metadata filename: volume_1c366dd9-1a3c-4cb8-8f7c-4fdabf6fb81e/20260703094315/az_nova_backup_8727aa2b-db7a-4559-b380-bc6d983ed688_metadata. {{(pid=101319) _read_metadata /opt/stack/cinder/cinder/backup/chunkeddriver.py:320}} Jul 03 09:43:35.835940 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-44b0aacb-2564-4929-a850-d3de5c4c76bc tempest-TestVolumeBackupRestore-997771116 None] _read_metadata finished. Metadata: { Jul 03 09:43:35.835940 np0000004400 cinder-backup[101319]: "backup_description": null, Jul 03 09:43:35.835940 np0000004400 cinder-backup[101319]: "backup_id": "8727aa2b-db7a-4559-b380-bc6d983ed688", Jul 03 09:43:35.835940 np0000004400 cinder-backup[101319]: "backup_name": "tempest-TestVolumeBackupRestore-backup-21470280", Jul 03 09:43:35.835940 np0000004400 cinder-backup[101319]: "created_at": "2026-07-03 09:43:09+00:00", Jul 03 09:43:35.835940 np0000004400 cinder-backup[101319]: "objects": [ Jul 03 09:43:35.835940 np0000004400 cinder-backup[101319]: { Jul 03 09:43:35.835940 np0000004400 cinder-backup[101319]: "volume_1c366dd9-1a3c-4cb8-8f7c-4fdabf6fb81e/20260703094315/az_nova_backup_8727aa2b-db7a-4559-b380-bc6d983ed688-00001": { Jul 03 09:43:35.835940 np0000004400 cinder-backup[101319]: "compression": "zlib", Jul 03 09:43:35.835940 np0000004400 cinder-backup[101319]: "length": 52428800, Jul 03 09:43:35.835940 np0000004400 cinder-backup[101319]: "md5": "82571f7121cb9475563edde615e4e4df", Jul 03 09:43:35.835940 np0000004400 cinder-backup[101319]: "offset": 0 Jul 03 09:43:35.835940 np0000004400 cinder-backup[101319]: } Jul 03 09:43:35.835940 np0000004400 cinder-backup[101319]: }, Jul 03 09:43:35.835940 np0000004400 cinder-backup[101319]: { Jul 03 09:43:35.835940 np0000004400 cinder-backup[101319]: "volume_1c366dd9-1a3c-4cb8-8f7c-4fdabf6fb81e/20260703094315/az_nova_backup_8727aa2b-db7a-4559-b380-bc6d983ed688-00002": { Jul 03 09:43:35.835940 np0000004400 cinder-backup[101319]: "compression": "zlib", Jul 03 09:43:35.835940 np0000004400 cinder-backup[101319]: "length": 52428800, Jul 03 09:43:35.835940 np0000004400 cinder-backup[101319]: "md5": "25e317773f308e446cc84c503a6d1f85", Jul 03 09:43:35.835940 np0000004400 cinder-backup[101319]: "offset": 52428800 Jul 03 09:43:35.835940 np0000004400 cinder-backup[101319]: } Jul 03 09:43:35.835940 np0000004400 cinder-backup[101319]: }, Jul 03 09:43:35.835940 np0000004400 cinder-backup[101319]: { Jul 03 09:43:35.835940 np0000004400 cinder-backup[101319]: "volume_1c366dd9-1a3c-4cb8-8f7c-4fdabf6fb81e/20260703094315/az_nova_backup_8727aa2b-db7a-4559-b380-bc6d983ed688-00003": { Jul 03 09:43:35.835940 np0000004400 cinder-backup[101319]: "compression": "zlib", Jul 03 09:43:35.835940 np0000004400 cinder-backup[101319]: "length": 52428800, Jul 03 09:43:35.835940 np0000004400 cinder-backup[101319]: "md5": "a35891500449df17e893f84bd88472fb", Jul 03 09:43:35.835940 np0000004400 cinder-backup[101319]: "offset": 104857600 Jul 03 09:43:35.835940 np0000004400 cinder-backup[101319]: } Jul 03 09:43:35.835940 np0000004400 cinder-backup[101319]: }, Jul 03 09:43:35.835940 np0000004400 cinder-backup[101319]: { Jul 03 09:43:35.835940 np0000004400 cinder-backup[101319]: "volume_1c366dd9-1a3c-4cb8-8f7c-4fdabf6fb81e/20260703094315/az_nova_backup_8727aa2b-db7a-4559-b380-bc6d983ed688-00004": { Jul 03 09:43:35.835940 np0000004400 cinder-backup[101319]: "compression": "zlib", Jul 03 09:43:35.835940 np0000004400 cinder-backup[101319]: "length": 52428800, Jul 03 09:43:35.835940 np0000004400 cinder-backup[101319]: "md5": "25e317773f308e446cc84c503a6d1f85", Jul 03 09:43:35.835940 np0000004400 cinder-backup[101319]: "offset": 157286400 Jul 03 09:43:35.835940 np0000004400 cinder-backup[101319]: } Jul 03 09:43:35.835940 np0000004400 cinder-backup[101319]: }, Jul 03 09:43:35.835940 np0000004400 cinder-backup[101319]: { Jul 03 09:43:35.835940 np0000004400 cinder-backup[101319]: "volume_1c366dd9-1a3c-4cb8-8f7c-4fdabf6fb81e/20260703094315/az_nova_backup_8727aa2b-db7a-4559-b380-bc6d983ed688-00005": { Jul 03 09:43:35.835940 np0000004400 cinder-backup[101319]: "compression": "zlib", Jul 03 09:43:35.835940 np0000004400 cinder-backup[101319]: "length": 52428800, Jul 03 09:43:35.835940 np0000004400 cinder-backup[101319]: "md5": "25e317773f308e446cc84c503a6d1f85", Jul 03 09:43:35.835940 np0000004400 cinder-backup[101319]: "offset": 209715200 Jul 03 09:43:35.835940 np0000004400 cinder-backup[101319]: } Jul 03 09:43:35.835940 np0000004400 cinder-backup[101319]: }, Jul 03 09:43:35.835940 np0000004400 cinder-backup[101319]: { Jul 03 09:43:35.835940 np0000004400 cinder-backup[101319]: "volume_1c366dd9-1a3c-4cb8-8f7c-4fdabf6fb81e/20260703094315/az_nova_backup_8727aa2b-db7a-4559-b380-bc6d983ed688-00006": { Jul 03 09:43:35.835940 np0000004400 cinder-backup[101319]: "compression": "zlib", Jul 03 09:43:35.835940 np0000004400 cinder-backup[101319]: "length": 52428800, Jul 03 09:43:35.835940 np0000004400 cinder-backup[101319]: "md5": "25e317773f308e446cc84c503a6d1f85", Jul 03 09:43:35.835940 np0000004400 cinder-backup[101319]: "offset": 262144000 Jul 03 09:43:35.835940 np0000004400 cinder-backup[101319]: } Jul 03 09:43:35.835940 np0000004400 cinder-backup[101319]: }, Jul 03 09:43:35.835940 np0000004400 cinder-backup[101319]: { Jul 03 09:43:35.835940 np0000004400 cinder-backup[101319]: "volume_1c366dd9-1a3c-4cb8-8f7c-4fdabf6fb81e/20260703094315/az_nova_backup_8727aa2b-db7a-4559-b380-bc6d983ed688-00007": { Jul 03 09:43:35.835940 np0000004400 cinder-backup[101319]: "compression": "zlib", Jul 03 09:43:35.835940 np0000004400 cinder-backup[101319]: "length": 52428800, Jul 03 09:43:35.835940 np0000004400 cinder-backup[101319]: "md5": "25e317773f308e446cc84c503a6d1f85", Jul 03 09:43:35.835940 np0000004400 cinder-backup[101319]: "offset": 314572800 Jul 03 09:43:35.835940 np0000004400 cinder-backup[101319]: } Jul 03 09:43:35.835940 np0000004400 cinder-backup[101319]: }, Jul 03 09:43:35.835940 np0000004400 cinder-backup[101319]: { Jul 03 09:43:35.835940 np0000004400 cinder-backup[101319]: "volume_1c366dd9-1a3c-4cb8-8f7c-4fdabf6fb81e/20260703094315/az_nova_backup_8727aa2b-db7a-4559-b380-bc6d983ed688-00008": { Jul 03 09:43:35.835940 np0000004400 cinder-backup[101319]: "compression": "zlib", Jul 03 09:43:35.835940 np0000004400 cinder-backup[101319]: "length": 52428800, Jul 03 09:43:35.835940 np0000004400 cinder-backup[101319]: "md5": "25e317773f308e446cc84c503a6d1f85", Jul 03 09:43:35.835940 np0000004400 cinder-backup[101319]: "offset": 367001600 Jul 03 09:43:35.835940 np0000004400 cinder-backup[101319]: } Jul 03 09:43:35.835940 np0000004400 cinder-backup[101319]: }, Jul 03 09:43:35.835940 np0000004400 cinder-backup[101319]: { Jul 03 09:43:35.835940 np0000004400 cinder-backup[101319]: "volume_1c366dd9-1a3c-4cb8-8f7c-4fdabf6fb81e/20260703094315/az_nova_backup_8727aa2b-db7a-4559-b380-bc6d983ed688-00009": { Jul 03 09:43:35.835940 np0000004400 cinder-backup[101319]: "compression": "zlib", Jul 03 09:43:35.835940 np0000004400 cinder-backup[101319]: "length": 52428800, Jul 03 09:43:35.835940 np0000004400 cinder-backup[101319]: "md5": "25e317773f308e446cc84c503a6d1f85", Jul 03 09:43:35.835940 np0000004400 cinder-backup[101319]: "offset": 419430400 Jul 03 09:43:35.835940 np0000004400 cinder-backup[101319]: } Jul 03 09:43:35.835940 np0000004400 cinder-backup[101319]: }, Jul 03 09:43:35.835940 np0000004400 cinder-backup[101319]: { Jul 03 09:43:35.835940 np0000004400 cinder-backup[101319]: "volume_1c366dd9-1a3c-4cb8-8f7c-4fdabf6fb81e/20260703094315/az_nova_backup_8727aa2b-db7a-4559-b380-bc6d983ed688-00010": { Jul 03 09:43:35.835940 np0000004400 cinder-backup[101319]: "compression": "zlib", Jul 03 09:43:35.835940 np0000004400 cinder-backup[101319]: "length": 52428800, Jul 03 09:43:35.835940 np0000004400 cinder-backup[101319]: "md5": "25e317773f308e446cc84c503a6d1f85", Jul 03 09:43:35.835940 np0000004400 cinder-backup[101319]: "offset": 471859200 Jul 03 09:43:35.835940 np0000004400 cinder-backup[101319]: } Jul 03 09:43:35.835940 np0000004400 cinder-backup[101319]: }, Jul 03 09:43:35.835940 np0000004400 cinder-backup[101319]: { Jul 03 09:43:35.835940 np0000004400 cinder-backup[101319]: "volume_1c366dd9-1a3c-4cb8-8f7c-4fdabf6fb81e/20260703094315/az_nova_backup_8727aa2b-db7a-4559-b380-bc6d983ed688-00011": { Jul 03 09:43:35.835940 np0000004400 cinder-backup[101319]: "compression": "zlib", Jul 03 09:43:35.835940 np0000004400 cinder-backup[101319]: "length": 52428800, Jul 03 09:43:35.835940 np0000004400 cinder-backup[101319]: "md5": "25e317773f308e446cc84c503a6d1f85", Jul 03 09:43:35.835940 np0000004400 cinder-backup[101319]: "offset": 524288000 Jul 03 09:43:35.835940 np0000004400 cinder-backup[101319]: } Jul 03 09:43:35.835940 np0000004400 cinder-backup[101319]: }, Jul 03 09:43:35.835940 np0000004400 cinder-backup[101319]: { Jul 03 09:43:35.835940 np0000004400 cinder-backup[101319]: "volume_1c366dd9-1a3c-4cb8-8f7c-4fdabf6fb81e/20260703094315/az_nova_backup_8727aa2b-db7a-4559-b380-bc6d983ed688-00012": { Jul 03 09:43:35.835940 np0000004400 cinder-backup[101319]: "compression": "zlib", Jul 03 09:43:35.835940 np0000004400 cinder-backup[101319]: "length": 52428800, Jul 03 09:43:35.835940 np0000004400 cinder-backup[101319]: "md5": "25e317773f308e446cc84c503a6d1f85", Jul 03 09:43:35.835940 np0000004400 cinder-backup[101319]: "offset": 576716800 Jul 03 09:43:35.835940 np0000004400 cinder-backup[101319]: } Jul 03 09:43:35.835940 np0000004400 cinder-backup[101319]: }, Jul 03 09:43:35.835940 np0000004400 cinder-backup[101319]: { Jul 03 09:43:35.835940 np0000004400 cinder-backup[101319]: "volume_1c366dd9-1a3c-4cb8-8f7c-4fdabf6fb81e/20260703094315/az_nova_backup_8727aa2b-db7a-4559-b380-bc6d983ed688-00013": { Jul 03 09:43:35.835940 np0000004400 cinder-backup[101319]: "compression": "zlib", Jul 03 09:43:35.835940 np0000004400 cinder-backup[101319]: "length": 52428800, Jul 03 09:43:35.835940 np0000004400 cinder-backup[101319]: "md5": "25e317773f308e446cc84c503a6d1f85", Jul 03 09:43:35.835940 np0000004400 cinder-backup[101319]: "offset": 629145600 Jul 03 09:43:35.835940 np0000004400 cinder-backup[101319]: } Jul 03 09:43:35.835940 np0000004400 cinder-backup[101319]: }, Jul 03 09:43:35.835940 np0000004400 cinder-backup[101319]: { Jul 03 09:43:35.835940 np0000004400 cinder-backup[101319]: "volume_1c366dd9-1a3c-4cb8-8f7c-4fdabf6fb81e/20260703094315/az_nova_backup_8727aa2b-db7a-4559-b380-bc6d983ed688-00014": { Jul 03 09:43:35.835940 np0000004400 cinder-backup[101319]: "compression": "zlib", Jul 03 09:43:35.835940 np0000004400 cinder-backup[101319]: "length": 52428800, Jul 03 09:43:35.835940 np0000004400 cinder-backup[101319]: "md5": "25e317773f308e446cc84c503a6d1f85", Jul 03 09:43:35.835940 np0000004400 cinder-backup[101319]: "offset": 681574400 Jul 03 09:43:35.835940 np0000004400 cinder-backup[101319]: } Jul 03 09:43:35.835940 np0000004400 cinder-backup[101319]: }, Jul 03 09:43:35.835940 np0000004400 cinder-backup[101319]: { Jul 03 09:43:35.835940 np0000004400 cinder-backup[101319]: "volume_1c366dd9-1a3c-4cb8-8f7c-4fdabf6fb81e/20260703094315/az_nova_backup_8727aa2b-db7a-4559-b380-bc6d983ed688-00015": { Jul 03 09:43:35.835940 np0000004400 cinder-backup[101319]: "compression": "zlib", Jul 03 09:43:35.835940 np0000004400 cinder-backup[101319]: "length": 52428800, Jul 03 09:43:35.835940 np0000004400 cinder-backup[101319]: "md5": "25e317773f308e446cc84c503a6d1f85", Jul 03 09:43:35.835940 np0000004400 cinder-backup[101319]: "offset": 734003200 Jul 03 09:43:35.835940 np0000004400 cinder-backup[101319]: } Jul 03 09:43:35.835940 np0000004400 cinder-backup[101319]: }, Jul 03 09:43:35.835940 np0000004400 cinder-backup[101319]: { Jul 03 09:43:35.835940 np0000004400 cinder-backup[101319]: "volume_1c366dd9-1a3c-4cb8-8f7c-4fdabf6fb81e/20260703094315/az_nova_backup_8727aa2b-db7a-4559-b380-bc6d983ed688-00016": { Jul 03 09:43:35.835940 np0000004400 cinder-backup[101319]: "compression": "zlib", Jul 03 09:43:35.835940 np0000004400 cinder-backup[101319]: "length": 52428800, Jul 03 09:43:35.835940 np0000004400 cinder-backup[101319]: "md5": "25e317773f308e446cc84c503a6d1f85", Jul 03 09:43:35.835940 np0000004400 cinder-backup[101319]: "offset": 786432000 Jul 03 09:43:35.835940 np0000004400 cinder-backup[101319]: } Jul 03 09:43:35.835940 np0000004400 cinder-backup[101319]: }, Jul 03 09:43:35.835940 np0000004400 cinder-backup[101319]: { Jul 03 09:43:35.835940 np0000004400 cinder-backup[101319]: "volume_1c366dd9-1a3c-4cb8-8f7c-4fdabf6fb81e/20260703094315/az_nova_backup_8727aa2b-db7a-4559-b380-bc6d983ed688-00017": { Jul 03 09:43:35.835940 np0000004400 cinder-backup[101319]: "compression": "zlib", Jul 03 09:43:35.835940 np0000004400 cinder-backup[101319]: "length": 52428800, Jul 03 09:43:35.835940 np0000004400 cinder-backup[101319]: "md5": "25e317773f308e446cc84c503a6d1f85", Jul 03 09:43:35.835940 np0000004400 cinder-backup[101319]: "offset": 838860800 Jul 03 09:43:35.835940 np0000004400 cinder-backup[101319]: } Jul 03 09:43:35.835940 np0000004400 cinder-backup[101319]: }, Jul 03 09:43:35.835940 np0000004400 cinder-backup[101319]: { Jul 03 09:43:35.835940 np0000004400 cinder-backup[101319]: "volume_1c366dd9-1a3c-4cb8-8f7c-4fdabf6fb81e/20260703094315/az_nova_backup_8727aa2b-db7a-4559-b380-bc6d983ed688-00018": { Jul 03 09:43:35.835940 np0000004400 cinder-backup[101319]: "compression": "zlib", Jul 03 09:43:35.835940 np0000004400 cinder-backup[101319]: "length": 52428800, Jul 03 09:43:35.835940 np0000004400 cinder-backup[101319]: "md5": "25e317773f308e446cc84c503a6d1f85", Jul 03 09:43:35.835940 np0000004400 cinder-backup[101319]: "offset": 891289600 Jul 03 09:43:35.835940 np0000004400 cinder-backup[101319]: } Jul 03 09:43:35.835940 np0000004400 cinder-backup[101319]: }, Jul 03 09:43:35.835940 np0000004400 cinder-backup[101319]: { Jul 03 09:43:35.835940 np0000004400 cinder-backup[101319]: "volume_1c366dd9-1a3c-4cb8-8f7c-4fdabf6fb81e/20260703094315/az_nova_backup_8727aa2b-db7a-4559-b380-bc6d983ed688-00019": { Jul 03 09:43:35.835940 np0000004400 cinder-backup[101319]: "compression": "zlib", Jul 03 09:43:35.835940 np0000004400 cinder-backup[101319]: "length": 52428800, Jul 03 09:43:35.835940 np0000004400 cinder-backup[101319]: "md5": "25e317773f308e446cc84c503a6d1f85", Jul 03 09:43:35.835940 np0000004400 cinder-backup[101319]: "offset": 943718400 Jul 03 09:43:35.835940 np0000004400 cinder-backup[101319]: } Jul 03 09:43:35.835940 np0000004400 cinder-backup[101319]: }, Jul 03 09:43:35.835940 np0000004400 cinder-backup[101319]: { Jul 03 09:43:35.835940 np0000004400 cinder-backup[101319]: "volume_1c366dd9-1a3c-4cb8-8f7c-4fdabf6fb81e/20260703094315/az_nova_backup_8727aa2b-db7a-4559-b380-bc6d983ed688-00020": { Jul 03 09:43:35.835940 np0000004400 cinder-backup[101319]: "compression": "zlib", Jul 03 09:43:35.835940 np0000004400 cinder-backup[101319]: "length": 52428800, Jul 03 09:43:35.835940 np0000004400 cinder-backup[101319]: "md5": "25e317773f308e446cc84c503a6d1f85", Jul 03 09:43:35.835940 np0000004400 cinder-backup[101319]: "offset": 996147200 Jul 03 09:43:35.835940 np0000004400 cinder-backup[101319]: } Jul 03 09:43:35.835940 np0000004400 cinder-backup[101319]: }, Jul 03 09:43:35.835940 np0000004400 cinder-backup[101319]: { Jul 03 09:43:35.835940 np0000004400 cinder-backup[101319]: "volume_1c366dd9-1a3c-4cb8-8f7c-4fdabf6fb81e/20260703094315/az_nova_backup_8727aa2b-db7a-4559-b380-bc6d983ed688-00021": { Jul 03 09:43:35.835940 np0000004400 cinder-backup[101319]: "compression": "zlib", Jul 03 09:43:35.835940 np0000004400 cinder-backup[101319]: "length": 25165824, Jul 03 09:43:35.835940 np0000004400 cinder-backup[101319]: "md5": "77377273b0a4b61febdbf7bbf52b9db9", Jul 03 09:43:35.835940 np0000004400 cinder-backup[101319]: "offset": 1048576000 Jul 03 09:43:35.835940 np0000004400 cinder-backup[101319]: } Jul 03 09:43:35.835940 np0000004400 cinder-backup[101319]: } Jul 03 09:43:35.835940 np0000004400 cinder-backup[101319]: ], Jul 03 09:43:35.835940 np0000004400 cinder-backup[101319]: "parent_id": null, Jul 03 09:43:35.835940 np0000004400 cinder-backup[101319]: "version": "1.0.0", Jul 03 09:43:35.835940 np0000004400 cinder-backup[101319]: "volume_id": "1c366dd9-1a3c-4cb8-8f7c-4fdabf6fb81e", Jul 03 09:43:35.835940 np0000004400 cinder-backup[101319]: "volume_meta": "{\"version\": 2, \"volume-base-metadata\": {\"id\": \"1c366dd9-1a3c-4cb8-8f7c-4fdabf6fb81e\", \"_name_id\": null, \"use_quota\": true, \"ec2_id\": null, \"user_id\": \"291d5b00365c48af818ae26172e33eae\", \"project_id\": \"8a91a271598c49e1b52c4e2c3a0f4413\", \"snapshot_id\": null, \"cluster_name\": null, \"host\": \"np0000004400@storpool#default\", \"size\": 1, \"availability_zone\": \"nova\", \"status\": \"backing-up\", \"attach_status\": \"detached\", \"migration_status\": null, \"scheduled_at\": \"2026-07-03T09:43:08.000000\", \"launched_at\": \"2026-07-03T09:43:09.000000\", \"terminated_at\": null, \"display_name\": \"tempest-TestVolumeBackupRestore-volume-978809464\", \"display_description\": null, \"provider_location\": null, \"provider_auth\": null, \"provider_geometry\": null, \"provider_id\": null, \"volume_type_id\": \"03e13fe6-0e30-4803-ace0-725d38e6dc24\", \"source_volid\": null, \"encryption_key_id\": null, \"consistencygroup_id\": null, \"group_id\": null, \"bootable\": true, \"multiattach\": false, \"replication_status\": null, \"replication_extended_status\": null, \"replication_driver_data\": null, \"previous_status\": \"available\", \"service_uuid\": \"6d4b0e79-fefe-4744-b25f-34be05095200\", \"shared_targets\": true, \"deleted_at\": null, \"deleted\": false, \"created_at\": \"2026-07-03T09:43:08.000000\", \"updated_at\": \"2026-07-03T09:43:09.000000\"}, \"volume-glance-metadata\": {\"hw_rng_model\": \"virtio\", \"os_glance_failed_import\": \"\", \"os_glance_importing_to_stores\": \"\", \"owner_specified.openstack.md5\": \"\", \"owner_specified.openstack.object\": \"images/cirros-0.6.3-x86_64-disk\", \"owner_specified.openstack.sha256\": \"\", \"image_id\": \"c1946dda-7935-4a75-a25a-cf65d1d25617\", \"image_name\": \"cirros-0.6.3-x86_64-disk\", \"checksum\": \"87617e24a5e30cb3b87fda8c0764838f\", \"container_format\": \"bare\", \"disk_format\": \"qcow2\", \"min_disk\": \"0\", \"min_ram\": \"0\", \"size\": \"21692416\"}}" Jul 03 09:43:35.835940 np0000004400 cinder-backup[101319]: }. {{(pid=101319) _read_metadata /opt/stack/cinder/cinder/backup/chunkeddriver.py:327}} Jul 03 09:43:35.840303 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-44b0aacb-2564-4929-a850-d3de5c4c76bc tempest-TestVolumeBackupRestore-997771116 None] v1 volume backup restore of 8727aa2b-db7a-4559-b380-bc6d983ed688 started. {{(pid=101319) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:678}} Jul 03 09:43:35.840303 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-44b0aacb-2564-4929-a850-d3de5c4c76bc tempest-TestVolumeBackupRestore-997771116 None] metadata_object_names = ['volume_1c366dd9-1a3c-4cb8-8f7c-4fdabf6fb81e/20260703094315/az_nova_backup_8727aa2b-db7a-4559-b380-bc6d983ed688-00001', 'volume_1c366dd9-1a3c-4cb8-8f7c-4fdabf6fb81e/20260703094315/az_nova_backup_8727aa2b-db7a-4559-b380-bc6d983ed688-00002', 'volume_1c366dd9-1a3c-4cb8-8f7c-4fdabf6fb81e/20260703094315/az_nova_backup_8727aa2b-db7a-4559-b380-bc6d983ed688-00003', 'volume_1c366dd9-1a3c-4cb8-8f7c-4fdabf6fb81e/20260703094315/az_nova_backup_8727aa2b-db7a-4559-b380-bc6d983ed688-00004', 'volume_1c366dd9-1a3c-4cb8-8f7c-4fdabf6fb81e/20260703094315/az_nova_backup_8727aa2b-db7a-4559-b380-bc6d983ed688-00005', 'volume_1c366dd9-1a3c-4cb8-8f7c-4fdabf6fb81e/20260703094315/az_nova_backup_8727aa2b-db7a-4559-b380-bc6d983ed688-00006', 'volume_1c366dd9-1a3c-4cb8-8f7c-4fdabf6fb81e/20260703094315/az_nova_backup_8727aa2b-db7a-4559-b380-bc6d983ed688-00007', 'volume_1c366dd9-1a3c-4cb8-8f7c-4fdabf6fb81e/20260703094315/az_nova_backup_8727aa2b-db7a-4559-b380-bc6d983ed688-00008', 'volume_1c366dd9-1a3c-4cb8-8f7c-4fdabf6fb81e/20260703094315/az_nova_backup_8727aa2b-db7a-4559-b380-bc6d983ed688-00009', 'volume_1c366dd9-1a3c-4cb8-8f7c-4fdabf6fb81e/20260703094315/az_nova_backup_8727aa2b-db7a-4559-b380-bc6d983ed688-00010', 'volume_1c366dd9-1a3c-4cb8-8f7c-4fdabf6fb81e/20260703094315/az_nova_backup_8727aa2b-db7a-4559-b380-bc6d983ed688-00011', 'volume_1c366dd9-1a3c-4cb8-8f7c-4fdabf6fb81e/20260703094315/az_nova_backup_8727aa2b-db7a-4559-b380-bc6d983ed688-00012', 'volume_1c366dd9-1a3c-4cb8-8f7c-4fdabf6fb81e/20260703094315/az_nova_backup_8727aa2b-db7a-4559-b380-bc6d983ed688-00013', 'volume_1c366dd9-1a3c-4cb8-8f7c-4fdabf6fb81e/20260703094315/az_nova_backup_8727aa2b-db7a-4559-b380-bc6d983ed688-00014', 'volume_1c366dd9-1a3c-4cb8-8f7c-4fdabf6fb81e/20260703094315/az_nova_backup_8727aa2b-db7a-4559-b380-bc6d983ed688-00015', 'volume_1c366dd9-1a3c-4cb8-8f7c-4fdabf6fb81e/20260703094315/az_nova_backup_8727aa2b-db7a-4559-b380-bc6d983ed688-00016', 'volume_1c366dd9-1a3c-4cb8-8f7c-4fdabf6fb81e/20260703094315/az_nova_backup_8727aa2b-db7a-4559-b380-bc6d983ed688-00017', 'volume_1c366dd9-1a3c-4cb8-8f7c-4fdabf6fb81e/20260703094315/az_nova_backup_8727aa2b-db7a-4559-b380-bc6d983ed688-00018', 'volume_1c366dd9-1a3c-4cb8-8f7c-4fdabf6fb81e/20260703094315/az_nova_backup_8727aa2b-db7a-4559-b380-bc6d983ed688-00019', 'volume_1c366dd9-1a3c-4cb8-8f7c-4fdabf6fb81e/20260703094315/az_nova_backup_8727aa2b-db7a-4559-b380-bc6d983ed688-00020', 'volume_1c366dd9-1a3c-4cb8-8f7c-4fdabf6fb81e/20260703094315/az_nova_backup_8727aa2b-db7a-4559-b380-bc6d983ed688-00021']. {{(pid=101319) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:685}} Jul 03 09:43:35.889621 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-44b0aacb-2564-4929-a850-d3de5c4c76bc tempest-TestVolumeBackupRestore-997771116 None] generated object list: ['volume_1c366dd9-1a3c-4cb8-8f7c-4fdabf6fb81e/20260703094315/az_nova_backup_8727aa2b-db7a-4559-b380-bc6d983ed688-00001', 'volume_1c366dd9-1a3c-4cb8-8f7c-4fdabf6fb81e/20260703094315/az_nova_backup_8727aa2b-db7a-4559-b380-bc6d983ed688-00002', 'volume_1c366dd9-1a3c-4cb8-8f7c-4fdabf6fb81e/20260703094315/az_nova_backup_8727aa2b-db7a-4559-b380-bc6d983ed688-00003', 'volume_1c366dd9-1a3c-4cb8-8f7c-4fdabf6fb81e/20260703094315/az_nova_backup_8727aa2b-db7a-4559-b380-bc6d983ed688-00004', 'volume_1c366dd9-1a3c-4cb8-8f7c-4fdabf6fb81e/20260703094315/az_nova_backup_8727aa2b-db7a-4559-b380-bc6d983ed688-00005', 'volume_1c366dd9-1a3c-4cb8-8f7c-4fdabf6fb81e/20260703094315/az_nova_backup_8727aa2b-db7a-4559-b380-bc6d983ed688-00006', 'volume_1c366dd9-1a3c-4cb8-8f7c-4fdabf6fb81e/20260703094315/az_nova_backup_8727aa2b-db7a-4559-b380-bc6d983ed688-00007', 'volume_1c366dd9-1a3c-4cb8-8f7c-4fdabf6fb81e/20260703094315/az_nova_backup_8727aa2b-db7a-4559-b380-bc6d983ed688-00008', 'volume_1c366dd9-1a3c-4cb8-8f7c-4fdabf6fb81e/20260703094315/az_nova_backup_8727aa2b-db7a-4559-b380-bc6d983ed688-00009', 'volume_1c366dd9-1a3c-4cb8-8f7c-4fdabf6fb81e/20260703094315/az_nova_backup_8727aa2b-db7a-4559-b380-bc6d983ed688-00010', 'volume_1c366dd9-1a3c-4cb8-8f7c-4fdabf6fb81e/20260703094315/az_nova_backup_8727aa2b-db7a-4559-b380-bc6d983ed688-00011', 'volume_1c366dd9-1a3c-4cb8-8f7c-4fdabf6fb81e/20260703094315/az_nova_backup_8727aa2b-db7a-4559-b380-bc6d983ed688-00012', 'volume_1c366dd9-1a3c-4cb8-8f7c-4fdabf6fb81e/20260703094315/az_nova_backup_8727aa2b-db7a-4559-b380-bc6d983ed688-00013', 'volume_1c366dd9-1a3c-4cb8-8f7c-4fdabf6fb81e/20260703094315/az_nova_backup_8727aa2b-db7a-4559-b380-bc6d983ed688-00014', 'volume_1c366dd9-1a3c-4cb8-8f7c-4fdabf6fb81e/20260703094315/az_nova_backup_8727aa2b-db7a-4559-b380-bc6d983ed688-00015', 'volume_1c366dd9-1a3c-4cb8-8f7c-4fdabf6fb81e/20260703094315/az_nova_backup_8727aa2b-db7a-4559-b380-bc6d983ed688-00016', 'volume_1c366dd9-1a3c-4cb8-8f7c-4fdabf6fb81e/20260703094315/az_nova_backup_8727aa2b-db7a-4559-b380-bc6d983ed688-00017', 'volume_1c366dd9-1a3c-4cb8-8f7c-4fdabf6fb81e/20260703094315/az_nova_backup_8727aa2b-db7a-4559-b380-bc6d983ed688-00018', 'volume_1c366dd9-1a3c-4cb8-8f7c-4fdabf6fb81e/20260703094315/az_nova_backup_8727aa2b-db7a-4559-b380-bc6d983ed688-00019', 'volume_1c366dd9-1a3c-4cb8-8f7c-4fdabf6fb81e/20260703094315/az_nova_backup_8727aa2b-db7a-4559-b380-bc6d983ed688-00020', 'volume_1c366dd9-1a3c-4cb8-8f7c-4fdabf6fb81e/20260703094315/az_nova_backup_8727aa2b-db7a-4559-b380-bc6d983ed688-00021', 'volume_1c366dd9-1a3c-4cb8-8f7c-4fdabf6fb81e/20260703094315/az_nova_backup_8727aa2b-db7a-4559-b380-bc6d983ed688_metadata', 'volume_1c366dd9-1a3c-4cb8-8f7c-4fdabf6fb81e/20260703094315/az_nova_backup_8727aa2b-db7a-4559-b380-bc6d983ed688_sha256file']. {{(pid=101319) _generate_object_names /opt/stack/cinder/cinder/backup/chunkeddriver.py:260}} Jul 03 09:43:35.942184 np0000004400 cinder-backup[101319]: DEBUG oslo_db.sqlalchemy.engines [None req-44b0aacb-2564-4929-a850-d3de5c4c76bc tempest-TestVolumeBackupRestore-997771116 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=101319) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 03 09:43:35.947520 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-44b0aacb-2564-4929-a850-d3de5c4c76bc tempest-TestVolumeBackupRestore-997771116 None] restoring object. backup: 8727aa2b-db7a-4559-b380-bc6d983ed688, container: volumebackups, object name: volume_1c366dd9-1a3c-4cb8-8f7c-4fdabf6fb81e/20260703094315/az_nova_backup_8727aa2b-db7a-4559-b380-bc6d983ed688-00001, volume: 12c3303b-9d75-4de7-bffd-31f22f904503. {{(pid=101319) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:705}} Jul 03 09:43:36.055157 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-44b0aacb-2564-4929-a850-d3de5c4c76bc tempest-TestVolumeBackupRestore-997771116 None] decompressing data using zlib algorithm {{(pid=101319) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:722}} Jul 03 09:43:36.492810 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-44b0aacb-2564-4929-a850-d3de5c4c76bc tempest-TestVolumeBackupRestore-997771116 None] restoring object. backup: 8727aa2b-db7a-4559-b380-bc6d983ed688, container: volumebackups, object name: volume_1c366dd9-1a3c-4cb8-8f7c-4fdabf6fb81e/20260703094315/az_nova_backup_8727aa2b-db7a-4559-b380-bc6d983ed688-00002, volume: 12c3303b-9d75-4de7-bffd-31f22f904503. {{(pid=101319) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:705}} Jul 03 09:43:36.508378 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-44b0aacb-2564-4929-a850-d3de5c4c76bc tempest-TestVolumeBackupRestore-997771116 None] decompressing data using zlib algorithm {{(pid=101319) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:722}} Jul 03 09:43:36.890123 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-44b0aacb-2564-4929-a850-d3de5c4c76bc tempest-TestVolumeBackupRestore-997771116 None] restoring object. backup: 8727aa2b-db7a-4559-b380-bc6d983ed688, container: volumebackups, object name: volume_1c366dd9-1a3c-4cb8-8f7c-4fdabf6fb81e/20260703094315/az_nova_backup_8727aa2b-db7a-4559-b380-bc6d983ed688-00003, volume: 12c3303b-9d75-4de7-bffd-31f22f904503. {{(pid=101319) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:705}} Jul 03 09:43:36.911298 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-44b0aacb-2564-4929-a850-d3de5c4c76bc tempest-TestVolumeBackupRestore-997771116 None] decompressing data using zlib algorithm {{(pid=101319) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:722}} Jul 03 09:43:37.273882 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-44b0aacb-2564-4929-a850-d3de5c4c76bc tempest-TestVolumeBackupRestore-997771116 None] restoring object. backup: 8727aa2b-db7a-4559-b380-bc6d983ed688, container: volumebackups, object name: volume_1c366dd9-1a3c-4cb8-8f7c-4fdabf6fb81e/20260703094315/az_nova_backup_8727aa2b-db7a-4559-b380-bc6d983ed688-00004, volume: 12c3303b-9d75-4de7-bffd-31f22f904503. {{(pid=101319) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:705}} Jul 03 09:43:37.288126 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-44b0aacb-2564-4929-a850-d3de5c4c76bc tempest-TestVolumeBackupRestore-997771116 None] decompressing data using zlib algorithm {{(pid=101319) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:722}} Jul 03 09:43:37.669773 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-44b0aacb-2564-4929-a850-d3de5c4c76bc tempest-TestVolumeBackupRestore-997771116 None] restoring object. backup: 8727aa2b-db7a-4559-b380-bc6d983ed688, container: volumebackups, object name: volume_1c366dd9-1a3c-4cb8-8f7c-4fdabf6fb81e/20260703094315/az_nova_backup_8727aa2b-db7a-4559-b380-bc6d983ed688-00005, volume: 12c3303b-9d75-4de7-bffd-31f22f904503. {{(pid=101319) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:705}} Jul 03 09:43:37.688854 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-44b0aacb-2564-4929-a850-d3de5c4c76bc tempest-TestVolumeBackupRestore-997771116 None] decompressing data using zlib algorithm {{(pid=101319) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:722}} Jul 03 09:43:38.080591 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-44b0aacb-2564-4929-a850-d3de5c4c76bc tempest-TestVolumeBackupRestore-997771116 None] restoring object. backup: 8727aa2b-db7a-4559-b380-bc6d983ed688, container: volumebackups, object name: volume_1c366dd9-1a3c-4cb8-8f7c-4fdabf6fb81e/20260703094315/az_nova_backup_8727aa2b-db7a-4559-b380-bc6d983ed688-00006, volume: 12c3303b-9d75-4de7-bffd-31f22f904503. {{(pid=101319) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:705}} Jul 03 09:43:38.097907 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-44b0aacb-2564-4929-a850-d3de5c4c76bc tempest-TestVolumeBackupRestore-997771116 None] decompressing data using zlib algorithm {{(pid=101319) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:722}} Jul 03 09:43:38.436036 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-44b0aacb-2564-4929-a850-d3de5c4c76bc tempest-TestVolumeBackupRestore-997771116 None] restoring object. backup: 8727aa2b-db7a-4559-b380-bc6d983ed688, container: volumebackups, object name: volume_1c366dd9-1a3c-4cb8-8f7c-4fdabf6fb81e/20260703094315/az_nova_backup_8727aa2b-db7a-4559-b380-bc6d983ed688-00007, volume: 12c3303b-9d75-4de7-bffd-31f22f904503. {{(pid=101319) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:705}} Jul 03 09:43:38.449870 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-44b0aacb-2564-4929-a850-d3de5c4c76bc tempest-TestVolumeBackupRestore-997771116 None] decompressing data using zlib algorithm {{(pid=101319) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:722}} Jul 03 09:43:38.795141 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-44b0aacb-2564-4929-a850-d3de5c4c76bc tempest-TestVolumeBackupRestore-997771116 None] restoring object. backup: 8727aa2b-db7a-4559-b380-bc6d983ed688, container: volumebackups, object name: volume_1c366dd9-1a3c-4cb8-8f7c-4fdabf6fb81e/20260703094315/az_nova_backup_8727aa2b-db7a-4559-b380-bc6d983ed688-00008, volume: 12c3303b-9d75-4de7-bffd-31f22f904503. {{(pid=101319) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:705}} Jul 03 09:43:38.811591 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-44b0aacb-2564-4929-a850-d3de5c4c76bc tempest-TestVolumeBackupRestore-997771116 None] decompressing data using zlib algorithm {{(pid=101319) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:722}} Jul 03 09:43:39.159621 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-44b0aacb-2564-4929-a850-d3de5c4c76bc tempest-TestVolumeBackupRestore-997771116 None] restoring object. backup: 8727aa2b-db7a-4559-b380-bc6d983ed688, container: volumebackups, object name: volume_1c366dd9-1a3c-4cb8-8f7c-4fdabf6fb81e/20260703094315/az_nova_backup_8727aa2b-db7a-4559-b380-bc6d983ed688-00009, volume: 12c3303b-9d75-4de7-bffd-31f22f904503. {{(pid=101319) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:705}} Jul 03 09:43:39.175622 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-44b0aacb-2564-4929-a850-d3de5c4c76bc tempest-TestVolumeBackupRestore-997771116 None] decompressing data using zlib algorithm {{(pid=101319) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:722}} Jul 03 09:43:39.519466 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-44b0aacb-2564-4929-a850-d3de5c4c76bc tempest-TestVolumeBackupRestore-997771116 None] restoring object. backup: 8727aa2b-db7a-4559-b380-bc6d983ed688, container: volumebackups, object name: volume_1c366dd9-1a3c-4cb8-8f7c-4fdabf6fb81e/20260703094315/az_nova_backup_8727aa2b-db7a-4559-b380-bc6d983ed688-00010, volume: 12c3303b-9d75-4de7-bffd-31f22f904503. {{(pid=101319) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:705}} Jul 03 09:43:39.535976 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-44b0aacb-2564-4929-a850-d3de5c4c76bc tempest-TestVolumeBackupRestore-997771116 None] decompressing data using zlib algorithm {{(pid=101319) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:722}} Jul 03 09:43:39.885076 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-44b0aacb-2564-4929-a850-d3de5c4c76bc tempest-TestVolumeBackupRestore-997771116 None] restoring object. backup: 8727aa2b-db7a-4559-b380-bc6d983ed688, container: volumebackups, object name: volume_1c366dd9-1a3c-4cb8-8f7c-4fdabf6fb81e/20260703094315/az_nova_backup_8727aa2b-db7a-4559-b380-bc6d983ed688-00011, volume: 12c3303b-9d75-4de7-bffd-31f22f904503. {{(pid=101319) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:705}} Jul 03 09:43:39.909209 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-44b0aacb-2564-4929-a850-d3de5c4c76bc tempest-TestVolumeBackupRestore-997771116 None] decompressing data using zlib algorithm {{(pid=101319) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:722}} Jul 03 09:43:40.288057 np0000004400 cinder-backup[101319]: DEBUG oslo_service.periodic_task [None req-ffd932d2-122c-4e68-b5ba-628aff7ae7b8 None None] Running periodic task BackupManager.publish_service_capabilities {{(pid=101319) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 03 09:43:40.288458 np0000004400 cinder-backup[101319]: DEBUG cinder.manager [None req-ffd932d2-122c-4e68-b5ba-628aff7ae7b8 None None] Notifying Schedulers of capabilities ... {{(pid=101319) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 03 09:43:40.294716 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-44b0aacb-2564-4929-a850-d3de5c4c76bc tempest-TestVolumeBackupRestore-997771116 None] restoring object. backup: 8727aa2b-db7a-4559-b380-bc6d983ed688, container: volumebackups, object name: volume_1c366dd9-1a3c-4cb8-8f7c-4fdabf6fb81e/20260703094315/az_nova_backup_8727aa2b-db7a-4559-b380-bc6d983ed688-00012, volume: 12c3303b-9d75-4de7-bffd-31f22f904503. {{(pid=101319) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:705}} Jul 03 09:43:40.310136 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-44b0aacb-2564-4929-a850-d3de5c4c76bc tempest-TestVolumeBackupRestore-997771116 None] decompressing data using zlib algorithm {{(pid=101319) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:722}} Jul 03 09:43:40.642828 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-44b0aacb-2564-4929-a850-d3de5c4c76bc tempest-TestVolumeBackupRestore-997771116 None] restoring object. backup: 8727aa2b-db7a-4559-b380-bc6d983ed688, container: volumebackups, object name: volume_1c366dd9-1a3c-4cb8-8f7c-4fdabf6fb81e/20260703094315/az_nova_backup_8727aa2b-db7a-4559-b380-bc6d983ed688-00013, volume: 12c3303b-9d75-4de7-bffd-31f22f904503. {{(pid=101319) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:705}} Jul 03 09:43:40.658606 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-44b0aacb-2564-4929-a850-d3de5c4c76bc tempest-TestVolumeBackupRestore-997771116 None] decompressing data using zlib algorithm {{(pid=101319) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:722}} Jul 03 09:43:41.030008 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-44b0aacb-2564-4929-a850-d3de5c4c76bc tempest-TestVolumeBackupRestore-997771116 None] restoring object. backup: 8727aa2b-db7a-4559-b380-bc6d983ed688, container: volumebackups, object name: volume_1c366dd9-1a3c-4cb8-8f7c-4fdabf6fb81e/20260703094315/az_nova_backup_8727aa2b-db7a-4559-b380-bc6d983ed688-00014, volume: 12c3303b-9d75-4de7-bffd-31f22f904503. {{(pid=101319) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:705}} Jul 03 09:43:41.050753 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-44b0aacb-2564-4929-a850-d3de5c4c76bc tempest-TestVolumeBackupRestore-997771116 None] decompressing data using zlib algorithm {{(pid=101319) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:722}} Jul 03 09:43:41.416104 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-44b0aacb-2564-4929-a850-d3de5c4c76bc tempest-TestVolumeBackupRestore-997771116 None] restoring object. backup: 8727aa2b-db7a-4559-b380-bc6d983ed688, container: volumebackups, object name: volume_1c366dd9-1a3c-4cb8-8f7c-4fdabf6fb81e/20260703094315/az_nova_backup_8727aa2b-db7a-4559-b380-bc6d983ed688-00015, volume: 12c3303b-9d75-4de7-bffd-31f22f904503. {{(pid=101319) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:705}} Jul 03 09:43:41.432589 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-44b0aacb-2564-4929-a850-d3de5c4c76bc tempest-TestVolumeBackupRestore-997771116 None] decompressing data using zlib algorithm {{(pid=101319) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:722}} Jul 03 09:43:41.772968 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-44b0aacb-2564-4929-a850-d3de5c4c76bc tempest-TestVolumeBackupRestore-997771116 None] restoring object. backup: 8727aa2b-db7a-4559-b380-bc6d983ed688, container: volumebackups, object name: volume_1c366dd9-1a3c-4cb8-8f7c-4fdabf6fb81e/20260703094315/az_nova_backup_8727aa2b-db7a-4559-b380-bc6d983ed688-00016, volume: 12c3303b-9d75-4de7-bffd-31f22f904503. {{(pid=101319) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:705}} Jul 03 09:43:41.787809 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-44b0aacb-2564-4929-a850-d3de5c4c76bc tempest-TestVolumeBackupRestore-997771116 None] decompressing data using zlib algorithm {{(pid=101319) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:722}} Jul 03 09:43:42.148966 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-44b0aacb-2564-4929-a850-d3de5c4c76bc tempest-TestVolumeBackupRestore-997771116 None] restoring object. backup: 8727aa2b-db7a-4559-b380-bc6d983ed688, container: volumebackups, object name: volume_1c366dd9-1a3c-4cb8-8f7c-4fdabf6fb81e/20260703094315/az_nova_backup_8727aa2b-db7a-4559-b380-bc6d983ed688-00017, volume: 12c3303b-9d75-4de7-bffd-31f22f904503. {{(pid=101319) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:705}} Jul 03 09:43:42.167847 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-44b0aacb-2564-4929-a850-d3de5c4c76bc tempest-TestVolumeBackupRestore-997771116 None] decompressing data using zlib algorithm {{(pid=101319) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:722}} Jul 03 09:43:42.557328 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-44b0aacb-2564-4929-a850-d3de5c4c76bc tempest-TestVolumeBackupRestore-997771116 None] restoring object. backup: 8727aa2b-db7a-4559-b380-bc6d983ed688, container: volumebackups, object name: volume_1c366dd9-1a3c-4cb8-8f7c-4fdabf6fb81e/20260703094315/az_nova_backup_8727aa2b-db7a-4559-b380-bc6d983ed688-00018, volume: 12c3303b-9d75-4de7-bffd-31f22f904503. {{(pid=101319) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:705}} Jul 03 09:43:43.209450 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-44b0aacb-2564-4929-a850-d3de5c4c76bc tempest-TestVolumeBackupRestore-997771116 None] decompressing data using zlib algorithm {{(pid=101319) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:722}} Jul 03 09:43:43.209450 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-44b0aacb-2564-4929-a850-d3de5c4c76bc tempest-TestVolumeBackupRestore-997771116 None] restoring object. backup: 8727aa2b-db7a-4559-b380-bc6d983ed688, container: volumebackups, object name: volume_1c366dd9-1a3c-4cb8-8f7c-4fdabf6fb81e/20260703094315/az_nova_backup_8727aa2b-db7a-4559-b380-bc6d983ed688-00019, volume: 12c3303b-9d75-4de7-bffd-31f22f904503. {{(pid=101319) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:705}} Jul 03 09:43:43.209450 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-44b0aacb-2564-4929-a850-d3de5c4c76bc tempest-TestVolumeBackupRestore-997771116 None] decompressing data using zlib algorithm {{(pid=101319) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:722}} Jul 03 09:43:43.312629 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-44b0aacb-2564-4929-a850-d3de5c4c76bc tempest-TestVolumeBackupRestore-997771116 None] restoring object. backup: 8727aa2b-db7a-4559-b380-bc6d983ed688, container: volumebackups, object name: volume_1c366dd9-1a3c-4cb8-8f7c-4fdabf6fb81e/20260703094315/az_nova_backup_8727aa2b-db7a-4559-b380-bc6d983ed688-00020, volume: 12c3303b-9d75-4de7-bffd-31f22f904503. {{(pid=101319) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:705}} Jul 03 09:43:43.327016 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-44b0aacb-2564-4929-a850-d3de5c4c76bc tempest-TestVolumeBackupRestore-997771116 None] decompressing data using zlib algorithm {{(pid=101319) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:722}} Jul 03 09:43:43.658585 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-44b0aacb-2564-4929-a850-d3de5c4c76bc tempest-TestVolumeBackupRestore-997771116 None] restoring object. backup: 8727aa2b-db7a-4559-b380-bc6d983ed688, container: volumebackups, object name: volume_1c366dd9-1a3c-4cb8-8f7c-4fdabf6fb81e/20260703094315/az_nova_backup_8727aa2b-db7a-4559-b380-bc6d983ed688-00021, volume: 12c3303b-9d75-4de7-bffd-31f22f904503. {{(pid=101319) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:705}} Jul 03 09:43:43.673684 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-44b0aacb-2564-4929-a850-d3de5c4c76bc tempest-TestVolumeBackupRestore-997771116 None] decompressing data using zlib algorithm {{(pid=101319) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:722}} Jul 03 09:43:43.830376 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-44b0aacb-2564-4929-a850-d3de5c4c76bc tempest-TestVolumeBackupRestore-997771116 None] v1 volume backup restore of 8727aa2b-db7a-4559-b380-bc6d983ed688 finished. {{(pid=101319) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:750}} Jul 03 09:43:43.831939 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.driver [None req-44b0aacb-2564-4929-a850-d3de5c4c76bc tempest-TestVolumeBackupRestore-997771116 None] Restoring volume base metadata {{(pid=101319) _restore_vol_base_meta /opt/stack/cinder/cinder/backup/driver.py:177}} Jul 03 09:43:43.840867 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.driver [None req-44b0aacb-2564-4929-a850-d3de5c4c76bc tempest-TestVolumeBackupRestore-997771116 None] No metadata of type 'volume-metadata' to restore {{(pid=101319) put /opt/stack/cinder/cinder/backup/driver.py:345}} Jul 03 09:43:43.840963 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.driver [None req-44b0aacb-2564-4929-a850-d3de5c4c76bc tempest-TestVolumeBackupRestore-997771116 None] Restoring volume glance metadata {{(pid=101319) _restore_vol_glance_meta /opt/stack/cinder/cinder/backup/driver.py:258}} Jul 03 09:43:43.955697 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-44b0aacb-2564-4929-a850-d3de5c4c76bc tempest-TestVolumeBackupRestore-997771116 None] restore 8727aa2b-db7a-4559-b380-bc6d983ed688 to 12c3303b-9d75-4de7-bffd-31f22f904503 finished. {{(pid=101319) restore /opt/stack/cinder/cinder/backup/chunkeddriver.py:815}} Jul 03 09:43:43.968121 np0000004400 cinder-backup[101319]: DEBUG oslo_concurrency.processutils [None req-44b0aacb-2564-4929-a850-d3de5c4c76bc tempest-TestVolumeBackupRestore-997771116 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chown 0 /dev/sdb {{(pid=101319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 09:43:43.991627 np0000004400 sudo[131981]: stack : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chown 0 /dev/sdb Jul 03 09:43:43.992543 np0000004400 sudo[131981]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1002) Jul 03 09:43:44.309487 np0000004400 sudo[131981]: pam_unix(sudo:session): session closed for user root Jul 03 09:43:44.311525 np0000004400 cinder-backup[101319]: DEBUG oslo_concurrency.processutils [None req-44b0aacb-2564-4929-a850-d3de5c4c76bc tempest-TestVolumeBackupRestore-997771116 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chown 0 /dev/sdb" returned: 0 in 0.344s {{(pid=101319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 09:43:44.312084 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-44b0aacb-2564-4929-a850-d3de5c4c76bc tempest-TestVolumeBackupRestore-997771116 None] ==> disconnect_volume: call "{'args': (, {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-12c3303b-9d75-4de7-bffd-31f22f904503', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '12c3303b-9d75-4de7-bffd-31f22f904503', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': False}, {'type': 'block', 'scsi_wwn': 'SStorPool_iSCSI_DISK_1034578903445799004', 'path': '/dev/sdb'}), 'kwargs': {'force': True, 'ignore_errors': False}}" {{(pid=101319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}} Jul 03 09:43:44.312296 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.base [None req-44b0aacb-2564-4929-a850-d3de5c4c76bc tempest-TestVolumeBackupRestore-997771116 None] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=101319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jul 03 09:43:44.313047 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.base [None req-44b0aacb-2564-4929-a850-d3de5c4c76bc tempest-TestVolumeBackupRestore-997771116 None] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=101319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jul 03 09:43:44.313161 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-44b0aacb-2564-4929-a850-d3de5c4c76bc tempest-TestVolumeBackupRestore-997771116 None] _get_connection_devices called with parameters: connection_properties={'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-12c3303b-9d75-4de7-bffd-31f22f904503', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '12c3303b-9d75-4de7-bffd-31f22f904503', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': False}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=101319) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:847}} Jul 03 09:43:44.324132 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-44b0aacb-2564-4929-a850-d3de5c4c76bc tempest-TestVolumeBackupRestore-997771116 None] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS: Jul 03 09:43:44.324132 np0000004400 cinder-backup[101319]: No targets found. Jul 03 09:43:44.324132 np0000004400 cinder-backup[101319]: iSNS: Jul 03 09:43:44.324132 np0000004400 cinder-backup[101319]: No targets found. Jul 03 09:43:44.324132 np0000004400 cinder-backup[101319]: STATIC: Jul 03 09:43:44.324132 np0000004400 cinder-backup[101319]: Target: iqn.2023-03.storpool.com:os--volume-12c3303b-9d75-4de7-bffd-31f22f904503 Jul 03 09:43:44.324132 np0000004400 cinder-backup[101319]: Portal: 192.168.40.100:3260,-1 Jul 03 09:43:44.324132 np0000004400 cinder-backup[101319]: Iface Name: default Jul 03 09:43:44.324132 np0000004400 cinder-backup[101319]: Target: iqn.2023-03.storpool.com:os--volume-b2e4f10c-8033-4c54-95a1-dfe45d6357a3 Jul 03 09:43:44.324132 np0000004400 cinder-backup[101319]: Portal: 192.168.50.100:3260,-1 Jul 03 09:43:44.324132 np0000004400 cinder-backup[101319]: Iface Name: default Jul 03 09:43:44.324132 np0000004400 cinder-backup[101319]: Portal: 192.168.40.100:3260,-1 Jul 03 09:43:44.324132 np0000004400 cinder-backup[101319]: Iface Name: default Jul 03 09:43:44.324132 np0000004400 cinder-backup[101319]: Target: iqn.2023-03.storpool.com:os--volume-f1c2bb03-f1f4-4186-9466-3b699bca16e6 Jul 03 09:43:44.324132 np0000004400 cinder-backup[101319]: Portal: 192.168.50.100:3260,-1 Jul 03 09:43:44.324132 np0000004400 cinder-backup[101319]: Iface Name: default Jul 03 09:43:44.324132 np0000004400 cinder-backup[101319]: Portal: 192.168.40.100:3260,-1 Jul 03 09:43:44.324132 np0000004400 cinder-backup[101319]: Iface Name: default Jul 03 09:43:44.324132 np0000004400 cinder-backup[101319]: Target: iqn.2023-03.storpool.com:os--volume-e9e3f386-d923-4ae1-a6ce-8dd2091673ac Jul 03 09:43:44.324132 np0000004400 cinder-backup[101319]: Portal: 192.168.50.100:3260,-1 Jul 03 09:43:44.324132 np0000004400 cinder-backup[101319]: Iface Name: default Jul 03 09:43:44.324132 np0000004400 cinder-backup[101319]: Portal: 192.168.40.100:3260,-1 Jul 03 09:43:44.324132 np0000004400 cinder-backup[101319]: Iface Name: default Jul 03 09:43:44.324132 np0000004400 cinder-backup[101319]: FIRMWARE: Jul 03 09:43:44.324132 np0000004400 cinder-backup[101319]: No targets found. Jul 03 09:43:44.324132 np0000004400 cinder-backup[101319]: stderr= {{(pid=101319) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jul 03 09:43:44.324703 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-44b0aacb-2564-4929-a850-d3de5c4c76bc tempest-TestVolumeBackupRestore-997771116 None] Regex to get portals from discoverydb: ^SENDTARGETS: Jul 03 09:43:44.324703 np0000004400 cinder-backup[101319]: .*?^DiscoveryAddress: 192.168.40.100,3260.*? Jul 03 09:43:44.324703 np0000004400 cinder-backup[101319]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=101319) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:390}} Jul 03 09:43:44.324703 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-44b0aacb-2564-4929-a850-d3de5c4c76bc tempest-TestVolumeBackupRestore-997771116 None] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-12c3303b-9d75-4de7-bffd-31f22f904503', 0)] {{(pid=101319) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:858}} Jul 03 09:43:44.346970 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-44b0aacb-2564-4929-a850-d3de5c4c76bc tempest-TestVolumeBackupRestore-997771116 None] iscsiadm ('-m', 'session'): stdout=tcp: [49] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b2e4f10c-8033-4c54-95a1-dfe45d6357a3 (non-flash) Jul 03 09:43:44.346970 np0000004400 cinder-backup[101319]: tcp: [50] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b2e4f10c-8033-4c54-95a1-dfe45d6357a3 (non-flash) Jul 03 09:43:44.346970 np0000004400 cinder-backup[101319]: tcp: [72] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e9e3f386-d923-4ae1-a6ce-8dd2091673ac (non-flash) Jul 03 09:43:44.346970 np0000004400 cinder-backup[101319]: tcp: [73] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e9e3f386-d923-4ae1-a6ce-8dd2091673ac (non-flash) Jul 03 09:43:44.346970 np0000004400 cinder-backup[101319]: tcp: [76] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f1c2bb03-f1f4-4186-9466-3b699bca16e6 (non-flash) Jul 03 09:43:44.346970 np0000004400 cinder-backup[101319]: tcp: [77] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f1c2bb03-f1f4-4186-9466-3b699bca16e6 (non-flash) Jul 03 09:43:44.346970 np0000004400 cinder-backup[101319]: tcp: [79] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-12c3303b-9d75-4de7-bffd-31f22f904503 (non-flash) Jul 03 09:43:44.346970 np0000004400 cinder-backup[101319]: stderr= {{(pid=101319) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jul 03 09:43:44.347246 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-44b0aacb-2564-4929-a850-d3de5c4c76bc tempest-TestVolumeBackupRestore-997771116 None] iscsi session list stdout=tcp: [49] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b2e4f10c-8033-4c54-95a1-dfe45d6357a3 (non-flash) Jul 03 09:43:44.347246 np0000004400 cinder-backup[101319]: tcp: [50] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b2e4f10c-8033-4c54-95a1-dfe45d6357a3 (non-flash) Jul 03 09:43:44.347246 np0000004400 cinder-backup[101319]: tcp: [72] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e9e3f386-d923-4ae1-a6ce-8dd2091673ac (non-flash) Jul 03 09:43:44.347246 np0000004400 cinder-backup[101319]: tcp: [73] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e9e3f386-d923-4ae1-a6ce-8dd2091673ac (non-flash) Jul 03 09:43:44.347246 np0000004400 cinder-backup[101319]: tcp: [76] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f1c2bb03-f1f4-4186-9466-3b699bca16e6 (non-flash) Jul 03 09:43:44.347246 np0000004400 cinder-backup[101319]: tcp: [77] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f1c2bb03-f1f4-4186-9466-3b699bca16e6 (non-flash) Jul 03 09:43:44.347246 np0000004400 cinder-backup[101319]: tcp: [79] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-12c3303b-9d75-4de7-bffd-31f22f904503 (non-flash) Jul 03 09:43:44.347246 np0000004400 cinder-backup[101319]: stderr= {{(pid=101319) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jul 03 09:43:44.347246 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-44b0aacb-2564-4929-a850-d3de5c4c76bc tempest-TestVolumeBackupRestore-997771116 None] Sessions list: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-b2e4f10c-8033-4c54-95a1-dfe45d6357a3', '49'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-b2e4f10c-8033-4c54-95a1-dfe45d6357a3', '50'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-e9e3f386-d923-4ae1-a6ce-8dd2091673ac', '72'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-e9e3f386-d923-4ae1-a6ce-8dd2091673ac', '73'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-f1c2bb03-f1f4-4186-9466-3b699bca16e6', '76'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-f1c2bb03-f1f4-4186-9466-3b699bca16e6', '77'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-12c3303b-9d75-4de7-bffd-31f22f904503', '79')] {{(pid=101319) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:866}} Jul 03 09:43:44.347445 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-44b0aacb-2564-4929-a850-d3de5c4c76bc tempest-TestVolumeBackupRestore-997771116 None] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-12c3303b-9d75-4de7-bffd-31f22f904503, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-12c3303b-9d75-4de7-bffd-31f22f904503', '79')] {{(pid=101319) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}} Jul 03 09:43:44.348282 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-44b0aacb-2564-4929-a850-d3de5c4c76bc tempest-TestVolumeBackupRestore-997771116 None] Resulting device map defaultdict(. at 0x7e76e7355f80>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-12c3303b-9d75-4de7-bffd-31f22f904503'): ({'sdb'}, set())}) {{(pid=101319) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:912}} Jul 03 09:43:44.348495 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.linuxscsi [None req-44b0aacb-2564-4929-a850-d3de5c4c76bc tempest-TestVolumeBackupRestore-997771116 None] Removing single pathed devices sdb {{(pid=101319) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}} Jul 03 09:43:44.358054 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.linuxscsi [None req-44b0aacb-2564-4929-a850-d3de5c4c76bc tempest-TestVolumeBackupRestore-997771116 None] Flushing IO for device /dev/sdb {{(pid=101319) flush_device_io /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:461}} Jul 03 09:43:44.366373 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.linuxscsi [None req-44b0aacb-2564-4929-a850-d3de5c4c76bc tempest-TestVolumeBackupRestore-997771116 None] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=101319) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}} Jul 03 09:43:44.426849 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.linuxscsi [None req-44b0aacb-2564-4929-a850-d3de5c4c76bc tempest-TestVolumeBackupRestore-997771116 None] Checking to see if SCSI volumes sdb have been removed. {{(pid=101319) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}} Jul 03 09:43:44.427025 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.linuxscsi [None req-44b0aacb-2564-4929-a850-d3de5c4c76bc tempest-TestVolumeBackupRestore-997771116 None] SCSI volumes sdb have been removed. {{(pid=101319) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}} Jul 03 09:43:44.428283 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.linuxscsi [None req-44b0aacb-2564-4929-a850-d3de5c4c76bc tempest-TestVolumeBackupRestore-997771116 None] Checking to see if device paths {'sdb'} are still under multipathd monitoring {{(pid=101319) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}} Jul 03 09:43:44.437284 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.linuxscsi [None req-44b0aacb-2564-4929-a850-d3de5c4c76bc tempest-TestVolumeBackupRestore-997771116 None] Device paths {'sdb'} have been removed from multipathd monitoring. {{(pid=101319) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}} Jul 03 09:43:44.437542 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-44b0aacb-2564-4929-a850-d3de5c4c76bc tempest-TestVolumeBackupRestore-997771116 None] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-12c3303b-9d75-4de7-bffd-31f22f904503')] {{(pid=101319) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1225}} Jul 03 09:43:44.447082 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-44b0aacb-2564-4929-a850-d3de5c4c76bc tempest-TestVolumeBackupRestore-997771116 None] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=101319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 03 09:43:44.479413 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-44b0aacb-2564-4929-a850-d3de5c4c76bc tempest-TestVolumeBackupRestore-997771116 None] iscsiadm ('--logout',): stdout=Logging out of session [sid: 79, target: iqn.2023-03.storpool.com:os--volume-12c3303b-9d75-4de7-bffd-31f22f904503, portal: 192.168.40.100,3260] Jul 03 09:43:44.479413 np0000004400 cinder-backup[101319]: Logout of [sid: 79, target: iqn.2023-03.storpool.com:os--volume-12c3303b-9d75-4de7-bffd-31f22f904503, portal: 192.168.40.100,3260] successful. Jul 03 09:43:44.479413 np0000004400 cinder-backup[101319]: stderr= {{(pid=101319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 03 09:43:44.493180 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-44b0aacb-2564-4929-a850-d3de5c4c76bc tempest-TestVolumeBackupRestore-997771116 None] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=101319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 03 09:43:44.493433 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.base [None req-44b0aacb-2564-4929-a850-d3de5c4c76bc tempest-TestVolumeBackupRestore-997771116 None] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.181s {{(pid=101319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jul 03 09:43:44.493583 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-44b0aacb-2564-4929-a850-d3de5c4c76bc tempest-TestVolumeBackupRestore-997771116 None] <== disconnect_volume: return (180ms) None {{(pid=101319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}} Jul 03 09:43:45.509818 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.manager [None req-44b0aacb-2564-4929-a850-d3de5c4c76bc tempest-TestVolumeBackupRestore-997771116 None] Encryption key ID for volume 12c3303b-9d75-4de7-bffd-31f22f904503 already matches encryption key ID in backup 8727aa2b-db7a-4559-b380-bc6d983ed688. {{(pid=101319) _run_restore /opt/stack/cinder/cinder/backup/manager.py:873}} Jul 03 09:43:45.533329 np0000004400 cinder-backup[101319]: INFO cinder.backup.manager [None req-44b0aacb-2564-4929-a850-d3de5c4c76bc tempest-TestVolumeBackupRestore-997771116 None] Finished restoring backup 8727aa2b-db7a-4559-b380-bc6d983ed688 to volume 12c3303b-9d75-4de7-bffd-31f22f904503. Jul 03 09:43:55.530454 np0000004400 cinder-backup[101319]: DEBUG dbcounter [-] [101319] Writing DB stats cinder:SELECT=87,cinder:UPDATE=11,cinder:INSERT=15 {{(pid=101319) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 03 09:43:57.769102 np0000004400 cinder-backup[101319]: INFO cinder.backup.manager [None req-594028f2-f605-43c8-921d-d6dd781f88ab tempest-VolumesBackupsTest-2142009639 None] Create backup started, backup: 231fdf27-e89f-4b12-b8d9-adad9ec76225 volume: 5ff1572c-401f-4af4-81ea-e10d782a782e. Jul 03 09:43:57.773185 np0000004400 cinder-backup[101319]: INFO cinder.backup.manager [None req-594028f2-f605-43c8-921d-d6dd781f88ab tempest-VolumesBackupsTest-2142009639 None] Call Volume Manager to get_backup_device for Backup(availability_zone='nova',container='tempest-volumesbackupstest-backup-container-412072100',created_at=2026-07-03T09:43:57Z,data_timestamp=2026-07-03T09:43:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesBackupsTest-Backup-512909804',encryption_key_id=None,fail_reason=None,host='np0000004400',id=231fdf27-e89f-4b12-b8d9-adad9ec76225,metadata={},num_dependent_backups=0,object_count=0,parent=None,parent_id=None,project_id='59044e18a5b24b19a7b9b8a380f2e1a0',restore_volume_id=None,service='cinder.backup.drivers.swift.SwiftBackupDriver',service_metadata=None,size=1,snapshot_id=None,status='creating',temp_snapshot_id=None,temp_volume_id=None,updated_at=None,user_id='91463b6c437c4711a49d3c31c513a101',volume_id=5ff1572c-401f-4af4-81ea-e10d782a782e) Jul 03 09:43:57.836692 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.drivers.swift [None req-594028f2-f605-43c8-921d-d6dd781f88ab tempest-VolumesBackupsTest-2142009639 None] Using swift URL https://10.4.3.95:8080/v1/AUTH_59044e18a5b24b19a7b9b8a380f2e1a0 {{(pid=101319) initialize /opt/stack/cinder/cinder/backup/drivers/swift.py:300}} Jul 03 09:43:57.836692 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.drivers.swift [None req-594028f2-f605-43c8-921d-d6dd781f88ab tempest-VolumesBackupsTest-2142009639 None] Connect to https://10.4.3.95:8080/v1/AUTH_ in "per_user" mode {{(pid=101319) initialize /opt/stack/cinder/cinder/backup/drivers/swift.py:301}} Jul 03 09:43:57.836692 np0000004400 cinder-backup[101319]: DEBUG os_brick.utils [None req-594028f2-f605-43c8-921d-d6dd781f88ab tempest-VolumesBackupsTest-2142009639 None] ==> get_connector_properties: call "{'root_helper': 'sudo cinder-rootwrap /etc/cinder/rootwrap.conf', 'my_ip': '10.4.3.95', 'multipath': False, 'enforce_multipath': False, 'host': None, 'execute': None}" {{(pid=101319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}} Jul 03 09:43:57.846174 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.scaleio [None req-594028f2-f605-43c8-921d-d6dd781f88ab tempest-VolumesBackupsTest-2142009639 None] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=101319) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}} Jul 03 09:43:57.862553 np0000004400 cinder-backup[101319]: DEBUG oslo_concurrency.processutils [None req-594028f2-f605-43c8-921d-d6dd781f88ab tempest-VolumesBackupsTest-2142009639 None] Running cmd (subprocess): nvme version {{(pid=101319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 09:43:57.874471 np0000004400 cinder-backup[101319]: DEBUG oslo_concurrency.processutils [None req-594028f2-f605-43c8-921d-d6dd781f88ab tempest-VolumesBackupsTest-2142009639 None] 'nvme version' failed. Not Retrying. {{(pid=101319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 03 09:43:57.874756 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.nvmeof [None req-594028f2-f605-43c8-921d-d6dd781f88ab tempest-VolumesBackupsTest-2142009639 None] nvme not present on system {{(pid=101319) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}} Jul 03 09:43:57.882633 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.lightos [None req-594028f2-f605-43c8-921d-d6dd781f88ab tempest-VolumesBackupsTest-2142009639 None] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=101319) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}} Jul 03 09:43:57.883913 np0000004400 cinder-backup[101319]: INFO os_brick.initiator.connectors.lightos [None req-594028f2-f605-43c8-921d-d6dd781f88ab tempest-VolumesBackupsTest-2142009639 None] Current host hostNQN and IP(s) are ['10.4.3.95', 'fe80::f816:3eff:fe47:268c', '192.168.40.6', 'fe80::f816:3eff:febf:7be2', '192.168.50.6', 'fe80::f816:3eff:fe99:8914', '192.168.10.6', 'fe80::f816:3eff:fe2f:e696', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::bc9d:84ff:fec2:6b49', 'fe80::fc16:3eff:fe36:77bf', 'fe80::4c47:1ff:fe64:1879', 'fe80::fc16:3eff:fec6:c223', 'fe80::fc16:3eff:fef5:5e6e', 'fe80::94d0:62ff:fec5:3886', 'fe80::fc16:3eff:fe48:c24e', 'fe80::fc16:3eff:fea8:bf8b', 'fe80::fc16:3eff:fe1e:8450', 'fe80::8435:18ff:feb9:798c', 'fe80::fc16:3eff:fe42:afa1', 'fe80::fc16:3eff:fe63:d9db', 'fe80::fc16:3eff:fe3b:46af', 'fe80::28c1:27ff:fe3c:5528'] Jul 03 09:43:57.884056 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.lightos [None req-594028f2-f605-43c8-921d-d6dd781f88ab tempest-VolumesBackupsTest-2142009639 None] LIGHTOS: did not find dsc, continuing anyway. {{(pid=101319) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}} Jul 03 09:43:57.884192 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.lightos [None req-594028f2-f605-43c8-921d-d6dd781f88ab tempest-VolumesBackupsTest-2142009639 None] LIGHTOS: no hostnqn found. {{(pid=101319) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}} Jul 03 09:43:57.884798 np0000004400 cinder-backup[101319]: DEBUG os_brick.utils [None req-594028f2-f605-43c8-921d-d6dd781f88ab tempest-VolumesBackupsTest-2142009639 None] <== get_connector_properties: return (47ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.95', 'host': 'np0000004400', 'multipath': False, 'enforce_multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:ae7e5bb0ebe6', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': '6b284368-d0ba-4d18-af6f-4998d3955c52', 'nvme_native_multipath': False} {{(pid=101319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}} Jul 03 09:43:58.388558 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connector [None req-594028f2-f605-43c8-921d-d6dd781f88ab tempest-VolumesBackupsTest-2142009639 None] Factory for iscsi on None {{(pid=101319) factory /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connector.py:243}} Jul 03 09:43:58.389089 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-594028f2-f605-43c8-921d-d6dd781f88ab tempest-VolumesBackupsTest-2142009639 None] ==> connect_volume: call "{'self': , 'connection_properties': {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-5b4a8460-d44c-48dc-80d1-22e538487d1b', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '5b4a8460-d44c-48dc-80d1-22e538487d1b', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': False}}" {{(pid=101319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}} Jul 03 09:43:58.389344 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.base [None req-594028f2-f605-43c8-921d-d6dd781f88ab tempest-VolumesBackupsTest-2142009639 None] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=101319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jul 03 09:44:04.463551 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.base [None req-594028f2-f605-43c8-921d-d6dd781f88ab tempest-VolumesBackupsTest-2142009639 None] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 6.074s {{(pid=101319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jul 03 09:44:04.464284 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.base [None req-594028f2-f605-43c8-921d-d6dd781f88ab tempest-VolumesBackupsTest-2142009639 None] Connection properties {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-5b4a8460-d44c-48dc-80d1-22e538487d1b', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '5b4a8460-d44c-48dc-80d1-22e538487d1b', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': False} {{(pid=101319) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}} Jul 03 09:44:04.476593 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.base [None req-594028f2-f605-43c8-921d-d6dd781f88ab tempest-VolumesBackupsTest-2142009639 None] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-5b4a8460-d44c-48dc-80d1-22e538487d1b" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=101319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jul 03 09:44:04.476593 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.base [None req-594028f2-f605-43c8-921d-d6dd781f88ab tempest-VolumesBackupsTest-2142009639 None] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-5b4a8460-d44c-48dc-80d1-22e538487d1b" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=101319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jul 03 09:44:04.476593 np0000004400 cinder-backup[101319]: INFO os_brick.initiator.connectors.iscsi [None req-594028f2-f605-43c8-921d-d6dd781f88ab tempest-VolumesBackupsTest-2142009639 None] Trying to connect to iSCSI portal 192.168.40.100:3260 Jul 03 09:44:04.487075 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-594028f2-f605-43c8-921d-d6dd781f88ab tempest-VolumesBackupsTest-2142009639 None] iscsiadm (): stdout= stderr=iscsiadm: No records found Jul 03 09:44:04.487075 np0000004400 cinder-backup[101319]: {{(pid=101319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 03 09:44:04.498491 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-594028f2-f605-43c8-921d-d6dd781f88ab tempest-VolumesBackupsTest-2142009639 None] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-5b4a8460-d44c-48dc-80d1-22e538487d1b] added Jul 03 09:44:04.498491 np0000004400 cinder-backup[101319]: stderr=iscsiadm: Config file line 363 does not have value Jul 03 09:44:04.498491 np0000004400 cinder-backup[101319]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs' Jul 03 09:44:04.498491 np0000004400 cinder-backup[101319]: iscsiadm: Config file line 363 does not have value Jul 03 09:44:04.498491 np0000004400 cinder-backup[101319]: iscsiadm: Config file line 363 does not have value Jul 03 09:44:04.498491 np0000004400 cinder-backup[101319]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs' Jul 03 09:44:04.498491 np0000004400 cinder-backup[101319]: {{(pid=101319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 03 09:44:04.499060 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-594028f2-f605-43c8-921d-d6dd781f88ab tempest-VolumesBackupsTest-2142009639 None] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=101319) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}} Jul 03 09:44:04.499628 np0000004400 cinder-backup[101319]: DEBUG os_brick.utils [None req-594028f2-f605-43c8-921d-d6dd781f88ab tempest-VolumesBackupsTest-2142009639 None] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0234(s), this was the 1st time calling it. {{(pid=101319) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}} Jul 03 09:44:04.500024 np0000004400 cinder-backup[101319]: DEBUG os_brick.utils [None req-594028f2-f605-43c8-921d-d6dd781f88ab tempest-VolumesBackupsTest-2142009639 None] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=101319) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}} Jul 03 09:44:05.502791 np0000004400 cinder-backup[101319]: INFO os_brick.initiator.connectors.iscsi [None req-594028f2-f605-43c8-921d-d6dd781f88ab tempest-VolumesBackupsTest-2142009639 None] Trying to connect to iSCSI portal 192.168.40.100:3260 Jul 03 09:44:05.517314 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-594028f2-f605-43c8-921d-d6dd781f88ab tempest-VolumesBackupsTest-2142009639 None] iscsiadm (): stdout=# BEGIN RECORD 2.1.9 Jul 03 09:44:05.517314 np0000004400 cinder-backup[101319]: node.name = iqn.2023-03.storpool.com:os--volume-5b4a8460-d44c-48dc-80d1-22e538487d1b Jul 03 09:44:05.517314 np0000004400 cinder-backup[101319]: node.tpgt = -1 Jul 03 09:44:05.517314 np0000004400 cinder-backup[101319]: node.startup = manual Jul 03 09:44:05.517314 np0000004400 cinder-backup[101319]: node.leading_login = No Jul 03 09:44:05.517314 np0000004400 cinder-backup[101319]: iface.iscsi_ifacename = default Jul 03 09:44:05.517314 np0000004400 cinder-backup[101319]: iface.net_ifacename = Jul 03 09:44:05.517314 np0000004400 cinder-backup[101319]: iface.ipaddress = Jul 03 09:44:05.517314 np0000004400 cinder-backup[101319]: iface.prefix_len = 0 Jul 03 09:44:05.517314 np0000004400 cinder-backup[101319]: iface.hwaddress = Jul 03 09:44:05.517314 np0000004400 cinder-backup[101319]: iface.transport_name = tcp Jul 03 09:44:05.517314 np0000004400 cinder-backup[101319]: iface.initiatorname = Jul 03 09:44:05.517314 np0000004400 cinder-backup[101319]: iface.state = Jul 03 09:44:05.517314 np0000004400 cinder-backup[101319]: iface.vlan_id = 0 Jul 03 09:44:05.517314 np0000004400 cinder-backup[101319]: iface.vlan_priority = 0 Jul 03 09:44:05.517314 np0000004400 cinder-backup[101319]: iface.vlan_state = Jul 03 09:44:05.517314 np0000004400 cinder-backup[101319]: iface.iface_num = 0 Jul 03 09:44:05.517314 np0000004400 cinder-backup[101319]: iface.mtu = 0 Jul 03 09:44:05.517314 np0000004400 cinder-backup[101319]: iface.port = 0 Jul 03 09:44:05.517314 np0000004400 cinder-backup[101319]: iface.bootproto = Jul 03 09:44:05.517314 np0000004400 cinder-backup[101319]: iface.subnet_mask = Jul 03 09:44:05.517314 np0000004400 cinder-backup[101319]: iface.gateway = Jul 03 09:44:05.517314 np0000004400 cinder-backup[101319]: iface.dhcp_alt_client_id_state = Jul 03 09:44:05.517314 np0000004400 cinder-backup[101319]: iface.dhcp_alt_client_id = Jul 03 09:44:05.517314 np0000004400 cinder-backup[101319]: iface.dhcp_dns = Jul 03 09:44:05.517314 np0000004400 cinder-backup[101319]: iface.dhcp_learn_iqn = Jul 03 09:44:05.517314 np0000004400 cinder-backup[101319]: iface.dhcp_req_vendor_id_state = Jul 03 09:44:05.517314 np0000004400 cinder-backup[101319]: iface.dhcp_vendor_id_state = Jul 03 09:44:05.517314 np0000004400 cinder-backup[101319]: iface.dhcp_vendor_id = Jul 03 09:44:05.517314 np0000004400 cinder-backup[101319]: iface.dhcp_slp_da = Jul 03 09:44:05.517314 np0000004400 cinder-backup[101319]: iface.fragmentation = Jul 03 09:44:05.517314 np0000004400 cinder-backup[101319]: iface.gratuitous_arp = Jul 03 09:44:05.517314 np0000004400 cinder-backup[101319]: iface.incoming_forwarding = Jul 03 09:44:05.517314 np0000004400 cinder-backup[101319]: iface.tos_state = Jul 03 09:44:05.517314 np0000004400 cinder-backup[101319]: iface.tos = 0 Jul 03 09:44:05.517314 np0000004400 cinder-backup[101319]: iface.ttl = 0 Jul 03 09:44:05.517314 np0000004400 cinder-backup[101319]: iface.delayed_ack = Jul 03 09:44:05.517314 np0000004400 cinder-backup[101319]: iface.tcp_nagle = Jul 03 09:44:05.517314 np0000004400 cinder-backup[101319]: iface.tcp_wsf_state = Jul 03 09:44:05.517314 np0000004400 cinder-backup[101319]: iface.tcp_wsf = 0 Jul 03 09:44:05.517314 np0000004400 cinder-backup[101319]: iface.tcp_timer_scale = 0 Jul 03 09:44:05.517314 np0000004400 cinder-backup[101319]: iface.tcp_timestamp = Jul 03 09:44:05.517314 np0000004400 cinder-backup[101319]: iface.redirect = Jul 03 09:44:05.517314 np0000004400 cinder-backup[101319]: iface.def_task_mgmt_timeout = 0 Jul 03 09:44:05.517314 np0000004400 cinder-backup[101319]: iface.header_digest = Jul 03 09:44:05.517314 np0000004400 cinder-backup[101319]: iface.data_digest = Jul 03 09:44:05.517314 np0000004400 cinder-backup[101319]: iface.immediate_data = Jul 03 09:44:05.517314 np0000004400 cinder-backup[101319]: iface.initial_r2t = Jul 03 09:44:05.517314 np0000004400 cinder-backup[101319]: iface.data_seq_inorder = Jul 03 09:44:05.517314 np0000004400 cinder-backup[101319]: iface.data_pdu_inorder = Jul 03 09:44:05.517314 np0000004400 cinder-backup[101319]: iface.erl = 0 Jul 03 09:44:05.517314 np0000004400 cinder-backup[101319]: iface.max_receive_data_len = 0 Jul 03 09:44:05.517314 np0000004400 cinder-backup[101319]: iface.first_burst_len = 0 Jul 03 09:44:05.517314 np0000004400 cinder-backup[101319]: iface.max_outstanding_r2t = 0 Jul 03 09:44:05.517314 np0000004400 cinder-backup[101319]: iface.max_burst_len = 0 Jul 03 09:44:05.517314 np0000004400 cinder-backup[101319]: iface.chap_auth = Jul 03 09:44:05.517314 np0000004400 cinder-backup[101319]: iface.bidi_chap = Jul 03 09:44:05.517314 np0000004400 cinder-backup[101319]: iface.strict_login_compliance = Jul 03 09:44:05.517314 np0000004400 cinder-backup[101319]: iface.discovery_auth = Jul 03 09:44:05.517314 np0000004400 cinder-backup[101319]: iface.discovery_logout = Jul 03 09:44:05.517314 np0000004400 cinder-backup[101319]: node.discovery_address = Jul 03 09:44:05.517314 np0000004400 cinder-backup[101319]: node.discovery_port = 0 Jul 03 09:44:05.517314 np0000004400 cinder-backup[101319]: node.discovery_type = fw Jul 03 09:44:05.517314 np0000004400 cinder-backup[101319]: node.session.initial_cmdsn = 0 Jul 03 09:44:05.517314 np0000004400 cinder-backup[101319]: node.session.initial_login_retry_max = 8 Jul 03 09:44:05.517314 np0000004400 cinder-backup[101319]: node.session.xmit_thread_priority = 0 Jul 03 09:44:05.517314 np0000004400 cinder-backup[101319]: node.session.cmds_max = 128 Jul 03 09:44:05.517314 np0000004400 cinder-backup[101319]: node.session.queue_depth = 32 Jul 03 09:44:05.517314 np0000004400 cinder-backup[101319]: node.session.nr_sessions = 1 Jul 03 09:44:05.517314 np0000004400 cinder-backup[101319]: node.session.auth.authmethod = None Jul 03 09:44:05.517314 np0000004400 cinder-backup[101319]: node.session.auth.username = Jul 03 09:44:05.517314 np0000004400 cinder-backup[101319]: node.session.auth.password = *** Jul 03 09:44:05.517314 np0000004400 cinder-backup[101319]: node.session.auth.username_in = Jul 03 09:44:05.517314 np0000004400 cinder-backup[101319]: node.session.auth.password_in = Jul 03 09:44:05.517314 np0000004400 cinder-backup[101319]: node.session.auth.chap_algs = SHA256 Jul 03 09:44:05.517314 np0000004400 cinder-backup[101319]: node.session.timeo.replacement_timeout = 120 Jul 03 09:44:05.517314 np0000004400 cinder-backup[101319]: node.session.err_timeo.abort_timeout = 15 Jul 03 09:44:05.517314 np0000004400 cinder-backup[101319]: node.session.err_timeo.lu_reset_timeout = 30 Jul 03 09:44:05.517314 np0000004400 cinder-backup[101319]: node.session.err_timeo.tgt_reset_timeout = 30 Jul 03 09:44:05.517314 np0000004400 cinder-backup[101319]: node.session.err_timeo.host_reset_timeout = 60 Jul 03 09:44:05.517314 np0000004400 cinder-backup[101319]: node.session.iscsi.FastAbort = Yes Jul 03 09:44:05.517314 np0000004400 cinder-backup[101319]: node.session.iscsi.InitialR2T = No Jul 03 09:44:05.517314 np0000004400 cinder-backup[101319]: node.session.iscsi.ImmediateData = Yes Jul 03 09:44:05.517314 np0000004400 cinder-backup[101319]: node.session.iscsi.FirstBurstLength = 262144 Jul 03 09:44:05.517314 np0000004400 cinder-backup[101319]: node.session.iscsi.MaxBurstLength = 16776192 Jul 03 09:44:05.517314 np0000004400 cinder-backup[101319]: node.session.iscsi.DefaultTime2Retain = 0 Jul 03 09:44:05.517314 np0000004400 cinder-backup[101319]: node.session.iscsi.DefaultTime2Wait = 2 Jul 03 09:44:05.517314 np0000004400 cinder-backup[101319]: node.session.iscsi.MaxConnections = 1 Jul 03 09:44:05.517314 np0000004400 cinder-backup[101319]: node.session.iscsi.MaxOutstandingR2T = 1 Jul 03 09:44:05.517314 np0000004400 cinder-backup[101319]: node.session.iscsi.ERL = 0 Jul 03 09:44:05.517314 np0000004400 cinder-backup[101319]: node.session.scan = auto Jul 03 09:44:05.517314 np0000004400 cinder-backup[101319]: node.session.reopen_max = 0 Jul 03 09:44:05.517314 np0000004400 cinder-backup[101319]: node.conn[0].address = 192.168.40.100 Jul 03 09:44:05.517314 np0000004400 cinder-backup[101319]: node.conn[0].port = 3260 Jul 03 09:44:05.517314 np0000004400 cinder-backup[101319]: node.conn[0].startup = manual Jul 03 09:44:05.517314 np0000004400 cinder-backup[101319]: node.conn[0].tcp.window_size = 524288 Jul 03 09:44:05.517314 np0000004400 cinder-backup[101319]: node.conn[0].tcp.type_of_service = 0 Jul 03 09:44:05.517314 np0000004400 cinder-backup[101319]: node.conn[0].timeo.logout_timeout = 15 Jul 03 09:44:05.517314 np0000004400 cinder-backup[101319]: node.conn[0].timeo.login_timeout = 15 Jul 03 09:44:05.517314 np0000004400 cinder-backup[101319]: node.conn[0].timeo.auth_timeout = 45 Jul 03 09:44:05.517314 np0000004400 cinder-backup[101319]: node.conn[0].timeo.noop_out_interval = 5 Jul 03 09:44:05.517314 np0000004400 cinder-backup[101319]: node.conn[0].timeo.noop_out_timeout = 5 Jul 03 09:44:05.517314 np0000004400 cinder-backup[101319]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0 Jul 03 09:44:05.517314 np0000004400 cinder-backup[101319]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144 Jul 03 09:44:05.517314 np0000004400 cinder-backup[101319]: node.conn[0].iscsi.HeaderDigest = None Jul 03 09:44:05.517314 np0000004400 cinder-backup[101319]: node.conn[0].iscsi.DataDigest = None Jul 03 09:44:05.517314 np0000004400 cinder-backup[101319]: node.conn[0].iscsi.IFMarker = No Jul 03 09:44:05.517314 np0000004400 cinder-backup[101319]: node.conn[0].iscsi.OFMarker = No Jul 03 09:44:05.517314 np0000004400 cinder-backup[101319]: # END RECORD Jul 03 09:44:05.517314 np0000004400 cinder-backup[101319]: stderr= {{(pid=101319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 03 09:44:05.527972 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-594028f2-f605-43c8-921d-d6dd781f88ab tempest-VolumesBackupsTest-2142009639 None] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=101319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 03 09:44:05.546913 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-594028f2-f605-43c8-921d-d6dd781f88ab tempest-VolumesBackupsTest-2142009639 None] iscsiadm ('-m', 'session'): stdout=tcp: [49] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b2e4f10c-8033-4c54-95a1-dfe45d6357a3 (non-flash) Jul 03 09:44:05.546913 np0000004400 cinder-backup[101319]: tcp: [50] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b2e4f10c-8033-4c54-95a1-dfe45d6357a3 (non-flash) Jul 03 09:44:05.546913 np0000004400 cinder-backup[101319]: tcp: [72] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e9e3f386-d923-4ae1-a6ce-8dd2091673ac (non-flash) Jul 03 09:44:05.546913 np0000004400 cinder-backup[101319]: tcp: [73] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e9e3f386-d923-4ae1-a6ce-8dd2091673ac (non-flash) Jul 03 09:44:05.546913 np0000004400 cinder-backup[101319]: tcp: [80] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5ff1572c-401f-4af4-81ea-e10d782a782e (non-flash) Jul 03 09:44:05.546913 np0000004400 cinder-backup[101319]: tcp: [81] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5ff1572c-401f-4af4-81ea-e10d782a782e (non-flash) Jul 03 09:44:05.546913 np0000004400 cinder-backup[101319]: tcp: [82] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-76320525-737e-4f58-8523-63ec9abbdc64 (non-flash) Jul 03 09:44:05.546913 np0000004400 cinder-backup[101319]: tcp: [83] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-76320525-737e-4f58-8523-63ec9abbdc64 (non-flash) Jul 03 09:44:05.546913 np0000004400 cinder-backup[101319]: tcp: [84] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-12c3303b-9d75-4de7-bffd-31f22f904503 (non-flash) Jul 03 09:44:05.546913 np0000004400 cinder-backup[101319]: tcp: [85] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-12c3303b-9d75-4de7-bffd-31f22f904503 (non-flash) Jul 03 09:44:05.546913 np0000004400 cinder-backup[101319]: stderr= {{(pid=101319) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jul 03 09:44:05.546913 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-594028f2-f605-43c8-921d-d6dd781f88ab tempest-VolumesBackupsTest-2142009639 None] iscsi session list stdout=tcp: [49] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b2e4f10c-8033-4c54-95a1-dfe45d6357a3 (non-flash) Jul 03 09:44:05.546913 np0000004400 cinder-backup[101319]: tcp: [50] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b2e4f10c-8033-4c54-95a1-dfe45d6357a3 (non-flash) Jul 03 09:44:05.546913 np0000004400 cinder-backup[101319]: tcp: [72] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e9e3f386-d923-4ae1-a6ce-8dd2091673ac (non-flash) Jul 03 09:44:05.546913 np0000004400 cinder-backup[101319]: tcp: [73] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e9e3f386-d923-4ae1-a6ce-8dd2091673ac (non-flash) Jul 03 09:44:05.546913 np0000004400 cinder-backup[101319]: tcp: [80] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5ff1572c-401f-4af4-81ea-e10d782a782e (non-flash) Jul 03 09:44:05.546913 np0000004400 cinder-backup[101319]: tcp: [81] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5ff1572c-401f-4af4-81ea-e10d782a782e (non-flash) Jul 03 09:44:05.546913 np0000004400 cinder-backup[101319]: tcp: [82] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-76320525-737e-4f58-8523-63ec9abbdc64 (non-flash) Jul 03 09:44:05.546913 np0000004400 cinder-backup[101319]: tcp: [83] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-76320525-737e-4f58-8523-63ec9abbdc64 (non-flash) Jul 03 09:44:05.546913 np0000004400 cinder-backup[101319]: tcp: [84] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-12c3303b-9d75-4de7-bffd-31f22f904503 (non-flash) Jul 03 09:44:05.546913 np0000004400 cinder-backup[101319]: tcp: [85] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-12c3303b-9d75-4de7-bffd-31f22f904503 (non-flash) Jul 03 09:44:05.546913 np0000004400 cinder-backup[101319]: stderr= {{(pid=101319) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jul 03 09:44:05.597195 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-594028f2-f605-43c8-921d-d6dd781f88ab tempest-VolumesBackupsTest-2142009639 None] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-5b4a8460-d44c-48dc-80d1-22e538487d1b, portal: 192.168.40.100,3260] Jul 03 09:44:05.597195 np0000004400 cinder-backup[101319]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-5b4a8460-d44c-48dc-80d1-22e538487d1b, portal: 192.168.40.100,3260] successful. Jul 03 09:44:05.597195 np0000004400 cinder-backup[101319]: stderr= {{(pid=101319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 03 09:44:05.610040 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-594028f2-f605-43c8-921d-d6dd781f88ab tempest-VolumesBackupsTest-2142009639 None] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=101319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 03 09:44:05.626378 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-594028f2-f605-43c8-921d-d6dd781f88ab tempest-VolumesBackupsTest-2142009639 None] iscsiadm ('-m', 'session'): stdout=tcp: [49] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b2e4f10c-8033-4c54-95a1-dfe45d6357a3 (non-flash) Jul 03 09:44:05.626378 np0000004400 cinder-backup[101319]: tcp: [50] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b2e4f10c-8033-4c54-95a1-dfe45d6357a3 (non-flash) Jul 03 09:44:05.626378 np0000004400 cinder-backup[101319]: tcp: [72] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e9e3f386-d923-4ae1-a6ce-8dd2091673ac (non-flash) Jul 03 09:44:05.626378 np0000004400 cinder-backup[101319]: tcp: [73] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e9e3f386-d923-4ae1-a6ce-8dd2091673ac (non-flash) Jul 03 09:44:05.626378 np0000004400 cinder-backup[101319]: tcp: [80] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5ff1572c-401f-4af4-81ea-e10d782a782e (non-flash) Jul 03 09:44:05.626378 np0000004400 cinder-backup[101319]: tcp: [81] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5ff1572c-401f-4af4-81ea-e10d782a782e (non-flash) Jul 03 09:44:05.626378 np0000004400 cinder-backup[101319]: tcp: [82] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-76320525-737e-4f58-8523-63ec9abbdc64 (non-flash) Jul 03 09:44:05.626378 np0000004400 cinder-backup[101319]: tcp: [83] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-76320525-737e-4f58-8523-63ec9abbdc64 (non-flash) Jul 03 09:44:05.626378 np0000004400 cinder-backup[101319]: tcp: [84] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-12c3303b-9d75-4de7-bffd-31f22f904503 (non-flash) Jul 03 09:44:05.626378 np0000004400 cinder-backup[101319]: tcp: [85] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-12c3303b-9d75-4de7-bffd-31f22f904503 (non-flash) Jul 03 09:44:05.626378 np0000004400 cinder-backup[101319]: tcp: [86] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5b4a8460-d44c-48dc-80d1-22e538487d1b (non-flash) Jul 03 09:44:05.626378 np0000004400 cinder-backup[101319]: stderr= {{(pid=101319) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jul 03 09:44:05.629064 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-594028f2-f605-43c8-921d-d6dd781f88ab tempest-VolumesBackupsTest-2142009639 None] iscsi session list stdout=tcp: [49] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b2e4f10c-8033-4c54-95a1-dfe45d6357a3 (non-flash) Jul 03 09:44:05.629064 np0000004400 cinder-backup[101319]: tcp: [50] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b2e4f10c-8033-4c54-95a1-dfe45d6357a3 (non-flash) Jul 03 09:44:05.629064 np0000004400 cinder-backup[101319]: tcp: [72] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e9e3f386-d923-4ae1-a6ce-8dd2091673ac (non-flash) Jul 03 09:44:05.629064 np0000004400 cinder-backup[101319]: tcp: [73] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e9e3f386-d923-4ae1-a6ce-8dd2091673ac (non-flash) Jul 03 09:44:05.629064 np0000004400 cinder-backup[101319]: tcp: [80] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5ff1572c-401f-4af4-81ea-e10d782a782e (non-flash) Jul 03 09:44:05.629064 np0000004400 cinder-backup[101319]: tcp: [81] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5ff1572c-401f-4af4-81ea-e10d782a782e (non-flash) Jul 03 09:44:05.629064 np0000004400 cinder-backup[101319]: tcp: [82] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-76320525-737e-4f58-8523-63ec9abbdc64 (non-flash) Jul 03 09:44:05.629064 np0000004400 cinder-backup[101319]: tcp: [83] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-76320525-737e-4f58-8523-63ec9abbdc64 (non-flash) Jul 03 09:44:05.629064 np0000004400 cinder-backup[101319]: tcp: [84] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-12c3303b-9d75-4de7-bffd-31f22f904503 (non-flash) Jul 03 09:44:05.629064 np0000004400 cinder-backup[101319]: tcp: [85] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-12c3303b-9d75-4de7-bffd-31f22f904503 (non-flash) Jul 03 09:44:05.629064 np0000004400 cinder-backup[101319]: tcp: [86] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5b4a8460-d44c-48dc-80d1-22e538487d1b (non-flash) Jul 03 09:44:05.629064 np0000004400 cinder-backup[101319]: stderr= {{(pid=101319) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jul 03 09:44:05.629064 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.base [None req-594028f2-f605-43c8-921d-d6dd781f88ab tempest-VolumesBackupsTest-2142009639 None] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-5b4a8460-d44c-48dc-80d1-22e538487d1b" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.152s {{(pid=101319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jul 03 09:44:05.629064 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-594028f2-f605-43c8-921d-d6dd781f88ab tempest-VolumesBackupsTest-2142009639 None] Connected to 192.168.40.100:3260 {{(pid=101319) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}} Jul 03 09:44:05.629064 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.linuxscsi [None req-594028f2-f605-43c8-921d-d6dd781f88ab tempest-VolumesBackupsTest-2142009639 None] HCTL ('15', '-', '-', 0) found on session 86 with lun 0 {{(pid=101319) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}} Jul 03 09:44:05.629064 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.linuxscsi [None req-594028f2-f605-43c8-921d-d6dd781f88ab tempest-VolumesBackupsTest-2142009639 None] Scanning host 15 c: -, t: -, l: 0) {{(pid=101319) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}} Jul 03 09:44:05.647312 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.linuxscsi [None req-594028f2-f605-43c8-921d-d6dd781f88ab tempest-VolumesBackupsTest-2142009639 None] Searching for a device in session 86 and hctl ['15', '*', '*', 0] yield: sdj {{(pid=101319) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}} Jul 03 09:44:05.647312 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-594028f2-f605-43c8-921d-d6dd781f88ab tempest-VolumesBackupsTest-2142009639 None] Connected to sdj using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-5b4a8460-d44c-48dc-80d1-22e538487d1b', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '5b4a8460-d44c-48dc-80d1-22e538487d1b', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': False} {{(pid=101319) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}} Jul 03 09:44:06.648925 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.base [None req-594028f2-f605-43c8-921d-d6dd781f88ab tempest-VolumesBackupsTest-2142009639 None] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 2.185s {{(pid=101319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jul 03 09:44:06.649323 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-594028f2-f605-43c8-921d-d6dd781f88ab tempest-VolumesBackupsTest-2142009639 None] <== connect_volume: return (8259ms) {'type': 'block', 'scsi_wwn': '1StorPooliSCSI_DISK_1034578903445799009', 'path': '/dev/sdj'} {{(pid=101319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}} Jul 03 09:44:06.649446 np0000004400 cinder-backup[101319]: DEBUG oslo_concurrency.processutils [None req-594028f2-f605-43c8-921d-d6dd781f88ab tempest-VolumesBackupsTest-2142009639 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chown 1002 /dev/sdj {{(pid=101319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 09:44:06.667684 np0000004400 sudo[133438]: stack : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chown 1002 /dev/sdj Jul 03 09:44:06.668263 np0000004400 sudo[133438]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1002) Jul 03 09:44:07.027720 np0000004400 sudo[133438]: pam_unix(sudo:session): session closed for user root Jul 03 09:44:07.031550 np0000004400 cinder-backup[101319]: DEBUG oslo_concurrency.processutils [None req-594028f2-f605-43c8-921d-d6dd781f88ab tempest-VolumesBackupsTest-2142009639 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chown 1002 /dev/sdj" returned: 0 in 0.382s {{(pid=101319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 09:44:07.091802 np0000004400 cinder-backup[101319]: DEBUG oslo_db.sqlalchemy.engines [None req-594028f2-f605-43c8-921d-d6dd781f88ab tempest-VolumesBackupsTest-2142009639 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=101319) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 03 09:44:07.104690 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-594028f2-f605-43c8-921d-d6dd781f88ab tempest-VolumesBackupsTest-2142009639 None] _create_container started, container: tempest-volumesbackupstest-backup-container-412072100,backup: 231fdf27-e89f-4b12-b8d9-adad9ec76225. {{(pid=101319) _create_container /opt/stack/cinder/cinder/backup/chunkeddriver.py:249}} Jul 03 09:44:07.265197 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.drivers.swift [None req-594028f2-f605-43c8-921d-d6dd781f88ab tempest-VolumesBackupsTest-2142009639 None] generate_object_name_prefix: volume_5ff1572c-401f-4af4-81ea-e10d782a782e/20260703094407/az_nova_backup_231fdf27-e89f-4b12-b8d9-adad9ec76225 {{(pid=101319) _generate_object_name_prefix /opt/stack/cinder/cinder/backup/drivers/swift.py:452}} Jul 03 09:44:07.271440 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-594028f2-f605-43c8-921d-d6dd781f88ab tempest-VolumesBackupsTest-2142009639 None] starting backup of volume: 5ff1572c-401f-4af4-81ea-e10d782a782e, volume size: 1073741824, object names prefix volume_5ff1572c-401f-4af4-81ea-e10d782a782e/20260703094407/az_nova_backup_231fdf27-e89f-4b12-b8d9-adad9ec76225, availability zone: nova {{(pid=101319) _prepare_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:359}} Jul 03 09:44:07.468354 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-594028f2-f605-43c8-921d-d6dd781f88ab tempest-VolumesBackupsTest-2142009639 None] Backing up chunk of data from volume. {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 09:44:07.758466 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-594028f2-f605-43c8-921d-d6dd781f88ab tempest-VolumesBackupsTest-2142009639 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101319) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 09:44:07.758949 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-594028f2-f605-43c8-921d-d6dd781f88ab tempest-VolumesBackupsTest-2142009639 None] About to put_object {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 09:44:07.873012 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-594028f2-f605-43c8-921d-d6dd781f88ab tempest-VolumesBackupsTest-2142009639 None] backup MD5 for volume_5ff1572c-401f-4af4-81ea-e10d782a782e/20260703094407/az_nova_backup_231fdf27-e89f-4b12-b8d9-adad9ec76225-00001: 25e317773f308e446cc84c503a6d1f85 {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 09:44:07.873228 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-594028f2-f605-43c8-921d-d6dd781f88ab tempest-VolumesBackupsTest-2142009639 None] Calling eventlet.sleep(0) {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 09:44:08.086049 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-594028f2-f605-43c8-921d-d6dd781f88ab tempest-VolumesBackupsTest-2142009639 None] Backing up chunk of data from volume. {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 09:44:08.352298 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-594028f2-f605-43c8-921d-d6dd781f88ab tempest-VolumesBackupsTest-2142009639 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101319) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 09:44:08.355284 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-594028f2-f605-43c8-921d-d6dd781f88ab tempest-VolumesBackupsTest-2142009639 None] About to put_object {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 09:44:08.488505 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-594028f2-f605-43c8-921d-d6dd781f88ab tempest-VolumesBackupsTest-2142009639 None] backup MD5 for volume_5ff1572c-401f-4af4-81ea-e10d782a782e/20260703094407/az_nova_backup_231fdf27-e89f-4b12-b8d9-adad9ec76225-00002: 25e317773f308e446cc84c503a6d1f85 {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 09:44:08.489130 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-594028f2-f605-43c8-921d-d6dd781f88ab tempest-VolumesBackupsTest-2142009639 None] Calling eventlet.sleep(0) {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 09:44:08.751500 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-594028f2-f605-43c8-921d-d6dd781f88ab tempest-VolumesBackupsTest-2142009639 None] Backing up chunk of data from volume. {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 09:44:09.004238 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-594028f2-f605-43c8-921d-d6dd781f88ab tempest-VolumesBackupsTest-2142009639 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101319) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 09:44:09.004649 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-594028f2-f605-43c8-921d-d6dd781f88ab tempest-VolumesBackupsTest-2142009639 None] About to put_object {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 09:44:09.111619 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-594028f2-f605-43c8-921d-d6dd781f88ab tempest-VolumesBackupsTest-2142009639 None] backup MD5 for volume_5ff1572c-401f-4af4-81ea-e10d782a782e/20260703094407/az_nova_backup_231fdf27-e89f-4b12-b8d9-adad9ec76225-00003: 25e317773f308e446cc84c503a6d1f85 {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 09:44:09.112551 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-594028f2-f605-43c8-921d-d6dd781f88ab tempest-VolumesBackupsTest-2142009639 None] Calling eventlet.sleep(0) {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 09:44:09.323768 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-594028f2-f605-43c8-921d-d6dd781f88ab tempest-VolumesBackupsTest-2142009639 None] Backing up chunk of data from volume. {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 09:44:09.595963 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-594028f2-f605-43c8-921d-d6dd781f88ab tempest-VolumesBackupsTest-2142009639 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101319) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 09:44:09.596150 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-594028f2-f605-43c8-921d-d6dd781f88ab tempest-VolumesBackupsTest-2142009639 None] About to put_object {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 09:44:09.717191 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-594028f2-f605-43c8-921d-d6dd781f88ab tempest-VolumesBackupsTest-2142009639 None] backup MD5 for volume_5ff1572c-401f-4af4-81ea-e10d782a782e/20260703094407/az_nova_backup_231fdf27-e89f-4b12-b8d9-adad9ec76225-00004: 25e317773f308e446cc84c503a6d1f85 {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 09:44:09.717387 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-594028f2-f605-43c8-921d-d6dd781f88ab tempest-VolumesBackupsTest-2142009639 None] Calling eventlet.sleep(0) {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 09:44:09.936639 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-594028f2-f605-43c8-921d-d6dd781f88ab tempest-VolumesBackupsTest-2142009639 None] Backing up chunk of data from volume. {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 09:44:10.207608 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-594028f2-f605-43c8-921d-d6dd781f88ab tempest-VolumesBackupsTest-2142009639 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101319) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 09:44:10.207954 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-594028f2-f605-43c8-921d-d6dd781f88ab tempest-VolumesBackupsTest-2142009639 None] About to put_object {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 09:44:10.320930 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-594028f2-f605-43c8-921d-d6dd781f88ab tempest-VolumesBackupsTest-2142009639 None] backup MD5 for volume_5ff1572c-401f-4af4-81ea-e10d782a782e/20260703094407/az_nova_backup_231fdf27-e89f-4b12-b8d9-adad9ec76225-00005: 25e317773f308e446cc84c503a6d1f85 {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 09:44:10.321143 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-594028f2-f605-43c8-921d-d6dd781f88ab tempest-VolumesBackupsTest-2142009639 None] Calling eventlet.sleep(0) {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 09:44:10.533940 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-594028f2-f605-43c8-921d-d6dd781f88ab tempest-VolumesBackupsTest-2142009639 None] Backing up chunk of data from volume. {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 09:44:10.786735 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-594028f2-f605-43c8-921d-d6dd781f88ab tempest-VolumesBackupsTest-2142009639 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101319) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 09:44:10.786958 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-594028f2-f605-43c8-921d-d6dd781f88ab tempest-VolumesBackupsTest-2142009639 None] About to put_object {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 09:44:10.913489 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-594028f2-f605-43c8-921d-d6dd781f88ab tempest-VolumesBackupsTest-2142009639 None] backup MD5 for volume_5ff1572c-401f-4af4-81ea-e10d782a782e/20260703094407/az_nova_backup_231fdf27-e89f-4b12-b8d9-adad9ec76225-00006: 25e317773f308e446cc84c503a6d1f85 {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 09:44:10.913703 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-594028f2-f605-43c8-921d-d6dd781f88ab tempest-VolumesBackupsTest-2142009639 None] Calling eventlet.sleep(0) {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 09:44:11.133729 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-594028f2-f605-43c8-921d-d6dd781f88ab tempest-VolumesBackupsTest-2142009639 None] Backing up chunk of data from volume. {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 09:44:11.404543 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-594028f2-f605-43c8-921d-d6dd781f88ab tempest-VolumesBackupsTest-2142009639 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101319) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 09:44:11.404873 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-594028f2-f605-43c8-921d-d6dd781f88ab tempest-VolumesBackupsTest-2142009639 None] About to put_object {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 09:44:11.532921 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-594028f2-f605-43c8-921d-d6dd781f88ab tempest-VolumesBackupsTest-2142009639 None] backup MD5 for volume_5ff1572c-401f-4af4-81ea-e10d782a782e/20260703094407/az_nova_backup_231fdf27-e89f-4b12-b8d9-adad9ec76225-00007: 25e317773f308e446cc84c503a6d1f85 {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 09:44:11.533062 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-594028f2-f605-43c8-921d-d6dd781f88ab tempest-VolumesBackupsTest-2142009639 None] Calling eventlet.sleep(0) {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 09:44:11.766009 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-594028f2-f605-43c8-921d-d6dd781f88ab tempest-VolumesBackupsTest-2142009639 None] Backing up chunk of data from volume. {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 09:44:12.014912 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-594028f2-f605-43c8-921d-d6dd781f88ab tempest-VolumesBackupsTest-2142009639 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101319) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 09:44:12.014912 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-594028f2-f605-43c8-921d-d6dd781f88ab tempest-VolumesBackupsTest-2142009639 None] About to put_object {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 09:44:12.129867 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-594028f2-f605-43c8-921d-d6dd781f88ab tempest-VolumesBackupsTest-2142009639 None] backup MD5 for volume_5ff1572c-401f-4af4-81ea-e10d782a782e/20260703094407/az_nova_backup_231fdf27-e89f-4b12-b8d9-adad9ec76225-00008: 25e317773f308e446cc84c503a6d1f85 {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 09:44:12.130193 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-594028f2-f605-43c8-921d-d6dd781f88ab tempest-VolumesBackupsTest-2142009639 None] Calling eventlet.sleep(0) {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 09:44:12.336500 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-594028f2-f605-43c8-921d-d6dd781f88ab tempest-VolumesBackupsTest-2142009639 None] Backing up chunk of data from volume. {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 09:44:12.618590 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-594028f2-f605-43c8-921d-d6dd781f88ab tempest-VolumesBackupsTest-2142009639 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101319) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 09:44:12.619011 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-594028f2-f605-43c8-921d-d6dd781f88ab tempest-VolumesBackupsTest-2142009639 None] About to put_object {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 09:44:12.730590 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-594028f2-f605-43c8-921d-d6dd781f88ab tempest-VolumesBackupsTest-2142009639 None] backup MD5 for volume_5ff1572c-401f-4af4-81ea-e10d782a782e/20260703094407/az_nova_backup_231fdf27-e89f-4b12-b8d9-adad9ec76225-00009: 25e317773f308e446cc84c503a6d1f85 {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 09:44:12.730715 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-594028f2-f605-43c8-921d-d6dd781f88ab tempest-VolumesBackupsTest-2142009639 None] Calling eventlet.sleep(0) {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 09:44:12.916304 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-594028f2-f605-43c8-921d-d6dd781f88ab tempest-VolumesBackupsTest-2142009639 None] Backing up chunk of data from volume. {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 09:44:13.173206 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-594028f2-f605-43c8-921d-d6dd781f88ab tempest-VolumesBackupsTest-2142009639 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101319) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 09:44:13.173322 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-594028f2-f605-43c8-921d-d6dd781f88ab tempest-VolumesBackupsTest-2142009639 None] About to put_object {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 09:44:13.283036 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-594028f2-f605-43c8-921d-d6dd781f88ab tempest-VolumesBackupsTest-2142009639 None] backup MD5 for volume_5ff1572c-401f-4af4-81ea-e10d782a782e/20260703094407/az_nova_backup_231fdf27-e89f-4b12-b8d9-adad9ec76225-00010: 25e317773f308e446cc84c503a6d1f85 {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 09:44:13.283175 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-594028f2-f605-43c8-921d-d6dd781f88ab tempest-VolumesBackupsTest-2142009639 None] Calling eventlet.sleep(0) {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 09:44:13.490085 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-594028f2-f605-43c8-921d-d6dd781f88ab tempest-VolumesBackupsTest-2142009639 None] Backing up chunk of data from volume. {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 09:44:13.776547 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-594028f2-f605-43c8-921d-d6dd781f88ab tempest-VolumesBackupsTest-2142009639 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101319) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 09:44:13.777998 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-594028f2-f605-43c8-921d-d6dd781f88ab tempest-VolumesBackupsTest-2142009639 None] About to put_object {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 09:44:13.895797 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-594028f2-f605-43c8-921d-d6dd781f88ab tempest-VolumesBackupsTest-2142009639 None] backup MD5 for volume_5ff1572c-401f-4af4-81ea-e10d782a782e/20260703094407/az_nova_backup_231fdf27-e89f-4b12-b8d9-adad9ec76225-00011: 25e317773f308e446cc84c503a6d1f85 {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 09:44:13.895797 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-594028f2-f605-43c8-921d-d6dd781f88ab tempest-VolumesBackupsTest-2142009639 None] Calling eventlet.sleep(0) {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 09:44:14.086248 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-594028f2-f605-43c8-921d-d6dd781f88ab tempest-VolumesBackupsTest-2142009639 None] Backing up chunk of data from volume. {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 09:44:14.333080 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-594028f2-f605-43c8-921d-d6dd781f88ab tempest-VolumesBackupsTest-2142009639 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101319) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 09:44:14.333266 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-594028f2-f605-43c8-921d-d6dd781f88ab tempest-VolumesBackupsTest-2142009639 None] About to put_object {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 09:44:14.444567 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-594028f2-f605-43c8-921d-d6dd781f88ab tempest-VolumesBackupsTest-2142009639 None] backup MD5 for volume_5ff1572c-401f-4af4-81ea-e10d782a782e/20260703094407/az_nova_backup_231fdf27-e89f-4b12-b8d9-adad9ec76225-00012: 25e317773f308e446cc84c503a6d1f85 {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 09:44:14.444800 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-594028f2-f605-43c8-921d-d6dd781f88ab tempest-VolumesBackupsTest-2142009639 None] Calling eventlet.sleep(0) {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 09:44:14.673507 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-594028f2-f605-43c8-921d-d6dd781f88ab tempest-VolumesBackupsTest-2142009639 None] Backing up chunk of data from volume. {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 09:44:14.925240 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-594028f2-f605-43c8-921d-d6dd781f88ab tempest-VolumesBackupsTest-2142009639 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101319) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 09:44:14.925761 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-594028f2-f605-43c8-921d-d6dd781f88ab tempest-VolumesBackupsTest-2142009639 None] About to put_object {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 09:44:15.044664 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-594028f2-f605-43c8-921d-d6dd781f88ab tempest-VolumesBackupsTest-2142009639 None] backup MD5 for volume_5ff1572c-401f-4af4-81ea-e10d782a782e/20260703094407/az_nova_backup_231fdf27-e89f-4b12-b8d9-adad9ec76225-00013: 25e317773f308e446cc84c503a6d1f85 {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 09:44:15.044878 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-594028f2-f605-43c8-921d-d6dd781f88ab tempest-VolumesBackupsTest-2142009639 None] Calling eventlet.sleep(0) {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 09:44:15.289593 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-594028f2-f605-43c8-921d-d6dd781f88ab tempest-VolumesBackupsTest-2142009639 None] Backing up chunk of data from volume. {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 09:44:15.569130 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-594028f2-f605-43c8-921d-d6dd781f88ab tempest-VolumesBackupsTest-2142009639 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101319) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 09:44:15.569130 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-594028f2-f605-43c8-921d-d6dd781f88ab tempest-VolumesBackupsTest-2142009639 None] About to put_object {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 09:44:15.682761 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-594028f2-f605-43c8-921d-d6dd781f88ab tempest-VolumesBackupsTest-2142009639 None] backup MD5 for volume_5ff1572c-401f-4af4-81ea-e10d782a782e/20260703094407/az_nova_backup_231fdf27-e89f-4b12-b8d9-adad9ec76225-00014: 25e317773f308e446cc84c503a6d1f85 {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 09:44:15.682934 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-594028f2-f605-43c8-921d-d6dd781f88ab tempest-VolumesBackupsTest-2142009639 None] Calling eventlet.sleep(0) {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 09:44:15.882478 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-594028f2-f605-43c8-921d-d6dd781f88ab tempest-VolumesBackupsTest-2142009639 None] Backing up chunk of data from volume. {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 09:44:16.174785 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-594028f2-f605-43c8-921d-d6dd781f88ab tempest-VolumesBackupsTest-2142009639 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101319) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 09:44:16.174785 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-594028f2-f605-43c8-921d-d6dd781f88ab tempest-VolumesBackupsTest-2142009639 None] About to put_object {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 09:44:16.284739 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-594028f2-f605-43c8-921d-d6dd781f88ab tempest-VolumesBackupsTest-2142009639 None] backup MD5 for volume_5ff1572c-401f-4af4-81ea-e10d782a782e/20260703094407/az_nova_backup_231fdf27-e89f-4b12-b8d9-adad9ec76225-00015: 25e317773f308e446cc84c503a6d1f85 {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 09:44:16.284739 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-594028f2-f605-43c8-921d-d6dd781f88ab tempest-VolumesBackupsTest-2142009639 None] Calling eventlet.sleep(0) {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 09:44:16.491419 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-594028f2-f605-43c8-921d-d6dd781f88ab tempest-VolumesBackupsTest-2142009639 None] Backing up chunk of data from volume. {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 09:44:16.762577 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-594028f2-f605-43c8-921d-d6dd781f88ab tempest-VolumesBackupsTest-2142009639 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101319) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 09:44:16.762799 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-594028f2-f605-43c8-921d-d6dd781f88ab tempest-VolumesBackupsTest-2142009639 None] About to put_object {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 09:44:16.872335 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-594028f2-f605-43c8-921d-d6dd781f88ab tempest-VolumesBackupsTest-2142009639 None] backup MD5 for volume_5ff1572c-401f-4af4-81ea-e10d782a782e/20260703094407/az_nova_backup_231fdf27-e89f-4b12-b8d9-adad9ec76225-00016: 25e317773f308e446cc84c503a6d1f85 {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 09:44:16.872490 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-594028f2-f605-43c8-921d-d6dd781f88ab tempest-VolumesBackupsTest-2142009639 None] Calling eventlet.sleep(0) {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 09:44:17.081269 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-594028f2-f605-43c8-921d-d6dd781f88ab tempest-VolumesBackupsTest-2142009639 None] Backing up chunk of data from volume. {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 09:44:17.322043 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-594028f2-f605-43c8-921d-d6dd781f88ab tempest-VolumesBackupsTest-2142009639 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101319) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 09:44:17.322376 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-594028f2-f605-43c8-921d-d6dd781f88ab tempest-VolumesBackupsTest-2142009639 None] About to put_object {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 09:44:17.425899 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-594028f2-f605-43c8-921d-d6dd781f88ab tempest-VolumesBackupsTest-2142009639 None] backup MD5 for volume_5ff1572c-401f-4af4-81ea-e10d782a782e/20260703094407/az_nova_backup_231fdf27-e89f-4b12-b8d9-adad9ec76225-00017: 25e317773f308e446cc84c503a6d1f85 {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 09:44:17.426111 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-594028f2-f605-43c8-921d-d6dd781f88ab tempest-VolumesBackupsTest-2142009639 None] Calling eventlet.sleep(0) {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 09:44:17.636651 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-594028f2-f605-43c8-921d-d6dd781f88ab tempest-VolumesBackupsTest-2142009639 None] Backing up chunk of data from volume. {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 09:44:17.886628 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-594028f2-f605-43c8-921d-d6dd781f88ab tempest-VolumesBackupsTest-2142009639 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101319) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 09:44:17.887214 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-594028f2-f605-43c8-921d-d6dd781f88ab tempest-VolumesBackupsTest-2142009639 None] About to put_object {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 09:44:18.012273 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-594028f2-f605-43c8-921d-d6dd781f88ab tempest-VolumesBackupsTest-2142009639 None] backup MD5 for volume_5ff1572c-401f-4af4-81ea-e10d782a782e/20260703094407/az_nova_backup_231fdf27-e89f-4b12-b8d9-adad9ec76225-00018: 25e317773f308e446cc84c503a6d1f85 {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 09:44:18.012474 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-594028f2-f605-43c8-921d-d6dd781f88ab tempest-VolumesBackupsTest-2142009639 None] Calling eventlet.sleep(0) {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 09:44:18.230357 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-594028f2-f605-43c8-921d-d6dd781f88ab tempest-VolumesBackupsTest-2142009639 None] Backing up chunk of data from volume. {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 09:44:18.396383 np0000004400 cinder-backup[101319]: INFO cinder.backup.manager [None req-0e492ae6-28c9-42fb-b5cd-6691b7fa5f24 tempest-VolumesBackupsTest-118275719 None] Create backup started, backup: 36c3a4f2-c782-418d-be49-db2bcf3421f7 volume: 35ece5f1-68f7-4f83-93fb-31eab852a359. Jul 03 09:44:18.401139 np0000004400 cinder-backup[101319]: INFO cinder.backup.manager [None req-0e492ae6-28c9-42fb-b5cd-6691b7fa5f24 tempest-VolumesBackupsTest-118275719 None] Call Volume Manager to get_backup_device for Backup(availability_zone='nova',container=None,created_at=2026-07-03T09:44:18Z,data_timestamp=2026-07-03T09:44:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesBackupsTest-Backup-717113228',encryption_key_id=None,fail_reason=None,host='np0000004400',id=36c3a4f2-c782-418d-be49-db2bcf3421f7,metadata={},num_dependent_backups=0,object_count=0,parent=None,parent_id=None,project_id='a484ec9218bf417bb9d7575ae6370646',restore_volume_id=None,service='cinder.backup.drivers.swift.SwiftBackupDriver',service_metadata=None,size=1,snapshot_id=None,status='creating',temp_snapshot_id=None,temp_volume_id=None,updated_at=None,user_id='b861df2a13684334b293b1f348152e37',volume_id=35ece5f1-68f7-4f83-93fb-31eab852a359) Jul 03 09:44:18.426888 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.drivers.swift [None req-0e492ae6-28c9-42fb-b5cd-6691b7fa5f24 tempest-VolumesBackupsTest-118275719 None] Using swift URL https://10.4.3.95:8080/v1/AUTH_a484ec9218bf417bb9d7575ae6370646 {{(pid=101319) initialize /opt/stack/cinder/cinder/backup/drivers/swift.py:300}} Jul 03 09:44:18.427129 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.drivers.swift [None req-0e492ae6-28c9-42fb-b5cd-6691b7fa5f24 tempest-VolumesBackupsTest-118275719 None] Connect to https://10.4.3.95:8080/v1/AUTH_ in "per_user" mode {{(pid=101319) initialize /opt/stack/cinder/cinder/backup/drivers/swift.py:301}} Jul 03 09:44:18.427522 np0000004400 cinder-backup[101319]: DEBUG os_brick.utils [None req-0e492ae6-28c9-42fb-b5cd-6691b7fa5f24 tempest-VolumesBackupsTest-118275719 None] ==> get_connector_properties: call "{'root_helper': 'sudo cinder-rootwrap /etc/cinder/rootwrap.conf', 'my_ip': '10.4.3.95', 'multipath': False, 'enforce_multipath': False, 'host': None, 'execute': None}" {{(pid=101319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}} Jul 03 09:44:18.438564 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.scaleio [None req-0e492ae6-28c9-42fb-b5cd-6691b7fa5f24 tempest-VolumesBackupsTest-118275719 None] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=101319) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}} Jul 03 09:44:18.457628 np0000004400 cinder-backup[101319]: DEBUG oslo_concurrency.processutils [None req-0e492ae6-28c9-42fb-b5cd-6691b7fa5f24 tempest-VolumesBackupsTest-118275719 None] Running cmd (subprocess): nvme version {{(pid=101319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 09:44:18.471941 np0000004400 cinder-backup[101319]: DEBUG oslo_concurrency.processutils [None req-0e492ae6-28c9-42fb-b5cd-6691b7fa5f24 tempest-VolumesBackupsTest-118275719 None] 'nvme version' failed. Not Retrying. {{(pid=101319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 03 09:44:18.472233 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.nvmeof [None req-0e492ae6-28c9-42fb-b5cd-6691b7fa5f24 tempest-VolumesBackupsTest-118275719 None] nvme not present on system {{(pid=101319) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}} Jul 03 09:44:18.481440 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.lightos [None req-0e492ae6-28c9-42fb-b5cd-6691b7fa5f24 tempest-VolumesBackupsTest-118275719 None] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=101319) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}} Jul 03 09:44:18.483065 np0000004400 cinder-backup[101319]: INFO os_brick.initiator.connectors.lightos [None req-0e492ae6-28c9-42fb-b5cd-6691b7fa5f24 tempest-VolumesBackupsTest-118275719 None] Current host hostNQN and IP(s) are ['10.4.3.95', 'fe80::f816:3eff:fe47:268c', '192.168.40.6', 'fe80::f816:3eff:febf:7be2', '192.168.50.6', 'fe80::f816:3eff:fe99:8914', '192.168.10.6', 'fe80::f816:3eff:fe2f:e696', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::bc9d:84ff:fec2:6b49', 'fe80::fc16:3eff:fe36:77bf', 'fe80::4c47:1ff:fe64:1879', 'fe80::fc16:3eff:fec6:c223', 'fe80::fc16:3eff:fef5:5e6e', 'fe80::94d0:62ff:fec5:3886', 'fe80::fc16:3eff:fe48:c24e', 'fe80::fc16:3eff:fea8:bf8b', 'fe80::fc16:3eff:fe1e:8450', 'fe80::8435:18ff:feb9:798c', 'fe80::fc16:3eff:fe42:afa1', 'fe80::fc16:3eff:fe3b:46af', 'fe80::28c1:27ff:fe3c:5528', 'fe80::fc16:3eff:fea0:4147', 'fe80::b0cf:48ff:fe29:caf0', 'fe80::fc16:3eff:fee8:8754', 'fe80::f4df:54ff:fe23:9c09', 'fe80::fc16:3eff:fedf:37a6', 'fe80::fc16:3eff:feec:2e14', 'fe80::a1:38ff:fe3d:434b'] Jul 03 09:44:18.483216 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.lightos [None req-0e492ae6-28c9-42fb-b5cd-6691b7fa5f24 tempest-VolumesBackupsTest-118275719 None] LIGHTOS: did not find dsc, continuing anyway. {{(pid=101319) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}} Jul 03 09:44:18.483361 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.lightos [None req-0e492ae6-28c9-42fb-b5cd-6691b7fa5f24 tempest-VolumesBackupsTest-118275719 None] LIGHTOS: no hostnqn found. {{(pid=101319) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}} Jul 03 09:44:18.483913 np0000004400 cinder-backup[101319]: DEBUG os_brick.utils [None req-0e492ae6-28c9-42fb-b5cd-6691b7fa5f24 tempest-VolumesBackupsTest-118275719 None] <== get_connector_properties: return (55ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.95', 'host': 'np0000004400', 'multipath': False, 'enforce_multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:ae7e5bb0ebe6', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': '6b284368-d0ba-4d18-af6f-4998d3955c52', 'nvme_native_multipath': False} {{(pid=101319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}} Jul 03 09:44:18.491986 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-594028f2-f605-43c8-921d-d6dd781f88ab tempest-VolumesBackupsTest-2142009639 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101319) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 09:44:18.492159 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-594028f2-f605-43c8-921d-d6dd781f88ab tempest-VolumesBackupsTest-2142009639 None] About to put_object {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 09:44:18.602512 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-594028f2-f605-43c8-921d-d6dd781f88ab tempest-VolumesBackupsTest-2142009639 None] backup MD5 for volume_5ff1572c-401f-4af4-81ea-e10d782a782e/20260703094407/az_nova_backup_231fdf27-e89f-4b12-b8d9-adad9ec76225-00019: 25e317773f308e446cc84c503a6d1f85 {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 09:44:18.602788 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-594028f2-f605-43c8-921d-d6dd781f88ab tempest-VolumesBackupsTest-2142009639 None] Calling eventlet.sleep(0) {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 09:44:18.637898 np0000004400 cinder-backup[101319]: DEBUG oslo_db.sqlalchemy.engines [None req-594028f2-f605-43c8-921d-d6dd781f88ab tempest-VolumesBackupsTest-2142009639 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=101319) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 03 09:44:18.858346 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-594028f2-f605-43c8-921d-d6dd781f88ab tempest-VolumesBackupsTest-2142009639 None] Backing up chunk of data from volume. {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 09:44:18.987714 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connector [None req-0e492ae6-28c9-42fb-b5cd-6691b7fa5f24 tempest-VolumesBackupsTest-118275719 None] Factory for iscsi on None {{(pid=101319) factory /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connector.py:243}} Jul 03 09:44:18.988078 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e492ae6-28c9-42fb-b5cd-6691b7fa5f24 tempest-VolumesBackupsTest-118275719 None] ==> connect_volume: call "{'self': , 'connection_properties': {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-35ece5f1-68f7-4f83-93fb-31eab852a359', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '35ece5f1-68f7-4f83-93fb-31eab852a359', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': False}}" {{(pid=101319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}} Jul 03 09:44:18.988283 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.base [None req-0e492ae6-28c9-42fb-b5cd-6691b7fa5f24 tempest-VolumesBackupsTest-118275719 None] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=101319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jul 03 09:44:18.988717 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.base [None req-0e492ae6-28c9-42fb-b5cd-6691b7fa5f24 tempest-VolumesBackupsTest-118275719 None] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.000s {{(pid=101319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jul 03 09:44:18.988900 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.base [None req-0e492ae6-28c9-42fb-b5cd-6691b7fa5f24 tempest-VolumesBackupsTest-118275719 None] Connection properties {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-35ece5f1-68f7-4f83-93fb-31eab852a359', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '35ece5f1-68f7-4f83-93fb-31eab852a359', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': False} {{(pid=101319) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}} Jul 03 09:44:18.999660 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.base [None req-0e492ae6-28c9-42fb-b5cd-6691b7fa5f24 tempest-VolumesBackupsTest-118275719 None] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-35ece5f1-68f7-4f83-93fb-31eab852a359" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=101319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jul 03 09:44:19.000134 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.base [None req-0e492ae6-28c9-42fb-b5cd-6691b7fa5f24 tempest-VolumesBackupsTest-118275719 None] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-35ece5f1-68f7-4f83-93fb-31eab852a359" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=101319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jul 03 09:44:19.000365 np0000004400 cinder-backup[101319]: INFO os_brick.initiator.connectors.iscsi [None req-0e492ae6-28c9-42fb-b5cd-6691b7fa5f24 tempest-VolumesBackupsTest-118275719 None] Trying to connect to iSCSI portal 192.168.40.100:3260 Jul 03 09:44:19.011593 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e492ae6-28c9-42fb-b5cd-6691b7fa5f24 tempest-VolumesBackupsTest-118275719 None] iscsiadm (): stdout= stderr=iscsiadm: No records found Jul 03 09:44:19.011593 np0000004400 cinder-backup[101319]: {{(pid=101319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 03 09:44:19.023787 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e492ae6-28c9-42fb-b5cd-6691b7fa5f24 tempest-VolumesBackupsTest-118275719 None] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-35ece5f1-68f7-4f83-93fb-31eab852a359] added Jul 03 09:44:19.023787 np0000004400 cinder-backup[101319]: stderr=iscsiadm: Config file line 363 does not have value Jul 03 09:44:19.023787 np0000004400 cinder-backup[101319]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs' Jul 03 09:44:19.023787 np0000004400 cinder-backup[101319]: iscsiadm: Config file line 363 does not have value Jul 03 09:44:19.023787 np0000004400 cinder-backup[101319]: iscsiadm: Config file line 363 does not have value Jul 03 09:44:19.023787 np0000004400 cinder-backup[101319]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs' Jul 03 09:44:19.023787 np0000004400 cinder-backup[101319]: {{(pid=101319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 03 09:44:19.024154 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e492ae6-28c9-42fb-b5cd-6691b7fa5f24 tempest-VolumesBackupsTest-118275719 None] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=101319) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}} Jul 03 09:44:19.024281 np0000004400 cinder-backup[101319]: DEBUG os_brick.utils [None req-0e492ae6-28c9-42fb-b5cd-6691b7fa5f24 tempest-VolumesBackupsTest-118275719 None] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0239(s), this was the 1st time calling it. {{(pid=101319) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}} Jul 03 09:44:19.024495 np0000004400 cinder-backup[101319]: DEBUG os_brick.utils [None req-0e492ae6-28c9-42fb-b5cd-6691b7fa5f24 tempest-VolumesBackupsTest-118275719 None] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=101319) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}} Jul 03 09:44:19.125888 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-594028f2-f605-43c8-921d-d6dd781f88ab tempest-VolumesBackupsTest-2142009639 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101319) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 09:44:19.126083 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-594028f2-f605-43c8-921d-d6dd781f88ab tempest-VolumesBackupsTest-2142009639 None] About to put_object {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 09:44:19.231929 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-594028f2-f605-43c8-921d-d6dd781f88ab tempest-VolumesBackupsTest-2142009639 None] backup MD5 for volume_5ff1572c-401f-4af4-81ea-e10d782a782e/20260703094407/az_nova_backup_231fdf27-e89f-4b12-b8d9-adad9ec76225-00020: 25e317773f308e446cc84c503a6d1f85 {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 09:44:19.232119 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-594028f2-f605-43c8-921d-d6dd781f88ab tempest-VolumesBackupsTest-2142009639 None] Calling eventlet.sleep(0) {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 09:44:19.327844 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-594028f2-f605-43c8-921d-d6dd781f88ab tempest-VolumesBackupsTest-2142009639 None] Backing up chunk of data from volume. {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 09:44:19.449560 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-594028f2-f605-43c8-921d-d6dd781f88ab tempest-VolumesBackupsTest-2142009639 None] Compressed 25165824 bytes of data to 24470 bytes using zlib. {{(pid=101319) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 09:44:19.450040 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-594028f2-f605-43c8-921d-d6dd781f88ab tempest-VolumesBackupsTest-2142009639 None] About to put_object {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 09:44:19.514789 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-594028f2-f605-43c8-921d-d6dd781f88ab tempest-VolumesBackupsTest-2142009639 None] backup MD5 for volume_5ff1572c-401f-4af4-81ea-e10d782a782e/20260703094407/az_nova_backup_231fdf27-e89f-4b12-b8d9-adad9ec76225-00021: 77377273b0a4b61febdbf7bbf52b9db9 {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 09:44:19.514917 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-594028f2-f605-43c8-921d-d6dd781f88ab tempest-VolumesBackupsTest-2142009639 None] Calling eventlet.sleep(0) {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 09:44:19.530418 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.driver [None req-594028f2-f605-43c8-921d-d6dd781f88ab tempest-VolumesBackupsTest-2142009639 None] Getting metadata type 'volume-base-metadata' {{(pid=101319) _save_vol_base_meta /opt/stack/cinder/cinder/backup/driver.py:79}} Jul 03 09:44:19.541122 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.driver [None req-594028f2-f605-43c8-921d-d6dd781f88ab tempest-VolumesBackupsTest-2142009639 None] Completed fetching metadata type 'volume-base-metadata' {{(pid=101319) _save_vol_base_meta /opt/stack/cinder/cinder/backup/driver.py:98}} Jul 03 09:44:19.541414 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.driver [None req-594028f2-f605-43c8-921d-d6dd781f88ab tempest-VolumesBackupsTest-2142009639 None] Getting metadata type 'volume-metadata' {{(pid=101319) _save_vol_meta /opt/stack/cinder/cinder/backup/driver.py:109}} Jul 03 09:44:19.548936 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.driver [None req-594028f2-f605-43c8-921d-d6dd781f88ab tempest-VolumesBackupsTest-2142009639 None] No metadata type 'volume-metadata' available {{(pid=101319) _save_vol_meta /opt/stack/cinder/cinder/backup/driver.py:123}} Jul 03 09:44:19.549154 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.driver [None req-594028f2-f605-43c8-921d-d6dd781f88ab tempest-VolumesBackupsTest-2142009639 None] Getting metadata type 'volume-glance-metadata' {{(pid=101319) _save_vol_glance_meta /opt/stack/cinder/cinder/backup/driver.py:132}} Jul 03 09:44:19.553917 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.driver [None req-594028f2-f605-43c8-921d-d6dd781f88ab tempest-VolumesBackupsTest-2142009639 None] No metadata type 'volume-glance-metadata' available {{(pid=101319) _save_vol_glance_meta /opt/stack/cinder/cinder/backup/driver.py:147}} Jul 03 09:44:19.554210 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-594028f2-f605-43c8-921d-d6dd781f88ab tempest-VolumesBackupsTest-2142009639 None] _write_sha256file started, container name: tempest-volumesbackupstest-backup-container-412072100, sha256file filename: volume_5ff1572c-401f-4af4-81ea-e10d782a782e/20260703094407/az_nova_backup_231fdf27-e89f-4b12-b8d9-adad9ec76225_sha256file. {{(pid=101319) _write_sha256file /opt/stack/cinder/cinder/backup/chunkeddriver.py:299}} Jul 03 09:44:19.619955 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-594028f2-f605-43c8-921d-d6dd781f88ab tempest-VolumesBackupsTest-2142009639 None] _write_sha256file finished. {{(pid=101319) _write_sha256file /opt/stack/cinder/cinder/backup/chunkeddriver.py:315}} Jul 03 09:44:19.620557 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-594028f2-f605-43c8-921d-d6dd781f88ab tempest-VolumesBackupsTest-2142009639 None] _write_metadata started, container name: tempest-volumesbackupstest-backup-container-412072100, metadata filename: volume_5ff1572c-401f-4af4-81ea-e10d782a782e/20260703094407/az_nova_backup_231fdf27-e89f-4b12-b8d9-adad9ec76225_metadata. {{(pid=101319) _write_metadata /opt/stack/cinder/cinder/backup/chunkeddriver.py:276}} Jul 03 09:44:19.648374 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-594028f2-f605-43c8-921d-d6dd781f88ab tempest-VolumesBackupsTest-2142009639 None] _write_metadata finished. Metadata: b'{\n "backup_description": null,\n "backup_id": "231fdf27-e89f-4b12-b8d9-adad9ec76225",\n "backup_name": "tempest-VolumesBackupsTest-Backup-512909804",\n "created_at": "2026-07-03 09:43:58+00:00",\n "objects": [\n {\n "volume_5ff1572c-401f-4af4-81ea-e10d782a782e/20260703094407/az_nova_backup_231fdf27-e89f-4b12-b8d9-adad9ec76225-00001": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 0\n }\n },\n {\n "volume_5ff1572c-401f-4af4-81ea-e10d782a782e/20260703094407/az_nova_backup_231fdf27-e89f-4b12-b8d9-adad9ec76225-00002": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 52428800\n }\n },\n {\n "volume_5ff1572c-401f-4af4-81ea-e10d782a782e/20260703094407/az_nova_backup_231fdf27-e89f-4b12-b8d9-adad9ec76225-00003": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 104857600\n }\n },\n {\n "volume_5ff1572c-401f-4af4-81ea-e10d782a782e/20260703094407/az_nova_backup_231fdf27-e89f-4b12-b8d9-adad9ec76225-00004": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 157286400\n }\n },\n {\n "volume_5ff1572c-401f-4af4-81ea-e10d782a782e/20260703094407/az_nova_backup_231fdf27-e89f-4b12-b8d9-adad9ec76225-00005": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 209715200\n }\n },\n {\n "volume_5ff1572c-401f-4af4-81ea-e10d782a782e/20260703094407/az_nova_backup_231fdf27-e89f-4b12-b8d9-adad9ec76225-00006": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 262144000\n }\n },\n {\n "volume_5ff1572c-401f-4af4-81ea-e10d782a782e/20260703094407/az_nova_backup_231fdf27-e89f-4b12-b8d9-adad9ec76225-00007": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 314572800\n }\n },\n {\n "volume_5ff1572c-401f-4af4-81ea-e10d782a782e/20260703094407/az_nova_backup_231fdf27-e89f-4b12-b8d9-adad9ec76225-00008": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 367001600\n }\n },\n {\n "volume_5ff1572c-401f-4af4-81ea-e10d782a782e/20260703094407/az_nova_backup_231fdf27-e89f-4b12-b8d9-adad9ec76225-00009": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 419430400\n }\n },\n {\n "volume_5ff1572c-401f-4af4-81ea-e10d782a782e/20260703094407/az_nova_backup_231fdf27-e89f-4b12-b8d9-adad9ec76225-00010": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 471859200\n }\n },\n {\n "volume_5ff1572c-401f-4af4-81ea-e10d782a782e/20260703094407/az_nova_backup_231fdf27-e89f-4b12-b8d9-adad9ec76225-00011": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 524288000\n }\n },\n {\n "volume_5ff1572c-401f-4af4-81ea-e10d782a782e/20260703094407/az_nova_backup_231fdf27-e89f-4b12-b8d9-adad9ec76225-00012": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 576716800\n }\n },\n {\n "volume_5ff1572c-401f-4af4-81ea-e10d782a782e/20260703094407/az_nova_backup_231fdf27-e89f-4b12-b8d9-adad9ec76225-00013": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 629145600\n }\n },\n {\n "volume_5ff1572c-401f-4af4-81ea-e10d782a782e/20260703094407/az_nova_backup_231fdf27-e89f-4b12-b8d9-adad9ec76225-00014": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 681574400\n }\n },\n {\n "volume_5ff1572c-401f-4af4-81ea-e10d782a782e/20260703094407/az_nova_backup_231fdf27-e89f-4b12-b8d9-adad9ec76225-00015": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 734003200\n }\n },\n {\n "volume_5ff1572c-401f-4af4-81ea-e10d782a782e/20260703094407/az_nova_backup_231fdf27-e89f-4b12-b8d9-adad9ec76225-00016": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 786432000\n }\n },\n {\n "volume_5ff1572c-401f-4af4-81ea-e10d782a782e/20260703094407/az_nova_backup_231fdf27-e89f-4b12-b8d9-adad9ec76225-00017": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 838860800\n }\n },\n {\n "volume_5ff1572c-401f-4af4-81ea-e10d782a782e/20260703094407/az_nova_backup_231fdf27-e89f-4b12-b8d9-adad9ec76225-00018": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 891289600\n }\n },\n {\n "volume_5ff1572c-401f-4af4-81ea-e10d782a782e/20260703094407/az_nova_backup_231fdf27-e89f-4b12-b8d9-adad9ec76225-00019": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 943718400\n }\n },\n {\n "volume_5ff1572c-401f-4af4-81ea-e10d782a782e/20260703094407/az_nova_backup_231fdf27-e89f-4b12-b8d9-adad9ec76225-00020": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 996147200\n }\n },\n {\n "volume_5ff1572c-401f-4af4-81ea-e10d782a782e/20260703094407/az_nova_backup_231fdf27-e89f-4b12-b8d9-adad9ec76225-00021": {\n "compression": "zlib",\n "length": 25165824,\n "md5": "77377273b0a4b61febdbf7bbf52b9db9",\n "offset": 1048576000\n }\n }\n ],\n "parent_id": null,\n "version": "1.0.0",\n "volume_id": "5ff1572c-401f-4af4-81ea-e10d782a782e",\n "volume_meta": "{\\"version\\": 2, \\"volume-base-metadata\\": {\\"id\\": \\"5ff1572c-401f-4af4-81ea-e10d782a782e\\", \\"_name_id\\": null, \\"use_quota\\": true, \\"ec2_id\\": null, \\"user_id\\": \\"91463b6c437c4711a49d3c31c513a101\\", \\"project_id\\": \\"59044e18a5b24b19a7b9b8a380f2e1a0\\", \\"snapshot_id\\": null, \\"cluster_name\\": null, \\"host\\": \\"np0000004400@storpool#default\\", \\"size\\": 1, \\"availability_zone\\": \\"nova\\", \\"status\\": \\"backing-up\\", \\"attach_status\\": \\"attached\\", \\"migration_status\\": null, \\"scheduled_at\\": \\"2026-07-03T09:42:52.000000\\", \\"launched_at\\": \\"2026-07-03T09:42:52.000000\\", \\"terminated_at\\": null, \\"display_name\\": \\"tempest-VolumesBackupsTest-Volume-1602351904\\", \\"display_description\\": null, \\"provider_location\\": null, \\"provider_auth\\": null, \\"provider_geometry\\": null, \\"provider_id\\": null, \\"volume_type_id\\": \\"03e13fe6-0e30-4803-ace0-725d38e6dc24\\", \\"source_volid\\": null, \\"encryption_key_id\\": null, \\"consistencygroup_id\\": null, \\"group_id\\": null, \\"bootable\\": false, \\"multiattach\\": false, \\"replication_status\\": null, \\"replication_extended_status\\": null, \\"replication_driver_data\\": null, \\"previous_status\\": \\"in-use\\", \\"service_uuid\\": \\"6d4b0e79-fefe-4744-b25f-34be05095200\\", \\"shared_targets\\": true, \\"deleted_at\\": null, \\"deleted\\": false, \\"created_at\\": \\"2026-07-03T09:42:51.000000\\", \\"updated_at\\": \\"2026-07-03T09:43:58.000000\\"}}"\n}'. {{(pid=101319) _write_metadata /opt/stack/cinder/cinder/backup/chunkeddriver.py:295}} Jul 03 09:44:19.654906 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-594028f2-f605-43c8-921d-d6dd781f88ab tempest-VolumesBackupsTest-2142009639 None] backup 231fdf27-e89f-4b12-b8d9-adad9ec76225 finished. {{(pid=101319) _finalize_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:462}} Jul 03 09:44:19.779267 np0000004400 cinder-backup[101319]: DEBUG oslo_concurrency.processutils [None req-594028f2-f605-43c8-921d-d6dd781f88ab tempest-VolumesBackupsTest-2142009639 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chown 0 /dev/sdj {{(pid=101319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 09:44:19.795664 np0000004400 sudo[133907]: stack : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chown 0 /dev/sdj Jul 03 09:44:19.796307 np0000004400 sudo[133907]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1002) Jul 03 09:44:20.026104 np0000004400 cinder-backup[101319]: INFO os_brick.initiator.connectors.iscsi [None req-0e492ae6-28c9-42fb-b5cd-6691b7fa5f24 tempest-VolumesBackupsTest-118275719 None] Trying to connect to iSCSI portal 192.168.40.100:3260 Jul 03 09:44:20.040650 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e492ae6-28c9-42fb-b5cd-6691b7fa5f24 tempest-VolumesBackupsTest-118275719 None] iscsiadm (): stdout=# BEGIN RECORD 2.1.9 Jul 03 09:44:20.040650 np0000004400 cinder-backup[101319]: node.name = iqn.2023-03.storpool.com:os--volume-35ece5f1-68f7-4f83-93fb-31eab852a359 Jul 03 09:44:20.040650 np0000004400 cinder-backup[101319]: node.tpgt = -1 Jul 03 09:44:20.040650 np0000004400 cinder-backup[101319]: node.startup = manual Jul 03 09:44:20.040650 np0000004400 cinder-backup[101319]: node.leading_login = No Jul 03 09:44:20.040650 np0000004400 cinder-backup[101319]: iface.iscsi_ifacename = default Jul 03 09:44:20.040650 np0000004400 cinder-backup[101319]: iface.net_ifacename = Jul 03 09:44:20.040650 np0000004400 cinder-backup[101319]: iface.ipaddress = Jul 03 09:44:20.040650 np0000004400 cinder-backup[101319]: iface.prefix_len = 0 Jul 03 09:44:20.040650 np0000004400 cinder-backup[101319]: iface.hwaddress = Jul 03 09:44:20.040650 np0000004400 cinder-backup[101319]: iface.transport_name = tcp Jul 03 09:44:20.040650 np0000004400 cinder-backup[101319]: iface.initiatorname = Jul 03 09:44:20.040650 np0000004400 cinder-backup[101319]: iface.state = Jul 03 09:44:20.040650 np0000004400 cinder-backup[101319]: iface.vlan_id = 0 Jul 03 09:44:20.040650 np0000004400 cinder-backup[101319]: iface.vlan_priority = 0 Jul 03 09:44:20.040650 np0000004400 cinder-backup[101319]: iface.vlan_state = Jul 03 09:44:20.040650 np0000004400 cinder-backup[101319]: iface.iface_num = 0 Jul 03 09:44:20.040650 np0000004400 cinder-backup[101319]: iface.mtu = 0 Jul 03 09:44:20.040650 np0000004400 cinder-backup[101319]: iface.port = 0 Jul 03 09:44:20.040650 np0000004400 cinder-backup[101319]: iface.bootproto = Jul 03 09:44:20.040650 np0000004400 cinder-backup[101319]: iface.subnet_mask = Jul 03 09:44:20.040650 np0000004400 cinder-backup[101319]: iface.gateway = Jul 03 09:44:20.040650 np0000004400 cinder-backup[101319]: iface.dhcp_alt_client_id_state = Jul 03 09:44:20.040650 np0000004400 cinder-backup[101319]: iface.dhcp_alt_client_id = Jul 03 09:44:20.040650 np0000004400 cinder-backup[101319]: iface.dhcp_dns = Jul 03 09:44:20.040650 np0000004400 cinder-backup[101319]: iface.dhcp_learn_iqn = Jul 03 09:44:20.040650 np0000004400 cinder-backup[101319]: iface.dhcp_req_vendor_id_state = Jul 03 09:44:20.040650 np0000004400 cinder-backup[101319]: iface.dhcp_vendor_id_state = Jul 03 09:44:20.040650 np0000004400 cinder-backup[101319]: iface.dhcp_vendor_id = Jul 03 09:44:20.040650 np0000004400 cinder-backup[101319]: iface.dhcp_slp_da = Jul 03 09:44:20.040650 np0000004400 cinder-backup[101319]: iface.fragmentation = Jul 03 09:44:20.040650 np0000004400 cinder-backup[101319]: iface.gratuitous_arp = Jul 03 09:44:20.040650 np0000004400 cinder-backup[101319]: iface.incoming_forwarding = Jul 03 09:44:20.040650 np0000004400 cinder-backup[101319]: iface.tos_state = Jul 03 09:44:20.040650 np0000004400 cinder-backup[101319]: iface.tos = 0 Jul 03 09:44:20.040650 np0000004400 cinder-backup[101319]: iface.ttl = 0 Jul 03 09:44:20.040650 np0000004400 cinder-backup[101319]: iface.delayed_ack = Jul 03 09:44:20.040650 np0000004400 cinder-backup[101319]: iface.tcp_nagle = Jul 03 09:44:20.040650 np0000004400 cinder-backup[101319]: iface.tcp_wsf_state = Jul 03 09:44:20.040650 np0000004400 cinder-backup[101319]: iface.tcp_wsf = 0 Jul 03 09:44:20.040650 np0000004400 cinder-backup[101319]: iface.tcp_timer_scale = 0 Jul 03 09:44:20.040650 np0000004400 cinder-backup[101319]: iface.tcp_timestamp = Jul 03 09:44:20.040650 np0000004400 cinder-backup[101319]: iface.redirect = Jul 03 09:44:20.040650 np0000004400 cinder-backup[101319]: iface.def_task_mgmt_timeout = 0 Jul 03 09:44:20.040650 np0000004400 cinder-backup[101319]: iface.header_digest = Jul 03 09:44:20.040650 np0000004400 cinder-backup[101319]: iface.data_digest = Jul 03 09:44:20.040650 np0000004400 cinder-backup[101319]: iface.immediate_data = Jul 03 09:44:20.040650 np0000004400 cinder-backup[101319]: iface.initial_r2t = Jul 03 09:44:20.040650 np0000004400 cinder-backup[101319]: iface.data_seq_inorder = Jul 03 09:44:20.040650 np0000004400 cinder-backup[101319]: iface.data_pdu_inorder = Jul 03 09:44:20.040650 np0000004400 cinder-backup[101319]: iface.erl = 0 Jul 03 09:44:20.040650 np0000004400 cinder-backup[101319]: iface.max_receive_data_len = 0 Jul 03 09:44:20.040650 np0000004400 cinder-backup[101319]: iface.first_burst_len = 0 Jul 03 09:44:20.040650 np0000004400 cinder-backup[101319]: iface.max_outstanding_r2t = 0 Jul 03 09:44:20.040650 np0000004400 cinder-backup[101319]: iface.max_burst_len = 0 Jul 03 09:44:20.040650 np0000004400 cinder-backup[101319]: iface.chap_auth = Jul 03 09:44:20.040650 np0000004400 cinder-backup[101319]: iface.bidi_chap = Jul 03 09:44:20.040650 np0000004400 cinder-backup[101319]: iface.strict_login_compliance = Jul 03 09:44:20.040650 np0000004400 cinder-backup[101319]: iface.discovery_auth = Jul 03 09:44:20.040650 np0000004400 cinder-backup[101319]: iface.discovery_logout = Jul 03 09:44:20.040650 np0000004400 cinder-backup[101319]: node.discovery_address = Jul 03 09:44:20.040650 np0000004400 cinder-backup[101319]: node.discovery_port = 0 Jul 03 09:44:20.040650 np0000004400 cinder-backup[101319]: node.discovery_type = fw Jul 03 09:44:20.040650 np0000004400 cinder-backup[101319]: node.session.initial_cmdsn = 0 Jul 03 09:44:20.040650 np0000004400 cinder-backup[101319]: node.session.initial_login_retry_max = 8 Jul 03 09:44:20.040650 np0000004400 cinder-backup[101319]: node.session.xmit_thread_priority = 0 Jul 03 09:44:20.040650 np0000004400 cinder-backup[101319]: node.session.cmds_max = 128 Jul 03 09:44:20.040650 np0000004400 cinder-backup[101319]: node.session.queue_depth = 32 Jul 03 09:44:20.040650 np0000004400 cinder-backup[101319]: node.session.nr_sessions = 1 Jul 03 09:44:20.040650 np0000004400 cinder-backup[101319]: node.session.auth.authmethod = None Jul 03 09:44:20.040650 np0000004400 cinder-backup[101319]: node.session.auth.username = Jul 03 09:44:20.040650 np0000004400 cinder-backup[101319]: node.session.auth.password = *** Jul 03 09:44:20.040650 np0000004400 cinder-backup[101319]: node.session.auth.username_in = Jul 03 09:44:20.040650 np0000004400 cinder-backup[101319]: node.session.auth.password_in = Jul 03 09:44:20.040650 np0000004400 cinder-backup[101319]: node.session.auth.chap_algs = SHA256 Jul 03 09:44:20.040650 np0000004400 cinder-backup[101319]: node.session.timeo.replacement_timeout = 120 Jul 03 09:44:20.040650 np0000004400 cinder-backup[101319]: node.session.err_timeo.abort_timeout = 15 Jul 03 09:44:20.040650 np0000004400 cinder-backup[101319]: node.session.err_timeo.lu_reset_timeout = 30 Jul 03 09:44:20.040650 np0000004400 cinder-backup[101319]: node.session.err_timeo.tgt_reset_timeout = 30 Jul 03 09:44:20.040650 np0000004400 cinder-backup[101319]: node.session.err_timeo.host_reset_timeout = 60 Jul 03 09:44:20.040650 np0000004400 cinder-backup[101319]: node.session.iscsi.FastAbort = Yes Jul 03 09:44:20.040650 np0000004400 cinder-backup[101319]: node.session.iscsi.InitialR2T = No Jul 03 09:44:20.040650 np0000004400 cinder-backup[101319]: node.session.iscsi.ImmediateData = Yes Jul 03 09:44:20.040650 np0000004400 cinder-backup[101319]: node.session.iscsi.FirstBurstLength = 262144 Jul 03 09:44:20.040650 np0000004400 cinder-backup[101319]: node.session.iscsi.MaxBurstLength = 16776192 Jul 03 09:44:20.040650 np0000004400 cinder-backup[101319]: node.session.iscsi.DefaultTime2Retain = 0 Jul 03 09:44:20.040650 np0000004400 cinder-backup[101319]: node.session.iscsi.DefaultTime2Wait = 2 Jul 03 09:44:20.040650 np0000004400 cinder-backup[101319]: node.session.iscsi.MaxConnections = 1 Jul 03 09:44:20.040650 np0000004400 cinder-backup[101319]: node.session.iscsi.MaxOutstandingR2T = 1 Jul 03 09:44:20.040650 np0000004400 cinder-backup[101319]: node.session.iscsi.ERL = 0 Jul 03 09:44:20.040650 np0000004400 cinder-backup[101319]: node.session.scan = auto Jul 03 09:44:20.040650 np0000004400 cinder-backup[101319]: node.session.reopen_max = 0 Jul 03 09:44:20.040650 np0000004400 cinder-backup[101319]: node.conn[0].address = 192.168.40.100 Jul 03 09:44:20.040650 np0000004400 cinder-backup[101319]: node.conn[0].port = 3260 Jul 03 09:44:20.040650 np0000004400 cinder-backup[101319]: node.conn[0].startup = manual Jul 03 09:44:20.040650 np0000004400 cinder-backup[101319]: node.conn[0].tcp.window_size = 524288 Jul 03 09:44:20.040650 np0000004400 cinder-backup[101319]: node.conn[0].tcp.type_of_service = 0 Jul 03 09:44:20.040650 np0000004400 cinder-backup[101319]: node.conn[0].timeo.logout_timeout = 15 Jul 03 09:44:20.040650 np0000004400 cinder-backup[101319]: node.conn[0].timeo.login_timeout = 15 Jul 03 09:44:20.040650 np0000004400 cinder-backup[101319]: node.conn[0].timeo.auth_timeout = 45 Jul 03 09:44:20.040650 np0000004400 cinder-backup[101319]: node.conn[0].timeo.noop_out_interval = 5 Jul 03 09:44:20.040650 np0000004400 cinder-backup[101319]: node.conn[0].timeo.noop_out_timeout = 5 Jul 03 09:44:20.040650 np0000004400 cinder-backup[101319]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0 Jul 03 09:44:20.040650 np0000004400 cinder-backup[101319]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144 Jul 03 09:44:20.040650 np0000004400 cinder-backup[101319]: node.conn[0].iscsi.HeaderDigest = None Jul 03 09:44:20.040650 np0000004400 cinder-backup[101319]: node.conn[0].iscsi.DataDigest = None Jul 03 09:44:20.040650 np0000004400 cinder-backup[101319]: node.conn[0].iscsi.IFMarker = No Jul 03 09:44:20.040650 np0000004400 cinder-backup[101319]: node.conn[0].iscsi.OFMarker = No Jul 03 09:44:20.040650 np0000004400 cinder-backup[101319]: # END RECORD Jul 03 09:44:20.040650 np0000004400 cinder-backup[101319]: stderr= {{(pid=101319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 03 09:44:20.051490 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e492ae6-28c9-42fb-b5cd-6691b7fa5f24 tempest-VolumesBackupsTest-118275719 None] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=101319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 03 09:44:20.070309 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e492ae6-28c9-42fb-b5cd-6691b7fa5f24 tempest-VolumesBackupsTest-118275719 None] iscsiadm ('-m', 'session'): stdout=tcp: [49] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b2e4f10c-8033-4c54-95a1-dfe45d6357a3 (non-flash) Jul 03 09:44:20.070309 np0000004400 cinder-backup[101319]: tcp: [50] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b2e4f10c-8033-4c54-95a1-dfe45d6357a3 (non-flash) Jul 03 09:44:20.070309 np0000004400 cinder-backup[101319]: tcp: [72] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e9e3f386-d923-4ae1-a6ce-8dd2091673ac (non-flash) Jul 03 09:44:20.070309 np0000004400 cinder-backup[101319]: tcp: [73] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e9e3f386-d923-4ae1-a6ce-8dd2091673ac (non-flash) Jul 03 09:44:20.070309 np0000004400 cinder-backup[101319]: tcp: [80] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5ff1572c-401f-4af4-81ea-e10d782a782e (non-flash) Jul 03 09:44:20.070309 np0000004400 cinder-backup[101319]: tcp: [81] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5ff1572c-401f-4af4-81ea-e10d782a782e (non-flash) Jul 03 09:44:20.070309 np0000004400 cinder-backup[101319]: tcp: [82] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-76320525-737e-4f58-8523-63ec9abbdc64 (non-flash) Jul 03 09:44:20.070309 np0000004400 cinder-backup[101319]: tcp: [83] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-76320525-737e-4f58-8523-63ec9abbdc64 (non-flash) Jul 03 09:44:20.070309 np0000004400 cinder-backup[101319]: tcp: [84] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-12c3303b-9d75-4de7-bffd-31f22f904503 (non-flash) Jul 03 09:44:20.070309 np0000004400 cinder-backup[101319]: tcp: [85] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-12c3303b-9d75-4de7-bffd-31f22f904503 (non-flash) Jul 03 09:44:20.070309 np0000004400 cinder-backup[101319]: tcp: [86] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5b4a8460-d44c-48dc-80d1-22e538487d1b (non-flash) Jul 03 09:44:20.070309 np0000004400 cinder-backup[101319]: tcp: [87] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-dc2d662f-bc12-4338-8e3d-6565f72ba808 (non-flash) Jul 03 09:44:20.070309 np0000004400 cinder-backup[101319]: tcp: [88] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-dc2d662f-bc12-4338-8e3d-6565f72ba808 (non-flash) Jul 03 09:44:20.070309 np0000004400 cinder-backup[101319]: stderr= {{(pid=101319) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jul 03 09:44:20.070751 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e492ae6-28c9-42fb-b5cd-6691b7fa5f24 tempest-VolumesBackupsTest-118275719 None] iscsi session list stdout=tcp: [49] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b2e4f10c-8033-4c54-95a1-dfe45d6357a3 (non-flash) Jul 03 09:44:20.070751 np0000004400 cinder-backup[101319]: tcp: [50] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b2e4f10c-8033-4c54-95a1-dfe45d6357a3 (non-flash) Jul 03 09:44:20.070751 np0000004400 cinder-backup[101319]: tcp: [72] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e9e3f386-d923-4ae1-a6ce-8dd2091673ac (non-flash) Jul 03 09:44:20.070751 np0000004400 cinder-backup[101319]: tcp: [73] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e9e3f386-d923-4ae1-a6ce-8dd2091673ac (non-flash) Jul 03 09:44:20.070751 np0000004400 cinder-backup[101319]: tcp: [80] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5ff1572c-401f-4af4-81ea-e10d782a782e (non-flash) Jul 03 09:44:20.070751 np0000004400 cinder-backup[101319]: tcp: [81] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5ff1572c-401f-4af4-81ea-e10d782a782e (non-flash) Jul 03 09:44:20.070751 np0000004400 cinder-backup[101319]: tcp: [82] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-76320525-737e-4f58-8523-63ec9abbdc64 (non-flash) Jul 03 09:44:20.070751 np0000004400 cinder-backup[101319]: tcp: [83] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-76320525-737e-4f58-8523-63ec9abbdc64 (non-flash) Jul 03 09:44:20.070751 np0000004400 cinder-backup[101319]: tcp: [84] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-12c3303b-9d75-4de7-bffd-31f22f904503 (non-flash) Jul 03 09:44:20.070751 np0000004400 cinder-backup[101319]: tcp: [85] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-12c3303b-9d75-4de7-bffd-31f22f904503 (non-flash) Jul 03 09:44:20.070751 np0000004400 cinder-backup[101319]: tcp: [86] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5b4a8460-d44c-48dc-80d1-22e538487d1b (non-flash) Jul 03 09:44:20.070751 np0000004400 cinder-backup[101319]: tcp: [87] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-dc2d662f-bc12-4338-8e3d-6565f72ba808 (non-flash) Jul 03 09:44:20.070751 np0000004400 cinder-backup[101319]: tcp: [88] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-dc2d662f-bc12-4338-8e3d-6565f72ba808 (non-flash) Jul 03 09:44:20.070751 np0000004400 cinder-backup[101319]: stderr= {{(pid=101319) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jul 03 09:44:20.105902 np0000004400 cinder-backup[101319]: DEBUG oslo_concurrency.processutils [None req-594028f2-f605-43c8-921d-d6dd781f88ab tempest-VolumesBackupsTest-2142009639 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chown 0 /dev/sdj" returned: 0 in 0.326s {{(pid=101319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 09:44:20.105902 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-594028f2-f605-43c8-921d-d6dd781f88ab tempest-VolumesBackupsTest-2142009639 None] ==> disconnect_volume: call "{'args': (, {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-5b4a8460-d44c-48dc-80d1-22e538487d1b', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '5b4a8460-d44c-48dc-80d1-22e538487d1b', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': False}, {'type': 'block', 'scsi_wwn': '1StorPooliSCSI_DISK_1034578903445799009', 'path': '/dev/sdj'}), 'kwargs': {'force': True, 'ignore_errors': True}}" {{(pid=101319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}} Jul 03 09:44:20.106393 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.base [None req-594028f2-f605-43c8-921d-d6dd781f88ab tempest-VolumesBackupsTest-2142009639 None] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=101319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jul 03 09:44:20.102837 np0000004400 sudo[133907]: pam_unix(sudo:session): session closed for user root Jul 03 09:44:20.123987 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e492ae6-28c9-42fb-b5cd-6691b7fa5f24 tempest-VolumesBackupsTest-118275719 None] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-35ece5f1-68f7-4f83-93fb-31eab852a359, portal: 192.168.40.100,3260] Jul 03 09:44:20.123987 np0000004400 cinder-backup[101319]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-35ece5f1-68f7-4f83-93fb-31eab852a359, portal: 192.168.40.100,3260] successful. Jul 03 09:44:20.123987 np0000004400 cinder-backup[101319]: stderr= {{(pid=101319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 03 09:44:20.142606 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e492ae6-28c9-42fb-b5cd-6691b7fa5f24 tempest-VolumesBackupsTest-118275719 None] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=101319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 03 09:44:20.163560 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e492ae6-28c9-42fb-b5cd-6691b7fa5f24 tempest-VolumesBackupsTest-118275719 None] iscsiadm ('-m', 'session'): stdout=tcp: [49] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b2e4f10c-8033-4c54-95a1-dfe45d6357a3 (non-flash) Jul 03 09:44:20.163560 np0000004400 cinder-backup[101319]: tcp: [50] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b2e4f10c-8033-4c54-95a1-dfe45d6357a3 (non-flash) Jul 03 09:44:20.163560 np0000004400 cinder-backup[101319]: tcp: [72] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e9e3f386-d923-4ae1-a6ce-8dd2091673ac (non-flash) Jul 03 09:44:20.163560 np0000004400 cinder-backup[101319]: tcp: [73] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e9e3f386-d923-4ae1-a6ce-8dd2091673ac (non-flash) Jul 03 09:44:20.163560 np0000004400 cinder-backup[101319]: tcp: [80] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5ff1572c-401f-4af4-81ea-e10d782a782e (non-flash) Jul 03 09:44:20.163560 np0000004400 cinder-backup[101319]: tcp: [81] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5ff1572c-401f-4af4-81ea-e10d782a782e (non-flash) Jul 03 09:44:20.163560 np0000004400 cinder-backup[101319]: tcp: [82] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-76320525-737e-4f58-8523-63ec9abbdc64 (non-flash) Jul 03 09:44:20.163560 np0000004400 cinder-backup[101319]: tcp: [83] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-76320525-737e-4f58-8523-63ec9abbdc64 (non-flash) Jul 03 09:44:20.163560 np0000004400 cinder-backup[101319]: tcp: [84] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-12c3303b-9d75-4de7-bffd-31f22f904503 (non-flash) Jul 03 09:44:20.163560 np0000004400 cinder-backup[101319]: tcp: [85] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-12c3303b-9d75-4de7-bffd-31f22f904503 (non-flash) Jul 03 09:44:20.163560 np0000004400 cinder-backup[101319]: tcp: [86] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5b4a8460-d44c-48dc-80d1-22e538487d1b (non-flash) Jul 03 09:44:20.163560 np0000004400 cinder-backup[101319]: tcp: [87] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-dc2d662f-bc12-4338-8e3d-6565f72ba808 (non-flash) Jul 03 09:44:20.163560 np0000004400 cinder-backup[101319]: tcp: [88] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-dc2d662f-bc12-4338-8e3d-6565f72ba808 (non-flash) Jul 03 09:44:20.163560 np0000004400 cinder-backup[101319]: tcp: [89] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-35ece5f1-68f7-4f83-93fb-31eab852a359 (non-flash) Jul 03 09:44:20.163560 np0000004400 cinder-backup[101319]: stderr= {{(pid=101319) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jul 03 09:44:20.164043 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e492ae6-28c9-42fb-b5cd-6691b7fa5f24 tempest-VolumesBackupsTest-118275719 None] iscsi session list stdout=tcp: [49] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b2e4f10c-8033-4c54-95a1-dfe45d6357a3 (non-flash) Jul 03 09:44:20.164043 np0000004400 cinder-backup[101319]: tcp: [50] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b2e4f10c-8033-4c54-95a1-dfe45d6357a3 (non-flash) Jul 03 09:44:20.164043 np0000004400 cinder-backup[101319]: tcp: [72] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e9e3f386-d923-4ae1-a6ce-8dd2091673ac (non-flash) Jul 03 09:44:20.164043 np0000004400 cinder-backup[101319]: tcp: [73] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e9e3f386-d923-4ae1-a6ce-8dd2091673ac (non-flash) Jul 03 09:44:20.164043 np0000004400 cinder-backup[101319]: tcp: [80] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5ff1572c-401f-4af4-81ea-e10d782a782e (non-flash) Jul 03 09:44:20.164043 np0000004400 cinder-backup[101319]: tcp: [81] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5ff1572c-401f-4af4-81ea-e10d782a782e (non-flash) Jul 03 09:44:20.164043 np0000004400 cinder-backup[101319]: tcp: [82] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-76320525-737e-4f58-8523-63ec9abbdc64 (non-flash) Jul 03 09:44:20.164043 np0000004400 cinder-backup[101319]: tcp: [83] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-76320525-737e-4f58-8523-63ec9abbdc64 (non-flash) Jul 03 09:44:20.164043 np0000004400 cinder-backup[101319]: tcp: [84] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-12c3303b-9d75-4de7-bffd-31f22f904503 (non-flash) Jul 03 09:44:20.164043 np0000004400 cinder-backup[101319]: tcp: [85] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-12c3303b-9d75-4de7-bffd-31f22f904503 (non-flash) Jul 03 09:44:20.164043 np0000004400 cinder-backup[101319]: tcp: [86] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5b4a8460-d44c-48dc-80d1-22e538487d1b (non-flash) Jul 03 09:44:20.164043 np0000004400 cinder-backup[101319]: tcp: [87] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-dc2d662f-bc12-4338-8e3d-6565f72ba808 (non-flash) Jul 03 09:44:20.164043 np0000004400 cinder-backup[101319]: tcp: [88] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-dc2d662f-bc12-4338-8e3d-6565f72ba808 (non-flash) Jul 03 09:44:20.164043 np0000004400 cinder-backup[101319]: tcp: [89] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-35ece5f1-68f7-4f83-93fb-31eab852a359 (non-flash) Jul 03 09:44:20.164043 np0000004400 cinder-backup[101319]: stderr= {{(pid=101319) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jul 03 09:44:20.164420 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.base [None req-0e492ae6-28c9-42fb-b5cd-6691b7fa5f24 tempest-VolumesBackupsTest-118275719 None] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-35ece5f1-68f7-4f83-93fb-31eab852a359" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.164s {{(pid=101319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jul 03 09:44:20.164420 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e492ae6-28c9-42fb-b5cd-6691b7fa5f24 tempest-VolumesBackupsTest-118275719 None] Connected to 192.168.40.100:3260 {{(pid=101319) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}} Jul 03 09:44:20.165539 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.linuxscsi [None req-0e492ae6-28c9-42fb-b5cd-6691b7fa5f24 tempest-VolumesBackupsTest-118275719 None] HCTL ('18', '-', '-', 0) found on session 89 with lun 0 {{(pid=101319) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}} Jul 03 09:44:20.165664 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.linuxscsi [None req-0e492ae6-28c9-42fb-b5cd-6691b7fa5f24 tempest-VolumesBackupsTest-118275719 None] Scanning host 18 c: -, t: -, l: 0) {{(pid=101319) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}} Jul 03 09:44:20.190897 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.linuxscsi [None req-0e492ae6-28c9-42fb-b5cd-6691b7fa5f24 tempest-VolumesBackupsTest-118275719 None] Searching for a device in session 89 and hctl ['18', '*', '*', 0] yield: sdm {{(pid=101319) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}} Jul 03 09:44:20.191007 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e492ae6-28c9-42fb-b5cd-6691b7fa5f24 tempest-VolumesBackupsTest-118275719 None] Connected to sdm using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-35ece5f1-68f7-4f83-93fb-31eab852a359', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '35ece5f1-68f7-4f83-93fb-31eab852a359', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': False} {{(pid=101319) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}} Jul 03 09:44:21.200569 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.base [None req-0e492ae6-28c9-42fb-b5cd-6691b7fa5f24 tempest-VolumesBackupsTest-118275719 None] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 2.212s {{(pid=101319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jul 03 09:44:21.201103 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e492ae6-28c9-42fb-b5cd-6691b7fa5f24 tempest-VolumesBackupsTest-118275719 None] <== connect_volume: return (2212ms) {'type': 'block', 'scsi_wwn': 'SStorPool_iSCSI_DISK_1034578903445799010', 'path': '/dev/sdm'} {{(pid=101319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}} Jul 03 09:44:21.201218 np0000004400 cinder-backup[101319]: DEBUG oslo_concurrency.processutils [None req-0e492ae6-28c9-42fb-b5cd-6691b7fa5f24 tempest-VolumesBackupsTest-118275719 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chown 1002 /dev/sdm {{(pid=101319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 09:44:21.207704 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.base [None req-594028f2-f605-43c8-921d-d6dd781f88ab tempest-VolumesBackupsTest-2142009639 None] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 1.101s {{(pid=101319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jul 03 09:44:21.208427 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-594028f2-f605-43c8-921d-d6dd781f88ab tempest-VolumesBackupsTest-2142009639 None] _get_connection_devices called with parameters: connection_properties={'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-5b4a8460-d44c-48dc-80d1-22e538487d1b', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '5b4a8460-d44c-48dc-80d1-22e538487d1b', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': False}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=101319) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:847}} Jul 03 09:44:21.222160 np0000004400 sudo[133966]: stack : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chown 1002 /dev/sdm Jul 03 09:44:21.222980 np0000004400 sudo[133966]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1002) Jul 03 09:44:21.226913 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-594028f2-f605-43c8-921d-d6dd781f88ab tempest-VolumesBackupsTest-2142009639 None] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS: Jul 03 09:44:21.226913 np0000004400 cinder-backup[101319]: No targets found. Jul 03 09:44:21.226913 np0000004400 cinder-backup[101319]: iSNS: Jul 03 09:44:21.226913 np0000004400 cinder-backup[101319]: No targets found. Jul 03 09:44:21.226913 np0000004400 cinder-backup[101319]: STATIC: Jul 03 09:44:21.226913 np0000004400 cinder-backup[101319]: Target: iqn.2023-03.storpool.com:os--volume-12c3303b-9d75-4de7-bffd-31f22f904503 Jul 03 09:44:21.226913 np0000004400 cinder-backup[101319]: Portal: 192.168.50.100:3260,-1 Jul 03 09:44:21.226913 np0000004400 cinder-backup[101319]: Iface Name: default Jul 03 09:44:21.226913 np0000004400 cinder-backup[101319]: Portal: 192.168.40.100:3260,-1 Jul 03 09:44:21.226913 np0000004400 cinder-backup[101319]: Iface Name: default Jul 03 09:44:21.226913 np0000004400 cinder-backup[101319]: Target: iqn.2023-03.storpool.com:os--volume-76320525-737e-4f58-8523-63ec9abbdc64 Jul 03 09:44:21.226913 np0000004400 cinder-backup[101319]: Portal: 192.168.50.100:3260,-1 Jul 03 09:44:21.226913 np0000004400 cinder-backup[101319]: Iface Name: default Jul 03 09:44:21.226913 np0000004400 cinder-backup[101319]: Portal: 192.168.40.100:3260,-1 Jul 03 09:44:21.226913 np0000004400 cinder-backup[101319]: Iface Name: default Jul 03 09:44:21.226913 np0000004400 cinder-backup[101319]: Target: iqn.2023-03.storpool.com:os--volume-5ff1572c-401f-4af4-81ea-e10d782a782e Jul 03 09:44:21.226913 np0000004400 cinder-backup[101319]: Portal: 192.168.50.100:3260,-1 Jul 03 09:44:21.226913 np0000004400 cinder-backup[101319]: Iface Name: default Jul 03 09:44:21.226913 np0000004400 cinder-backup[101319]: Portal: 192.168.40.100:3260,-1 Jul 03 09:44:21.226913 np0000004400 cinder-backup[101319]: Iface Name: default Jul 03 09:44:21.226913 np0000004400 cinder-backup[101319]: Target: iqn.2023-03.storpool.com:os--volume-b2e4f10c-8033-4c54-95a1-dfe45d6357a3 Jul 03 09:44:21.226913 np0000004400 cinder-backup[101319]: Portal: 192.168.50.100:3260,-1 Jul 03 09:44:21.226913 np0000004400 cinder-backup[101319]: Iface Name: default Jul 03 09:44:21.226913 np0000004400 cinder-backup[101319]: Portal: 192.168.40.100:3260,-1 Jul 03 09:44:21.226913 np0000004400 cinder-backup[101319]: Iface Name: default Jul 03 09:44:21.226913 np0000004400 cinder-backup[101319]: Target: iqn.2023-03.storpool.com:os--volume-e9e3f386-d923-4ae1-a6ce-8dd2091673ac Jul 03 09:44:21.226913 np0000004400 cinder-backup[101319]: Portal: 192.168.50.100:3260,-1 Jul 03 09:44:21.226913 np0000004400 cinder-backup[101319]: Iface Name: default Jul 03 09:44:21.226913 np0000004400 cinder-backup[101319]: Portal: 192.168.40.100:3260,-1 Jul 03 09:44:21.226913 np0000004400 cinder-backup[101319]: Iface Name: default Jul 03 09:44:21.226913 np0000004400 cinder-backup[101319]: Target: iqn.2023-03.storpool.com:os--volume-35ece5f1-68f7-4f83-93fb-31eab852a359 Jul 03 09:44:21.226913 np0000004400 cinder-backup[101319]: Portal: 192.168.40.100:3260,-1 Jul 03 09:44:21.226913 np0000004400 cinder-backup[101319]: Iface Name: default Jul 03 09:44:21.226913 np0000004400 cinder-backup[101319]: Target: iqn.2023-03.storpool.com:os--volume-5b4a8460-d44c-48dc-80d1-22e538487d1b Jul 03 09:44:21.226913 np0000004400 cinder-backup[101319]: Portal: 192.168.40.100:3260,-1 Jul 03 09:44:21.226913 np0000004400 cinder-backup[101319]: Iface Name: default Jul 03 09:44:21.226913 np0000004400 cinder-backup[101319]: Target: iqn.2023-03.storpool.com:os--volume-dc2d662f-bc12-4338-8e3d-6565f72ba808 Jul 03 09:44:21.226913 np0000004400 cinder-backup[101319]: Portal: 192.168.50.100:3260,-1 Jul 03 09:44:21.226913 np0000004400 cinder-backup[101319]: Iface Name: default Jul 03 09:44:21.226913 np0000004400 cinder-backup[101319]: Portal: 192.168.40.100:3260,-1 Jul 03 09:44:21.226913 np0000004400 cinder-backup[101319]: Iface Name: default Jul 03 09:44:21.226913 np0000004400 cinder-backup[101319]: FIRMWARE: Jul 03 09:44:21.226913 np0000004400 cinder-backup[101319]: No targets found. Jul 03 09:44:21.226913 np0000004400 cinder-backup[101319]: stderr= {{(pid=101319) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jul 03 09:44:21.228082 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-594028f2-f605-43c8-921d-d6dd781f88ab tempest-VolumesBackupsTest-2142009639 None] Regex to get portals from discoverydb: ^SENDTARGETS: Jul 03 09:44:21.228082 np0000004400 cinder-backup[101319]: .*?^DiscoveryAddress: 192.168.40.100,3260.*? Jul 03 09:44:21.228082 np0000004400 cinder-backup[101319]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=101319) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:390}} Jul 03 09:44:21.228082 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-594028f2-f605-43c8-921d-d6dd781f88ab tempest-VolumesBackupsTest-2142009639 None] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-5b4a8460-d44c-48dc-80d1-22e538487d1b', 0)] {{(pid=101319) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:858}} Jul 03 09:44:21.258737 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-594028f2-f605-43c8-921d-d6dd781f88ab tempest-VolumesBackupsTest-2142009639 None] iscsiadm ('-m', 'session'): stdout=tcp: [49] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b2e4f10c-8033-4c54-95a1-dfe45d6357a3 (non-flash) Jul 03 09:44:21.258737 np0000004400 cinder-backup[101319]: tcp: [50] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b2e4f10c-8033-4c54-95a1-dfe45d6357a3 (non-flash) Jul 03 09:44:21.258737 np0000004400 cinder-backup[101319]: tcp: [72] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e9e3f386-d923-4ae1-a6ce-8dd2091673ac (non-flash) Jul 03 09:44:21.258737 np0000004400 cinder-backup[101319]: tcp: [73] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e9e3f386-d923-4ae1-a6ce-8dd2091673ac (non-flash) Jul 03 09:44:21.258737 np0000004400 cinder-backup[101319]: tcp: [80] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5ff1572c-401f-4af4-81ea-e10d782a782e (non-flash) Jul 03 09:44:21.258737 np0000004400 cinder-backup[101319]: tcp: [81] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5ff1572c-401f-4af4-81ea-e10d782a782e (non-flash) Jul 03 09:44:21.258737 np0000004400 cinder-backup[101319]: tcp: [82] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-76320525-737e-4f58-8523-63ec9abbdc64 (non-flash) Jul 03 09:44:21.258737 np0000004400 cinder-backup[101319]: tcp: [83] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-76320525-737e-4f58-8523-63ec9abbdc64 (non-flash) Jul 03 09:44:21.258737 np0000004400 cinder-backup[101319]: tcp: [84] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-12c3303b-9d75-4de7-bffd-31f22f904503 (non-flash) Jul 03 09:44:21.258737 np0000004400 cinder-backup[101319]: tcp: [85] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-12c3303b-9d75-4de7-bffd-31f22f904503 (non-flash) Jul 03 09:44:21.258737 np0000004400 cinder-backup[101319]: tcp: [86] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5b4a8460-d44c-48dc-80d1-22e538487d1b (non-flash) Jul 03 09:44:21.258737 np0000004400 cinder-backup[101319]: tcp: [87] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-dc2d662f-bc12-4338-8e3d-6565f72ba808 (non-flash) Jul 03 09:44:21.258737 np0000004400 cinder-backup[101319]: tcp: [88] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-dc2d662f-bc12-4338-8e3d-6565f72ba808 (non-flash) Jul 03 09:44:21.258737 np0000004400 cinder-backup[101319]: tcp: [89] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-35ece5f1-68f7-4f83-93fb-31eab852a359 (non-flash) Jul 03 09:44:21.258737 np0000004400 cinder-backup[101319]: stderr= {{(pid=101319) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jul 03 09:44:21.259085 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-594028f2-f605-43c8-921d-d6dd781f88ab tempest-VolumesBackupsTest-2142009639 None] iscsi session list stdout=tcp: [49] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b2e4f10c-8033-4c54-95a1-dfe45d6357a3 (non-flash) Jul 03 09:44:21.259085 np0000004400 cinder-backup[101319]: tcp: [50] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b2e4f10c-8033-4c54-95a1-dfe45d6357a3 (non-flash) Jul 03 09:44:21.259085 np0000004400 cinder-backup[101319]: tcp: [72] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e9e3f386-d923-4ae1-a6ce-8dd2091673ac (non-flash) Jul 03 09:44:21.259085 np0000004400 cinder-backup[101319]: tcp: [73] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e9e3f386-d923-4ae1-a6ce-8dd2091673ac (non-flash) Jul 03 09:44:21.259085 np0000004400 cinder-backup[101319]: tcp: [80] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5ff1572c-401f-4af4-81ea-e10d782a782e (non-flash) Jul 03 09:44:21.259085 np0000004400 cinder-backup[101319]: tcp: [81] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5ff1572c-401f-4af4-81ea-e10d782a782e (non-flash) Jul 03 09:44:21.259085 np0000004400 cinder-backup[101319]: tcp: [82] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-76320525-737e-4f58-8523-63ec9abbdc64 (non-flash) Jul 03 09:44:21.259085 np0000004400 cinder-backup[101319]: tcp: [83] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-76320525-737e-4f58-8523-63ec9abbdc64 (non-flash) Jul 03 09:44:21.259085 np0000004400 cinder-backup[101319]: tcp: [84] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-12c3303b-9d75-4de7-bffd-31f22f904503 (non-flash) Jul 03 09:44:21.259085 np0000004400 cinder-backup[101319]: tcp: [85] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-12c3303b-9d75-4de7-bffd-31f22f904503 (non-flash) Jul 03 09:44:21.259085 np0000004400 cinder-backup[101319]: tcp: [86] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5b4a8460-d44c-48dc-80d1-22e538487d1b (non-flash) Jul 03 09:44:21.259085 np0000004400 cinder-backup[101319]: tcp: [87] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-dc2d662f-bc12-4338-8e3d-6565f72ba808 (non-flash) Jul 03 09:44:21.259085 np0000004400 cinder-backup[101319]: tcp: [88] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-dc2d662f-bc12-4338-8e3d-6565f72ba808 (non-flash) Jul 03 09:44:21.259085 np0000004400 cinder-backup[101319]: tcp: [89] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-35ece5f1-68f7-4f83-93fb-31eab852a359 (non-flash) Jul 03 09:44:21.259085 np0000004400 cinder-backup[101319]: stderr= {{(pid=101319) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jul 03 09:44:21.259085 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-594028f2-f605-43c8-921d-d6dd781f88ab tempest-VolumesBackupsTest-2142009639 None] Sessions list: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-b2e4f10c-8033-4c54-95a1-dfe45d6357a3', '49'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-b2e4f10c-8033-4c54-95a1-dfe45d6357a3', '50'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-e9e3f386-d923-4ae1-a6ce-8dd2091673ac', '72'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-e9e3f386-d923-4ae1-a6ce-8dd2091673ac', '73'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-5ff1572c-401f-4af4-81ea-e10d782a782e', '80'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-5ff1572c-401f-4af4-81ea-e10d782a782e', '81'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-76320525-737e-4f58-8523-63ec9abbdc64', '82'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-76320525-737e-4f58-8523-63ec9abbdc64', '83'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-12c3303b-9d75-4de7-bffd-31f22f904503', '84'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-12c3303b-9d75-4de7-bffd-31f22f904503', '85'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-5b4a8460-d44c-48dc-80d1-22e538487d1b', '86'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-dc2d662f-bc12-4338-8e3d-6565f72ba808', '87'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-dc2d662f-bc12-4338-8e3d-6565f72ba808', '88'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-35ece5f1-68f7-4f83-93fb-31eab852a359', '89')] {{(pid=101319) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:866}} Jul 03 09:44:21.259444 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-594028f2-f605-43c8-921d-d6dd781f88ab tempest-VolumesBackupsTest-2142009639 None] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-5b4a8460-d44c-48dc-80d1-22e538487d1b, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-5b4a8460-d44c-48dc-80d1-22e538487d1b', '86')] {{(pid=101319) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}} Jul 03 09:44:21.260358 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-594028f2-f605-43c8-921d-d6dd781f88ab tempest-VolumesBackupsTest-2142009639 None] Resulting device map defaultdict(. at 0x7e76e71a74c0>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-5b4a8460-d44c-48dc-80d1-22e538487d1b'): ({'sdj'}, set())}) {{(pid=101319) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:912}} Jul 03 09:44:21.260594 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.linuxscsi [None req-594028f2-f605-43c8-921d-d6dd781f88ab tempest-VolumesBackupsTest-2142009639 None] Removing single pathed devices sdj {{(pid=101319) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}} Jul 03 09:44:21.272978 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.linuxscsi [None req-594028f2-f605-43c8-921d-d6dd781f88ab tempest-VolumesBackupsTest-2142009639 None] Flushing IO for device /dev/sdj {{(pid=101319) flush_device_io /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:461}} Jul 03 09:44:21.286306 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.linuxscsi [None req-594028f2-f605-43c8-921d-d6dd781f88ab tempest-VolumesBackupsTest-2142009639 None] Remove SCSI device /dev/sdj with /sys/block/sdj/device/delete {{(pid=101319) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}} Jul 03 09:44:21.346147 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.linuxscsi [None req-594028f2-f605-43c8-921d-d6dd781f88ab tempest-VolumesBackupsTest-2142009639 None] Checking to see if SCSI volumes sdj have been removed. {{(pid=101319) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}} Jul 03 09:44:21.346538 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.linuxscsi [None req-594028f2-f605-43c8-921d-d6dd781f88ab tempest-VolumesBackupsTest-2142009639 None] SCSI volumes sdj have been removed. {{(pid=101319) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}} Jul 03 09:44:21.348926 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.linuxscsi [None req-594028f2-f605-43c8-921d-d6dd781f88ab tempest-VolumesBackupsTest-2142009639 None] Checking to see if device paths {'sdj'} are still under multipathd monitoring {{(pid=101319) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}} Jul 03 09:44:21.359352 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.linuxscsi [None req-594028f2-f605-43c8-921d-d6dd781f88ab tempest-VolumesBackupsTest-2142009639 None] Device paths {'sdj'} have been removed from multipathd monitoring. {{(pid=101319) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}} Jul 03 09:44:21.359686 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-594028f2-f605-43c8-921d-d6dd781f88ab tempest-VolumesBackupsTest-2142009639 None] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-5b4a8460-d44c-48dc-80d1-22e538487d1b')] {{(pid=101319) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1225}} Jul 03 09:44:21.372461 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-594028f2-f605-43c8-921d-d6dd781f88ab tempest-VolumesBackupsTest-2142009639 None] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=101319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 03 09:44:21.415418 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-594028f2-f605-43c8-921d-d6dd781f88ab tempest-VolumesBackupsTest-2142009639 None] iscsiadm ('--logout',): stdout=Logging out of session [sid: 86, target: iqn.2023-03.storpool.com:os--volume-5b4a8460-d44c-48dc-80d1-22e538487d1b, portal: 192.168.40.100,3260] Jul 03 09:44:21.415418 np0000004400 cinder-backup[101319]: Logout of [sid: 86, target: iqn.2023-03.storpool.com:os--volume-5b4a8460-d44c-48dc-80d1-22e538487d1b, portal: 192.168.40.100,3260] successful. Jul 03 09:44:21.415418 np0000004400 cinder-backup[101319]: stderr= {{(pid=101319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 03 09:44:21.442591 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-594028f2-f605-43c8-921d-d6dd781f88ab tempest-VolumesBackupsTest-2142009639 None] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=101319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 03 09:44:21.442888 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.base [None req-594028f2-f605-43c8-921d-d6dd781f88ab tempest-VolumesBackupsTest-2142009639 None] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.236s {{(pid=101319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jul 03 09:44:21.443078 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-594028f2-f605-43c8-921d-d6dd781f88ab tempest-VolumesBackupsTest-2142009639 None] <== disconnect_volume: return (1337ms) None {{(pid=101319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}} Jul 03 09:44:21.598489 np0000004400 sudo[133966]: pam_unix(sudo:session): session closed for user root Jul 03 09:44:21.600337 np0000004400 cinder-backup[101319]: DEBUG oslo_concurrency.processutils [None req-0e492ae6-28c9-42fb-b5cd-6691b7fa5f24 tempest-VolumesBackupsTest-118275719 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chown 1002 /dev/sdm" returned: 0 in 0.399s {{(pid=101319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 09:44:21.610173 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-0e492ae6-28c9-42fb-b5cd-6691b7fa5f24 tempest-VolumesBackupsTest-118275719 None] _create_container started, container: volumebackups,backup: 36c3a4f2-c782-418d-be49-db2bcf3421f7. {{(pid=101319) _create_container /opt/stack/cinder/cinder/backup/chunkeddriver.py:249}} Jul 03 09:44:21.756817 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.drivers.swift [None req-0e492ae6-28c9-42fb-b5cd-6691b7fa5f24 tempest-VolumesBackupsTest-118275719 None] generate_object_name_prefix: volume_35ece5f1-68f7-4f83-93fb-31eab852a359/20260703094421/az_nova_backup_36c3a4f2-c782-418d-be49-db2bcf3421f7 {{(pid=101319) _generate_object_name_prefix /opt/stack/cinder/cinder/backup/drivers/swift.py:452}} Jul 03 09:44:21.762457 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-0e492ae6-28c9-42fb-b5cd-6691b7fa5f24 tempest-VolumesBackupsTest-118275719 None] starting backup of volume: 35ece5f1-68f7-4f83-93fb-31eab852a359, volume size: 1073741824, object names prefix volume_35ece5f1-68f7-4f83-93fb-31eab852a359/20260703094421/az_nova_backup_36c3a4f2-c782-418d-be49-db2bcf3421f7, availability zone: nova {{(pid=101319) _prepare_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:359}} Jul 03 09:44:21.953436 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-0e492ae6-28c9-42fb-b5cd-6691b7fa5f24 tempest-VolumesBackupsTest-118275719 None] Backing up chunk of data from volume. {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 09:44:22.195469 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-0e492ae6-28c9-42fb-b5cd-6691b7fa5f24 tempest-VolumesBackupsTest-118275719 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101319) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 09:44:22.195663 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-0e492ae6-28c9-42fb-b5cd-6691b7fa5f24 tempest-VolumesBackupsTest-118275719 None] About to put_object {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 09:44:22.307736 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-0e492ae6-28c9-42fb-b5cd-6691b7fa5f24 tempest-VolumesBackupsTest-118275719 None] backup MD5 for volume_35ece5f1-68f7-4f83-93fb-31eab852a359/20260703094421/az_nova_backup_36c3a4f2-c782-418d-be49-db2bcf3421f7-00001: 25e317773f308e446cc84c503a6d1f85 {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 09:44:22.307736 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-0e492ae6-28c9-42fb-b5cd-6691b7fa5f24 tempest-VolumesBackupsTest-118275719 None] Calling eventlet.sleep(0) {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 09:44:22.476795 np0000004400 cinder-backup[101319]: INFO cinder.backup.manager [None req-594028f2-f605-43c8-921d-d6dd781f88ab tempest-VolumesBackupsTest-2142009639 None] Create backup finished. backup: 231fdf27-e89f-4b12-b8d9-adad9ec76225. Jul 03 09:44:22.508500 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-0e492ae6-28c9-42fb-b5cd-6691b7fa5f24 tempest-VolumesBackupsTest-118275719 None] Backing up chunk of data from volume. {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 09:44:22.757311 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-0e492ae6-28c9-42fb-b5cd-6691b7fa5f24 tempest-VolumesBackupsTest-118275719 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101319) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 09:44:22.757496 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-0e492ae6-28c9-42fb-b5cd-6691b7fa5f24 tempest-VolumesBackupsTest-118275719 None] About to put_object {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 09:44:22.859301 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-0e492ae6-28c9-42fb-b5cd-6691b7fa5f24 tempest-VolumesBackupsTest-118275719 None] backup MD5 for volume_35ece5f1-68f7-4f83-93fb-31eab852a359/20260703094421/az_nova_backup_36c3a4f2-c782-418d-be49-db2bcf3421f7-00002: 25e317773f308e446cc84c503a6d1f85 {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 09:44:22.859487 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-0e492ae6-28c9-42fb-b5cd-6691b7fa5f24 tempest-VolumesBackupsTest-118275719 None] Calling eventlet.sleep(0) {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 09:44:23.042276 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-0e492ae6-28c9-42fb-b5cd-6691b7fa5f24 tempest-VolumesBackupsTest-118275719 None] Backing up chunk of data from volume. {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 09:44:23.293291 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-0e492ae6-28c9-42fb-b5cd-6691b7fa5f24 tempest-VolumesBackupsTest-118275719 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101319) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 09:44:23.293291 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-0e492ae6-28c9-42fb-b5cd-6691b7fa5f24 tempest-VolumesBackupsTest-118275719 None] About to put_object {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 09:44:23.392633 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-0e492ae6-28c9-42fb-b5cd-6691b7fa5f24 tempest-VolumesBackupsTest-118275719 None] backup MD5 for volume_35ece5f1-68f7-4f83-93fb-31eab852a359/20260703094421/az_nova_backup_36c3a4f2-c782-418d-be49-db2bcf3421f7-00003: 25e317773f308e446cc84c503a6d1f85 {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 09:44:23.392633 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-0e492ae6-28c9-42fb-b5cd-6691b7fa5f24 tempest-VolumesBackupsTest-118275719 None] Calling eventlet.sleep(0) {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 09:44:23.438640 np0000004400 cinder-backup[101319]: INFO cinder.backup.manager [None req-af36d12f-f1ec-41be-ad4c-7ce4c1c68683 tempest-VolumesBackupsTest-2142009639 None] Delete backup started, backup: 231fdf27-e89f-4b12-b8d9-adad9ec76225. Jul 03 09:44:23.442495 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.drivers.swift [None req-af36d12f-f1ec-41be-ad4c-7ce4c1c68683 tempest-VolumesBackupsTest-2142009639 None] Using swift URL https://10.4.3.95:8080/v1/AUTH_59044e18a5b24b19a7b9b8a380f2e1a0 {{(pid=101319) initialize /opt/stack/cinder/cinder/backup/drivers/swift.py:300}} Jul 03 09:44:23.442954 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.drivers.swift [None req-af36d12f-f1ec-41be-ad4c-7ce4c1c68683 tempest-VolumesBackupsTest-2142009639 None] Connect to https://10.4.3.95:8080/v1/AUTH_ in "per_user" mode {{(pid=101319) initialize /opt/stack/cinder/cinder/backup/drivers/swift.py:301}} Jul 03 09:44:23.443300 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-af36d12f-f1ec-41be-ad4c-7ce4c1c68683 tempest-VolumesBackupsTest-2142009639 None] delete started, backup: 231fdf27-e89f-4b12-b8d9-adad9ec76225, container: tempest-volumesbackupstest-backup-container-412072100, prefix: volume_5ff1572c-401f-4af4-81ea-e10d782a782e/20260703094407/az_nova_backup_231fdf27-e89f-4b12-b8d9-adad9ec76225. {{(pid=101319) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:822}} Jul 03 09:44:23.506716 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-af36d12f-f1ec-41be-ad4c-7ce4c1c68683 tempest-VolumesBackupsTest-2142009639 None] generated object list: ['volume_5ff1572c-401f-4af4-81ea-e10d782a782e/20260703094407/az_nova_backup_231fdf27-e89f-4b12-b8d9-adad9ec76225-00001', 'volume_5ff1572c-401f-4af4-81ea-e10d782a782e/20260703094407/az_nova_backup_231fdf27-e89f-4b12-b8d9-adad9ec76225-00002', 'volume_5ff1572c-401f-4af4-81ea-e10d782a782e/20260703094407/az_nova_backup_231fdf27-e89f-4b12-b8d9-adad9ec76225-00003', 'volume_5ff1572c-401f-4af4-81ea-e10d782a782e/20260703094407/az_nova_backup_231fdf27-e89f-4b12-b8d9-adad9ec76225-00004', 'volume_5ff1572c-401f-4af4-81ea-e10d782a782e/20260703094407/az_nova_backup_231fdf27-e89f-4b12-b8d9-adad9ec76225-00005', 'volume_5ff1572c-401f-4af4-81ea-e10d782a782e/20260703094407/az_nova_backup_231fdf27-e89f-4b12-b8d9-adad9ec76225-00006', 'volume_5ff1572c-401f-4af4-81ea-e10d782a782e/20260703094407/az_nova_backup_231fdf27-e89f-4b12-b8d9-adad9ec76225-00007', 'volume_5ff1572c-401f-4af4-81ea-e10d782a782e/20260703094407/az_nova_backup_231fdf27-e89f-4b12-b8d9-adad9ec76225-00008', 'volume_5ff1572c-401f-4af4-81ea-e10d782a782e/20260703094407/az_nova_backup_231fdf27-e89f-4b12-b8d9-adad9ec76225-00009', 'volume_5ff1572c-401f-4af4-81ea-e10d782a782e/20260703094407/az_nova_backup_231fdf27-e89f-4b12-b8d9-adad9ec76225-00010', 'volume_5ff1572c-401f-4af4-81ea-e10d782a782e/20260703094407/az_nova_backup_231fdf27-e89f-4b12-b8d9-adad9ec76225-00011', 'volume_5ff1572c-401f-4af4-81ea-e10d782a782e/20260703094407/az_nova_backup_231fdf27-e89f-4b12-b8d9-adad9ec76225-00012', 'volume_5ff1572c-401f-4af4-81ea-e10d782a782e/20260703094407/az_nova_backup_231fdf27-e89f-4b12-b8d9-adad9ec76225-00013', 'volume_5ff1572c-401f-4af4-81ea-e10d782a782e/20260703094407/az_nova_backup_231fdf27-e89f-4b12-b8d9-adad9ec76225-00014', 'volume_5ff1572c-401f-4af4-81ea-e10d782a782e/20260703094407/az_nova_backup_231fdf27-e89f-4b12-b8d9-adad9ec76225-00015', 'volume_5ff1572c-401f-4af4-81ea-e10d782a782e/20260703094407/az_nova_backup_231fdf27-e89f-4b12-b8d9-adad9ec76225-00016', 'volume_5ff1572c-401f-4af4-81ea-e10d782a782e/20260703094407/az_nova_backup_231fdf27-e89f-4b12-b8d9-adad9ec76225-00017', 'volume_5ff1572c-401f-4af4-81ea-e10d782a782e/20260703094407/az_nova_backup_231fdf27-e89f-4b12-b8d9-adad9ec76225-00018', 'volume_5ff1572c-401f-4af4-81ea-e10d782a782e/20260703094407/az_nova_backup_231fdf27-e89f-4b12-b8d9-adad9ec76225-00019', 'volume_5ff1572c-401f-4af4-81ea-e10d782a782e/20260703094407/az_nova_backup_231fdf27-e89f-4b12-b8d9-adad9ec76225-00020', 'volume_5ff1572c-401f-4af4-81ea-e10d782a782e/20260703094407/az_nova_backup_231fdf27-e89f-4b12-b8d9-adad9ec76225-00021', 'volume_5ff1572c-401f-4af4-81ea-e10d782a782e/20260703094407/az_nova_backup_231fdf27-e89f-4b12-b8d9-adad9ec76225_metadata', 'volume_5ff1572c-401f-4af4-81ea-e10d782a782e/20260703094407/az_nova_backup_231fdf27-e89f-4b12-b8d9-adad9ec76225_sha256file']. {{(pid=101319) _generate_object_names /opt/stack/cinder/cinder/backup/chunkeddriver.py:260}} Jul 03 09:44:23.532437 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-af36d12f-f1ec-41be-ad4c-7ce4c1c68683 tempest-VolumesBackupsTest-2142009639 None] deleted object: volume_5ff1572c-401f-4af4-81ea-e10d782a782e/20260703094407/az_nova_backup_231fdf27-e89f-4b12-b8d9-adad9ec76225-00001 in container: tempest-volumesbackupstest-backup-container-412072100. {{(pid=101319) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 09:44:23.553443 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-af36d12f-f1ec-41be-ad4c-7ce4c1c68683 tempest-VolumesBackupsTest-2142009639 None] deleted object: volume_5ff1572c-401f-4af4-81ea-e10d782a782e/20260703094407/az_nova_backup_231fdf27-e89f-4b12-b8d9-adad9ec76225-00002 in container: tempest-volumesbackupstest-backup-container-412072100. {{(pid=101319) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 09:44:23.583443 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-af36d12f-f1ec-41be-ad4c-7ce4c1c68683 tempest-VolumesBackupsTest-2142009639 None] deleted object: volume_5ff1572c-401f-4af4-81ea-e10d782a782e/20260703094407/az_nova_backup_231fdf27-e89f-4b12-b8d9-adad9ec76225-00003 in container: tempest-volumesbackupstest-backup-container-412072100. {{(pid=101319) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 09:44:23.601191 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-af36d12f-f1ec-41be-ad4c-7ce4c1c68683 tempest-VolumesBackupsTest-2142009639 None] deleted object: volume_5ff1572c-401f-4af4-81ea-e10d782a782e/20260703094407/az_nova_backup_231fdf27-e89f-4b12-b8d9-adad9ec76225-00004 in container: tempest-volumesbackupstest-backup-container-412072100. {{(pid=101319) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 09:44:23.607222 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-0e492ae6-28c9-42fb-b5cd-6691b7fa5f24 tempest-VolumesBackupsTest-118275719 None] Backing up chunk of data from volume. {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 09:44:23.625180 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-af36d12f-f1ec-41be-ad4c-7ce4c1c68683 tempest-VolumesBackupsTest-2142009639 None] deleted object: volume_5ff1572c-401f-4af4-81ea-e10d782a782e/20260703094407/az_nova_backup_231fdf27-e89f-4b12-b8d9-adad9ec76225-00005 in container: tempest-volumesbackupstest-backup-container-412072100. {{(pid=101319) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 09:44:23.651937 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-af36d12f-f1ec-41be-ad4c-7ce4c1c68683 tempest-VolumesBackupsTest-2142009639 None] deleted object: volume_5ff1572c-401f-4af4-81ea-e10d782a782e/20260703094407/az_nova_backup_231fdf27-e89f-4b12-b8d9-adad9ec76225-00006 in container: tempest-volumesbackupstest-backup-container-412072100. {{(pid=101319) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 09:44:23.671699 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-af36d12f-f1ec-41be-ad4c-7ce4c1c68683 tempest-VolumesBackupsTest-2142009639 None] deleted object: volume_5ff1572c-401f-4af4-81ea-e10d782a782e/20260703094407/az_nova_backup_231fdf27-e89f-4b12-b8d9-adad9ec76225-00007 in container: tempest-volumesbackupstest-backup-container-412072100. {{(pid=101319) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 09:44:23.692885 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-af36d12f-f1ec-41be-ad4c-7ce4c1c68683 tempest-VolumesBackupsTest-2142009639 None] deleted object: volume_5ff1572c-401f-4af4-81ea-e10d782a782e/20260703094407/az_nova_backup_231fdf27-e89f-4b12-b8d9-adad9ec76225-00008 in container: tempest-volumesbackupstest-backup-container-412072100. {{(pid=101319) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 09:44:23.714023 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-af36d12f-f1ec-41be-ad4c-7ce4c1c68683 tempest-VolumesBackupsTest-2142009639 None] deleted object: volume_5ff1572c-401f-4af4-81ea-e10d782a782e/20260703094407/az_nova_backup_231fdf27-e89f-4b12-b8d9-adad9ec76225-00009 in container: tempest-volumesbackupstest-backup-container-412072100. {{(pid=101319) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 09:44:23.733990 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-af36d12f-f1ec-41be-ad4c-7ce4c1c68683 tempest-VolumesBackupsTest-2142009639 None] deleted object: volume_5ff1572c-401f-4af4-81ea-e10d782a782e/20260703094407/az_nova_backup_231fdf27-e89f-4b12-b8d9-adad9ec76225-00010 in container: tempest-volumesbackupstest-backup-container-412072100. {{(pid=101319) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 09:44:23.752897 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-af36d12f-f1ec-41be-ad4c-7ce4c1c68683 tempest-VolumesBackupsTest-2142009639 None] deleted object: volume_5ff1572c-401f-4af4-81ea-e10d782a782e/20260703094407/az_nova_backup_231fdf27-e89f-4b12-b8d9-adad9ec76225-00011 in container: tempest-volumesbackupstest-backup-container-412072100. {{(pid=101319) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 09:44:23.773567 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-af36d12f-f1ec-41be-ad4c-7ce4c1c68683 tempest-VolumesBackupsTest-2142009639 None] deleted object: volume_5ff1572c-401f-4af4-81ea-e10d782a782e/20260703094407/az_nova_backup_231fdf27-e89f-4b12-b8d9-adad9ec76225-00012 in container: tempest-volumesbackupstest-backup-container-412072100. {{(pid=101319) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 09:44:23.792236 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-af36d12f-f1ec-41be-ad4c-7ce4c1c68683 tempest-VolumesBackupsTest-2142009639 None] deleted object: volume_5ff1572c-401f-4af4-81ea-e10d782a782e/20260703094407/az_nova_backup_231fdf27-e89f-4b12-b8d9-adad9ec76225-00013 in container: tempest-volumesbackupstest-backup-container-412072100. {{(pid=101319) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 09:44:23.811701 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-af36d12f-f1ec-41be-ad4c-7ce4c1c68683 tempest-VolumesBackupsTest-2142009639 None] deleted object: volume_5ff1572c-401f-4af4-81ea-e10d782a782e/20260703094407/az_nova_backup_231fdf27-e89f-4b12-b8d9-adad9ec76225-00014 in container: tempest-volumesbackupstest-backup-container-412072100. {{(pid=101319) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 09:44:23.830890 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-af36d12f-f1ec-41be-ad4c-7ce4c1c68683 tempest-VolumesBackupsTest-2142009639 None] deleted object: volume_5ff1572c-401f-4af4-81ea-e10d782a782e/20260703094407/az_nova_backup_231fdf27-e89f-4b12-b8d9-adad9ec76225-00015 in container: tempest-volumesbackupstest-backup-container-412072100. {{(pid=101319) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 09:44:23.850419 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-af36d12f-f1ec-41be-ad4c-7ce4c1c68683 tempest-VolumesBackupsTest-2142009639 None] deleted object: volume_5ff1572c-401f-4af4-81ea-e10d782a782e/20260703094407/az_nova_backup_231fdf27-e89f-4b12-b8d9-adad9ec76225-00016 in container: tempest-volumesbackupstest-backup-container-412072100. {{(pid=101319) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 09:44:23.873877 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-af36d12f-f1ec-41be-ad4c-7ce4c1c68683 tempest-VolumesBackupsTest-2142009639 None] deleted object: volume_5ff1572c-401f-4af4-81ea-e10d782a782e/20260703094407/az_nova_backup_231fdf27-e89f-4b12-b8d9-adad9ec76225-00017 in container: tempest-volumesbackupstest-backup-container-412072100. {{(pid=101319) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 09:44:23.876951 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-0e492ae6-28c9-42fb-b5cd-6691b7fa5f24 tempest-VolumesBackupsTest-118275719 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101319) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 09:44:23.877137 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-0e492ae6-28c9-42fb-b5cd-6691b7fa5f24 tempest-VolumesBackupsTest-118275719 None] About to put_object {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 09:44:23.895545 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-af36d12f-f1ec-41be-ad4c-7ce4c1c68683 tempest-VolumesBackupsTest-2142009639 None] deleted object: volume_5ff1572c-401f-4af4-81ea-e10d782a782e/20260703094407/az_nova_backup_231fdf27-e89f-4b12-b8d9-adad9ec76225-00018 in container: tempest-volumesbackupstest-backup-container-412072100. {{(pid=101319) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 09:44:23.914261 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-af36d12f-f1ec-41be-ad4c-7ce4c1c68683 tempest-VolumesBackupsTest-2142009639 None] deleted object: volume_5ff1572c-401f-4af4-81ea-e10d782a782e/20260703094407/az_nova_backup_231fdf27-e89f-4b12-b8d9-adad9ec76225-00019 in container: tempest-volumesbackupstest-backup-container-412072100. {{(pid=101319) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 09:44:23.942443 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-af36d12f-f1ec-41be-ad4c-7ce4c1c68683 tempest-VolumesBackupsTest-2142009639 None] deleted object: volume_5ff1572c-401f-4af4-81ea-e10d782a782e/20260703094407/az_nova_backup_231fdf27-e89f-4b12-b8d9-adad9ec76225-00020 in container: tempest-volumesbackupstest-backup-container-412072100. {{(pid=101319) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 09:44:23.965384 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-af36d12f-f1ec-41be-ad4c-7ce4c1c68683 tempest-VolumesBackupsTest-2142009639 None] deleted object: volume_5ff1572c-401f-4af4-81ea-e10d782a782e/20260703094407/az_nova_backup_231fdf27-e89f-4b12-b8d9-adad9ec76225-00021 in container: tempest-volumesbackupstest-backup-container-412072100. {{(pid=101319) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 09:44:23.983767 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-af36d12f-f1ec-41be-ad4c-7ce4c1c68683 tempest-VolumesBackupsTest-2142009639 None] deleted object: volume_5ff1572c-401f-4af4-81ea-e10d782a782e/20260703094407/az_nova_backup_231fdf27-e89f-4b12-b8d9-adad9ec76225_metadata in container: tempest-volumesbackupstest-backup-container-412072100. {{(pid=101319) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 09:44:23.990094 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-0e492ae6-28c9-42fb-b5cd-6691b7fa5f24 tempest-VolumesBackupsTest-118275719 None] backup MD5 for volume_35ece5f1-68f7-4f83-93fb-31eab852a359/20260703094421/az_nova_backup_36c3a4f2-c782-418d-be49-db2bcf3421f7-00004: 25e317773f308e446cc84c503a6d1f85 {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 09:44:23.990224 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-0e492ae6-28c9-42fb-b5cd-6691b7fa5f24 tempest-VolumesBackupsTest-118275719 None] Calling eventlet.sleep(0) {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 09:44:24.026757 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-af36d12f-f1ec-41be-ad4c-7ce4c1c68683 tempest-VolumesBackupsTest-2142009639 None] deleted object: volume_5ff1572c-401f-4af4-81ea-e10d782a782e/20260703094407/az_nova_backup_231fdf27-e89f-4b12-b8d9-adad9ec76225_sha256file in container: tempest-volumesbackupstest-backup-container-412072100. {{(pid=101319) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 09:44:24.027206 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-af36d12f-f1ec-41be-ad4c-7ce4c1c68683 tempest-VolumesBackupsTest-2142009639 None] delete 231fdf27-e89f-4b12-b8d9-adad9ec76225 finished. {{(pid=101319) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:848}} Jul 03 09:44:24.058270 np0000004400 cinder-backup[101319]: DEBUG oslo_db.sqlalchemy.engines [None req-0e492ae6-28c9-42fb-b5cd-6691b7fa5f24 tempest-VolumesBackupsTest-118275719 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=101319) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 03 09:44:24.072242 np0000004400 cinder-backup[101319]: DEBUG cinder.quota [None req-af36d12f-f1ec-41be-ad4c-7ce4c1c68683 tempest-VolumesBackupsTest-2142009639 None] Created reservations ['d9dcd76e-1fbf-4eb7-adaf-bb5583586541', '7c24e226-7b2f-469b-b5bf-9e98596056ac'] {{(pid=101319) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 09:44:24.089080 np0000004400 cinder-backup[101319]: INFO cinder.backup.manager [None req-af36d12f-f1ec-41be-ad4c-7ce4c1c68683 tempest-VolumesBackupsTest-2142009639 None] Delete backup finished, backup 231fdf27-e89f-4b12-b8d9-adad9ec76225 deleted. Jul 03 09:44:24.229379 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-0e492ae6-28c9-42fb-b5cd-6691b7fa5f24 tempest-VolumesBackupsTest-118275719 None] Backing up chunk of data from volume. {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 09:44:24.468533 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-0e492ae6-28c9-42fb-b5cd-6691b7fa5f24 tempest-VolumesBackupsTest-118275719 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101319) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 09:44:24.469029 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-0e492ae6-28c9-42fb-b5cd-6691b7fa5f24 tempest-VolumesBackupsTest-118275719 None] About to put_object {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 09:44:24.573013 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-0e492ae6-28c9-42fb-b5cd-6691b7fa5f24 tempest-VolumesBackupsTest-118275719 None] backup MD5 for volume_35ece5f1-68f7-4f83-93fb-31eab852a359/20260703094421/az_nova_backup_36c3a4f2-c782-418d-be49-db2bcf3421f7-00005: 25e317773f308e446cc84c503a6d1f85 {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 09:44:24.573201 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-0e492ae6-28c9-42fb-b5cd-6691b7fa5f24 tempest-VolumesBackupsTest-118275719 None] Calling eventlet.sleep(0) {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 09:44:24.771080 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-0e492ae6-28c9-42fb-b5cd-6691b7fa5f24 tempest-VolumesBackupsTest-118275719 None] Backing up chunk of data from volume. {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 09:44:25.028026 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-0e492ae6-28c9-42fb-b5cd-6691b7fa5f24 tempest-VolumesBackupsTest-118275719 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101319) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 09:44:25.028247 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-0e492ae6-28c9-42fb-b5cd-6691b7fa5f24 tempest-VolumesBackupsTest-118275719 None] About to put_object {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 09:44:25.143786 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-0e492ae6-28c9-42fb-b5cd-6691b7fa5f24 tempest-VolumesBackupsTest-118275719 None] backup MD5 for volume_35ece5f1-68f7-4f83-93fb-31eab852a359/20260703094421/az_nova_backup_36c3a4f2-c782-418d-be49-db2bcf3421f7-00006: 25e317773f308e446cc84c503a6d1f85 {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 09:44:25.144047 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-0e492ae6-28c9-42fb-b5cd-6691b7fa5f24 tempest-VolumesBackupsTest-118275719 None] Calling eventlet.sleep(0) {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 09:44:25.364250 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-0e492ae6-28c9-42fb-b5cd-6691b7fa5f24 tempest-VolumesBackupsTest-118275719 None] Backing up chunk of data from volume. {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 09:44:25.626426 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-0e492ae6-28c9-42fb-b5cd-6691b7fa5f24 tempest-VolumesBackupsTest-118275719 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101319) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 09:44:25.626880 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-0e492ae6-28c9-42fb-b5cd-6691b7fa5f24 tempest-VolumesBackupsTest-118275719 None] About to put_object {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 09:44:25.724307 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-0e492ae6-28c9-42fb-b5cd-6691b7fa5f24 tempest-VolumesBackupsTest-118275719 None] backup MD5 for volume_35ece5f1-68f7-4f83-93fb-31eab852a359/20260703094421/az_nova_backup_36c3a4f2-c782-418d-be49-db2bcf3421f7-00007: 25e317773f308e446cc84c503a6d1f85 {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 09:44:25.724511 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-0e492ae6-28c9-42fb-b5cd-6691b7fa5f24 tempest-VolumesBackupsTest-118275719 None] Calling eventlet.sleep(0) {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 09:44:25.921264 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-0e492ae6-28c9-42fb-b5cd-6691b7fa5f24 tempest-VolumesBackupsTest-118275719 None] Backing up chunk of data from volume. {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 09:44:26.174302 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-0e492ae6-28c9-42fb-b5cd-6691b7fa5f24 tempest-VolumesBackupsTest-118275719 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101319) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 09:44:26.174476 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-0e492ae6-28c9-42fb-b5cd-6691b7fa5f24 tempest-VolumesBackupsTest-118275719 None] About to put_object {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 09:44:26.289501 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-0e492ae6-28c9-42fb-b5cd-6691b7fa5f24 tempest-VolumesBackupsTest-118275719 None] backup MD5 for volume_35ece5f1-68f7-4f83-93fb-31eab852a359/20260703094421/az_nova_backup_36c3a4f2-c782-418d-be49-db2bcf3421f7-00008: 25e317773f308e446cc84c503a6d1f85 {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 09:44:26.289745 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-0e492ae6-28c9-42fb-b5cd-6691b7fa5f24 tempest-VolumesBackupsTest-118275719 None] Calling eventlet.sleep(0) {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 09:44:26.499593 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-0e492ae6-28c9-42fb-b5cd-6691b7fa5f24 tempest-VolumesBackupsTest-118275719 None] Backing up chunk of data from volume. {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 09:44:26.754061 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-0e492ae6-28c9-42fb-b5cd-6691b7fa5f24 tempest-VolumesBackupsTest-118275719 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101319) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 09:44:26.754380 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-0e492ae6-28c9-42fb-b5cd-6691b7fa5f24 tempest-VolumesBackupsTest-118275719 None] About to put_object {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 09:44:26.879355 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-0e492ae6-28c9-42fb-b5cd-6691b7fa5f24 tempest-VolumesBackupsTest-118275719 None] backup MD5 for volume_35ece5f1-68f7-4f83-93fb-31eab852a359/20260703094421/az_nova_backup_36c3a4f2-c782-418d-be49-db2bcf3421f7-00009: 25e317773f308e446cc84c503a6d1f85 {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 09:44:26.879355 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-0e492ae6-28c9-42fb-b5cd-6691b7fa5f24 tempest-VolumesBackupsTest-118275719 None] Calling eventlet.sleep(0) {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 09:44:27.078359 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-0e492ae6-28c9-42fb-b5cd-6691b7fa5f24 tempest-VolumesBackupsTest-118275719 None] Backing up chunk of data from volume. {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 09:44:27.329125 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-0e492ae6-28c9-42fb-b5cd-6691b7fa5f24 tempest-VolumesBackupsTest-118275719 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101319) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 09:44:27.329336 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-0e492ae6-28c9-42fb-b5cd-6691b7fa5f24 tempest-VolumesBackupsTest-118275719 None] About to put_object {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 09:44:27.431785 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-0e492ae6-28c9-42fb-b5cd-6691b7fa5f24 tempest-VolumesBackupsTest-118275719 None] backup MD5 for volume_35ece5f1-68f7-4f83-93fb-31eab852a359/20260703094421/az_nova_backup_36c3a4f2-c782-418d-be49-db2bcf3421f7-00010: 25e317773f308e446cc84c503a6d1f85 {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 09:44:27.431924 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-0e492ae6-28c9-42fb-b5cd-6691b7fa5f24 tempest-VolumesBackupsTest-118275719 None] Calling eventlet.sleep(0) {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 09:44:27.603693 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-0e492ae6-28c9-42fb-b5cd-6691b7fa5f24 tempest-VolumesBackupsTest-118275719 None] Backing up chunk of data from volume. {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 09:44:27.839791 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-0e492ae6-28c9-42fb-b5cd-6691b7fa5f24 tempest-VolumesBackupsTest-118275719 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101319) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 09:44:27.840141 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-0e492ae6-28c9-42fb-b5cd-6691b7fa5f24 tempest-VolumesBackupsTest-118275719 None] About to put_object {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 09:44:27.949186 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-0e492ae6-28c9-42fb-b5cd-6691b7fa5f24 tempest-VolumesBackupsTest-118275719 None] backup MD5 for volume_35ece5f1-68f7-4f83-93fb-31eab852a359/20260703094421/az_nova_backup_36c3a4f2-c782-418d-be49-db2bcf3421f7-00011: 25e317773f308e446cc84c503a6d1f85 {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 09:44:27.949362 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-0e492ae6-28c9-42fb-b5cd-6691b7fa5f24 tempest-VolumesBackupsTest-118275719 None] Calling eventlet.sleep(0) {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 09:44:28.123803 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-0e492ae6-28c9-42fb-b5cd-6691b7fa5f24 tempest-VolumesBackupsTest-118275719 None] Backing up chunk of data from volume. {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 09:44:28.363353 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-0e492ae6-28c9-42fb-b5cd-6691b7fa5f24 tempest-VolumesBackupsTest-118275719 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101319) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 09:44:28.363504 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-0e492ae6-28c9-42fb-b5cd-6691b7fa5f24 tempest-VolumesBackupsTest-118275719 None] About to put_object {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 09:44:28.465795 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-0e492ae6-28c9-42fb-b5cd-6691b7fa5f24 tempest-VolumesBackupsTest-118275719 None] backup MD5 for volume_35ece5f1-68f7-4f83-93fb-31eab852a359/20260703094421/az_nova_backup_36c3a4f2-c782-418d-be49-db2bcf3421f7-00012: 25e317773f308e446cc84c503a6d1f85 {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 09:44:28.466020 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-0e492ae6-28c9-42fb-b5cd-6691b7fa5f24 tempest-VolumesBackupsTest-118275719 None] Calling eventlet.sleep(0) {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 09:44:28.648238 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-0e492ae6-28c9-42fb-b5cd-6691b7fa5f24 tempest-VolumesBackupsTest-118275719 None] Backing up chunk of data from volume. {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 09:44:28.887452 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-0e492ae6-28c9-42fb-b5cd-6691b7fa5f24 tempest-VolumesBackupsTest-118275719 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101319) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 09:44:28.887944 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-0e492ae6-28c9-42fb-b5cd-6691b7fa5f24 tempest-VolumesBackupsTest-118275719 None] About to put_object {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 09:44:28.992552 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-0e492ae6-28c9-42fb-b5cd-6691b7fa5f24 tempest-VolumesBackupsTest-118275719 None] backup MD5 for volume_35ece5f1-68f7-4f83-93fb-31eab852a359/20260703094421/az_nova_backup_36c3a4f2-c782-418d-be49-db2bcf3421f7-00013: 25e317773f308e446cc84c503a6d1f85 {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 09:44:28.992792 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-0e492ae6-28c9-42fb-b5cd-6691b7fa5f24 tempest-VolumesBackupsTest-118275719 None] Calling eventlet.sleep(0) {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 09:44:29.178878 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-0e492ae6-28c9-42fb-b5cd-6691b7fa5f24 tempest-VolumesBackupsTest-118275719 None] Backing up chunk of data from volume. {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 09:44:29.450736 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-0e492ae6-28c9-42fb-b5cd-6691b7fa5f24 tempest-VolumesBackupsTest-118275719 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101319) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 09:44:29.450736 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-0e492ae6-28c9-42fb-b5cd-6691b7fa5f24 tempest-VolumesBackupsTest-118275719 None] About to put_object {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 09:44:29.560023 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-0e492ae6-28c9-42fb-b5cd-6691b7fa5f24 tempest-VolumesBackupsTest-118275719 None] backup MD5 for volume_35ece5f1-68f7-4f83-93fb-31eab852a359/20260703094421/az_nova_backup_36c3a4f2-c782-418d-be49-db2bcf3421f7-00014: 25e317773f308e446cc84c503a6d1f85 {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 09:44:29.560304 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-0e492ae6-28c9-42fb-b5cd-6691b7fa5f24 tempest-VolumesBackupsTest-118275719 None] Calling eventlet.sleep(0) {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 09:44:29.738645 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-0e492ae6-28c9-42fb-b5cd-6691b7fa5f24 tempest-VolumesBackupsTest-118275719 None] Backing up chunk of data from volume. {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 09:44:29.996999 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-0e492ae6-28c9-42fb-b5cd-6691b7fa5f24 tempest-VolumesBackupsTest-118275719 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101319) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 09:44:29.997384 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-0e492ae6-28c9-42fb-b5cd-6691b7fa5f24 tempest-VolumesBackupsTest-118275719 None] About to put_object {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 09:44:30.108290 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-0e492ae6-28c9-42fb-b5cd-6691b7fa5f24 tempest-VolumesBackupsTest-118275719 None] backup MD5 for volume_35ece5f1-68f7-4f83-93fb-31eab852a359/20260703094421/az_nova_backup_36c3a4f2-c782-418d-be49-db2bcf3421f7-00015: 25e317773f308e446cc84c503a6d1f85 {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 09:44:30.108426 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-0e492ae6-28c9-42fb-b5cd-6691b7fa5f24 tempest-VolumesBackupsTest-118275719 None] Calling eventlet.sleep(0) {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 09:44:30.286456 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-0e492ae6-28c9-42fb-b5cd-6691b7fa5f24 tempest-VolumesBackupsTest-118275719 None] Backing up chunk of data from volume. {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 09:44:30.534349 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-0e492ae6-28c9-42fb-b5cd-6691b7fa5f24 tempest-VolumesBackupsTest-118275719 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101319) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 09:44:30.534508 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-0e492ae6-28c9-42fb-b5cd-6691b7fa5f24 tempest-VolumesBackupsTest-118275719 None] About to put_object {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 09:44:30.633754 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-0e492ae6-28c9-42fb-b5cd-6691b7fa5f24 tempest-VolumesBackupsTest-118275719 None] backup MD5 for volume_35ece5f1-68f7-4f83-93fb-31eab852a359/20260703094421/az_nova_backup_36c3a4f2-c782-418d-be49-db2bcf3421f7-00016: 25e317773f308e446cc84c503a6d1f85 {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 09:44:30.633996 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-0e492ae6-28c9-42fb-b5cd-6691b7fa5f24 tempest-VolumesBackupsTest-118275719 None] Calling eventlet.sleep(0) {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 09:44:30.839663 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-0e492ae6-28c9-42fb-b5cd-6691b7fa5f24 tempest-VolumesBackupsTest-118275719 None] Backing up chunk of data from volume. {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 09:44:31.090808 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-0e492ae6-28c9-42fb-b5cd-6691b7fa5f24 tempest-VolumesBackupsTest-118275719 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101319) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 09:44:31.091512 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-0e492ae6-28c9-42fb-b5cd-6691b7fa5f24 tempest-VolumesBackupsTest-118275719 None] About to put_object {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 09:44:31.192375 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-0e492ae6-28c9-42fb-b5cd-6691b7fa5f24 tempest-VolumesBackupsTest-118275719 None] backup MD5 for volume_35ece5f1-68f7-4f83-93fb-31eab852a359/20260703094421/az_nova_backup_36c3a4f2-c782-418d-be49-db2bcf3421f7-00017: 25e317773f308e446cc84c503a6d1f85 {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 09:44:31.192525 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-0e492ae6-28c9-42fb-b5cd-6691b7fa5f24 tempest-VolumesBackupsTest-118275719 None] Calling eventlet.sleep(0) {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 09:44:31.392617 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-0e492ae6-28c9-42fb-b5cd-6691b7fa5f24 tempest-VolumesBackupsTest-118275719 None] Backing up chunk of data from volume. {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 09:44:31.736866 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-0e492ae6-28c9-42fb-b5cd-6691b7fa5f24 tempest-VolumesBackupsTest-118275719 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101319) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 09:44:31.737103 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-0e492ae6-28c9-42fb-b5cd-6691b7fa5f24 tempest-VolumesBackupsTest-118275719 None] About to put_object {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 09:44:31.868722 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-0e492ae6-28c9-42fb-b5cd-6691b7fa5f24 tempest-VolumesBackupsTest-118275719 None] backup MD5 for volume_35ece5f1-68f7-4f83-93fb-31eab852a359/20260703094421/az_nova_backup_36c3a4f2-c782-418d-be49-db2bcf3421f7-00018: 25e317773f308e446cc84c503a6d1f85 {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 09:44:31.868837 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-0e492ae6-28c9-42fb-b5cd-6691b7fa5f24 tempest-VolumesBackupsTest-118275719 None] Calling eventlet.sleep(0) {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 09:44:32.072997 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-0e492ae6-28c9-42fb-b5cd-6691b7fa5f24 tempest-VolumesBackupsTest-118275719 None] Backing up chunk of data from volume. {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 09:44:32.324167 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-0e492ae6-28c9-42fb-b5cd-6691b7fa5f24 tempest-VolumesBackupsTest-118275719 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101319) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 09:44:32.324517 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-0e492ae6-28c9-42fb-b5cd-6691b7fa5f24 tempest-VolumesBackupsTest-118275719 None] About to put_object {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 09:44:32.430886 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-0e492ae6-28c9-42fb-b5cd-6691b7fa5f24 tempest-VolumesBackupsTest-118275719 None] backup MD5 for volume_35ece5f1-68f7-4f83-93fb-31eab852a359/20260703094421/az_nova_backup_36c3a4f2-c782-418d-be49-db2bcf3421f7-00019: 25e317773f308e446cc84c503a6d1f85 {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 09:44:32.431006 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-0e492ae6-28c9-42fb-b5cd-6691b7fa5f24 tempest-VolumesBackupsTest-118275719 None] Calling eventlet.sleep(0) {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 09:44:32.665092 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-0e492ae6-28c9-42fb-b5cd-6691b7fa5f24 tempest-VolumesBackupsTest-118275719 None] Backing up chunk of data from volume. {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 09:44:32.908729 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-0e492ae6-28c9-42fb-b5cd-6691b7fa5f24 tempest-VolumesBackupsTest-118275719 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101319) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 09:44:32.908928 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-0e492ae6-28c9-42fb-b5cd-6691b7fa5f24 tempest-VolumesBackupsTest-118275719 None] About to put_object {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 09:44:33.020851 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-0e492ae6-28c9-42fb-b5cd-6691b7fa5f24 tempest-VolumesBackupsTest-118275719 None] backup MD5 for volume_35ece5f1-68f7-4f83-93fb-31eab852a359/20260703094421/az_nova_backup_36c3a4f2-c782-418d-be49-db2bcf3421f7-00020: 25e317773f308e446cc84c503a6d1f85 {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 09:44:33.021009 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-0e492ae6-28c9-42fb-b5cd-6691b7fa5f24 tempest-VolumesBackupsTest-118275719 None] Calling eventlet.sleep(0) {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 09:44:33.138342 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-0e492ae6-28c9-42fb-b5cd-6691b7fa5f24 tempest-VolumesBackupsTest-118275719 None] Backing up chunk of data from volume. {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 09:44:33.278134 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-0e492ae6-28c9-42fb-b5cd-6691b7fa5f24 tempest-VolumesBackupsTest-118275719 None] Compressed 25165824 bytes of data to 24470 bytes using zlib. {{(pid=101319) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 09:44:33.278282 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-0e492ae6-28c9-42fb-b5cd-6691b7fa5f24 tempest-VolumesBackupsTest-118275719 None] About to put_object {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 09:44:33.343838 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-0e492ae6-28c9-42fb-b5cd-6691b7fa5f24 tempest-VolumesBackupsTest-118275719 None] backup MD5 for volume_35ece5f1-68f7-4f83-93fb-31eab852a359/20260703094421/az_nova_backup_36c3a4f2-c782-418d-be49-db2bcf3421f7-00021: 77377273b0a4b61febdbf7bbf52b9db9 {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 09:44:33.344307 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-0e492ae6-28c9-42fb-b5cd-6691b7fa5f24 tempest-VolumesBackupsTest-118275719 None] Calling eventlet.sleep(0) {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 09:44:33.350753 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.driver [None req-0e492ae6-28c9-42fb-b5cd-6691b7fa5f24 tempest-VolumesBackupsTest-118275719 None] Getting metadata type 'volume-base-metadata' {{(pid=101319) _save_vol_base_meta /opt/stack/cinder/cinder/backup/driver.py:79}} Jul 03 09:44:33.357947 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.driver [None req-0e492ae6-28c9-42fb-b5cd-6691b7fa5f24 tempest-VolumesBackupsTest-118275719 None] Completed fetching metadata type 'volume-base-metadata' {{(pid=101319) _save_vol_base_meta /opt/stack/cinder/cinder/backup/driver.py:98}} Jul 03 09:44:33.358154 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.driver [None req-0e492ae6-28c9-42fb-b5cd-6691b7fa5f24 tempest-VolumesBackupsTest-118275719 None] Getting metadata type 'volume-metadata' {{(pid=101319) _save_vol_meta /opt/stack/cinder/cinder/backup/driver.py:109}} Jul 03 09:44:33.363522 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.driver [None req-0e492ae6-28c9-42fb-b5cd-6691b7fa5f24 tempest-VolumesBackupsTest-118275719 None] No metadata type 'volume-metadata' available {{(pid=101319) _save_vol_meta /opt/stack/cinder/cinder/backup/driver.py:123}} Jul 03 09:44:33.363723 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.driver [None req-0e492ae6-28c9-42fb-b5cd-6691b7fa5f24 tempest-VolumesBackupsTest-118275719 None] Getting metadata type 'volume-glance-metadata' {{(pid=101319) _save_vol_glance_meta /opt/stack/cinder/cinder/backup/driver.py:132}} Jul 03 09:44:33.368219 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.driver [None req-0e492ae6-28c9-42fb-b5cd-6691b7fa5f24 tempest-VolumesBackupsTest-118275719 None] No metadata type 'volume-glance-metadata' available {{(pid=101319) _save_vol_glance_meta /opt/stack/cinder/cinder/backup/driver.py:147}} Jul 03 09:44:33.368515 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-0e492ae6-28c9-42fb-b5cd-6691b7fa5f24 tempest-VolumesBackupsTest-118275719 None] _write_sha256file started, container name: volumebackups, sha256file filename: volume_35ece5f1-68f7-4f83-93fb-31eab852a359/20260703094421/az_nova_backup_36c3a4f2-c782-418d-be49-db2bcf3421f7_sha256file. {{(pid=101319) _write_sha256file /opt/stack/cinder/cinder/backup/chunkeddriver.py:299}} Jul 03 09:44:33.438708 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-0e492ae6-28c9-42fb-b5cd-6691b7fa5f24 tempest-VolumesBackupsTest-118275719 None] _write_sha256file finished. {{(pid=101319) _write_sha256file /opt/stack/cinder/cinder/backup/chunkeddriver.py:315}} Jul 03 09:44:33.439527 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-0e492ae6-28c9-42fb-b5cd-6691b7fa5f24 tempest-VolumesBackupsTest-118275719 None] _write_metadata started, container name: volumebackups, metadata filename: volume_35ece5f1-68f7-4f83-93fb-31eab852a359/20260703094421/az_nova_backup_36c3a4f2-c782-418d-be49-db2bcf3421f7_metadata. {{(pid=101319) _write_metadata /opt/stack/cinder/cinder/backup/chunkeddriver.py:276}} Jul 03 09:44:33.466906 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-0e492ae6-28c9-42fb-b5cd-6691b7fa5f24 tempest-VolumesBackupsTest-118275719 None] _write_metadata finished. Metadata: b'{\n "backup_description": null,\n "backup_id": "36c3a4f2-c782-418d-be49-db2bcf3421f7",\n "backup_name": "tempest-VolumesBackupsTest-Backup-717113228",\n "created_at": "2026-07-03 09:44:18+00:00",\n "objects": [\n {\n "volume_35ece5f1-68f7-4f83-93fb-31eab852a359/20260703094421/az_nova_backup_36c3a4f2-c782-418d-be49-db2bcf3421f7-00001": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 0\n }\n },\n {\n "volume_35ece5f1-68f7-4f83-93fb-31eab852a359/20260703094421/az_nova_backup_36c3a4f2-c782-418d-be49-db2bcf3421f7-00002": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 52428800\n }\n },\n {\n "volume_35ece5f1-68f7-4f83-93fb-31eab852a359/20260703094421/az_nova_backup_36c3a4f2-c782-418d-be49-db2bcf3421f7-00003": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 104857600\n }\n },\n {\n "volume_35ece5f1-68f7-4f83-93fb-31eab852a359/20260703094421/az_nova_backup_36c3a4f2-c782-418d-be49-db2bcf3421f7-00004": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 157286400\n }\n },\n {\n "volume_35ece5f1-68f7-4f83-93fb-31eab852a359/20260703094421/az_nova_backup_36c3a4f2-c782-418d-be49-db2bcf3421f7-00005": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 209715200\n }\n },\n {\n "volume_35ece5f1-68f7-4f83-93fb-31eab852a359/20260703094421/az_nova_backup_36c3a4f2-c782-418d-be49-db2bcf3421f7-00006": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 262144000\n }\n },\n {\n "volume_35ece5f1-68f7-4f83-93fb-31eab852a359/20260703094421/az_nova_backup_36c3a4f2-c782-418d-be49-db2bcf3421f7-00007": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 314572800\n }\n },\n {\n "volume_35ece5f1-68f7-4f83-93fb-31eab852a359/20260703094421/az_nova_backup_36c3a4f2-c782-418d-be49-db2bcf3421f7-00008": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 367001600\n }\n },\n {\n "volume_35ece5f1-68f7-4f83-93fb-31eab852a359/20260703094421/az_nova_backup_36c3a4f2-c782-418d-be49-db2bcf3421f7-00009": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 419430400\n }\n },\n {\n "volume_35ece5f1-68f7-4f83-93fb-31eab852a359/20260703094421/az_nova_backup_36c3a4f2-c782-418d-be49-db2bcf3421f7-00010": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 471859200\n }\n },\n {\n "volume_35ece5f1-68f7-4f83-93fb-31eab852a359/20260703094421/az_nova_backup_36c3a4f2-c782-418d-be49-db2bcf3421f7-00011": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 524288000\n }\n },\n {\n "volume_35ece5f1-68f7-4f83-93fb-31eab852a359/20260703094421/az_nova_backup_36c3a4f2-c782-418d-be49-db2bcf3421f7-00012": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 576716800\n }\n },\n {\n "volume_35ece5f1-68f7-4f83-93fb-31eab852a359/20260703094421/az_nova_backup_36c3a4f2-c782-418d-be49-db2bcf3421f7-00013": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 629145600\n }\n },\n {\n "volume_35ece5f1-68f7-4f83-93fb-31eab852a359/20260703094421/az_nova_backup_36c3a4f2-c782-418d-be49-db2bcf3421f7-00014": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 681574400\n }\n },\n {\n "volume_35ece5f1-68f7-4f83-93fb-31eab852a359/20260703094421/az_nova_backup_36c3a4f2-c782-418d-be49-db2bcf3421f7-00015": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 734003200\n }\n },\n {\n "volume_35ece5f1-68f7-4f83-93fb-31eab852a359/20260703094421/az_nova_backup_36c3a4f2-c782-418d-be49-db2bcf3421f7-00016": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 786432000\n }\n },\n {\n "volume_35ece5f1-68f7-4f83-93fb-31eab852a359/20260703094421/az_nova_backup_36c3a4f2-c782-418d-be49-db2bcf3421f7-00017": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 838860800\n }\n },\n {\n "volume_35ece5f1-68f7-4f83-93fb-31eab852a359/20260703094421/az_nova_backup_36c3a4f2-c782-418d-be49-db2bcf3421f7-00018": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 891289600\n }\n },\n {\n "volume_35ece5f1-68f7-4f83-93fb-31eab852a359/20260703094421/az_nova_backup_36c3a4f2-c782-418d-be49-db2bcf3421f7-00019": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 943718400\n }\n },\n {\n "volume_35ece5f1-68f7-4f83-93fb-31eab852a359/20260703094421/az_nova_backup_36c3a4f2-c782-418d-be49-db2bcf3421f7-00020": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 996147200\n }\n },\n {\n "volume_35ece5f1-68f7-4f83-93fb-31eab852a359/20260703094421/az_nova_backup_36c3a4f2-c782-418d-be49-db2bcf3421f7-00021": {\n "compression": "zlib",\n "length": 25165824,\n "md5": "77377273b0a4b61febdbf7bbf52b9db9",\n "offset": 1048576000\n }\n }\n ],\n "parent_id": null,\n "version": "1.0.0",\n "volume_id": "35ece5f1-68f7-4f83-93fb-31eab852a359",\n "volume_meta": "{\\"version\\": 2, \\"volume-base-metadata\\": {\\"id\\": \\"35ece5f1-68f7-4f83-93fb-31eab852a359\\", \\"_name_id\\": null, \\"use_quota\\": true, \\"ec2_id\\": null, \\"user_id\\": \\"b861df2a13684334b293b1f348152e37\\", \\"project_id\\": \\"a484ec9218bf417bb9d7575ae6370646\\", \\"snapshot_id\\": null, \\"cluster_name\\": null, \\"host\\": \\"np0000004400@storpool#default\\", \\"size\\": 1, \\"availability_zone\\": \\"nova\\", \\"status\\": \\"backing-up\\", \\"attach_status\\": \\"detached\\", \\"migration_status\\": null, \\"scheduled_at\\": \\"2026-07-03T09:44:17.000000\\", \\"launched_at\\": \\"2026-07-03T09:44:17.000000\\", \\"terminated_at\\": null, \\"display_name\\": \\"tempest-VolumesBackupsTest-Volume-1897405656\\", \\"display_description\\": null, \\"provider_location\\": null, \\"provider_auth\\": null, \\"provider_geometry\\": null, \\"provider_id\\": null, \\"volume_type_id\\": \\"03e13fe6-0e30-4803-ace0-725d38e6dc24\\", \\"source_volid\\": null, \\"encryption_key_id\\": null, \\"consistencygroup_id\\": null, \\"group_id\\": null, \\"bootable\\": false, \\"multiattach\\": false, \\"replication_status\\": null, \\"replication_extended_status\\": null, \\"replication_driver_data\\": null, \\"previous_status\\": \\"available\\", \\"service_uuid\\": \\"6d4b0e79-fefe-4744-b25f-34be05095200\\", \\"shared_targets\\": true, \\"deleted_at\\": null, \\"deleted\\": false, \\"created_at\\": \\"2026-07-03T09:44:17.000000\\", \\"updated_at\\": \\"2026-07-03T09:44:18.000000\\"}}"\n}'. {{(pid=101319) _write_metadata /opt/stack/cinder/cinder/backup/chunkeddriver.py:295}} Jul 03 09:44:33.473337 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-0e492ae6-28c9-42fb-b5cd-6691b7fa5f24 tempest-VolumesBackupsTest-118275719 None] backup 36c3a4f2-c782-418d-be49-db2bcf3421f7 finished. {{(pid=101319) _finalize_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:462}} Jul 03 09:44:33.603542 np0000004400 cinder-backup[101319]: DEBUG oslo_concurrency.processutils [None req-0e492ae6-28c9-42fb-b5cd-6691b7fa5f24 tempest-VolumesBackupsTest-118275719 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chown 0 /dev/sdm {{(pid=101319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 09:44:33.624330 np0000004400 sudo[134412]: stack : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chown 0 /dev/sdm Jul 03 09:44:33.625179 np0000004400 sudo[134412]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1002) Jul 03 09:44:33.934434 np0000004400 sudo[134412]: pam_unix(sudo:session): session closed for user root Jul 03 09:44:33.936805 np0000004400 cinder-backup[101319]: DEBUG oslo_concurrency.processutils [None req-0e492ae6-28c9-42fb-b5cd-6691b7fa5f24 tempest-VolumesBackupsTest-118275719 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chown 0 /dev/sdm" returned: 0 in 0.333s {{(pid=101319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 09:44:33.937701 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e492ae6-28c9-42fb-b5cd-6691b7fa5f24 tempest-VolumesBackupsTest-118275719 None] ==> disconnect_volume: call "{'args': (, {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-35ece5f1-68f7-4f83-93fb-31eab852a359', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '35ece5f1-68f7-4f83-93fb-31eab852a359', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': False}, {'type': 'block', 'scsi_wwn': 'SStorPool_iSCSI_DISK_1034578903445799010', 'path': '/dev/sdm'}), 'kwargs': {'force': True, 'ignore_errors': True}}" {{(pid=101319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}} Jul 03 09:44:33.937991 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.base [None req-0e492ae6-28c9-42fb-b5cd-6691b7fa5f24 tempest-VolumesBackupsTest-118275719 None] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=101319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jul 03 09:44:33.938684 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.base [None req-0e492ae6-28c9-42fb-b5cd-6691b7fa5f24 tempest-VolumesBackupsTest-118275719 None] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=101319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jul 03 09:44:33.939254 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e492ae6-28c9-42fb-b5cd-6691b7fa5f24 tempest-VolumesBackupsTest-118275719 None] _get_connection_devices called with parameters: connection_properties={'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-35ece5f1-68f7-4f83-93fb-31eab852a359', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '35ece5f1-68f7-4f83-93fb-31eab852a359', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': False}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=101319) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:847}} Jul 03 09:44:33.951083 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e492ae6-28c9-42fb-b5cd-6691b7fa5f24 tempest-VolumesBackupsTest-118275719 None] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS: Jul 03 09:44:33.951083 np0000004400 cinder-backup[101319]: No targets found. Jul 03 09:44:33.951083 np0000004400 cinder-backup[101319]: iSNS: Jul 03 09:44:33.951083 np0000004400 cinder-backup[101319]: No targets found. Jul 03 09:44:33.951083 np0000004400 cinder-backup[101319]: STATIC: Jul 03 09:44:33.951083 np0000004400 cinder-backup[101319]: Target: iqn.2023-03.storpool.com:os--volume-aecd73f6-86c7-4ae8-8bfa-b46655eb6efb Jul 03 09:44:33.951083 np0000004400 cinder-backup[101319]: Portal: 192.168.50.100:3260,-1 Jul 03 09:44:33.951083 np0000004400 cinder-backup[101319]: Iface Name: default Jul 03 09:44:33.951083 np0000004400 cinder-backup[101319]: Portal: 192.168.40.100:3260,-1 Jul 03 09:44:33.951083 np0000004400 cinder-backup[101319]: Iface Name: default Jul 03 09:44:33.951083 np0000004400 cinder-backup[101319]: Target: iqn.2023-03.storpool.com:os--volume-12c3303b-9d75-4de7-bffd-31f22f904503 Jul 03 09:44:33.951083 np0000004400 cinder-backup[101319]: Portal: 192.168.50.100:3260,-1 Jul 03 09:44:33.951083 np0000004400 cinder-backup[101319]: Iface Name: default Jul 03 09:44:33.951083 np0000004400 cinder-backup[101319]: Portal: 192.168.40.100:3260,-1 Jul 03 09:44:33.951083 np0000004400 cinder-backup[101319]: Iface Name: default Jul 03 09:44:33.951083 np0000004400 cinder-backup[101319]: Target: iqn.2023-03.storpool.com:os--volume-76320525-737e-4f58-8523-63ec9abbdc64 Jul 03 09:44:33.951083 np0000004400 cinder-backup[101319]: Portal: 192.168.50.100:3260,-1 Jul 03 09:44:33.951083 np0000004400 cinder-backup[101319]: Iface Name: default Jul 03 09:44:33.951083 np0000004400 cinder-backup[101319]: Portal: 192.168.40.100:3260,-1 Jul 03 09:44:33.951083 np0000004400 cinder-backup[101319]: Iface Name: default Jul 03 09:44:33.951083 np0000004400 cinder-backup[101319]: Target: iqn.2023-03.storpool.com:os--volume-b2e4f10c-8033-4c54-95a1-dfe45d6357a3 Jul 03 09:44:33.951083 np0000004400 cinder-backup[101319]: Portal: 192.168.50.100:3260,-1 Jul 03 09:44:33.951083 np0000004400 cinder-backup[101319]: Iface Name: default Jul 03 09:44:33.951083 np0000004400 cinder-backup[101319]: Portal: 192.168.40.100:3260,-1 Jul 03 09:44:33.951083 np0000004400 cinder-backup[101319]: Iface Name: default Jul 03 09:44:33.951083 np0000004400 cinder-backup[101319]: Target: iqn.2023-03.storpool.com:os--volume-e9e3f386-d923-4ae1-a6ce-8dd2091673ac Jul 03 09:44:33.951083 np0000004400 cinder-backup[101319]: Portal: 192.168.50.100:3260,-1 Jul 03 09:44:33.951083 np0000004400 cinder-backup[101319]: Iface Name: default Jul 03 09:44:33.951083 np0000004400 cinder-backup[101319]: Portal: 192.168.40.100:3260,-1 Jul 03 09:44:33.951083 np0000004400 cinder-backup[101319]: Iface Name: default Jul 03 09:44:33.951083 np0000004400 cinder-backup[101319]: Target: iqn.2023-03.storpool.com:os--volume-35ece5f1-68f7-4f83-93fb-31eab852a359 Jul 03 09:44:33.951083 np0000004400 cinder-backup[101319]: Portal: 192.168.40.100:3260,-1 Jul 03 09:44:33.951083 np0000004400 cinder-backup[101319]: Iface Name: default Jul 03 09:44:33.951083 np0000004400 cinder-backup[101319]: Target: iqn.2023-03.storpool.com:os--volume-dc2d662f-bc12-4338-8e3d-6565f72ba808 Jul 03 09:44:33.951083 np0000004400 cinder-backup[101319]: Portal: 192.168.50.100:3260,-1 Jul 03 09:44:33.951083 np0000004400 cinder-backup[101319]: Iface Name: default Jul 03 09:44:33.951083 np0000004400 cinder-backup[101319]: Portal: 192.168.40.100:3260,-1 Jul 03 09:44:33.951083 np0000004400 cinder-backup[101319]: Iface Name: default Jul 03 09:44:33.951083 np0000004400 cinder-backup[101319]: FIRMWARE: Jul 03 09:44:33.951083 np0000004400 cinder-backup[101319]: No targets found. Jul 03 09:44:33.951083 np0000004400 cinder-backup[101319]: stderr= {{(pid=101319) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jul 03 09:44:33.951857 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e492ae6-28c9-42fb-b5cd-6691b7fa5f24 tempest-VolumesBackupsTest-118275719 None] Regex to get portals from discoverydb: ^SENDTARGETS: Jul 03 09:44:33.951857 np0000004400 cinder-backup[101319]: .*?^DiscoveryAddress: 192.168.40.100,3260.*? Jul 03 09:44:33.951857 np0000004400 cinder-backup[101319]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=101319) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:390}} Jul 03 09:44:33.951857 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e492ae6-28c9-42fb-b5cd-6691b7fa5f24 tempest-VolumesBackupsTest-118275719 None] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-35ece5f1-68f7-4f83-93fb-31eab852a359', 0)] {{(pid=101319) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:858}} Jul 03 09:44:33.979185 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e492ae6-28c9-42fb-b5cd-6691b7fa5f24 tempest-VolumesBackupsTest-118275719 None] iscsiadm ('-m', 'session'): stdout=tcp: [49] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b2e4f10c-8033-4c54-95a1-dfe45d6357a3 (non-flash) Jul 03 09:44:33.979185 np0000004400 cinder-backup[101319]: tcp: [50] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b2e4f10c-8033-4c54-95a1-dfe45d6357a3 (non-flash) Jul 03 09:44:33.979185 np0000004400 cinder-backup[101319]: tcp: [72] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e9e3f386-d923-4ae1-a6ce-8dd2091673ac (non-flash) Jul 03 09:44:33.979185 np0000004400 cinder-backup[101319]: tcp: [73] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e9e3f386-d923-4ae1-a6ce-8dd2091673ac (non-flash) Jul 03 09:44:33.979185 np0000004400 cinder-backup[101319]: tcp: [82] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-76320525-737e-4f58-8523-63ec9abbdc64 (non-flash) Jul 03 09:44:33.979185 np0000004400 cinder-backup[101319]: tcp: [83] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-76320525-737e-4f58-8523-63ec9abbdc64 (non-flash) Jul 03 09:44:33.979185 np0000004400 cinder-backup[101319]: tcp: [84] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-12c3303b-9d75-4de7-bffd-31f22f904503 (non-flash) Jul 03 09:44:33.979185 np0000004400 cinder-backup[101319]: tcp: [85] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-12c3303b-9d75-4de7-bffd-31f22f904503 (non-flash) Jul 03 09:44:33.979185 np0000004400 cinder-backup[101319]: tcp: [87] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-dc2d662f-bc12-4338-8e3d-6565f72ba808 (non-flash) Jul 03 09:44:33.979185 np0000004400 cinder-backup[101319]: tcp: [88] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-dc2d662f-bc12-4338-8e3d-6565f72ba808 (non-flash) Jul 03 09:44:33.979185 np0000004400 cinder-backup[101319]: tcp: [89] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-35ece5f1-68f7-4f83-93fb-31eab852a359 (non-flash) Jul 03 09:44:33.979185 np0000004400 cinder-backup[101319]: tcp: [90] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-aecd73f6-86c7-4ae8-8bfa-b46655eb6efb (non-flash) Jul 03 09:44:33.979185 np0000004400 cinder-backup[101319]: tcp: [91] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-aecd73f6-86c7-4ae8-8bfa-b46655eb6efb (non-flash) Jul 03 09:44:33.979185 np0000004400 cinder-backup[101319]: stderr= {{(pid=101319) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jul 03 09:44:33.979763 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e492ae6-28c9-42fb-b5cd-6691b7fa5f24 tempest-VolumesBackupsTest-118275719 None] iscsi session list stdout=tcp: [49] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b2e4f10c-8033-4c54-95a1-dfe45d6357a3 (non-flash) Jul 03 09:44:33.979763 np0000004400 cinder-backup[101319]: tcp: [50] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b2e4f10c-8033-4c54-95a1-dfe45d6357a3 (non-flash) Jul 03 09:44:33.979763 np0000004400 cinder-backup[101319]: tcp: [72] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e9e3f386-d923-4ae1-a6ce-8dd2091673ac (non-flash) Jul 03 09:44:33.979763 np0000004400 cinder-backup[101319]: tcp: [73] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e9e3f386-d923-4ae1-a6ce-8dd2091673ac (non-flash) Jul 03 09:44:33.979763 np0000004400 cinder-backup[101319]: tcp: [82] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-76320525-737e-4f58-8523-63ec9abbdc64 (non-flash) Jul 03 09:44:33.979763 np0000004400 cinder-backup[101319]: tcp: [83] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-76320525-737e-4f58-8523-63ec9abbdc64 (non-flash) Jul 03 09:44:33.979763 np0000004400 cinder-backup[101319]: tcp: [84] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-12c3303b-9d75-4de7-bffd-31f22f904503 (non-flash) Jul 03 09:44:33.979763 np0000004400 cinder-backup[101319]: tcp: [85] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-12c3303b-9d75-4de7-bffd-31f22f904503 (non-flash) Jul 03 09:44:33.979763 np0000004400 cinder-backup[101319]: tcp: [87] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-dc2d662f-bc12-4338-8e3d-6565f72ba808 (non-flash) Jul 03 09:44:33.979763 np0000004400 cinder-backup[101319]: tcp: [88] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-dc2d662f-bc12-4338-8e3d-6565f72ba808 (non-flash) Jul 03 09:44:33.979763 np0000004400 cinder-backup[101319]: tcp: [89] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-35ece5f1-68f7-4f83-93fb-31eab852a359 (non-flash) Jul 03 09:44:33.979763 np0000004400 cinder-backup[101319]: tcp: [90] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-aecd73f6-86c7-4ae8-8bfa-b46655eb6efb (non-flash) Jul 03 09:44:33.979763 np0000004400 cinder-backup[101319]: tcp: [91] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-aecd73f6-86c7-4ae8-8bfa-b46655eb6efb (non-flash) Jul 03 09:44:33.979763 np0000004400 cinder-backup[101319]: stderr= {{(pid=101319) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jul 03 09:44:33.979763 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e492ae6-28c9-42fb-b5cd-6691b7fa5f24 tempest-VolumesBackupsTest-118275719 None] Sessions list: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-b2e4f10c-8033-4c54-95a1-dfe45d6357a3', '49'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-b2e4f10c-8033-4c54-95a1-dfe45d6357a3', '50'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-e9e3f386-d923-4ae1-a6ce-8dd2091673ac', '72'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-e9e3f386-d923-4ae1-a6ce-8dd2091673ac', '73'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-76320525-737e-4f58-8523-63ec9abbdc64', '82'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-76320525-737e-4f58-8523-63ec9abbdc64', '83'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-12c3303b-9d75-4de7-bffd-31f22f904503', '84'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-12c3303b-9d75-4de7-bffd-31f22f904503', '85'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-dc2d662f-bc12-4338-8e3d-6565f72ba808', '87'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-dc2d662f-bc12-4338-8e3d-6565f72ba808', '88'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-35ece5f1-68f7-4f83-93fb-31eab852a359', '89'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-aecd73f6-86c7-4ae8-8bfa-b46655eb6efb', '90'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-aecd73f6-86c7-4ae8-8bfa-b46655eb6efb', '91')] {{(pid=101319) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:866}} Jul 03 09:44:33.980237 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e492ae6-28c9-42fb-b5cd-6691b7fa5f24 tempest-VolumesBackupsTest-118275719 None] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-35ece5f1-68f7-4f83-93fb-31eab852a359, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-35ece5f1-68f7-4f83-93fb-31eab852a359', '89')] {{(pid=101319) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}} Jul 03 09:44:33.981607 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e492ae6-28c9-42fb-b5cd-6691b7fa5f24 tempest-VolumesBackupsTest-118275719 None] Resulting device map defaultdict(. at 0x7e76e71f3920>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-35ece5f1-68f7-4f83-93fb-31eab852a359'): ({'sdm'}, set())}) {{(pid=101319) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:912}} Jul 03 09:44:33.981933 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.linuxscsi [None req-0e492ae6-28c9-42fb-b5cd-6691b7fa5f24 tempest-VolumesBackupsTest-118275719 None] Removing single pathed devices sdm {{(pid=101319) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}} Jul 03 09:44:33.992961 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.linuxscsi [None req-0e492ae6-28c9-42fb-b5cd-6691b7fa5f24 tempest-VolumesBackupsTest-118275719 None] Flushing IO for device /dev/sdm {{(pid=101319) flush_device_io /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:461}} Jul 03 09:44:34.000462 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.linuxscsi [None req-0e492ae6-28c9-42fb-b5cd-6691b7fa5f24 tempest-VolumesBackupsTest-118275719 None] Remove SCSI device /dev/sdm with /sys/block/sdm/device/delete {{(pid=101319) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}} Jul 03 09:44:34.048760 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.linuxscsi [None req-0e492ae6-28c9-42fb-b5cd-6691b7fa5f24 tempest-VolumesBackupsTest-118275719 None] Checking to see if SCSI volumes sdm have been removed. {{(pid=101319) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}} Jul 03 09:44:34.048914 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.linuxscsi [None req-0e492ae6-28c9-42fb-b5cd-6691b7fa5f24 tempest-VolumesBackupsTest-118275719 None] SCSI volumes sdm have been removed. {{(pid=101319) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}} Jul 03 09:44:34.050304 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.linuxscsi [None req-0e492ae6-28c9-42fb-b5cd-6691b7fa5f24 tempest-VolumesBackupsTest-118275719 None] Checking to see if device paths {'sdm'} are still under multipathd monitoring {{(pid=101319) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}} Jul 03 09:44:34.059111 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.linuxscsi [None req-0e492ae6-28c9-42fb-b5cd-6691b7fa5f24 tempest-VolumesBackupsTest-118275719 None] Device paths {'sdm'} have been removed from multipathd monitoring. {{(pid=101319) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}} Jul 03 09:44:34.059321 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e492ae6-28c9-42fb-b5cd-6691b7fa5f24 tempest-VolumesBackupsTest-118275719 None] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-35ece5f1-68f7-4f83-93fb-31eab852a359')] {{(pid=101319) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1225}} Jul 03 09:44:34.068591 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e492ae6-28c9-42fb-b5cd-6691b7fa5f24 tempest-VolumesBackupsTest-118275719 None] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=101319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 03 09:44:34.108079 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e492ae6-28c9-42fb-b5cd-6691b7fa5f24 tempest-VolumesBackupsTest-118275719 None] iscsiadm ('--logout',): stdout=Logging out of session [sid: 89, target: iqn.2023-03.storpool.com:os--volume-35ece5f1-68f7-4f83-93fb-31eab852a359, portal: 192.168.40.100,3260] Jul 03 09:44:34.108079 np0000004400 cinder-backup[101319]: Logout of [sid: 89, target: iqn.2023-03.storpool.com:os--volume-35ece5f1-68f7-4f83-93fb-31eab852a359, portal: 192.168.40.100,3260] successful. Jul 03 09:44:34.108079 np0000004400 cinder-backup[101319]: stderr= {{(pid=101319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 03 09:44:34.130823 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e492ae6-28c9-42fb-b5cd-6691b7fa5f24 tempest-VolumesBackupsTest-118275719 None] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=101319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 03 09:44:34.131050 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.base [None req-0e492ae6-28c9-42fb-b5cd-6691b7fa5f24 tempest-VolumesBackupsTest-118275719 None] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.192s {{(pid=101319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jul 03 09:44:34.131175 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e492ae6-28c9-42fb-b5cd-6691b7fa5f24 tempest-VolumesBackupsTest-118275719 None] <== disconnect_volume: return (193ms) None {{(pid=101319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}} Jul 03 09:44:35.152278 np0000004400 cinder-backup[101319]: INFO cinder.backup.manager [None req-0e492ae6-28c9-42fb-b5cd-6691b7fa5f24 tempest-VolumesBackupsTest-118275719 None] Create backup finished. backup: 36c3a4f2-c782-418d-be49-db2bcf3421f7. Jul 03 09:44:35.836552 np0000004400 cinder-backup[101319]: INFO cinder.backup.manager [None req-d05ff3d6-4b83-4db0-8816-e91017864e60 tempest-VolumesBackupsTest-118275719 None] Restore backup started, backup: 36c3a4f2-c782-418d-be49-db2bcf3421f7 volume: 35ece5f1-68f7-4f83-93fb-31eab852a359. Jul 03 09:44:35.848943 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.drivers.swift [None req-d05ff3d6-4b83-4db0-8816-e91017864e60 tempest-VolumesBackupsTest-118275719 None] Using swift URL https://10.4.3.95:8080/v1/AUTH_a484ec9218bf417bb9d7575ae6370646 {{(pid=101319) initialize /opt/stack/cinder/cinder/backup/drivers/swift.py:300}} Jul 03 09:44:35.849120 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.drivers.swift [None req-d05ff3d6-4b83-4db0-8816-e91017864e60 tempest-VolumesBackupsTest-118275719 None] Connect to https://10.4.3.95:8080/v1/AUTH_ in "per_user" mode {{(pid=101319) initialize /opt/stack/cinder/cinder/backup/drivers/swift.py:301}} Jul 03 09:44:35.849359 np0000004400 cinder-backup[101319]: DEBUG os_brick.utils [None req-d05ff3d6-4b83-4db0-8816-e91017864e60 tempest-VolumesBackupsTest-118275719 None] ==> get_connector_properties: call "{'root_helper': 'sudo cinder-rootwrap /etc/cinder/rootwrap.conf', 'my_ip': '10.4.3.95', 'multipath': False, 'enforce_multipath': False, 'host': None, 'execute': None}" {{(pid=101319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}} Jul 03 09:44:35.860022 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.scaleio [None req-d05ff3d6-4b83-4db0-8816-e91017864e60 tempest-VolumesBackupsTest-118275719 None] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=101319) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}} Jul 03 09:44:35.880698 np0000004400 cinder-backup[101319]: DEBUG oslo_concurrency.processutils [None req-d05ff3d6-4b83-4db0-8816-e91017864e60 tempest-VolumesBackupsTest-118275719 None] Running cmd (subprocess): nvme version {{(pid=101319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 09:44:35.892036 np0000004400 cinder-backup[101319]: DEBUG oslo_concurrency.processutils [None req-d05ff3d6-4b83-4db0-8816-e91017864e60 tempest-VolumesBackupsTest-118275719 None] 'nvme version' failed. Not Retrying. {{(pid=101319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 03 09:44:35.892364 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.nvmeof [None req-d05ff3d6-4b83-4db0-8816-e91017864e60 tempest-VolumesBackupsTest-118275719 None] nvme not present on system {{(pid=101319) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}} Jul 03 09:44:35.901728 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.lightos [None req-d05ff3d6-4b83-4db0-8816-e91017864e60 tempest-VolumesBackupsTest-118275719 None] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=101319) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}} Jul 03 09:44:35.903518 np0000004400 cinder-backup[101319]: INFO os_brick.initiator.connectors.lightos [None req-d05ff3d6-4b83-4db0-8816-e91017864e60 tempest-VolumesBackupsTest-118275719 None] Current host hostNQN and IP(s) are ['10.4.3.95', 'fe80::f816:3eff:fe47:268c', '192.168.40.6', 'fe80::f816:3eff:febf:7be2', '192.168.50.6', 'fe80::f816:3eff:fe99:8914', '192.168.10.6', 'fe80::f816:3eff:fe2f:e696', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::bc9d:84ff:fec2:6b49', 'fe80::fc16:3eff:fe36:77bf', 'fe80::4c47:1ff:fe64:1879', 'fe80::fc16:3eff:fec6:c223', 'fe80::fc16:3eff:fef5:5e6e', 'fe80::94d0:62ff:fec5:3886', 'fe80::fc16:3eff:fe48:c24e', 'fe80::fc16:3eff:fea8:bf8b', 'fe80::fc16:3eff:fe42:afa1', 'fe80::fc16:3eff:fea0:4147', 'fe80::b0cf:48ff:fe29:caf0', 'fe80::fc16:3eff:fee8:8754', 'fe80::f4df:54ff:fe23:9c09', 'fe80::fc16:3eff:fedf:37a6', 'fe80::fc16:3eff:feec:2e14', 'fe80::a1:38ff:fe3d:434b', 'fe80::fc16:3eff:fe63:d9db'] Jul 03 09:44:35.903696 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.lightos [None req-d05ff3d6-4b83-4db0-8816-e91017864e60 tempest-VolumesBackupsTest-118275719 None] LIGHTOS: did not find dsc, continuing anyway. {{(pid=101319) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}} Jul 03 09:44:35.903847 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.lightos [None req-d05ff3d6-4b83-4db0-8816-e91017864e60 tempest-VolumesBackupsTest-118275719 None] LIGHTOS: no hostnqn found. {{(pid=101319) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}} Jul 03 09:44:35.904090 np0000004400 cinder-backup[101319]: DEBUG os_brick.utils [None req-d05ff3d6-4b83-4db0-8816-e91017864e60 tempest-VolumesBackupsTest-118275719 None] <== get_connector_properties: return (54ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.95', 'host': 'np0000004400', 'multipath': False, 'enforce_multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:ae7e5bb0ebe6', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': '6b284368-d0ba-4d18-af6f-4998d3955c52', 'nvme_native_multipath': False} {{(pid=101319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}} Jul 03 09:44:36.914135 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connector [None req-d05ff3d6-4b83-4db0-8816-e91017864e60 tempest-VolumesBackupsTest-118275719 None] Factory for iscsi on None {{(pid=101319) factory /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connector.py:243}} Jul 03 09:44:36.914602 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-d05ff3d6-4b83-4db0-8816-e91017864e60 tempest-VolumesBackupsTest-118275719 None] ==> connect_volume: call "{'self': , 'connection_properties': {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-35ece5f1-68f7-4f83-93fb-31eab852a359', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '35ece5f1-68f7-4f83-93fb-31eab852a359', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': False}}" {{(pid=101319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}} Jul 03 09:44:36.914823 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.base [None req-d05ff3d6-4b83-4db0-8816-e91017864e60 tempest-VolumesBackupsTest-118275719 None] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=101319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jul 03 09:44:36.915355 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.base [None req-d05ff3d6-4b83-4db0-8816-e91017864e60 tempest-VolumesBackupsTest-118275719 None] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=101319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jul 03 09:44:36.915601 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.base [None req-d05ff3d6-4b83-4db0-8816-e91017864e60 tempest-VolumesBackupsTest-118275719 None] Connection properties {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-35ece5f1-68f7-4f83-93fb-31eab852a359', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '35ece5f1-68f7-4f83-93fb-31eab852a359', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': False} {{(pid=101319) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}} Jul 03 09:44:36.926391 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.base [None req-d05ff3d6-4b83-4db0-8816-e91017864e60 tempest-VolumesBackupsTest-118275719 None] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-35ece5f1-68f7-4f83-93fb-31eab852a359" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=101319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jul 03 09:44:36.926391 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.base [None req-d05ff3d6-4b83-4db0-8816-e91017864e60 tempest-VolumesBackupsTest-118275719 None] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-35ece5f1-68f7-4f83-93fb-31eab852a359" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.000s {{(pid=101319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jul 03 09:44:36.926391 np0000004400 cinder-backup[101319]: INFO os_brick.initiator.connectors.iscsi [None req-d05ff3d6-4b83-4db0-8816-e91017864e60 tempest-VolumesBackupsTest-118275719 None] Trying to connect to iSCSI portal 192.168.40.100:3260 Jul 03 09:44:36.936534 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-d05ff3d6-4b83-4db0-8816-e91017864e60 tempest-VolumesBackupsTest-118275719 None] iscsiadm (): stdout= stderr=iscsiadm: No records found Jul 03 09:44:36.936534 np0000004400 cinder-backup[101319]: {{(pid=101319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 03 09:44:36.946158 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-d05ff3d6-4b83-4db0-8816-e91017864e60 tempest-VolumesBackupsTest-118275719 None] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-35ece5f1-68f7-4f83-93fb-31eab852a359] added Jul 03 09:44:36.946158 np0000004400 cinder-backup[101319]: stderr=iscsiadm: Config file line 363 does not have value Jul 03 09:44:36.946158 np0000004400 cinder-backup[101319]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs' Jul 03 09:44:36.946158 np0000004400 cinder-backup[101319]: iscsiadm: Config file line 363 does not have value Jul 03 09:44:36.946158 np0000004400 cinder-backup[101319]: iscsiadm: Config file line 363 does not have value Jul 03 09:44:36.946158 np0000004400 cinder-backup[101319]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs' Jul 03 09:44:36.946158 np0000004400 cinder-backup[101319]: {{(pid=101319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 03 09:44:36.946364 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-d05ff3d6-4b83-4db0-8816-e91017864e60 tempest-VolumesBackupsTest-118275719 None] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=101319) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}} Jul 03 09:44:36.946890 np0000004400 cinder-backup[101319]: DEBUG os_brick.utils [None req-d05ff3d6-4b83-4db0-8816-e91017864e60 tempest-VolumesBackupsTest-118275719 None] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0209(s), this was the 1st time calling it. {{(pid=101319) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}} Jul 03 09:44:36.947024 np0000004400 cinder-backup[101319]: DEBUG os_brick.utils [None req-d05ff3d6-4b83-4db0-8816-e91017864e60 tempest-VolumesBackupsTest-118275719 None] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=101319) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}} Jul 03 09:44:37.948237 np0000004400 cinder-backup[101319]: INFO os_brick.initiator.connectors.iscsi [None req-d05ff3d6-4b83-4db0-8816-e91017864e60 tempest-VolumesBackupsTest-118275719 None] Trying to connect to iSCSI portal 192.168.40.100:3260 Jul 03 09:44:37.958379 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-d05ff3d6-4b83-4db0-8816-e91017864e60 tempest-VolumesBackupsTest-118275719 None] iscsiadm (): stdout=# BEGIN RECORD 2.1.9 Jul 03 09:44:37.958379 np0000004400 cinder-backup[101319]: node.name = iqn.2023-03.storpool.com:os--volume-35ece5f1-68f7-4f83-93fb-31eab852a359 Jul 03 09:44:37.958379 np0000004400 cinder-backup[101319]: node.tpgt = -1 Jul 03 09:44:37.958379 np0000004400 cinder-backup[101319]: node.startup = manual Jul 03 09:44:37.958379 np0000004400 cinder-backup[101319]: node.leading_login = No Jul 03 09:44:37.958379 np0000004400 cinder-backup[101319]: iface.iscsi_ifacename = default Jul 03 09:44:37.958379 np0000004400 cinder-backup[101319]: iface.net_ifacename = Jul 03 09:44:37.958379 np0000004400 cinder-backup[101319]: iface.ipaddress = Jul 03 09:44:37.958379 np0000004400 cinder-backup[101319]: iface.prefix_len = 0 Jul 03 09:44:37.958379 np0000004400 cinder-backup[101319]: iface.hwaddress = Jul 03 09:44:37.958379 np0000004400 cinder-backup[101319]: iface.transport_name = tcp Jul 03 09:44:37.958379 np0000004400 cinder-backup[101319]: iface.initiatorname = Jul 03 09:44:37.958379 np0000004400 cinder-backup[101319]: iface.state = Jul 03 09:44:37.958379 np0000004400 cinder-backup[101319]: iface.vlan_id = 0 Jul 03 09:44:37.958379 np0000004400 cinder-backup[101319]: iface.vlan_priority = 0 Jul 03 09:44:37.958379 np0000004400 cinder-backup[101319]: iface.vlan_state = Jul 03 09:44:37.958379 np0000004400 cinder-backup[101319]: iface.iface_num = 0 Jul 03 09:44:37.958379 np0000004400 cinder-backup[101319]: iface.mtu = 0 Jul 03 09:44:37.958379 np0000004400 cinder-backup[101319]: iface.port = 0 Jul 03 09:44:37.958379 np0000004400 cinder-backup[101319]: iface.bootproto = Jul 03 09:44:37.958379 np0000004400 cinder-backup[101319]: iface.subnet_mask = Jul 03 09:44:37.958379 np0000004400 cinder-backup[101319]: iface.gateway = Jul 03 09:44:37.958379 np0000004400 cinder-backup[101319]: iface.dhcp_alt_client_id_state = Jul 03 09:44:37.958379 np0000004400 cinder-backup[101319]: iface.dhcp_alt_client_id = Jul 03 09:44:37.958379 np0000004400 cinder-backup[101319]: iface.dhcp_dns = Jul 03 09:44:37.958379 np0000004400 cinder-backup[101319]: iface.dhcp_learn_iqn = Jul 03 09:44:37.958379 np0000004400 cinder-backup[101319]: iface.dhcp_req_vendor_id_state = Jul 03 09:44:37.958379 np0000004400 cinder-backup[101319]: iface.dhcp_vendor_id_state = Jul 03 09:44:37.958379 np0000004400 cinder-backup[101319]: iface.dhcp_vendor_id = Jul 03 09:44:37.958379 np0000004400 cinder-backup[101319]: iface.dhcp_slp_da = Jul 03 09:44:37.958379 np0000004400 cinder-backup[101319]: iface.fragmentation = Jul 03 09:44:37.958379 np0000004400 cinder-backup[101319]: iface.gratuitous_arp = Jul 03 09:44:37.958379 np0000004400 cinder-backup[101319]: iface.incoming_forwarding = Jul 03 09:44:37.958379 np0000004400 cinder-backup[101319]: iface.tos_state = Jul 03 09:44:37.958379 np0000004400 cinder-backup[101319]: iface.tos = 0 Jul 03 09:44:37.958379 np0000004400 cinder-backup[101319]: iface.ttl = 0 Jul 03 09:44:37.958379 np0000004400 cinder-backup[101319]: iface.delayed_ack = Jul 03 09:44:37.958379 np0000004400 cinder-backup[101319]: iface.tcp_nagle = Jul 03 09:44:37.958379 np0000004400 cinder-backup[101319]: iface.tcp_wsf_state = Jul 03 09:44:37.958379 np0000004400 cinder-backup[101319]: iface.tcp_wsf = 0 Jul 03 09:44:37.958379 np0000004400 cinder-backup[101319]: iface.tcp_timer_scale = 0 Jul 03 09:44:37.958379 np0000004400 cinder-backup[101319]: iface.tcp_timestamp = Jul 03 09:44:37.958379 np0000004400 cinder-backup[101319]: iface.redirect = Jul 03 09:44:37.958379 np0000004400 cinder-backup[101319]: iface.def_task_mgmt_timeout = 0 Jul 03 09:44:37.958379 np0000004400 cinder-backup[101319]: iface.header_digest = Jul 03 09:44:37.958379 np0000004400 cinder-backup[101319]: iface.data_digest = Jul 03 09:44:37.958379 np0000004400 cinder-backup[101319]: iface.immediate_data = Jul 03 09:44:37.958379 np0000004400 cinder-backup[101319]: iface.initial_r2t = Jul 03 09:44:37.958379 np0000004400 cinder-backup[101319]: iface.data_seq_inorder = Jul 03 09:44:37.958379 np0000004400 cinder-backup[101319]: iface.data_pdu_inorder = Jul 03 09:44:37.958379 np0000004400 cinder-backup[101319]: iface.erl = 0 Jul 03 09:44:37.958379 np0000004400 cinder-backup[101319]: iface.max_receive_data_len = 0 Jul 03 09:44:37.958379 np0000004400 cinder-backup[101319]: iface.first_burst_len = 0 Jul 03 09:44:37.958379 np0000004400 cinder-backup[101319]: iface.max_outstanding_r2t = 0 Jul 03 09:44:37.958379 np0000004400 cinder-backup[101319]: iface.max_burst_len = 0 Jul 03 09:44:37.958379 np0000004400 cinder-backup[101319]: iface.chap_auth = Jul 03 09:44:37.958379 np0000004400 cinder-backup[101319]: iface.bidi_chap = Jul 03 09:44:37.958379 np0000004400 cinder-backup[101319]: iface.strict_login_compliance = Jul 03 09:44:37.958379 np0000004400 cinder-backup[101319]: iface.discovery_auth = Jul 03 09:44:37.958379 np0000004400 cinder-backup[101319]: iface.discovery_logout = Jul 03 09:44:37.958379 np0000004400 cinder-backup[101319]: node.discovery_address = Jul 03 09:44:37.958379 np0000004400 cinder-backup[101319]: node.discovery_port = 0 Jul 03 09:44:37.958379 np0000004400 cinder-backup[101319]: node.discovery_type = fw Jul 03 09:44:37.958379 np0000004400 cinder-backup[101319]: node.session.initial_cmdsn = 0 Jul 03 09:44:37.958379 np0000004400 cinder-backup[101319]: node.session.initial_login_retry_max = 8 Jul 03 09:44:37.958379 np0000004400 cinder-backup[101319]: node.session.xmit_thread_priority = 0 Jul 03 09:44:37.958379 np0000004400 cinder-backup[101319]: node.session.cmds_max = 128 Jul 03 09:44:37.958379 np0000004400 cinder-backup[101319]: node.session.queue_depth = 32 Jul 03 09:44:37.958379 np0000004400 cinder-backup[101319]: node.session.nr_sessions = 1 Jul 03 09:44:37.958379 np0000004400 cinder-backup[101319]: node.session.auth.authmethod = None Jul 03 09:44:37.958379 np0000004400 cinder-backup[101319]: node.session.auth.username = Jul 03 09:44:37.958379 np0000004400 cinder-backup[101319]: node.session.auth.password = *** Jul 03 09:44:37.958379 np0000004400 cinder-backup[101319]: node.session.auth.username_in = Jul 03 09:44:37.958379 np0000004400 cinder-backup[101319]: node.session.auth.password_in = Jul 03 09:44:37.958379 np0000004400 cinder-backup[101319]: node.session.auth.chap_algs = SHA256 Jul 03 09:44:37.958379 np0000004400 cinder-backup[101319]: node.session.timeo.replacement_timeout = 120 Jul 03 09:44:37.958379 np0000004400 cinder-backup[101319]: node.session.err_timeo.abort_timeout = 15 Jul 03 09:44:37.958379 np0000004400 cinder-backup[101319]: node.session.err_timeo.lu_reset_timeout = 30 Jul 03 09:44:37.958379 np0000004400 cinder-backup[101319]: node.session.err_timeo.tgt_reset_timeout = 30 Jul 03 09:44:37.958379 np0000004400 cinder-backup[101319]: node.session.err_timeo.host_reset_timeout = 60 Jul 03 09:44:37.958379 np0000004400 cinder-backup[101319]: node.session.iscsi.FastAbort = Yes Jul 03 09:44:37.958379 np0000004400 cinder-backup[101319]: node.session.iscsi.InitialR2T = No Jul 03 09:44:37.958379 np0000004400 cinder-backup[101319]: node.session.iscsi.ImmediateData = Yes Jul 03 09:44:37.958379 np0000004400 cinder-backup[101319]: node.session.iscsi.FirstBurstLength = 262144 Jul 03 09:44:37.958379 np0000004400 cinder-backup[101319]: node.session.iscsi.MaxBurstLength = 16776192 Jul 03 09:44:37.958379 np0000004400 cinder-backup[101319]: node.session.iscsi.DefaultTime2Retain = 0 Jul 03 09:44:37.958379 np0000004400 cinder-backup[101319]: node.session.iscsi.DefaultTime2Wait = 2 Jul 03 09:44:37.958379 np0000004400 cinder-backup[101319]: node.session.iscsi.MaxConnections = 1 Jul 03 09:44:37.958379 np0000004400 cinder-backup[101319]: node.session.iscsi.MaxOutstandingR2T = 1 Jul 03 09:44:37.958379 np0000004400 cinder-backup[101319]: node.session.iscsi.ERL = 0 Jul 03 09:44:37.958379 np0000004400 cinder-backup[101319]: node.session.scan = auto Jul 03 09:44:37.958379 np0000004400 cinder-backup[101319]: node.session.reopen_max = 0 Jul 03 09:44:37.958379 np0000004400 cinder-backup[101319]: node.conn[0].address = 192.168.40.100 Jul 03 09:44:37.958379 np0000004400 cinder-backup[101319]: node.conn[0].port = 3260 Jul 03 09:44:37.958379 np0000004400 cinder-backup[101319]: node.conn[0].startup = manual Jul 03 09:44:37.958379 np0000004400 cinder-backup[101319]: node.conn[0].tcp.window_size = 524288 Jul 03 09:44:37.958379 np0000004400 cinder-backup[101319]: node.conn[0].tcp.type_of_service = 0 Jul 03 09:44:37.958379 np0000004400 cinder-backup[101319]: node.conn[0].timeo.logout_timeout = 15 Jul 03 09:44:37.958379 np0000004400 cinder-backup[101319]: node.conn[0].timeo.login_timeout = 15 Jul 03 09:44:37.958379 np0000004400 cinder-backup[101319]: node.conn[0].timeo.auth_timeout = 45 Jul 03 09:44:37.958379 np0000004400 cinder-backup[101319]: node.conn[0].timeo.noop_out_interval = 5 Jul 03 09:44:37.958379 np0000004400 cinder-backup[101319]: node.conn[0].timeo.noop_out_timeout = 5 Jul 03 09:44:37.958379 np0000004400 cinder-backup[101319]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0 Jul 03 09:44:37.958379 np0000004400 cinder-backup[101319]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144 Jul 03 09:44:37.958379 np0000004400 cinder-backup[101319]: node.conn[0].iscsi.HeaderDigest = None Jul 03 09:44:37.958379 np0000004400 cinder-backup[101319]: node.conn[0].iscsi.DataDigest = None Jul 03 09:44:37.958379 np0000004400 cinder-backup[101319]: node.conn[0].iscsi.IFMarker = No Jul 03 09:44:37.958379 np0000004400 cinder-backup[101319]: node.conn[0].iscsi.OFMarker = No Jul 03 09:44:37.958379 np0000004400 cinder-backup[101319]: # END RECORD Jul 03 09:44:37.958379 np0000004400 cinder-backup[101319]: stderr= {{(pid=101319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 03 09:44:37.973005 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-d05ff3d6-4b83-4db0-8816-e91017864e60 tempest-VolumesBackupsTest-118275719 None] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=101319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 03 09:44:37.993916 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-d05ff3d6-4b83-4db0-8816-e91017864e60 tempest-VolumesBackupsTest-118275719 None] iscsiadm ('-m', 'session'): stdout=tcp: [49] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b2e4f10c-8033-4c54-95a1-dfe45d6357a3 (non-flash) Jul 03 09:44:37.993916 np0000004400 cinder-backup[101319]: tcp: [50] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b2e4f10c-8033-4c54-95a1-dfe45d6357a3 (non-flash) Jul 03 09:44:37.993916 np0000004400 cinder-backup[101319]: tcp: [72] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e9e3f386-d923-4ae1-a6ce-8dd2091673ac (non-flash) Jul 03 09:44:37.993916 np0000004400 cinder-backup[101319]: tcp: [73] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e9e3f386-d923-4ae1-a6ce-8dd2091673ac (non-flash) Jul 03 09:44:37.993916 np0000004400 cinder-backup[101319]: tcp: [82] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-76320525-737e-4f58-8523-63ec9abbdc64 (non-flash) Jul 03 09:44:37.993916 np0000004400 cinder-backup[101319]: tcp: [83] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-76320525-737e-4f58-8523-63ec9abbdc64 (non-flash) Jul 03 09:44:37.993916 np0000004400 cinder-backup[101319]: tcp: [84] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-12c3303b-9d75-4de7-bffd-31f22f904503 (non-flash) Jul 03 09:44:37.993916 np0000004400 cinder-backup[101319]: tcp: [85] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-12c3303b-9d75-4de7-bffd-31f22f904503 (non-flash) Jul 03 09:44:37.993916 np0000004400 cinder-backup[101319]: tcp: [87] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-dc2d662f-bc12-4338-8e3d-6565f72ba808 (non-flash) Jul 03 09:44:37.993916 np0000004400 cinder-backup[101319]: tcp: [88] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-dc2d662f-bc12-4338-8e3d-6565f72ba808 (non-flash) Jul 03 09:44:37.993916 np0000004400 cinder-backup[101319]: tcp: [90] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-aecd73f6-86c7-4ae8-8bfa-b46655eb6efb (non-flash) Jul 03 09:44:37.993916 np0000004400 cinder-backup[101319]: tcp: [91] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-aecd73f6-86c7-4ae8-8bfa-b46655eb6efb (non-flash) Jul 03 09:44:37.993916 np0000004400 cinder-backup[101319]: stderr= {{(pid=101319) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jul 03 09:44:37.994178 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-d05ff3d6-4b83-4db0-8816-e91017864e60 tempest-VolumesBackupsTest-118275719 None] iscsi session list stdout=tcp: [49] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b2e4f10c-8033-4c54-95a1-dfe45d6357a3 (non-flash) Jul 03 09:44:37.994178 np0000004400 cinder-backup[101319]: tcp: [50] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b2e4f10c-8033-4c54-95a1-dfe45d6357a3 (non-flash) Jul 03 09:44:37.994178 np0000004400 cinder-backup[101319]: tcp: [72] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e9e3f386-d923-4ae1-a6ce-8dd2091673ac (non-flash) Jul 03 09:44:37.994178 np0000004400 cinder-backup[101319]: tcp: [73] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e9e3f386-d923-4ae1-a6ce-8dd2091673ac (non-flash) Jul 03 09:44:37.994178 np0000004400 cinder-backup[101319]: tcp: [82] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-76320525-737e-4f58-8523-63ec9abbdc64 (non-flash) Jul 03 09:44:37.994178 np0000004400 cinder-backup[101319]: tcp: [83] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-76320525-737e-4f58-8523-63ec9abbdc64 (non-flash) Jul 03 09:44:37.994178 np0000004400 cinder-backup[101319]: tcp: [84] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-12c3303b-9d75-4de7-bffd-31f22f904503 (non-flash) Jul 03 09:44:37.994178 np0000004400 cinder-backup[101319]: tcp: [85] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-12c3303b-9d75-4de7-bffd-31f22f904503 (non-flash) Jul 03 09:44:37.994178 np0000004400 cinder-backup[101319]: tcp: [87] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-dc2d662f-bc12-4338-8e3d-6565f72ba808 (non-flash) Jul 03 09:44:37.994178 np0000004400 cinder-backup[101319]: tcp: [88] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-dc2d662f-bc12-4338-8e3d-6565f72ba808 (non-flash) Jul 03 09:44:37.994178 np0000004400 cinder-backup[101319]: tcp: [90] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-aecd73f6-86c7-4ae8-8bfa-b46655eb6efb (non-flash) Jul 03 09:44:37.994178 np0000004400 cinder-backup[101319]: tcp: [91] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-aecd73f6-86c7-4ae8-8bfa-b46655eb6efb (non-flash) Jul 03 09:44:37.994178 np0000004400 cinder-backup[101319]: stderr= {{(pid=101319) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jul 03 09:44:38.051206 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-d05ff3d6-4b83-4db0-8816-e91017864e60 tempest-VolumesBackupsTest-118275719 None] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-35ece5f1-68f7-4f83-93fb-31eab852a359, portal: 192.168.40.100,3260] Jul 03 09:44:38.051206 np0000004400 cinder-backup[101319]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-35ece5f1-68f7-4f83-93fb-31eab852a359, portal: 192.168.40.100,3260] successful. Jul 03 09:44:38.051206 np0000004400 cinder-backup[101319]: stderr= {{(pid=101319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 03 09:44:38.064782 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-d05ff3d6-4b83-4db0-8816-e91017864e60 tempest-VolumesBackupsTest-118275719 None] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=101319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 03 09:44:38.089329 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-d05ff3d6-4b83-4db0-8816-e91017864e60 tempest-VolumesBackupsTest-118275719 None] iscsiadm ('-m', 'session'): stdout=tcp: [49] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b2e4f10c-8033-4c54-95a1-dfe45d6357a3 (non-flash) Jul 03 09:44:38.089329 np0000004400 cinder-backup[101319]: tcp: [50] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b2e4f10c-8033-4c54-95a1-dfe45d6357a3 (non-flash) Jul 03 09:44:38.089329 np0000004400 cinder-backup[101319]: tcp: [72] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e9e3f386-d923-4ae1-a6ce-8dd2091673ac (non-flash) Jul 03 09:44:38.089329 np0000004400 cinder-backup[101319]: tcp: [73] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e9e3f386-d923-4ae1-a6ce-8dd2091673ac (non-flash) Jul 03 09:44:38.089329 np0000004400 cinder-backup[101319]: tcp: [82] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-76320525-737e-4f58-8523-63ec9abbdc64 (non-flash) Jul 03 09:44:38.089329 np0000004400 cinder-backup[101319]: tcp: [83] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-76320525-737e-4f58-8523-63ec9abbdc64 (non-flash) Jul 03 09:44:38.089329 np0000004400 cinder-backup[101319]: tcp: [84] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-12c3303b-9d75-4de7-bffd-31f22f904503 (non-flash) Jul 03 09:44:38.089329 np0000004400 cinder-backup[101319]: tcp: [85] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-12c3303b-9d75-4de7-bffd-31f22f904503 (non-flash) Jul 03 09:44:38.089329 np0000004400 cinder-backup[101319]: tcp: [87] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-dc2d662f-bc12-4338-8e3d-6565f72ba808 (non-flash) Jul 03 09:44:38.089329 np0000004400 cinder-backup[101319]: tcp: [88] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-dc2d662f-bc12-4338-8e3d-6565f72ba808 (non-flash) Jul 03 09:44:38.089329 np0000004400 cinder-backup[101319]: tcp: [90] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-aecd73f6-86c7-4ae8-8bfa-b46655eb6efb (non-flash) Jul 03 09:44:38.089329 np0000004400 cinder-backup[101319]: tcp: [91] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-aecd73f6-86c7-4ae8-8bfa-b46655eb6efb (non-flash) Jul 03 09:44:38.089329 np0000004400 cinder-backup[101319]: tcp: [92] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-35ece5f1-68f7-4f83-93fb-31eab852a359 (non-flash) Jul 03 09:44:38.089329 np0000004400 cinder-backup[101319]: stderr= {{(pid=101319) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jul 03 09:44:38.089329 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-d05ff3d6-4b83-4db0-8816-e91017864e60 tempest-VolumesBackupsTest-118275719 None] iscsi session list stdout=tcp: [49] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b2e4f10c-8033-4c54-95a1-dfe45d6357a3 (non-flash) Jul 03 09:44:38.089329 np0000004400 cinder-backup[101319]: tcp: [50] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b2e4f10c-8033-4c54-95a1-dfe45d6357a3 (non-flash) Jul 03 09:44:38.089329 np0000004400 cinder-backup[101319]: tcp: [72] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e9e3f386-d923-4ae1-a6ce-8dd2091673ac (non-flash) Jul 03 09:44:38.089329 np0000004400 cinder-backup[101319]: tcp: [73] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e9e3f386-d923-4ae1-a6ce-8dd2091673ac (non-flash) Jul 03 09:44:38.089329 np0000004400 cinder-backup[101319]: tcp: [82] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-76320525-737e-4f58-8523-63ec9abbdc64 (non-flash) Jul 03 09:44:38.089329 np0000004400 cinder-backup[101319]: tcp: [83] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-76320525-737e-4f58-8523-63ec9abbdc64 (non-flash) Jul 03 09:44:38.089329 np0000004400 cinder-backup[101319]: tcp: [84] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-12c3303b-9d75-4de7-bffd-31f22f904503 (non-flash) Jul 03 09:44:38.089329 np0000004400 cinder-backup[101319]: tcp: [85] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-12c3303b-9d75-4de7-bffd-31f22f904503 (non-flash) Jul 03 09:44:38.089329 np0000004400 cinder-backup[101319]: tcp: [87] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-dc2d662f-bc12-4338-8e3d-6565f72ba808 (non-flash) Jul 03 09:44:38.089329 np0000004400 cinder-backup[101319]: tcp: [88] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-dc2d662f-bc12-4338-8e3d-6565f72ba808 (non-flash) Jul 03 09:44:38.089329 np0000004400 cinder-backup[101319]: tcp: [90] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-aecd73f6-86c7-4ae8-8bfa-b46655eb6efb (non-flash) Jul 03 09:44:38.089329 np0000004400 cinder-backup[101319]: tcp: [91] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-aecd73f6-86c7-4ae8-8bfa-b46655eb6efb (non-flash) Jul 03 09:44:38.089329 np0000004400 cinder-backup[101319]: tcp: [92] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-35ece5f1-68f7-4f83-93fb-31eab852a359 (non-flash) Jul 03 09:44:38.089329 np0000004400 cinder-backup[101319]: stderr= {{(pid=101319) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jul 03 09:44:38.089329 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.base [None req-d05ff3d6-4b83-4db0-8816-e91017864e60 tempest-VolumesBackupsTest-118275719 None] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-35ece5f1-68f7-4f83-93fb-31eab852a359" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.163s {{(pid=101319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jul 03 09:44:38.089329 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-d05ff3d6-4b83-4db0-8816-e91017864e60 tempest-VolumesBackupsTest-118275719 None] Connected to 192.168.40.100:3260 {{(pid=101319) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}} Jul 03 09:44:38.090088 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.linuxscsi [None req-d05ff3d6-4b83-4db0-8816-e91017864e60 tempest-VolumesBackupsTest-118275719 None] HCTL ('7', '-', '-', 0) found on session 92 with lun 0 {{(pid=101319) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}} Jul 03 09:44:38.090088 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.linuxscsi [None req-d05ff3d6-4b83-4db0-8816-e91017864e60 tempest-VolumesBackupsTest-118275719 None] Scanning host 7 c: -, t: -, l: 0) {{(pid=101319) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}} Jul 03 09:44:38.105054 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.linuxscsi [None req-d05ff3d6-4b83-4db0-8816-e91017864e60 tempest-VolumesBackupsTest-118275719 None] Searching for a device in session 92 and hctl ['7', '*', '*', 0] yield: None {{(pid=101319) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}} Jul 03 09:44:39.105329 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.linuxscsi [None req-d05ff3d6-4b83-4db0-8816-e91017864e60 tempest-VolumesBackupsTest-118275719 None] Searching for a device in session 92 and hctl ['7', '*', '*', 0] yield: sdb {{(pid=101319) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}} Jul 03 09:44:39.105776 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-d05ff3d6-4b83-4db0-8816-e91017864e60 tempest-VolumesBackupsTest-118275719 None] Connected to sdb using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-35ece5f1-68f7-4f83-93fb-31eab852a359', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '35ece5f1-68f7-4f83-93fb-31eab852a359', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': False} {{(pid=101319) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}} Jul 03 09:44:39.106157 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.base [None req-d05ff3d6-4b83-4db0-8816-e91017864e60 tempest-VolumesBackupsTest-118275719 None] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 2.191s {{(pid=101319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jul 03 09:44:39.106337 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-d05ff3d6-4b83-4db0-8816-e91017864e60 tempest-VolumesBackupsTest-118275719 None] <== connect_volume: return (2191ms) {'type': 'block', 'scsi_wwn': 'SStorPool_iSCSI_DISK_1034578903445799010', 'path': '/dev/sdb'} {{(pid=101319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}} Jul 03 09:44:39.106662 np0000004400 cinder-backup[101319]: DEBUG oslo_concurrency.processutils [None req-d05ff3d6-4b83-4db0-8816-e91017864e60 tempest-VolumesBackupsTest-118275719 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chown 1002 /dev/sdb {{(pid=101319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 09:44:39.123149 np0000004400 sudo[134641]: stack : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chown 1002 /dev/sdb Jul 03 09:44:39.123791 np0000004400 sudo[134641]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1002) Jul 03 09:44:39.421893 np0000004400 sudo[134641]: pam_unix(sudo:session): session closed for user root Jul 03 09:44:39.424159 np0000004400 cinder-backup[101319]: DEBUG oslo_concurrency.processutils [None req-d05ff3d6-4b83-4db0-8816-e91017864e60 tempest-VolumesBackupsTest-118275719 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chown 1002 /dev/sdb" returned: 0 in 0.317s {{(pid=101319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 09:44:39.424600 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-d05ff3d6-4b83-4db0-8816-e91017864e60 tempest-VolumesBackupsTest-118275719 None] starting restore of backup volume_35ece5f1-68f7-4f83-93fb-31eab852a359/20260703094421/az_nova_backup_36c3a4f2-c782-418d-be49-db2bcf3421f7 container: volumebackups, to existing volume 35ece5f1-68f7-4f83-93fb-31eab852a359, backup: 36c3a4f2-c782-418d-be49-db2bcf3421f7. {{(pid=101319) restore /opt/stack/cinder/cinder/backup/chunkeddriver.py:761}} Jul 03 09:44:39.424734 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-d05ff3d6-4b83-4db0-8816-e91017864e60 tempest-VolumesBackupsTest-118275719 None] _read_metadata started, container name: volumebackups, metadata filename: volume_35ece5f1-68f7-4f83-93fb-31eab852a359/20260703094421/az_nova_backup_36c3a4f2-c782-418d-be49-db2bcf3421f7_metadata. {{(pid=101319) _read_metadata /opt/stack/cinder/cinder/backup/chunkeddriver.py:320}} Jul 03 09:44:39.441355 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-d05ff3d6-4b83-4db0-8816-e91017864e60 tempest-VolumesBackupsTest-118275719 None] _read_metadata finished. Metadata: { Jul 03 09:44:39.441355 np0000004400 cinder-backup[101319]: "backup_description": null, Jul 03 09:44:39.441355 np0000004400 cinder-backup[101319]: "backup_id": "36c3a4f2-c782-418d-be49-db2bcf3421f7", Jul 03 09:44:39.441355 np0000004400 cinder-backup[101319]: "backup_name": "tempest-VolumesBackupsTest-Backup-717113228", Jul 03 09:44:39.441355 np0000004400 cinder-backup[101319]: "created_at": "2026-07-03 09:44:18+00:00", Jul 03 09:44:39.441355 np0000004400 cinder-backup[101319]: "objects": [ Jul 03 09:44:39.441355 np0000004400 cinder-backup[101319]: { Jul 03 09:44:39.441355 np0000004400 cinder-backup[101319]: "volume_35ece5f1-68f7-4f83-93fb-31eab852a359/20260703094421/az_nova_backup_36c3a4f2-c782-418d-be49-db2bcf3421f7-00001": { Jul 03 09:44:39.441355 np0000004400 cinder-backup[101319]: "compression": "zlib", Jul 03 09:44:39.441355 np0000004400 cinder-backup[101319]: "length": 52428800, Jul 03 09:44:39.441355 np0000004400 cinder-backup[101319]: "md5": "25e317773f308e446cc84c503a6d1f85", Jul 03 09:44:39.441355 np0000004400 cinder-backup[101319]: "offset": 0 Jul 03 09:44:39.441355 np0000004400 cinder-backup[101319]: } Jul 03 09:44:39.441355 np0000004400 cinder-backup[101319]: }, Jul 03 09:44:39.441355 np0000004400 cinder-backup[101319]: { Jul 03 09:44:39.441355 np0000004400 cinder-backup[101319]: "volume_35ece5f1-68f7-4f83-93fb-31eab852a359/20260703094421/az_nova_backup_36c3a4f2-c782-418d-be49-db2bcf3421f7-00002": { Jul 03 09:44:39.441355 np0000004400 cinder-backup[101319]: "compression": "zlib", Jul 03 09:44:39.441355 np0000004400 cinder-backup[101319]: "length": 52428800, Jul 03 09:44:39.441355 np0000004400 cinder-backup[101319]: "md5": "25e317773f308e446cc84c503a6d1f85", Jul 03 09:44:39.441355 np0000004400 cinder-backup[101319]: "offset": 52428800 Jul 03 09:44:39.441355 np0000004400 cinder-backup[101319]: } Jul 03 09:44:39.441355 np0000004400 cinder-backup[101319]: }, Jul 03 09:44:39.441355 np0000004400 cinder-backup[101319]: { Jul 03 09:44:39.441355 np0000004400 cinder-backup[101319]: "volume_35ece5f1-68f7-4f83-93fb-31eab852a359/20260703094421/az_nova_backup_36c3a4f2-c782-418d-be49-db2bcf3421f7-00003": { Jul 03 09:44:39.441355 np0000004400 cinder-backup[101319]: "compression": "zlib", Jul 03 09:44:39.441355 np0000004400 cinder-backup[101319]: "length": 52428800, Jul 03 09:44:39.441355 np0000004400 cinder-backup[101319]: "md5": "25e317773f308e446cc84c503a6d1f85", Jul 03 09:44:39.441355 np0000004400 cinder-backup[101319]: "offset": 104857600 Jul 03 09:44:39.441355 np0000004400 cinder-backup[101319]: } Jul 03 09:44:39.441355 np0000004400 cinder-backup[101319]: }, Jul 03 09:44:39.441355 np0000004400 cinder-backup[101319]: { Jul 03 09:44:39.441355 np0000004400 cinder-backup[101319]: "volume_35ece5f1-68f7-4f83-93fb-31eab852a359/20260703094421/az_nova_backup_36c3a4f2-c782-418d-be49-db2bcf3421f7-00004": { Jul 03 09:44:39.441355 np0000004400 cinder-backup[101319]: "compression": "zlib", Jul 03 09:44:39.441355 np0000004400 cinder-backup[101319]: "length": 52428800, Jul 03 09:44:39.441355 np0000004400 cinder-backup[101319]: "md5": "25e317773f308e446cc84c503a6d1f85", Jul 03 09:44:39.441355 np0000004400 cinder-backup[101319]: "offset": 157286400 Jul 03 09:44:39.441355 np0000004400 cinder-backup[101319]: } Jul 03 09:44:39.441355 np0000004400 cinder-backup[101319]: }, Jul 03 09:44:39.441355 np0000004400 cinder-backup[101319]: { Jul 03 09:44:39.441355 np0000004400 cinder-backup[101319]: "volume_35ece5f1-68f7-4f83-93fb-31eab852a359/20260703094421/az_nova_backup_36c3a4f2-c782-418d-be49-db2bcf3421f7-00005": { Jul 03 09:44:39.441355 np0000004400 cinder-backup[101319]: "compression": "zlib", Jul 03 09:44:39.441355 np0000004400 cinder-backup[101319]: "length": 52428800, Jul 03 09:44:39.441355 np0000004400 cinder-backup[101319]: "md5": "25e317773f308e446cc84c503a6d1f85", Jul 03 09:44:39.441355 np0000004400 cinder-backup[101319]: "offset": 209715200 Jul 03 09:44:39.441355 np0000004400 cinder-backup[101319]: } Jul 03 09:44:39.441355 np0000004400 cinder-backup[101319]: }, Jul 03 09:44:39.441355 np0000004400 cinder-backup[101319]: { Jul 03 09:44:39.441355 np0000004400 cinder-backup[101319]: "volume_35ece5f1-68f7-4f83-93fb-31eab852a359/20260703094421/az_nova_backup_36c3a4f2-c782-418d-be49-db2bcf3421f7-00006": { Jul 03 09:44:39.441355 np0000004400 cinder-backup[101319]: "compression": "zlib", Jul 03 09:44:39.441355 np0000004400 cinder-backup[101319]: "length": 52428800, Jul 03 09:44:39.441355 np0000004400 cinder-backup[101319]: "md5": "25e317773f308e446cc84c503a6d1f85", Jul 03 09:44:39.441355 np0000004400 cinder-backup[101319]: "offset": 262144000 Jul 03 09:44:39.441355 np0000004400 cinder-backup[101319]: } Jul 03 09:44:39.441355 np0000004400 cinder-backup[101319]: }, Jul 03 09:44:39.441355 np0000004400 cinder-backup[101319]: { Jul 03 09:44:39.441355 np0000004400 cinder-backup[101319]: "volume_35ece5f1-68f7-4f83-93fb-31eab852a359/20260703094421/az_nova_backup_36c3a4f2-c782-418d-be49-db2bcf3421f7-00007": { Jul 03 09:44:39.441355 np0000004400 cinder-backup[101319]: "compression": "zlib", Jul 03 09:44:39.441355 np0000004400 cinder-backup[101319]: "length": 52428800, Jul 03 09:44:39.441355 np0000004400 cinder-backup[101319]: "md5": "25e317773f308e446cc84c503a6d1f85", Jul 03 09:44:39.441355 np0000004400 cinder-backup[101319]: "offset": 314572800 Jul 03 09:44:39.441355 np0000004400 cinder-backup[101319]: } Jul 03 09:44:39.441355 np0000004400 cinder-backup[101319]: }, Jul 03 09:44:39.441355 np0000004400 cinder-backup[101319]: { Jul 03 09:44:39.441355 np0000004400 cinder-backup[101319]: "volume_35ece5f1-68f7-4f83-93fb-31eab852a359/20260703094421/az_nova_backup_36c3a4f2-c782-418d-be49-db2bcf3421f7-00008": { Jul 03 09:44:39.441355 np0000004400 cinder-backup[101319]: "compression": "zlib", Jul 03 09:44:39.441355 np0000004400 cinder-backup[101319]: "length": 52428800, Jul 03 09:44:39.441355 np0000004400 cinder-backup[101319]: "md5": "25e317773f308e446cc84c503a6d1f85", Jul 03 09:44:39.441355 np0000004400 cinder-backup[101319]: "offset": 367001600 Jul 03 09:44:39.441355 np0000004400 cinder-backup[101319]: } Jul 03 09:44:39.441355 np0000004400 cinder-backup[101319]: }, Jul 03 09:44:39.441355 np0000004400 cinder-backup[101319]: { Jul 03 09:44:39.441355 np0000004400 cinder-backup[101319]: "volume_35ece5f1-68f7-4f83-93fb-31eab852a359/20260703094421/az_nova_backup_36c3a4f2-c782-418d-be49-db2bcf3421f7-00009": { Jul 03 09:44:39.441355 np0000004400 cinder-backup[101319]: "compression": "zlib", Jul 03 09:44:39.441355 np0000004400 cinder-backup[101319]: "length": 52428800, Jul 03 09:44:39.441355 np0000004400 cinder-backup[101319]: "md5": "25e317773f308e446cc84c503a6d1f85", Jul 03 09:44:39.441355 np0000004400 cinder-backup[101319]: "offset": 419430400 Jul 03 09:44:39.441355 np0000004400 cinder-backup[101319]: } Jul 03 09:44:39.441355 np0000004400 cinder-backup[101319]: }, Jul 03 09:44:39.441355 np0000004400 cinder-backup[101319]: { Jul 03 09:44:39.441355 np0000004400 cinder-backup[101319]: "volume_35ece5f1-68f7-4f83-93fb-31eab852a359/20260703094421/az_nova_backup_36c3a4f2-c782-418d-be49-db2bcf3421f7-00010": { Jul 03 09:44:39.441355 np0000004400 cinder-backup[101319]: "compression": "zlib", Jul 03 09:44:39.441355 np0000004400 cinder-backup[101319]: "length": 52428800, Jul 03 09:44:39.441355 np0000004400 cinder-backup[101319]: "md5": "25e317773f308e446cc84c503a6d1f85", Jul 03 09:44:39.441355 np0000004400 cinder-backup[101319]: "offset": 471859200 Jul 03 09:44:39.441355 np0000004400 cinder-backup[101319]: } Jul 03 09:44:39.441355 np0000004400 cinder-backup[101319]: }, Jul 03 09:44:39.441355 np0000004400 cinder-backup[101319]: { Jul 03 09:44:39.441355 np0000004400 cinder-backup[101319]: "volume_35ece5f1-68f7-4f83-93fb-31eab852a359/20260703094421/az_nova_backup_36c3a4f2-c782-418d-be49-db2bcf3421f7-00011": { Jul 03 09:44:39.441355 np0000004400 cinder-backup[101319]: "compression": "zlib", Jul 03 09:44:39.441355 np0000004400 cinder-backup[101319]: "length": 52428800, Jul 03 09:44:39.441355 np0000004400 cinder-backup[101319]: "md5": "25e317773f308e446cc84c503a6d1f85", Jul 03 09:44:39.441355 np0000004400 cinder-backup[101319]: "offset": 524288000 Jul 03 09:44:39.441355 np0000004400 cinder-backup[101319]: } Jul 03 09:44:39.441355 np0000004400 cinder-backup[101319]: }, Jul 03 09:44:39.441355 np0000004400 cinder-backup[101319]: { Jul 03 09:44:39.441355 np0000004400 cinder-backup[101319]: "volume_35ece5f1-68f7-4f83-93fb-31eab852a359/20260703094421/az_nova_backup_36c3a4f2-c782-418d-be49-db2bcf3421f7-00012": { Jul 03 09:44:39.441355 np0000004400 cinder-backup[101319]: "compression": "zlib", Jul 03 09:44:39.441355 np0000004400 cinder-backup[101319]: "length": 52428800, Jul 03 09:44:39.441355 np0000004400 cinder-backup[101319]: "md5": "25e317773f308e446cc84c503a6d1f85", Jul 03 09:44:39.441355 np0000004400 cinder-backup[101319]: "offset": 576716800 Jul 03 09:44:39.441355 np0000004400 cinder-backup[101319]: } Jul 03 09:44:39.441355 np0000004400 cinder-backup[101319]: }, Jul 03 09:44:39.441355 np0000004400 cinder-backup[101319]: { Jul 03 09:44:39.441355 np0000004400 cinder-backup[101319]: "volume_35ece5f1-68f7-4f83-93fb-31eab852a359/20260703094421/az_nova_backup_36c3a4f2-c782-418d-be49-db2bcf3421f7-00013": { Jul 03 09:44:39.441355 np0000004400 cinder-backup[101319]: "compression": "zlib", Jul 03 09:44:39.441355 np0000004400 cinder-backup[101319]: "length": 52428800, Jul 03 09:44:39.441355 np0000004400 cinder-backup[101319]: "md5": "25e317773f308e446cc84c503a6d1f85", Jul 03 09:44:39.441355 np0000004400 cinder-backup[101319]: "offset": 629145600 Jul 03 09:44:39.441355 np0000004400 cinder-backup[101319]: } Jul 03 09:44:39.441355 np0000004400 cinder-backup[101319]: }, Jul 03 09:44:39.441355 np0000004400 cinder-backup[101319]: { Jul 03 09:44:39.441355 np0000004400 cinder-backup[101319]: "volume_35ece5f1-68f7-4f83-93fb-31eab852a359/20260703094421/az_nova_backup_36c3a4f2-c782-418d-be49-db2bcf3421f7-00014": { Jul 03 09:44:39.441355 np0000004400 cinder-backup[101319]: "compression": "zlib", Jul 03 09:44:39.441355 np0000004400 cinder-backup[101319]: "length": 52428800, Jul 03 09:44:39.441355 np0000004400 cinder-backup[101319]: "md5": "25e317773f308e446cc84c503a6d1f85", Jul 03 09:44:39.441355 np0000004400 cinder-backup[101319]: "offset": 681574400 Jul 03 09:44:39.441355 np0000004400 cinder-backup[101319]: } Jul 03 09:44:39.441355 np0000004400 cinder-backup[101319]: }, Jul 03 09:44:39.441355 np0000004400 cinder-backup[101319]: { Jul 03 09:44:39.441355 np0000004400 cinder-backup[101319]: "volume_35ece5f1-68f7-4f83-93fb-31eab852a359/20260703094421/az_nova_backup_36c3a4f2-c782-418d-be49-db2bcf3421f7-00015": { Jul 03 09:44:39.441355 np0000004400 cinder-backup[101319]: "compression": "zlib", Jul 03 09:44:39.441355 np0000004400 cinder-backup[101319]: "length": 52428800, Jul 03 09:44:39.441355 np0000004400 cinder-backup[101319]: "md5": "25e317773f308e446cc84c503a6d1f85", Jul 03 09:44:39.441355 np0000004400 cinder-backup[101319]: "offset": 734003200 Jul 03 09:44:39.441355 np0000004400 cinder-backup[101319]: } Jul 03 09:44:39.441355 np0000004400 cinder-backup[101319]: }, Jul 03 09:44:39.441355 np0000004400 cinder-backup[101319]: { Jul 03 09:44:39.441355 np0000004400 cinder-backup[101319]: "volume_35ece5f1-68f7-4f83-93fb-31eab852a359/20260703094421/az_nova_backup_36c3a4f2-c782-418d-be49-db2bcf3421f7-00016": { Jul 03 09:44:39.441355 np0000004400 cinder-backup[101319]: "compression": "zlib", Jul 03 09:44:39.441355 np0000004400 cinder-backup[101319]: "length": 52428800, Jul 03 09:44:39.441355 np0000004400 cinder-backup[101319]: "md5": "25e317773f308e446cc84c503a6d1f85", Jul 03 09:44:39.441355 np0000004400 cinder-backup[101319]: "offset": 786432000 Jul 03 09:44:39.441355 np0000004400 cinder-backup[101319]: } Jul 03 09:44:39.441355 np0000004400 cinder-backup[101319]: }, Jul 03 09:44:39.441355 np0000004400 cinder-backup[101319]: { Jul 03 09:44:39.441355 np0000004400 cinder-backup[101319]: "volume_35ece5f1-68f7-4f83-93fb-31eab852a359/20260703094421/az_nova_backup_36c3a4f2-c782-418d-be49-db2bcf3421f7-00017": { Jul 03 09:44:39.441355 np0000004400 cinder-backup[101319]: "compression": "zlib", Jul 03 09:44:39.441355 np0000004400 cinder-backup[101319]: "length": 52428800, Jul 03 09:44:39.441355 np0000004400 cinder-backup[101319]: "md5": "25e317773f308e446cc84c503a6d1f85", Jul 03 09:44:39.441355 np0000004400 cinder-backup[101319]: "offset": 838860800 Jul 03 09:44:39.441355 np0000004400 cinder-backup[101319]: } Jul 03 09:44:39.441355 np0000004400 cinder-backup[101319]: }, Jul 03 09:44:39.441355 np0000004400 cinder-backup[101319]: { Jul 03 09:44:39.441355 np0000004400 cinder-backup[101319]: "volume_35ece5f1-68f7-4f83-93fb-31eab852a359/20260703094421/az_nova_backup_36c3a4f2-c782-418d-be49-db2bcf3421f7-00018": { Jul 03 09:44:39.441355 np0000004400 cinder-backup[101319]: "compression": "zlib", Jul 03 09:44:39.441355 np0000004400 cinder-backup[101319]: "length": 52428800, Jul 03 09:44:39.441355 np0000004400 cinder-backup[101319]: "md5": "25e317773f308e446cc84c503a6d1f85", Jul 03 09:44:39.441355 np0000004400 cinder-backup[101319]: "offset": 891289600 Jul 03 09:44:39.441355 np0000004400 cinder-backup[101319]: } Jul 03 09:44:39.441355 np0000004400 cinder-backup[101319]: }, Jul 03 09:44:39.441355 np0000004400 cinder-backup[101319]: { Jul 03 09:44:39.441355 np0000004400 cinder-backup[101319]: "volume_35ece5f1-68f7-4f83-93fb-31eab852a359/20260703094421/az_nova_backup_36c3a4f2-c782-418d-be49-db2bcf3421f7-00019": { Jul 03 09:44:39.441355 np0000004400 cinder-backup[101319]: "compression": "zlib", Jul 03 09:44:39.441355 np0000004400 cinder-backup[101319]: "length": 52428800, Jul 03 09:44:39.441355 np0000004400 cinder-backup[101319]: "md5": "25e317773f308e446cc84c503a6d1f85", Jul 03 09:44:39.441355 np0000004400 cinder-backup[101319]: "offset": 943718400 Jul 03 09:44:39.441355 np0000004400 cinder-backup[101319]: } Jul 03 09:44:39.441355 np0000004400 cinder-backup[101319]: }, Jul 03 09:44:39.441355 np0000004400 cinder-backup[101319]: { Jul 03 09:44:39.441355 np0000004400 cinder-backup[101319]: "volume_35ece5f1-68f7-4f83-93fb-31eab852a359/20260703094421/az_nova_backup_36c3a4f2-c782-418d-be49-db2bcf3421f7-00020": { Jul 03 09:44:39.441355 np0000004400 cinder-backup[101319]: "compression": "zlib", Jul 03 09:44:39.441355 np0000004400 cinder-backup[101319]: "length": 52428800, Jul 03 09:44:39.441355 np0000004400 cinder-backup[101319]: "md5": "25e317773f308e446cc84c503a6d1f85", Jul 03 09:44:39.441355 np0000004400 cinder-backup[101319]: "offset": 996147200 Jul 03 09:44:39.441355 np0000004400 cinder-backup[101319]: } Jul 03 09:44:39.441355 np0000004400 cinder-backup[101319]: }, Jul 03 09:44:39.441355 np0000004400 cinder-backup[101319]: { Jul 03 09:44:39.441355 np0000004400 cinder-backup[101319]: "volume_35ece5f1-68f7-4f83-93fb-31eab852a359/20260703094421/az_nova_backup_36c3a4f2-c782-418d-be49-db2bcf3421f7-00021": { Jul 03 09:44:39.441355 np0000004400 cinder-backup[101319]: "compression": "zlib", Jul 03 09:44:39.441355 np0000004400 cinder-backup[101319]: "length": 25165824, Jul 03 09:44:39.441355 np0000004400 cinder-backup[101319]: "md5": "77377273b0a4b61febdbf7bbf52b9db9", Jul 03 09:44:39.441355 np0000004400 cinder-backup[101319]: "offset": 1048576000 Jul 03 09:44:39.441355 np0000004400 cinder-backup[101319]: } Jul 03 09:44:39.441355 np0000004400 cinder-backup[101319]: } Jul 03 09:44:39.441355 np0000004400 cinder-backup[101319]: ], Jul 03 09:44:39.441355 np0000004400 cinder-backup[101319]: "parent_id": null, Jul 03 09:44:39.441355 np0000004400 cinder-backup[101319]: "version": "1.0.0", Jul 03 09:44:39.441355 np0000004400 cinder-backup[101319]: "volume_id": "35ece5f1-68f7-4f83-93fb-31eab852a359", Jul 03 09:44:39.441355 np0000004400 cinder-backup[101319]: "volume_meta": "{\"version\": 2, \"volume-base-metadata\": {\"id\": \"35ece5f1-68f7-4f83-93fb-31eab852a359\", \"_name_id\": null, \"use_quota\": true, \"ec2_id\": null, \"user_id\": \"b861df2a13684334b293b1f348152e37\", \"project_id\": \"a484ec9218bf417bb9d7575ae6370646\", \"snapshot_id\": null, \"cluster_name\": null, \"host\": \"np0000004400@storpool#default\", \"size\": 1, \"availability_zone\": \"nova\", \"status\": \"backing-up\", \"attach_status\": \"detached\", \"migration_status\": null, \"scheduled_at\": \"2026-07-03T09:44:17.000000\", \"launched_at\": \"2026-07-03T09:44:17.000000\", \"terminated_at\": null, \"display_name\": \"tempest-VolumesBackupsTest-Volume-1897405656\", \"display_description\": null, \"provider_location\": null, \"provider_auth\": null, \"provider_geometry\": null, \"provider_id\": null, \"volume_type_id\": \"03e13fe6-0e30-4803-ace0-725d38e6dc24\", \"source_volid\": null, \"encryption_key_id\": null, \"consistencygroup_id\": null, \"group_id\": null, \"bootable\": false, \"multiattach\": false, \"replication_status\": null, \"replication_extended_status\": null, \"replication_driver_data\": null, \"previous_status\": \"available\", \"service_uuid\": \"6d4b0e79-fefe-4744-b25f-34be05095200\", \"shared_targets\": true, \"deleted_at\": null, \"deleted\": false, \"created_at\": \"2026-07-03T09:44:17.000000\", \"updated_at\": \"2026-07-03T09:44:18.000000\"}}" Jul 03 09:44:39.441355 np0000004400 cinder-backup[101319]: }. {{(pid=101319) _read_metadata /opt/stack/cinder/cinder/backup/chunkeddriver.py:327}} Jul 03 09:44:39.444722 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-d05ff3d6-4b83-4db0-8816-e91017864e60 tempest-VolumesBackupsTest-118275719 None] Restoring backup version 1.0.0 {{(pid=101319) restore /opt/stack/cinder/cinder/backup/chunkeddriver.py:774}} Jul 03 09:44:39.444722 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-d05ff3d6-4b83-4db0-8816-e91017864e60 tempest-VolumesBackupsTest-118275719 None] _read_metadata started, container name: volumebackups, metadata filename: volume_35ece5f1-68f7-4f83-93fb-31eab852a359/20260703094421/az_nova_backup_36c3a4f2-c782-418d-be49-db2bcf3421f7_metadata. {{(pid=101319) _read_metadata /opt/stack/cinder/cinder/backup/chunkeddriver.py:320}} Jul 03 09:44:39.458033 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-d05ff3d6-4b83-4db0-8816-e91017864e60 tempest-VolumesBackupsTest-118275719 None] _read_metadata finished. Metadata: { Jul 03 09:44:39.458033 np0000004400 cinder-backup[101319]: "backup_description": null, Jul 03 09:44:39.458033 np0000004400 cinder-backup[101319]: "backup_id": "36c3a4f2-c782-418d-be49-db2bcf3421f7", Jul 03 09:44:39.458033 np0000004400 cinder-backup[101319]: "backup_name": "tempest-VolumesBackupsTest-Backup-717113228", Jul 03 09:44:39.458033 np0000004400 cinder-backup[101319]: "created_at": "2026-07-03 09:44:18+00:00", Jul 03 09:44:39.458033 np0000004400 cinder-backup[101319]: "objects": [ Jul 03 09:44:39.458033 np0000004400 cinder-backup[101319]: { Jul 03 09:44:39.458033 np0000004400 cinder-backup[101319]: "volume_35ece5f1-68f7-4f83-93fb-31eab852a359/20260703094421/az_nova_backup_36c3a4f2-c782-418d-be49-db2bcf3421f7-00001": { Jul 03 09:44:39.458033 np0000004400 cinder-backup[101319]: "compression": "zlib", Jul 03 09:44:39.458033 np0000004400 cinder-backup[101319]: "length": 52428800, Jul 03 09:44:39.458033 np0000004400 cinder-backup[101319]: "md5": "25e317773f308e446cc84c503a6d1f85", Jul 03 09:44:39.458033 np0000004400 cinder-backup[101319]: "offset": 0 Jul 03 09:44:39.458033 np0000004400 cinder-backup[101319]: } Jul 03 09:44:39.458033 np0000004400 cinder-backup[101319]: }, Jul 03 09:44:39.458033 np0000004400 cinder-backup[101319]: { Jul 03 09:44:39.458033 np0000004400 cinder-backup[101319]: "volume_35ece5f1-68f7-4f83-93fb-31eab852a359/20260703094421/az_nova_backup_36c3a4f2-c782-418d-be49-db2bcf3421f7-00002": { Jul 03 09:44:39.458033 np0000004400 cinder-backup[101319]: "compression": "zlib", Jul 03 09:44:39.458033 np0000004400 cinder-backup[101319]: "length": 52428800, Jul 03 09:44:39.458033 np0000004400 cinder-backup[101319]: "md5": "25e317773f308e446cc84c503a6d1f85", Jul 03 09:44:39.458033 np0000004400 cinder-backup[101319]: "offset": 52428800 Jul 03 09:44:39.458033 np0000004400 cinder-backup[101319]: } Jul 03 09:44:39.458033 np0000004400 cinder-backup[101319]: }, Jul 03 09:44:39.458033 np0000004400 cinder-backup[101319]: { Jul 03 09:44:39.458033 np0000004400 cinder-backup[101319]: "volume_35ece5f1-68f7-4f83-93fb-31eab852a359/20260703094421/az_nova_backup_36c3a4f2-c782-418d-be49-db2bcf3421f7-00003": { Jul 03 09:44:39.458033 np0000004400 cinder-backup[101319]: "compression": "zlib", Jul 03 09:44:39.458033 np0000004400 cinder-backup[101319]: "length": 52428800, Jul 03 09:44:39.458033 np0000004400 cinder-backup[101319]: "md5": "25e317773f308e446cc84c503a6d1f85", Jul 03 09:44:39.458033 np0000004400 cinder-backup[101319]: "offset": 104857600 Jul 03 09:44:39.458033 np0000004400 cinder-backup[101319]: } Jul 03 09:44:39.458033 np0000004400 cinder-backup[101319]: }, Jul 03 09:44:39.458033 np0000004400 cinder-backup[101319]: { Jul 03 09:44:39.458033 np0000004400 cinder-backup[101319]: "volume_35ece5f1-68f7-4f83-93fb-31eab852a359/20260703094421/az_nova_backup_36c3a4f2-c782-418d-be49-db2bcf3421f7-00004": { Jul 03 09:44:39.458033 np0000004400 cinder-backup[101319]: "compression": "zlib", Jul 03 09:44:39.458033 np0000004400 cinder-backup[101319]: "length": 52428800, Jul 03 09:44:39.458033 np0000004400 cinder-backup[101319]: "md5": "25e317773f308e446cc84c503a6d1f85", Jul 03 09:44:39.458033 np0000004400 cinder-backup[101319]: "offset": 157286400 Jul 03 09:44:39.458033 np0000004400 cinder-backup[101319]: } Jul 03 09:44:39.458033 np0000004400 cinder-backup[101319]: }, Jul 03 09:44:39.458033 np0000004400 cinder-backup[101319]: { Jul 03 09:44:39.458033 np0000004400 cinder-backup[101319]: "volume_35ece5f1-68f7-4f83-93fb-31eab852a359/20260703094421/az_nova_backup_36c3a4f2-c782-418d-be49-db2bcf3421f7-00005": { Jul 03 09:44:39.458033 np0000004400 cinder-backup[101319]: "compression": "zlib", Jul 03 09:44:39.458033 np0000004400 cinder-backup[101319]: "length": 52428800, Jul 03 09:44:39.458033 np0000004400 cinder-backup[101319]: "md5": "25e317773f308e446cc84c503a6d1f85", Jul 03 09:44:39.458033 np0000004400 cinder-backup[101319]: "offset": 209715200 Jul 03 09:44:39.458033 np0000004400 cinder-backup[101319]: } Jul 03 09:44:39.458033 np0000004400 cinder-backup[101319]: }, Jul 03 09:44:39.458033 np0000004400 cinder-backup[101319]: { Jul 03 09:44:39.458033 np0000004400 cinder-backup[101319]: "volume_35ece5f1-68f7-4f83-93fb-31eab852a359/20260703094421/az_nova_backup_36c3a4f2-c782-418d-be49-db2bcf3421f7-00006": { Jul 03 09:44:39.458033 np0000004400 cinder-backup[101319]: "compression": "zlib", Jul 03 09:44:39.458033 np0000004400 cinder-backup[101319]: "length": 52428800, Jul 03 09:44:39.458033 np0000004400 cinder-backup[101319]: "md5": "25e317773f308e446cc84c503a6d1f85", Jul 03 09:44:39.458033 np0000004400 cinder-backup[101319]: "offset": 262144000 Jul 03 09:44:39.458033 np0000004400 cinder-backup[101319]: } Jul 03 09:44:39.458033 np0000004400 cinder-backup[101319]: }, Jul 03 09:44:39.458033 np0000004400 cinder-backup[101319]: { Jul 03 09:44:39.458033 np0000004400 cinder-backup[101319]: "volume_35ece5f1-68f7-4f83-93fb-31eab852a359/20260703094421/az_nova_backup_36c3a4f2-c782-418d-be49-db2bcf3421f7-00007": { Jul 03 09:44:39.458033 np0000004400 cinder-backup[101319]: "compression": "zlib", Jul 03 09:44:39.458033 np0000004400 cinder-backup[101319]: "length": 52428800, Jul 03 09:44:39.458033 np0000004400 cinder-backup[101319]: "md5": "25e317773f308e446cc84c503a6d1f85", Jul 03 09:44:39.458033 np0000004400 cinder-backup[101319]: "offset": 314572800 Jul 03 09:44:39.458033 np0000004400 cinder-backup[101319]: } Jul 03 09:44:39.458033 np0000004400 cinder-backup[101319]: }, Jul 03 09:44:39.458033 np0000004400 cinder-backup[101319]: { Jul 03 09:44:39.458033 np0000004400 cinder-backup[101319]: "volume_35ece5f1-68f7-4f83-93fb-31eab852a359/20260703094421/az_nova_backup_36c3a4f2-c782-418d-be49-db2bcf3421f7-00008": { Jul 03 09:44:39.458033 np0000004400 cinder-backup[101319]: "compression": "zlib", Jul 03 09:44:39.458033 np0000004400 cinder-backup[101319]: "length": 52428800, Jul 03 09:44:39.458033 np0000004400 cinder-backup[101319]: "md5": "25e317773f308e446cc84c503a6d1f85", Jul 03 09:44:39.458033 np0000004400 cinder-backup[101319]: "offset": 367001600 Jul 03 09:44:39.458033 np0000004400 cinder-backup[101319]: } Jul 03 09:44:39.458033 np0000004400 cinder-backup[101319]: }, Jul 03 09:44:39.458033 np0000004400 cinder-backup[101319]: { Jul 03 09:44:39.458033 np0000004400 cinder-backup[101319]: "volume_35ece5f1-68f7-4f83-93fb-31eab852a359/20260703094421/az_nova_backup_36c3a4f2-c782-418d-be49-db2bcf3421f7-00009": { Jul 03 09:44:39.458033 np0000004400 cinder-backup[101319]: "compression": "zlib", Jul 03 09:44:39.458033 np0000004400 cinder-backup[101319]: "length": 52428800, Jul 03 09:44:39.458033 np0000004400 cinder-backup[101319]: "md5": "25e317773f308e446cc84c503a6d1f85", Jul 03 09:44:39.458033 np0000004400 cinder-backup[101319]: "offset": 419430400 Jul 03 09:44:39.458033 np0000004400 cinder-backup[101319]: } Jul 03 09:44:39.458033 np0000004400 cinder-backup[101319]: }, Jul 03 09:44:39.458033 np0000004400 cinder-backup[101319]: { Jul 03 09:44:39.458033 np0000004400 cinder-backup[101319]: "volume_35ece5f1-68f7-4f83-93fb-31eab852a359/20260703094421/az_nova_backup_36c3a4f2-c782-418d-be49-db2bcf3421f7-00010": { Jul 03 09:44:39.458033 np0000004400 cinder-backup[101319]: "compression": "zlib", Jul 03 09:44:39.458033 np0000004400 cinder-backup[101319]: "length": 52428800, Jul 03 09:44:39.458033 np0000004400 cinder-backup[101319]: "md5": "25e317773f308e446cc84c503a6d1f85", Jul 03 09:44:39.458033 np0000004400 cinder-backup[101319]: "offset": 471859200 Jul 03 09:44:39.458033 np0000004400 cinder-backup[101319]: } Jul 03 09:44:39.458033 np0000004400 cinder-backup[101319]: }, Jul 03 09:44:39.458033 np0000004400 cinder-backup[101319]: { Jul 03 09:44:39.458033 np0000004400 cinder-backup[101319]: "volume_35ece5f1-68f7-4f83-93fb-31eab852a359/20260703094421/az_nova_backup_36c3a4f2-c782-418d-be49-db2bcf3421f7-00011": { Jul 03 09:44:39.458033 np0000004400 cinder-backup[101319]: "compression": "zlib", Jul 03 09:44:39.458033 np0000004400 cinder-backup[101319]: "length": 52428800, Jul 03 09:44:39.458033 np0000004400 cinder-backup[101319]: "md5": "25e317773f308e446cc84c503a6d1f85", Jul 03 09:44:39.458033 np0000004400 cinder-backup[101319]: "offset": 524288000 Jul 03 09:44:39.458033 np0000004400 cinder-backup[101319]: } Jul 03 09:44:39.458033 np0000004400 cinder-backup[101319]: }, Jul 03 09:44:39.458033 np0000004400 cinder-backup[101319]: { Jul 03 09:44:39.458033 np0000004400 cinder-backup[101319]: "volume_35ece5f1-68f7-4f83-93fb-31eab852a359/20260703094421/az_nova_backup_36c3a4f2-c782-418d-be49-db2bcf3421f7-00012": { Jul 03 09:44:39.458033 np0000004400 cinder-backup[101319]: "compression": "zlib", Jul 03 09:44:39.458033 np0000004400 cinder-backup[101319]: "length": 52428800, Jul 03 09:44:39.458033 np0000004400 cinder-backup[101319]: "md5": "25e317773f308e446cc84c503a6d1f85", Jul 03 09:44:39.458033 np0000004400 cinder-backup[101319]: "offset": 576716800 Jul 03 09:44:39.458033 np0000004400 cinder-backup[101319]: } Jul 03 09:44:39.458033 np0000004400 cinder-backup[101319]: }, Jul 03 09:44:39.458033 np0000004400 cinder-backup[101319]: { Jul 03 09:44:39.458033 np0000004400 cinder-backup[101319]: "volume_35ece5f1-68f7-4f83-93fb-31eab852a359/20260703094421/az_nova_backup_36c3a4f2-c782-418d-be49-db2bcf3421f7-00013": { Jul 03 09:44:39.458033 np0000004400 cinder-backup[101319]: "compression": "zlib", Jul 03 09:44:39.458033 np0000004400 cinder-backup[101319]: "length": 52428800, Jul 03 09:44:39.458033 np0000004400 cinder-backup[101319]: "md5": "25e317773f308e446cc84c503a6d1f85", Jul 03 09:44:39.458033 np0000004400 cinder-backup[101319]: "offset": 629145600 Jul 03 09:44:39.458033 np0000004400 cinder-backup[101319]: } Jul 03 09:44:39.458033 np0000004400 cinder-backup[101319]: }, Jul 03 09:44:39.458033 np0000004400 cinder-backup[101319]: { Jul 03 09:44:39.458033 np0000004400 cinder-backup[101319]: "volume_35ece5f1-68f7-4f83-93fb-31eab852a359/20260703094421/az_nova_backup_36c3a4f2-c782-418d-be49-db2bcf3421f7-00014": { Jul 03 09:44:39.458033 np0000004400 cinder-backup[101319]: "compression": "zlib", Jul 03 09:44:39.458033 np0000004400 cinder-backup[101319]: "length": 52428800, Jul 03 09:44:39.458033 np0000004400 cinder-backup[101319]: "md5": "25e317773f308e446cc84c503a6d1f85", Jul 03 09:44:39.458033 np0000004400 cinder-backup[101319]: "offset": 681574400 Jul 03 09:44:39.458033 np0000004400 cinder-backup[101319]: } Jul 03 09:44:39.458033 np0000004400 cinder-backup[101319]: }, Jul 03 09:44:39.458033 np0000004400 cinder-backup[101319]: { Jul 03 09:44:39.458033 np0000004400 cinder-backup[101319]: "volume_35ece5f1-68f7-4f83-93fb-31eab852a359/20260703094421/az_nova_backup_36c3a4f2-c782-418d-be49-db2bcf3421f7-00015": { Jul 03 09:44:39.458033 np0000004400 cinder-backup[101319]: "compression": "zlib", Jul 03 09:44:39.458033 np0000004400 cinder-backup[101319]: "length": 52428800, Jul 03 09:44:39.458033 np0000004400 cinder-backup[101319]: "md5": "25e317773f308e446cc84c503a6d1f85", Jul 03 09:44:39.458033 np0000004400 cinder-backup[101319]: "offset": 734003200 Jul 03 09:44:39.458033 np0000004400 cinder-backup[101319]: } Jul 03 09:44:39.458033 np0000004400 cinder-backup[101319]: }, Jul 03 09:44:39.458033 np0000004400 cinder-backup[101319]: { Jul 03 09:44:39.458033 np0000004400 cinder-backup[101319]: "volume_35ece5f1-68f7-4f83-93fb-31eab852a359/20260703094421/az_nova_backup_36c3a4f2-c782-418d-be49-db2bcf3421f7-00016": { Jul 03 09:44:39.458033 np0000004400 cinder-backup[101319]: "compression": "zlib", Jul 03 09:44:39.458033 np0000004400 cinder-backup[101319]: "length": 52428800, Jul 03 09:44:39.458033 np0000004400 cinder-backup[101319]: "md5": "25e317773f308e446cc84c503a6d1f85", Jul 03 09:44:39.458033 np0000004400 cinder-backup[101319]: "offset": 786432000 Jul 03 09:44:39.458033 np0000004400 cinder-backup[101319]: } Jul 03 09:44:39.458033 np0000004400 cinder-backup[101319]: }, Jul 03 09:44:39.458033 np0000004400 cinder-backup[101319]: { Jul 03 09:44:39.458033 np0000004400 cinder-backup[101319]: "volume_35ece5f1-68f7-4f83-93fb-31eab852a359/20260703094421/az_nova_backup_36c3a4f2-c782-418d-be49-db2bcf3421f7-00017": { Jul 03 09:44:39.458033 np0000004400 cinder-backup[101319]: "compression": "zlib", Jul 03 09:44:39.458033 np0000004400 cinder-backup[101319]: "length": 52428800, Jul 03 09:44:39.458033 np0000004400 cinder-backup[101319]: "md5": "25e317773f308e446cc84c503a6d1f85", Jul 03 09:44:39.458033 np0000004400 cinder-backup[101319]: "offset": 838860800 Jul 03 09:44:39.458033 np0000004400 cinder-backup[101319]: } Jul 03 09:44:39.458033 np0000004400 cinder-backup[101319]: }, Jul 03 09:44:39.458033 np0000004400 cinder-backup[101319]: { Jul 03 09:44:39.458033 np0000004400 cinder-backup[101319]: "volume_35ece5f1-68f7-4f83-93fb-31eab852a359/20260703094421/az_nova_backup_36c3a4f2-c782-418d-be49-db2bcf3421f7-00018": { Jul 03 09:44:39.458033 np0000004400 cinder-backup[101319]: "compression": "zlib", Jul 03 09:44:39.458033 np0000004400 cinder-backup[101319]: "length": 52428800, Jul 03 09:44:39.458033 np0000004400 cinder-backup[101319]: "md5": "25e317773f308e446cc84c503a6d1f85", Jul 03 09:44:39.458033 np0000004400 cinder-backup[101319]: "offset": 891289600 Jul 03 09:44:39.458033 np0000004400 cinder-backup[101319]: } Jul 03 09:44:39.458033 np0000004400 cinder-backup[101319]: }, Jul 03 09:44:39.458033 np0000004400 cinder-backup[101319]: { Jul 03 09:44:39.458033 np0000004400 cinder-backup[101319]: "volume_35ece5f1-68f7-4f83-93fb-31eab852a359/20260703094421/az_nova_backup_36c3a4f2-c782-418d-be49-db2bcf3421f7-00019": { Jul 03 09:44:39.458033 np0000004400 cinder-backup[101319]: "compression": "zlib", Jul 03 09:44:39.458033 np0000004400 cinder-backup[101319]: "length": 52428800, Jul 03 09:44:39.458033 np0000004400 cinder-backup[101319]: "md5": "25e317773f308e446cc84c503a6d1f85", Jul 03 09:44:39.458033 np0000004400 cinder-backup[101319]: "offset": 943718400 Jul 03 09:44:39.458033 np0000004400 cinder-backup[101319]: } Jul 03 09:44:39.458033 np0000004400 cinder-backup[101319]: }, Jul 03 09:44:39.458033 np0000004400 cinder-backup[101319]: { Jul 03 09:44:39.458033 np0000004400 cinder-backup[101319]: "volume_35ece5f1-68f7-4f83-93fb-31eab852a359/20260703094421/az_nova_backup_36c3a4f2-c782-418d-be49-db2bcf3421f7-00020": { Jul 03 09:44:39.458033 np0000004400 cinder-backup[101319]: "compression": "zlib", Jul 03 09:44:39.458033 np0000004400 cinder-backup[101319]: "length": 52428800, Jul 03 09:44:39.458033 np0000004400 cinder-backup[101319]: "md5": "25e317773f308e446cc84c503a6d1f85", Jul 03 09:44:39.458033 np0000004400 cinder-backup[101319]: "offset": 996147200 Jul 03 09:44:39.458033 np0000004400 cinder-backup[101319]: } Jul 03 09:44:39.458033 np0000004400 cinder-backup[101319]: }, Jul 03 09:44:39.458033 np0000004400 cinder-backup[101319]: { Jul 03 09:44:39.458033 np0000004400 cinder-backup[101319]: "volume_35ece5f1-68f7-4f83-93fb-31eab852a359/20260703094421/az_nova_backup_36c3a4f2-c782-418d-be49-db2bcf3421f7-00021": { Jul 03 09:44:39.458033 np0000004400 cinder-backup[101319]: "compression": "zlib", Jul 03 09:44:39.458033 np0000004400 cinder-backup[101319]: "length": 25165824, Jul 03 09:44:39.458033 np0000004400 cinder-backup[101319]: "md5": "77377273b0a4b61febdbf7bbf52b9db9", Jul 03 09:44:39.458033 np0000004400 cinder-backup[101319]: "offset": 1048576000 Jul 03 09:44:39.458033 np0000004400 cinder-backup[101319]: } Jul 03 09:44:39.458033 np0000004400 cinder-backup[101319]: } Jul 03 09:44:39.458033 np0000004400 cinder-backup[101319]: ], Jul 03 09:44:39.458033 np0000004400 cinder-backup[101319]: "parent_id": null, Jul 03 09:44:39.458033 np0000004400 cinder-backup[101319]: "version": "1.0.0", Jul 03 09:44:39.458033 np0000004400 cinder-backup[101319]: "volume_id": "35ece5f1-68f7-4f83-93fb-31eab852a359", Jul 03 09:44:39.458033 np0000004400 cinder-backup[101319]: "volume_meta": "{\"version\": 2, \"volume-base-metadata\": {\"id\": \"35ece5f1-68f7-4f83-93fb-31eab852a359\", \"_name_id\": null, \"use_quota\": true, \"ec2_id\": null, \"user_id\": \"b861df2a13684334b293b1f348152e37\", \"project_id\": \"a484ec9218bf417bb9d7575ae6370646\", \"snapshot_id\": null, \"cluster_name\": null, \"host\": \"np0000004400@storpool#default\", \"size\": 1, \"availability_zone\": \"nova\", \"status\": \"backing-up\", \"attach_status\": \"detached\", \"migration_status\": null, \"scheduled_at\": \"2026-07-03T09:44:17.000000\", \"launched_at\": \"2026-07-03T09:44:17.000000\", \"terminated_at\": null, \"display_name\": \"tempest-VolumesBackupsTest-Volume-1897405656\", \"display_description\": null, \"provider_location\": null, \"provider_auth\": null, \"provider_geometry\": null, \"provider_id\": null, \"volume_type_id\": \"03e13fe6-0e30-4803-ace0-725d38e6dc24\", \"source_volid\": null, \"encryption_key_id\": null, \"consistencygroup_id\": null, \"group_id\": null, \"bootable\": false, \"multiattach\": false, \"replication_status\": null, \"replication_extended_status\": null, \"replication_driver_data\": null, \"previous_status\": \"available\", \"service_uuid\": \"6d4b0e79-fefe-4744-b25f-34be05095200\", \"shared_targets\": true, \"deleted_at\": null, \"deleted\": false, \"created_at\": \"2026-07-03T09:44:17.000000\", \"updated_at\": \"2026-07-03T09:44:18.000000\"}}" Jul 03 09:44:39.458033 np0000004400 cinder-backup[101319]: }. {{(pid=101319) _read_metadata /opt/stack/cinder/cinder/backup/chunkeddriver.py:327}} Jul 03 09:44:39.461896 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-d05ff3d6-4b83-4db0-8816-e91017864e60 tempest-VolumesBackupsTest-118275719 None] v1 volume backup restore of 36c3a4f2-c782-418d-be49-db2bcf3421f7 started. {{(pid=101319) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:678}} Jul 03 09:44:39.461896 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-d05ff3d6-4b83-4db0-8816-e91017864e60 tempest-VolumesBackupsTest-118275719 None] metadata_object_names = ['volume_35ece5f1-68f7-4f83-93fb-31eab852a359/20260703094421/az_nova_backup_36c3a4f2-c782-418d-be49-db2bcf3421f7-00001', 'volume_35ece5f1-68f7-4f83-93fb-31eab852a359/20260703094421/az_nova_backup_36c3a4f2-c782-418d-be49-db2bcf3421f7-00002', 'volume_35ece5f1-68f7-4f83-93fb-31eab852a359/20260703094421/az_nova_backup_36c3a4f2-c782-418d-be49-db2bcf3421f7-00003', 'volume_35ece5f1-68f7-4f83-93fb-31eab852a359/20260703094421/az_nova_backup_36c3a4f2-c782-418d-be49-db2bcf3421f7-00004', 'volume_35ece5f1-68f7-4f83-93fb-31eab852a359/20260703094421/az_nova_backup_36c3a4f2-c782-418d-be49-db2bcf3421f7-00005', 'volume_35ece5f1-68f7-4f83-93fb-31eab852a359/20260703094421/az_nova_backup_36c3a4f2-c782-418d-be49-db2bcf3421f7-00006', 'volume_35ece5f1-68f7-4f83-93fb-31eab852a359/20260703094421/az_nova_backup_36c3a4f2-c782-418d-be49-db2bcf3421f7-00007', 'volume_35ece5f1-68f7-4f83-93fb-31eab852a359/20260703094421/az_nova_backup_36c3a4f2-c782-418d-be49-db2bcf3421f7-00008', 'volume_35ece5f1-68f7-4f83-93fb-31eab852a359/20260703094421/az_nova_backup_36c3a4f2-c782-418d-be49-db2bcf3421f7-00009', 'volume_35ece5f1-68f7-4f83-93fb-31eab852a359/20260703094421/az_nova_backup_36c3a4f2-c782-418d-be49-db2bcf3421f7-00010', 'volume_35ece5f1-68f7-4f83-93fb-31eab852a359/20260703094421/az_nova_backup_36c3a4f2-c782-418d-be49-db2bcf3421f7-00011', 'volume_35ece5f1-68f7-4f83-93fb-31eab852a359/20260703094421/az_nova_backup_36c3a4f2-c782-418d-be49-db2bcf3421f7-00012', 'volume_35ece5f1-68f7-4f83-93fb-31eab852a359/20260703094421/az_nova_backup_36c3a4f2-c782-418d-be49-db2bcf3421f7-00013', 'volume_35ece5f1-68f7-4f83-93fb-31eab852a359/20260703094421/az_nova_backup_36c3a4f2-c782-418d-be49-db2bcf3421f7-00014', 'volume_35ece5f1-68f7-4f83-93fb-31eab852a359/20260703094421/az_nova_backup_36c3a4f2-c782-418d-be49-db2bcf3421f7-00015', 'volume_35ece5f1-68f7-4f83-93fb-31eab852a359/20260703094421/az_nova_backup_36c3a4f2-c782-418d-be49-db2bcf3421f7-00016', 'volume_35ece5f1-68f7-4f83-93fb-31eab852a359/20260703094421/az_nova_backup_36c3a4f2-c782-418d-be49-db2bcf3421f7-00017', 'volume_35ece5f1-68f7-4f83-93fb-31eab852a359/20260703094421/az_nova_backup_36c3a4f2-c782-418d-be49-db2bcf3421f7-00018', 'volume_35ece5f1-68f7-4f83-93fb-31eab852a359/20260703094421/az_nova_backup_36c3a4f2-c782-418d-be49-db2bcf3421f7-00019', 'volume_35ece5f1-68f7-4f83-93fb-31eab852a359/20260703094421/az_nova_backup_36c3a4f2-c782-418d-be49-db2bcf3421f7-00020', 'volume_35ece5f1-68f7-4f83-93fb-31eab852a359/20260703094421/az_nova_backup_36c3a4f2-c782-418d-be49-db2bcf3421f7-00021']. {{(pid=101319) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:685}} Jul 03 09:44:39.511506 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-d05ff3d6-4b83-4db0-8816-e91017864e60 tempest-VolumesBackupsTest-118275719 None] generated object list: ['volume_35ece5f1-68f7-4f83-93fb-31eab852a359/20260703094421/az_nova_backup_36c3a4f2-c782-418d-be49-db2bcf3421f7-00001', 'volume_35ece5f1-68f7-4f83-93fb-31eab852a359/20260703094421/az_nova_backup_36c3a4f2-c782-418d-be49-db2bcf3421f7-00002', 'volume_35ece5f1-68f7-4f83-93fb-31eab852a359/20260703094421/az_nova_backup_36c3a4f2-c782-418d-be49-db2bcf3421f7-00003', 'volume_35ece5f1-68f7-4f83-93fb-31eab852a359/20260703094421/az_nova_backup_36c3a4f2-c782-418d-be49-db2bcf3421f7-00004', 'volume_35ece5f1-68f7-4f83-93fb-31eab852a359/20260703094421/az_nova_backup_36c3a4f2-c782-418d-be49-db2bcf3421f7-00005', 'volume_35ece5f1-68f7-4f83-93fb-31eab852a359/20260703094421/az_nova_backup_36c3a4f2-c782-418d-be49-db2bcf3421f7-00006', 'volume_35ece5f1-68f7-4f83-93fb-31eab852a359/20260703094421/az_nova_backup_36c3a4f2-c782-418d-be49-db2bcf3421f7-00007', 'volume_35ece5f1-68f7-4f83-93fb-31eab852a359/20260703094421/az_nova_backup_36c3a4f2-c782-418d-be49-db2bcf3421f7-00008', 'volume_35ece5f1-68f7-4f83-93fb-31eab852a359/20260703094421/az_nova_backup_36c3a4f2-c782-418d-be49-db2bcf3421f7-00009', 'volume_35ece5f1-68f7-4f83-93fb-31eab852a359/20260703094421/az_nova_backup_36c3a4f2-c782-418d-be49-db2bcf3421f7-00010', 'volume_35ece5f1-68f7-4f83-93fb-31eab852a359/20260703094421/az_nova_backup_36c3a4f2-c782-418d-be49-db2bcf3421f7-00011', 'volume_35ece5f1-68f7-4f83-93fb-31eab852a359/20260703094421/az_nova_backup_36c3a4f2-c782-418d-be49-db2bcf3421f7-00012', 'volume_35ece5f1-68f7-4f83-93fb-31eab852a359/20260703094421/az_nova_backup_36c3a4f2-c782-418d-be49-db2bcf3421f7-00013', 'volume_35ece5f1-68f7-4f83-93fb-31eab852a359/20260703094421/az_nova_backup_36c3a4f2-c782-418d-be49-db2bcf3421f7-00014', 'volume_35ece5f1-68f7-4f83-93fb-31eab852a359/20260703094421/az_nova_backup_36c3a4f2-c782-418d-be49-db2bcf3421f7-00015', 'volume_35ece5f1-68f7-4f83-93fb-31eab852a359/20260703094421/az_nova_backup_36c3a4f2-c782-418d-be49-db2bcf3421f7-00016', 'volume_35ece5f1-68f7-4f83-93fb-31eab852a359/20260703094421/az_nova_backup_36c3a4f2-c782-418d-be49-db2bcf3421f7-00017', 'volume_35ece5f1-68f7-4f83-93fb-31eab852a359/20260703094421/az_nova_backup_36c3a4f2-c782-418d-be49-db2bcf3421f7-00018', 'volume_35ece5f1-68f7-4f83-93fb-31eab852a359/20260703094421/az_nova_backup_36c3a4f2-c782-418d-be49-db2bcf3421f7-00019', 'volume_35ece5f1-68f7-4f83-93fb-31eab852a359/20260703094421/az_nova_backup_36c3a4f2-c782-418d-be49-db2bcf3421f7-00020', 'volume_35ece5f1-68f7-4f83-93fb-31eab852a359/20260703094421/az_nova_backup_36c3a4f2-c782-418d-be49-db2bcf3421f7-00021', 'volume_35ece5f1-68f7-4f83-93fb-31eab852a359/20260703094421/az_nova_backup_36c3a4f2-c782-418d-be49-db2bcf3421f7_metadata', 'volume_35ece5f1-68f7-4f83-93fb-31eab852a359/20260703094421/az_nova_backup_36c3a4f2-c782-418d-be49-db2bcf3421f7_sha256file']. {{(pid=101319) _generate_object_names /opt/stack/cinder/cinder/backup/chunkeddriver.py:260}} Jul 03 09:44:39.553703 np0000004400 cinder-backup[101319]: DEBUG oslo_db.sqlalchemy.engines [None req-d05ff3d6-4b83-4db0-8816-e91017864e60 tempest-VolumesBackupsTest-118275719 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=101319) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 03 09:44:39.558223 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-d05ff3d6-4b83-4db0-8816-e91017864e60 tempest-VolumesBackupsTest-118275719 None] restoring object. backup: 36c3a4f2-c782-418d-be49-db2bcf3421f7, container: volumebackups, object name: volume_35ece5f1-68f7-4f83-93fb-31eab852a359/20260703094421/az_nova_backup_36c3a4f2-c782-418d-be49-db2bcf3421f7-00001, volume: 35ece5f1-68f7-4f83-93fb-31eab852a359. {{(pid=101319) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:705}} Jul 03 09:44:39.574558 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-d05ff3d6-4b83-4db0-8816-e91017864e60 tempest-VolumesBackupsTest-118275719 None] decompressing data using zlib algorithm {{(pid=101319) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:722}} Jul 03 09:44:39.959824 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-d05ff3d6-4b83-4db0-8816-e91017864e60 tempest-VolumesBackupsTest-118275719 None] restoring object. backup: 36c3a4f2-c782-418d-be49-db2bcf3421f7, container: volumebackups, object name: volume_35ece5f1-68f7-4f83-93fb-31eab852a359/20260703094421/az_nova_backup_36c3a4f2-c782-418d-be49-db2bcf3421f7-00002, volume: 35ece5f1-68f7-4f83-93fb-31eab852a359. {{(pid=101319) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:705}} Jul 03 09:44:39.973444 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-d05ff3d6-4b83-4db0-8816-e91017864e60 tempest-VolumesBackupsTest-118275719 None] decompressing data using zlib algorithm {{(pid=101319) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:722}} Jul 03 09:44:40.363969 np0000004400 cinder-backup[101319]: DEBUG oslo_service.periodic_task [None req-ffd932d2-122c-4e68-b5ba-628aff7ae7b8 None None] Running periodic task BackupManager.publish_service_capabilities {{(pid=101319) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 03 09:44:40.363969 np0000004400 cinder-backup[101319]: DEBUG cinder.manager [None req-ffd932d2-122c-4e68-b5ba-628aff7ae7b8 None None] Notifying Schedulers of capabilities ... {{(pid=101319) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 03 09:44:40.380553 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-d05ff3d6-4b83-4db0-8816-e91017864e60 tempest-VolumesBackupsTest-118275719 None] restoring object. backup: 36c3a4f2-c782-418d-be49-db2bcf3421f7, container: volumebackups, object name: volume_35ece5f1-68f7-4f83-93fb-31eab852a359/20260703094421/az_nova_backup_36c3a4f2-c782-418d-be49-db2bcf3421f7-00003, volume: 35ece5f1-68f7-4f83-93fb-31eab852a359. {{(pid=101319) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:705}} Jul 03 09:44:40.395707 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-d05ff3d6-4b83-4db0-8816-e91017864e60 tempest-VolumesBackupsTest-118275719 None] decompressing data using zlib algorithm {{(pid=101319) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:722}} Jul 03 09:44:40.776144 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-d05ff3d6-4b83-4db0-8816-e91017864e60 tempest-VolumesBackupsTest-118275719 None] restoring object. backup: 36c3a4f2-c782-418d-be49-db2bcf3421f7, container: volumebackups, object name: volume_35ece5f1-68f7-4f83-93fb-31eab852a359/20260703094421/az_nova_backup_36c3a4f2-c782-418d-be49-db2bcf3421f7-00004, volume: 35ece5f1-68f7-4f83-93fb-31eab852a359. {{(pid=101319) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:705}} Jul 03 09:44:40.789764 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-d05ff3d6-4b83-4db0-8816-e91017864e60 tempest-VolumesBackupsTest-118275719 None] decompressing data using zlib algorithm {{(pid=101319) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:722}} Jul 03 09:44:41.174481 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-d05ff3d6-4b83-4db0-8816-e91017864e60 tempest-VolumesBackupsTest-118275719 None] restoring object. backup: 36c3a4f2-c782-418d-be49-db2bcf3421f7, container: volumebackups, object name: volume_35ece5f1-68f7-4f83-93fb-31eab852a359/20260703094421/az_nova_backup_36c3a4f2-c782-418d-be49-db2bcf3421f7-00005, volume: 35ece5f1-68f7-4f83-93fb-31eab852a359. {{(pid=101319) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:705}} Jul 03 09:44:41.188254 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-d05ff3d6-4b83-4db0-8816-e91017864e60 tempest-VolumesBackupsTest-118275719 None] decompressing data using zlib algorithm {{(pid=101319) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:722}} Jul 03 09:44:41.285557 np0000004400 cinder-backup[101319]: INFO cinder.backup.manager [None req-b6d5137a-1e4e-4124-857c-f62fe2999803 tempest-VolumesBackupsTest-2142009639 None] Create backup started, backup: a636aad8-67e3-4daa-ac42-7179916eefe7 volume: b9d43525-b482-4d2d-8541-23ede348708e. Jul 03 09:44:41.290957 np0000004400 cinder-backup[101319]: INFO cinder.backup.manager [None req-b6d5137a-1e4e-4124-857c-f62fe2999803 tempest-VolumesBackupsTest-2142009639 None] Call Volume Manager to get_backup_device for Backup(availability_zone='nova',container='tempest-volumesbackupstest-backup-container-313960817',created_at=2026-07-03T09:44:41Z,data_timestamp=2026-07-03T09:44:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesBackupsTest-Backup-1496010604',encryption_key_id=None,fail_reason=None,host='np0000004400',id=a636aad8-67e3-4daa-ac42-7179916eefe7,metadata={},num_dependent_backups=0,object_count=0,parent=None,parent_id=None,project_id='59044e18a5b24b19a7b9b8a380f2e1a0',restore_volume_id=None,service='cinder.backup.drivers.swift.SwiftBackupDriver',service_metadata=None,size=1,snapshot_id=None,status='creating',temp_snapshot_id=None,temp_volume_id=None,updated_at=None,user_id='91463b6c437c4711a49d3c31c513a101',volume_id=b9d43525-b482-4d2d-8541-23ede348708e) Jul 03 09:44:41.315706 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.drivers.swift [None req-b6d5137a-1e4e-4124-857c-f62fe2999803 tempest-VolumesBackupsTest-2142009639 None] Using swift URL https://10.4.3.95:8080/v1/AUTH_59044e18a5b24b19a7b9b8a380f2e1a0 {{(pid=101319) initialize /opt/stack/cinder/cinder/backup/drivers/swift.py:300}} Jul 03 09:44:41.315706 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.drivers.swift [None req-b6d5137a-1e4e-4124-857c-f62fe2999803 tempest-VolumesBackupsTest-2142009639 None] Connect to https://10.4.3.95:8080/v1/AUTH_ in "per_user" mode {{(pid=101319) initialize /opt/stack/cinder/cinder/backup/drivers/swift.py:301}} Jul 03 09:44:41.315706 np0000004400 cinder-backup[101319]: DEBUG os_brick.utils [None req-b6d5137a-1e4e-4124-857c-f62fe2999803 tempest-VolumesBackupsTest-2142009639 None] ==> get_connector_properties: call "{'root_helper': 'sudo cinder-rootwrap /etc/cinder/rootwrap.conf', 'my_ip': '10.4.3.95', 'multipath': False, 'enforce_multipath': False, 'host': None, 'execute': None}" {{(pid=101319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}} Jul 03 09:44:41.325666 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.scaleio [None req-b6d5137a-1e4e-4124-857c-f62fe2999803 tempest-VolumesBackupsTest-2142009639 None] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=101319) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}} Jul 03 09:44:41.343901 np0000004400 cinder-backup[101319]: DEBUG oslo_concurrency.processutils [None req-b6d5137a-1e4e-4124-857c-f62fe2999803 tempest-VolumesBackupsTest-2142009639 None] Running cmd (subprocess): nvme version {{(pid=101319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 09:44:41.359277 np0000004400 cinder-backup[101319]: DEBUG oslo_concurrency.processutils [None req-b6d5137a-1e4e-4124-857c-f62fe2999803 tempest-VolumesBackupsTest-2142009639 None] 'nvme version' failed. Not Retrying. {{(pid=101319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 03 09:44:41.359558 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.nvmeof [None req-b6d5137a-1e4e-4124-857c-f62fe2999803 tempest-VolumesBackupsTest-2142009639 None] nvme not present on system {{(pid=101319) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}} Jul 03 09:44:41.403363 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.lightos [None req-b6d5137a-1e4e-4124-857c-f62fe2999803 tempest-VolumesBackupsTest-2142009639 None] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=101319) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}} Jul 03 09:44:41.404729 np0000004400 cinder-backup[101319]: INFO os_brick.initiator.connectors.lightos [None req-b6d5137a-1e4e-4124-857c-f62fe2999803 tempest-VolumesBackupsTest-2142009639 None] Current host hostNQN and IP(s) are ['10.4.3.95', 'fe80::f816:3eff:fe47:268c', '192.168.40.6', 'fe80::f816:3eff:febf:7be2', '192.168.50.6', 'fe80::f816:3eff:fe99:8914', '192.168.10.6', 'fe80::f816:3eff:fe2f:e696', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::bc9d:84ff:fec2:6b49', 'fe80::fc16:3eff:fe36:77bf', 'fe80::4c47:1ff:fe64:1879', 'fe80::fc16:3eff:fec6:c223', 'fe80::fc16:3eff:fef5:5e6e', 'fe80::94d0:62ff:fec5:3886', 'fe80::fc16:3eff:fe48:c24e', 'fe80::fc16:3eff:fea8:bf8b', 'fe80::fc16:3eff:fe42:afa1', 'fe80::fc16:3eff:fea0:4147', 'fe80::b0cf:48ff:fe29:caf0', 'fe80::fc16:3eff:fedf:37a6', 'fe80::fc16:3eff:feec:2e14', 'fe80::a1:38ff:fe3d:434b', 'fe80::fc16:3eff:fe63:d9db'] Jul 03 09:44:41.404885 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.lightos [None req-b6d5137a-1e4e-4124-857c-f62fe2999803 tempest-VolumesBackupsTest-2142009639 None] LIGHTOS: did not find dsc, continuing anyway. {{(pid=101319) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}} Jul 03 09:44:41.405003 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.lightos [None req-b6d5137a-1e4e-4124-857c-f62fe2999803 tempest-VolumesBackupsTest-2142009639 None] LIGHTOS: no hostnqn found. {{(pid=101319) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}} Jul 03 09:44:41.405236 np0000004400 cinder-backup[101319]: DEBUG os_brick.utils [None req-b6d5137a-1e4e-4124-857c-f62fe2999803 tempest-VolumesBackupsTest-2142009639 None] <== get_connector_properties: return (89ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.95', 'host': 'np0000004400', 'multipath': False, 'enforce_multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:ae7e5bb0ebe6', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': '6b284368-d0ba-4d18-af6f-4998d3955c52', 'nvme_native_multipath': False} {{(pid=101319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}} Jul 03 09:44:41.617995 np0000004400 cinder-backup[101319]: DEBUG oslo_db.sqlalchemy.engines [None req-d05ff3d6-4b83-4db0-8816-e91017864e60 tempest-VolumesBackupsTest-118275719 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=101319) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 03 09:44:41.622165 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-d05ff3d6-4b83-4db0-8816-e91017864e60 tempest-VolumesBackupsTest-118275719 None] restoring object. backup: 36c3a4f2-c782-418d-be49-db2bcf3421f7, container: volumebackups, object name: volume_35ece5f1-68f7-4f83-93fb-31eab852a359/20260703094421/az_nova_backup_36c3a4f2-c782-418d-be49-db2bcf3421f7-00006, volume: 35ece5f1-68f7-4f83-93fb-31eab852a359. {{(pid=101319) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:705}} Jul 03 09:44:41.637771 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-d05ff3d6-4b83-4db0-8816-e91017864e60 tempest-VolumesBackupsTest-118275719 None] decompressing data using zlib algorithm {{(pid=101319) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:722}} Jul 03 09:44:42.008988 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connector [None req-b6d5137a-1e4e-4124-857c-f62fe2999803 tempest-VolumesBackupsTest-2142009639 None] Factory for iscsi on None {{(pid=101319) factory /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connector.py:243}} Jul 03 09:44:42.009336 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-b6d5137a-1e4e-4124-857c-f62fe2999803 tempest-VolumesBackupsTest-2142009639 None] ==> connect_volume: call "{'self': , 'connection_properties': {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-b9d43525-b482-4d2d-8541-23ede348708e', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'b9d43525-b482-4d2d-8541-23ede348708e', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': False}}" {{(pid=101319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}} Jul 03 09:44:42.009545 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.base [None req-b6d5137a-1e4e-4124-857c-f62fe2999803 tempest-VolumesBackupsTest-2142009639 None] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=101319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jul 03 09:44:42.013988 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-d05ff3d6-4b83-4db0-8816-e91017864e60 tempest-VolumesBackupsTest-118275719 None] restoring object. backup: 36c3a4f2-c782-418d-be49-db2bcf3421f7, container: volumebackups, object name: volume_35ece5f1-68f7-4f83-93fb-31eab852a359/20260703094421/az_nova_backup_36c3a4f2-c782-418d-be49-db2bcf3421f7-00007, volume: 35ece5f1-68f7-4f83-93fb-31eab852a359. {{(pid=101319) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:705}} Jul 03 09:44:42.025928 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-d05ff3d6-4b83-4db0-8816-e91017864e60 tempest-VolumesBackupsTest-118275719 None] decompressing data using zlib algorithm {{(pid=101319) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:722}} Jul 03 09:44:42.401226 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-d05ff3d6-4b83-4db0-8816-e91017864e60 tempest-VolumesBackupsTest-118275719 None] restoring object. backup: 36c3a4f2-c782-418d-be49-db2bcf3421f7, container: volumebackups, object name: volume_35ece5f1-68f7-4f83-93fb-31eab852a359/20260703094421/az_nova_backup_36c3a4f2-c782-418d-be49-db2bcf3421f7-00008, volume: 35ece5f1-68f7-4f83-93fb-31eab852a359. {{(pid=101319) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:705}} Jul 03 09:44:42.416158 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-d05ff3d6-4b83-4db0-8816-e91017864e60 tempest-VolumesBackupsTest-118275719 None] decompressing data using zlib algorithm {{(pid=101319) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:722}} Jul 03 09:44:42.838267 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-d05ff3d6-4b83-4db0-8816-e91017864e60 tempest-VolumesBackupsTest-118275719 None] restoring object. backup: 36c3a4f2-c782-418d-be49-db2bcf3421f7, container: volumebackups, object name: volume_35ece5f1-68f7-4f83-93fb-31eab852a359/20260703094421/az_nova_backup_36c3a4f2-c782-418d-be49-db2bcf3421f7-00009, volume: 35ece5f1-68f7-4f83-93fb-31eab852a359. {{(pid=101319) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:705}} Jul 03 09:44:42.851690 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-d05ff3d6-4b83-4db0-8816-e91017864e60 tempest-VolumesBackupsTest-118275719 None] decompressing data using zlib algorithm {{(pid=101319) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:722}} Jul 03 09:44:43.226034 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-d05ff3d6-4b83-4db0-8816-e91017864e60 tempest-VolumesBackupsTest-118275719 None] restoring object. backup: 36c3a4f2-c782-418d-be49-db2bcf3421f7, container: volumebackups, object name: volume_35ece5f1-68f7-4f83-93fb-31eab852a359/20260703094421/az_nova_backup_36c3a4f2-c782-418d-be49-db2bcf3421f7-00010, volume: 35ece5f1-68f7-4f83-93fb-31eab852a359. {{(pid=101319) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:705}} Jul 03 09:44:43.238693 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-d05ff3d6-4b83-4db0-8816-e91017864e60 tempest-VolumesBackupsTest-118275719 None] decompressing data using zlib algorithm {{(pid=101319) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:722}} Jul 03 09:44:43.622449 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-d05ff3d6-4b83-4db0-8816-e91017864e60 tempest-VolumesBackupsTest-118275719 None] restoring object. backup: 36c3a4f2-c782-418d-be49-db2bcf3421f7, container: volumebackups, object name: volume_35ece5f1-68f7-4f83-93fb-31eab852a359/20260703094421/az_nova_backup_36c3a4f2-c782-418d-be49-db2bcf3421f7-00011, volume: 35ece5f1-68f7-4f83-93fb-31eab852a359. {{(pid=101319) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:705}} Jul 03 09:44:43.636918 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-d05ff3d6-4b83-4db0-8816-e91017864e60 tempest-VolumesBackupsTest-118275719 None] decompressing data using zlib algorithm {{(pid=101319) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:722}} Jul 03 09:44:44.023466 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-d05ff3d6-4b83-4db0-8816-e91017864e60 tempest-VolumesBackupsTest-118275719 None] restoring object. backup: 36c3a4f2-c782-418d-be49-db2bcf3421f7, container: volumebackups, object name: volume_35ece5f1-68f7-4f83-93fb-31eab852a359/20260703094421/az_nova_backup_36c3a4f2-c782-418d-be49-db2bcf3421f7-00012, volume: 35ece5f1-68f7-4f83-93fb-31eab852a359. {{(pid=101319) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:705}} Jul 03 09:44:44.041943 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-d05ff3d6-4b83-4db0-8816-e91017864e60 tempest-VolumesBackupsTest-118275719 None] decompressing data using zlib algorithm {{(pid=101319) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:722}} Jul 03 09:44:44.418084 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-d05ff3d6-4b83-4db0-8816-e91017864e60 tempest-VolumesBackupsTest-118275719 None] restoring object. backup: 36c3a4f2-c782-418d-be49-db2bcf3421f7, container: volumebackups, object name: volume_35ece5f1-68f7-4f83-93fb-31eab852a359/20260703094421/az_nova_backup_36c3a4f2-c782-418d-be49-db2bcf3421f7-00013, volume: 35ece5f1-68f7-4f83-93fb-31eab852a359. {{(pid=101319) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:705}} Jul 03 09:44:44.431974 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-d05ff3d6-4b83-4db0-8816-e91017864e60 tempest-VolumesBackupsTest-118275719 None] decompressing data using zlib algorithm {{(pid=101319) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:722}} Jul 03 09:44:44.816749 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.base [None req-b6d5137a-1e4e-4124-857c-f62fe2999803 tempest-VolumesBackupsTest-2142009639 None] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 2.807s {{(pid=101319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jul 03 09:44:44.817177 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.base [None req-b6d5137a-1e4e-4124-857c-f62fe2999803 tempest-VolumesBackupsTest-2142009639 None] Connection properties {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-b9d43525-b482-4d2d-8541-23ede348708e', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'b9d43525-b482-4d2d-8541-23ede348708e', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': False} {{(pid=101319) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}} Jul 03 09:44:44.823648 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-d05ff3d6-4b83-4db0-8816-e91017864e60 tempest-VolumesBackupsTest-118275719 None] restoring object. backup: 36c3a4f2-c782-418d-be49-db2bcf3421f7, container: volumebackups, object name: volume_35ece5f1-68f7-4f83-93fb-31eab852a359/20260703094421/az_nova_backup_36c3a4f2-c782-418d-be49-db2bcf3421f7-00014, volume: 35ece5f1-68f7-4f83-93fb-31eab852a359. {{(pid=101319) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:705}} Jul 03 09:44:44.828070 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.base [None req-b6d5137a-1e4e-4124-857c-f62fe2999803 tempest-VolumesBackupsTest-2142009639 None] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-b9d43525-b482-4d2d-8541-23ede348708e" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=101319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jul 03 09:44:44.828513 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.base [None req-b6d5137a-1e4e-4124-857c-f62fe2999803 tempest-VolumesBackupsTest-2142009639 None] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-b9d43525-b482-4d2d-8541-23ede348708e" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.000s {{(pid=101319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jul 03 09:44:44.829602 np0000004400 cinder-backup[101319]: INFO os_brick.initiator.connectors.iscsi [None req-b6d5137a-1e4e-4124-857c-f62fe2999803 tempest-VolumesBackupsTest-2142009639 None] Trying to connect to iSCSI portal 192.168.40.100:3260 Jul 03 09:44:44.838921 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-d05ff3d6-4b83-4db0-8816-e91017864e60 tempest-VolumesBackupsTest-118275719 None] decompressing data using zlib algorithm {{(pid=101319) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:722}} Jul 03 09:44:44.840147 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-b6d5137a-1e4e-4124-857c-f62fe2999803 tempest-VolumesBackupsTest-2142009639 None] iscsiadm (): stdout= stderr=iscsiadm: No records found Jul 03 09:44:44.840147 np0000004400 cinder-backup[101319]: {{(pid=101319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 03 09:44:44.852432 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-b6d5137a-1e4e-4124-857c-f62fe2999803 tempest-VolumesBackupsTest-2142009639 None] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-b9d43525-b482-4d2d-8541-23ede348708e] added Jul 03 09:44:44.852432 np0000004400 cinder-backup[101319]: stderr=iscsiadm: Config file line 363 does not have value Jul 03 09:44:44.852432 np0000004400 cinder-backup[101319]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs' Jul 03 09:44:44.852432 np0000004400 cinder-backup[101319]: iscsiadm: Config file line 363 does not have value Jul 03 09:44:44.852432 np0000004400 cinder-backup[101319]: iscsiadm: Config file line 363 does not have value Jul 03 09:44:44.852432 np0000004400 cinder-backup[101319]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs' Jul 03 09:44:44.852432 np0000004400 cinder-backup[101319]: {{(pid=101319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 03 09:44:44.852432 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-b6d5137a-1e4e-4124-857c-f62fe2999803 tempest-VolumesBackupsTest-2142009639 None] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=101319) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}} Jul 03 09:44:44.852432 np0000004400 cinder-backup[101319]: DEBUG os_brick.utils [None req-b6d5137a-1e4e-4124-857c-f62fe2999803 tempest-VolumesBackupsTest-2142009639 None] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0222(s), this was the 1st time calling it. {{(pid=101319) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}} Jul 03 09:44:44.852432 np0000004400 cinder-backup[101319]: DEBUG os_brick.utils [None req-b6d5137a-1e4e-4124-857c-f62fe2999803 tempest-VolumesBackupsTest-2142009639 None] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=101319) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}} Jul 03 09:44:45.244132 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-d05ff3d6-4b83-4db0-8816-e91017864e60 tempest-VolumesBackupsTest-118275719 None] restoring object. backup: 36c3a4f2-c782-418d-be49-db2bcf3421f7, container: volumebackups, object name: volume_35ece5f1-68f7-4f83-93fb-31eab852a359/20260703094421/az_nova_backup_36c3a4f2-c782-418d-be49-db2bcf3421f7-00015, volume: 35ece5f1-68f7-4f83-93fb-31eab852a359. {{(pid=101319) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:705}} Jul 03 09:44:45.260126 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-d05ff3d6-4b83-4db0-8816-e91017864e60 tempest-VolumesBackupsTest-118275719 None] decompressing data using zlib algorithm {{(pid=101319) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:722}} Jul 03 09:44:45.343290 np0000004400 cinder-backup[101319]: INFO cinder.backup.manager [None req-1aa1df77-90d9-4e9a-ab00-286bc8c3649e tempest-TestVolumeBackupRestore-997771116 None] Delete backup started, backup: 8727aa2b-db7a-4559-b380-bc6d983ed688. Jul 03 09:44:45.346938 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.drivers.swift [None req-1aa1df77-90d9-4e9a-ab00-286bc8c3649e tempest-TestVolumeBackupRestore-997771116 None] Using swift URL https://10.4.3.95:8080/v1/AUTH_8a91a271598c49e1b52c4e2c3a0f4413 {{(pid=101319) initialize /opt/stack/cinder/cinder/backup/drivers/swift.py:300}} Jul 03 09:44:45.347153 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.drivers.swift [None req-1aa1df77-90d9-4e9a-ab00-286bc8c3649e tempest-TestVolumeBackupRestore-997771116 None] Connect to https://10.4.3.95:8080/v1/AUTH_ in "per_user" mode {{(pid=101319) initialize /opt/stack/cinder/cinder/backup/drivers/swift.py:301}} Jul 03 09:44:45.347393 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-1aa1df77-90d9-4e9a-ab00-286bc8c3649e tempest-TestVolumeBackupRestore-997771116 None] delete started, backup: 8727aa2b-db7a-4559-b380-bc6d983ed688, container: volumebackups, prefix: volume_1c366dd9-1a3c-4cb8-8f7c-4fdabf6fb81e/20260703094315/az_nova_backup_8727aa2b-db7a-4559-b380-bc6d983ed688. {{(pid=101319) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:822}} Jul 03 09:44:45.412205 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-1aa1df77-90d9-4e9a-ab00-286bc8c3649e tempest-TestVolumeBackupRestore-997771116 None] generated object list: ['volume_1c366dd9-1a3c-4cb8-8f7c-4fdabf6fb81e/20260703094315/az_nova_backup_8727aa2b-db7a-4559-b380-bc6d983ed688-00001', 'volume_1c366dd9-1a3c-4cb8-8f7c-4fdabf6fb81e/20260703094315/az_nova_backup_8727aa2b-db7a-4559-b380-bc6d983ed688-00002', 'volume_1c366dd9-1a3c-4cb8-8f7c-4fdabf6fb81e/20260703094315/az_nova_backup_8727aa2b-db7a-4559-b380-bc6d983ed688-00003', 'volume_1c366dd9-1a3c-4cb8-8f7c-4fdabf6fb81e/20260703094315/az_nova_backup_8727aa2b-db7a-4559-b380-bc6d983ed688-00004', 'volume_1c366dd9-1a3c-4cb8-8f7c-4fdabf6fb81e/20260703094315/az_nova_backup_8727aa2b-db7a-4559-b380-bc6d983ed688-00005', 'volume_1c366dd9-1a3c-4cb8-8f7c-4fdabf6fb81e/20260703094315/az_nova_backup_8727aa2b-db7a-4559-b380-bc6d983ed688-00006', 'volume_1c366dd9-1a3c-4cb8-8f7c-4fdabf6fb81e/20260703094315/az_nova_backup_8727aa2b-db7a-4559-b380-bc6d983ed688-00007', 'volume_1c366dd9-1a3c-4cb8-8f7c-4fdabf6fb81e/20260703094315/az_nova_backup_8727aa2b-db7a-4559-b380-bc6d983ed688-00008', 'volume_1c366dd9-1a3c-4cb8-8f7c-4fdabf6fb81e/20260703094315/az_nova_backup_8727aa2b-db7a-4559-b380-bc6d983ed688-00009', 'volume_1c366dd9-1a3c-4cb8-8f7c-4fdabf6fb81e/20260703094315/az_nova_backup_8727aa2b-db7a-4559-b380-bc6d983ed688-00010', 'volume_1c366dd9-1a3c-4cb8-8f7c-4fdabf6fb81e/20260703094315/az_nova_backup_8727aa2b-db7a-4559-b380-bc6d983ed688-00011', 'volume_1c366dd9-1a3c-4cb8-8f7c-4fdabf6fb81e/20260703094315/az_nova_backup_8727aa2b-db7a-4559-b380-bc6d983ed688-00012', 'volume_1c366dd9-1a3c-4cb8-8f7c-4fdabf6fb81e/20260703094315/az_nova_backup_8727aa2b-db7a-4559-b380-bc6d983ed688-00013', 'volume_1c366dd9-1a3c-4cb8-8f7c-4fdabf6fb81e/20260703094315/az_nova_backup_8727aa2b-db7a-4559-b380-bc6d983ed688-00014', 'volume_1c366dd9-1a3c-4cb8-8f7c-4fdabf6fb81e/20260703094315/az_nova_backup_8727aa2b-db7a-4559-b380-bc6d983ed688-00015', 'volume_1c366dd9-1a3c-4cb8-8f7c-4fdabf6fb81e/20260703094315/az_nova_backup_8727aa2b-db7a-4559-b380-bc6d983ed688-00016', 'volume_1c366dd9-1a3c-4cb8-8f7c-4fdabf6fb81e/20260703094315/az_nova_backup_8727aa2b-db7a-4559-b380-bc6d983ed688-00017', 'volume_1c366dd9-1a3c-4cb8-8f7c-4fdabf6fb81e/20260703094315/az_nova_backup_8727aa2b-db7a-4559-b380-bc6d983ed688-00018', 'volume_1c366dd9-1a3c-4cb8-8f7c-4fdabf6fb81e/20260703094315/az_nova_backup_8727aa2b-db7a-4559-b380-bc6d983ed688-00019', 'volume_1c366dd9-1a3c-4cb8-8f7c-4fdabf6fb81e/20260703094315/az_nova_backup_8727aa2b-db7a-4559-b380-bc6d983ed688-00020', 'volume_1c366dd9-1a3c-4cb8-8f7c-4fdabf6fb81e/20260703094315/az_nova_backup_8727aa2b-db7a-4559-b380-bc6d983ed688-00021', 'volume_1c366dd9-1a3c-4cb8-8f7c-4fdabf6fb81e/20260703094315/az_nova_backup_8727aa2b-db7a-4559-b380-bc6d983ed688_metadata', 'volume_1c366dd9-1a3c-4cb8-8f7c-4fdabf6fb81e/20260703094315/az_nova_backup_8727aa2b-db7a-4559-b380-bc6d983ed688_sha256file']. {{(pid=101319) _generate_object_names /opt/stack/cinder/cinder/backup/chunkeddriver.py:260}} Jul 03 09:44:45.476052 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-1aa1df77-90d9-4e9a-ab00-286bc8c3649e tempest-TestVolumeBackupRestore-997771116 None] deleted object: volume_1c366dd9-1a3c-4cb8-8f7c-4fdabf6fb81e/20260703094315/az_nova_backup_8727aa2b-db7a-4559-b380-bc6d983ed688-00001 in container: volumebackups. {{(pid=101319) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 09:44:45.501763 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-1aa1df77-90d9-4e9a-ab00-286bc8c3649e tempest-TestVolumeBackupRestore-997771116 None] deleted object: volume_1c366dd9-1a3c-4cb8-8f7c-4fdabf6fb81e/20260703094315/az_nova_backup_8727aa2b-db7a-4559-b380-bc6d983ed688-00002 in container: volumebackups. {{(pid=101319) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 09:44:45.529736 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-1aa1df77-90d9-4e9a-ab00-286bc8c3649e tempest-TestVolumeBackupRestore-997771116 None] deleted object: volume_1c366dd9-1a3c-4cb8-8f7c-4fdabf6fb81e/20260703094315/az_nova_backup_8727aa2b-db7a-4559-b380-bc6d983ed688-00003 in container: volumebackups. {{(pid=101319) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 09:44:45.703909 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-1aa1df77-90d9-4e9a-ab00-286bc8c3649e tempest-TestVolumeBackupRestore-997771116 None] deleted object: volume_1c366dd9-1a3c-4cb8-8f7c-4fdabf6fb81e/20260703094315/az_nova_backup_8727aa2b-db7a-4559-b380-bc6d983ed688-00004 in container: volumebackups. {{(pid=101319) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 09:44:45.717008 np0000004400 cinder-backup[101319]: DEBUG oslo_db.sqlalchemy.engines [None req-d05ff3d6-4b83-4db0-8816-e91017864e60 tempest-VolumesBackupsTest-118275719 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=101319) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 03 09:44:45.721285 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-d05ff3d6-4b83-4db0-8816-e91017864e60 tempest-VolumesBackupsTest-118275719 None] restoring object. backup: 36c3a4f2-c782-418d-be49-db2bcf3421f7, container: volumebackups, object name: volume_35ece5f1-68f7-4f83-93fb-31eab852a359/20260703094421/az_nova_backup_36c3a4f2-c782-418d-be49-db2bcf3421f7-00016, volume: 35ece5f1-68f7-4f83-93fb-31eab852a359. {{(pid=101319) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:705}} Jul 03 09:44:45.730294 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-1aa1df77-90d9-4e9a-ab00-286bc8c3649e tempest-TestVolumeBackupRestore-997771116 None] deleted object: volume_1c366dd9-1a3c-4cb8-8f7c-4fdabf6fb81e/20260703094315/az_nova_backup_8727aa2b-db7a-4559-b380-bc6d983ed688-00005 in container: volumebackups. {{(pid=101319) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 09:44:45.747574 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-d05ff3d6-4b83-4db0-8816-e91017864e60 tempest-VolumesBackupsTest-118275719 None] decompressing data using zlib algorithm {{(pid=101319) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:722}} Jul 03 09:44:45.754004 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-1aa1df77-90d9-4e9a-ab00-286bc8c3649e tempest-TestVolumeBackupRestore-997771116 None] deleted object: volume_1c366dd9-1a3c-4cb8-8f7c-4fdabf6fb81e/20260703094315/az_nova_backup_8727aa2b-db7a-4559-b380-bc6d983ed688-00006 in container: volumebackups. {{(pid=101319) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 09:44:45.774503 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-1aa1df77-90d9-4e9a-ab00-286bc8c3649e tempest-TestVolumeBackupRestore-997771116 None] deleted object: volume_1c366dd9-1a3c-4cb8-8f7c-4fdabf6fb81e/20260703094315/az_nova_backup_8727aa2b-db7a-4559-b380-bc6d983ed688-00007 in container: volumebackups. {{(pid=101319) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 09:44:45.789815 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-1aa1df77-90d9-4e9a-ab00-286bc8c3649e tempest-TestVolumeBackupRestore-997771116 None] deleted object: volume_1c366dd9-1a3c-4cb8-8f7c-4fdabf6fb81e/20260703094315/az_nova_backup_8727aa2b-db7a-4559-b380-bc6d983ed688-00008 in container: volumebackups. {{(pid=101319) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 09:44:45.813200 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-1aa1df77-90d9-4e9a-ab00-286bc8c3649e tempest-TestVolumeBackupRestore-997771116 None] deleted object: volume_1c366dd9-1a3c-4cb8-8f7c-4fdabf6fb81e/20260703094315/az_nova_backup_8727aa2b-db7a-4559-b380-bc6d983ed688-00009 in container: volumebackups. {{(pid=101319) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 09:44:45.830594 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-1aa1df77-90d9-4e9a-ab00-286bc8c3649e tempest-TestVolumeBackupRestore-997771116 None] deleted object: volume_1c366dd9-1a3c-4cb8-8f7c-4fdabf6fb81e/20260703094315/az_nova_backup_8727aa2b-db7a-4559-b380-bc6d983ed688-00010 in container: volumebackups. {{(pid=101319) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 09:44:45.851835 np0000004400 cinder-backup[101319]: INFO os_brick.initiator.connectors.iscsi [None req-b6d5137a-1e4e-4124-857c-f62fe2999803 tempest-VolumesBackupsTest-2142009639 None] Trying to connect to iSCSI portal 192.168.40.100:3260 Jul 03 09:44:45.856695 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-1aa1df77-90d9-4e9a-ab00-286bc8c3649e tempest-TestVolumeBackupRestore-997771116 None] deleted object: volume_1c366dd9-1a3c-4cb8-8f7c-4fdabf6fb81e/20260703094315/az_nova_backup_8727aa2b-db7a-4559-b380-bc6d983ed688-00011 in container: volumebackups. {{(pid=101319) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 09:44:45.863222 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-b6d5137a-1e4e-4124-857c-f62fe2999803 tempest-VolumesBackupsTest-2142009639 None] iscsiadm (): stdout=# BEGIN RECORD 2.1.9 Jul 03 09:44:45.863222 np0000004400 cinder-backup[101319]: node.name = iqn.2023-03.storpool.com:os--volume-b9d43525-b482-4d2d-8541-23ede348708e Jul 03 09:44:45.863222 np0000004400 cinder-backup[101319]: node.tpgt = -1 Jul 03 09:44:45.863222 np0000004400 cinder-backup[101319]: node.startup = manual Jul 03 09:44:45.863222 np0000004400 cinder-backup[101319]: node.leading_login = No Jul 03 09:44:45.863222 np0000004400 cinder-backup[101319]: iface.iscsi_ifacename = default Jul 03 09:44:45.863222 np0000004400 cinder-backup[101319]: iface.net_ifacename = Jul 03 09:44:45.863222 np0000004400 cinder-backup[101319]: iface.ipaddress = Jul 03 09:44:45.863222 np0000004400 cinder-backup[101319]: iface.prefix_len = 0 Jul 03 09:44:45.863222 np0000004400 cinder-backup[101319]: iface.hwaddress = Jul 03 09:44:45.863222 np0000004400 cinder-backup[101319]: iface.transport_name = tcp Jul 03 09:44:45.863222 np0000004400 cinder-backup[101319]: iface.initiatorname = Jul 03 09:44:45.863222 np0000004400 cinder-backup[101319]: iface.state = Jul 03 09:44:45.863222 np0000004400 cinder-backup[101319]: iface.vlan_id = 0 Jul 03 09:44:45.863222 np0000004400 cinder-backup[101319]: iface.vlan_priority = 0 Jul 03 09:44:45.863222 np0000004400 cinder-backup[101319]: iface.vlan_state = Jul 03 09:44:45.863222 np0000004400 cinder-backup[101319]: iface.iface_num = 0 Jul 03 09:44:45.863222 np0000004400 cinder-backup[101319]: iface.mtu = 0 Jul 03 09:44:45.863222 np0000004400 cinder-backup[101319]: iface.port = 0 Jul 03 09:44:45.863222 np0000004400 cinder-backup[101319]: iface.bootproto = Jul 03 09:44:45.863222 np0000004400 cinder-backup[101319]: iface.subnet_mask = Jul 03 09:44:45.863222 np0000004400 cinder-backup[101319]: iface.gateway = Jul 03 09:44:45.863222 np0000004400 cinder-backup[101319]: iface.dhcp_alt_client_id_state = Jul 03 09:44:45.863222 np0000004400 cinder-backup[101319]: iface.dhcp_alt_client_id = Jul 03 09:44:45.863222 np0000004400 cinder-backup[101319]: iface.dhcp_dns = Jul 03 09:44:45.863222 np0000004400 cinder-backup[101319]: iface.dhcp_learn_iqn = Jul 03 09:44:45.863222 np0000004400 cinder-backup[101319]: iface.dhcp_req_vendor_id_state = Jul 03 09:44:45.863222 np0000004400 cinder-backup[101319]: iface.dhcp_vendor_id_state = Jul 03 09:44:45.863222 np0000004400 cinder-backup[101319]: iface.dhcp_vendor_id = Jul 03 09:44:45.863222 np0000004400 cinder-backup[101319]: iface.dhcp_slp_da = Jul 03 09:44:45.863222 np0000004400 cinder-backup[101319]: iface.fragmentation = Jul 03 09:44:45.863222 np0000004400 cinder-backup[101319]: iface.gratuitous_arp = Jul 03 09:44:45.863222 np0000004400 cinder-backup[101319]: iface.incoming_forwarding = Jul 03 09:44:45.863222 np0000004400 cinder-backup[101319]: iface.tos_state = Jul 03 09:44:45.863222 np0000004400 cinder-backup[101319]: iface.tos = 0 Jul 03 09:44:45.863222 np0000004400 cinder-backup[101319]: iface.ttl = 0 Jul 03 09:44:45.863222 np0000004400 cinder-backup[101319]: iface.delayed_ack = Jul 03 09:44:45.863222 np0000004400 cinder-backup[101319]: iface.tcp_nagle = Jul 03 09:44:45.863222 np0000004400 cinder-backup[101319]: iface.tcp_wsf_state = Jul 03 09:44:45.863222 np0000004400 cinder-backup[101319]: iface.tcp_wsf = 0 Jul 03 09:44:45.863222 np0000004400 cinder-backup[101319]: iface.tcp_timer_scale = 0 Jul 03 09:44:45.863222 np0000004400 cinder-backup[101319]: iface.tcp_timestamp = Jul 03 09:44:45.863222 np0000004400 cinder-backup[101319]: iface.redirect = Jul 03 09:44:45.863222 np0000004400 cinder-backup[101319]: iface.def_task_mgmt_timeout = 0 Jul 03 09:44:45.863222 np0000004400 cinder-backup[101319]: iface.header_digest = Jul 03 09:44:45.863222 np0000004400 cinder-backup[101319]: iface.data_digest = Jul 03 09:44:45.863222 np0000004400 cinder-backup[101319]: iface.immediate_data = Jul 03 09:44:45.863222 np0000004400 cinder-backup[101319]: iface.initial_r2t = Jul 03 09:44:45.863222 np0000004400 cinder-backup[101319]: iface.data_seq_inorder = Jul 03 09:44:45.863222 np0000004400 cinder-backup[101319]: iface.data_pdu_inorder = Jul 03 09:44:45.863222 np0000004400 cinder-backup[101319]: iface.erl = 0 Jul 03 09:44:45.863222 np0000004400 cinder-backup[101319]: iface.max_receive_data_len = 0 Jul 03 09:44:45.863222 np0000004400 cinder-backup[101319]: iface.first_burst_len = 0 Jul 03 09:44:45.863222 np0000004400 cinder-backup[101319]: iface.max_outstanding_r2t = 0 Jul 03 09:44:45.863222 np0000004400 cinder-backup[101319]: iface.max_burst_len = 0 Jul 03 09:44:45.863222 np0000004400 cinder-backup[101319]: iface.chap_auth = Jul 03 09:44:45.863222 np0000004400 cinder-backup[101319]: iface.bidi_chap = Jul 03 09:44:45.863222 np0000004400 cinder-backup[101319]: iface.strict_login_compliance = Jul 03 09:44:45.863222 np0000004400 cinder-backup[101319]: iface.discovery_auth = Jul 03 09:44:45.863222 np0000004400 cinder-backup[101319]: iface.discovery_logout = Jul 03 09:44:45.863222 np0000004400 cinder-backup[101319]: node.discovery_address = Jul 03 09:44:45.863222 np0000004400 cinder-backup[101319]: node.discovery_port = 0 Jul 03 09:44:45.863222 np0000004400 cinder-backup[101319]: node.discovery_type = fw Jul 03 09:44:45.863222 np0000004400 cinder-backup[101319]: node.session.initial_cmdsn = 0 Jul 03 09:44:45.863222 np0000004400 cinder-backup[101319]: node.session.initial_login_retry_max = 8 Jul 03 09:44:45.863222 np0000004400 cinder-backup[101319]: node.session.xmit_thread_priority = 0 Jul 03 09:44:45.863222 np0000004400 cinder-backup[101319]: node.session.cmds_max = 128 Jul 03 09:44:45.863222 np0000004400 cinder-backup[101319]: node.session.queue_depth = 32 Jul 03 09:44:45.863222 np0000004400 cinder-backup[101319]: node.session.nr_sessions = 1 Jul 03 09:44:45.863222 np0000004400 cinder-backup[101319]: node.session.auth.authmethod = None Jul 03 09:44:45.863222 np0000004400 cinder-backup[101319]: node.session.auth.username = Jul 03 09:44:45.863222 np0000004400 cinder-backup[101319]: node.session.auth.password = *** Jul 03 09:44:45.863222 np0000004400 cinder-backup[101319]: node.session.auth.username_in = Jul 03 09:44:45.863222 np0000004400 cinder-backup[101319]: node.session.auth.password_in = Jul 03 09:44:45.863222 np0000004400 cinder-backup[101319]: node.session.auth.chap_algs = SHA256 Jul 03 09:44:45.863222 np0000004400 cinder-backup[101319]: node.session.timeo.replacement_timeout = 120 Jul 03 09:44:45.863222 np0000004400 cinder-backup[101319]: node.session.err_timeo.abort_timeout = 15 Jul 03 09:44:45.863222 np0000004400 cinder-backup[101319]: node.session.err_timeo.lu_reset_timeout = 30 Jul 03 09:44:45.863222 np0000004400 cinder-backup[101319]: node.session.err_timeo.tgt_reset_timeout = 30 Jul 03 09:44:45.863222 np0000004400 cinder-backup[101319]: node.session.err_timeo.host_reset_timeout = 60 Jul 03 09:44:45.863222 np0000004400 cinder-backup[101319]: node.session.iscsi.FastAbort = Yes Jul 03 09:44:45.863222 np0000004400 cinder-backup[101319]: node.session.iscsi.InitialR2T = No Jul 03 09:44:45.863222 np0000004400 cinder-backup[101319]: node.session.iscsi.ImmediateData = Yes Jul 03 09:44:45.863222 np0000004400 cinder-backup[101319]: node.session.iscsi.FirstBurstLength = 262144 Jul 03 09:44:45.863222 np0000004400 cinder-backup[101319]: node.session.iscsi.MaxBurstLength = 16776192 Jul 03 09:44:45.863222 np0000004400 cinder-backup[101319]: node.session.iscsi.DefaultTime2Retain = 0 Jul 03 09:44:45.863222 np0000004400 cinder-backup[101319]: node.session.iscsi.DefaultTime2Wait = 2 Jul 03 09:44:45.863222 np0000004400 cinder-backup[101319]: node.session.iscsi.MaxConnections = 1 Jul 03 09:44:45.863222 np0000004400 cinder-backup[101319]: node.session.iscsi.MaxOutstandingR2T = 1 Jul 03 09:44:45.863222 np0000004400 cinder-backup[101319]: node.session.iscsi.ERL = 0 Jul 03 09:44:45.863222 np0000004400 cinder-backup[101319]: node.session.scan = auto Jul 03 09:44:45.863222 np0000004400 cinder-backup[101319]: node.session.reopen_max = 0 Jul 03 09:44:45.863222 np0000004400 cinder-backup[101319]: node.conn[0].address = 192.168.40.100 Jul 03 09:44:45.863222 np0000004400 cinder-backup[101319]: node.conn[0].port = 3260 Jul 03 09:44:45.863222 np0000004400 cinder-backup[101319]: node.conn[0].startup = manual Jul 03 09:44:45.863222 np0000004400 cinder-backup[101319]: node.conn[0].tcp.window_size = 524288 Jul 03 09:44:45.863222 np0000004400 cinder-backup[101319]: node.conn[0].tcp.type_of_service = 0 Jul 03 09:44:45.863222 np0000004400 cinder-backup[101319]: node.conn[0].timeo.logout_timeout = 15 Jul 03 09:44:45.863222 np0000004400 cinder-backup[101319]: node.conn[0].timeo.login_timeout = 15 Jul 03 09:44:45.863222 np0000004400 cinder-backup[101319]: node.conn[0].timeo.auth_timeout = 45 Jul 03 09:44:45.863222 np0000004400 cinder-backup[101319]: node.conn[0].timeo.noop_out_interval = 5 Jul 03 09:44:45.863222 np0000004400 cinder-backup[101319]: node.conn[0].timeo.noop_out_timeout = 5 Jul 03 09:44:45.863222 np0000004400 cinder-backup[101319]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0 Jul 03 09:44:45.863222 np0000004400 cinder-backup[101319]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144 Jul 03 09:44:45.863222 np0000004400 cinder-backup[101319]: node.conn[0].iscsi.HeaderDigest = None Jul 03 09:44:45.863222 np0000004400 cinder-backup[101319]: node.conn[0].iscsi.DataDigest = None Jul 03 09:44:45.863222 np0000004400 cinder-backup[101319]: node.conn[0].iscsi.IFMarker = No Jul 03 09:44:45.863222 np0000004400 cinder-backup[101319]: node.conn[0].iscsi.OFMarker = No Jul 03 09:44:45.863222 np0000004400 cinder-backup[101319]: # END RECORD Jul 03 09:44:45.863222 np0000004400 cinder-backup[101319]: stderr= {{(pid=101319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 03 09:44:45.874053 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-b6d5137a-1e4e-4124-857c-f62fe2999803 tempest-VolumesBackupsTest-2142009639 None] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=101319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 03 09:44:45.874858 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-1aa1df77-90d9-4e9a-ab00-286bc8c3649e tempest-TestVolumeBackupRestore-997771116 None] deleted object: volume_1c366dd9-1a3c-4cb8-8f7c-4fdabf6fb81e/20260703094315/az_nova_backup_8727aa2b-db7a-4559-b380-bc6d983ed688-00012 in container: volumebackups. {{(pid=101319) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 09:44:45.890060 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-b6d5137a-1e4e-4124-857c-f62fe2999803 tempest-VolumesBackupsTest-2142009639 None] iscsiadm ('-m', 'session'): stdout=tcp: [49] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b2e4f10c-8033-4c54-95a1-dfe45d6357a3 (non-flash) Jul 03 09:44:45.890060 np0000004400 cinder-backup[101319]: tcp: [50] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b2e4f10c-8033-4c54-95a1-dfe45d6357a3 (non-flash) Jul 03 09:44:45.890060 np0000004400 cinder-backup[101319]: tcp: [82] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-76320525-737e-4f58-8523-63ec9abbdc64 (non-flash) Jul 03 09:44:45.890060 np0000004400 cinder-backup[101319]: tcp: [83] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-76320525-737e-4f58-8523-63ec9abbdc64 (non-flash) Jul 03 09:44:45.890060 np0000004400 cinder-backup[101319]: tcp: [87] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-dc2d662f-bc12-4338-8e3d-6565f72ba808 (non-flash) Jul 03 09:44:45.890060 np0000004400 cinder-backup[101319]: tcp: [88] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-dc2d662f-bc12-4338-8e3d-6565f72ba808 (non-flash) Jul 03 09:44:45.890060 np0000004400 cinder-backup[101319]: tcp: [92] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-35ece5f1-68f7-4f83-93fb-31eab852a359 (non-flash) Jul 03 09:44:45.890060 np0000004400 cinder-backup[101319]: tcp: [93] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-aecd73f6-86c7-4ae8-8bfa-b46655eb6efb (non-flash) Jul 03 09:44:45.890060 np0000004400 cinder-backup[101319]: tcp: [94] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-aecd73f6-86c7-4ae8-8bfa-b46655eb6efb (non-flash) Jul 03 09:44:45.890060 np0000004400 cinder-backup[101319]: stderr= {{(pid=101319) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jul 03 09:44:45.890309 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-b6d5137a-1e4e-4124-857c-f62fe2999803 tempest-VolumesBackupsTest-2142009639 None] iscsi session list stdout=tcp: [49] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b2e4f10c-8033-4c54-95a1-dfe45d6357a3 (non-flash) Jul 03 09:44:45.890309 np0000004400 cinder-backup[101319]: tcp: [50] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b2e4f10c-8033-4c54-95a1-dfe45d6357a3 (non-flash) Jul 03 09:44:45.890309 np0000004400 cinder-backup[101319]: tcp: [82] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-76320525-737e-4f58-8523-63ec9abbdc64 (non-flash) Jul 03 09:44:45.890309 np0000004400 cinder-backup[101319]: tcp: [83] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-76320525-737e-4f58-8523-63ec9abbdc64 (non-flash) Jul 03 09:44:45.890309 np0000004400 cinder-backup[101319]: tcp: [87] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-dc2d662f-bc12-4338-8e3d-6565f72ba808 (non-flash) Jul 03 09:44:45.890309 np0000004400 cinder-backup[101319]: tcp: [88] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-dc2d662f-bc12-4338-8e3d-6565f72ba808 (non-flash) Jul 03 09:44:45.890309 np0000004400 cinder-backup[101319]: tcp: [92] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-35ece5f1-68f7-4f83-93fb-31eab852a359 (non-flash) Jul 03 09:44:45.890309 np0000004400 cinder-backup[101319]: tcp: [93] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-aecd73f6-86c7-4ae8-8bfa-b46655eb6efb (non-flash) Jul 03 09:44:45.890309 np0000004400 cinder-backup[101319]: tcp: [94] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-aecd73f6-86c7-4ae8-8bfa-b46655eb6efb (non-flash) Jul 03 09:44:45.890309 np0000004400 cinder-backup[101319]: stderr= {{(pid=101319) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jul 03 09:44:45.892107 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-1aa1df77-90d9-4e9a-ab00-286bc8c3649e tempest-TestVolumeBackupRestore-997771116 None] deleted object: volume_1c366dd9-1a3c-4cb8-8f7c-4fdabf6fb81e/20260703094315/az_nova_backup_8727aa2b-db7a-4559-b380-bc6d983ed688-00013 in container: volumebackups. {{(pid=101319) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 09:44:45.944348 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-1aa1df77-90d9-4e9a-ab00-286bc8c3649e tempest-TestVolumeBackupRestore-997771116 None] deleted object: volume_1c366dd9-1a3c-4cb8-8f7c-4fdabf6fb81e/20260703094315/az_nova_backup_8727aa2b-db7a-4559-b380-bc6d983ed688-00014 in container: volumebackups. {{(pid=101319) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 09:44:45.947090 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-b6d5137a-1e4e-4124-857c-f62fe2999803 tempest-VolumesBackupsTest-2142009639 None] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-b9d43525-b482-4d2d-8541-23ede348708e, portal: 192.168.40.100,3260] Jul 03 09:44:45.947090 np0000004400 cinder-backup[101319]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-b9d43525-b482-4d2d-8541-23ede348708e, portal: 192.168.40.100,3260] successful. Jul 03 09:44:45.947090 np0000004400 cinder-backup[101319]: stderr= {{(pid=101319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 03 09:44:45.959056 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-b6d5137a-1e4e-4124-857c-f62fe2999803 tempest-VolumesBackupsTest-2142009639 None] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=101319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 03 09:44:45.969591 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-1aa1df77-90d9-4e9a-ab00-286bc8c3649e tempest-TestVolumeBackupRestore-997771116 None] deleted object: volume_1c366dd9-1a3c-4cb8-8f7c-4fdabf6fb81e/20260703094315/az_nova_backup_8727aa2b-db7a-4559-b380-bc6d983ed688-00015 in container: volumebackups. {{(pid=101319) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 09:44:45.978572 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-b6d5137a-1e4e-4124-857c-f62fe2999803 tempest-VolumesBackupsTest-2142009639 None] iscsiadm ('-m', 'session'): stdout=tcp: [49] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b2e4f10c-8033-4c54-95a1-dfe45d6357a3 (non-flash) Jul 03 09:44:45.978572 np0000004400 cinder-backup[101319]: tcp: [50] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b2e4f10c-8033-4c54-95a1-dfe45d6357a3 (non-flash) Jul 03 09:44:45.978572 np0000004400 cinder-backup[101319]: tcp: [82] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-76320525-737e-4f58-8523-63ec9abbdc64 (non-flash) Jul 03 09:44:45.978572 np0000004400 cinder-backup[101319]: tcp: [83] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-76320525-737e-4f58-8523-63ec9abbdc64 (non-flash) Jul 03 09:44:45.978572 np0000004400 cinder-backup[101319]: tcp: [87] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-dc2d662f-bc12-4338-8e3d-6565f72ba808 (non-flash) Jul 03 09:44:45.978572 np0000004400 cinder-backup[101319]: tcp: [88] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-dc2d662f-bc12-4338-8e3d-6565f72ba808 (non-flash) Jul 03 09:44:45.978572 np0000004400 cinder-backup[101319]: tcp: [92] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-35ece5f1-68f7-4f83-93fb-31eab852a359 (non-flash) Jul 03 09:44:45.978572 np0000004400 cinder-backup[101319]: tcp: [93] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-aecd73f6-86c7-4ae8-8bfa-b46655eb6efb (non-flash) Jul 03 09:44:45.978572 np0000004400 cinder-backup[101319]: tcp: [94] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-aecd73f6-86c7-4ae8-8bfa-b46655eb6efb (non-flash) Jul 03 09:44:45.978572 np0000004400 cinder-backup[101319]: tcp: [95] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b9d43525-b482-4d2d-8541-23ede348708e (non-flash) Jul 03 09:44:45.978572 np0000004400 cinder-backup[101319]: stderr= {{(pid=101319) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jul 03 09:44:45.978857 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-b6d5137a-1e4e-4124-857c-f62fe2999803 tempest-VolumesBackupsTest-2142009639 None] iscsi session list stdout=tcp: [49] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b2e4f10c-8033-4c54-95a1-dfe45d6357a3 (non-flash) Jul 03 09:44:45.978857 np0000004400 cinder-backup[101319]: tcp: [50] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b2e4f10c-8033-4c54-95a1-dfe45d6357a3 (non-flash) Jul 03 09:44:45.978857 np0000004400 cinder-backup[101319]: tcp: [82] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-76320525-737e-4f58-8523-63ec9abbdc64 (non-flash) Jul 03 09:44:45.978857 np0000004400 cinder-backup[101319]: tcp: [83] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-76320525-737e-4f58-8523-63ec9abbdc64 (non-flash) Jul 03 09:44:45.978857 np0000004400 cinder-backup[101319]: tcp: [87] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-dc2d662f-bc12-4338-8e3d-6565f72ba808 (non-flash) Jul 03 09:44:45.978857 np0000004400 cinder-backup[101319]: tcp: [88] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-dc2d662f-bc12-4338-8e3d-6565f72ba808 (non-flash) Jul 03 09:44:45.978857 np0000004400 cinder-backup[101319]: tcp: [92] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-35ece5f1-68f7-4f83-93fb-31eab852a359 (non-flash) Jul 03 09:44:45.978857 np0000004400 cinder-backup[101319]: tcp: [93] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-aecd73f6-86c7-4ae8-8bfa-b46655eb6efb (non-flash) Jul 03 09:44:45.978857 np0000004400 cinder-backup[101319]: tcp: [94] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-aecd73f6-86c7-4ae8-8bfa-b46655eb6efb (non-flash) Jul 03 09:44:45.978857 np0000004400 cinder-backup[101319]: tcp: [95] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b9d43525-b482-4d2d-8541-23ede348708e (non-flash) Jul 03 09:44:45.978857 np0000004400 cinder-backup[101319]: stderr= {{(pid=101319) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jul 03 09:44:45.979105 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.base [None req-b6d5137a-1e4e-4124-857c-f62fe2999803 tempest-VolumesBackupsTest-2142009639 None] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-b9d43525-b482-4d2d-8541-23ede348708e" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.150s {{(pid=101319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jul 03 09:44:45.979105 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-b6d5137a-1e4e-4124-857c-f62fe2999803 tempest-VolumesBackupsTest-2142009639 None] Connected to 192.168.40.100:3260 {{(pid=101319) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}} Jul 03 09:44:45.979940 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.linuxscsi [None req-b6d5137a-1e4e-4124-857c-f62fe2999803 tempest-VolumesBackupsTest-2142009639 None] HCTL ('10', '-', '-', 0) found on session 95 with lun 0 {{(pid=101319) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}} Jul 03 09:44:45.980057 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.linuxscsi [None req-b6d5137a-1e4e-4124-857c-f62fe2999803 tempest-VolumesBackupsTest-2142009639 None] Scanning host 10 c: -, t: -, l: 0) {{(pid=101319) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}} Jul 03 09:44:45.992056 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-1aa1df77-90d9-4e9a-ab00-286bc8c3649e tempest-TestVolumeBackupRestore-997771116 None] deleted object: volume_1c366dd9-1a3c-4cb8-8f7c-4fdabf6fb81e/20260703094315/az_nova_backup_8727aa2b-db7a-4559-b380-bc6d983ed688-00016 in container: volumebackups. {{(pid=101319) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 09:44:45.996165 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.linuxscsi [None req-b6d5137a-1e4e-4124-857c-f62fe2999803 tempest-VolumesBackupsTest-2142009639 None] Searching for a device in session 95 and hctl ['10', '*', '*', 0] yield: sde {{(pid=101319) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}} Jul 03 09:44:45.996380 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-b6d5137a-1e4e-4124-857c-f62fe2999803 tempest-VolumesBackupsTest-2142009639 None] Connected to sde using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-b9d43525-b482-4d2d-8541-23ede348708e', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'b9d43525-b482-4d2d-8541-23ede348708e', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': False} {{(pid=101319) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}} Jul 03 09:44:46.160057 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-1aa1df77-90d9-4e9a-ab00-286bc8c3649e tempest-TestVolumeBackupRestore-997771116 None] deleted object: volume_1c366dd9-1a3c-4cb8-8f7c-4fdabf6fb81e/20260703094315/az_nova_backup_8727aa2b-db7a-4559-b380-bc6d983ed688-00017 in container: volumebackups. {{(pid=101319) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 09:44:46.170995 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-d05ff3d6-4b83-4db0-8816-e91017864e60 tempest-VolumesBackupsTest-118275719 None] restoring object. backup: 36c3a4f2-c782-418d-be49-db2bcf3421f7, container: volumebackups, object name: volume_35ece5f1-68f7-4f83-93fb-31eab852a359/20260703094421/az_nova_backup_36c3a4f2-c782-418d-be49-db2bcf3421f7-00017, volume: 35ece5f1-68f7-4f83-93fb-31eab852a359. {{(pid=101319) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:705}} Jul 03 09:44:46.188112 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-1aa1df77-90d9-4e9a-ab00-286bc8c3649e tempest-TestVolumeBackupRestore-997771116 None] deleted object: volume_1c366dd9-1a3c-4cb8-8f7c-4fdabf6fb81e/20260703094315/az_nova_backup_8727aa2b-db7a-4559-b380-bc6d983ed688-00018 in container: volumebackups. {{(pid=101319) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 09:44:46.191595 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-d05ff3d6-4b83-4db0-8816-e91017864e60 tempest-VolumesBackupsTest-118275719 None] decompressing data using zlib algorithm {{(pid=101319) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:722}} Jul 03 09:44:46.213597 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-1aa1df77-90d9-4e9a-ab00-286bc8c3649e tempest-TestVolumeBackupRestore-997771116 None] deleted object: volume_1c366dd9-1a3c-4cb8-8f7c-4fdabf6fb81e/20260703094315/az_nova_backup_8727aa2b-db7a-4559-b380-bc6d983ed688-00019 in container: volumebackups. {{(pid=101319) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 09:44:46.244545 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-1aa1df77-90d9-4e9a-ab00-286bc8c3649e tempest-TestVolumeBackupRestore-997771116 None] deleted object: volume_1c366dd9-1a3c-4cb8-8f7c-4fdabf6fb81e/20260703094315/az_nova_backup_8727aa2b-db7a-4559-b380-bc6d983ed688-00020 in container: volumebackups. {{(pid=101319) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 09:44:46.269201 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-1aa1df77-90d9-4e9a-ab00-286bc8c3649e tempest-TestVolumeBackupRestore-997771116 None] deleted object: volume_1c366dd9-1a3c-4cb8-8f7c-4fdabf6fb81e/20260703094315/az_nova_backup_8727aa2b-db7a-4559-b380-bc6d983ed688-00021 in container: volumebackups. {{(pid=101319) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 09:44:46.298719 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-1aa1df77-90d9-4e9a-ab00-286bc8c3649e tempest-TestVolumeBackupRestore-997771116 None] deleted object: volume_1c366dd9-1a3c-4cb8-8f7c-4fdabf6fb81e/20260703094315/az_nova_backup_8727aa2b-db7a-4559-b380-bc6d983ed688_metadata in container: volumebackups. {{(pid=101319) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 09:44:46.326006 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-1aa1df77-90d9-4e9a-ab00-286bc8c3649e tempest-TestVolumeBackupRestore-997771116 None] deleted object: volume_1c366dd9-1a3c-4cb8-8f7c-4fdabf6fb81e/20260703094315/az_nova_backup_8727aa2b-db7a-4559-b380-bc6d983ed688_sha256file in container: volumebackups. {{(pid=101319) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 09:44:46.326254 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-1aa1df77-90d9-4e9a-ab00-286bc8c3649e tempest-TestVolumeBackupRestore-997771116 None] delete 8727aa2b-db7a-4559-b380-bc6d983ed688 finished. {{(pid=101319) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:848}} Jul 03 09:44:46.340070 np0000004400 cinder-backup[101319]: DEBUG cinder.quota [None req-1aa1df77-90d9-4e9a-ab00-286bc8c3649e tempest-TestVolumeBackupRestore-997771116 None] Created reservations ['488b717b-6333-4d19-99c6-fd509ebc7eee', 'cbf69012-c3e6-4365-81f1-322eddaeb6d9'] {{(pid=101319) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 09:44:46.356332 np0000004400 cinder-backup[101319]: INFO cinder.backup.manager [None req-1aa1df77-90d9-4e9a-ab00-286bc8c3649e tempest-TestVolumeBackupRestore-997771116 None] Delete backup finished, backup 8727aa2b-db7a-4559-b380-bc6d983ed688 deleted. Jul 03 09:44:46.590580 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-d05ff3d6-4b83-4db0-8816-e91017864e60 tempest-VolumesBackupsTest-118275719 None] restoring object. backup: 36c3a4f2-c782-418d-be49-db2bcf3421f7, container: volumebackups, object name: volume_35ece5f1-68f7-4f83-93fb-31eab852a359/20260703094421/az_nova_backup_36c3a4f2-c782-418d-be49-db2bcf3421f7-00018, volume: 35ece5f1-68f7-4f83-93fb-31eab852a359. {{(pid=101319) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:705}} Jul 03 09:44:46.611312 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-d05ff3d6-4b83-4db0-8816-e91017864e60 tempest-VolumesBackupsTest-118275719 None] decompressing data using zlib algorithm {{(pid=101319) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:722}} Jul 03 09:44:47.042841 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.base [None req-b6d5137a-1e4e-4124-857c-f62fe2999803 tempest-VolumesBackupsTest-2142009639 None] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 2.226s {{(pid=101319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jul 03 09:44:47.043219 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-b6d5137a-1e4e-4124-857c-f62fe2999803 tempest-VolumesBackupsTest-2142009639 None] <== connect_volume: return (5033ms) {'type': 'block', 'scsi_wwn': 'SStorPool_iSCSI_DISK_1034578903445799013', 'path': '/dev/sde'} {{(pid=101319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}} Jul 03 09:44:47.043613 np0000004400 cinder-backup[101319]: DEBUG oslo_concurrency.processutils [None req-b6d5137a-1e4e-4124-857c-f62fe2999803 tempest-VolumesBackupsTest-2142009639 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chown 1002 /dev/sde {{(pid=101319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 09:44:47.063237 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-d05ff3d6-4b83-4db0-8816-e91017864e60 tempest-VolumesBackupsTest-118275719 None] restoring object. backup: 36c3a4f2-c782-418d-be49-db2bcf3421f7, container: volumebackups, object name: volume_35ece5f1-68f7-4f83-93fb-31eab852a359/20260703094421/az_nova_backup_36c3a4f2-c782-418d-be49-db2bcf3421f7-00019, volume: 35ece5f1-68f7-4f83-93fb-31eab852a359. {{(pid=101319) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:705}} Jul 03 09:44:47.066842 np0000004400 sudo[135053]: stack : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chown 1002 /dev/sde Jul 03 09:44:47.067649 np0000004400 sudo[135053]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1002) Jul 03 09:44:47.083582 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-d05ff3d6-4b83-4db0-8816-e91017864e60 tempest-VolumesBackupsTest-118275719 None] decompressing data using zlib algorithm {{(pid=101319) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:722}} Jul 03 09:44:47.434578 np0000004400 sudo[135053]: pam_unix(sudo:session): session closed for user root Jul 03 09:44:47.511703 np0000004400 cinder-backup[101319]: DEBUG oslo_concurrency.processutils [None req-b6d5137a-1e4e-4124-857c-f62fe2999803 tempest-VolumesBackupsTest-2142009639 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chown 1002 /dev/sde" returned: 0 in 0.468s {{(pid=101319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 09:44:47.554720 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-d05ff3d6-4b83-4db0-8816-e91017864e60 tempest-VolumesBackupsTest-118275719 None] restoring object. backup: 36c3a4f2-c782-418d-be49-db2bcf3421f7, container: volumebackups, object name: volume_35ece5f1-68f7-4f83-93fb-31eab852a359/20260703094421/az_nova_backup_36c3a4f2-c782-418d-be49-db2bcf3421f7-00020, volume: 35ece5f1-68f7-4f83-93fb-31eab852a359. {{(pid=101319) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:705}} Jul 03 09:44:47.559699 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-b6d5137a-1e4e-4124-857c-f62fe2999803 tempest-VolumesBackupsTest-2142009639 None] _create_container started, container: tempest-volumesbackupstest-backup-container-313960817,backup: a636aad8-67e3-4daa-ac42-7179916eefe7. {{(pid=101319) _create_container /opt/stack/cinder/cinder/backup/chunkeddriver.py:249}} Jul 03 09:44:47.577253 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-d05ff3d6-4b83-4db0-8816-e91017864e60 tempest-VolumesBackupsTest-118275719 None] decompressing data using zlib algorithm {{(pid=101319) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:722}} Jul 03 09:44:47.615685 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.drivers.swift [None req-b6d5137a-1e4e-4124-857c-f62fe2999803 tempest-VolumesBackupsTest-2142009639 None] generate_object_name_prefix: volume_b9d43525-b482-4d2d-8541-23ede348708e/20260703094447/az_nova_backup_a636aad8-67e3-4daa-ac42-7179916eefe7 {{(pid=101319) _generate_object_name_prefix /opt/stack/cinder/cinder/backup/drivers/swift.py:452}} Jul 03 09:44:47.623982 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-b6d5137a-1e4e-4124-857c-f62fe2999803 tempest-VolumesBackupsTest-2142009639 None] starting backup of volume: b9d43525-b482-4d2d-8541-23ede348708e, volume size: 1073741824, object names prefix volume_b9d43525-b482-4d2d-8541-23ede348708e/20260703094447/az_nova_backup_a636aad8-67e3-4daa-ac42-7179916eefe7, availability zone: nova {{(pid=101319) _prepare_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:359}} Jul 03 09:44:47.969638 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-b6d5137a-1e4e-4124-857c-f62fe2999803 tempest-VolumesBackupsTest-2142009639 None] Backing up chunk of data from volume. {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 09:44:47.972334 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-d05ff3d6-4b83-4db0-8816-e91017864e60 tempest-VolumesBackupsTest-118275719 None] restoring object. backup: 36c3a4f2-c782-418d-be49-db2bcf3421f7, container: volumebackups, object name: volume_35ece5f1-68f7-4f83-93fb-31eab852a359/20260703094421/az_nova_backup_36c3a4f2-c782-418d-be49-db2bcf3421f7-00021, volume: 35ece5f1-68f7-4f83-93fb-31eab852a359. {{(pid=101319) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:705}} Jul 03 09:44:47.991207 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-d05ff3d6-4b83-4db0-8816-e91017864e60 tempest-VolumesBackupsTest-118275719 None] decompressing data using zlib algorithm {{(pid=101319) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:722}} Jul 03 09:44:48.187580 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-d05ff3d6-4b83-4db0-8816-e91017864e60 tempest-VolumesBackupsTest-118275719 None] v1 volume backup restore of 36c3a4f2-c782-418d-be49-db2bcf3421f7 finished. {{(pid=101319) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:750}} Jul 03 09:44:48.187987 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.driver [None req-d05ff3d6-4b83-4db0-8816-e91017864e60 tempest-VolumesBackupsTest-118275719 None] Restoring volume base metadata {{(pid=101319) _restore_vol_base_meta /opt/stack/cinder/cinder/backup/driver.py:177}} Jul 03 09:44:48.194602 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.driver [None req-d05ff3d6-4b83-4db0-8816-e91017864e60 tempest-VolumesBackupsTest-118275719 None] Excluding field 'display_name' {{(pid=101319) _filter /opt/stack/cinder/cinder/backup/driver.py:171}} Jul 03 09:44:48.194921 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.driver [None req-d05ff3d6-4b83-4db0-8816-e91017864e60 tempest-VolumesBackupsTest-118275719 None] Excluding field 'display_description' {{(pid=101319) _filter /opt/stack/cinder/cinder/backup/driver.py:171}} Jul 03 09:44:48.203684 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.driver [None req-d05ff3d6-4b83-4db0-8816-e91017864e60 tempest-VolumesBackupsTest-118275719 None] No metadata of type 'volume-metadata' to restore {{(pid=101319) put /opt/stack/cinder/cinder/backup/driver.py:345}} Jul 03 09:44:48.203916 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.driver [None req-d05ff3d6-4b83-4db0-8816-e91017864e60 tempest-VolumesBackupsTest-118275719 None] No metadata of type 'volume-glance-metadata' to restore {{(pid=101319) put /opt/stack/cinder/cinder/backup/driver.py:345}} Jul 03 09:44:48.204139 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-d05ff3d6-4b83-4db0-8816-e91017864e60 tempest-VolumesBackupsTest-118275719 None] restore 36c3a4f2-c782-418d-be49-db2bcf3421f7 to 35ece5f1-68f7-4f83-93fb-31eab852a359 finished. {{(pid=101319) restore /opt/stack/cinder/cinder/backup/chunkeddriver.py:815}} Jul 03 09:44:48.437244 np0000004400 cinder-backup[101319]: DEBUG oslo_concurrency.processutils [None req-d05ff3d6-4b83-4db0-8816-e91017864e60 tempest-VolumesBackupsTest-118275719 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chown 0 /dev/sdb {{(pid=101319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 09:44:48.462752 np0000004400 sudo[135150]: stack : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chown 0 /dev/sdb Jul 03 09:44:48.463422 np0000004400 sudo[135150]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1002) Jul 03 09:44:48.807563 np0000004400 sudo[135150]: pam_unix(sudo:session): session closed for user root Jul 03 09:44:48.810620 np0000004400 cinder-backup[101319]: DEBUG oslo_concurrency.processutils [None req-d05ff3d6-4b83-4db0-8816-e91017864e60 tempest-VolumesBackupsTest-118275719 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chown 0 /dev/sdb" returned: 0 in 0.373s {{(pid=101319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 09:44:48.810988 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-d05ff3d6-4b83-4db0-8816-e91017864e60 tempest-VolumesBackupsTest-118275719 None] ==> disconnect_volume: call "{'args': (, {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-35ece5f1-68f7-4f83-93fb-31eab852a359', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '35ece5f1-68f7-4f83-93fb-31eab852a359', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': False}, {'type': 'block', 'scsi_wwn': 'SStorPool_iSCSI_DISK_1034578903445799010', 'path': '/dev/sdb'}), 'kwargs': {'force': True, 'ignore_errors': False}}" {{(pid=101319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}} Jul 03 09:44:48.811195 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.base [None req-d05ff3d6-4b83-4db0-8816-e91017864e60 tempest-VolumesBackupsTest-118275719 None] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=101319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jul 03 09:44:48.811678 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.base [None req-d05ff3d6-4b83-4db0-8816-e91017864e60 tempest-VolumesBackupsTest-118275719 None] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=101319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jul 03 09:44:48.812142 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-d05ff3d6-4b83-4db0-8816-e91017864e60 tempest-VolumesBackupsTest-118275719 None] _get_connection_devices called with parameters: connection_properties={'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-35ece5f1-68f7-4f83-93fb-31eab852a359', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '35ece5f1-68f7-4f83-93fb-31eab852a359', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': False}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=101319) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:847}} Jul 03 09:44:48.824845 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-d05ff3d6-4b83-4db0-8816-e91017864e60 tempest-VolumesBackupsTest-118275719 None] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS: Jul 03 09:44:48.824845 np0000004400 cinder-backup[101319]: No targets found. Jul 03 09:44:48.824845 np0000004400 cinder-backup[101319]: iSNS: Jul 03 09:44:48.824845 np0000004400 cinder-backup[101319]: No targets found. Jul 03 09:44:48.824845 np0000004400 cinder-backup[101319]: STATIC: Jul 03 09:44:48.824845 np0000004400 cinder-backup[101319]: Target: iqn.2023-03.storpool.com:os--volume-aecd73f6-86c7-4ae8-8bfa-b46655eb6efb Jul 03 09:44:48.824845 np0000004400 cinder-backup[101319]: Portal: 192.168.50.100:3260,-1 Jul 03 09:44:48.824845 np0000004400 cinder-backup[101319]: Iface Name: default Jul 03 09:44:48.824845 np0000004400 cinder-backup[101319]: Portal: 192.168.40.100:3260,-1 Jul 03 09:44:48.824845 np0000004400 cinder-backup[101319]: Iface Name: default Jul 03 09:44:48.824845 np0000004400 cinder-backup[101319]: Target: iqn.2023-03.storpool.com:os--volume-76320525-737e-4f58-8523-63ec9abbdc64 Jul 03 09:44:48.824845 np0000004400 cinder-backup[101319]: Portal: 192.168.50.100:3260,-1 Jul 03 09:44:48.824845 np0000004400 cinder-backup[101319]: Iface Name: default Jul 03 09:44:48.824845 np0000004400 cinder-backup[101319]: Portal: 192.168.40.100:3260,-1 Jul 03 09:44:48.824845 np0000004400 cinder-backup[101319]: Iface Name: default Jul 03 09:44:48.824845 np0000004400 cinder-backup[101319]: Target: iqn.2023-03.storpool.com:os--volume-b2e4f10c-8033-4c54-95a1-dfe45d6357a3 Jul 03 09:44:48.824845 np0000004400 cinder-backup[101319]: Portal: 192.168.50.100:3260,-1 Jul 03 09:44:48.824845 np0000004400 cinder-backup[101319]: Iface Name: default Jul 03 09:44:48.824845 np0000004400 cinder-backup[101319]: Portal: 192.168.40.100:3260,-1 Jul 03 09:44:48.824845 np0000004400 cinder-backup[101319]: Iface Name: default Jul 03 09:44:48.824845 np0000004400 cinder-backup[101319]: Target: iqn.2023-03.storpool.com:os--volume-35ece5f1-68f7-4f83-93fb-31eab852a359 Jul 03 09:44:48.824845 np0000004400 cinder-backup[101319]: Portal: 192.168.40.100:3260,-1 Jul 03 09:44:48.824845 np0000004400 cinder-backup[101319]: Iface Name: default Jul 03 09:44:48.824845 np0000004400 cinder-backup[101319]: Target: iqn.2023-03.storpool.com:os--volume-dc2d662f-bc12-4338-8e3d-6565f72ba808 Jul 03 09:44:48.824845 np0000004400 cinder-backup[101319]: Portal: 192.168.50.100:3260,-1 Jul 03 09:44:48.824845 np0000004400 cinder-backup[101319]: Iface Name: default Jul 03 09:44:48.824845 np0000004400 cinder-backup[101319]: Portal: 192.168.40.100:3260,-1 Jul 03 09:44:48.824845 np0000004400 cinder-backup[101319]: Iface Name: default Jul 03 09:44:48.824845 np0000004400 cinder-backup[101319]: Target: iqn.2023-03.storpool.com:os--volume-b9d43525-b482-4d2d-8541-23ede348708e Jul 03 09:44:48.824845 np0000004400 cinder-backup[101319]: Portal: 192.168.40.100:3260,-1 Jul 03 09:44:48.824845 np0000004400 cinder-backup[101319]: Iface Name: default Jul 03 09:44:48.824845 np0000004400 cinder-backup[101319]: FIRMWARE: Jul 03 09:44:48.824845 np0000004400 cinder-backup[101319]: No targets found. Jul 03 09:44:48.824845 np0000004400 cinder-backup[101319]: stderr= {{(pid=101319) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jul 03 09:44:48.825812 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-d05ff3d6-4b83-4db0-8816-e91017864e60 tempest-VolumesBackupsTest-118275719 None] Regex to get portals from discoverydb: ^SENDTARGETS: Jul 03 09:44:48.825812 np0000004400 cinder-backup[101319]: .*?^DiscoveryAddress: 192.168.40.100,3260.*? Jul 03 09:44:48.825812 np0000004400 cinder-backup[101319]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=101319) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:390}} Jul 03 09:44:48.825812 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-d05ff3d6-4b83-4db0-8816-e91017864e60 tempest-VolumesBackupsTest-118275719 None] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-35ece5f1-68f7-4f83-93fb-31eab852a359', 0)] {{(pid=101319) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:858}} Jul 03 09:44:48.865963 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-d05ff3d6-4b83-4db0-8816-e91017864e60 tempest-VolumesBackupsTest-118275719 None] iscsiadm ('-m', 'session'): stdout=tcp: [49] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b2e4f10c-8033-4c54-95a1-dfe45d6357a3 (non-flash) Jul 03 09:44:48.865963 np0000004400 cinder-backup[101319]: tcp: [50] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b2e4f10c-8033-4c54-95a1-dfe45d6357a3 (non-flash) Jul 03 09:44:48.865963 np0000004400 cinder-backup[101319]: tcp: [82] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-76320525-737e-4f58-8523-63ec9abbdc64 (non-flash) Jul 03 09:44:48.865963 np0000004400 cinder-backup[101319]: tcp: [83] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-76320525-737e-4f58-8523-63ec9abbdc64 (non-flash) Jul 03 09:44:48.865963 np0000004400 cinder-backup[101319]: tcp: [87] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-dc2d662f-bc12-4338-8e3d-6565f72ba808 (non-flash) Jul 03 09:44:48.865963 np0000004400 cinder-backup[101319]: tcp: [88] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-dc2d662f-bc12-4338-8e3d-6565f72ba808 (non-flash) Jul 03 09:44:48.865963 np0000004400 cinder-backup[101319]: tcp: [92] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-35ece5f1-68f7-4f83-93fb-31eab852a359 (non-flash) Jul 03 09:44:48.865963 np0000004400 cinder-backup[101319]: tcp: [93] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-aecd73f6-86c7-4ae8-8bfa-b46655eb6efb (non-flash) Jul 03 09:44:48.865963 np0000004400 cinder-backup[101319]: tcp: [94] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-aecd73f6-86c7-4ae8-8bfa-b46655eb6efb (non-flash) Jul 03 09:44:48.865963 np0000004400 cinder-backup[101319]: tcp: [95] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b9d43525-b482-4d2d-8541-23ede348708e (non-flash) Jul 03 09:44:48.865963 np0000004400 cinder-backup[101319]: stderr= {{(pid=101319) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jul 03 09:44:48.866282 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-d05ff3d6-4b83-4db0-8816-e91017864e60 tempest-VolumesBackupsTest-118275719 None] iscsi session list stdout=tcp: [49] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b2e4f10c-8033-4c54-95a1-dfe45d6357a3 (non-flash) Jul 03 09:44:48.866282 np0000004400 cinder-backup[101319]: tcp: [50] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b2e4f10c-8033-4c54-95a1-dfe45d6357a3 (non-flash) Jul 03 09:44:48.866282 np0000004400 cinder-backup[101319]: tcp: [82] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-76320525-737e-4f58-8523-63ec9abbdc64 (non-flash) Jul 03 09:44:48.866282 np0000004400 cinder-backup[101319]: tcp: [83] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-76320525-737e-4f58-8523-63ec9abbdc64 (non-flash) Jul 03 09:44:48.866282 np0000004400 cinder-backup[101319]: tcp: [87] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-dc2d662f-bc12-4338-8e3d-6565f72ba808 (non-flash) Jul 03 09:44:48.866282 np0000004400 cinder-backup[101319]: tcp: [88] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-dc2d662f-bc12-4338-8e3d-6565f72ba808 (non-flash) Jul 03 09:44:48.866282 np0000004400 cinder-backup[101319]: tcp: [92] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-35ece5f1-68f7-4f83-93fb-31eab852a359 (non-flash) Jul 03 09:44:48.866282 np0000004400 cinder-backup[101319]: tcp: [93] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-aecd73f6-86c7-4ae8-8bfa-b46655eb6efb (non-flash) Jul 03 09:44:48.866282 np0000004400 cinder-backup[101319]: tcp: [94] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-aecd73f6-86c7-4ae8-8bfa-b46655eb6efb (non-flash) Jul 03 09:44:48.866282 np0000004400 cinder-backup[101319]: tcp: [95] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b9d43525-b482-4d2d-8541-23ede348708e (non-flash) Jul 03 09:44:48.866282 np0000004400 cinder-backup[101319]: stderr= {{(pid=101319) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jul 03 09:44:48.866539 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-d05ff3d6-4b83-4db0-8816-e91017864e60 tempest-VolumesBackupsTest-118275719 None] Sessions list: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-b2e4f10c-8033-4c54-95a1-dfe45d6357a3', '49'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-b2e4f10c-8033-4c54-95a1-dfe45d6357a3', '50'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-76320525-737e-4f58-8523-63ec9abbdc64', '82'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-76320525-737e-4f58-8523-63ec9abbdc64', '83'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-dc2d662f-bc12-4338-8e3d-6565f72ba808', '87'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-dc2d662f-bc12-4338-8e3d-6565f72ba808', '88'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-35ece5f1-68f7-4f83-93fb-31eab852a359', '92'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-aecd73f6-86c7-4ae8-8bfa-b46655eb6efb', '93'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-aecd73f6-86c7-4ae8-8bfa-b46655eb6efb', '94'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-b9d43525-b482-4d2d-8541-23ede348708e', '95')] {{(pid=101319) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:866}} Jul 03 09:44:48.866539 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-d05ff3d6-4b83-4db0-8816-e91017864e60 tempest-VolumesBackupsTest-118275719 None] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-35ece5f1-68f7-4f83-93fb-31eab852a359, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-35ece5f1-68f7-4f83-93fb-31eab852a359', '92')] {{(pid=101319) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}} Jul 03 09:44:48.867685 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-d05ff3d6-4b83-4db0-8816-e91017864e60 tempest-VolumesBackupsTest-118275719 None] Resulting device map defaultdict(. at 0x7e76e7585300>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-35ece5f1-68f7-4f83-93fb-31eab852a359'): ({'sdb'}, set())}) {{(pid=101319) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:912}} Jul 03 09:44:48.867767 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.linuxscsi [None req-d05ff3d6-4b83-4db0-8816-e91017864e60 tempest-VolumesBackupsTest-118275719 None] Removing single pathed devices sdb {{(pid=101319) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}} Jul 03 09:44:48.868159 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-b6d5137a-1e4e-4124-857c-f62fe2999803 tempest-VolumesBackupsTest-2142009639 None] Compressed 52428800 bytes of data to 19825286 bytes using zlib. {{(pid=101319) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 09:44:48.868275 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-b6d5137a-1e4e-4124-857c-f62fe2999803 tempest-VolumesBackupsTest-2142009639 None] About to put_object {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 09:44:48.895880 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.linuxscsi [None req-d05ff3d6-4b83-4db0-8816-e91017864e60 tempest-VolumesBackupsTest-118275719 None] Flushing IO for device /dev/sdb {{(pid=101319) flush_device_io /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:461}} Jul 03 09:44:48.907744 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.linuxscsi [None req-d05ff3d6-4b83-4db0-8816-e91017864e60 tempest-VolumesBackupsTest-118275719 None] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=101319) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}} Jul 03 09:44:48.956723 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.linuxscsi [None req-d05ff3d6-4b83-4db0-8816-e91017864e60 tempest-VolumesBackupsTest-118275719 None] Checking to see if SCSI volumes sdb have been removed. {{(pid=101319) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}} Jul 03 09:44:48.956911 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.linuxscsi [None req-d05ff3d6-4b83-4db0-8816-e91017864e60 tempest-VolumesBackupsTest-118275719 None] SCSI volumes sdb have been removed. {{(pid=101319) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}} Jul 03 09:44:48.958242 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.linuxscsi [None req-d05ff3d6-4b83-4db0-8816-e91017864e60 tempest-VolumesBackupsTest-118275719 None] Checking to see if device paths {'sdb'} are still under multipathd monitoring {{(pid=101319) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}} Jul 03 09:44:48.970855 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.linuxscsi [None req-d05ff3d6-4b83-4db0-8816-e91017864e60 tempest-VolumesBackupsTest-118275719 None] Device paths {'sdb'} have been removed from multipathd monitoring. {{(pid=101319) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}} Jul 03 09:44:48.971093 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-d05ff3d6-4b83-4db0-8816-e91017864e60 tempest-VolumesBackupsTest-118275719 None] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-35ece5f1-68f7-4f83-93fb-31eab852a359')] {{(pid=101319) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1225}} Jul 03 09:44:48.982216 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-d05ff3d6-4b83-4db0-8816-e91017864e60 tempest-VolumesBackupsTest-118275719 None] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=101319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 03 09:44:49.024481 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-d05ff3d6-4b83-4db0-8816-e91017864e60 tempest-VolumesBackupsTest-118275719 None] iscsiadm ('--logout',): stdout=Logging out of session [sid: 92, target: iqn.2023-03.storpool.com:os--volume-35ece5f1-68f7-4f83-93fb-31eab852a359, portal: 192.168.40.100,3260] Jul 03 09:44:49.024481 np0000004400 cinder-backup[101319]: Logout of [sid: 92, target: iqn.2023-03.storpool.com:os--volume-35ece5f1-68f7-4f83-93fb-31eab852a359, portal: 192.168.40.100,3260] successful. Jul 03 09:44:49.024481 np0000004400 cinder-backup[101319]: stderr= {{(pid=101319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 03 09:44:49.046176 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-d05ff3d6-4b83-4db0-8816-e91017864e60 tempest-VolumesBackupsTest-118275719 None] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=101319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 03 09:44:49.046453 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.base [None req-d05ff3d6-4b83-4db0-8816-e91017864e60 tempest-VolumesBackupsTest-118275719 None] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.235s {{(pid=101319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jul 03 09:44:49.046622 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-d05ff3d6-4b83-4db0-8816-e91017864e60 tempest-VolumesBackupsTest-118275719 None] <== disconnect_volume: return (235ms) None {{(pid=101319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}} Jul 03 09:44:49.139093 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-b6d5137a-1e4e-4124-857c-f62fe2999803 tempest-VolumesBackupsTest-2142009639 None] backup MD5 for volume_b9d43525-b482-4d2d-8541-23ede348708e/20260703094447/az_nova_backup_a636aad8-67e3-4daa-ac42-7179916eefe7-00001: 82571f7121cb9475563edde615e4e4df {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 09:44:49.139227 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-b6d5137a-1e4e-4124-857c-f62fe2999803 tempest-VolumesBackupsTest-2142009639 None] Calling eventlet.sleep(0) {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 09:44:49.349385 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-b6d5137a-1e4e-4124-857c-f62fe2999803 tempest-VolumesBackupsTest-2142009639 None] Backing up chunk of data from volume. {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 09:44:49.599521 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-b6d5137a-1e4e-4124-857c-f62fe2999803 tempest-VolumesBackupsTest-2142009639 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101319) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 09:44:49.599648 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-b6d5137a-1e4e-4124-857c-f62fe2999803 tempest-VolumesBackupsTest-2142009639 None] About to put_object {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 09:44:49.709281 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-b6d5137a-1e4e-4124-857c-f62fe2999803 tempest-VolumesBackupsTest-2142009639 None] backup MD5 for volume_b9d43525-b482-4d2d-8541-23ede348708e/20260703094447/az_nova_backup_a636aad8-67e3-4daa-ac42-7179916eefe7-00002: 25e317773f308e446cc84c503a6d1f85 {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 09:44:49.709470 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-b6d5137a-1e4e-4124-857c-f62fe2999803 tempest-VolumesBackupsTest-2142009639 None] Calling eventlet.sleep(0) {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 09:44:49.914398 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-b6d5137a-1e4e-4124-857c-f62fe2999803 tempest-VolumesBackupsTest-2142009639 None] Backing up chunk of data from volume. {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 09:44:50.060232 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.manager [None req-d05ff3d6-4b83-4db0-8816-e91017864e60 tempest-VolumesBackupsTest-118275719 None] Encryption key ID for volume 35ece5f1-68f7-4f83-93fb-31eab852a359 already matches encryption key ID in backup 36c3a4f2-c782-418d-be49-db2bcf3421f7. {{(pid=101319) _run_restore /opt/stack/cinder/cinder/backup/manager.py:873}} Jul 03 09:44:50.074459 np0000004400 cinder-backup[101319]: INFO cinder.backup.manager [None req-d05ff3d6-4b83-4db0-8816-e91017864e60 tempest-VolumesBackupsTest-118275719 None] Finished restoring backup 36c3a4f2-c782-418d-be49-db2bcf3421f7 to volume 35ece5f1-68f7-4f83-93fb-31eab852a359. Jul 03 09:44:50.199279 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-b6d5137a-1e4e-4124-857c-f62fe2999803 tempest-VolumesBackupsTest-2142009639 None] Compressed 52428800 bytes of data to 1362154 bytes using zlib. {{(pid=101319) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 09:44:50.199279 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-b6d5137a-1e4e-4124-857c-f62fe2999803 tempest-VolumesBackupsTest-2142009639 None] About to put_object {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 09:44:50.231136 np0000004400 cinder-backup[101319]: INFO cinder.backup.manager [None req-e53feec1-8677-4812-9b8f-1243b2f4b697 tempest-VolumesBackupsTest-118275719 None] Delete backup started, backup: 36c3a4f2-c782-418d-be49-db2bcf3421f7. Jul 03 09:44:50.239156 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.drivers.swift [None req-e53feec1-8677-4812-9b8f-1243b2f4b697 tempest-VolumesBackupsTest-118275719 None] Using swift URL https://10.4.3.95:8080/v1/AUTH_a484ec9218bf417bb9d7575ae6370646 {{(pid=101319) initialize /opt/stack/cinder/cinder/backup/drivers/swift.py:300}} Jul 03 09:44:50.239538 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.drivers.swift [None req-e53feec1-8677-4812-9b8f-1243b2f4b697 tempest-VolumesBackupsTest-118275719 None] Connect to https://10.4.3.95:8080/v1/AUTH_ in "per_user" mode {{(pid=101319) initialize /opt/stack/cinder/cinder/backup/drivers/swift.py:301}} Jul 03 09:44:50.239859 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-e53feec1-8677-4812-9b8f-1243b2f4b697 tempest-VolumesBackupsTest-118275719 None] delete started, backup: 36c3a4f2-c782-418d-be49-db2bcf3421f7, container: volumebackups, prefix: volume_35ece5f1-68f7-4f83-93fb-31eab852a359/20260703094421/az_nova_backup_36c3a4f2-c782-418d-be49-db2bcf3421f7. {{(pid=101319) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:822}} Jul 03 09:44:50.287040 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-e53feec1-8677-4812-9b8f-1243b2f4b697 tempest-VolumesBackupsTest-118275719 None] generated object list: ['volume_35ece5f1-68f7-4f83-93fb-31eab852a359/20260703094421/az_nova_backup_36c3a4f2-c782-418d-be49-db2bcf3421f7-00001', 'volume_35ece5f1-68f7-4f83-93fb-31eab852a359/20260703094421/az_nova_backup_36c3a4f2-c782-418d-be49-db2bcf3421f7-00002', 'volume_35ece5f1-68f7-4f83-93fb-31eab852a359/20260703094421/az_nova_backup_36c3a4f2-c782-418d-be49-db2bcf3421f7-00003', 'volume_35ece5f1-68f7-4f83-93fb-31eab852a359/20260703094421/az_nova_backup_36c3a4f2-c782-418d-be49-db2bcf3421f7-00004', 'volume_35ece5f1-68f7-4f83-93fb-31eab852a359/20260703094421/az_nova_backup_36c3a4f2-c782-418d-be49-db2bcf3421f7-00005', 'volume_35ece5f1-68f7-4f83-93fb-31eab852a359/20260703094421/az_nova_backup_36c3a4f2-c782-418d-be49-db2bcf3421f7-00006', 'volume_35ece5f1-68f7-4f83-93fb-31eab852a359/20260703094421/az_nova_backup_36c3a4f2-c782-418d-be49-db2bcf3421f7-00007', 'volume_35ece5f1-68f7-4f83-93fb-31eab852a359/20260703094421/az_nova_backup_36c3a4f2-c782-418d-be49-db2bcf3421f7-00008', 'volume_35ece5f1-68f7-4f83-93fb-31eab852a359/20260703094421/az_nova_backup_36c3a4f2-c782-418d-be49-db2bcf3421f7-00009', 'volume_35ece5f1-68f7-4f83-93fb-31eab852a359/20260703094421/az_nova_backup_36c3a4f2-c782-418d-be49-db2bcf3421f7-00010', 'volume_35ece5f1-68f7-4f83-93fb-31eab852a359/20260703094421/az_nova_backup_36c3a4f2-c782-418d-be49-db2bcf3421f7-00011', 'volume_35ece5f1-68f7-4f83-93fb-31eab852a359/20260703094421/az_nova_backup_36c3a4f2-c782-418d-be49-db2bcf3421f7-00012', 'volume_35ece5f1-68f7-4f83-93fb-31eab852a359/20260703094421/az_nova_backup_36c3a4f2-c782-418d-be49-db2bcf3421f7-00013', 'volume_35ece5f1-68f7-4f83-93fb-31eab852a359/20260703094421/az_nova_backup_36c3a4f2-c782-418d-be49-db2bcf3421f7-00014', 'volume_35ece5f1-68f7-4f83-93fb-31eab852a359/20260703094421/az_nova_backup_36c3a4f2-c782-418d-be49-db2bcf3421f7-00015', 'volume_35ece5f1-68f7-4f83-93fb-31eab852a359/20260703094421/az_nova_backup_36c3a4f2-c782-418d-be49-db2bcf3421f7-00016', 'volume_35ece5f1-68f7-4f83-93fb-31eab852a359/20260703094421/az_nova_backup_36c3a4f2-c782-418d-be49-db2bcf3421f7-00017', 'volume_35ece5f1-68f7-4f83-93fb-31eab852a359/20260703094421/az_nova_backup_36c3a4f2-c782-418d-be49-db2bcf3421f7-00018', 'volume_35ece5f1-68f7-4f83-93fb-31eab852a359/20260703094421/az_nova_backup_36c3a4f2-c782-418d-be49-db2bcf3421f7-00019', 'volume_35ece5f1-68f7-4f83-93fb-31eab852a359/20260703094421/az_nova_backup_36c3a4f2-c782-418d-be49-db2bcf3421f7-00020', 'volume_35ece5f1-68f7-4f83-93fb-31eab852a359/20260703094421/az_nova_backup_36c3a4f2-c782-418d-be49-db2bcf3421f7-00021', 'volume_35ece5f1-68f7-4f83-93fb-31eab852a359/20260703094421/az_nova_backup_36c3a4f2-c782-418d-be49-db2bcf3421f7_metadata', 'volume_35ece5f1-68f7-4f83-93fb-31eab852a359/20260703094421/az_nova_backup_36c3a4f2-c782-418d-be49-db2bcf3421f7_sha256file']. {{(pid=101319) _generate_object_names /opt/stack/cinder/cinder/backup/chunkeddriver.py:260}} Jul 03 09:44:50.309427 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-e53feec1-8677-4812-9b8f-1243b2f4b697 tempest-VolumesBackupsTest-118275719 None] deleted object: volume_35ece5f1-68f7-4f83-93fb-31eab852a359/20260703094421/az_nova_backup_36c3a4f2-c782-418d-be49-db2bcf3421f7-00001 in container: volumebackups. {{(pid=101319) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 09:44:50.328980 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-e53feec1-8677-4812-9b8f-1243b2f4b697 tempest-VolumesBackupsTest-118275719 None] deleted object: volume_35ece5f1-68f7-4f83-93fb-31eab852a359/20260703094421/az_nova_backup_36c3a4f2-c782-418d-be49-db2bcf3421f7-00002 in container: volumebackups. {{(pid=101319) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 09:44:50.336178 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-b6d5137a-1e4e-4124-857c-f62fe2999803 tempest-VolumesBackupsTest-2142009639 None] backup MD5 for volume_b9d43525-b482-4d2d-8541-23ede348708e/20260703094447/az_nova_backup_a636aad8-67e3-4daa-ac42-7179916eefe7-00003: a35891500449df17e893f84bd88472fb {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 09:44:50.336178 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-b6d5137a-1e4e-4124-857c-f62fe2999803 tempest-VolumesBackupsTest-2142009639 None] Calling eventlet.sleep(0) {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 09:44:50.370398 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-e53feec1-8677-4812-9b8f-1243b2f4b697 tempest-VolumesBackupsTest-118275719 None] deleted object: volume_35ece5f1-68f7-4f83-93fb-31eab852a359/20260703094421/az_nova_backup_36c3a4f2-c782-418d-be49-db2bcf3421f7-00003 in container: volumebackups. {{(pid=101319) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 09:44:50.382308 np0000004400 cinder-backup[101319]: DEBUG oslo_db.sqlalchemy.engines [None req-b6d5137a-1e4e-4124-857c-f62fe2999803 tempest-VolumesBackupsTest-2142009639 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=101319) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 03 09:44:50.397055 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-e53feec1-8677-4812-9b8f-1243b2f4b697 tempest-VolumesBackupsTest-118275719 None] deleted object: volume_35ece5f1-68f7-4f83-93fb-31eab852a359/20260703094421/az_nova_backup_36c3a4f2-c782-418d-be49-db2bcf3421f7-00004 in container: volumebackups. {{(pid=101319) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 09:44:50.439818 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-e53feec1-8677-4812-9b8f-1243b2f4b697 tempest-VolumesBackupsTest-118275719 None] deleted object: volume_35ece5f1-68f7-4f83-93fb-31eab852a359/20260703094421/az_nova_backup_36c3a4f2-c782-418d-be49-db2bcf3421f7-00005 in container: volumebackups. {{(pid=101319) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 09:44:50.490918 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-e53feec1-8677-4812-9b8f-1243b2f4b697 tempest-VolumesBackupsTest-118275719 None] deleted object: volume_35ece5f1-68f7-4f83-93fb-31eab852a359/20260703094421/az_nova_backup_36c3a4f2-c782-418d-be49-db2bcf3421f7-00006 in container: volumebackups. {{(pid=101319) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 09:44:50.533488 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-e53feec1-8677-4812-9b8f-1243b2f4b697 tempest-VolumesBackupsTest-118275719 None] deleted object: volume_35ece5f1-68f7-4f83-93fb-31eab852a359/20260703094421/az_nova_backup_36c3a4f2-c782-418d-be49-db2bcf3421f7-00007 in container: volumebackups. {{(pid=101319) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 09:44:50.557648 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-e53feec1-8677-4812-9b8f-1243b2f4b697 tempest-VolumesBackupsTest-118275719 None] deleted object: volume_35ece5f1-68f7-4f83-93fb-31eab852a359/20260703094421/az_nova_backup_36c3a4f2-c782-418d-be49-db2bcf3421f7-00008 in container: volumebackups. {{(pid=101319) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 09:44:50.575439 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-b6d5137a-1e4e-4124-857c-f62fe2999803 tempest-VolumesBackupsTest-2142009639 None] Backing up chunk of data from volume. {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 09:44:50.583742 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-e53feec1-8677-4812-9b8f-1243b2f4b697 tempest-VolumesBackupsTest-118275719 None] deleted object: volume_35ece5f1-68f7-4f83-93fb-31eab852a359/20260703094421/az_nova_backup_36c3a4f2-c782-418d-be49-db2bcf3421f7-00009 in container: volumebackups. {{(pid=101319) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 09:44:50.603592 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-e53feec1-8677-4812-9b8f-1243b2f4b697 tempest-VolumesBackupsTest-118275719 None] deleted object: volume_35ece5f1-68f7-4f83-93fb-31eab852a359/20260703094421/az_nova_backup_36c3a4f2-c782-418d-be49-db2bcf3421f7-00010 in container: volumebackups. {{(pid=101319) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 09:44:50.623255 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-e53feec1-8677-4812-9b8f-1243b2f4b697 tempest-VolumesBackupsTest-118275719 None] deleted object: volume_35ece5f1-68f7-4f83-93fb-31eab852a359/20260703094421/az_nova_backup_36c3a4f2-c782-418d-be49-db2bcf3421f7-00011 in container: volumebackups. {{(pid=101319) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 09:44:50.648635 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-e53feec1-8677-4812-9b8f-1243b2f4b697 tempest-VolumesBackupsTest-118275719 None] deleted object: volume_35ece5f1-68f7-4f83-93fb-31eab852a359/20260703094421/az_nova_backup_36c3a4f2-c782-418d-be49-db2bcf3421f7-00012 in container: volumebackups. {{(pid=101319) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 09:44:50.672660 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-e53feec1-8677-4812-9b8f-1243b2f4b697 tempest-VolumesBackupsTest-118275719 None] deleted object: volume_35ece5f1-68f7-4f83-93fb-31eab852a359/20260703094421/az_nova_backup_36c3a4f2-c782-418d-be49-db2bcf3421f7-00013 in container: volumebackups. {{(pid=101319) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 09:44:50.697580 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-e53feec1-8677-4812-9b8f-1243b2f4b697 tempest-VolumesBackupsTest-118275719 None] deleted object: volume_35ece5f1-68f7-4f83-93fb-31eab852a359/20260703094421/az_nova_backup_36c3a4f2-c782-418d-be49-db2bcf3421f7-00014 in container: volumebackups. {{(pid=101319) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 09:44:50.720518 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-e53feec1-8677-4812-9b8f-1243b2f4b697 tempest-VolumesBackupsTest-118275719 None] deleted object: volume_35ece5f1-68f7-4f83-93fb-31eab852a359/20260703094421/az_nova_backup_36c3a4f2-c782-418d-be49-db2bcf3421f7-00015 in container: volumebackups. {{(pid=101319) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 09:44:50.744604 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-e53feec1-8677-4812-9b8f-1243b2f4b697 tempest-VolumesBackupsTest-118275719 None] deleted object: volume_35ece5f1-68f7-4f83-93fb-31eab852a359/20260703094421/az_nova_backup_36c3a4f2-c782-418d-be49-db2bcf3421f7-00016 in container: volumebackups. {{(pid=101319) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 09:44:50.766116 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-e53feec1-8677-4812-9b8f-1243b2f4b697 tempest-VolumesBackupsTest-118275719 None] deleted object: volume_35ece5f1-68f7-4f83-93fb-31eab852a359/20260703094421/az_nova_backup_36c3a4f2-c782-418d-be49-db2bcf3421f7-00017 in container: volumebackups. {{(pid=101319) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 09:44:50.788791 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-e53feec1-8677-4812-9b8f-1243b2f4b697 tempest-VolumesBackupsTest-118275719 None] deleted object: volume_35ece5f1-68f7-4f83-93fb-31eab852a359/20260703094421/az_nova_backup_36c3a4f2-c782-418d-be49-db2bcf3421f7-00018 in container: volumebackups. {{(pid=101319) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 09:44:50.806769 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-e53feec1-8677-4812-9b8f-1243b2f4b697 tempest-VolumesBackupsTest-118275719 None] deleted object: volume_35ece5f1-68f7-4f83-93fb-31eab852a359/20260703094421/az_nova_backup_36c3a4f2-c782-418d-be49-db2bcf3421f7-00019 in container: volumebackups. {{(pid=101319) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 09:44:50.825902 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-e53feec1-8677-4812-9b8f-1243b2f4b697 tempest-VolumesBackupsTest-118275719 None] deleted object: volume_35ece5f1-68f7-4f83-93fb-31eab852a359/20260703094421/az_nova_backup_36c3a4f2-c782-418d-be49-db2bcf3421f7-00020 in container: volumebackups. {{(pid=101319) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 09:44:50.835921 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-b6d5137a-1e4e-4124-857c-f62fe2999803 tempest-VolumesBackupsTest-2142009639 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101319) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 09:44:50.836065 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-b6d5137a-1e4e-4124-857c-f62fe2999803 tempest-VolumesBackupsTest-2142009639 None] About to put_object {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 09:44:50.846037 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-e53feec1-8677-4812-9b8f-1243b2f4b697 tempest-VolumesBackupsTest-118275719 None] deleted object: volume_35ece5f1-68f7-4f83-93fb-31eab852a359/20260703094421/az_nova_backup_36c3a4f2-c782-418d-be49-db2bcf3421f7-00021 in container: volumebackups. {{(pid=101319) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 09:44:50.866594 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-e53feec1-8677-4812-9b8f-1243b2f4b697 tempest-VolumesBackupsTest-118275719 None] deleted object: volume_35ece5f1-68f7-4f83-93fb-31eab852a359/20260703094421/az_nova_backup_36c3a4f2-c782-418d-be49-db2bcf3421f7_metadata in container: volumebackups. {{(pid=101319) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 09:44:50.886136 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-e53feec1-8677-4812-9b8f-1243b2f4b697 tempest-VolumesBackupsTest-118275719 None] deleted object: volume_35ece5f1-68f7-4f83-93fb-31eab852a359/20260703094421/az_nova_backup_36c3a4f2-c782-418d-be49-db2bcf3421f7_sha256file in container: volumebackups. {{(pid=101319) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 09:44:50.886344 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-e53feec1-8677-4812-9b8f-1243b2f4b697 tempest-VolumesBackupsTest-118275719 None] delete 36c3a4f2-c782-418d-be49-db2bcf3421f7 finished. {{(pid=101319) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:848}} Jul 03 09:44:50.904578 np0000004400 cinder-backup[101319]: DEBUG cinder.quota [None req-e53feec1-8677-4812-9b8f-1243b2f4b697 tempest-VolumesBackupsTest-118275719 None] Created reservations ['b50f705f-d10b-4ebe-835b-0b0db1f475b9', '31c5c037-4ec8-432a-80c9-7b010bc8da82'] {{(pid=101319) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 09:44:50.919830 np0000004400 cinder-backup[101319]: INFO cinder.backup.manager [None req-e53feec1-8677-4812-9b8f-1243b2f4b697 tempest-VolumesBackupsTest-118275719 None] Delete backup finished, backup 36c3a4f2-c782-418d-be49-db2bcf3421f7 deleted. Jul 03 09:44:50.941358 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-b6d5137a-1e4e-4124-857c-f62fe2999803 tempest-VolumesBackupsTest-2142009639 None] backup MD5 for volume_b9d43525-b482-4d2d-8541-23ede348708e/20260703094447/az_nova_backup_a636aad8-67e3-4daa-ac42-7179916eefe7-00004: 25e317773f308e446cc84c503a6d1f85 {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 09:44:50.941526 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-b6d5137a-1e4e-4124-857c-f62fe2999803 tempest-VolumesBackupsTest-2142009639 None] Calling eventlet.sleep(0) {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 09:44:51.135817 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-b6d5137a-1e4e-4124-857c-f62fe2999803 tempest-VolumesBackupsTest-2142009639 None] Backing up chunk of data from volume. {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 09:44:51.389810 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-b6d5137a-1e4e-4124-857c-f62fe2999803 tempest-VolumesBackupsTest-2142009639 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101319) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 09:44:51.390253 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-b6d5137a-1e4e-4124-857c-f62fe2999803 tempest-VolumesBackupsTest-2142009639 None] About to put_object {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 09:44:51.490465 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-b6d5137a-1e4e-4124-857c-f62fe2999803 tempest-VolumesBackupsTest-2142009639 None] backup MD5 for volume_b9d43525-b482-4d2d-8541-23ede348708e/20260703094447/az_nova_backup_a636aad8-67e3-4daa-ac42-7179916eefe7-00005: 25e317773f308e446cc84c503a6d1f85 {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 09:44:51.490465 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-b6d5137a-1e4e-4124-857c-f62fe2999803 tempest-VolumesBackupsTest-2142009639 None] Calling eventlet.sleep(0) {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 09:44:51.710994 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-b6d5137a-1e4e-4124-857c-f62fe2999803 tempest-VolumesBackupsTest-2142009639 None] Backing up chunk of data from volume. {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 09:44:51.948662 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-b6d5137a-1e4e-4124-857c-f62fe2999803 tempest-VolumesBackupsTest-2142009639 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101319) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 09:44:51.948820 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-b6d5137a-1e4e-4124-857c-f62fe2999803 tempest-VolumesBackupsTest-2142009639 None] About to put_object {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 09:44:52.050392 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-b6d5137a-1e4e-4124-857c-f62fe2999803 tempest-VolumesBackupsTest-2142009639 None] backup MD5 for volume_b9d43525-b482-4d2d-8541-23ede348708e/20260703094447/az_nova_backup_a636aad8-67e3-4daa-ac42-7179916eefe7-00006: 25e317773f308e446cc84c503a6d1f85 {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 09:44:52.050392 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-b6d5137a-1e4e-4124-857c-f62fe2999803 tempest-VolumesBackupsTest-2142009639 None] Calling eventlet.sleep(0) {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 09:44:52.281646 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-b6d5137a-1e4e-4124-857c-f62fe2999803 tempest-VolumesBackupsTest-2142009639 None] Backing up chunk of data from volume. {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 09:44:52.541975 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-b6d5137a-1e4e-4124-857c-f62fe2999803 tempest-VolumesBackupsTest-2142009639 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101319) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 09:44:52.542354 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-b6d5137a-1e4e-4124-857c-f62fe2999803 tempest-VolumesBackupsTest-2142009639 None] About to put_object {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 09:44:52.666339 np0000004400 cinder-backup[101319]: INFO cinder.backup.manager [None req-1b52199c-010f-4d91-967a-441d98ec32e0 tempest-VolumesBackupsTest-118275719 None] Create backup started, backup: 3087847d-58e1-4a0c-af9c-2639ae9f2aeb volume: b86cbab3-7c42-409e-b4f6-0ed61267a031. Jul 03 09:44:52.666339 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-b6d5137a-1e4e-4124-857c-f62fe2999803 tempest-VolumesBackupsTest-2142009639 None] backup MD5 for volume_b9d43525-b482-4d2d-8541-23ede348708e/20260703094447/az_nova_backup_a636aad8-67e3-4daa-ac42-7179916eefe7-00007: 25e317773f308e446cc84c503a6d1f85 {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 09:44:52.666339 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-b6d5137a-1e4e-4124-857c-f62fe2999803 tempest-VolumesBackupsTest-2142009639 None] Calling eventlet.sleep(0) {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 09:44:52.698301 np0000004400 cinder-backup[101319]: INFO cinder.backup.manager [None req-1b52199c-010f-4d91-967a-441d98ec32e0 tempest-VolumesBackupsTest-118275719 None] Call Volume Manager to get_backup_device for Backup(availability_zone='nova',container=None,created_at=2026-07-03T09:44:52Z,data_timestamp=2026-07-03T09:44:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesBackupsTest-Backup-2010155406',encryption_key_id=None,fail_reason=None,host='np0000004400',id=3087847d-58e1-4a0c-af9c-2639ae9f2aeb,metadata={},num_dependent_backups=0,object_count=0,parent=None,parent_id=None,project_id='a484ec9218bf417bb9d7575ae6370646',restore_volume_id=None,service='cinder.backup.drivers.swift.SwiftBackupDriver',service_metadata=None,size=1,snapshot_id=None,status='creating',temp_snapshot_id=None,temp_volume_id=None,updated_at=None,user_id='b861df2a13684334b293b1f348152e37',volume_id=b86cbab3-7c42-409e-b4f6-0ed61267a031) Jul 03 09:44:52.725498 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.drivers.swift [None req-1b52199c-010f-4d91-967a-441d98ec32e0 tempest-VolumesBackupsTest-118275719 None] Using swift URL https://10.4.3.95:8080/v1/AUTH_a484ec9218bf417bb9d7575ae6370646 {{(pid=101319) initialize /opt/stack/cinder/cinder/backup/drivers/swift.py:300}} Jul 03 09:44:52.725703 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.drivers.swift [None req-1b52199c-010f-4d91-967a-441d98ec32e0 tempest-VolumesBackupsTest-118275719 None] Connect to https://10.4.3.95:8080/v1/AUTH_ in "per_user" mode {{(pid=101319) initialize /opt/stack/cinder/cinder/backup/drivers/swift.py:301}} Jul 03 09:44:52.729432 np0000004400 cinder-backup[101319]: DEBUG os_brick.utils [None req-1b52199c-010f-4d91-967a-441d98ec32e0 tempest-VolumesBackupsTest-118275719 None] ==> get_connector_properties: call "{'root_helper': 'sudo cinder-rootwrap /etc/cinder/rootwrap.conf', 'my_ip': '10.4.3.95', 'multipath': False, 'enforce_multipath': False, 'host': None, 'execute': None}" {{(pid=101319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}} Jul 03 09:44:52.741324 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.scaleio [None req-1b52199c-010f-4d91-967a-441d98ec32e0 tempest-VolumesBackupsTest-118275719 None] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=101319) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}} Jul 03 09:44:52.768134 np0000004400 cinder-backup[101319]: DEBUG oslo_concurrency.processutils [None req-1b52199c-010f-4d91-967a-441d98ec32e0 tempest-VolumesBackupsTest-118275719 None] Running cmd (subprocess): nvme version {{(pid=101319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 09:44:52.785834 np0000004400 cinder-backup[101319]: DEBUG oslo_concurrency.processutils [None req-1b52199c-010f-4d91-967a-441d98ec32e0 tempest-VolumesBackupsTest-118275719 None] 'nvme version' failed. Not Retrying. {{(pid=101319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 03 09:44:52.786844 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.nvmeof [None req-1b52199c-010f-4d91-967a-441d98ec32e0 tempest-VolumesBackupsTest-118275719 None] nvme not present on system {{(pid=101319) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}} Jul 03 09:44:52.815722 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.lightos [None req-1b52199c-010f-4d91-967a-441d98ec32e0 tempest-VolumesBackupsTest-118275719 None] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=101319) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}} Jul 03 09:44:52.817068 np0000004400 cinder-backup[101319]: INFO os_brick.initiator.connectors.lightos [None req-1b52199c-010f-4d91-967a-441d98ec32e0 tempest-VolumesBackupsTest-118275719 None] Current host hostNQN and IP(s) are ['10.4.3.95', 'fe80::f816:3eff:fe47:268c', '192.168.40.6', 'fe80::f816:3eff:febf:7be2', '192.168.50.6', 'fe80::f816:3eff:fe99:8914', '192.168.10.6', 'fe80::f816:3eff:fe2f:e696', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::bc9d:84ff:fec2:6b49', 'fe80::fc16:3eff:fe36:77bf', 'fe80::4c47:1ff:fe64:1879', 'fe80::fc16:3eff:fec6:c223', 'fe80::fc16:3eff:fef5:5e6e', 'fe80::94d0:62ff:fec5:3886', 'fe80::fc16:3eff:fe48:c24e', 'fe80::fc16:3eff:fea8:bf8b', 'fe80::fc16:3eff:fe42:afa1', 'fe80::fc16:3eff:fea0:4147', 'fe80::b0cf:48ff:fe29:caf0', 'fe80::fc16:3eff:fedf:37a6', 'fe80::fc16:3eff:fe63:d9db', 'fe80::fc16:3eff:fe3b:46af', 'fe80::28c1:27ff:fe3c:5528'] Jul 03 09:44:52.817220 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.lightos [None req-1b52199c-010f-4d91-967a-441d98ec32e0 tempest-VolumesBackupsTest-118275719 None] LIGHTOS: did not find dsc, continuing anyway. {{(pid=101319) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}} Jul 03 09:44:52.817352 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.lightos [None req-1b52199c-010f-4d91-967a-441d98ec32e0 tempest-VolumesBackupsTest-118275719 None] LIGHTOS: no hostnqn found. {{(pid=101319) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}} Jul 03 09:44:52.817601 np0000004400 cinder-backup[101319]: DEBUG os_brick.utils [None req-1b52199c-010f-4d91-967a-441d98ec32e0 tempest-VolumesBackupsTest-118275719 None] <== get_connector_properties: return (90ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.95', 'host': 'np0000004400', 'multipath': False, 'enforce_multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:ae7e5bb0ebe6', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': '6b284368-d0ba-4d18-af6f-4998d3955c52', 'nvme_native_multipath': False} {{(pid=101319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}} Jul 03 09:44:52.941463 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-b6d5137a-1e4e-4124-857c-f62fe2999803 tempest-VolumesBackupsTest-2142009639 None] Backing up chunk of data from volume. {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 09:44:53.211106 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-b6d5137a-1e4e-4124-857c-f62fe2999803 tempest-VolumesBackupsTest-2142009639 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101319) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 09:44:53.211310 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-b6d5137a-1e4e-4124-857c-f62fe2999803 tempest-VolumesBackupsTest-2142009639 None] About to put_object {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 09:44:53.321766 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connector [None req-1b52199c-010f-4d91-967a-441d98ec32e0 tempest-VolumesBackupsTest-118275719 None] Factory for iscsi on None {{(pid=101319) factory /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connector.py:243}} Jul 03 09:44:53.322257 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-1b52199c-010f-4d91-967a-441d98ec32e0 tempest-VolumesBackupsTest-118275719 None] ==> connect_volume: call "{'self': , 'connection_properties': {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-b86cbab3-7c42-409e-b4f6-0ed61267a031', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'b86cbab3-7c42-409e-b4f6-0ed61267a031', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': False}}" {{(pid=101319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}} Jul 03 09:44:53.322538 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.base [None req-1b52199c-010f-4d91-967a-441d98ec32e0 tempest-VolumesBackupsTest-118275719 None] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=101319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jul 03 09:44:53.323041 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.base [None req-1b52199c-010f-4d91-967a-441d98ec32e0 tempest-VolumesBackupsTest-118275719 None] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=101319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jul 03 09:44:53.323295 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.base [None req-1b52199c-010f-4d91-967a-441d98ec32e0 tempest-VolumesBackupsTest-118275719 None] Connection properties {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-b86cbab3-7c42-409e-b4f6-0ed61267a031', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'b86cbab3-7c42-409e-b4f6-0ed61267a031', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': False} {{(pid=101319) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}} Jul 03 09:44:53.331837 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-b6d5137a-1e4e-4124-857c-f62fe2999803 tempest-VolumesBackupsTest-2142009639 None] backup MD5 for volume_b9d43525-b482-4d2d-8541-23ede348708e/20260703094447/az_nova_backup_a636aad8-67e3-4daa-ac42-7179916eefe7-00008: 25e317773f308e446cc84c503a6d1f85 {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 09:44:53.332042 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-b6d5137a-1e4e-4124-857c-f62fe2999803 tempest-VolumesBackupsTest-2142009639 None] Calling eventlet.sleep(0) {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 09:44:53.368870 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.base [None req-1b52199c-010f-4d91-967a-441d98ec32e0 tempest-VolumesBackupsTest-118275719 None] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-b86cbab3-7c42-409e-b4f6-0ed61267a031" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=101319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jul 03 09:44:53.369245 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.base [None req-1b52199c-010f-4d91-967a-441d98ec32e0 tempest-VolumesBackupsTest-118275719 None] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-b86cbab3-7c42-409e-b4f6-0ed61267a031" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.000s {{(pid=101319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jul 03 09:44:53.369450 np0000004400 cinder-backup[101319]: INFO os_brick.initiator.connectors.iscsi [None req-1b52199c-010f-4d91-967a-441d98ec32e0 tempest-VolumesBackupsTest-118275719 None] Trying to connect to iSCSI portal 192.168.40.100:3260 Jul 03 09:44:53.376576 np0000004400 cinder-backup[101319]: DEBUG oslo_db.sqlalchemy.engines [None req-b6d5137a-1e4e-4124-857c-f62fe2999803 tempest-VolumesBackupsTest-2142009639 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=101319) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 03 09:44:53.379511 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-1b52199c-010f-4d91-967a-441d98ec32e0 tempest-VolumesBackupsTest-118275719 None] iscsiadm (): stdout= stderr=iscsiadm: No records found Jul 03 09:44:53.379511 np0000004400 cinder-backup[101319]: {{(pid=101319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 03 09:44:53.390962 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-1b52199c-010f-4d91-967a-441d98ec32e0 tempest-VolumesBackupsTest-118275719 None] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-b86cbab3-7c42-409e-b4f6-0ed61267a031] added Jul 03 09:44:53.390962 np0000004400 cinder-backup[101319]: stderr=iscsiadm: Config file line 363 does not have value Jul 03 09:44:53.390962 np0000004400 cinder-backup[101319]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs' Jul 03 09:44:53.390962 np0000004400 cinder-backup[101319]: iscsiadm: Config file line 363 does not have value Jul 03 09:44:53.390962 np0000004400 cinder-backup[101319]: iscsiadm: Config file line 363 does not have value Jul 03 09:44:53.390962 np0000004400 cinder-backup[101319]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs' Jul 03 09:44:53.390962 np0000004400 cinder-backup[101319]: {{(pid=101319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 03 09:44:53.391264 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-1b52199c-010f-4d91-967a-441d98ec32e0 tempest-VolumesBackupsTest-118275719 None] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=101319) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}} Jul 03 09:44:53.391538 np0000004400 cinder-backup[101319]: DEBUG os_brick.utils [None req-1b52199c-010f-4d91-967a-441d98ec32e0 tempest-VolumesBackupsTest-118275719 None] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.022(s), this was the 1st time calling it. {{(pid=101319) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}} Jul 03 09:44:53.391751 np0000004400 cinder-backup[101319]: DEBUG os_brick.utils [None req-1b52199c-010f-4d91-967a-441d98ec32e0 tempest-VolumesBackupsTest-118275719 None] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=101319) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}} Jul 03 09:44:53.607296 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-b6d5137a-1e4e-4124-857c-f62fe2999803 tempest-VolumesBackupsTest-2142009639 None] Backing up chunk of data from volume. {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 09:44:53.856189 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-b6d5137a-1e4e-4124-857c-f62fe2999803 tempest-VolumesBackupsTest-2142009639 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101319) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 09:44:53.856350 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-b6d5137a-1e4e-4124-857c-f62fe2999803 tempest-VolumesBackupsTest-2142009639 None] About to put_object {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 09:44:53.956175 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-b6d5137a-1e4e-4124-857c-f62fe2999803 tempest-VolumesBackupsTest-2142009639 None] backup MD5 for volume_b9d43525-b482-4d2d-8541-23ede348708e/20260703094447/az_nova_backup_a636aad8-67e3-4daa-ac42-7179916eefe7-00009: 25e317773f308e446cc84c503a6d1f85 {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 09:44:53.956346 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-b6d5137a-1e4e-4124-857c-f62fe2999803 tempest-VolumesBackupsTest-2142009639 None] Calling eventlet.sleep(0) {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 09:44:54.128530 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-b6d5137a-1e4e-4124-857c-f62fe2999803 tempest-VolumesBackupsTest-2142009639 None] Backing up chunk of data from volume. {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 09:44:54.372803 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-b6d5137a-1e4e-4124-857c-f62fe2999803 tempest-VolumesBackupsTest-2142009639 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101319) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 09:44:54.373023 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-b6d5137a-1e4e-4124-857c-f62fe2999803 tempest-VolumesBackupsTest-2142009639 None] About to put_object {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 09:44:54.393302 np0000004400 cinder-backup[101319]: INFO os_brick.initiator.connectors.iscsi [None req-1b52199c-010f-4d91-967a-441d98ec32e0 tempest-VolumesBackupsTest-118275719 None] Trying to connect to iSCSI portal 192.168.40.100:3260 Jul 03 09:44:54.408124 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-1b52199c-010f-4d91-967a-441d98ec32e0 tempest-VolumesBackupsTest-118275719 None] iscsiadm (): stdout=# BEGIN RECORD 2.1.9 Jul 03 09:44:54.408124 np0000004400 cinder-backup[101319]: node.name = iqn.2023-03.storpool.com:os--volume-b86cbab3-7c42-409e-b4f6-0ed61267a031 Jul 03 09:44:54.408124 np0000004400 cinder-backup[101319]: node.tpgt = -1 Jul 03 09:44:54.408124 np0000004400 cinder-backup[101319]: node.startup = manual Jul 03 09:44:54.408124 np0000004400 cinder-backup[101319]: node.leading_login = No Jul 03 09:44:54.408124 np0000004400 cinder-backup[101319]: iface.iscsi_ifacename = default Jul 03 09:44:54.408124 np0000004400 cinder-backup[101319]: iface.net_ifacename = Jul 03 09:44:54.408124 np0000004400 cinder-backup[101319]: iface.ipaddress = Jul 03 09:44:54.408124 np0000004400 cinder-backup[101319]: iface.prefix_len = 0 Jul 03 09:44:54.408124 np0000004400 cinder-backup[101319]: iface.hwaddress = Jul 03 09:44:54.408124 np0000004400 cinder-backup[101319]: iface.transport_name = tcp Jul 03 09:44:54.408124 np0000004400 cinder-backup[101319]: iface.initiatorname = Jul 03 09:44:54.408124 np0000004400 cinder-backup[101319]: iface.state = Jul 03 09:44:54.408124 np0000004400 cinder-backup[101319]: iface.vlan_id = 0 Jul 03 09:44:54.408124 np0000004400 cinder-backup[101319]: iface.vlan_priority = 0 Jul 03 09:44:54.408124 np0000004400 cinder-backup[101319]: iface.vlan_state = Jul 03 09:44:54.408124 np0000004400 cinder-backup[101319]: iface.iface_num = 0 Jul 03 09:44:54.408124 np0000004400 cinder-backup[101319]: iface.mtu = 0 Jul 03 09:44:54.408124 np0000004400 cinder-backup[101319]: iface.port = 0 Jul 03 09:44:54.408124 np0000004400 cinder-backup[101319]: iface.bootproto = Jul 03 09:44:54.408124 np0000004400 cinder-backup[101319]: iface.subnet_mask = Jul 03 09:44:54.408124 np0000004400 cinder-backup[101319]: iface.gateway = Jul 03 09:44:54.408124 np0000004400 cinder-backup[101319]: iface.dhcp_alt_client_id_state = Jul 03 09:44:54.408124 np0000004400 cinder-backup[101319]: iface.dhcp_alt_client_id = Jul 03 09:44:54.408124 np0000004400 cinder-backup[101319]: iface.dhcp_dns = Jul 03 09:44:54.408124 np0000004400 cinder-backup[101319]: iface.dhcp_learn_iqn = Jul 03 09:44:54.408124 np0000004400 cinder-backup[101319]: iface.dhcp_req_vendor_id_state = Jul 03 09:44:54.408124 np0000004400 cinder-backup[101319]: iface.dhcp_vendor_id_state = Jul 03 09:44:54.408124 np0000004400 cinder-backup[101319]: iface.dhcp_vendor_id = Jul 03 09:44:54.408124 np0000004400 cinder-backup[101319]: iface.dhcp_slp_da = Jul 03 09:44:54.408124 np0000004400 cinder-backup[101319]: iface.fragmentation = Jul 03 09:44:54.408124 np0000004400 cinder-backup[101319]: iface.gratuitous_arp = Jul 03 09:44:54.408124 np0000004400 cinder-backup[101319]: iface.incoming_forwarding = Jul 03 09:44:54.408124 np0000004400 cinder-backup[101319]: iface.tos_state = Jul 03 09:44:54.408124 np0000004400 cinder-backup[101319]: iface.tos = 0 Jul 03 09:44:54.408124 np0000004400 cinder-backup[101319]: iface.ttl = 0 Jul 03 09:44:54.408124 np0000004400 cinder-backup[101319]: iface.delayed_ack = Jul 03 09:44:54.408124 np0000004400 cinder-backup[101319]: iface.tcp_nagle = Jul 03 09:44:54.408124 np0000004400 cinder-backup[101319]: iface.tcp_wsf_state = Jul 03 09:44:54.408124 np0000004400 cinder-backup[101319]: iface.tcp_wsf = 0 Jul 03 09:44:54.408124 np0000004400 cinder-backup[101319]: iface.tcp_timer_scale = 0 Jul 03 09:44:54.408124 np0000004400 cinder-backup[101319]: iface.tcp_timestamp = Jul 03 09:44:54.408124 np0000004400 cinder-backup[101319]: iface.redirect = Jul 03 09:44:54.408124 np0000004400 cinder-backup[101319]: iface.def_task_mgmt_timeout = 0 Jul 03 09:44:54.408124 np0000004400 cinder-backup[101319]: iface.header_digest = Jul 03 09:44:54.408124 np0000004400 cinder-backup[101319]: iface.data_digest = Jul 03 09:44:54.408124 np0000004400 cinder-backup[101319]: iface.immediate_data = Jul 03 09:44:54.408124 np0000004400 cinder-backup[101319]: iface.initial_r2t = Jul 03 09:44:54.408124 np0000004400 cinder-backup[101319]: iface.data_seq_inorder = Jul 03 09:44:54.408124 np0000004400 cinder-backup[101319]: iface.data_pdu_inorder = Jul 03 09:44:54.408124 np0000004400 cinder-backup[101319]: iface.erl = 0 Jul 03 09:44:54.408124 np0000004400 cinder-backup[101319]: iface.max_receive_data_len = 0 Jul 03 09:44:54.408124 np0000004400 cinder-backup[101319]: iface.first_burst_len = 0 Jul 03 09:44:54.408124 np0000004400 cinder-backup[101319]: iface.max_outstanding_r2t = 0 Jul 03 09:44:54.408124 np0000004400 cinder-backup[101319]: iface.max_burst_len = 0 Jul 03 09:44:54.408124 np0000004400 cinder-backup[101319]: iface.chap_auth = Jul 03 09:44:54.408124 np0000004400 cinder-backup[101319]: iface.bidi_chap = Jul 03 09:44:54.408124 np0000004400 cinder-backup[101319]: iface.strict_login_compliance = Jul 03 09:44:54.408124 np0000004400 cinder-backup[101319]: iface.discovery_auth = Jul 03 09:44:54.408124 np0000004400 cinder-backup[101319]: iface.discovery_logout = Jul 03 09:44:54.408124 np0000004400 cinder-backup[101319]: node.discovery_address = Jul 03 09:44:54.408124 np0000004400 cinder-backup[101319]: node.discovery_port = 0 Jul 03 09:44:54.408124 np0000004400 cinder-backup[101319]: node.discovery_type = fw Jul 03 09:44:54.408124 np0000004400 cinder-backup[101319]: node.session.initial_cmdsn = 0 Jul 03 09:44:54.408124 np0000004400 cinder-backup[101319]: node.session.initial_login_retry_max = 8 Jul 03 09:44:54.408124 np0000004400 cinder-backup[101319]: node.session.xmit_thread_priority = 0 Jul 03 09:44:54.408124 np0000004400 cinder-backup[101319]: node.session.cmds_max = 128 Jul 03 09:44:54.408124 np0000004400 cinder-backup[101319]: node.session.queue_depth = 32 Jul 03 09:44:54.408124 np0000004400 cinder-backup[101319]: node.session.nr_sessions = 1 Jul 03 09:44:54.408124 np0000004400 cinder-backup[101319]: node.session.auth.authmethod = None Jul 03 09:44:54.408124 np0000004400 cinder-backup[101319]: node.session.auth.username = Jul 03 09:44:54.408124 np0000004400 cinder-backup[101319]: node.session.auth.password = *** Jul 03 09:44:54.408124 np0000004400 cinder-backup[101319]: node.session.auth.username_in = Jul 03 09:44:54.408124 np0000004400 cinder-backup[101319]: node.session.auth.password_in = Jul 03 09:44:54.408124 np0000004400 cinder-backup[101319]: node.session.auth.chap_algs = SHA256 Jul 03 09:44:54.408124 np0000004400 cinder-backup[101319]: node.session.timeo.replacement_timeout = 120 Jul 03 09:44:54.408124 np0000004400 cinder-backup[101319]: node.session.err_timeo.abort_timeout = 15 Jul 03 09:44:54.408124 np0000004400 cinder-backup[101319]: node.session.err_timeo.lu_reset_timeout = 30 Jul 03 09:44:54.408124 np0000004400 cinder-backup[101319]: node.session.err_timeo.tgt_reset_timeout = 30 Jul 03 09:44:54.408124 np0000004400 cinder-backup[101319]: node.session.err_timeo.host_reset_timeout = 60 Jul 03 09:44:54.408124 np0000004400 cinder-backup[101319]: node.session.iscsi.FastAbort = Yes Jul 03 09:44:54.408124 np0000004400 cinder-backup[101319]: node.session.iscsi.InitialR2T = No Jul 03 09:44:54.408124 np0000004400 cinder-backup[101319]: node.session.iscsi.ImmediateData = Yes Jul 03 09:44:54.408124 np0000004400 cinder-backup[101319]: node.session.iscsi.FirstBurstLength = 262144 Jul 03 09:44:54.408124 np0000004400 cinder-backup[101319]: node.session.iscsi.MaxBurstLength = 16776192 Jul 03 09:44:54.408124 np0000004400 cinder-backup[101319]: node.session.iscsi.DefaultTime2Retain = 0 Jul 03 09:44:54.408124 np0000004400 cinder-backup[101319]: node.session.iscsi.DefaultTime2Wait = 2 Jul 03 09:44:54.408124 np0000004400 cinder-backup[101319]: node.session.iscsi.MaxConnections = 1 Jul 03 09:44:54.408124 np0000004400 cinder-backup[101319]: node.session.iscsi.MaxOutstandingR2T = 1 Jul 03 09:44:54.408124 np0000004400 cinder-backup[101319]: node.session.iscsi.ERL = 0 Jul 03 09:44:54.408124 np0000004400 cinder-backup[101319]: node.session.scan = auto Jul 03 09:44:54.408124 np0000004400 cinder-backup[101319]: node.session.reopen_max = 0 Jul 03 09:44:54.408124 np0000004400 cinder-backup[101319]: node.conn[0].address = 192.168.40.100 Jul 03 09:44:54.408124 np0000004400 cinder-backup[101319]: node.conn[0].port = 3260 Jul 03 09:44:54.408124 np0000004400 cinder-backup[101319]: node.conn[0].startup = manual Jul 03 09:44:54.408124 np0000004400 cinder-backup[101319]: node.conn[0].tcp.window_size = 524288 Jul 03 09:44:54.408124 np0000004400 cinder-backup[101319]: node.conn[0].tcp.type_of_service = 0 Jul 03 09:44:54.408124 np0000004400 cinder-backup[101319]: node.conn[0].timeo.logout_timeout = 15 Jul 03 09:44:54.408124 np0000004400 cinder-backup[101319]: node.conn[0].timeo.login_timeout = 15 Jul 03 09:44:54.408124 np0000004400 cinder-backup[101319]: node.conn[0].timeo.auth_timeout = 45 Jul 03 09:44:54.408124 np0000004400 cinder-backup[101319]: node.conn[0].timeo.noop_out_interval = 5 Jul 03 09:44:54.408124 np0000004400 cinder-backup[101319]: node.conn[0].timeo.noop_out_timeout = 5 Jul 03 09:44:54.408124 np0000004400 cinder-backup[101319]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0 Jul 03 09:44:54.408124 np0000004400 cinder-backup[101319]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144 Jul 03 09:44:54.408124 np0000004400 cinder-backup[101319]: node.conn[0].iscsi.HeaderDigest = None Jul 03 09:44:54.408124 np0000004400 cinder-backup[101319]: node.conn[0].iscsi.DataDigest = None Jul 03 09:44:54.408124 np0000004400 cinder-backup[101319]: node.conn[0].iscsi.IFMarker = No Jul 03 09:44:54.408124 np0000004400 cinder-backup[101319]: node.conn[0].iscsi.OFMarker = No Jul 03 09:44:54.408124 np0000004400 cinder-backup[101319]: # END RECORD Jul 03 09:44:54.408124 np0000004400 cinder-backup[101319]: stderr= {{(pid=101319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 03 09:44:54.420465 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-1b52199c-010f-4d91-967a-441d98ec32e0 tempest-VolumesBackupsTest-118275719 None] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=101319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 03 09:44:54.435734 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-1b52199c-010f-4d91-967a-441d98ec32e0 tempest-VolumesBackupsTest-118275719 None] iscsiadm ('-m', 'session'): stdout=tcp: [49] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b2e4f10c-8033-4c54-95a1-dfe45d6357a3 (non-flash) Jul 03 09:44:54.435734 np0000004400 cinder-backup[101319]: tcp: [50] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b2e4f10c-8033-4c54-95a1-dfe45d6357a3 (non-flash) Jul 03 09:44:54.435734 np0000004400 cinder-backup[101319]: tcp: [82] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-76320525-737e-4f58-8523-63ec9abbdc64 (non-flash) Jul 03 09:44:54.435734 np0000004400 cinder-backup[101319]: tcp: [83] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-76320525-737e-4f58-8523-63ec9abbdc64 (non-flash) Jul 03 09:44:54.435734 np0000004400 cinder-backup[101319]: tcp: [87] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-dc2d662f-bc12-4338-8e3d-6565f72ba808 (non-flash) Jul 03 09:44:54.435734 np0000004400 cinder-backup[101319]: tcp: [88] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-dc2d662f-bc12-4338-8e3d-6565f72ba808 (non-flash) Jul 03 09:44:54.435734 np0000004400 cinder-backup[101319]: tcp: [93] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-aecd73f6-86c7-4ae8-8bfa-b46655eb6efb (non-flash) Jul 03 09:44:54.435734 np0000004400 cinder-backup[101319]: tcp: [94] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-aecd73f6-86c7-4ae8-8bfa-b46655eb6efb (non-flash) Jul 03 09:44:54.435734 np0000004400 cinder-backup[101319]: tcp: [95] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b9d43525-b482-4d2d-8541-23ede348708e (non-flash) Jul 03 09:44:54.435734 np0000004400 cinder-backup[101319]: stderr= {{(pid=101319) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jul 03 09:44:54.435981 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-1b52199c-010f-4d91-967a-441d98ec32e0 tempest-VolumesBackupsTest-118275719 None] iscsi session list stdout=tcp: [49] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b2e4f10c-8033-4c54-95a1-dfe45d6357a3 (non-flash) Jul 03 09:44:54.435981 np0000004400 cinder-backup[101319]: tcp: [50] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b2e4f10c-8033-4c54-95a1-dfe45d6357a3 (non-flash) Jul 03 09:44:54.435981 np0000004400 cinder-backup[101319]: tcp: [82] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-76320525-737e-4f58-8523-63ec9abbdc64 (non-flash) Jul 03 09:44:54.435981 np0000004400 cinder-backup[101319]: tcp: [83] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-76320525-737e-4f58-8523-63ec9abbdc64 (non-flash) Jul 03 09:44:54.435981 np0000004400 cinder-backup[101319]: tcp: [87] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-dc2d662f-bc12-4338-8e3d-6565f72ba808 (non-flash) Jul 03 09:44:54.435981 np0000004400 cinder-backup[101319]: tcp: [88] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-dc2d662f-bc12-4338-8e3d-6565f72ba808 (non-flash) Jul 03 09:44:54.435981 np0000004400 cinder-backup[101319]: tcp: [93] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-aecd73f6-86c7-4ae8-8bfa-b46655eb6efb (non-flash) Jul 03 09:44:54.435981 np0000004400 cinder-backup[101319]: tcp: [94] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-aecd73f6-86c7-4ae8-8bfa-b46655eb6efb (non-flash) Jul 03 09:44:54.435981 np0000004400 cinder-backup[101319]: tcp: [95] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b9d43525-b482-4d2d-8541-23ede348708e (non-flash) Jul 03 09:44:54.435981 np0000004400 cinder-backup[101319]: stderr= {{(pid=101319) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jul 03 09:44:54.473272 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-b6d5137a-1e4e-4124-857c-f62fe2999803 tempest-VolumesBackupsTest-2142009639 None] backup MD5 for volume_b9d43525-b482-4d2d-8541-23ede348708e/20260703094447/az_nova_backup_a636aad8-67e3-4daa-ac42-7179916eefe7-00010: 25e317773f308e446cc84c503a6d1f85 {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 09:44:54.473383 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-b6d5137a-1e4e-4124-857c-f62fe2999803 tempest-VolumesBackupsTest-2142009639 None] Calling eventlet.sleep(0) {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 09:44:54.483444 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-1b52199c-010f-4d91-967a-441d98ec32e0 tempest-VolumesBackupsTest-118275719 None] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-b86cbab3-7c42-409e-b4f6-0ed61267a031, portal: 192.168.40.100,3260] Jul 03 09:44:54.483444 np0000004400 cinder-backup[101319]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-b86cbab3-7c42-409e-b4f6-0ed61267a031, portal: 192.168.40.100,3260] successful. Jul 03 09:44:54.483444 np0000004400 cinder-backup[101319]: stderr= {{(pid=101319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 03 09:44:54.501907 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-1b52199c-010f-4d91-967a-441d98ec32e0 tempest-VolumesBackupsTest-118275719 None] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=101319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 03 09:44:54.521801 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-1b52199c-010f-4d91-967a-441d98ec32e0 tempest-VolumesBackupsTest-118275719 None] iscsiadm ('-m', 'session'): stdout=tcp: [49] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b2e4f10c-8033-4c54-95a1-dfe45d6357a3 (non-flash) Jul 03 09:44:54.521801 np0000004400 cinder-backup[101319]: tcp: [50] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b2e4f10c-8033-4c54-95a1-dfe45d6357a3 (non-flash) Jul 03 09:44:54.521801 np0000004400 cinder-backup[101319]: tcp: [82] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-76320525-737e-4f58-8523-63ec9abbdc64 (non-flash) Jul 03 09:44:54.521801 np0000004400 cinder-backup[101319]: tcp: [83] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-76320525-737e-4f58-8523-63ec9abbdc64 (non-flash) Jul 03 09:44:54.521801 np0000004400 cinder-backup[101319]: tcp: [87] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-dc2d662f-bc12-4338-8e3d-6565f72ba808 (non-flash) Jul 03 09:44:54.521801 np0000004400 cinder-backup[101319]: tcp: [88] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-dc2d662f-bc12-4338-8e3d-6565f72ba808 (non-flash) Jul 03 09:44:54.521801 np0000004400 cinder-backup[101319]: tcp: [93] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-aecd73f6-86c7-4ae8-8bfa-b46655eb6efb (non-flash) Jul 03 09:44:54.521801 np0000004400 cinder-backup[101319]: tcp: [94] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-aecd73f6-86c7-4ae8-8bfa-b46655eb6efb (non-flash) Jul 03 09:44:54.521801 np0000004400 cinder-backup[101319]: tcp: [95] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b9d43525-b482-4d2d-8541-23ede348708e (non-flash) Jul 03 09:44:54.521801 np0000004400 cinder-backup[101319]: tcp: [96] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b86cbab3-7c42-409e-b4f6-0ed61267a031 (non-flash) Jul 03 09:44:54.521801 np0000004400 cinder-backup[101319]: stderr= {{(pid=101319) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jul 03 09:44:54.522118 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-1b52199c-010f-4d91-967a-441d98ec32e0 tempest-VolumesBackupsTest-118275719 None] iscsi session list stdout=tcp: [49] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b2e4f10c-8033-4c54-95a1-dfe45d6357a3 (non-flash) Jul 03 09:44:54.522118 np0000004400 cinder-backup[101319]: tcp: [50] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b2e4f10c-8033-4c54-95a1-dfe45d6357a3 (non-flash) Jul 03 09:44:54.522118 np0000004400 cinder-backup[101319]: tcp: [82] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-76320525-737e-4f58-8523-63ec9abbdc64 (non-flash) Jul 03 09:44:54.522118 np0000004400 cinder-backup[101319]: tcp: [83] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-76320525-737e-4f58-8523-63ec9abbdc64 (non-flash) Jul 03 09:44:54.522118 np0000004400 cinder-backup[101319]: tcp: [87] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-dc2d662f-bc12-4338-8e3d-6565f72ba808 (non-flash) Jul 03 09:44:54.522118 np0000004400 cinder-backup[101319]: tcp: [88] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-dc2d662f-bc12-4338-8e3d-6565f72ba808 (non-flash) Jul 03 09:44:54.522118 np0000004400 cinder-backup[101319]: tcp: [93] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-aecd73f6-86c7-4ae8-8bfa-b46655eb6efb (non-flash) Jul 03 09:44:54.522118 np0000004400 cinder-backup[101319]: tcp: [94] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-aecd73f6-86c7-4ae8-8bfa-b46655eb6efb (non-flash) Jul 03 09:44:54.522118 np0000004400 cinder-backup[101319]: tcp: [95] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b9d43525-b482-4d2d-8541-23ede348708e (non-flash) Jul 03 09:44:54.522118 np0000004400 cinder-backup[101319]: tcp: [96] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b86cbab3-7c42-409e-b4f6-0ed61267a031 (non-flash) Jul 03 09:44:54.522118 np0000004400 cinder-backup[101319]: stderr= {{(pid=101319) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jul 03 09:44:54.522498 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.base [None req-1b52199c-010f-4d91-967a-441d98ec32e0 tempest-VolumesBackupsTest-118275719 None] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-b86cbab3-7c42-409e-b4f6-0ed61267a031" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.153s {{(pid=101319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jul 03 09:44:54.522593 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-1b52199c-010f-4d91-967a-441d98ec32e0 tempest-VolumesBackupsTest-118275719 None] Connected to 192.168.40.100:3260 {{(pid=101319) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}} Jul 03 09:44:54.524029 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.linuxscsi [None req-1b52199c-010f-4d91-967a-441d98ec32e0 tempest-VolumesBackupsTest-118275719 None] HCTL ('7', '-', '-', 0) found on session 96 with lun 0 {{(pid=101319) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}} Jul 03 09:44:54.524247 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.linuxscsi [None req-1b52199c-010f-4d91-967a-441d98ec32e0 tempest-VolumesBackupsTest-118275719 None] Scanning host 7 c: -, t: -, l: 0) {{(pid=101319) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}} Jul 03 09:44:54.554503 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.linuxscsi [None req-1b52199c-010f-4d91-967a-441d98ec32e0 tempest-VolumesBackupsTest-118275719 None] Searching for a device in session 96 and hctl ['7', '*', '*', 0] yield: sdb {{(pid=101319) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}} Jul 03 09:44:54.554810 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-1b52199c-010f-4d91-967a-441d98ec32e0 tempest-VolumesBackupsTest-118275719 None] Connected to sdb using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-b86cbab3-7c42-409e-b4f6-0ed61267a031', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'b86cbab3-7c42-409e-b4f6-0ed61267a031', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': False} {{(pid=101319) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}} Jul 03 09:44:54.677972 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-b6d5137a-1e4e-4124-857c-f62fe2999803 tempest-VolumesBackupsTest-2142009639 None] Backing up chunk of data from volume. {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 09:44:54.921194 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-b6d5137a-1e4e-4124-857c-f62fe2999803 tempest-VolumesBackupsTest-2142009639 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101319) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 09:44:54.921419 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-b6d5137a-1e4e-4124-857c-f62fe2999803 tempest-VolumesBackupsTest-2142009639 None] About to put_object {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 09:44:55.041999 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-b6d5137a-1e4e-4124-857c-f62fe2999803 tempest-VolumesBackupsTest-2142009639 None] backup MD5 for volume_b9d43525-b482-4d2d-8541-23ede348708e/20260703094447/az_nova_backup_a636aad8-67e3-4daa-ac42-7179916eefe7-00011: 25e317773f308e446cc84c503a6d1f85 {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 09:44:55.042598 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-b6d5137a-1e4e-4124-857c-f62fe2999803 tempest-VolumesBackupsTest-2142009639 None] Calling eventlet.sleep(0) {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 09:44:55.220332 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-b6d5137a-1e4e-4124-857c-f62fe2999803 tempest-VolumesBackupsTest-2142009639 None] Backing up chunk of data from volume. {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 09:44:55.469480 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-b6d5137a-1e4e-4124-857c-f62fe2999803 tempest-VolumesBackupsTest-2142009639 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101319) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 09:44:55.469690 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-b6d5137a-1e4e-4124-857c-f62fe2999803 tempest-VolumesBackupsTest-2142009639 None] About to put_object {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 09:44:55.560105 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.base [None req-1b52199c-010f-4d91-967a-441d98ec32e0 tempest-VolumesBackupsTest-118275719 None] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 2.237s {{(pid=101319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jul 03 09:44:55.560338 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-1b52199c-010f-4d91-967a-441d98ec32e0 tempest-VolumesBackupsTest-118275719 None] <== connect_volume: return (2237ms) {'type': 'block', 'scsi_wwn': '1StorPooliSCSI_DISK_1034578903445799018', 'path': '/dev/sdb'} {{(pid=101319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}} Jul 03 09:44:55.560741 np0000004400 cinder-backup[101319]: DEBUG oslo_concurrency.processutils [None req-1b52199c-010f-4d91-967a-441d98ec32e0 tempest-VolumesBackupsTest-118275719 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chown 1002 /dev/sdb {{(pid=101319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 09:44:55.582489 np0000004400 sudo[135311]: stack : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chown 1002 /dev/sdb Jul 03 09:44:55.583133 np0000004400 sudo[135311]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1002) Jul 03 09:44:55.597055 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-b6d5137a-1e4e-4124-857c-f62fe2999803 tempest-VolumesBackupsTest-2142009639 None] backup MD5 for volume_b9d43525-b482-4d2d-8541-23ede348708e/20260703094447/az_nova_backup_a636aad8-67e3-4daa-ac42-7179916eefe7-00012: 25e317773f308e446cc84c503a6d1f85 {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 09:44:55.597055 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-b6d5137a-1e4e-4124-857c-f62fe2999803 tempest-VolumesBackupsTest-2142009639 None] Calling eventlet.sleep(0) {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 09:44:55.597055 np0000004400 cinder-backup[101319]: DEBUG dbcounter [-] [101319] Writing DB stats cinder:SELECT=131,cinder:UPDATE=37,cinder:INSERT=6 {{(pid=101319) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 03 09:44:55.787645 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-b6d5137a-1e4e-4124-857c-f62fe2999803 tempest-VolumesBackupsTest-2142009639 None] Backing up chunk of data from volume. {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 09:44:55.935499 np0000004400 sudo[135311]: pam_unix(sudo:session): session closed for user root Jul 03 09:44:55.938143 np0000004400 cinder-backup[101319]: DEBUG oslo_concurrency.processutils [None req-1b52199c-010f-4d91-967a-441d98ec32e0 tempest-VolumesBackupsTest-118275719 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chown 1002 /dev/sdb" returned: 0 in 0.377s {{(pid=101319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 09:44:55.953198 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-1b52199c-010f-4d91-967a-441d98ec32e0 tempest-VolumesBackupsTest-118275719 None] _create_container started, container: volumebackups,backup: 3087847d-58e1-4a0c-af9c-2639ae9f2aeb. {{(pid=101319) _create_container /opt/stack/cinder/cinder/backup/chunkeddriver.py:249}} Jul 03 09:44:55.996338 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.drivers.swift [None req-1b52199c-010f-4d91-967a-441d98ec32e0 tempest-VolumesBackupsTest-118275719 None] generate_object_name_prefix: volume_b86cbab3-7c42-409e-b4f6-0ed61267a031/20260703094455/az_nova_backup_3087847d-58e1-4a0c-af9c-2639ae9f2aeb {{(pid=101319) _generate_object_name_prefix /opt/stack/cinder/cinder/backup/drivers/swift.py:452}} Jul 03 09:44:56.007338 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-1b52199c-010f-4d91-967a-441d98ec32e0 tempest-VolumesBackupsTest-118275719 None] starting backup of volume: b86cbab3-7c42-409e-b4f6-0ed61267a031, volume size: 1073741824, object names prefix volume_b86cbab3-7c42-409e-b4f6-0ed61267a031/20260703094455/az_nova_backup_3087847d-58e1-4a0c-af9c-2639ae9f2aeb, availability zone: nova {{(pid=101319) _prepare_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:359}} Jul 03 09:44:56.040077 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-b6d5137a-1e4e-4124-857c-f62fe2999803 tempest-VolumesBackupsTest-2142009639 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101319) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 09:44:56.040376 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-b6d5137a-1e4e-4124-857c-f62fe2999803 tempest-VolumesBackupsTest-2142009639 None] About to put_object {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 09:44:56.182731 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-b6d5137a-1e4e-4124-857c-f62fe2999803 tempest-VolumesBackupsTest-2142009639 None] backup MD5 for volume_b9d43525-b482-4d2d-8541-23ede348708e/20260703094447/az_nova_backup_a636aad8-67e3-4daa-ac42-7179916eefe7-00013: 25e317773f308e446cc84c503a6d1f85 {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 09:44:56.182959 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-b6d5137a-1e4e-4124-857c-f62fe2999803 tempest-VolumesBackupsTest-2142009639 None] Calling eventlet.sleep(0) {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 09:44:56.228239 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-1b52199c-010f-4d91-967a-441d98ec32e0 tempest-VolumesBackupsTest-118275719 None] Backing up chunk of data from volume. {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 09:44:56.379759 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-b6d5137a-1e4e-4124-857c-f62fe2999803 tempest-VolumesBackupsTest-2142009639 None] Backing up chunk of data from volume. {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 09:44:56.501990 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-1b52199c-010f-4d91-967a-441d98ec32e0 tempest-VolumesBackupsTest-118275719 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101319) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 09:44:56.502240 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-1b52199c-010f-4d91-967a-441d98ec32e0 tempest-VolumesBackupsTest-118275719 None] About to put_object {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 09:44:56.609688 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-1b52199c-010f-4d91-967a-441d98ec32e0 tempest-VolumesBackupsTest-118275719 None] backup MD5 for volume_b86cbab3-7c42-409e-b4f6-0ed61267a031/20260703094455/az_nova_backup_3087847d-58e1-4a0c-af9c-2639ae9f2aeb-00001: 25e317773f308e446cc84c503a6d1f85 {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 09:44:56.609926 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-1b52199c-010f-4d91-967a-441d98ec32e0 tempest-VolumesBackupsTest-118275719 None] Calling eventlet.sleep(0) {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 09:44:56.638527 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-b6d5137a-1e4e-4124-857c-f62fe2999803 tempest-VolumesBackupsTest-2142009639 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101319) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 09:44:56.638743 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-b6d5137a-1e4e-4124-857c-f62fe2999803 tempest-VolumesBackupsTest-2142009639 None] About to put_object {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 09:44:56.774770 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-b6d5137a-1e4e-4124-857c-f62fe2999803 tempest-VolumesBackupsTest-2142009639 None] backup MD5 for volume_b9d43525-b482-4d2d-8541-23ede348708e/20260703094447/az_nova_backup_a636aad8-67e3-4daa-ac42-7179916eefe7-00014: 25e317773f308e446cc84c503a6d1f85 {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 09:44:56.775049 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-b6d5137a-1e4e-4124-857c-f62fe2999803 tempest-VolumesBackupsTest-2142009639 None] Calling eventlet.sleep(0) {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 09:44:56.886570 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-1b52199c-010f-4d91-967a-441d98ec32e0 tempest-VolumesBackupsTest-118275719 None] Backing up chunk of data from volume. {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 09:44:56.969238 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-b6d5137a-1e4e-4124-857c-f62fe2999803 tempest-VolumesBackupsTest-2142009639 None] Backing up chunk of data from volume. {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 09:44:57.141602 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-1b52199c-010f-4d91-967a-441d98ec32e0 tempest-VolumesBackupsTest-118275719 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101319) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 09:44:57.143221 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-1b52199c-010f-4d91-967a-441d98ec32e0 tempest-VolumesBackupsTest-118275719 None] About to put_object {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 09:44:57.215380 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-b6d5137a-1e4e-4124-857c-f62fe2999803 tempest-VolumesBackupsTest-2142009639 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101319) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 09:44:57.215584 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-b6d5137a-1e4e-4124-857c-f62fe2999803 tempest-VolumesBackupsTest-2142009639 None] About to put_object {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 09:44:57.263424 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-1b52199c-010f-4d91-967a-441d98ec32e0 tempest-VolumesBackupsTest-118275719 None] backup MD5 for volume_b86cbab3-7c42-409e-b4f6-0ed61267a031/20260703094455/az_nova_backup_3087847d-58e1-4a0c-af9c-2639ae9f2aeb-00002: 25e317773f308e446cc84c503a6d1f85 {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 09:44:57.263424 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-1b52199c-010f-4d91-967a-441d98ec32e0 tempest-VolumesBackupsTest-118275719 None] Calling eventlet.sleep(0) {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 09:44:57.322968 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-b6d5137a-1e4e-4124-857c-f62fe2999803 tempest-VolumesBackupsTest-2142009639 None] backup MD5 for volume_b9d43525-b482-4d2d-8541-23ede348708e/20260703094447/az_nova_backup_a636aad8-67e3-4daa-ac42-7179916eefe7-00015: 25e317773f308e446cc84c503a6d1f85 {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 09:44:57.323115 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-b6d5137a-1e4e-4124-857c-f62fe2999803 tempest-VolumesBackupsTest-2142009639 None] Calling eventlet.sleep(0) {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 09:44:57.520731 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-1b52199c-010f-4d91-967a-441d98ec32e0 tempest-VolumesBackupsTest-118275719 None] Backing up chunk of data from volume. {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 09:44:57.583933 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-b6d5137a-1e4e-4124-857c-f62fe2999803 tempest-VolumesBackupsTest-2142009639 None] Backing up chunk of data from volume. {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 09:44:57.772692 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-1b52199c-010f-4d91-967a-441d98ec32e0 tempest-VolumesBackupsTest-118275719 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101319) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 09:44:57.772834 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-1b52199c-010f-4d91-967a-441d98ec32e0 tempest-VolumesBackupsTest-118275719 None] About to put_object {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 09:44:57.835136 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-b6d5137a-1e4e-4124-857c-f62fe2999803 tempest-VolumesBackupsTest-2142009639 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101319) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 09:44:57.835484 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-b6d5137a-1e4e-4124-857c-f62fe2999803 tempest-VolumesBackupsTest-2142009639 None] About to put_object {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 09:44:57.890346 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-1b52199c-010f-4d91-967a-441d98ec32e0 tempest-VolumesBackupsTest-118275719 None] backup MD5 for volume_b86cbab3-7c42-409e-b4f6-0ed61267a031/20260703094455/az_nova_backup_3087847d-58e1-4a0c-af9c-2639ae9f2aeb-00003: 25e317773f308e446cc84c503a6d1f85 {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 09:44:57.890746 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-1b52199c-010f-4d91-967a-441d98ec32e0 tempest-VolumesBackupsTest-118275719 None] Calling eventlet.sleep(0) {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 09:44:57.940915 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-b6d5137a-1e4e-4124-857c-f62fe2999803 tempest-VolumesBackupsTest-2142009639 None] backup MD5 for volume_b9d43525-b482-4d2d-8541-23ede348708e/20260703094447/az_nova_backup_a636aad8-67e3-4daa-ac42-7179916eefe7-00016: 25e317773f308e446cc84c503a6d1f85 {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 09:44:57.941153 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-b6d5137a-1e4e-4124-857c-f62fe2999803 tempest-VolumesBackupsTest-2142009639 None] Calling eventlet.sleep(0) {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 09:44:58.156930 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-1b52199c-010f-4d91-967a-441d98ec32e0 tempest-VolumesBackupsTest-118275719 None] Backing up chunk of data from volume. {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 09:44:58.198520 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-b6d5137a-1e4e-4124-857c-f62fe2999803 tempest-VolumesBackupsTest-2142009639 None] Backing up chunk of data from volume. {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 09:44:58.421419 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-1b52199c-010f-4d91-967a-441d98ec32e0 tempest-VolumesBackupsTest-118275719 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101319) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 09:44:58.422606 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-1b52199c-010f-4d91-967a-441d98ec32e0 tempest-VolumesBackupsTest-118275719 None] About to put_object {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 09:44:58.454012 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-b6d5137a-1e4e-4124-857c-f62fe2999803 tempest-VolumesBackupsTest-2142009639 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101319) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 09:44:58.454994 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-b6d5137a-1e4e-4124-857c-f62fe2999803 tempest-VolumesBackupsTest-2142009639 None] About to put_object {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 09:44:58.542639 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-1b52199c-010f-4d91-967a-441d98ec32e0 tempest-VolumesBackupsTest-118275719 None] backup MD5 for volume_b86cbab3-7c42-409e-b4f6-0ed61267a031/20260703094455/az_nova_backup_3087847d-58e1-4a0c-af9c-2639ae9f2aeb-00004: 25e317773f308e446cc84c503a6d1f85 {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 09:44:58.542818 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-1b52199c-010f-4d91-967a-441d98ec32e0 tempest-VolumesBackupsTest-118275719 None] Calling eventlet.sleep(0) {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 09:44:58.572996 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-b6d5137a-1e4e-4124-857c-f62fe2999803 tempest-VolumesBackupsTest-2142009639 None] backup MD5 for volume_b9d43525-b482-4d2d-8541-23ede348708e/20260703094447/az_nova_backup_a636aad8-67e3-4daa-ac42-7179916eefe7-00017: 25e317773f308e446cc84c503a6d1f85 {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 09:44:58.573256 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-b6d5137a-1e4e-4124-857c-f62fe2999803 tempest-VolumesBackupsTest-2142009639 None] Calling eventlet.sleep(0) {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 09:44:58.839787 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-1b52199c-010f-4d91-967a-441d98ec32e0 tempest-VolumesBackupsTest-118275719 None] Backing up chunk of data from volume. {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 09:44:58.872264 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-b6d5137a-1e4e-4124-857c-f62fe2999803 tempest-VolumesBackupsTest-2142009639 None] Backing up chunk of data from volume. {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 09:44:59.106731 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-1b52199c-010f-4d91-967a-441d98ec32e0 tempest-VolumesBackupsTest-118275719 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101319) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 09:44:59.107010 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-1b52199c-010f-4d91-967a-441d98ec32e0 tempest-VolumesBackupsTest-118275719 None] About to put_object {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 09:44:59.121962 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-b6d5137a-1e4e-4124-857c-f62fe2999803 tempest-VolumesBackupsTest-2142009639 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101319) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 09:44:59.122151 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-b6d5137a-1e4e-4124-857c-f62fe2999803 tempest-VolumesBackupsTest-2142009639 None] About to put_object {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 09:44:59.213874 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-1b52199c-010f-4d91-967a-441d98ec32e0 tempest-VolumesBackupsTest-118275719 None] backup MD5 for volume_b86cbab3-7c42-409e-b4f6-0ed61267a031/20260703094455/az_nova_backup_3087847d-58e1-4a0c-af9c-2639ae9f2aeb-00005: 25e317773f308e446cc84c503a6d1f85 {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 09:44:59.214023 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-1b52199c-010f-4d91-967a-441d98ec32e0 tempest-VolumesBackupsTest-118275719 None] Calling eventlet.sleep(0) {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 09:44:59.228910 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-b6d5137a-1e4e-4124-857c-f62fe2999803 tempest-VolumesBackupsTest-2142009639 None] backup MD5 for volume_b9d43525-b482-4d2d-8541-23ede348708e/20260703094447/az_nova_backup_a636aad8-67e3-4daa-ac42-7179916eefe7-00018: 25e317773f308e446cc84c503a6d1f85 {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 09:44:59.229399 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-b6d5137a-1e4e-4124-857c-f62fe2999803 tempest-VolumesBackupsTest-2142009639 None] Calling eventlet.sleep(0) {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 09:44:59.487651 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-1b52199c-010f-4d91-967a-441d98ec32e0 tempest-VolumesBackupsTest-118275719 None] Backing up chunk of data from volume. {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 09:44:59.497657 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-b6d5137a-1e4e-4124-857c-f62fe2999803 tempest-VolumesBackupsTest-2142009639 None] Backing up chunk of data from volume. {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 09:44:59.738365 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-1b52199c-010f-4d91-967a-441d98ec32e0 tempest-VolumesBackupsTest-118275719 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101319) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 09:44:59.738529 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-1b52199c-010f-4d91-967a-441d98ec32e0 tempest-VolumesBackupsTest-118275719 None] About to put_object {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 09:44:59.752803 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-b6d5137a-1e4e-4124-857c-f62fe2999803 tempest-VolumesBackupsTest-2142009639 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101319) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 09:44:59.752914 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-b6d5137a-1e4e-4124-857c-f62fe2999803 tempest-VolumesBackupsTest-2142009639 None] About to put_object {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 09:44:59.840462 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-1b52199c-010f-4d91-967a-441d98ec32e0 tempest-VolumesBackupsTest-118275719 None] backup MD5 for volume_b86cbab3-7c42-409e-b4f6-0ed61267a031/20260703094455/az_nova_backup_3087847d-58e1-4a0c-af9c-2639ae9f2aeb-00006: 25e317773f308e446cc84c503a6d1f85 {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 09:44:59.840584 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-1b52199c-010f-4d91-967a-441d98ec32e0 tempest-VolumesBackupsTest-118275719 None] Calling eventlet.sleep(0) {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 09:44:59.859806 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-b6d5137a-1e4e-4124-857c-f62fe2999803 tempest-VolumesBackupsTest-2142009639 None] backup MD5 for volume_b9d43525-b482-4d2d-8541-23ede348708e/20260703094447/az_nova_backup_a636aad8-67e3-4daa-ac42-7179916eefe7-00019: 25e317773f308e446cc84c503a6d1f85 {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 09:44:59.859926 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-b6d5137a-1e4e-4124-857c-f62fe2999803 tempest-VolumesBackupsTest-2142009639 None] Calling eventlet.sleep(0) {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 09:45:00.123183 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-1b52199c-010f-4d91-967a-441d98ec32e0 tempest-VolumesBackupsTest-118275719 None] Backing up chunk of data from volume. {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 09:45:00.135251 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-b6d5137a-1e4e-4124-857c-f62fe2999803 tempest-VolumesBackupsTest-2142009639 None] Backing up chunk of data from volume. {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 09:45:00.367368 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-1b52199c-010f-4d91-967a-441d98ec32e0 tempest-VolumesBackupsTest-118275719 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101319) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 09:45:00.367516 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-1b52199c-010f-4d91-967a-441d98ec32e0 tempest-VolumesBackupsTest-118275719 None] About to put_object {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 09:45:00.379085 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-b6d5137a-1e4e-4124-857c-f62fe2999803 tempest-VolumesBackupsTest-2142009639 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101319) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 09:45:00.379255 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-b6d5137a-1e4e-4124-857c-f62fe2999803 tempest-VolumesBackupsTest-2142009639 None] About to put_object {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 09:45:00.472172 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-1b52199c-010f-4d91-967a-441d98ec32e0 tempest-VolumesBackupsTest-118275719 None] backup MD5 for volume_b86cbab3-7c42-409e-b4f6-0ed61267a031/20260703094455/az_nova_backup_3087847d-58e1-4a0c-af9c-2639ae9f2aeb-00007: 25e317773f308e446cc84c503a6d1f85 {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 09:45:00.472354 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-1b52199c-010f-4d91-967a-441d98ec32e0 tempest-VolumesBackupsTest-118275719 None] Calling eventlet.sleep(0) {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 09:45:00.480382 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-b6d5137a-1e4e-4124-857c-f62fe2999803 tempest-VolumesBackupsTest-2142009639 None] backup MD5 for volume_b9d43525-b482-4d2d-8541-23ede348708e/20260703094447/az_nova_backup_a636aad8-67e3-4daa-ac42-7179916eefe7-00020: 25e317773f308e446cc84c503a6d1f85 {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 09:45:00.480576 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-b6d5137a-1e4e-4124-857c-f62fe2999803 tempest-VolumesBackupsTest-2142009639 None] Calling eventlet.sleep(0) {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 09:45:00.624189 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-b6d5137a-1e4e-4124-857c-f62fe2999803 tempest-VolumesBackupsTest-2142009639 None] Backing up chunk of data from volume. {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 09:45:00.711261 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-1b52199c-010f-4d91-967a-441d98ec32e0 tempest-VolumesBackupsTest-118275719 None] Backing up chunk of data from volume. {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 09:45:00.761877 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-b6d5137a-1e4e-4124-857c-f62fe2999803 tempest-VolumesBackupsTest-2142009639 None] Compressed 25165824 bytes of data to 24470 bytes using zlib. {{(pid=101319) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 09:45:00.762050 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-b6d5137a-1e4e-4124-857c-f62fe2999803 tempest-VolumesBackupsTest-2142009639 None] About to put_object {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 09:45:00.849532 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-b6d5137a-1e4e-4124-857c-f62fe2999803 tempest-VolumesBackupsTest-2142009639 None] backup MD5 for volume_b9d43525-b482-4d2d-8541-23ede348708e/20260703094447/az_nova_backup_a636aad8-67e3-4daa-ac42-7179916eefe7-00021: 77377273b0a4b61febdbf7bbf52b9db9 {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 09:45:00.849724 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-b6d5137a-1e4e-4124-857c-f62fe2999803 tempest-VolumesBackupsTest-2142009639 None] Calling eventlet.sleep(0) {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 09:45:00.864021 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.driver [None req-b6d5137a-1e4e-4124-857c-f62fe2999803 tempest-VolumesBackupsTest-2142009639 None] Getting metadata type 'volume-base-metadata' {{(pid=101319) _save_vol_base_meta /opt/stack/cinder/cinder/backup/driver.py:79}} Jul 03 09:45:00.872176 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.driver [None req-b6d5137a-1e4e-4124-857c-f62fe2999803 tempest-VolumesBackupsTest-2142009639 None] Completed fetching metadata type 'volume-base-metadata' {{(pid=101319) _save_vol_base_meta /opt/stack/cinder/cinder/backup/driver.py:98}} Jul 03 09:45:00.872438 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.driver [None req-b6d5137a-1e4e-4124-857c-f62fe2999803 tempest-VolumesBackupsTest-2142009639 None] Getting metadata type 'volume-metadata' {{(pid=101319) _save_vol_meta /opt/stack/cinder/cinder/backup/driver.py:109}} Jul 03 09:45:00.877329 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.driver [None req-b6d5137a-1e4e-4124-857c-f62fe2999803 tempest-VolumesBackupsTest-2142009639 None] No metadata type 'volume-metadata' available {{(pid=101319) _save_vol_meta /opt/stack/cinder/cinder/backup/driver.py:123}} Jul 03 09:45:00.877436 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.driver [None req-b6d5137a-1e4e-4124-857c-f62fe2999803 tempest-VolumesBackupsTest-2142009639 None] Getting metadata type 'volume-glance-metadata' {{(pid=101319) _save_vol_glance_meta /opt/stack/cinder/cinder/backup/driver.py:132}} Jul 03 09:45:00.881188 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.driver [None req-b6d5137a-1e4e-4124-857c-f62fe2999803 tempest-VolumesBackupsTest-2142009639 None] Completed fetching metadata type 'volume-glance-metadata' {{(pid=101319) _save_vol_glance_meta /opt/stack/cinder/cinder/backup/driver.py:145}} Jul 03 09:45:00.881519 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-b6d5137a-1e4e-4124-857c-f62fe2999803 tempest-VolumesBackupsTest-2142009639 None] _write_sha256file started, container name: tempest-volumesbackupstest-backup-container-313960817, sha256file filename: volume_b9d43525-b482-4d2d-8541-23ede348708e/20260703094447/az_nova_backup_a636aad8-67e3-4daa-ac42-7179916eefe7_sha256file. {{(pid=101319) _write_sha256file /opt/stack/cinder/cinder/backup/chunkeddriver.py:299}} Jul 03 09:45:00.940299 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-b6d5137a-1e4e-4124-857c-f62fe2999803 tempest-VolumesBackupsTest-2142009639 None] _write_sha256file finished. {{(pid=101319) _write_sha256file /opt/stack/cinder/cinder/backup/chunkeddriver.py:315}} Jul 03 09:45:00.940978 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-b6d5137a-1e4e-4124-857c-f62fe2999803 tempest-VolumesBackupsTest-2142009639 None] _write_metadata started, container name: tempest-volumesbackupstest-backup-container-313960817, metadata filename: volume_b9d43525-b482-4d2d-8541-23ede348708e/20260703094447/az_nova_backup_a636aad8-67e3-4daa-ac42-7179916eefe7_metadata. {{(pid=101319) _write_metadata /opt/stack/cinder/cinder/backup/chunkeddriver.py:276}} Jul 03 09:45:00.963164 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-b6d5137a-1e4e-4124-857c-f62fe2999803 tempest-VolumesBackupsTest-2142009639 None] _write_metadata finished. Metadata: b'{\n "backup_description": null,\n "backup_id": "a636aad8-67e3-4daa-ac42-7179916eefe7",\n "backup_name": "tempest-VolumesBackupsTest-Backup-1496010604",\n "created_at": "2026-07-03 09:44:41+00:00",\n "objects": [\n {\n "volume_b9d43525-b482-4d2d-8541-23ede348708e/20260703094447/az_nova_backup_a636aad8-67e3-4daa-ac42-7179916eefe7-00001": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "82571f7121cb9475563edde615e4e4df",\n "offset": 0\n }\n },\n {\n "volume_b9d43525-b482-4d2d-8541-23ede348708e/20260703094447/az_nova_backup_a636aad8-67e3-4daa-ac42-7179916eefe7-00002": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 52428800\n }\n },\n {\n "volume_b9d43525-b482-4d2d-8541-23ede348708e/20260703094447/az_nova_backup_a636aad8-67e3-4daa-ac42-7179916eefe7-00003": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "a35891500449df17e893f84bd88472fb",\n "offset": 104857600\n }\n },\n {\n "volume_b9d43525-b482-4d2d-8541-23ede348708e/20260703094447/az_nova_backup_a636aad8-67e3-4daa-ac42-7179916eefe7-00004": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 157286400\n }\n },\n {\n "volume_b9d43525-b482-4d2d-8541-23ede348708e/20260703094447/az_nova_backup_a636aad8-67e3-4daa-ac42-7179916eefe7-00005": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 209715200\n }\n },\n {\n "volume_b9d43525-b482-4d2d-8541-23ede348708e/20260703094447/az_nova_backup_a636aad8-67e3-4daa-ac42-7179916eefe7-00006": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 262144000\n }\n },\n {\n "volume_b9d43525-b482-4d2d-8541-23ede348708e/20260703094447/az_nova_backup_a636aad8-67e3-4daa-ac42-7179916eefe7-00007": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 314572800\n }\n },\n {\n "volume_b9d43525-b482-4d2d-8541-23ede348708e/20260703094447/az_nova_backup_a636aad8-67e3-4daa-ac42-7179916eefe7-00008": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 367001600\n }\n },\n {\n "volume_b9d43525-b482-4d2d-8541-23ede348708e/20260703094447/az_nova_backup_a636aad8-67e3-4daa-ac42-7179916eefe7-00009": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 419430400\n }\n },\n {\n "volume_b9d43525-b482-4d2d-8541-23ede348708e/20260703094447/az_nova_backup_a636aad8-67e3-4daa-ac42-7179916eefe7-00010": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 471859200\n }\n },\n {\n "volume_b9d43525-b482-4d2d-8541-23ede348708e/20260703094447/az_nova_backup_a636aad8-67e3-4daa-ac42-7179916eefe7-00011": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 524288000\n }\n },\n {\n "volume_b9d43525-b482-4d2d-8541-23ede348708e/20260703094447/az_nova_backup_a636aad8-67e3-4daa-ac42-7179916eefe7-00012": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 576716800\n }\n },\n {\n "volume_b9d43525-b482-4d2d-8541-23ede348708e/20260703094447/az_nova_backup_a636aad8-67e3-4daa-ac42-7179916eefe7-00013": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 629145600\n }\n },\n {\n "volume_b9d43525-b482-4d2d-8541-23ede348708e/20260703094447/az_nova_backup_a636aad8-67e3-4daa-ac42-7179916eefe7-00014": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 681574400\n }\n },\n {\n "volume_b9d43525-b482-4d2d-8541-23ede348708e/20260703094447/az_nova_backup_a636aad8-67e3-4daa-ac42-7179916eefe7-00015": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 734003200\n }\n },\n {\n "volume_b9d43525-b482-4d2d-8541-23ede348708e/20260703094447/az_nova_backup_a636aad8-67e3-4daa-ac42-7179916eefe7-00016": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 786432000\n }\n },\n {\n "volume_b9d43525-b482-4d2d-8541-23ede348708e/20260703094447/az_nova_backup_a636aad8-67e3-4daa-ac42-7179916eefe7-00017": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 838860800\n }\n },\n {\n "volume_b9d43525-b482-4d2d-8541-23ede348708e/20260703094447/az_nova_backup_a636aad8-67e3-4daa-ac42-7179916eefe7-00018": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 891289600\n }\n },\n {\n "volume_b9d43525-b482-4d2d-8541-23ede348708e/20260703094447/az_nova_backup_a636aad8-67e3-4daa-ac42-7179916eefe7-00019": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 943718400\n }\n },\n {\n "volume_b9d43525-b482-4d2d-8541-23ede348708e/20260703094447/az_nova_backup_a636aad8-67e3-4daa-ac42-7179916eefe7-00020": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 996147200\n }\n },\n {\n "volume_b9d43525-b482-4d2d-8541-23ede348708e/20260703094447/az_nova_backup_a636aad8-67e3-4daa-ac42-7179916eefe7-00021": {\n "compression": "zlib",\n "length": 25165824,\n "md5": "77377273b0a4b61febdbf7bbf52b9db9",\n "offset": 1048576000\n }\n }\n ],\n "parent_id": null,\n "version": "1.0.0",\n "volume_id": "b9d43525-b482-4d2d-8541-23ede348708e",\n "volume_meta": "{\\"version\\": 2, \\"volume-base-metadata\\": {\\"id\\": \\"b9d43525-b482-4d2d-8541-23ede348708e\\", \\"_name_id\\": null, \\"use_quota\\": true, \\"ec2_id\\": null, \\"user_id\\": \\"91463b6c437c4711a49d3c31c513a101\\", \\"project_id\\": \\"59044e18a5b24b19a7b9b8a380f2e1a0\\", \\"snapshot_id\\": null, \\"cluster_name\\": null, \\"host\\": \\"np0000004400@storpool#default\\", \\"size\\": 1, \\"availability_zone\\": \\"nova\\", \\"status\\": \\"backing-up\\", \\"attach_status\\": \\"detached\\", \\"migration_status\\": null, \\"scheduled_at\\": \\"2026-07-03T09:44:40.000000\\", \\"launched_at\\": \\"2026-07-03T09:44:40.000000\\", \\"terminated_at\\": null, \\"display_name\\": \\"tempest-VolumesBackupsTest-Volume-2079726756\\", \\"display_description\\": null, \\"provider_location\\": null, \\"provider_auth\\": null, \\"provider_geometry\\": null, \\"provider_id\\": null, \\"volume_type_id\\": \\"03e13fe6-0e30-4803-ace0-725d38e6dc24\\", \\"source_volid\\": null, \\"encryption_key_id\\": null, \\"consistencygroup_id\\": null, \\"group_id\\": null, \\"bootable\\": true, \\"multiattach\\": false, \\"replication_status\\": null, \\"replication_extended_status\\": null, \\"replication_driver_data\\": null, \\"previous_status\\": \\"available\\", \\"service_uuid\\": \\"6d4b0e79-fefe-4744-b25f-34be05095200\\", \\"shared_targets\\": true, \\"deleted_at\\": null, \\"deleted\\": false, \\"created_at\\": \\"2026-07-03T09:44:40.000000\\", \\"updated_at\\": \\"2026-07-03T09:44:41.000000\\"}, \\"volume-glance-metadata\\": {\\"hw_rng_model\\": \\"virtio\\", \\"os_glance_failed_import\\": \\"\\", \\"os_glance_importing_to_stores\\": \\"\\", \\"owner_specified.openstack.md5\\": \\"\\", \\"owner_specified.openstack.object\\": \\"images/cirros-0.6.3-x86_64-disk\\", \\"owner_specified.openstack.sha256\\": \\"\\", \\"image_id\\": \\"c1946dda-7935-4a75-a25a-cf65d1d25617\\", \\"image_name\\": \\"cirros-0.6.3-x86_64-disk\\", \\"checksum\\": \\"87617e24a5e30cb3b87fda8c0764838f\\", \\"container_format\\": \\"bare\\", \\"disk_format\\": \\"qcow2\\", \\"min_disk\\": \\"0\\", \\"min_ram\\": \\"0\\", \\"size\\": \\"21692416\\"}}"\n}'. {{(pid=101319) _write_metadata /opt/stack/cinder/cinder/backup/chunkeddriver.py:295}} Jul 03 09:45:00.969218 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-b6d5137a-1e4e-4124-857c-f62fe2999803 tempest-VolumesBackupsTest-2142009639 None] backup a636aad8-67e3-4daa-ac42-7179916eefe7 finished. {{(pid=101319) _finalize_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:462}} Jul 03 09:45:01.089371 np0000004400 cinder-backup[101319]: DEBUG oslo_concurrency.processutils [None req-b6d5137a-1e4e-4124-857c-f62fe2999803 tempest-VolumesBackupsTest-2142009639 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chown 0 /dev/sde {{(pid=101319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 09:45:01.098634 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-1b52199c-010f-4d91-967a-441d98ec32e0 tempest-VolumesBackupsTest-118275719 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101319) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 09:45:01.098885 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-1b52199c-010f-4d91-967a-441d98ec32e0 tempest-VolumesBackupsTest-118275719 None] About to put_object {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 09:45:01.110547 np0000004400 sudo[135751]: stack : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chown 0 /dev/sde Jul 03 09:45:01.111229 np0000004400 sudo[135751]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1002) Jul 03 09:45:01.164277 np0000004400 cinder-backup[101319]: INFO cinder.backup.manager [None req-dd7cebed-c6db-4da9-be53-3cc828012d99 tempest-ProjectAdminTests33-1900627284 None] Create backup started, backup: cfdc4925-e984-4da2-aa3e-e1e8a7c37558 volume: 4b68dad5-e9a3-4bd1-84e2-ba745cb7bb83. Jul 03 09:45:01.171069 np0000004400 cinder-backup[101319]: INFO cinder.backup.manager [None req-dd7cebed-c6db-4da9-be53-3cc828012d99 tempest-ProjectAdminTests33-1900627284 None] Call Volume Manager to get_backup_device for Backup(availability_zone='nova',container=None,created_at=2026-07-03T09:45:01Z,data_timestamp=2026-07-03T09:45:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-type-Backup-880845111',encryption_key_id=None,fail_reason=None,host='np0000004400',id=cfdc4925-e984-4da2-aa3e-e1e8a7c37558,metadata={},num_dependent_backups=0,object_count=0,parent=None,parent_id=None,project_id='a2309d0555a742279b4a5017d94ebf02',restore_volume_id=None,service='cinder.backup.drivers.swift.SwiftBackupDriver',service_metadata=None,size=1,snapshot_id=None,status='creating',temp_snapshot_id=None,temp_volume_id=None,updated_at=None,user_id='23ba560f6eed465495956e82c26b6f69',volume_id=4b68dad5-e9a3-4bd1-84e2-ba745cb7bb83) Jul 03 09:45:01.206990 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.drivers.swift [None req-dd7cebed-c6db-4da9-be53-3cc828012d99 tempest-ProjectAdminTests33-1900627284 None] Using swift URL https://10.4.3.95:8080/v1/AUTH_a2309d0555a742279b4a5017d94ebf02 {{(pid=101319) initialize /opt/stack/cinder/cinder/backup/drivers/swift.py:300}} Jul 03 09:45:01.207374 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.drivers.swift [None req-dd7cebed-c6db-4da9-be53-3cc828012d99 tempest-ProjectAdminTests33-1900627284 None] Connect to https://10.4.3.95:8080/v1/AUTH_ in "per_user" mode {{(pid=101319) initialize /opt/stack/cinder/cinder/backup/drivers/swift.py:301}} Jul 03 09:45:01.207993 np0000004400 cinder-backup[101319]: DEBUG os_brick.utils [None req-dd7cebed-c6db-4da9-be53-3cc828012d99 tempest-ProjectAdminTests33-1900627284 None] ==> get_connector_properties: call "{'root_helper': 'sudo cinder-rootwrap /etc/cinder/rootwrap.conf', 'my_ip': '10.4.3.95', 'multipath': False, 'enforce_multipath': False, 'host': None, 'execute': None}" {{(pid=101319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}} Jul 03 09:45:01.221422 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.scaleio [None req-dd7cebed-c6db-4da9-be53-3cc828012d99 tempest-ProjectAdminTests33-1900627284 None] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=101319) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}} Jul 03 09:45:01.233277 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-1b52199c-010f-4d91-967a-441d98ec32e0 tempest-VolumesBackupsTest-118275719 None] backup MD5 for volume_b86cbab3-7c42-409e-b4f6-0ed61267a031/20260703094455/az_nova_backup_3087847d-58e1-4a0c-af9c-2639ae9f2aeb-00008: 25e317773f308e446cc84c503a6d1f85 {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 09:45:01.233469 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-1b52199c-010f-4d91-967a-441d98ec32e0 tempest-VolumesBackupsTest-118275719 None] Calling eventlet.sleep(0) {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 09:45:01.273908 np0000004400 cinder-backup[101319]: DEBUG oslo_concurrency.processutils [None req-dd7cebed-c6db-4da9-be53-3cc828012d99 tempest-ProjectAdminTests33-1900627284 None] Running cmd (subprocess): nvme version {{(pid=101319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 09:45:01.285634 np0000004400 cinder-backup[101319]: DEBUG oslo_db.sqlalchemy.engines [None req-1b52199c-010f-4d91-967a-441d98ec32e0 tempest-VolumesBackupsTest-118275719 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=101319) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 03 09:45:01.289501 np0000004400 cinder-backup[101319]: DEBUG oslo_concurrency.processutils [None req-dd7cebed-c6db-4da9-be53-3cc828012d99 tempest-ProjectAdminTests33-1900627284 None] 'nvme version' failed. Not Retrying. {{(pid=101319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 03 09:45:01.289745 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.nvmeof [None req-dd7cebed-c6db-4da9-be53-3cc828012d99 tempest-ProjectAdminTests33-1900627284 None] nvme not present on system {{(pid=101319) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}} Jul 03 09:45:01.298623 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.lightos [None req-dd7cebed-c6db-4da9-be53-3cc828012d99 tempest-ProjectAdminTests33-1900627284 None] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=101319) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}} Jul 03 09:45:01.300015 np0000004400 cinder-backup[101319]: INFO os_brick.initiator.connectors.lightos [None req-dd7cebed-c6db-4da9-be53-3cc828012d99 tempest-ProjectAdminTests33-1900627284 None] Current host hostNQN and IP(s) are ['10.4.3.95', 'fe80::f816:3eff:fe47:268c', '192.168.40.6', 'fe80::f816:3eff:febf:7be2', '192.168.50.6', 'fe80::f816:3eff:fe99:8914', '192.168.10.6', 'fe80::f816:3eff:fe2f:e696', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::bc9d:84ff:fec2:6b49', 'fe80::fc16:3eff:fe36:77bf', 'fe80::4c47:1ff:fe64:1879', 'fe80::fc16:3eff:fec6:c223', 'fe80::fc16:3eff:fef5:5e6e', 'fe80::94d0:62ff:fec5:3886', 'fe80::fc16:3eff:fe48:c24e', 'fe80::fc16:3eff:fea8:bf8b', 'fe80::fc16:3eff:fe42:afa1', 'fe80::fc16:3eff:fea0:4147', 'fe80::b0cf:48ff:fe29:caf0', 'fe80::fc16:3eff:fedf:37a6', 'fe80::fc16:3eff:fe63:d9db', 'fe80::fc16:3eff:fe3b:46af', 'fe80::28c1:27ff:fe3c:5528'] Jul 03 09:45:01.300226 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.lightos [None req-dd7cebed-c6db-4da9-be53-3cc828012d99 tempest-ProjectAdminTests33-1900627284 None] LIGHTOS: did not find dsc, continuing anyway. {{(pid=101319) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}} Jul 03 09:45:01.300418 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.lightos [None req-dd7cebed-c6db-4da9-be53-3cc828012d99 tempest-ProjectAdminTests33-1900627284 None] LIGHTOS: no hostnqn found. {{(pid=101319) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}} Jul 03 09:45:01.300752 np0000004400 cinder-backup[101319]: DEBUG os_brick.utils [None req-dd7cebed-c6db-4da9-be53-3cc828012d99 tempest-ProjectAdminTests33-1900627284 None] <== get_connector_properties: return (92ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.95', 'host': 'np0000004400', 'multipath': False, 'enforce_multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:ae7e5bb0ebe6', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': '6b284368-d0ba-4d18-af6f-4998d3955c52', 'nvme_native_multipath': False} {{(pid=101319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}} Jul 03 09:45:01.448849 np0000004400 sudo[135751]: pam_unix(sudo:session): session closed for user root Jul 03 09:45:01.450931 np0000004400 cinder-backup[101319]: DEBUG oslo_concurrency.processutils [None req-b6d5137a-1e4e-4124-857c-f62fe2999803 tempest-VolumesBackupsTest-2142009639 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chown 0 /dev/sde" returned: 0 in 0.362s {{(pid=101319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 09:45:01.451538 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-b6d5137a-1e4e-4124-857c-f62fe2999803 tempest-VolumesBackupsTest-2142009639 None] ==> disconnect_volume: call "{'args': (, {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-b9d43525-b482-4d2d-8541-23ede348708e', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'b9d43525-b482-4d2d-8541-23ede348708e', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': False}, {'type': 'block', 'scsi_wwn': 'SStorPool_iSCSI_DISK_1034578903445799013', 'path': '/dev/sde'}), 'kwargs': {'force': True, 'ignore_errors': True}}" {{(pid=101319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}} Jul 03 09:45:01.451804 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.base [None req-b6d5137a-1e4e-4124-857c-f62fe2999803 tempest-VolumesBackupsTest-2142009639 None] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=101319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jul 03 09:45:01.496706 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-1b52199c-010f-4d91-967a-441d98ec32e0 tempest-VolumesBackupsTest-118275719 None] Backing up chunk of data from volume. {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 09:45:01.751339 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-1b52199c-010f-4d91-967a-441d98ec32e0 tempest-VolumesBackupsTest-118275719 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101319) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 09:45:01.751619 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-1b52199c-010f-4d91-967a-441d98ec32e0 tempest-VolumesBackupsTest-118275719 None] About to put_object {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 09:45:01.805343 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connector [None req-dd7cebed-c6db-4da9-be53-3cc828012d99 tempest-ProjectAdminTests33-1900627284 None] Factory for iscsi on None {{(pid=101319) factory /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connector.py:243}} Jul 03 09:45:01.805726 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-dd7cebed-c6db-4da9-be53-3cc828012d99 tempest-ProjectAdminTests33-1900627284 None] ==> connect_volume: call "{'self': , 'connection_properties': {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-4b68dad5-e9a3-4bd1-84e2-ba745cb7bb83', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '4b68dad5-e9a3-4bd1-84e2-ba745cb7bb83', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': False}}" {{(pid=101319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}} Jul 03 09:45:01.806006 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.base [None req-dd7cebed-c6db-4da9-be53-3cc828012d99 tempest-ProjectAdminTests33-1900627284 None] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=101319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jul 03 09:45:01.851759 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-1b52199c-010f-4d91-967a-441d98ec32e0 tempest-VolumesBackupsTest-118275719 None] backup MD5 for volume_b86cbab3-7c42-409e-b4f6-0ed61267a031/20260703094455/az_nova_backup_3087847d-58e1-4a0c-af9c-2639ae9f2aeb-00009: 25e317773f308e446cc84c503a6d1f85 {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 09:45:01.851986 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-1b52199c-010f-4d91-967a-441d98ec32e0 tempest-VolumesBackupsTest-118275719 None] Calling eventlet.sleep(0) {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 09:45:02.057775 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-1b52199c-010f-4d91-967a-441d98ec32e0 tempest-VolumesBackupsTest-118275719 None] Backing up chunk of data from volume. {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 09:45:02.316342 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-1b52199c-010f-4d91-967a-441d98ec32e0 tempest-VolumesBackupsTest-118275719 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101319) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 09:45:02.316802 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-1b52199c-010f-4d91-967a-441d98ec32e0 tempest-VolumesBackupsTest-118275719 None] About to put_object {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 09:45:02.425600 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-1b52199c-010f-4d91-967a-441d98ec32e0 tempest-VolumesBackupsTest-118275719 None] backup MD5 for volume_b86cbab3-7c42-409e-b4f6-0ed61267a031/20260703094455/az_nova_backup_3087847d-58e1-4a0c-af9c-2639ae9f2aeb-00010: 25e317773f308e446cc84c503a6d1f85 {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 09:45:02.425773 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-1b52199c-010f-4d91-967a-441d98ec32e0 tempest-VolumesBackupsTest-118275719 None] Calling eventlet.sleep(0) {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 09:45:02.510263 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.base [None req-b6d5137a-1e4e-4124-857c-f62fe2999803 tempest-VolumesBackupsTest-2142009639 None] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 1.058s {{(pid=101319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jul 03 09:45:02.510854 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-b6d5137a-1e4e-4124-857c-f62fe2999803 tempest-VolumesBackupsTest-2142009639 None] _get_connection_devices called with parameters: connection_properties={'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-b9d43525-b482-4d2d-8541-23ede348708e', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'b9d43525-b482-4d2d-8541-23ede348708e', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': False}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=101319) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:847}} Jul 03 09:45:02.525083 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-b6d5137a-1e4e-4124-857c-f62fe2999803 tempest-VolumesBackupsTest-2142009639 None] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS: Jul 03 09:45:02.525083 np0000004400 cinder-backup[101319]: No targets found. Jul 03 09:45:02.525083 np0000004400 cinder-backup[101319]: iSNS: Jul 03 09:45:02.525083 np0000004400 cinder-backup[101319]: No targets found. Jul 03 09:45:02.525083 np0000004400 cinder-backup[101319]: STATIC: Jul 03 09:45:02.525083 np0000004400 cinder-backup[101319]: Target: iqn.2023-03.storpool.com:os--volume-aecd73f6-86c7-4ae8-8bfa-b46655eb6efb Jul 03 09:45:02.525083 np0000004400 cinder-backup[101319]: Portal: 192.168.50.100:3260,-1 Jul 03 09:45:02.525083 np0000004400 cinder-backup[101319]: Iface Name: default Jul 03 09:45:02.525083 np0000004400 cinder-backup[101319]: Portal: 192.168.40.100:3260,-1 Jul 03 09:45:02.525083 np0000004400 cinder-backup[101319]: Iface Name: default Jul 03 09:45:02.525083 np0000004400 cinder-backup[101319]: Target: iqn.2023-03.storpool.com:os--volume-b86cbab3-7c42-409e-b4f6-0ed61267a031 Jul 03 09:45:02.525083 np0000004400 cinder-backup[101319]: Portal: 192.168.40.100:3260,-1 Jul 03 09:45:02.525083 np0000004400 cinder-backup[101319]: Iface Name: default Jul 03 09:45:02.525083 np0000004400 cinder-backup[101319]: Target: iqn.2023-03.storpool.com:os--volume-76320525-737e-4f58-8523-63ec9abbdc64 Jul 03 09:45:02.525083 np0000004400 cinder-backup[101319]: Portal: 192.168.50.100:3260,-1 Jul 03 09:45:02.525083 np0000004400 cinder-backup[101319]: Iface Name: default Jul 03 09:45:02.525083 np0000004400 cinder-backup[101319]: Portal: 192.168.40.100:3260,-1 Jul 03 09:45:02.525083 np0000004400 cinder-backup[101319]: Iface Name: default Jul 03 09:45:02.525083 np0000004400 cinder-backup[101319]: Target: iqn.2023-03.storpool.com:os--volume-b2e4f10c-8033-4c54-95a1-dfe45d6357a3 Jul 03 09:45:02.525083 np0000004400 cinder-backup[101319]: Portal: 192.168.50.100:3260,-1 Jul 03 09:45:02.525083 np0000004400 cinder-backup[101319]: Iface Name: default Jul 03 09:45:02.525083 np0000004400 cinder-backup[101319]: Portal: 192.168.40.100:3260,-1 Jul 03 09:45:02.525083 np0000004400 cinder-backup[101319]: Iface Name: default Jul 03 09:45:02.525083 np0000004400 cinder-backup[101319]: Target: iqn.2023-03.storpool.com:os--volume-8c32af3e-9a59-44d2-8663-514226151ed2 Jul 03 09:45:02.525083 np0000004400 cinder-backup[101319]: Portal: 192.168.50.100:3260,-1 Jul 03 09:45:02.525083 np0000004400 cinder-backup[101319]: Iface Name: default Jul 03 09:45:02.525083 np0000004400 cinder-backup[101319]: Portal: 192.168.40.100:3260,-1 Jul 03 09:45:02.525083 np0000004400 cinder-backup[101319]: Iface Name: default Jul 03 09:45:02.525083 np0000004400 cinder-backup[101319]: Target: iqn.2023-03.storpool.com:os--volume-d47f5d2f-dce5-42f7-a693-a654fd702622 Jul 03 09:45:02.525083 np0000004400 cinder-backup[101319]: Portal: 192.168.50.100:3260,-1 Jul 03 09:45:02.525083 np0000004400 cinder-backup[101319]: Iface Name: default Jul 03 09:45:02.525083 np0000004400 cinder-backup[101319]: Portal: 192.168.40.100:3260,-1 Jul 03 09:45:02.525083 np0000004400 cinder-backup[101319]: Iface Name: default Jul 03 09:45:02.525083 np0000004400 cinder-backup[101319]: Target: iqn.2023-03.storpool.com:os--volume-dc2d662f-bc12-4338-8e3d-6565f72ba808 Jul 03 09:45:02.525083 np0000004400 cinder-backup[101319]: Portal: 192.168.50.100:3260,-1 Jul 03 09:45:02.525083 np0000004400 cinder-backup[101319]: Iface Name: default Jul 03 09:45:02.525083 np0000004400 cinder-backup[101319]: Portal: 192.168.40.100:3260,-1 Jul 03 09:45:02.525083 np0000004400 cinder-backup[101319]: Iface Name: default Jul 03 09:45:02.525083 np0000004400 cinder-backup[101319]: Target: iqn.2023-03.storpool.com:os--volume-b9d43525-b482-4d2d-8541-23ede348708e Jul 03 09:45:02.525083 np0000004400 cinder-backup[101319]: Portal: 192.168.40.100:3260,-1 Jul 03 09:45:02.525083 np0000004400 cinder-backup[101319]: Iface Name: default Jul 03 09:45:02.525083 np0000004400 cinder-backup[101319]: FIRMWARE: Jul 03 09:45:02.525083 np0000004400 cinder-backup[101319]: No targets found. Jul 03 09:45:02.525083 np0000004400 cinder-backup[101319]: stderr= {{(pid=101319) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jul 03 09:45:02.526185 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-b6d5137a-1e4e-4124-857c-f62fe2999803 tempest-VolumesBackupsTest-2142009639 None] Regex to get portals from discoverydb: ^SENDTARGETS: Jul 03 09:45:02.526185 np0000004400 cinder-backup[101319]: .*?^DiscoveryAddress: 192.168.40.100,3260.*? Jul 03 09:45:02.526185 np0000004400 cinder-backup[101319]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=101319) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:390}} Jul 03 09:45:02.526185 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-b6d5137a-1e4e-4124-857c-f62fe2999803 tempest-VolumesBackupsTest-2142009639 None] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-b9d43525-b482-4d2d-8541-23ede348708e', 0)] {{(pid=101319) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:858}} Jul 03 09:45:02.588915 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-b6d5137a-1e4e-4124-857c-f62fe2999803 tempest-VolumesBackupsTest-2142009639 None] iscsiadm ('-m', 'session'): stdout=tcp: [100] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8c32af3e-9a59-44d2-8663-514226151ed2 (non-flash) Jul 03 09:45:02.588915 np0000004400 cinder-backup[101319]: tcp: [49] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b2e4f10c-8033-4c54-95a1-dfe45d6357a3 (non-flash) Jul 03 09:45:02.588915 np0000004400 cinder-backup[101319]: tcp: [50] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b2e4f10c-8033-4c54-95a1-dfe45d6357a3 (non-flash) Jul 03 09:45:02.588915 np0000004400 cinder-backup[101319]: tcp: [82] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-76320525-737e-4f58-8523-63ec9abbdc64 (non-flash) Jul 03 09:45:02.588915 np0000004400 cinder-backup[101319]: tcp: [83] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-76320525-737e-4f58-8523-63ec9abbdc64 (non-flash) Jul 03 09:45:02.588915 np0000004400 cinder-backup[101319]: tcp: [87] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-dc2d662f-bc12-4338-8e3d-6565f72ba808 (non-flash) Jul 03 09:45:02.588915 np0000004400 cinder-backup[101319]: tcp: [88] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-dc2d662f-bc12-4338-8e3d-6565f72ba808 (non-flash) Jul 03 09:45:02.588915 np0000004400 cinder-backup[101319]: tcp: [93] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-aecd73f6-86c7-4ae8-8bfa-b46655eb6efb (non-flash) Jul 03 09:45:02.588915 np0000004400 cinder-backup[101319]: tcp: [94] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-aecd73f6-86c7-4ae8-8bfa-b46655eb6efb (non-flash) Jul 03 09:45:02.588915 np0000004400 cinder-backup[101319]: tcp: [95] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b9d43525-b482-4d2d-8541-23ede348708e (non-flash) Jul 03 09:45:02.588915 np0000004400 cinder-backup[101319]: tcp: [96] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b86cbab3-7c42-409e-b4f6-0ed61267a031 (non-flash) Jul 03 09:45:02.588915 np0000004400 cinder-backup[101319]: tcp: [97] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d47f5d2f-dce5-42f7-a693-a654fd702622 (non-flash) Jul 03 09:45:02.588915 np0000004400 cinder-backup[101319]: tcp: [98] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d47f5d2f-dce5-42f7-a693-a654fd702622 (non-flash) Jul 03 09:45:02.588915 np0000004400 cinder-backup[101319]: tcp: [99] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8c32af3e-9a59-44d2-8663-514226151ed2 (non-flash) Jul 03 09:45:02.588915 np0000004400 cinder-backup[101319]: stderr= {{(pid=101319) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jul 03 09:45:02.589671 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-b6d5137a-1e4e-4124-857c-f62fe2999803 tempest-VolumesBackupsTest-2142009639 None] iscsi session list stdout=tcp: [100] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8c32af3e-9a59-44d2-8663-514226151ed2 (non-flash) Jul 03 09:45:02.589671 np0000004400 cinder-backup[101319]: tcp: [49] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b2e4f10c-8033-4c54-95a1-dfe45d6357a3 (non-flash) Jul 03 09:45:02.589671 np0000004400 cinder-backup[101319]: tcp: [50] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b2e4f10c-8033-4c54-95a1-dfe45d6357a3 (non-flash) Jul 03 09:45:02.589671 np0000004400 cinder-backup[101319]: tcp: [82] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-76320525-737e-4f58-8523-63ec9abbdc64 (non-flash) Jul 03 09:45:02.589671 np0000004400 cinder-backup[101319]: tcp: [83] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-76320525-737e-4f58-8523-63ec9abbdc64 (non-flash) Jul 03 09:45:02.589671 np0000004400 cinder-backup[101319]: tcp: [87] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-dc2d662f-bc12-4338-8e3d-6565f72ba808 (non-flash) Jul 03 09:45:02.589671 np0000004400 cinder-backup[101319]: tcp: [88] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-dc2d662f-bc12-4338-8e3d-6565f72ba808 (non-flash) Jul 03 09:45:02.589671 np0000004400 cinder-backup[101319]: tcp: [93] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-aecd73f6-86c7-4ae8-8bfa-b46655eb6efb (non-flash) Jul 03 09:45:02.589671 np0000004400 cinder-backup[101319]: tcp: [94] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-aecd73f6-86c7-4ae8-8bfa-b46655eb6efb (non-flash) Jul 03 09:45:02.589671 np0000004400 cinder-backup[101319]: tcp: [95] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b9d43525-b482-4d2d-8541-23ede348708e (non-flash) Jul 03 09:45:02.589671 np0000004400 cinder-backup[101319]: tcp: [96] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b86cbab3-7c42-409e-b4f6-0ed61267a031 (non-flash) Jul 03 09:45:02.589671 np0000004400 cinder-backup[101319]: tcp: [97] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d47f5d2f-dce5-42f7-a693-a654fd702622 (non-flash) Jul 03 09:45:02.589671 np0000004400 cinder-backup[101319]: tcp: [98] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d47f5d2f-dce5-42f7-a693-a654fd702622 (non-flash) Jul 03 09:45:02.589671 np0000004400 cinder-backup[101319]: tcp: [99] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8c32af3e-9a59-44d2-8663-514226151ed2 (non-flash) Jul 03 09:45:02.589671 np0000004400 cinder-backup[101319]: stderr= {{(pid=101319) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jul 03 09:45:02.590511 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-b6d5137a-1e4e-4124-857c-f62fe2999803 tempest-VolumesBackupsTest-2142009639 None] Sessions list: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-8c32af3e-9a59-44d2-8663-514226151ed2', '100'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-b2e4f10c-8033-4c54-95a1-dfe45d6357a3', '49'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-b2e4f10c-8033-4c54-95a1-dfe45d6357a3', '50'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-76320525-737e-4f58-8523-63ec9abbdc64', '82'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-76320525-737e-4f58-8523-63ec9abbdc64', '83'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-dc2d662f-bc12-4338-8e3d-6565f72ba808', '87'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-dc2d662f-bc12-4338-8e3d-6565f72ba808', '88'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-aecd73f6-86c7-4ae8-8bfa-b46655eb6efb', '93'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-aecd73f6-86c7-4ae8-8bfa-b46655eb6efb', '94'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-b9d43525-b482-4d2d-8541-23ede348708e', '95'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-b86cbab3-7c42-409e-b4f6-0ed61267a031', '96'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-d47f5d2f-dce5-42f7-a693-a654fd702622', '97'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-d47f5d2f-dce5-42f7-a693-a654fd702622', '98'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-8c32af3e-9a59-44d2-8663-514226151ed2', '99')] {{(pid=101319) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:866}} Jul 03 09:45:02.590964 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-b6d5137a-1e4e-4124-857c-f62fe2999803 tempest-VolumesBackupsTest-2142009639 None] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-b9d43525-b482-4d2d-8541-23ede348708e, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-b9d43525-b482-4d2d-8541-23ede348708e', '95')] {{(pid=101319) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}} Jul 03 09:45:02.592453 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-b6d5137a-1e4e-4124-857c-f62fe2999803 tempest-VolumesBackupsTest-2142009639 None] Resulting device map defaultdict(. at 0x7e7705b9f740>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-b9d43525-b482-4d2d-8541-23ede348708e'): ({'sde'}, set())}) {{(pid=101319) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:912}} Jul 03 09:45:02.592722 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.linuxscsi [None req-b6d5137a-1e4e-4124-857c-f62fe2999803 tempest-VolumesBackupsTest-2142009639 None] Removing single pathed devices sde {{(pid=101319) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}} Jul 03 09:45:02.603651 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.linuxscsi [None req-b6d5137a-1e4e-4124-857c-f62fe2999803 tempest-VolumesBackupsTest-2142009639 None] Flushing IO for device /dev/sde {{(pid=101319) flush_device_io /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:461}} Jul 03 09:45:02.611601 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.linuxscsi [None req-b6d5137a-1e4e-4124-857c-f62fe2999803 tempest-VolumesBackupsTest-2142009639 None] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=101319) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}} Jul 03 09:45:02.624231 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-1b52199c-010f-4d91-967a-441d98ec32e0 tempest-VolumesBackupsTest-118275719 None] Backing up chunk of data from volume. {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 09:45:02.677385 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.linuxscsi [None req-b6d5137a-1e4e-4124-857c-f62fe2999803 tempest-VolumesBackupsTest-2142009639 None] Checking to see if SCSI volumes sde have been removed. {{(pid=101319) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}} Jul 03 09:45:02.677620 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.linuxscsi [None req-b6d5137a-1e4e-4124-857c-f62fe2999803 tempest-VolumesBackupsTest-2142009639 None] SCSI volumes sde have been removed. {{(pid=101319) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}} Jul 03 09:45:02.679109 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.linuxscsi [None req-b6d5137a-1e4e-4124-857c-f62fe2999803 tempest-VolumesBackupsTest-2142009639 None] Checking to see if device paths {'sde'} are still under multipathd monitoring {{(pid=101319) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}} Jul 03 09:45:02.689718 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.linuxscsi [None req-b6d5137a-1e4e-4124-857c-f62fe2999803 tempest-VolumesBackupsTest-2142009639 None] Device paths {'sde'} have been removed from multipathd monitoring. {{(pid=101319) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}} Jul 03 09:45:02.689917 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-b6d5137a-1e4e-4124-857c-f62fe2999803 tempest-VolumesBackupsTest-2142009639 None] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-b9d43525-b482-4d2d-8541-23ede348708e')] {{(pid=101319) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1225}} Jul 03 09:45:02.701356 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-b6d5137a-1e4e-4124-857c-f62fe2999803 tempest-VolumesBackupsTest-2142009639 None] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=101319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 03 09:45:02.736361 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-b6d5137a-1e4e-4124-857c-f62fe2999803 tempest-VolumesBackupsTest-2142009639 None] iscsiadm ('--logout',): stdout=Logging out of session [sid: 95, target: iqn.2023-03.storpool.com:os--volume-b9d43525-b482-4d2d-8541-23ede348708e, portal: 192.168.40.100,3260] Jul 03 09:45:02.736361 np0000004400 cinder-backup[101319]: Logout of [sid: 95, target: iqn.2023-03.storpool.com:os--volume-b9d43525-b482-4d2d-8541-23ede348708e, portal: 192.168.40.100,3260] successful. Jul 03 09:45:02.736361 np0000004400 cinder-backup[101319]: stderr= {{(pid=101319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 03 09:45:02.756045 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-b6d5137a-1e4e-4124-857c-f62fe2999803 tempest-VolumesBackupsTest-2142009639 None] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=101319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 03 09:45:02.756367 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.base [None req-b6d5137a-1e4e-4124-857c-f62fe2999803 tempest-VolumesBackupsTest-2142009639 None] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.246s {{(pid=101319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jul 03 09:45:02.756597 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-b6d5137a-1e4e-4124-857c-f62fe2999803 tempest-VolumesBackupsTest-2142009639 None] <== disconnect_volume: return (1304ms) None {{(pid=101319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}} Jul 03 09:45:02.757812 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.base [None req-dd7cebed-c6db-4da9-be53-3cc828012d99 tempest-ProjectAdminTests33-1900627284 None] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.952s {{(pid=101319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jul 03 09:45:02.758099 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.base [None req-dd7cebed-c6db-4da9-be53-3cc828012d99 tempest-ProjectAdminTests33-1900627284 None] Connection properties {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-4b68dad5-e9a3-4bd1-84e2-ba745cb7bb83', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '4b68dad5-e9a3-4bd1-84e2-ba745cb7bb83', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': False} {{(pid=101319) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}} Jul 03 09:45:02.770730 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.base [None req-dd7cebed-c6db-4da9-be53-3cc828012d99 tempest-ProjectAdminTests33-1900627284 None] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-4b68dad5-e9a3-4bd1-84e2-ba745cb7bb83" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=101319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jul 03 09:45:02.771315 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.base [None req-dd7cebed-c6db-4da9-be53-3cc828012d99 tempest-ProjectAdminTests33-1900627284 None] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-4b68dad5-e9a3-4bd1-84e2-ba745cb7bb83" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=101319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jul 03 09:45:02.771605 np0000004400 cinder-backup[101319]: INFO os_brick.initiator.connectors.iscsi [None req-dd7cebed-c6db-4da9-be53-3cc828012d99 tempest-ProjectAdminTests33-1900627284 None] Trying to connect to iSCSI portal 192.168.40.100:3260 Jul 03 09:45:02.782358 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-dd7cebed-c6db-4da9-be53-3cc828012d99 tempest-ProjectAdminTests33-1900627284 None] iscsiadm (): stdout= stderr=iscsiadm: No records found Jul 03 09:45:02.782358 np0000004400 cinder-backup[101319]: {{(pid=101319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 03 09:45:02.793622 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-dd7cebed-c6db-4da9-be53-3cc828012d99 tempest-ProjectAdminTests33-1900627284 None] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-4b68dad5-e9a3-4bd1-84e2-ba745cb7bb83] added Jul 03 09:45:02.793622 np0000004400 cinder-backup[101319]: stderr=iscsiadm: Config file line 363 does not have value Jul 03 09:45:02.793622 np0000004400 cinder-backup[101319]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs' Jul 03 09:45:02.793622 np0000004400 cinder-backup[101319]: iscsiadm: Config file line 363 does not have value Jul 03 09:45:02.793622 np0000004400 cinder-backup[101319]: iscsiadm: Config file line 363 does not have value Jul 03 09:45:02.793622 np0000004400 cinder-backup[101319]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs' Jul 03 09:45:02.793622 np0000004400 cinder-backup[101319]: {{(pid=101319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 03 09:45:02.793869 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-dd7cebed-c6db-4da9-be53-3cc828012d99 tempest-ProjectAdminTests33-1900627284 None] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=101319) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}} Jul 03 09:45:02.794092 np0000004400 cinder-backup[101319]: DEBUG os_brick.utils [None req-dd7cebed-c6db-4da9-be53-3cc828012d99 tempest-ProjectAdminTests33-1900627284 None] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0225(s), this was the 1st time calling it. {{(pid=101319) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}} Jul 03 09:45:02.794256 np0000004400 cinder-backup[101319]: DEBUG os_brick.utils [None req-dd7cebed-c6db-4da9-be53-3cc828012d99 tempest-ProjectAdminTests33-1900627284 None] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=101319) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}} Jul 03 09:45:02.892424 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-1b52199c-010f-4d91-967a-441d98ec32e0 tempest-VolumesBackupsTest-118275719 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101319) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 09:45:02.892623 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-1b52199c-010f-4d91-967a-441d98ec32e0 tempest-VolumesBackupsTest-118275719 None] About to put_object {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 09:45:02.993967 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-1b52199c-010f-4d91-967a-441d98ec32e0 tempest-VolumesBackupsTest-118275719 None] backup MD5 for volume_b86cbab3-7c42-409e-b4f6-0ed61267a031/20260703094455/az_nova_backup_3087847d-58e1-4a0c-af9c-2639ae9f2aeb-00011: 25e317773f308e446cc84c503a6d1f85 {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 09:45:02.994128 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-1b52199c-010f-4d91-967a-441d98ec32e0 tempest-VolumesBackupsTest-118275719 None] Calling eventlet.sleep(0) {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 09:45:03.226224 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-1b52199c-010f-4d91-967a-441d98ec32e0 tempest-VolumesBackupsTest-118275719 None] Backing up chunk of data from volume. {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 09:45:03.483219 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-1b52199c-010f-4d91-967a-441d98ec32e0 tempest-VolumesBackupsTest-118275719 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101319) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 09:45:03.483687 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-1b52199c-010f-4d91-967a-441d98ec32e0 tempest-VolumesBackupsTest-118275719 None] About to put_object {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 09:45:03.605464 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-1b52199c-010f-4d91-967a-441d98ec32e0 tempest-VolumesBackupsTest-118275719 None] backup MD5 for volume_b86cbab3-7c42-409e-b4f6-0ed61267a031/20260703094455/az_nova_backup_3087847d-58e1-4a0c-af9c-2639ae9f2aeb-00012: 25e317773f308e446cc84c503a6d1f85 {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 09:45:03.605660 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-1b52199c-010f-4d91-967a-441d98ec32e0 tempest-VolumesBackupsTest-118275719 None] Calling eventlet.sleep(0) {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 09:45:03.782112 np0000004400 cinder-backup[101319]: INFO cinder.backup.manager [None req-b6d5137a-1e4e-4124-857c-f62fe2999803 tempest-VolumesBackupsTest-2142009639 None] Create backup finished. backup: a636aad8-67e3-4daa-ac42-7179916eefe7. Jul 03 09:45:03.795333 np0000004400 cinder-backup[101319]: INFO os_brick.initiator.connectors.iscsi [None req-dd7cebed-c6db-4da9-be53-3cc828012d99 tempest-ProjectAdminTests33-1900627284 None] Trying to connect to iSCSI portal 192.168.40.100:3260 Jul 03 09:45:03.803309 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-1b52199c-010f-4d91-967a-441d98ec32e0 tempest-VolumesBackupsTest-118275719 None] Backing up chunk of data from volume. {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 09:45:03.807168 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-dd7cebed-c6db-4da9-be53-3cc828012d99 tempest-ProjectAdminTests33-1900627284 None] iscsiadm (): stdout=# BEGIN RECORD 2.1.9 Jul 03 09:45:03.807168 np0000004400 cinder-backup[101319]: node.name = iqn.2023-03.storpool.com:os--volume-4b68dad5-e9a3-4bd1-84e2-ba745cb7bb83 Jul 03 09:45:03.807168 np0000004400 cinder-backup[101319]: node.tpgt = -1 Jul 03 09:45:03.807168 np0000004400 cinder-backup[101319]: node.startup = manual Jul 03 09:45:03.807168 np0000004400 cinder-backup[101319]: node.leading_login = No Jul 03 09:45:03.807168 np0000004400 cinder-backup[101319]: iface.iscsi_ifacename = default Jul 03 09:45:03.807168 np0000004400 cinder-backup[101319]: iface.net_ifacename = Jul 03 09:45:03.807168 np0000004400 cinder-backup[101319]: iface.ipaddress = Jul 03 09:45:03.807168 np0000004400 cinder-backup[101319]: iface.prefix_len = 0 Jul 03 09:45:03.807168 np0000004400 cinder-backup[101319]: iface.hwaddress = Jul 03 09:45:03.807168 np0000004400 cinder-backup[101319]: iface.transport_name = tcp Jul 03 09:45:03.807168 np0000004400 cinder-backup[101319]: iface.initiatorname = Jul 03 09:45:03.807168 np0000004400 cinder-backup[101319]: iface.state = Jul 03 09:45:03.807168 np0000004400 cinder-backup[101319]: iface.vlan_id = 0 Jul 03 09:45:03.807168 np0000004400 cinder-backup[101319]: iface.vlan_priority = 0 Jul 03 09:45:03.807168 np0000004400 cinder-backup[101319]: iface.vlan_state = Jul 03 09:45:03.807168 np0000004400 cinder-backup[101319]: iface.iface_num = 0 Jul 03 09:45:03.807168 np0000004400 cinder-backup[101319]: iface.mtu = 0 Jul 03 09:45:03.807168 np0000004400 cinder-backup[101319]: iface.port = 0 Jul 03 09:45:03.807168 np0000004400 cinder-backup[101319]: iface.bootproto = Jul 03 09:45:03.807168 np0000004400 cinder-backup[101319]: iface.subnet_mask = Jul 03 09:45:03.807168 np0000004400 cinder-backup[101319]: iface.gateway = Jul 03 09:45:03.807168 np0000004400 cinder-backup[101319]: iface.dhcp_alt_client_id_state = Jul 03 09:45:03.807168 np0000004400 cinder-backup[101319]: iface.dhcp_alt_client_id = Jul 03 09:45:03.807168 np0000004400 cinder-backup[101319]: iface.dhcp_dns = Jul 03 09:45:03.807168 np0000004400 cinder-backup[101319]: iface.dhcp_learn_iqn = Jul 03 09:45:03.807168 np0000004400 cinder-backup[101319]: iface.dhcp_req_vendor_id_state = Jul 03 09:45:03.807168 np0000004400 cinder-backup[101319]: iface.dhcp_vendor_id_state = Jul 03 09:45:03.807168 np0000004400 cinder-backup[101319]: iface.dhcp_vendor_id = Jul 03 09:45:03.807168 np0000004400 cinder-backup[101319]: iface.dhcp_slp_da = Jul 03 09:45:03.807168 np0000004400 cinder-backup[101319]: iface.fragmentation = Jul 03 09:45:03.807168 np0000004400 cinder-backup[101319]: iface.gratuitous_arp = Jul 03 09:45:03.807168 np0000004400 cinder-backup[101319]: iface.incoming_forwarding = Jul 03 09:45:03.807168 np0000004400 cinder-backup[101319]: iface.tos_state = Jul 03 09:45:03.807168 np0000004400 cinder-backup[101319]: iface.tos = 0 Jul 03 09:45:03.807168 np0000004400 cinder-backup[101319]: iface.ttl = 0 Jul 03 09:45:03.807168 np0000004400 cinder-backup[101319]: iface.delayed_ack = Jul 03 09:45:03.807168 np0000004400 cinder-backup[101319]: iface.tcp_nagle = Jul 03 09:45:03.807168 np0000004400 cinder-backup[101319]: iface.tcp_wsf_state = Jul 03 09:45:03.807168 np0000004400 cinder-backup[101319]: iface.tcp_wsf = 0 Jul 03 09:45:03.807168 np0000004400 cinder-backup[101319]: iface.tcp_timer_scale = 0 Jul 03 09:45:03.807168 np0000004400 cinder-backup[101319]: iface.tcp_timestamp = Jul 03 09:45:03.807168 np0000004400 cinder-backup[101319]: iface.redirect = Jul 03 09:45:03.807168 np0000004400 cinder-backup[101319]: iface.def_task_mgmt_timeout = 0 Jul 03 09:45:03.807168 np0000004400 cinder-backup[101319]: iface.header_digest = Jul 03 09:45:03.807168 np0000004400 cinder-backup[101319]: iface.data_digest = Jul 03 09:45:03.807168 np0000004400 cinder-backup[101319]: iface.immediate_data = Jul 03 09:45:03.807168 np0000004400 cinder-backup[101319]: iface.initial_r2t = Jul 03 09:45:03.807168 np0000004400 cinder-backup[101319]: iface.data_seq_inorder = Jul 03 09:45:03.807168 np0000004400 cinder-backup[101319]: iface.data_pdu_inorder = Jul 03 09:45:03.807168 np0000004400 cinder-backup[101319]: iface.erl = 0 Jul 03 09:45:03.807168 np0000004400 cinder-backup[101319]: iface.max_receive_data_len = 0 Jul 03 09:45:03.807168 np0000004400 cinder-backup[101319]: iface.first_burst_len = 0 Jul 03 09:45:03.807168 np0000004400 cinder-backup[101319]: iface.max_outstanding_r2t = 0 Jul 03 09:45:03.807168 np0000004400 cinder-backup[101319]: iface.max_burst_len = 0 Jul 03 09:45:03.807168 np0000004400 cinder-backup[101319]: iface.chap_auth = Jul 03 09:45:03.807168 np0000004400 cinder-backup[101319]: iface.bidi_chap = Jul 03 09:45:03.807168 np0000004400 cinder-backup[101319]: iface.strict_login_compliance = Jul 03 09:45:03.807168 np0000004400 cinder-backup[101319]: iface.discovery_auth = Jul 03 09:45:03.807168 np0000004400 cinder-backup[101319]: iface.discovery_logout = Jul 03 09:45:03.807168 np0000004400 cinder-backup[101319]: node.discovery_address = Jul 03 09:45:03.807168 np0000004400 cinder-backup[101319]: node.discovery_port = 0 Jul 03 09:45:03.807168 np0000004400 cinder-backup[101319]: node.discovery_type = fw Jul 03 09:45:03.807168 np0000004400 cinder-backup[101319]: node.session.initial_cmdsn = 0 Jul 03 09:45:03.807168 np0000004400 cinder-backup[101319]: node.session.initial_login_retry_max = 8 Jul 03 09:45:03.807168 np0000004400 cinder-backup[101319]: node.session.xmit_thread_priority = 0 Jul 03 09:45:03.807168 np0000004400 cinder-backup[101319]: node.session.cmds_max = 128 Jul 03 09:45:03.807168 np0000004400 cinder-backup[101319]: node.session.queue_depth = 32 Jul 03 09:45:03.807168 np0000004400 cinder-backup[101319]: node.session.nr_sessions = 1 Jul 03 09:45:03.807168 np0000004400 cinder-backup[101319]: node.session.auth.authmethod = None Jul 03 09:45:03.807168 np0000004400 cinder-backup[101319]: node.session.auth.username = Jul 03 09:45:03.807168 np0000004400 cinder-backup[101319]: node.session.auth.password = *** Jul 03 09:45:03.807168 np0000004400 cinder-backup[101319]: node.session.auth.username_in = Jul 03 09:45:03.807168 np0000004400 cinder-backup[101319]: node.session.auth.password_in = Jul 03 09:45:03.807168 np0000004400 cinder-backup[101319]: node.session.auth.chap_algs = SHA256 Jul 03 09:45:03.807168 np0000004400 cinder-backup[101319]: node.session.timeo.replacement_timeout = 120 Jul 03 09:45:03.807168 np0000004400 cinder-backup[101319]: node.session.err_timeo.abort_timeout = 15 Jul 03 09:45:03.807168 np0000004400 cinder-backup[101319]: node.session.err_timeo.lu_reset_timeout = 30 Jul 03 09:45:03.807168 np0000004400 cinder-backup[101319]: node.session.err_timeo.tgt_reset_timeout = 30 Jul 03 09:45:03.807168 np0000004400 cinder-backup[101319]: node.session.err_timeo.host_reset_timeout = 60 Jul 03 09:45:03.807168 np0000004400 cinder-backup[101319]: node.session.iscsi.FastAbort = Yes Jul 03 09:45:03.807168 np0000004400 cinder-backup[101319]: node.session.iscsi.InitialR2T = No Jul 03 09:45:03.807168 np0000004400 cinder-backup[101319]: node.session.iscsi.ImmediateData = Yes Jul 03 09:45:03.807168 np0000004400 cinder-backup[101319]: node.session.iscsi.FirstBurstLength = 262144 Jul 03 09:45:03.807168 np0000004400 cinder-backup[101319]: node.session.iscsi.MaxBurstLength = 16776192 Jul 03 09:45:03.807168 np0000004400 cinder-backup[101319]: node.session.iscsi.DefaultTime2Retain = 0 Jul 03 09:45:03.807168 np0000004400 cinder-backup[101319]: node.session.iscsi.DefaultTime2Wait = 2 Jul 03 09:45:03.807168 np0000004400 cinder-backup[101319]: node.session.iscsi.MaxConnections = 1 Jul 03 09:45:03.807168 np0000004400 cinder-backup[101319]: node.session.iscsi.MaxOutstandingR2T = 1 Jul 03 09:45:03.807168 np0000004400 cinder-backup[101319]: node.session.iscsi.ERL = 0 Jul 03 09:45:03.807168 np0000004400 cinder-backup[101319]: node.session.scan = auto Jul 03 09:45:03.807168 np0000004400 cinder-backup[101319]: node.session.reopen_max = 0 Jul 03 09:45:03.807168 np0000004400 cinder-backup[101319]: node.conn[0].address = 192.168.40.100 Jul 03 09:45:03.807168 np0000004400 cinder-backup[101319]: node.conn[0].port = 3260 Jul 03 09:45:03.807168 np0000004400 cinder-backup[101319]: node.conn[0].startup = manual Jul 03 09:45:03.807168 np0000004400 cinder-backup[101319]: node.conn[0].tcp.window_size = 524288 Jul 03 09:45:03.807168 np0000004400 cinder-backup[101319]: node.conn[0].tcp.type_of_service = 0 Jul 03 09:45:03.807168 np0000004400 cinder-backup[101319]: node.conn[0].timeo.logout_timeout = 15 Jul 03 09:45:03.807168 np0000004400 cinder-backup[101319]: node.conn[0].timeo.login_timeout = 15 Jul 03 09:45:03.807168 np0000004400 cinder-backup[101319]: node.conn[0].timeo.auth_timeout = 45 Jul 03 09:45:03.807168 np0000004400 cinder-backup[101319]: node.conn[0].timeo.noop_out_interval = 5 Jul 03 09:45:03.807168 np0000004400 cinder-backup[101319]: node.conn[0].timeo.noop_out_timeout = 5 Jul 03 09:45:03.807168 np0000004400 cinder-backup[101319]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0 Jul 03 09:45:03.807168 np0000004400 cinder-backup[101319]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144 Jul 03 09:45:03.807168 np0000004400 cinder-backup[101319]: node.conn[0].iscsi.HeaderDigest = None Jul 03 09:45:03.807168 np0000004400 cinder-backup[101319]: node.conn[0].iscsi.DataDigest = None Jul 03 09:45:03.807168 np0000004400 cinder-backup[101319]: node.conn[0].iscsi.IFMarker = No Jul 03 09:45:03.807168 np0000004400 cinder-backup[101319]: node.conn[0].iscsi.OFMarker = No Jul 03 09:45:03.807168 np0000004400 cinder-backup[101319]: # END RECORD Jul 03 09:45:03.807168 np0000004400 cinder-backup[101319]: stderr= {{(pid=101319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 03 09:45:03.819526 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-dd7cebed-c6db-4da9-be53-3cc828012d99 tempest-ProjectAdminTests33-1900627284 None] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=101319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 03 09:45:03.838137 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-dd7cebed-c6db-4da9-be53-3cc828012d99 tempest-ProjectAdminTests33-1900627284 None] iscsiadm ('-m', 'session'): stdout=tcp: [100] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8c32af3e-9a59-44d2-8663-514226151ed2 (non-flash) Jul 03 09:45:03.838137 np0000004400 cinder-backup[101319]: tcp: [49] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b2e4f10c-8033-4c54-95a1-dfe45d6357a3 (non-flash) Jul 03 09:45:03.838137 np0000004400 cinder-backup[101319]: tcp: [50] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b2e4f10c-8033-4c54-95a1-dfe45d6357a3 (non-flash) Jul 03 09:45:03.838137 np0000004400 cinder-backup[101319]: tcp: [82] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-76320525-737e-4f58-8523-63ec9abbdc64 (non-flash) Jul 03 09:45:03.838137 np0000004400 cinder-backup[101319]: tcp: [83] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-76320525-737e-4f58-8523-63ec9abbdc64 (non-flash) Jul 03 09:45:03.838137 np0000004400 cinder-backup[101319]: tcp: [87] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-dc2d662f-bc12-4338-8e3d-6565f72ba808 (non-flash) Jul 03 09:45:03.838137 np0000004400 cinder-backup[101319]: tcp: [88] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-dc2d662f-bc12-4338-8e3d-6565f72ba808 (non-flash) Jul 03 09:45:03.838137 np0000004400 cinder-backup[101319]: tcp: [93] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-aecd73f6-86c7-4ae8-8bfa-b46655eb6efb (non-flash) Jul 03 09:45:03.838137 np0000004400 cinder-backup[101319]: tcp: [94] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-aecd73f6-86c7-4ae8-8bfa-b46655eb6efb (non-flash) Jul 03 09:45:03.838137 np0000004400 cinder-backup[101319]: tcp: [96] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b86cbab3-7c42-409e-b4f6-0ed61267a031 (non-flash) Jul 03 09:45:03.838137 np0000004400 cinder-backup[101319]: tcp: [97] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d47f5d2f-dce5-42f7-a693-a654fd702622 (non-flash) Jul 03 09:45:03.838137 np0000004400 cinder-backup[101319]: tcp: [98] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d47f5d2f-dce5-42f7-a693-a654fd702622 (non-flash) Jul 03 09:45:03.838137 np0000004400 cinder-backup[101319]: tcp: [99] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8c32af3e-9a59-44d2-8663-514226151ed2 (non-flash) Jul 03 09:45:03.838137 np0000004400 cinder-backup[101319]: stderr= {{(pid=101319) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jul 03 09:45:03.838719 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-dd7cebed-c6db-4da9-be53-3cc828012d99 tempest-ProjectAdminTests33-1900627284 None] iscsi session list stdout=tcp: [100] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8c32af3e-9a59-44d2-8663-514226151ed2 (non-flash) Jul 03 09:45:03.838719 np0000004400 cinder-backup[101319]: tcp: [49] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b2e4f10c-8033-4c54-95a1-dfe45d6357a3 (non-flash) Jul 03 09:45:03.838719 np0000004400 cinder-backup[101319]: tcp: [50] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b2e4f10c-8033-4c54-95a1-dfe45d6357a3 (non-flash) Jul 03 09:45:03.838719 np0000004400 cinder-backup[101319]: tcp: [82] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-76320525-737e-4f58-8523-63ec9abbdc64 (non-flash) Jul 03 09:45:03.838719 np0000004400 cinder-backup[101319]: tcp: [83] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-76320525-737e-4f58-8523-63ec9abbdc64 (non-flash) Jul 03 09:45:03.838719 np0000004400 cinder-backup[101319]: tcp: [87] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-dc2d662f-bc12-4338-8e3d-6565f72ba808 (non-flash) Jul 03 09:45:03.838719 np0000004400 cinder-backup[101319]: tcp: [88] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-dc2d662f-bc12-4338-8e3d-6565f72ba808 (non-flash) Jul 03 09:45:03.838719 np0000004400 cinder-backup[101319]: tcp: [93] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-aecd73f6-86c7-4ae8-8bfa-b46655eb6efb (non-flash) Jul 03 09:45:03.838719 np0000004400 cinder-backup[101319]: tcp: [94] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-aecd73f6-86c7-4ae8-8bfa-b46655eb6efb (non-flash) Jul 03 09:45:03.838719 np0000004400 cinder-backup[101319]: tcp: [96] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b86cbab3-7c42-409e-b4f6-0ed61267a031 (non-flash) Jul 03 09:45:03.838719 np0000004400 cinder-backup[101319]: tcp: [97] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d47f5d2f-dce5-42f7-a693-a654fd702622 (non-flash) Jul 03 09:45:03.838719 np0000004400 cinder-backup[101319]: tcp: [98] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d47f5d2f-dce5-42f7-a693-a654fd702622 (non-flash) Jul 03 09:45:03.838719 np0000004400 cinder-backup[101319]: tcp: [99] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8c32af3e-9a59-44d2-8663-514226151ed2 (non-flash) Jul 03 09:45:03.838719 np0000004400 cinder-backup[101319]: stderr= {{(pid=101319) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jul 03 09:45:03.887576 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-dd7cebed-c6db-4da9-be53-3cc828012d99 tempest-ProjectAdminTests33-1900627284 None] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-4b68dad5-e9a3-4bd1-84e2-ba745cb7bb83, portal: 192.168.40.100,3260] Jul 03 09:45:03.887576 np0000004400 cinder-backup[101319]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-4b68dad5-e9a3-4bd1-84e2-ba745cb7bb83, portal: 192.168.40.100,3260] successful. Jul 03 09:45:03.887576 np0000004400 cinder-backup[101319]: stderr= {{(pid=101319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 03 09:45:03.899879 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-dd7cebed-c6db-4da9-be53-3cc828012d99 tempest-ProjectAdminTests33-1900627284 None] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=101319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 03 09:45:03.921680 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-dd7cebed-c6db-4da9-be53-3cc828012d99 tempest-ProjectAdminTests33-1900627284 None] iscsiadm ('-m', 'session'): stdout=tcp: [100] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8c32af3e-9a59-44d2-8663-514226151ed2 (non-flash) Jul 03 09:45:03.921680 np0000004400 cinder-backup[101319]: tcp: [101] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-4b68dad5-e9a3-4bd1-84e2-ba745cb7bb83 (non-flash) Jul 03 09:45:03.921680 np0000004400 cinder-backup[101319]: tcp: [49] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b2e4f10c-8033-4c54-95a1-dfe45d6357a3 (non-flash) Jul 03 09:45:03.921680 np0000004400 cinder-backup[101319]: tcp: [50] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b2e4f10c-8033-4c54-95a1-dfe45d6357a3 (non-flash) Jul 03 09:45:03.921680 np0000004400 cinder-backup[101319]: tcp: [82] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-76320525-737e-4f58-8523-63ec9abbdc64 (non-flash) Jul 03 09:45:03.921680 np0000004400 cinder-backup[101319]: tcp: [83] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-76320525-737e-4f58-8523-63ec9abbdc64 (non-flash) Jul 03 09:45:03.921680 np0000004400 cinder-backup[101319]: tcp: [87] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-dc2d662f-bc12-4338-8e3d-6565f72ba808 (non-flash) Jul 03 09:45:03.921680 np0000004400 cinder-backup[101319]: tcp: [88] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-dc2d662f-bc12-4338-8e3d-6565f72ba808 (non-flash) Jul 03 09:45:03.921680 np0000004400 cinder-backup[101319]: tcp: [93] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-aecd73f6-86c7-4ae8-8bfa-b46655eb6efb (non-flash) Jul 03 09:45:03.921680 np0000004400 cinder-backup[101319]: tcp: [94] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-aecd73f6-86c7-4ae8-8bfa-b46655eb6efb (non-flash) Jul 03 09:45:03.921680 np0000004400 cinder-backup[101319]: tcp: [96] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b86cbab3-7c42-409e-b4f6-0ed61267a031 (non-flash) Jul 03 09:45:03.921680 np0000004400 cinder-backup[101319]: tcp: [97] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d47f5d2f-dce5-42f7-a693-a654fd702622 (non-flash) Jul 03 09:45:03.921680 np0000004400 cinder-backup[101319]: tcp: [98] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d47f5d2f-dce5-42f7-a693-a654fd702622 (non-flash) Jul 03 09:45:03.921680 np0000004400 cinder-backup[101319]: tcp: [99] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8c32af3e-9a59-44d2-8663-514226151ed2 (non-flash) Jul 03 09:45:03.921680 np0000004400 cinder-backup[101319]: stderr= {{(pid=101319) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jul 03 09:45:03.922070 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-dd7cebed-c6db-4da9-be53-3cc828012d99 tempest-ProjectAdminTests33-1900627284 None] iscsi session list stdout=tcp: [100] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8c32af3e-9a59-44d2-8663-514226151ed2 (non-flash) Jul 03 09:45:03.922070 np0000004400 cinder-backup[101319]: tcp: [101] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-4b68dad5-e9a3-4bd1-84e2-ba745cb7bb83 (non-flash) Jul 03 09:45:03.922070 np0000004400 cinder-backup[101319]: tcp: [49] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b2e4f10c-8033-4c54-95a1-dfe45d6357a3 (non-flash) Jul 03 09:45:03.922070 np0000004400 cinder-backup[101319]: tcp: [50] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b2e4f10c-8033-4c54-95a1-dfe45d6357a3 (non-flash) Jul 03 09:45:03.922070 np0000004400 cinder-backup[101319]: tcp: [82] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-76320525-737e-4f58-8523-63ec9abbdc64 (non-flash) Jul 03 09:45:03.922070 np0000004400 cinder-backup[101319]: tcp: [83] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-76320525-737e-4f58-8523-63ec9abbdc64 (non-flash) Jul 03 09:45:03.922070 np0000004400 cinder-backup[101319]: tcp: [87] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-dc2d662f-bc12-4338-8e3d-6565f72ba808 (non-flash) Jul 03 09:45:03.922070 np0000004400 cinder-backup[101319]: tcp: [88] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-dc2d662f-bc12-4338-8e3d-6565f72ba808 (non-flash) Jul 03 09:45:03.922070 np0000004400 cinder-backup[101319]: tcp: [93] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-aecd73f6-86c7-4ae8-8bfa-b46655eb6efb (non-flash) Jul 03 09:45:03.922070 np0000004400 cinder-backup[101319]: tcp: [94] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-aecd73f6-86c7-4ae8-8bfa-b46655eb6efb (non-flash) Jul 03 09:45:03.922070 np0000004400 cinder-backup[101319]: tcp: [96] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b86cbab3-7c42-409e-b4f6-0ed61267a031 (non-flash) Jul 03 09:45:03.922070 np0000004400 cinder-backup[101319]: tcp: [97] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d47f5d2f-dce5-42f7-a693-a654fd702622 (non-flash) Jul 03 09:45:03.922070 np0000004400 cinder-backup[101319]: tcp: [98] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d47f5d2f-dce5-42f7-a693-a654fd702622 (non-flash) Jul 03 09:45:03.922070 np0000004400 cinder-backup[101319]: tcp: [99] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8c32af3e-9a59-44d2-8663-514226151ed2 (non-flash) Jul 03 09:45:03.922070 np0000004400 cinder-backup[101319]: stderr= {{(pid=101319) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jul 03 09:45:03.922480 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.base [None req-dd7cebed-c6db-4da9-be53-3cc828012d99 tempest-ProjectAdminTests33-1900627284 None] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-4b68dad5-e9a3-4bd1-84e2-ba745cb7bb83" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.151s {{(pid=101319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jul 03 09:45:03.922480 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-dd7cebed-c6db-4da9-be53-3cc828012d99 tempest-ProjectAdminTests33-1900627284 None] Connected to 192.168.40.100:3260 {{(pid=101319) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}} Jul 03 09:45:03.923349 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.linuxscsi [None req-dd7cebed-c6db-4da9-be53-3cc828012d99 tempest-ProjectAdminTests33-1900627284 None] HCTL ('10', '-', '-', 0) found on session 101 with lun 0 {{(pid=101319) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}} Jul 03 09:45:03.923487 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.linuxscsi [None req-dd7cebed-c6db-4da9-be53-3cc828012d99 tempest-ProjectAdminTests33-1900627284 None] Scanning host 10 c: -, t: -, l: 0) {{(pid=101319) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}} Jul 03 09:45:03.938300 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.linuxscsi [None req-dd7cebed-c6db-4da9-be53-3cc828012d99 tempest-ProjectAdminTests33-1900627284 None] Searching for a device in session 101 and hctl ['10', '*', '*', 0] yield: sde {{(pid=101319) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}} Jul 03 09:45:03.938300 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-dd7cebed-c6db-4da9-be53-3cc828012d99 tempest-ProjectAdminTests33-1900627284 None] Connected to sde using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-4b68dad5-e9a3-4bd1-84e2-ba745cb7bb83', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '4b68dad5-e9a3-4bd1-84e2-ba745cb7bb83', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': False} {{(pid=101319) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}} Jul 03 09:45:04.073794 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-1b52199c-010f-4d91-967a-441d98ec32e0 tempest-VolumesBackupsTest-118275719 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101319) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 09:45:04.073794 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-1b52199c-010f-4d91-967a-441d98ec32e0 tempest-VolumesBackupsTest-118275719 None] About to put_object {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 09:45:04.179289 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-1b52199c-010f-4d91-967a-441d98ec32e0 tempest-VolumesBackupsTest-118275719 None] backup MD5 for volume_b86cbab3-7c42-409e-b4f6-0ed61267a031/20260703094455/az_nova_backup_3087847d-58e1-4a0c-af9c-2639ae9f2aeb-00013: 25e317773f308e446cc84c503a6d1f85 {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 09:45:04.179582 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-1b52199c-010f-4d91-967a-441d98ec32e0 tempest-VolumesBackupsTest-118275719 None] Calling eventlet.sleep(0) {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 09:45:04.445466 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-1b52199c-010f-4d91-967a-441d98ec32e0 tempest-VolumesBackupsTest-118275719 None] Backing up chunk of data from volume. {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 09:45:04.698446 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-1b52199c-010f-4d91-967a-441d98ec32e0 tempest-VolumesBackupsTest-118275719 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101319) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 09:45:04.698446 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-1b52199c-010f-4d91-967a-441d98ec32e0 tempest-VolumesBackupsTest-118275719 None] About to put_object {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 09:45:04.822430 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-1b52199c-010f-4d91-967a-441d98ec32e0 tempest-VolumesBackupsTest-118275719 None] backup MD5 for volume_b86cbab3-7c42-409e-b4f6-0ed61267a031/20260703094455/az_nova_backup_3087847d-58e1-4a0c-af9c-2639ae9f2aeb-00014: 25e317773f308e446cc84c503a6d1f85 {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 09:45:04.822746 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-1b52199c-010f-4d91-967a-441d98ec32e0 tempest-VolumesBackupsTest-118275719 None] Calling eventlet.sleep(0) {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 09:45:04.942063 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.base [None req-dd7cebed-c6db-4da9-be53-3cc828012d99 tempest-ProjectAdminTests33-1900627284 None] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 2.184s {{(pid=101319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jul 03 09:45:04.942211 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-dd7cebed-c6db-4da9-be53-3cc828012d99 tempest-ProjectAdminTests33-1900627284 None] <== connect_volume: return (3136ms) {'type': 'block', 'scsi_wwn': '3300000003c4ac265', 'path': '/dev/sde'} {{(pid=101319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}} Jul 03 09:45:04.943552 np0000004400 cinder-backup[101319]: DEBUG oslo_concurrency.processutils [None req-dd7cebed-c6db-4da9-be53-3cc828012d99 tempest-ProjectAdminTests33-1900627284 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chown 1002 /dev/sde {{(pid=101319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 09:45:04.964228 np0000004400 sudo[135889]: stack : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chown 1002 /dev/sde Jul 03 09:45:04.964896 np0000004400 sudo[135889]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1002) Jul 03 09:45:05.032741 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-1b52199c-010f-4d91-967a-441d98ec32e0 tempest-VolumesBackupsTest-118275719 None] Backing up chunk of data from volume. {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 09:45:05.143997 np0000004400 cinder-backup[101319]: INFO cinder.backup.manager [None req-5b578e84-b5bc-4a14-9ad7-6bb3bd07d595 tempest-VolumesBackupsTest-2142009639 None] Restore backup started, backup: a636aad8-67e3-4daa-ac42-7179916eefe7 volume: d416aa2d-9214-4dcb-ba7c-32b834c4d794. Jul 03 09:45:05.168156 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.drivers.swift [None req-5b578e84-b5bc-4a14-9ad7-6bb3bd07d595 tempest-VolumesBackupsTest-2142009639 None] Using swift URL https://10.4.3.95:8080/v1/AUTH_59044e18a5b24b19a7b9b8a380f2e1a0 {{(pid=101319) initialize /opt/stack/cinder/cinder/backup/drivers/swift.py:300}} Jul 03 09:45:05.168344 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.drivers.swift [None req-5b578e84-b5bc-4a14-9ad7-6bb3bd07d595 tempest-VolumesBackupsTest-2142009639 None] Connect to https://10.4.3.95:8080/v1/AUTH_ in "per_user" mode {{(pid=101319) initialize /opt/stack/cinder/cinder/backup/drivers/swift.py:301}} Jul 03 09:45:05.168795 np0000004400 cinder-backup[101319]: DEBUG os_brick.utils [None req-5b578e84-b5bc-4a14-9ad7-6bb3bd07d595 tempest-VolumesBackupsTest-2142009639 None] ==> get_connector_properties: call "{'root_helper': 'sudo cinder-rootwrap /etc/cinder/rootwrap.conf', 'my_ip': '10.4.3.95', 'multipath': False, 'enforce_multipath': False, 'host': None, 'execute': None}" {{(pid=101319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}} Jul 03 09:45:05.178423 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.scaleio [None req-5b578e84-b5bc-4a14-9ad7-6bb3bd07d595 tempest-VolumesBackupsTest-2142009639 None] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=101319) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}} Jul 03 09:45:05.197327 np0000004400 cinder-backup[101319]: DEBUG oslo_concurrency.processutils [None req-5b578e84-b5bc-4a14-9ad7-6bb3bd07d595 tempest-VolumesBackupsTest-2142009639 None] Running cmd (subprocess): nvme version {{(pid=101319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 09:45:05.216448 np0000004400 cinder-backup[101319]: DEBUG oslo_concurrency.processutils [None req-5b578e84-b5bc-4a14-9ad7-6bb3bd07d595 tempest-VolumesBackupsTest-2142009639 None] 'nvme version' failed. Not Retrying. {{(pid=101319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 03 09:45:05.216816 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.nvmeof [None req-5b578e84-b5bc-4a14-9ad7-6bb3bd07d595 tempest-VolumesBackupsTest-2142009639 None] nvme not present on system {{(pid=101319) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}} Jul 03 09:45:05.224900 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.lightos [None req-5b578e84-b5bc-4a14-9ad7-6bb3bd07d595 tempest-VolumesBackupsTest-2142009639 None] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=101319) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}} Jul 03 09:45:05.226673 np0000004400 cinder-backup[101319]: INFO os_brick.initiator.connectors.lightos [None req-5b578e84-b5bc-4a14-9ad7-6bb3bd07d595 tempest-VolumesBackupsTest-2142009639 None] Current host hostNQN and IP(s) are ['10.4.3.95', 'fe80::f816:3eff:fe47:268c', '192.168.40.6', 'fe80::f816:3eff:febf:7be2', '192.168.50.6', 'fe80::f816:3eff:fe99:8914', '192.168.10.6', 'fe80::f816:3eff:fe2f:e696', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::bc9d:84ff:fec2:6b49', 'fe80::fc16:3eff:fe36:77bf', 'fe80::4c47:1ff:fe64:1879', 'fe80::fc16:3eff:fec6:c223', 'fe80::fc16:3eff:fef5:5e6e', 'fe80::94d0:62ff:fec5:3886', 'fe80::fc16:3eff:fe48:c24e', 'fe80::fc16:3eff:fea8:bf8b', 'fe80::fc16:3eff:fe42:afa1', 'fe80::fc16:3eff:fea0:4147', 'fe80::b0cf:48ff:fe29:caf0', 'fe80::fc16:3eff:fedf:37a6', 'fe80::fc16:3eff:fe63:d9db', 'fe80::fc16:3eff:fe3b:46af', 'fe80::28c1:27ff:fe3c:5528', 'fe80::fc16:3eff:fe91:aa0'] Jul 03 09:45:05.226853 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.lightos [None req-5b578e84-b5bc-4a14-9ad7-6bb3bd07d595 tempest-VolumesBackupsTest-2142009639 None] LIGHTOS: did not find dsc, continuing anyway. {{(pid=101319) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}} Jul 03 09:45:05.227011 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.lightos [None req-5b578e84-b5bc-4a14-9ad7-6bb3bd07d595 tempest-VolumesBackupsTest-2142009639 None] LIGHTOS: no hostnqn found. {{(pid=101319) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}} Jul 03 09:45:05.227333 np0000004400 cinder-backup[101319]: DEBUG os_brick.utils [None req-5b578e84-b5bc-4a14-9ad7-6bb3bd07d595 tempest-VolumesBackupsTest-2142009639 None] <== get_connector_properties: return (58ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.95', 'host': 'np0000004400', 'multipath': False, 'enforce_multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:ae7e5bb0ebe6', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': '6b284368-d0ba-4d18-af6f-4998d3955c52', 'nvme_native_multipath': False} {{(pid=101319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}} Jul 03 09:45:05.263650 np0000004400 sudo[135889]: pam_unix(sudo:session): session closed for user root Jul 03 09:45:05.265483 np0000004400 cinder-backup[101319]: DEBUG oslo_concurrency.processutils [None req-dd7cebed-c6db-4da9-be53-3cc828012d99 tempest-ProjectAdminTests33-1900627284 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chown 1002 /dev/sde" returned: 0 in 0.323s {{(pid=101319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 09:45:05.316045 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-1b52199c-010f-4d91-967a-441d98ec32e0 tempest-VolumesBackupsTest-118275719 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101319) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 09:45:05.316221 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-1b52199c-010f-4d91-967a-441d98ec32e0 tempest-VolumesBackupsTest-118275719 None] About to put_object {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 09:45:05.320904 np0000004400 cinder-backup[101319]: DEBUG oslo_db.sqlalchemy.engines [None req-dd7cebed-c6db-4da9-be53-3cc828012d99 tempest-ProjectAdminTests33-1900627284 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=101319) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 03 09:45:05.332847 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-dd7cebed-c6db-4da9-be53-3cc828012d99 tempest-ProjectAdminTests33-1900627284 None] _create_container started, container: volumebackups,backup: cfdc4925-e984-4da2-aa3e-e1e8a7c37558. {{(pid=101319) _create_container /opt/stack/cinder/cinder/backup/chunkeddriver.py:249}} Jul 03 09:45:05.439618 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-1b52199c-010f-4d91-967a-441d98ec32e0 tempest-VolumesBackupsTest-118275719 None] backup MD5 for volume_b86cbab3-7c42-409e-b4f6-0ed61267a031/20260703094455/az_nova_backup_3087847d-58e1-4a0c-af9c-2639ae9f2aeb-00015: 25e317773f308e446cc84c503a6d1f85 {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 09:45:05.439774 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-1b52199c-010f-4d91-967a-441d98ec32e0 tempest-VolumesBackupsTest-118275719 None] Calling eventlet.sleep(0) {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 09:45:05.544857 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.drivers.swift [None req-dd7cebed-c6db-4da9-be53-3cc828012d99 tempest-ProjectAdminTests33-1900627284 None] generate_object_name_prefix: volume_4b68dad5-e9a3-4bd1-84e2-ba745cb7bb83/20260703094505/az_nova_backup_cfdc4925-e984-4da2-aa3e-e1e8a7c37558 {{(pid=101319) _generate_object_name_prefix /opt/stack/cinder/cinder/backup/drivers/swift.py:452}} Jul 03 09:45:05.555336 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-dd7cebed-c6db-4da9-be53-3cc828012d99 tempest-ProjectAdminTests33-1900627284 None] starting backup of volume: 4b68dad5-e9a3-4bd1-84e2-ba745cb7bb83, volume size: 1073741824, object names prefix volume_4b68dad5-e9a3-4bd1-84e2-ba745cb7bb83/20260703094505/az_nova_backup_cfdc4925-e984-4da2-aa3e-e1e8a7c37558, availability zone: nova {{(pid=101319) _prepare_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:359}} Jul 03 09:45:05.658051 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-1b52199c-010f-4d91-967a-441d98ec32e0 tempest-VolumesBackupsTest-118275719 None] Backing up chunk of data from volume. {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 09:45:05.767790 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-dd7cebed-c6db-4da9-be53-3cc828012d99 tempest-ProjectAdminTests33-1900627284 None] Backing up chunk of data from volume. {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 09:45:05.933321 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-1b52199c-010f-4d91-967a-441d98ec32e0 tempest-VolumesBackupsTest-118275719 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101319) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 09:45:05.933552 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-1b52199c-010f-4d91-967a-441d98ec32e0 tempest-VolumesBackupsTest-118275719 None] About to put_object {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 09:45:06.024579 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-dd7cebed-c6db-4da9-be53-3cc828012d99 tempest-ProjectAdminTests33-1900627284 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101319) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 09:45:06.024725 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-dd7cebed-c6db-4da9-be53-3cc828012d99 tempest-ProjectAdminTests33-1900627284 None] About to put_object {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 09:45:06.046483 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-1b52199c-010f-4d91-967a-441d98ec32e0 tempest-VolumesBackupsTest-118275719 None] backup MD5 for volume_b86cbab3-7c42-409e-b4f6-0ed61267a031/20260703094455/az_nova_backup_3087847d-58e1-4a0c-af9c-2639ae9f2aeb-00016: 25e317773f308e446cc84c503a6d1f85 {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 09:45:06.046660 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-1b52199c-010f-4d91-967a-441d98ec32e0 tempest-VolumesBackupsTest-118275719 None] Calling eventlet.sleep(0) {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 09:45:06.138433 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-dd7cebed-c6db-4da9-be53-3cc828012d99 tempest-ProjectAdminTests33-1900627284 None] backup MD5 for volume_4b68dad5-e9a3-4bd1-84e2-ba745cb7bb83/20260703094505/az_nova_backup_cfdc4925-e984-4da2-aa3e-e1e8a7c37558-00001: 25e317773f308e446cc84c503a6d1f85 {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 09:45:06.138654 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-dd7cebed-c6db-4da9-be53-3cc828012d99 tempest-ProjectAdminTests33-1900627284 None] Calling eventlet.sleep(0) {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 09:45:06.244528 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connector [None req-5b578e84-b5bc-4a14-9ad7-6bb3bd07d595 tempest-VolumesBackupsTest-2142009639 None] Factory for iscsi on None {{(pid=101319) factory /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connector.py:243}} Jul 03 09:45:06.245994 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b578e84-b5bc-4a14-9ad7-6bb3bd07d595 tempest-VolumesBackupsTest-2142009639 None] ==> connect_volume: call "{'self': , 'connection_properties': {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-d416aa2d-9214-4dcb-ba7c-32b834c4d794', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'd416aa2d-9214-4dcb-ba7c-32b834c4d794', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': False}}" {{(pid=101319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}} Jul 03 09:45:06.246230 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.base [None req-5b578e84-b5bc-4a14-9ad7-6bb3bd07d595 tempest-VolumesBackupsTest-2142009639 None] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=101319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jul 03 09:45:06.247005 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.base [None req-5b578e84-b5bc-4a14-9ad7-6bb3bd07d595 tempest-VolumesBackupsTest-2142009639 None] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=101319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jul 03 09:45:06.247797 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.base [None req-5b578e84-b5bc-4a14-9ad7-6bb3bd07d595 tempest-VolumesBackupsTest-2142009639 None] Connection properties {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-d416aa2d-9214-4dcb-ba7c-32b834c4d794', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'd416aa2d-9214-4dcb-ba7c-32b834c4d794', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': False} {{(pid=101319) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}} Jul 03 09:45:06.263839 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.base [None req-5b578e84-b5bc-4a14-9ad7-6bb3bd07d595 tempest-VolumesBackupsTest-2142009639 None] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-d416aa2d-9214-4dcb-ba7c-32b834c4d794" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=101319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jul 03 09:45:06.264477 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.base [None req-5b578e84-b5bc-4a14-9ad7-6bb3bd07d595 tempest-VolumesBackupsTest-2142009639 None] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-d416aa2d-9214-4dcb-ba7c-32b834c4d794" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=101319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jul 03 09:45:06.264737 np0000004400 cinder-backup[101319]: INFO os_brick.initiator.connectors.iscsi [None req-5b578e84-b5bc-4a14-9ad7-6bb3bd07d595 tempest-VolumesBackupsTest-2142009639 None] Trying to connect to iSCSI portal 192.168.40.100:3260 Jul 03 09:45:06.277675 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b578e84-b5bc-4a14-9ad7-6bb3bd07d595 tempest-VolumesBackupsTest-2142009639 None] iscsiadm (): stdout= stderr=iscsiadm: No records found Jul 03 09:45:06.277675 np0000004400 cinder-backup[101319]: {{(pid=101319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 03 09:45:06.291024 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b578e84-b5bc-4a14-9ad7-6bb3bd07d595 tempest-VolumesBackupsTest-2142009639 None] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-d416aa2d-9214-4dcb-ba7c-32b834c4d794] added Jul 03 09:45:06.291024 np0000004400 cinder-backup[101319]: stderr=iscsiadm: Config file line 363 does not have value Jul 03 09:45:06.291024 np0000004400 cinder-backup[101319]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs' Jul 03 09:45:06.291024 np0000004400 cinder-backup[101319]: iscsiadm: Config file line 363 does not have value Jul 03 09:45:06.291024 np0000004400 cinder-backup[101319]: iscsiadm: Config file line 363 does not have value Jul 03 09:45:06.291024 np0000004400 cinder-backup[101319]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs' Jul 03 09:45:06.291024 np0000004400 cinder-backup[101319]: {{(pid=101319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 03 09:45:06.291288 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b578e84-b5bc-4a14-9ad7-6bb3bd07d595 tempest-VolumesBackupsTest-2142009639 None] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=101319) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}} Jul 03 09:45:06.291716 np0000004400 cinder-backup[101319]: DEBUG os_brick.utils [None req-5b578e84-b5bc-4a14-9ad7-6bb3bd07d595 tempest-VolumesBackupsTest-2142009639 None] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0267(s), this was the 1st time calling it. {{(pid=101319) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}} Jul 03 09:45:06.291863 np0000004400 cinder-backup[101319]: DEBUG os_brick.utils [None req-5b578e84-b5bc-4a14-9ad7-6bb3bd07d595 tempest-VolumesBackupsTest-2142009639 None] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=101319) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}} Jul 03 09:45:06.294474 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-1b52199c-010f-4d91-967a-441d98ec32e0 tempest-VolumesBackupsTest-118275719 None] Backing up chunk of data from volume. {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 09:45:06.397727 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-dd7cebed-c6db-4da9-be53-3cc828012d99 tempest-ProjectAdminTests33-1900627284 None] Backing up chunk of data from volume. {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 09:45:06.559065 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-1b52199c-010f-4d91-967a-441d98ec32e0 tempest-VolumesBackupsTest-118275719 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101319) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 09:45:06.559295 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-1b52199c-010f-4d91-967a-441d98ec32e0 tempest-VolumesBackupsTest-118275719 None] About to put_object {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 09:45:06.667392 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-dd7cebed-c6db-4da9-be53-3cc828012d99 tempest-ProjectAdminTests33-1900627284 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101319) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 09:45:06.667729 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-dd7cebed-c6db-4da9-be53-3cc828012d99 tempest-ProjectAdminTests33-1900627284 None] About to put_object {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 09:45:06.675488 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-1b52199c-010f-4d91-967a-441d98ec32e0 tempest-VolumesBackupsTest-118275719 None] backup MD5 for volume_b86cbab3-7c42-409e-b4f6-0ed61267a031/20260703094455/az_nova_backup_3087847d-58e1-4a0c-af9c-2639ae9f2aeb-00017: 25e317773f308e446cc84c503a6d1f85 {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 09:45:06.675790 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-1b52199c-010f-4d91-967a-441d98ec32e0 tempest-VolumesBackupsTest-118275719 None] Calling eventlet.sleep(0) {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 09:45:06.783800 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-dd7cebed-c6db-4da9-be53-3cc828012d99 tempest-ProjectAdminTests33-1900627284 None] backup MD5 for volume_4b68dad5-e9a3-4bd1-84e2-ba745cb7bb83/20260703094505/az_nova_backup_cfdc4925-e984-4da2-aa3e-e1e8a7c37558-00002: 25e317773f308e446cc84c503a6d1f85 {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 09:45:06.784201 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-dd7cebed-c6db-4da9-be53-3cc828012d99 tempest-ProjectAdminTests33-1900627284 None] Calling eventlet.sleep(0) {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 09:45:06.913269 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-1b52199c-010f-4d91-967a-441d98ec32e0 tempest-VolumesBackupsTest-118275719 None] Backing up chunk of data from volume. {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 09:45:07.017671 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-dd7cebed-c6db-4da9-be53-3cc828012d99 tempest-ProjectAdminTests33-1900627284 None] Backing up chunk of data from volume. {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 09:45:07.178856 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-1b52199c-010f-4d91-967a-441d98ec32e0 tempest-VolumesBackupsTest-118275719 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101319) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 09:45:07.179005 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-1b52199c-010f-4d91-967a-441d98ec32e0 tempest-VolumesBackupsTest-118275719 None] About to put_object {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 09:45:07.257968 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-dd7cebed-c6db-4da9-be53-3cc828012d99 tempest-ProjectAdminTests33-1900627284 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101319) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 09:45:07.258130 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-dd7cebed-c6db-4da9-be53-3cc828012d99 tempest-ProjectAdminTests33-1900627284 None] About to put_object {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 09:45:07.284976 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-1b52199c-010f-4d91-967a-441d98ec32e0 tempest-VolumesBackupsTest-118275719 None] backup MD5 for volume_b86cbab3-7c42-409e-b4f6-0ed61267a031/20260703094455/az_nova_backup_3087847d-58e1-4a0c-af9c-2639ae9f2aeb-00018: 25e317773f308e446cc84c503a6d1f85 {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 09:45:07.285136 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-1b52199c-010f-4d91-967a-441d98ec32e0 tempest-VolumesBackupsTest-118275719 None] Calling eventlet.sleep(0) {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 09:45:07.293883 np0000004400 cinder-backup[101319]: INFO os_brick.initiator.connectors.iscsi [None req-5b578e84-b5bc-4a14-9ad7-6bb3bd07d595 tempest-VolumesBackupsTest-2142009639 None] Trying to connect to iSCSI portal 192.168.40.100:3260 Jul 03 09:45:07.309877 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b578e84-b5bc-4a14-9ad7-6bb3bd07d595 tempest-VolumesBackupsTest-2142009639 None] iscsiadm (): stdout=# BEGIN RECORD 2.1.9 Jul 03 09:45:07.309877 np0000004400 cinder-backup[101319]: node.name = iqn.2023-03.storpool.com:os--volume-d416aa2d-9214-4dcb-ba7c-32b834c4d794 Jul 03 09:45:07.309877 np0000004400 cinder-backup[101319]: node.tpgt = -1 Jul 03 09:45:07.309877 np0000004400 cinder-backup[101319]: node.startup = manual Jul 03 09:45:07.309877 np0000004400 cinder-backup[101319]: node.leading_login = No Jul 03 09:45:07.309877 np0000004400 cinder-backup[101319]: iface.iscsi_ifacename = default Jul 03 09:45:07.309877 np0000004400 cinder-backup[101319]: iface.net_ifacename = Jul 03 09:45:07.309877 np0000004400 cinder-backup[101319]: iface.ipaddress = Jul 03 09:45:07.309877 np0000004400 cinder-backup[101319]: iface.prefix_len = 0 Jul 03 09:45:07.309877 np0000004400 cinder-backup[101319]: iface.hwaddress = Jul 03 09:45:07.309877 np0000004400 cinder-backup[101319]: iface.transport_name = tcp Jul 03 09:45:07.309877 np0000004400 cinder-backup[101319]: iface.initiatorname = Jul 03 09:45:07.309877 np0000004400 cinder-backup[101319]: iface.state = Jul 03 09:45:07.309877 np0000004400 cinder-backup[101319]: iface.vlan_id = 0 Jul 03 09:45:07.309877 np0000004400 cinder-backup[101319]: iface.vlan_priority = 0 Jul 03 09:45:07.309877 np0000004400 cinder-backup[101319]: iface.vlan_state = Jul 03 09:45:07.309877 np0000004400 cinder-backup[101319]: iface.iface_num = 0 Jul 03 09:45:07.309877 np0000004400 cinder-backup[101319]: iface.mtu = 0 Jul 03 09:45:07.309877 np0000004400 cinder-backup[101319]: iface.port = 0 Jul 03 09:45:07.309877 np0000004400 cinder-backup[101319]: iface.bootproto = Jul 03 09:45:07.309877 np0000004400 cinder-backup[101319]: iface.subnet_mask = Jul 03 09:45:07.309877 np0000004400 cinder-backup[101319]: iface.gateway = Jul 03 09:45:07.309877 np0000004400 cinder-backup[101319]: iface.dhcp_alt_client_id_state = Jul 03 09:45:07.309877 np0000004400 cinder-backup[101319]: iface.dhcp_alt_client_id = Jul 03 09:45:07.309877 np0000004400 cinder-backup[101319]: iface.dhcp_dns = Jul 03 09:45:07.309877 np0000004400 cinder-backup[101319]: iface.dhcp_learn_iqn = Jul 03 09:45:07.309877 np0000004400 cinder-backup[101319]: iface.dhcp_req_vendor_id_state = Jul 03 09:45:07.309877 np0000004400 cinder-backup[101319]: iface.dhcp_vendor_id_state = Jul 03 09:45:07.309877 np0000004400 cinder-backup[101319]: iface.dhcp_vendor_id = Jul 03 09:45:07.309877 np0000004400 cinder-backup[101319]: iface.dhcp_slp_da = Jul 03 09:45:07.309877 np0000004400 cinder-backup[101319]: iface.fragmentation = Jul 03 09:45:07.309877 np0000004400 cinder-backup[101319]: iface.gratuitous_arp = Jul 03 09:45:07.309877 np0000004400 cinder-backup[101319]: iface.incoming_forwarding = Jul 03 09:45:07.309877 np0000004400 cinder-backup[101319]: iface.tos_state = Jul 03 09:45:07.309877 np0000004400 cinder-backup[101319]: iface.tos = 0 Jul 03 09:45:07.309877 np0000004400 cinder-backup[101319]: iface.ttl = 0 Jul 03 09:45:07.309877 np0000004400 cinder-backup[101319]: iface.delayed_ack = Jul 03 09:45:07.309877 np0000004400 cinder-backup[101319]: iface.tcp_nagle = Jul 03 09:45:07.309877 np0000004400 cinder-backup[101319]: iface.tcp_wsf_state = Jul 03 09:45:07.309877 np0000004400 cinder-backup[101319]: iface.tcp_wsf = 0 Jul 03 09:45:07.309877 np0000004400 cinder-backup[101319]: iface.tcp_timer_scale = 0 Jul 03 09:45:07.309877 np0000004400 cinder-backup[101319]: iface.tcp_timestamp = Jul 03 09:45:07.309877 np0000004400 cinder-backup[101319]: iface.redirect = Jul 03 09:45:07.309877 np0000004400 cinder-backup[101319]: iface.def_task_mgmt_timeout = 0 Jul 03 09:45:07.309877 np0000004400 cinder-backup[101319]: iface.header_digest = Jul 03 09:45:07.309877 np0000004400 cinder-backup[101319]: iface.data_digest = Jul 03 09:45:07.309877 np0000004400 cinder-backup[101319]: iface.immediate_data = Jul 03 09:45:07.309877 np0000004400 cinder-backup[101319]: iface.initial_r2t = Jul 03 09:45:07.309877 np0000004400 cinder-backup[101319]: iface.data_seq_inorder = Jul 03 09:45:07.309877 np0000004400 cinder-backup[101319]: iface.data_pdu_inorder = Jul 03 09:45:07.309877 np0000004400 cinder-backup[101319]: iface.erl = 0 Jul 03 09:45:07.309877 np0000004400 cinder-backup[101319]: iface.max_receive_data_len = 0 Jul 03 09:45:07.309877 np0000004400 cinder-backup[101319]: iface.first_burst_len = 0 Jul 03 09:45:07.309877 np0000004400 cinder-backup[101319]: iface.max_outstanding_r2t = 0 Jul 03 09:45:07.309877 np0000004400 cinder-backup[101319]: iface.max_burst_len = 0 Jul 03 09:45:07.309877 np0000004400 cinder-backup[101319]: iface.chap_auth = Jul 03 09:45:07.309877 np0000004400 cinder-backup[101319]: iface.bidi_chap = Jul 03 09:45:07.309877 np0000004400 cinder-backup[101319]: iface.strict_login_compliance = Jul 03 09:45:07.309877 np0000004400 cinder-backup[101319]: iface.discovery_auth = Jul 03 09:45:07.309877 np0000004400 cinder-backup[101319]: iface.discovery_logout = Jul 03 09:45:07.309877 np0000004400 cinder-backup[101319]: node.discovery_address = Jul 03 09:45:07.309877 np0000004400 cinder-backup[101319]: node.discovery_port = 0 Jul 03 09:45:07.309877 np0000004400 cinder-backup[101319]: node.discovery_type = fw Jul 03 09:45:07.309877 np0000004400 cinder-backup[101319]: node.session.initial_cmdsn = 0 Jul 03 09:45:07.309877 np0000004400 cinder-backup[101319]: node.session.initial_login_retry_max = 8 Jul 03 09:45:07.309877 np0000004400 cinder-backup[101319]: node.session.xmit_thread_priority = 0 Jul 03 09:45:07.309877 np0000004400 cinder-backup[101319]: node.session.cmds_max = 128 Jul 03 09:45:07.309877 np0000004400 cinder-backup[101319]: node.session.queue_depth = 32 Jul 03 09:45:07.309877 np0000004400 cinder-backup[101319]: node.session.nr_sessions = 1 Jul 03 09:45:07.309877 np0000004400 cinder-backup[101319]: node.session.auth.authmethod = None Jul 03 09:45:07.309877 np0000004400 cinder-backup[101319]: node.session.auth.username = Jul 03 09:45:07.309877 np0000004400 cinder-backup[101319]: node.session.auth.password = *** Jul 03 09:45:07.309877 np0000004400 cinder-backup[101319]: node.session.auth.username_in = Jul 03 09:45:07.309877 np0000004400 cinder-backup[101319]: node.session.auth.password_in = Jul 03 09:45:07.309877 np0000004400 cinder-backup[101319]: node.session.auth.chap_algs = SHA256 Jul 03 09:45:07.309877 np0000004400 cinder-backup[101319]: node.session.timeo.replacement_timeout = 120 Jul 03 09:45:07.309877 np0000004400 cinder-backup[101319]: node.session.err_timeo.abort_timeout = 15 Jul 03 09:45:07.309877 np0000004400 cinder-backup[101319]: node.session.err_timeo.lu_reset_timeout = 30 Jul 03 09:45:07.309877 np0000004400 cinder-backup[101319]: node.session.err_timeo.tgt_reset_timeout = 30 Jul 03 09:45:07.309877 np0000004400 cinder-backup[101319]: node.session.err_timeo.host_reset_timeout = 60 Jul 03 09:45:07.309877 np0000004400 cinder-backup[101319]: node.session.iscsi.FastAbort = Yes Jul 03 09:45:07.309877 np0000004400 cinder-backup[101319]: node.session.iscsi.InitialR2T = No Jul 03 09:45:07.309877 np0000004400 cinder-backup[101319]: node.session.iscsi.ImmediateData = Yes Jul 03 09:45:07.309877 np0000004400 cinder-backup[101319]: node.session.iscsi.FirstBurstLength = 262144 Jul 03 09:45:07.309877 np0000004400 cinder-backup[101319]: node.session.iscsi.MaxBurstLength = 16776192 Jul 03 09:45:07.309877 np0000004400 cinder-backup[101319]: node.session.iscsi.DefaultTime2Retain = 0 Jul 03 09:45:07.309877 np0000004400 cinder-backup[101319]: node.session.iscsi.DefaultTime2Wait = 2 Jul 03 09:45:07.309877 np0000004400 cinder-backup[101319]: node.session.iscsi.MaxConnections = 1 Jul 03 09:45:07.309877 np0000004400 cinder-backup[101319]: node.session.iscsi.MaxOutstandingR2T = 1 Jul 03 09:45:07.309877 np0000004400 cinder-backup[101319]: node.session.iscsi.ERL = 0 Jul 03 09:45:07.309877 np0000004400 cinder-backup[101319]: node.session.scan = auto Jul 03 09:45:07.309877 np0000004400 cinder-backup[101319]: node.session.reopen_max = 0 Jul 03 09:45:07.309877 np0000004400 cinder-backup[101319]: node.conn[0].address = 192.168.40.100 Jul 03 09:45:07.309877 np0000004400 cinder-backup[101319]: node.conn[0].port = 3260 Jul 03 09:45:07.309877 np0000004400 cinder-backup[101319]: node.conn[0].startup = manual Jul 03 09:45:07.309877 np0000004400 cinder-backup[101319]: node.conn[0].tcp.window_size = 524288 Jul 03 09:45:07.309877 np0000004400 cinder-backup[101319]: node.conn[0].tcp.type_of_service = 0 Jul 03 09:45:07.309877 np0000004400 cinder-backup[101319]: node.conn[0].timeo.logout_timeout = 15 Jul 03 09:45:07.309877 np0000004400 cinder-backup[101319]: node.conn[0].timeo.login_timeout = 15 Jul 03 09:45:07.309877 np0000004400 cinder-backup[101319]: node.conn[0].timeo.auth_timeout = 45 Jul 03 09:45:07.309877 np0000004400 cinder-backup[101319]: node.conn[0].timeo.noop_out_interval = 5 Jul 03 09:45:07.309877 np0000004400 cinder-backup[101319]: node.conn[0].timeo.noop_out_timeout = 5 Jul 03 09:45:07.309877 np0000004400 cinder-backup[101319]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0 Jul 03 09:45:07.309877 np0000004400 cinder-backup[101319]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144 Jul 03 09:45:07.309877 np0000004400 cinder-backup[101319]: node.conn[0].iscsi.HeaderDigest = None Jul 03 09:45:07.309877 np0000004400 cinder-backup[101319]: node.conn[0].iscsi.DataDigest = None Jul 03 09:45:07.309877 np0000004400 cinder-backup[101319]: node.conn[0].iscsi.IFMarker = No Jul 03 09:45:07.309877 np0000004400 cinder-backup[101319]: node.conn[0].iscsi.OFMarker = No Jul 03 09:45:07.309877 np0000004400 cinder-backup[101319]: # END RECORD Jul 03 09:45:07.309877 np0000004400 cinder-backup[101319]: stderr= {{(pid=101319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 03 09:45:07.322479 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b578e84-b5bc-4a14-9ad7-6bb3bd07d595 tempest-VolumesBackupsTest-2142009639 None] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=101319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 03 09:45:07.341896 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b578e84-b5bc-4a14-9ad7-6bb3bd07d595 tempest-VolumesBackupsTest-2142009639 None] iscsiadm ('-m', 'session'): stdout=tcp: [100] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8c32af3e-9a59-44d2-8663-514226151ed2 (non-flash) Jul 03 09:45:07.341896 np0000004400 cinder-backup[101319]: tcp: [101] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-4b68dad5-e9a3-4bd1-84e2-ba745cb7bb83 (non-flash) Jul 03 09:45:07.341896 np0000004400 cinder-backup[101319]: tcp: [49] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b2e4f10c-8033-4c54-95a1-dfe45d6357a3 (non-flash) Jul 03 09:45:07.341896 np0000004400 cinder-backup[101319]: tcp: [50] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b2e4f10c-8033-4c54-95a1-dfe45d6357a3 (non-flash) Jul 03 09:45:07.341896 np0000004400 cinder-backup[101319]: tcp: [82] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-76320525-737e-4f58-8523-63ec9abbdc64 (non-flash) Jul 03 09:45:07.341896 np0000004400 cinder-backup[101319]: tcp: [83] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-76320525-737e-4f58-8523-63ec9abbdc64 (non-flash) Jul 03 09:45:07.341896 np0000004400 cinder-backup[101319]: tcp: [87] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-dc2d662f-bc12-4338-8e3d-6565f72ba808 (non-flash) Jul 03 09:45:07.341896 np0000004400 cinder-backup[101319]: tcp: [88] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-dc2d662f-bc12-4338-8e3d-6565f72ba808 (non-flash) Jul 03 09:45:07.341896 np0000004400 cinder-backup[101319]: tcp: [93] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-aecd73f6-86c7-4ae8-8bfa-b46655eb6efb (non-flash) Jul 03 09:45:07.341896 np0000004400 cinder-backup[101319]: tcp: [94] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-aecd73f6-86c7-4ae8-8bfa-b46655eb6efb (non-flash) Jul 03 09:45:07.341896 np0000004400 cinder-backup[101319]: tcp: [96] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b86cbab3-7c42-409e-b4f6-0ed61267a031 (non-flash) Jul 03 09:45:07.341896 np0000004400 cinder-backup[101319]: tcp: [97] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d47f5d2f-dce5-42f7-a693-a654fd702622 (non-flash) Jul 03 09:45:07.341896 np0000004400 cinder-backup[101319]: tcp: [98] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d47f5d2f-dce5-42f7-a693-a654fd702622 (non-flash) Jul 03 09:45:07.341896 np0000004400 cinder-backup[101319]: tcp: [99] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8c32af3e-9a59-44d2-8663-514226151ed2 (non-flash) Jul 03 09:45:07.341896 np0000004400 cinder-backup[101319]: stderr= {{(pid=101319) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jul 03 09:45:07.342319 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b578e84-b5bc-4a14-9ad7-6bb3bd07d595 tempest-VolumesBackupsTest-2142009639 None] iscsi session list stdout=tcp: [100] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8c32af3e-9a59-44d2-8663-514226151ed2 (non-flash) Jul 03 09:45:07.342319 np0000004400 cinder-backup[101319]: tcp: [101] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-4b68dad5-e9a3-4bd1-84e2-ba745cb7bb83 (non-flash) Jul 03 09:45:07.342319 np0000004400 cinder-backup[101319]: tcp: [49] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b2e4f10c-8033-4c54-95a1-dfe45d6357a3 (non-flash) Jul 03 09:45:07.342319 np0000004400 cinder-backup[101319]: tcp: [50] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b2e4f10c-8033-4c54-95a1-dfe45d6357a3 (non-flash) Jul 03 09:45:07.342319 np0000004400 cinder-backup[101319]: tcp: [82] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-76320525-737e-4f58-8523-63ec9abbdc64 (non-flash) Jul 03 09:45:07.342319 np0000004400 cinder-backup[101319]: tcp: [83] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-76320525-737e-4f58-8523-63ec9abbdc64 (non-flash) Jul 03 09:45:07.342319 np0000004400 cinder-backup[101319]: tcp: [87] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-dc2d662f-bc12-4338-8e3d-6565f72ba808 (non-flash) Jul 03 09:45:07.342319 np0000004400 cinder-backup[101319]: tcp: [88] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-dc2d662f-bc12-4338-8e3d-6565f72ba808 (non-flash) Jul 03 09:45:07.342319 np0000004400 cinder-backup[101319]: tcp: [93] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-aecd73f6-86c7-4ae8-8bfa-b46655eb6efb (non-flash) Jul 03 09:45:07.342319 np0000004400 cinder-backup[101319]: tcp: [94] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-aecd73f6-86c7-4ae8-8bfa-b46655eb6efb (non-flash) Jul 03 09:45:07.342319 np0000004400 cinder-backup[101319]: tcp: [96] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b86cbab3-7c42-409e-b4f6-0ed61267a031 (non-flash) Jul 03 09:45:07.342319 np0000004400 cinder-backup[101319]: tcp: [97] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d47f5d2f-dce5-42f7-a693-a654fd702622 (non-flash) Jul 03 09:45:07.342319 np0000004400 cinder-backup[101319]: tcp: [98] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d47f5d2f-dce5-42f7-a693-a654fd702622 (non-flash) Jul 03 09:45:07.342319 np0000004400 cinder-backup[101319]: tcp: [99] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8c32af3e-9a59-44d2-8663-514226151ed2 (non-flash) Jul 03 09:45:07.342319 np0000004400 cinder-backup[101319]: stderr= {{(pid=101319) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jul 03 09:45:07.371629 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-dd7cebed-c6db-4da9-be53-3cc828012d99 tempest-ProjectAdminTests33-1900627284 None] backup MD5 for volume_4b68dad5-e9a3-4bd1-84e2-ba745cb7bb83/20260703094505/az_nova_backup_cfdc4925-e984-4da2-aa3e-e1e8a7c37558-00003: 25e317773f308e446cc84c503a6d1f85 {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 09:45:07.372639 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-dd7cebed-c6db-4da9-be53-3cc828012d99 tempest-ProjectAdminTests33-1900627284 None] Calling eventlet.sleep(0) {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 09:45:07.399998 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b578e84-b5bc-4a14-9ad7-6bb3bd07d595 tempest-VolumesBackupsTest-2142009639 None] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-d416aa2d-9214-4dcb-ba7c-32b834c4d794, portal: 192.168.40.100,3260] Jul 03 09:45:07.399998 np0000004400 cinder-backup[101319]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-d416aa2d-9214-4dcb-ba7c-32b834c4d794, portal: 192.168.40.100,3260] successful. Jul 03 09:45:07.399998 np0000004400 cinder-backup[101319]: stderr= {{(pid=101319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 03 09:45:07.410393 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b578e84-b5bc-4a14-9ad7-6bb3bd07d595 tempest-VolumesBackupsTest-2142009639 None] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=101319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 03 09:45:07.429429 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b578e84-b5bc-4a14-9ad7-6bb3bd07d595 tempest-VolumesBackupsTest-2142009639 None] iscsiadm ('-m', 'session'): stdout=tcp: [100] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8c32af3e-9a59-44d2-8663-514226151ed2 (non-flash) Jul 03 09:45:07.429429 np0000004400 cinder-backup[101319]: tcp: [101] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-4b68dad5-e9a3-4bd1-84e2-ba745cb7bb83 (non-flash) Jul 03 09:45:07.429429 np0000004400 cinder-backup[101319]: tcp: [102] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d416aa2d-9214-4dcb-ba7c-32b834c4d794 (non-flash) Jul 03 09:45:07.429429 np0000004400 cinder-backup[101319]: tcp: [49] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b2e4f10c-8033-4c54-95a1-dfe45d6357a3 (non-flash) Jul 03 09:45:07.429429 np0000004400 cinder-backup[101319]: tcp: [50] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b2e4f10c-8033-4c54-95a1-dfe45d6357a3 (non-flash) Jul 03 09:45:07.429429 np0000004400 cinder-backup[101319]: tcp: [82] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-76320525-737e-4f58-8523-63ec9abbdc64 (non-flash) Jul 03 09:45:07.429429 np0000004400 cinder-backup[101319]: tcp: [83] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-76320525-737e-4f58-8523-63ec9abbdc64 (non-flash) Jul 03 09:45:07.429429 np0000004400 cinder-backup[101319]: tcp: [87] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-dc2d662f-bc12-4338-8e3d-6565f72ba808 (non-flash) Jul 03 09:45:07.429429 np0000004400 cinder-backup[101319]: tcp: [88] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-dc2d662f-bc12-4338-8e3d-6565f72ba808 (non-flash) Jul 03 09:45:07.429429 np0000004400 cinder-backup[101319]: tcp: [93] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-aecd73f6-86c7-4ae8-8bfa-b46655eb6efb (non-flash) Jul 03 09:45:07.429429 np0000004400 cinder-backup[101319]: tcp: [94] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-aecd73f6-86c7-4ae8-8bfa-b46655eb6efb (non-flash) Jul 03 09:45:07.429429 np0000004400 cinder-backup[101319]: tcp: [96] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b86cbab3-7c42-409e-b4f6-0ed61267a031 (non-flash) Jul 03 09:45:07.429429 np0000004400 cinder-backup[101319]: tcp: [97] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d47f5d2f-dce5-42f7-a693-a654fd702622 (non-flash) Jul 03 09:45:07.429429 np0000004400 cinder-backup[101319]: tcp: [98] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d47f5d2f-dce5-42f7-a693-a654fd702622 (non-flash) Jul 03 09:45:07.429429 np0000004400 cinder-backup[101319]: tcp: [99] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8c32af3e-9a59-44d2-8663-514226151ed2 (non-flash) Jul 03 09:45:07.429429 np0000004400 cinder-backup[101319]: stderr= {{(pid=101319) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jul 03 09:45:07.429794 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b578e84-b5bc-4a14-9ad7-6bb3bd07d595 tempest-VolumesBackupsTest-2142009639 None] iscsi session list stdout=tcp: [100] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8c32af3e-9a59-44d2-8663-514226151ed2 (non-flash) Jul 03 09:45:07.429794 np0000004400 cinder-backup[101319]: tcp: [101] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-4b68dad5-e9a3-4bd1-84e2-ba745cb7bb83 (non-flash) Jul 03 09:45:07.429794 np0000004400 cinder-backup[101319]: tcp: [102] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d416aa2d-9214-4dcb-ba7c-32b834c4d794 (non-flash) Jul 03 09:45:07.429794 np0000004400 cinder-backup[101319]: tcp: [49] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b2e4f10c-8033-4c54-95a1-dfe45d6357a3 (non-flash) Jul 03 09:45:07.429794 np0000004400 cinder-backup[101319]: tcp: [50] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b2e4f10c-8033-4c54-95a1-dfe45d6357a3 (non-flash) Jul 03 09:45:07.429794 np0000004400 cinder-backup[101319]: tcp: [82] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-76320525-737e-4f58-8523-63ec9abbdc64 (non-flash) Jul 03 09:45:07.429794 np0000004400 cinder-backup[101319]: tcp: [83] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-76320525-737e-4f58-8523-63ec9abbdc64 (non-flash) Jul 03 09:45:07.429794 np0000004400 cinder-backup[101319]: tcp: [87] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-dc2d662f-bc12-4338-8e3d-6565f72ba808 (non-flash) Jul 03 09:45:07.429794 np0000004400 cinder-backup[101319]: tcp: [88] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-dc2d662f-bc12-4338-8e3d-6565f72ba808 (non-flash) Jul 03 09:45:07.429794 np0000004400 cinder-backup[101319]: tcp: [93] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-aecd73f6-86c7-4ae8-8bfa-b46655eb6efb (non-flash) Jul 03 09:45:07.429794 np0000004400 cinder-backup[101319]: tcp: [94] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-aecd73f6-86c7-4ae8-8bfa-b46655eb6efb (non-flash) Jul 03 09:45:07.429794 np0000004400 cinder-backup[101319]: tcp: [96] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b86cbab3-7c42-409e-b4f6-0ed61267a031 (non-flash) Jul 03 09:45:07.429794 np0000004400 cinder-backup[101319]: tcp: [97] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d47f5d2f-dce5-42f7-a693-a654fd702622 (non-flash) Jul 03 09:45:07.429794 np0000004400 cinder-backup[101319]: tcp: [98] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d47f5d2f-dce5-42f7-a693-a654fd702622 (non-flash) Jul 03 09:45:07.429794 np0000004400 cinder-backup[101319]: tcp: [99] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8c32af3e-9a59-44d2-8663-514226151ed2 (non-flash) Jul 03 09:45:07.429794 np0000004400 cinder-backup[101319]: stderr= {{(pid=101319) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jul 03 09:45:07.430057 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.base [None req-5b578e84-b5bc-4a14-9ad7-6bb3bd07d595 tempest-VolumesBackupsTest-2142009639 None] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-d416aa2d-9214-4dcb-ba7c-32b834c4d794" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.166s {{(pid=101319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jul 03 09:45:07.430057 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b578e84-b5bc-4a14-9ad7-6bb3bd07d595 tempest-VolumesBackupsTest-2142009639 None] Connected to 192.168.40.100:3260 {{(pid=101319) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}} Jul 03 09:45:07.431284 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.linuxscsi [None req-5b578e84-b5bc-4a14-9ad7-6bb3bd07d595 tempest-VolumesBackupsTest-2142009639 None] HCTL ('19', '-', '-', 0) found on session 102 with lun 0 {{(pid=101319) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}} Jul 03 09:45:07.431353 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.linuxscsi [None req-5b578e84-b5bc-4a14-9ad7-6bb3bd07d595 tempest-VolumesBackupsTest-2142009639 None] Scanning host 19 c: -, t: -, l: 0) {{(pid=101319) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}} Jul 03 09:45:07.453027 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.linuxscsi [None req-5b578e84-b5bc-4a14-9ad7-6bb3bd07d595 tempest-VolumesBackupsTest-2142009639 None] Searching for a device in session 102 and hctl ['19', '*', '*', 0] yield: None {{(pid=101319) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}} Jul 03 09:45:07.535612 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-1b52199c-010f-4d91-967a-441d98ec32e0 tempest-VolumesBackupsTest-118275719 None] Backing up chunk of data from volume. {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 09:45:07.629717 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-dd7cebed-c6db-4da9-be53-3cc828012d99 tempest-ProjectAdminTests33-1900627284 None] Backing up chunk of data from volume. {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 09:45:07.804455 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-1b52199c-010f-4d91-967a-441d98ec32e0 tempest-VolumesBackupsTest-118275719 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101319) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 09:45:07.805017 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-1b52199c-010f-4d91-967a-441d98ec32e0 tempest-VolumesBackupsTest-118275719 None] About to put_object {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 09:45:07.874532 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-dd7cebed-c6db-4da9-be53-3cc828012d99 tempest-ProjectAdminTests33-1900627284 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101319) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 09:45:07.874765 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-dd7cebed-c6db-4da9-be53-3cc828012d99 tempest-ProjectAdminTests33-1900627284 None] About to put_object {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 09:45:07.902895 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-1b52199c-010f-4d91-967a-441d98ec32e0 tempest-VolumesBackupsTest-118275719 None] backup MD5 for volume_b86cbab3-7c42-409e-b4f6-0ed61267a031/20260703094455/az_nova_backup_3087847d-58e1-4a0c-af9c-2639ae9f2aeb-00019: 25e317773f308e446cc84c503a6d1f85 {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 09:45:07.902895 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-1b52199c-010f-4d91-967a-441d98ec32e0 tempest-VolumesBackupsTest-118275719 None] Calling eventlet.sleep(0) {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 09:45:07.996383 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-dd7cebed-c6db-4da9-be53-3cc828012d99 tempest-ProjectAdminTests33-1900627284 None] backup MD5 for volume_4b68dad5-e9a3-4bd1-84e2-ba745cb7bb83/20260703094505/az_nova_backup_cfdc4925-e984-4da2-aa3e-e1e8a7c37558-00004: 25e317773f308e446cc84c503a6d1f85 {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 09:45:07.996557 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-dd7cebed-c6db-4da9-be53-3cc828012d99 tempest-ProjectAdminTests33-1900627284 None] Calling eventlet.sleep(0) {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 09:45:08.142808 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-1b52199c-010f-4d91-967a-441d98ec32e0 tempest-VolumesBackupsTest-118275719 None] Backing up chunk of data from volume. {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 09:45:08.222255 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-dd7cebed-c6db-4da9-be53-3cc828012d99 tempest-ProjectAdminTests33-1900627284 None] Backing up chunk of data from volume. {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 09:45:08.412854 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-1b52199c-010f-4d91-967a-441d98ec32e0 tempest-VolumesBackupsTest-118275719 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101319) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 09:45:08.412994 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-1b52199c-010f-4d91-967a-441d98ec32e0 tempest-VolumesBackupsTest-118275719 None] About to put_object {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 09:45:08.454307 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.linuxscsi [None req-5b578e84-b5bc-4a14-9ad7-6bb3bd07d595 tempest-VolumesBackupsTest-2142009639 None] Searching for a device in session 102 and hctl ['19', '*', '*', 0] yield: sdn {{(pid=101319) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}} Jul 03 09:45:08.454537 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b578e84-b5bc-4a14-9ad7-6bb3bd07d595 tempest-VolumesBackupsTest-2142009639 None] Connected to sdn using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-d416aa2d-9214-4dcb-ba7c-32b834c4d794', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'd416aa2d-9214-4dcb-ba7c-32b834c4d794', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': False} {{(pid=101319) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}} Jul 03 09:45:08.455265 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.base [None req-5b578e84-b5bc-4a14-9ad7-6bb3bd07d595 tempest-VolumesBackupsTest-2142009639 None] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 2.208s {{(pid=101319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jul 03 09:45:08.455455 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b578e84-b5bc-4a14-9ad7-6bb3bd07d595 tempest-VolumesBackupsTest-2142009639 None] <== connect_volume: return (2208ms) {'type': 'block', 'scsi_wwn': 'SStorPool_iSCSI_DISK_1034578903445799025', 'path': '/dev/sdn'} {{(pid=101319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}} Jul 03 09:45:08.455803 np0000004400 cinder-backup[101319]: DEBUG oslo_concurrency.processutils [None req-5b578e84-b5bc-4a14-9ad7-6bb3bd07d595 tempest-VolumesBackupsTest-2142009639 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chown 1002 /dev/sdn {{(pid=101319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 09:45:08.481245 np0000004400 sudo[136006]: stack : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chown 1002 /dev/sdn Jul 03 09:45:08.481876 np0000004400 sudo[136006]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1002) Jul 03 09:45:08.493543 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-dd7cebed-c6db-4da9-be53-3cc828012d99 tempest-ProjectAdminTests33-1900627284 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101319) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 09:45:08.493781 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-dd7cebed-c6db-4da9-be53-3cc828012d99 tempest-ProjectAdminTests33-1900627284 None] About to put_object {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 09:45:08.522426 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-1b52199c-010f-4d91-967a-441d98ec32e0 tempest-VolumesBackupsTest-118275719 None] backup MD5 for volume_b86cbab3-7c42-409e-b4f6-0ed61267a031/20260703094455/az_nova_backup_3087847d-58e1-4a0c-af9c-2639ae9f2aeb-00020: 25e317773f308e446cc84c503a6d1f85 {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 09:45:08.522426 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-1b52199c-010f-4d91-967a-441d98ec32e0 tempest-VolumesBackupsTest-118275719 None] Calling eventlet.sleep(0) {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 09:45:08.613228 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-dd7cebed-c6db-4da9-be53-3cc828012d99 tempest-ProjectAdminTests33-1900627284 None] backup MD5 for volume_4b68dad5-e9a3-4bd1-84e2-ba745cb7bb83/20260703094505/az_nova_backup_cfdc4925-e984-4da2-aa3e-e1e8a7c37558-00005: 25e317773f308e446cc84c503a6d1f85 {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 09:45:08.613478 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-dd7cebed-c6db-4da9-be53-3cc828012d99 tempest-ProjectAdminTests33-1900627284 None] Calling eventlet.sleep(0) {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 09:45:08.639306 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-1b52199c-010f-4d91-967a-441d98ec32e0 tempest-VolumesBackupsTest-118275719 None] Backing up chunk of data from volume. {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 09:45:08.760749 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-1b52199c-010f-4d91-967a-441d98ec32e0 tempest-VolumesBackupsTest-118275719 None] Compressed 25165824 bytes of data to 24470 bytes using zlib. {{(pid=101319) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 09:45:08.760895 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-1b52199c-010f-4d91-967a-441d98ec32e0 tempest-VolumesBackupsTest-118275719 None] About to put_object {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 09:45:08.828988 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-dd7cebed-c6db-4da9-be53-3cc828012d99 tempest-ProjectAdminTests33-1900627284 None] Backing up chunk of data from volume. {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 09:45:08.831839 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-1b52199c-010f-4d91-967a-441d98ec32e0 tempest-VolumesBackupsTest-118275719 None] backup MD5 for volume_b86cbab3-7c42-409e-b4f6-0ed61267a031/20260703094455/az_nova_backup_3087847d-58e1-4a0c-af9c-2639ae9f2aeb-00021: 77377273b0a4b61febdbf7bbf52b9db9 {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 09:45:08.832065 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-1b52199c-010f-4d91-967a-441d98ec32e0 tempest-VolumesBackupsTest-118275719 None] Calling eventlet.sleep(0) {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 09:45:08.833427 np0000004400 sudo[136006]: pam_unix(sudo:session): session closed for user root Jul 03 09:45:08.835041 np0000004400 cinder-backup[101319]: DEBUG oslo_concurrency.processutils [None req-5b578e84-b5bc-4a14-9ad7-6bb3bd07d595 tempest-VolumesBackupsTest-2142009639 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chown 1002 /dev/sdn" returned: 0 in 0.379s {{(pid=101319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 09:45:08.835470 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-5b578e84-b5bc-4a14-9ad7-6bb3bd07d595 tempest-VolumesBackupsTest-2142009639 None] starting restore of backup volume_b9d43525-b482-4d2d-8541-23ede348708e/20260703094447/az_nova_backup_a636aad8-67e3-4daa-ac42-7179916eefe7 container: tempest-volumesbackupstest-backup-container-313960817, to new volume d416aa2d-9214-4dcb-ba7c-32b834c4d794, backup: a636aad8-67e3-4daa-ac42-7179916eefe7. {{(pid=101319) restore /opt/stack/cinder/cinder/backup/chunkeddriver.py:761}} Jul 03 09:45:08.835712 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-5b578e84-b5bc-4a14-9ad7-6bb3bd07d595 tempest-VolumesBackupsTest-2142009639 None] _read_metadata started, container name: tempest-volumesbackupstest-backup-container-313960817, metadata filename: volume_b9d43525-b482-4d2d-8541-23ede348708e/20260703094447/az_nova_backup_a636aad8-67e3-4daa-ac42-7179916eefe7_metadata. {{(pid=101319) _read_metadata /opt/stack/cinder/cinder/backup/chunkeddriver.py:320}} Jul 03 09:45:08.848152 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.driver [None req-1b52199c-010f-4d91-967a-441d98ec32e0 tempest-VolumesBackupsTest-118275719 None] Getting metadata type 'volume-base-metadata' {{(pid=101319) _save_vol_base_meta /opt/stack/cinder/cinder/backup/driver.py:79}} Jul 03 09:45:08.858078 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.driver [None req-1b52199c-010f-4d91-967a-441d98ec32e0 tempest-VolumesBackupsTest-118275719 None] Completed fetching metadata type 'volume-base-metadata' {{(pid=101319) _save_vol_base_meta /opt/stack/cinder/cinder/backup/driver.py:98}} Jul 03 09:45:08.858492 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.driver [None req-1b52199c-010f-4d91-967a-441d98ec32e0 tempest-VolumesBackupsTest-118275719 None] Getting metadata type 'volume-metadata' {{(pid=101319) _save_vol_meta /opt/stack/cinder/cinder/backup/driver.py:109}} Jul 03 09:45:08.862116 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-5b578e84-b5bc-4a14-9ad7-6bb3bd07d595 tempest-VolumesBackupsTest-2142009639 None] _read_metadata finished. Metadata: { Jul 03 09:45:08.862116 np0000004400 cinder-backup[101319]: "backup_description": null, Jul 03 09:45:08.862116 np0000004400 cinder-backup[101319]: "backup_id": "a636aad8-67e3-4daa-ac42-7179916eefe7", Jul 03 09:45:08.862116 np0000004400 cinder-backup[101319]: "backup_name": "tempest-VolumesBackupsTest-Backup-1496010604", Jul 03 09:45:08.862116 np0000004400 cinder-backup[101319]: "created_at": "2026-07-03 09:44:41+00:00", Jul 03 09:45:08.862116 np0000004400 cinder-backup[101319]: "objects": [ Jul 03 09:45:08.862116 np0000004400 cinder-backup[101319]: { Jul 03 09:45:08.862116 np0000004400 cinder-backup[101319]: "volume_b9d43525-b482-4d2d-8541-23ede348708e/20260703094447/az_nova_backup_a636aad8-67e3-4daa-ac42-7179916eefe7-00001": { Jul 03 09:45:08.862116 np0000004400 cinder-backup[101319]: "compression": "zlib", Jul 03 09:45:08.862116 np0000004400 cinder-backup[101319]: "length": 52428800, Jul 03 09:45:08.862116 np0000004400 cinder-backup[101319]: "md5": "82571f7121cb9475563edde615e4e4df", Jul 03 09:45:08.862116 np0000004400 cinder-backup[101319]: "offset": 0 Jul 03 09:45:08.862116 np0000004400 cinder-backup[101319]: } Jul 03 09:45:08.862116 np0000004400 cinder-backup[101319]: }, Jul 03 09:45:08.862116 np0000004400 cinder-backup[101319]: { Jul 03 09:45:08.862116 np0000004400 cinder-backup[101319]: "volume_b9d43525-b482-4d2d-8541-23ede348708e/20260703094447/az_nova_backup_a636aad8-67e3-4daa-ac42-7179916eefe7-00002": { Jul 03 09:45:08.862116 np0000004400 cinder-backup[101319]: "compression": "zlib", Jul 03 09:45:08.862116 np0000004400 cinder-backup[101319]: "length": 52428800, Jul 03 09:45:08.862116 np0000004400 cinder-backup[101319]: "md5": "25e317773f308e446cc84c503a6d1f85", Jul 03 09:45:08.862116 np0000004400 cinder-backup[101319]: "offset": 52428800 Jul 03 09:45:08.862116 np0000004400 cinder-backup[101319]: } Jul 03 09:45:08.862116 np0000004400 cinder-backup[101319]: }, Jul 03 09:45:08.862116 np0000004400 cinder-backup[101319]: { Jul 03 09:45:08.862116 np0000004400 cinder-backup[101319]: "volume_b9d43525-b482-4d2d-8541-23ede348708e/20260703094447/az_nova_backup_a636aad8-67e3-4daa-ac42-7179916eefe7-00003": { Jul 03 09:45:08.862116 np0000004400 cinder-backup[101319]: "compression": "zlib", Jul 03 09:45:08.862116 np0000004400 cinder-backup[101319]: "length": 52428800, Jul 03 09:45:08.862116 np0000004400 cinder-backup[101319]: "md5": "a35891500449df17e893f84bd88472fb", Jul 03 09:45:08.862116 np0000004400 cinder-backup[101319]: "offset": 104857600 Jul 03 09:45:08.862116 np0000004400 cinder-backup[101319]: } Jul 03 09:45:08.862116 np0000004400 cinder-backup[101319]: }, Jul 03 09:45:08.862116 np0000004400 cinder-backup[101319]: { Jul 03 09:45:08.862116 np0000004400 cinder-backup[101319]: "volume_b9d43525-b482-4d2d-8541-23ede348708e/20260703094447/az_nova_backup_a636aad8-67e3-4daa-ac42-7179916eefe7-00004": { Jul 03 09:45:08.862116 np0000004400 cinder-backup[101319]: "compression": "zlib", Jul 03 09:45:08.862116 np0000004400 cinder-backup[101319]: "length": 52428800, Jul 03 09:45:08.862116 np0000004400 cinder-backup[101319]: "md5": "25e317773f308e446cc84c503a6d1f85", Jul 03 09:45:08.862116 np0000004400 cinder-backup[101319]: "offset": 157286400 Jul 03 09:45:08.862116 np0000004400 cinder-backup[101319]: } Jul 03 09:45:08.862116 np0000004400 cinder-backup[101319]: }, Jul 03 09:45:08.862116 np0000004400 cinder-backup[101319]: { Jul 03 09:45:08.862116 np0000004400 cinder-backup[101319]: "volume_b9d43525-b482-4d2d-8541-23ede348708e/20260703094447/az_nova_backup_a636aad8-67e3-4daa-ac42-7179916eefe7-00005": { Jul 03 09:45:08.862116 np0000004400 cinder-backup[101319]: "compression": "zlib", Jul 03 09:45:08.862116 np0000004400 cinder-backup[101319]: "length": 52428800, Jul 03 09:45:08.862116 np0000004400 cinder-backup[101319]: "md5": "25e317773f308e446cc84c503a6d1f85", Jul 03 09:45:08.862116 np0000004400 cinder-backup[101319]: "offset": 209715200 Jul 03 09:45:08.862116 np0000004400 cinder-backup[101319]: } Jul 03 09:45:08.862116 np0000004400 cinder-backup[101319]: }, Jul 03 09:45:08.862116 np0000004400 cinder-backup[101319]: { Jul 03 09:45:08.862116 np0000004400 cinder-backup[101319]: "volume_b9d43525-b482-4d2d-8541-23ede348708e/20260703094447/az_nova_backup_a636aad8-67e3-4daa-ac42-7179916eefe7-00006": { Jul 03 09:45:08.862116 np0000004400 cinder-backup[101319]: "compression": "zlib", Jul 03 09:45:08.862116 np0000004400 cinder-backup[101319]: "length": 52428800, Jul 03 09:45:08.862116 np0000004400 cinder-backup[101319]: "md5": "25e317773f308e446cc84c503a6d1f85", Jul 03 09:45:08.862116 np0000004400 cinder-backup[101319]: "offset": 262144000 Jul 03 09:45:08.862116 np0000004400 cinder-backup[101319]: } Jul 03 09:45:08.862116 np0000004400 cinder-backup[101319]: }, Jul 03 09:45:08.862116 np0000004400 cinder-backup[101319]: { Jul 03 09:45:08.862116 np0000004400 cinder-backup[101319]: "volume_b9d43525-b482-4d2d-8541-23ede348708e/20260703094447/az_nova_backup_a636aad8-67e3-4daa-ac42-7179916eefe7-00007": { Jul 03 09:45:08.862116 np0000004400 cinder-backup[101319]: "compression": "zlib", Jul 03 09:45:08.862116 np0000004400 cinder-backup[101319]: "length": 52428800, Jul 03 09:45:08.862116 np0000004400 cinder-backup[101319]: "md5": "25e317773f308e446cc84c503a6d1f85", Jul 03 09:45:08.862116 np0000004400 cinder-backup[101319]: "offset": 314572800 Jul 03 09:45:08.862116 np0000004400 cinder-backup[101319]: } Jul 03 09:45:08.862116 np0000004400 cinder-backup[101319]: }, Jul 03 09:45:08.862116 np0000004400 cinder-backup[101319]: { Jul 03 09:45:08.862116 np0000004400 cinder-backup[101319]: "volume_b9d43525-b482-4d2d-8541-23ede348708e/20260703094447/az_nova_backup_a636aad8-67e3-4daa-ac42-7179916eefe7-00008": { Jul 03 09:45:08.862116 np0000004400 cinder-backup[101319]: "compression": "zlib", Jul 03 09:45:08.862116 np0000004400 cinder-backup[101319]: "length": 52428800, Jul 03 09:45:08.862116 np0000004400 cinder-backup[101319]: "md5": "25e317773f308e446cc84c503a6d1f85", Jul 03 09:45:08.862116 np0000004400 cinder-backup[101319]: "offset": 367001600 Jul 03 09:45:08.862116 np0000004400 cinder-backup[101319]: } Jul 03 09:45:08.862116 np0000004400 cinder-backup[101319]: }, Jul 03 09:45:08.862116 np0000004400 cinder-backup[101319]: { Jul 03 09:45:08.862116 np0000004400 cinder-backup[101319]: "volume_b9d43525-b482-4d2d-8541-23ede348708e/20260703094447/az_nova_backup_a636aad8-67e3-4daa-ac42-7179916eefe7-00009": { Jul 03 09:45:08.862116 np0000004400 cinder-backup[101319]: "compression": "zlib", Jul 03 09:45:08.862116 np0000004400 cinder-backup[101319]: "length": 52428800, Jul 03 09:45:08.862116 np0000004400 cinder-backup[101319]: "md5": "25e317773f308e446cc84c503a6d1f85", Jul 03 09:45:08.862116 np0000004400 cinder-backup[101319]: "offset": 419430400 Jul 03 09:45:08.862116 np0000004400 cinder-backup[101319]: } Jul 03 09:45:08.862116 np0000004400 cinder-backup[101319]: }, Jul 03 09:45:08.862116 np0000004400 cinder-backup[101319]: { Jul 03 09:45:08.862116 np0000004400 cinder-backup[101319]: "volume_b9d43525-b482-4d2d-8541-23ede348708e/20260703094447/az_nova_backup_a636aad8-67e3-4daa-ac42-7179916eefe7-00010": { Jul 03 09:45:08.862116 np0000004400 cinder-backup[101319]: "compression": "zlib", Jul 03 09:45:08.862116 np0000004400 cinder-backup[101319]: "length": 52428800, Jul 03 09:45:08.862116 np0000004400 cinder-backup[101319]: "md5": "25e317773f308e446cc84c503a6d1f85", Jul 03 09:45:08.862116 np0000004400 cinder-backup[101319]: "offset": 471859200 Jul 03 09:45:08.862116 np0000004400 cinder-backup[101319]: } Jul 03 09:45:08.862116 np0000004400 cinder-backup[101319]: }, Jul 03 09:45:08.862116 np0000004400 cinder-backup[101319]: { Jul 03 09:45:08.862116 np0000004400 cinder-backup[101319]: "volume_b9d43525-b482-4d2d-8541-23ede348708e/20260703094447/az_nova_backup_a636aad8-67e3-4daa-ac42-7179916eefe7-00011": { Jul 03 09:45:08.862116 np0000004400 cinder-backup[101319]: "compression": "zlib", Jul 03 09:45:08.862116 np0000004400 cinder-backup[101319]: "length": 52428800, Jul 03 09:45:08.862116 np0000004400 cinder-backup[101319]: "md5": "25e317773f308e446cc84c503a6d1f85", Jul 03 09:45:08.862116 np0000004400 cinder-backup[101319]: "offset": 524288000 Jul 03 09:45:08.862116 np0000004400 cinder-backup[101319]: } Jul 03 09:45:08.862116 np0000004400 cinder-backup[101319]: }, Jul 03 09:45:08.862116 np0000004400 cinder-backup[101319]: { Jul 03 09:45:08.862116 np0000004400 cinder-backup[101319]: "volume_b9d43525-b482-4d2d-8541-23ede348708e/20260703094447/az_nova_backup_a636aad8-67e3-4daa-ac42-7179916eefe7-00012": { Jul 03 09:45:08.862116 np0000004400 cinder-backup[101319]: "compression": "zlib", Jul 03 09:45:08.862116 np0000004400 cinder-backup[101319]: "length": 52428800, Jul 03 09:45:08.862116 np0000004400 cinder-backup[101319]: "md5": "25e317773f308e446cc84c503a6d1f85", Jul 03 09:45:08.862116 np0000004400 cinder-backup[101319]: "offset": 576716800 Jul 03 09:45:08.862116 np0000004400 cinder-backup[101319]: } Jul 03 09:45:08.862116 np0000004400 cinder-backup[101319]: }, Jul 03 09:45:08.862116 np0000004400 cinder-backup[101319]: { Jul 03 09:45:08.862116 np0000004400 cinder-backup[101319]: "volume_b9d43525-b482-4d2d-8541-23ede348708e/20260703094447/az_nova_backup_a636aad8-67e3-4daa-ac42-7179916eefe7-00013": { Jul 03 09:45:08.862116 np0000004400 cinder-backup[101319]: "compression": "zlib", Jul 03 09:45:08.862116 np0000004400 cinder-backup[101319]: "length": 52428800, Jul 03 09:45:08.862116 np0000004400 cinder-backup[101319]: "md5": "25e317773f308e446cc84c503a6d1f85", Jul 03 09:45:08.862116 np0000004400 cinder-backup[101319]: "offset": 629145600 Jul 03 09:45:08.862116 np0000004400 cinder-backup[101319]: } Jul 03 09:45:08.862116 np0000004400 cinder-backup[101319]: }, Jul 03 09:45:08.862116 np0000004400 cinder-backup[101319]: { Jul 03 09:45:08.862116 np0000004400 cinder-backup[101319]: "volume_b9d43525-b482-4d2d-8541-23ede348708e/20260703094447/az_nova_backup_a636aad8-67e3-4daa-ac42-7179916eefe7-00014": { Jul 03 09:45:08.862116 np0000004400 cinder-backup[101319]: "compression": "zlib", Jul 03 09:45:08.862116 np0000004400 cinder-backup[101319]: "length": 52428800, Jul 03 09:45:08.862116 np0000004400 cinder-backup[101319]: "md5": "25e317773f308e446cc84c503a6d1f85", Jul 03 09:45:08.862116 np0000004400 cinder-backup[101319]: "offset": 681574400 Jul 03 09:45:08.862116 np0000004400 cinder-backup[101319]: } Jul 03 09:45:08.862116 np0000004400 cinder-backup[101319]: }, Jul 03 09:45:08.862116 np0000004400 cinder-backup[101319]: { Jul 03 09:45:08.862116 np0000004400 cinder-backup[101319]: "volume_b9d43525-b482-4d2d-8541-23ede348708e/20260703094447/az_nova_backup_a636aad8-67e3-4daa-ac42-7179916eefe7-00015": { Jul 03 09:45:08.862116 np0000004400 cinder-backup[101319]: "compression": "zlib", Jul 03 09:45:08.862116 np0000004400 cinder-backup[101319]: "length": 52428800, Jul 03 09:45:08.862116 np0000004400 cinder-backup[101319]: "md5": "25e317773f308e446cc84c503a6d1f85", Jul 03 09:45:08.862116 np0000004400 cinder-backup[101319]: "offset": 734003200 Jul 03 09:45:08.862116 np0000004400 cinder-backup[101319]: } Jul 03 09:45:08.862116 np0000004400 cinder-backup[101319]: }, Jul 03 09:45:08.862116 np0000004400 cinder-backup[101319]: { Jul 03 09:45:08.862116 np0000004400 cinder-backup[101319]: "volume_b9d43525-b482-4d2d-8541-23ede348708e/20260703094447/az_nova_backup_a636aad8-67e3-4daa-ac42-7179916eefe7-00016": { Jul 03 09:45:08.862116 np0000004400 cinder-backup[101319]: "compression": "zlib", Jul 03 09:45:08.862116 np0000004400 cinder-backup[101319]: "length": 52428800, Jul 03 09:45:08.862116 np0000004400 cinder-backup[101319]: "md5": "25e317773f308e446cc84c503a6d1f85", Jul 03 09:45:08.862116 np0000004400 cinder-backup[101319]: "offset": 786432000 Jul 03 09:45:08.862116 np0000004400 cinder-backup[101319]: } Jul 03 09:45:08.862116 np0000004400 cinder-backup[101319]: }, Jul 03 09:45:08.862116 np0000004400 cinder-backup[101319]: { Jul 03 09:45:08.862116 np0000004400 cinder-backup[101319]: "volume_b9d43525-b482-4d2d-8541-23ede348708e/20260703094447/az_nova_backup_a636aad8-67e3-4daa-ac42-7179916eefe7-00017": { Jul 03 09:45:08.862116 np0000004400 cinder-backup[101319]: "compression": "zlib", Jul 03 09:45:08.862116 np0000004400 cinder-backup[101319]: "length": 52428800, Jul 03 09:45:08.862116 np0000004400 cinder-backup[101319]: "md5": "25e317773f308e446cc84c503a6d1f85", Jul 03 09:45:08.862116 np0000004400 cinder-backup[101319]: "offset": 838860800 Jul 03 09:45:08.862116 np0000004400 cinder-backup[101319]: } Jul 03 09:45:08.862116 np0000004400 cinder-backup[101319]: }, Jul 03 09:45:08.862116 np0000004400 cinder-backup[101319]: { Jul 03 09:45:08.862116 np0000004400 cinder-backup[101319]: "volume_b9d43525-b482-4d2d-8541-23ede348708e/20260703094447/az_nova_backup_a636aad8-67e3-4daa-ac42-7179916eefe7-00018": { Jul 03 09:45:08.862116 np0000004400 cinder-backup[101319]: "compression": "zlib", Jul 03 09:45:08.862116 np0000004400 cinder-backup[101319]: "length": 52428800, Jul 03 09:45:08.862116 np0000004400 cinder-backup[101319]: "md5": "25e317773f308e446cc84c503a6d1f85", Jul 03 09:45:08.862116 np0000004400 cinder-backup[101319]: "offset": 891289600 Jul 03 09:45:08.862116 np0000004400 cinder-backup[101319]: } Jul 03 09:45:08.862116 np0000004400 cinder-backup[101319]: }, Jul 03 09:45:08.862116 np0000004400 cinder-backup[101319]: { Jul 03 09:45:08.862116 np0000004400 cinder-backup[101319]: "volume_b9d43525-b482-4d2d-8541-23ede348708e/20260703094447/az_nova_backup_a636aad8-67e3-4daa-ac42-7179916eefe7-00019": { Jul 03 09:45:08.862116 np0000004400 cinder-backup[101319]: "compression": "zlib", Jul 03 09:45:08.862116 np0000004400 cinder-backup[101319]: "length": 52428800, Jul 03 09:45:08.862116 np0000004400 cinder-backup[101319]: "md5": "25e317773f308e446cc84c503a6d1f85", Jul 03 09:45:08.862116 np0000004400 cinder-backup[101319]: "offset": 943718400 Jul 03 09:45:08.862116 np0000004400 cinder-backup[101319]: } Jul 03 09:45:08.862116 np0000004400 cinder-backup[101319]: }, Jul 03 09:45:08.862116 np0000004400 cinder-backup[101319]: { Jul 03 09:45:08.862116 np0000004400 cinder-backup[101319]: "volume_b9d43525-b482-4d2d-8541-23ede348708e/20260703094447/az_nova_backup_a636aad8-67e3-4daa-ac42-7179916eefe7-00020": { Jul 03 09:45:08.862116 np0000004400 cinder-backup[101319]: "compression": "zlib", Jul 03 09:45:08.862116 np0000004400 cinder-backup[101319]: "length": 52428800, Jul 03 09:45:08.862116 np0000004400 cinder-backup[101319]: "md5": "25e317773f308e446cc84c503a6d1f85", Jul 03 09:45:08.862116 np0000004400 cinder-backup[101319]: "offset": 996147200 Jul 03 09:45:08.862116 np0000004400 cinder-backup[101319]: } Jul 03 09:45:08.862116 np0000004400 cinder-backup[101319]: }, Jul 03 09:45:08.862116 np0000004400 cinder-backup[101319]: { Jul 03 09:45:08.862116 np0000004400 cinder-backup[101319]: "volume_b9d43525-b482-4d2d-8541-23ede348708e/20260703094447/az_nova_backup_a636aad8-67e3-4daa-ac42-7179916eefe7-00021": { Jul 03 09:45:08.862116 np0000004400 cinder-backup[101319]: "compression": "zlib", Jul 03 09:45:08.862116 np0000004400 cinder-backup[101319]: "length": 25165824, Jul 03 09:45:08.862116 np0000004400 cinder-backup[101319]: "md5": "77377273b0a4b61febdbf7bbf52b9db9", Jul 03 09:45:08.862116 np0000004400 cinder-backup[101319]: "offset": 1048576000 Jul 03 09:45:08.862116 np0000004400 cinder-backup[101319]: } Jul 03 09:45:08.862116 np0000004400 cinder-backup[101319]: } Jul 03 09:45:08.862116 np0000004400 cinder-backup[101319]: ], Jul 03 09:45:08.862116 np0000004400 cinder-backup[101319]: "parent_id": null, Jul 03 09:45:08.862116 np0000004400 cinder-backup[101319]: "version": "1.0.0", Jul 03 09:45:08.862116 np0000004400 cinder-backup[101319]: "volume_id": "b9d43525-b482-4d2d-8541-23ede348708e", Jul 03 09:45:08.862116 np0000004400 cinder-backup[101319]: "volume_meta": "{\"version\": 2, \"volume-base-metadata\": {\"id\": \"b9d43525-b482-4d2d-8541-23ede348708e\", \"_name_id\": null, \"use_quota\": true, \"ec2_id\": null, \"user_id\": \"91463b6c437c4711a49d3c31c513a101\", \"project_id\": \"59044e18a5b24b19a7b9b8a380f2e1a0\", \"snapshot_id\": null, \"cluster_name\": null, \"host\": \"np0000004400@storpool#default\", \"size\": 1, \"availability_zone\": \"nova\", \"status\": \"backing-up\", \"attach_status\": \"detached\", \"migration_status\": null, \"scheduled_at\": \"2026-07-03T09:44:40.000000\", \"launched_at\": \"2026-07-03T09:44:40.000000\", \"terminated_at\": null, \"display_name\": \"tempest-VolumesBackupsTest-Volume-2079726756\", \"display_description\": null, \"provider_location\": null, \"provider_auth\": null, \"provider_geometry\": null, \"provider_id\": null, \"volume_type_id\": \"03e13fe6-0e30-4803-ace0-725d38e6dc24\", \"source_volid\": null, \"encryption_key_id\": null, \"consistencygroup_id\": null, \"group_id\": null, \"bootable\": true, \"multiattach\": false, \"replication_status\": null, \"replication_extended_status\": null, \"replication_driver_data\": null, \"previous_status\": \"available\", \"service_uuid\": \"6d4b0e79-fefe-4744-b25f-34be05095200\", \"shared_targets\": true, \"deleted_at\": null, \"deleted\": false, \"created_at\": \"2026-07-03T09:44:40.000000\", \"updated_at\": \"2026-07-03T09:44:41.000000\"}, \"volume-glance-metadata\": {\"hw_rng_model\": \"virtio\", \"os_glance_failed_import\": \"\", \"os_glance_importing_to_stores\": \"\", \"owner_specified.openstack.md5\": \"\", \"owner_specified.openstack.object\": \"images/cirros-0.6.3-x86_64-disk\", \"owner_specified.openstack.sha256\": \"\", \"image_id\": \"c1946dda-7935-4a75-a25a-cf65d1d25617\", \"image_name\": \"cirros-0.6.3-x86_64-disk\", \"checksum\": \"87617e24a5e30cb3b87fda8c0764838f\", \"container_format\": \"bare\", \"disk_format\": \"qcow2\", \"min_disk\": \"0\", \"min_ram\": \"0\", \"size\": \"21692416\"}}" Jul 03 09:45:08.862116 np0000004400 cinder-backup[101319]: }. {{(pid=101319) _read_metadata /opt/stack/cinder/cinder/backup/chunkeddriver.py:327}} Jul 03 09:45:08.865204 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-5b578e84-b5bc-4a14-9ad7-6bb3bd07d595 tempest-VolumesBackupsTest-2142009639 None] Restoring backup version 1.0.0 {{(pid=101319) restore /opt/stack/cinder/cinder/backup/chunkeddriver.py:774}} Jul 03 09:45:08.865204 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-5b578e84-b5bc-4a14-9ad7-6bb3bd07d595 tempest-VolumesBackupsTest-2142009639 None] _read_metadata started, container name: tempest-volumesbackupstest-backup-container-313960817, metadata filename: volume_b9d43525-b482-4d2d-8541-23ede348708e/20260703094447/az_nova_backup_a636aad8-67e3-4daa-ac42-7179916eefe7_metadata. {{(pid=101319) _read_metadata /opt/stack/cinder/cinder/backup/chunkeddriver.py:320}} Jul 03 09:45:08.867786 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.driver [None req-1b52199c-010f-4d91-967a-441d98ec32e0 tempest-VolumesBackupsTest-118275719 None] No metadata type 'volume-metadata' available {{(pid=101319) _save_vol_meta /opt/stack/cinder/cinder/backup/driver.py:123}} Jul 03 09:45:08.867986 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.driver [None req-1b52199c-010f-4d91-967a-441d98ec32e0 tempest-VolumesBackupsTest-118275719 None] Getting metadata type 'volume-glance-metadata' {{(pid=101319) _save_vol_glance_meta /opt/stack/cinder/cinder/backup/driver.py:132}} Jul 03 09:45:08.873247 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.driver [None req-1b52199c-010f-4d91-967a-441d98ec32e0 tempest-VolumesBackupsTest-118275719 None] No metadata type 'volume-glance-metadata' available {{(pid=101319) _save_vol_glance_meta /opt/stack/cinder/cinder/backup/driver.py:147}} Jul 03 09:45:08.873490 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-1b52199c-010f-4d91-967a-441d98ec32e0 tempest-VolumesBackupsTest-118275719 None] _write_sha256file started, container name: volumebackups, sha256file filename: volume_b86cbab3-7c42-409e-b4f6-0ed61267a031/20260703094455/az_nova_backup_3087847d-58e1-4a0c-af9c-2639ae9f2aeb_sha256file. {{(pid=101319) _write_sha256file /opt/stack/cinder/cinder/backup/chunkeddriver.py:299}} Jul 03 09:45:08.900317 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-5b578e84-b5bc-4a14-9ad7-6bb3bd07d595 tempest-VolumesBackupsTest-2142009639 None] _read_metadata finished. Metadata: { Jul 03 09:45:08.900317 np0000004400 cinder-backup[101319]: "backup_description": null, Jul 03 09:45:08.900317 np0000004400 cinder-backup[101319]: "backup_id": "a636aad8-67e3-4daa-ac42-7179916eefe7", Jul 03 09:45:08.900317 np0000004400 cinder-backup[101319]: "backup_name": "tempest-VolumesBackupsTest-Backup-1496010604", Jul 03 09:45:08.900317 np0000004400 cinder-backup[101319]: "created_at": "2026-07-03 09:44:41+00:00", Jul 03 09:45:08.900317 np0000004400 cinder-backup[101319]: "objects": [ Jul 03 09:45:08.900317 np0000004400 cinder-backup[101319]: { Jul 03 09:45:08.900317 np0000004400 cinder-backup[101319]: "volume_b9d43525-b482-4d2d-8541-23ede348708e/20260703094447/az_nova_backup_a636aad8-67e3-4daa-ac42-7179916eefe7-00001": { Jul 03 09:45:08.900317 np0000004400 cinder-backup[101319]: "compression": "zlib", Jul 03 09:45:08.900317 np0000004400 cinder-backup[101319]: "length": 52428800, Jul 03 09:45:08.900317 np0000004400 cinder-backup[101319]: "md5": "82571f7121cb9475563edde615e4e4df", Jul 03 09:45:08.900317 np0000004400 cinder-backup[101319]: "offset": 0 Jul 03 09:45:08.900317 np0000004400 cinder-backup[101319]: } Jul 03 09:45:08.900317 np0000004400 cinder-backup[101319]: }, Jul 03 09:45:08.900317 np0000004400 cinder-backup[101319]: { Jul 03 09:45:08.900317 np0000004400 cinder-backup[101319]: "volume_b9d43525-b482-4d2d-8541-23ede348708e/20260703094447/az_nova_backup_a636aad8-67e3-4daa-ac42-7179916eefe7-00002": { Jul 03 09:45:08.900317 np0000004400 cinder-backup[101319]: "compression": "zlib", Jul 03 09:45:08.900317 np0000004400 cinder-backup[101319]: "length": 52428800, Jul 03 09:45:08.900317 np0000004400 cinder-backup[101319]: "md5": "25e317773f308e446cc84c503a6d1f85", Jul 03 09:45:08.900317 np0000004400 cinder-backup[101319]: "offset": 52428800 Jul 03 09:45:08.900317 np0000004400 cinder-backup[101319]: } Jul 03 09:45:08.900317 np0000004400 cinder-backup[101319]: }, Jul 03 09:45:08.900317 np0000004400 cinder-backup[101319]: { Jul 03 09:45:08.900317 np0000004400 cinder-backup[101319]: "volume_b9d43525-b482-4d2d-8541-23ede348708e/20260703094447/az_nova_backup_a636aad8-67e3-4daa-ac42-7179916eefe7-00003": { Jul 03 09:45:08.900317 np0000004400 cinder-backup[101319]: "compression": "zlib", Jul 03 09:45:08.900317 np0000004400 cinder-backup[101319]: "length": 52428800, Jul 03 09:45:08.900317 np0000004400 cinder-backup[101319]: "md5": "a35891500449df17e893f84bd88472fb", Jul 03 09:45:08.900317 np0000004400 cinder-backup[101319]: "offset": 104857600 Jul 03 09:45:08.900317 np0000004400 cinder-backup[101319]: } Jul 03 09:45:08.900317 np0000004400 cinder-backup[101319]: }, Jul 03 09:45:08.900317 np0000004400 cinder-backup[101319]: { Jul 03 09:45:08.900317 np0000004400 cinder-backup[101319]: "volume_b9d43525-b482-4d2d-8541-23ede348708e/20260703094447/az_nova_backup_a636aad8-67e3-4daa-ac42-7179916eefe7-00004": { Jul 03 09:45:08.900317 np0000004400 cinder-backup[101319]: "compression": "zlib", Jul 03 09:45:08.900317 np0000004400 cinder-backup[101319]: "length": 52428800, Jul 03 09:45:08.900317 np0000004400 cinder-backup[101319]: "md5": "25e317773f308e446cc84c503a6d1f85", Jul 03 09:45:08.900317 np0000004400 cinder-backup[101319]: "offset": 157286400 Jul 03 09:45:08.900317 np0000004400 cinder-backup[101319]: } Jul 03 09:45:08.900317 np0000004400 cinder-backup[101319]: }, Jul 03 09:45:08.900317 np0000004400 cinder-backup[101319]: { Jul 03 09:45:08.900317 np0000004400 cinder-backup[101319]: "volume_b9d43525-b482-4d2d-8541-23ede348708e/20260703094447/az_nova_backup_a636aad8-67e3-4daa-ac42-7179916eefe7-00005": { Jul 03 09:45:08.900317 np0000004400 cinder-backup[101319]: "compression": "zlib", Jul 03 09:45:08.900317 np0000004400 cinder-backup[101319]: "length": 52428800, Jul 03 09:45:08.900317 np0000004400 cinder-backup[101319]: "md5": "25e317773f308e446cc84c503a6d1f85", Jul 03 09:45:08.900317 np0000004400 cinder-backup[101319]: "offset": 209715200 Jul 03 09:45:08.900317 np0000004400 cinder-backup[101319]: } Jul 03 09:45:08.900317 np0000004400 cinder-backup[101319]: }, Jul 03 09:45:08.900317 np0000004400 cinder-backup[101319]: { Jul 03 09:45:08.900317 np0000004400 cinder-backup[101319]: "volume_b9d43525-b482-4d2d-8541-23ede348708e/20260703094447/az_nova_backup_a636aad8-67e3-4daa-ac42-7179916eefe7-00006": { Jul 03 09:45:08.900317 np0000004400 cinder-backup[101319]: "compression": "zlib", Jul 03 09:45:08.900317 np0000004400 cinder-backup[101319]: "length": 52428800, Jul 03 09:45:08.900317 np0000004400 cinder-backup[101319]: "md5": "25e317773f308e446cc84c503a6d1f85", Jul 03 09:45:08.900317 np0000004400 cinder-backup[101319]: "offset": 262144000 Jul 03 09:45:08.900317 np0000004400 cinder-backup[101319]: } Jul 03 09:45:08.900317 np0000004400 cinder-backup[101319]: }, Jul 03 09:45:08.900317 np0000004400 cinder-backup[101319]: { Jul 03 09:45:08.900317 np0000004400 cinder-backup[101319]: "volume_b9d43525-b482-4d2d-8541-23ede348708e/20260703094447/az_nova_backup_a636aad8-67e3-4daa-ac42-7179916eefe7-00007": { Jul 03 09:45:08.900317 np0000004400 cinder-backup[101319]: "compression": "zlib", Jul 03 09:45:08.900317 np0000004400 cinder-backup[101319]: "length": 52428800, Jul 03 09:45:08.900317 np0000004400 cinder-backup[101319]: "md5": "25e317773f308e446cc84c503a6d1f85", Jul 03 09:45:08.900317 np0000004400 cinder-backup[101319]: "offset": 314572800 Jul 03 09:45:08.900317 np0000004400 cinder-backup[101319]: } Jul 03 09:45:08.900317 np0000004400 cinder-backup[101319]: }, Jul 03 09:45:08.900317 np0000004400 cinder-backup[101319]: { Jul 03 09:45:08.900317 np0000004400 cinder-backup[101319]: "volume_b9d43525-b482-4d2d-8541-23ede348708e/20260703094447/az_nova_backup_a636aad8-67e3-4daa-ac42-7179916eefe7-00008": { Jul 03 09:45:08.900317 np0000004400 cinder-backup[101319]: "compression": "zlib", Jul 03 09:45:08.900317 np0000004400 cinder-backup[101319]: "length": 52428800, Jul 03 09:45:08.900317 np0000004400 cinder-backup[101319]: "md5": "25e317773f308e446cc84c503a6d1f85", Jul 03 09:45:08.900317 np0000004400 cinder-backup[101319]: "offset": 367001600 Jul 03 09:45:08.900317 np0000004400 cinder-backup[101319]: } Jul 03 09:45:08.900317 np0000004400 cinder-backup[101319]: }, Jul 03 09:45:08.900317 np0000004400 cinder-backup[101319]: { Jul 03 09:45:08.900317 np0000004400 cinder-backup[101319]: "volume_b9d43525-b482-4d2d-8541-23ede348708e/20260703094447/az_nova_backup_a636aad8-67e3-4daa-ac42-7179916eefe7-00009": { Jul 03 09:45:08.900317 np0000004400 cinder-backup[101319]: "compression": "zlib", Jul 03 09:45:08.900317 np0000004400 cinder-backup[101319]: "length": 52428800, Jul 03 09:45:08.900317 np0000004400 cinder-backup[101319]: "md5": "25e317773f308e446cc84c503a6d1f85", Jul 03 09:45:08.900317 np0000004400 cinder-backup[101319]: "offset": 419430400 Jul 03 09:45:08.900317 np0000004400 cinder-backup[101319]: } Jul 03 09:45:08.900317 np0000004400 cinder-backup[101319]: }, Jul 03 09:45:08.900317 np0000004400 cinder-backup[101319]: { Jul 03 09:45:08.900317 np0000004400 cinder-backup[101319]: "volume_b9d43525-b482-4d2d-8541-23ede348708e/20260703094447/az_nova_backup_a636aad8-67e3-4daa-ac42-7179916eefe7-00010": { Jul 03 09:45:08.900317 np0000004400 cinder-backup[101319]: "compression": "zlib", Jul 03 09:45:08.900317 np0000004400 cinder-backup[101319]: "length": 52428800, Jul 03 09:45:08.900317 np0000004400 cinder-backup[101319]: "md5": "25e317773f308e446cc84c503a6d1f85", Jul 03 09:45:08.900317 np0000004400 cinder-backup[101319]: "offset": 471859200 Jul 03 09:45:08.900317 np0000004400 cinder-backup[101319]: } Jul 03 09:45:08.900317 np0000004400 cinder-backup[101319]: }, Jul 03 09:45:08.900317 np0000004400 cinder-backup[101319]: { Jul 03 09:45:08.900317 np0000004400 cinder-backup[101319]: "volume_b9d43525-b482-4d2d-8541-23ede348708e/20260703094447/az_nova_backup_a636aad8-67e3-4daa-ac42-7179916eefe7-00011": { Jul 03 09:45:08.900317 np0000004400 cinder-backup[101319]: "compression": "zlib", Jul 03 09:45:08.900317 np0000004400 cinder-backup[101319]: "length": 52428800, Jul 03 09:45:08.900317 np0000004400 cinder-backup[101319]: "md5": "25e317773f308e446cc84c503a6d1f85", Jul 03 09:45:08.900317 np0000004400 cinder-backup[101319]: "offset": 524288000 Jul 03 09:45:08.900317 np0000004400 cinder-backup[101319]: } Jul 03 09:45:08.900317 np0000004400 cinder-backup[101319]: }, Jul 03 09:45:08.900317 np0000004400 cinder-backup[101319]: { Jul 03 09:45:08.900317 np0000004400 cinder-backup[101319]: "volume_b9d43525-b482-4d2d-8541-23ede348708e/20260703094447/az_nova_backup_a636aad8-67e3-4daa-ac42-7179916eefe7-00012": { Jul 03 09:45:08.900317 np0000004400 cinder-backup[101319]: "compression": "zlib", Jul 03 09:45:08.900317 np0000004400 cinder-backup[101319]: "length": 52428800, Jul 03 09:45:08.900317 np0000004400 cinder-backup[101319]: "md5": "25e317773f308e446cc84c503a6d1f85", Jul 03 09:45:08.900317 np0000004400 cinder-backup[101319]: "offset": 576716800 Jul 03 09:45:08.900317 np0000004400 cinder-backup[101319]: } Jul 03 09:45:08.900317 np0000004400 cinder-backup[101319]: }, Jul 03 09:45:08.900317 np0000004400 cinder-backup[101319]: { Jul 03 09:45:08.900317 np0000004400 cinder-backup[101319]: "volume_b9d43525-b482-4d2d-8541-23ede348708e/20260703094447/az_nova_backup_a636aad8-67e3-4daa-ac42-7179916eefe7-00013": { Jul 03 09:45:08.900317 np0000004400 cinder-backup[101319]: "compression": "zlib", Jul 03 09:45:08.900317 np0000004400 cinder-backup[101319]: "length": 52428800, Jul 03 09:45:08.900317 np0000004400 cinder-backup[101319]: "md5": "25e317773f308e446cc84c503a6d1f85", Jul 03 09:45:08.900317 np0000004400 cinder-backup[101319]: "offset": 629145600 Jul 03 09:45:08.900317 np0000004400 cinder-backup[101319]: } Jul 03 09:45:08.900317 np0000004400 cinder-backup[101319]: }, Jul 03 09:45:08.900317 np0000004400 cinder-backup[101319]: { Jul 03 09:45:08.900317 np0000004400 cinder-backup[101319]: "volume_b9d43525-b482-4d2d-8541-23ede348708e/20260703094447/az_nova_backup_a636aad8-67e3-4daa-ac42-7179916eefe7-00014": { Jul 03 09:45:08.900317 np0000004400 cinder-backup[101319]: "compression": "zlib", Jul 03 09:45:08.900317 np0000004400 cinder-backup[101319]: "length": 52428800, Jul 03 09:45:08.900317 np0000004400 cinder-backup[101319]: "md5": "25e317773f308e446cc84c503a6d1f85", Jul 03 09:45:08.900317 np0000004400 cinder-backup[101319]: "offset": 681574400 Jul 03 09:45:08.900317 np0000004400 cinder-backup[101319]: } Jul 03 09:45:08.900317 np0000004400 cinder-backup[101319]: }, Jul 03 09:45:08.900317 np0000004400 cinder-backup[101319]: { Jul 03 09:45:08.900317 np0000004400 cinder-backup[101319]: "volume_b9d43525-b482-4d2d-8541-23ede348708e/20260703094447/az_nova_backup_a636aad8-67e3-4daa-ac42-7179916eefe7-00015": { Jul 03 09:45:08.900317 np0000004400 cinder-backup[101319]: "compression": "zlib", Jul 03 09:45:08.900317 np0000004400 cinder-backup[101319]: "length": 52428800, Jul 03 09:45:08.900317 np0000004400 cinder-backup[101319]: "md5": "25e317773f308e446cc84c503a6d1f85", Jul 03 09:45:08.900317 np0000004400 cinder-backup[101319]: "offset": 734003200 Jul 03 09:45:08.900317 np0000004400 cinder-backup[101319]: } Jul 03 09:45:08.900317 np0000004400 cinder-backup[101319]: }, Jul 03 09:45:08.900317 np0000004400 cinder-backup[101319]: { Jul 03 09:45:08.900317 np0000004400 cinder-backup[101319]: "volume_b9d43525-b482-4d2d-8541-23ede348708e/20260703094447/az_nova_backup_a636aad8-67e3-4daa-ac42-7179916eefe7-00016": { Jul 03 09:45:08.900317 np0000004400 cinder-backup[101319]: "compression": "zlib", Jul 03 09:45:08.900317 np0000004400 cinder-backup[101319]: "length": 52428800, Jul 03 09:45:08.900317 np0000004400 cinder-backup[101319]: "md5": "25e317773f308e446cc84c503a6d1f85", Jul 03 09:45:08.900317 np0000004400 cinder-backup[101319]: "offset": 786432000 Jul 03 09:45:08.900317 np0000004400 cinder-backup[101319]: } Jul 03 09:45:08.900317 np0000004400 cinder-backup[101319]: }, Jul 03 09:45:08.900317 np0000004400 cinder-backup[101319]: { Jul 03 09:45:08.900317 np0000004400 cinder-backup[101319]: "volume_b9d43525-b482-4d2d-8541-23ede348708e/20260703094447/az_nova_backup_a636aad8-67e3-4daa-ac42-7179916eefe7-00017": { Jul 03 09:45:08.900317 np0000004400 cinder-backup[101319]: "compression": "zlib", Jul 03 09:45:08.900317 np0000004400 cinder-backup[101319]: "length": 52428800, Jul 03 09:45:08.900317 np0000004400 cinder-backup[101319]: "md5": "25e317773f308e446cc84c503a6d1f85", Jul 03 09:45:08.900317 np0000004400 cinder-backup[101319]: "offset": 838860800 Jul 03 09:45:08.900317 np0000004400 cinder-backup[101319]: } Jul 03 09:45:08.900317 np0000004400 cinder-backup[101319]: }, Jul 03 09:45:08.900317 np0000004400 cinder-backup[101319]: { Jul 03 09:45:08.900317 np0000004400 cinder-backup[101319]: "volume_b9d43525-b482-4d2d-8541-23ede348708e/20260703094447/az_nova_backup_a636aad8-67e3-4daa-ac42-7179916eefe7-00018": { Jul 03 09:45:08.900317 np0000004400 cinder-backup[101319]: "compression": "zlib", Jul 03 09:45:08.900317 np0000004400 cinder-backup[101319]: "length": 52428800, Jul 03 09:45:08.900317 np0000004400 cinder-backup[101319]: "md5": "25e317773f308e446cc84c503a6d1f85", Jul 03 09:45:08.900317 np0000004400 cinder-backup[101319]: "offset": 891289600 Jul 03 09:45:08.900317 np0000004400 cinder-backup[101319]: } Jul 03 09:45:08.900317 np0000004400 cinder-backup[101319]: }, Jul 03 09:45:08.900317 np0000004400 cinder-backup[101319]: { Jul 03 09:45:08.900317 np0000004400 cinder-backup[101319]: "volume_b9d43525-b482-4d2d-8541-23ede348708e/20260703094447/az_nova_backup_a636aad8-67e3-4daa-ac42-7179916eefe7-00019": { Jul 03 09:45:08.900317 np0000004400 cinder-backup[101319]: "compression": "zlib", Jul 03 09:45:08.900317 np0000004400 cinder-backup[101319]: "length": 52428800, Jul 03 09:45:08.900317 np0000004400 cinder-backup[101319]: "md5": "25e317773f308e446cc84c503a6d1f85", Jul 03 09:45:08.900317 np0000004400 cinder-backup[101319]: "offset": 943718400 Jul 03 09:45:08.900317 np0000004400 cinder-backup[101319]: } Jul 03 09:45:08.900317 np0000004400 cinder-backup[101319]: }, Jul 03 09:45:08.900317 np0000004400 cinder-backup[101319]: { Jul 03 09:45:08.900317 np0000004400 cinder-backup[101319]: "volume_b9d43525-b482-4d2d-8541-23ede348708e/20260703094447/az_nova_backup_a636aad8-67e3-4daa-ac42-7179916eefe7-00020": { Jul 03 09:45:08.900317 np0000004400 cinder-backup[101319]: "compression": "zlib", Jul 03 09:45:08.900317 np0000004400 cinder-backup[101319]: "length": 52428800, Jul 03 09:45:08.900317 np0000004400 cinder-backup[101319]: "md5": "25e317773f308e446cc84c503a6d1f85", Jul 03 09:45:08.900317 np0000004400 cinder-backup[101319]: "offset": 996147200 Jul 03 09:45:08.900317 np0000004400 cinder-backup[101319]: } Jul 03 09:45:08.900317 np0000004400 cinder-backup[101319]: }, Jul 03 09:45:08.900317 np0000004400 cinder-backup[101319]: { Jul 03 09:45:08.900317 np0000004400 cinder-backup[101319]: "volume_b9d43525-b482-4d2d-8541-23ede348708e/20260703094447/az_nova_backup_a636aad8-67e3-4daa-ac42-7179916eefe7-00021": { Jul 03 09:45:08.900317 np0000004400 cinder-backup[101319]: "compression": "zlib", Jul 03 09:45:08.900317 np0000004400 cinder-backup[101319]: "length": 25165824, Jul 03 09:45:08.900317 np0000004400 cinder-backup[101319]: "md5": "77377273b0a4b61febdbf7bbf52b9db9", Jul 03 09:45:08.900317 np0000004400 cinder-backup[101319]: "offset": 1048576000 Jul 03 09:45:08.900317 np0000004400 cinder-backup[101319]: } Jul 03 09:45:08.900317 np0000004400 cinder-backup[101319]: } Jul 03 09:45:08.900317 np0000004400 cinder-backup[101319]: ], Jul 03 09:45:08.900317 np0000004400 cinder-backup[101319]: "parent_id": null, Jul 03 09:45:08.900317 np0000004400 cinder-backup[101319]: "version": "1.0.0", Jul 03 09:45:08.900317 np0000004400 cinder-backup[101319]: "volume_id": "b9d43525-b482-4d2d-8541-23ede348708e", Jul 03 09:45:08.900317 np0000004400 cinder-backup[101319]: "volume_meta": "{\"version\": 2, \"volume-base-metadata\": {\"id\": \"b9d43525-b482-4d2d-8541-23ede348708e\", \"_name_id\": null, \"use_quota\": true, \"ec2_id\": null, \"user_id\": \"91463b6c437c4711a49d3c31c513a101\", \"project_id\": \"59044e18a5b24b19a7b9b8a380f2e1a0\", \"snapshot_id\": null, \"cluster_name\": null, \"host\": \"np0000004400@storpool#default\", \"size\": 1, \"availability_zone\": \"nova\", \"status\": \"backing-up\", \"attach_status\": \"detached\", \"migration_status\": null, \"scheduled_at\": \"2026-07-03T09:44:40.000000\", \"launched_at\": \"2026-07-03T09:44:40.000000\", \"terminated_at\": null, \"display_name\": \"tempest-VolumesBackupsTest-Volume-2079726756\", \"display_description\": null, \"provider_location\": null, \"provider_auth\": null, \"provider_geometry\": null, \"provider_id\": null, \"volume_type_id\": \"03e13fe6-0e30-4803-ace0-725d38e6dc24\", \"source_volid\": null, \"encryption_key_id\": null, \"consistencygroup_id\": null, \"group_id\": null, \"bootable\": true, \"multiattach\": false, \"replication_status\": null, \"replication_extended_status\": null, \"replication_driver_data\": null, \"previous_status\": \"available\", \"service_uuid\": \"6d4b0e79-fefe-4744-b25f-34be05095200\", \"shared_targets\": true, \"deleted_at\": null, \"deleted\": false, \"created_at\": \"2026-07-03T09:44:40.000000\", \"updated_at\": \"2026-07-03T09:44:41.000000\"}, \"volume-glance-metadata\": {\"hw_rng_model\": \"virtio\", \"os_glance_failed_import\": \"\", \"os_glance_importing_to_stores\": \"\", \"owner_specified.openstack.md5\": \"\", \"owner_specified.openstack.object\": \"images/cirros-0.6.3-x86_64-disk\", \"owner_specified.openstack.sha256\": \"\", \"image_id\": \"c1946dda-7935-4a75-a25a-cf65d1d25617\", \"image_name\": \"cirros-0.6.3-x86_64-disk\", \"checksum\": \"87617e24a5e30cb3b87fda8c0764838f\", \"container_format\": \"bare\", \"disk_format\": \"qcow2\", \"min_disk\": \"0\", \"min_ram\": \"0\", \"size\": \"21692416\"}}" Jul 03 09:45:08.900317 np0000004400 cinder-backup[101319]: }. {{(pid=101319) _read_metadata /opt/stack/cinder/cinder/backup/chunkeddriver.py:327}} Jul 03 09:45:08.904883 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-5b578e84-b5bc-4a14-9ad7-6bb3bd07d595 tempest-VolumesBackupsTest-2142009639 None] v1 volume backup restore of a636aad8-67e3-4daa-ac42-7179916eefe7 started. {{(pid=101319) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:678}} Jul 03 09:45:08.904883 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-5b578e84-b5bc-4a14-9ad7-6bb3bd07d595 tempest-VolumesBackupsTest-2142009639 None] metadata_object_names = ['volume_b9d43525-b482-4d2d-8541-23ede348708e/20260703094447/az_nova_backup_a636aad8-67e3-4daa-ac42-7179916eefe7-00001', 'volume_b9d43525-b482-4d2d-8541-23ede348708e/20260703094447/az_nova_backup_a636aad8-67e3-4daa-ac42-7179916eefe7-00002', 'volume_b9d43525-b482-4d2d-8541-23ede348708e/20260703094447/az_nova_backup_a636aad8-67e3-4daa-ac42-7179916eefe7-00003', 'volume_b9d43525-b482-4d2d-8541-23ede348708e/20260703094447/az_nova_backup_a636aad8-67e3-4daa-ac42-7179916eefe7-00004', 'volume_b9d43525-b482-4d2d-8541-23ede348708e/20260703094447/az_nova_backup_a636aad8-67e3-4daa-ac42-7179916eefe7-00005', 'volume_b9d43525-b482-4d2d-8541-23ede348708e/20260703094447/az_nova_backup_a636aad8-67e3-4daa-ac42-7179916eefe7-00006', 'volume_b9d43525-b482-4d2d-8541-23ede348708e/20260703094447/az_nova_backup_a636aad8-67e3-4daa-ac42-7179916eefe7-00007', 'volume_b9d43525-b482-4d2d-8541-23ede348708e/20260703094447/az_nova_backup_a636aad8-67e3-4daa-ac42-7179916eefe7-00008', 'volume_b9d43525-b482-4d2d-8541-23ede348708e/20260703094447/az_nova_backup_a636aad8-67e3-4daa-ac42-7179916eefe7-00009', 'volume_b9d43525-b482-4d2d-8541-23ede348708e/20260703094447/az_nova_backup_a636aad8-67e3-4daa-ac42-7179916eefe7-00010', 'volume_b9d43525-b482-4d2d-8541-23ede348708e/20260703094447/az_nova_backup_a636aad8-67e3-4daa-ac42-7179916eefe7-00011', 'volume_b9d43525-b482-4d2d-8541-23ede348708e/20260703094447/az_nova_backup_a636aad8-67e3-4daa-ac42-7179916eefe7-00012', 'volume_b9d43525-b482-4d2d-8541-23ede348708e/20260703094447/az_nova_backup_a636aad8-67e3-4daa-ac42-7179916eefe7-00013', 'volume_b9d43525-b482-4d2d-8541-23ede348708e/20260703094447/az_nova_backup_a636aad8-67e3-4daa-ac42-7179916eefe7-00014', 'volume_b9d43525-b482-4d2d-8541-23ede348708e/20260703094447/az_nova_backup_a636aad8-67e3-4daa-ac42-7179916eefe7-00015', 'volume_b9d43525-b482-4d2d-8541-23ede348708e/20260703094447/az_nova_backup_a636aad8-67e3-4daa-ac42-7179916eefe7-00016', 'volume_b9d43525-b482-4d2d-8541-23ede348708e/20260703094447/az_nova_backup_a636aad8-67e3-4daa-ac42-7179916eefe7-00017', 'volume_b9d43525-b482-4d2d-8541-23ede348708e/20260703094447/az_nova_backup_a636aad8-67e3-4daa-ac42-7179916eefe7-00018', 'volume_b9d43525-b482-4d2d-8541-23ede348708e/20260703094447/az_nova_backup_a636aad8-67e3-4daa-ac42-7179916eefe7-00019', 'volume_b9d43525-b482-4d2d-8541-23ede348708e/20260703094447/az_nova_backup_a636aad8-67e3-4daa-ac42-7179916eefe7-00020', 'volume_b9d43525-b482-4d2d-8541-23ede348708e/20260703094447/az_nova_backup_a636aad8-67e3-4daa-ac42-7179916eefe7-00021']. {{(pid=101319) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:685}} Jul 03 09:45:08.951487 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-5b578e84-b5bc-4a14-9ad7-6bb3bd07d595 tempest-VolumesBackupsTest-2142009639 None] generated object list: ['volume_b9d43525-b482-4d2d-8541-23ede348708e/20260703094447/az_nova_backup_a636aad8-67e3-4daa-ac42-7179916eefe7-00001', 'volume_b9d43525-b482-4d2d-8541-23ede348708e/20260703094447/az_nova_backup_a636aad8-67e3-4daa-ac42-7179916eefe7-00002', 'volume_b9d43525-b482-4d2d-8541-23ede348708e/20260703094447/az_nova_backup_a636aad8-67e3-4daa-ac42-7179916eefe7-00003', 'volume_b9d43525-b482-4d2d-8541-23ede348708e/20260703094447/az_nova_backup_a636aad8-67e3-4daa-ac42-7179916eefe7-00004', 'volume_b9d43525-b482-4d2d-8541-23ede348708e/20260703094447/az_nova_backup_a636aad8-67e3-4daa-ac42-7179916eefe7-00005', 'volume_b9d43525-b482-4d2d-8541-23ede348708e/20260703094447/az_nova_backup_a636aad8-67e3-4daa-ac42-7179916eefe7-00006', 'volume_b9d43525-b482-4d2d-8541-23ede348708e/20260703094447/az_nova_backup_a636aad8-67e3-4daa-ac42-7179916eefe7-00007', 'volume_b9d43525-b482-4d2d-8541-23ede348708e/20260703094447/az_nova_backup_a636aad8-67e3-4daa-ac42-7179916eefe7-00008', 'volume_b9d43525-b482-4d2d-8541-23ede348708e/20260703094447/az_nova_backup_a636aad8-67e3-4daa-ac42-7179916eefe7-00009', 'volume_b9d43525-b482-4d2d-8541-23ede348708e/20260703094447/az_nova_backup_a636aad8-67e3-4daa-ac42-7179916eefe7-00010', 'volume_b9d43525-b482-4d2d-8541-23ede348708e/20260703094447/az_nova_backup_a636aad8-67e3-4daa-ac42-7179916eefe7-00011', 'volume_b9d43525-b482-4d2d-8541-23ede348708e/20260703094447/az_nova_backup_a636aad8-67e3-4daa-ac42-7179916eefe7-00012', 'volume_b9d43525-b482-4d2d-8541-23ede348708e/20260703094447/az_nova_backup_a636aad8-67e3-4daa-ac42-7179916eefe7-00013', 'volume_b9d43525-b482-4d2d-8541-23ede348708e/20260703094447/az_nova_backup_a636aad8-67e3-4daa-ac42-7179916eefe7-00014', 'volume_b9d43525-b482-4d2d-8541-23ede348708e/20260703094447/az_nova_backup_a636aad8-67e3-4daa-ac42-7179916eefe7-00015', 'volume_b9d43525-b482-4d2d-8541-23ede348708e/20260703094447/az_nova_backup_a636aad8-67e3-4daa-ac42-7179916eefe7-00016', 'volume_b9d43525-b482-4d2d-8541-23ede348708e/20260703094447/az_nova_backup_a636aad8-67e3-4daa-ac42-7179916eefe7-00017', 'volume_b9d43525-b482-4d2d-8541-23ede348708e/20260703094447/az_nova_backup_a636aad8-67e3-4daa-ac42-7179916eefe7-00018', 'volume_b9d43525-b482-4d2d-8541-23ede348708e/20260703094447/az_nova_backup_a636aad8-67e3-4daa-ac42-7179916eefe7-00019', 'volume_b9d43525-b482-4d2d-8541-23ede348708e/20260703094447/az_nova_backup_a636aad8-67e3-4daa-ac42-7179916eefe7-00020', 'volume_b9d43525-b482-4d2d-8541-23ede348708e/20260703094447/az_nova_backup_a636aad8-67e3-4daa-ac42-7179916eefe7-00021', 'volume_b9d43525-b482-4d2d-8541-23ede348708e/20260703094447/az_nova_backup_a636aad8-67e3-4daa-ac42-7179916eefe7_metadata', 'volume_b9d43525-b482-4d2d-8541-23ede348708e/20260703094447/az_nova_backup_a636aad8-67e3-4daa-ac42-7179916eefe7_sha256file']. {{(pid=101319) _generate_object_names /opt/stack/cinder/cinder/backup/chunkeddriver.py:260}} Jul 03 09:45:08.955609 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-5b578e84-b5bc-4a14-9ad7-6bb3bd07d595 tempest-VolumesBackupsTest-2142009639 None] restoring object. backup: a636aad8-67e3-4daa-ac42-7179916eefe7, container: tempest-volumesbackupstest-backup-container-313960817, object name: volume_b9d43525-b482-4d2d-8541-23ede348708e/20260703094447/az_nova_backup_a636aad8-67e3-4daa-ac42-7179916eefe7-00001, volume: d416aa2d-9214-4dcb-ba7c-32b834c4d794. {{(pid=101319) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:705}} Jul 03 09:45:08.958107 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-1b52199c-010f-4d91-967a-441d98ec32e0 tempest-VolumesBackupsTest-118275719 None] _write_sha256file finished. {{(pid=101319) _write_sha256file /opt/stack/cinder/cinder/backup/chunkeddriver.py:315}} Jul 03 09:45:08.958710 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-1b52199c-010f-4d91-967a-441d98ec32e0 tempest-VolumesBackupsTest-118275719 None] _write_metadata started, container name: volumebackups, metadata filename: volume_b86cbab3-7c42-409e-b4f6-0ed61267a031/20260703094455/az_nova_backup_3087847d-58e1-4a0c-af9c-2639ae9f2aeb_metadata. {{(pid=101319) _write_metadata /opt/stack/cinder/cinder/backup/chunkeddriver.py:276}} Jul 03 09:45:09.041459 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-5b578e84-b5bc-4a14-9ad7-6bb3bd07d595 tempest-VolumesBackupsTest-2142009639 None] decompressing data using zlib algorithm {{(pid=101319) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:722}} Jul 03 09:45:09.048253 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-1b52199c-010f-4d91-967a-441d98ec32e0 tempest-VolumesBackupsTest-118275719 None] _write_metadata finished. Metadata: b'{\n "backup_description": null,\n "backup_id": "3087847d-58e1-4a0c-af9c-2639ae9f2aeb",\n "backup_name": "tempest-VolumesBackupsTest-Backup-2010155406",\n "created_at": "2026-07-03 09:44:53+00:00",\n "objects": [\n {\n "volume_b86cbab3-7c42-409e-b4f6-0ed61267a031/20260703094455/az_nova_backup_3087847d-58e1-4a0c-af9c-2639ae9f2aeb-00001": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 0\n }\n },\n {\n "volume_b86cbab3-7c42-409e-b4f6-0ed61267a031/20260703094455/az_nova_backup_3087847d-58e1-4a0c-af9c-2639ae9f2aeb-00002": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 52428800\n }\n },\n {\n "volume_b86cbab3-7c42-409e-b4f6-0ed61267a031/20260703094455/az_nova_backup_3087847d-58e1-4a0c-af9c-2639ae9f2aeb-00003": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 104857600\n }\n },\n {\n "volume_b86cbab3-7c42-409e-b4f6-0ed61267a031/20260703094455/az_nova_backup_3087847d-58e1-4a0c-af9c-2639ae9f2aeb-00004": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 157286400\n }\n },\n {\n "volume_b86cbab3-7c42-409e-b4f6-0ed61267a031/20260703094455/az_nova_backup_3087847d-58e1-4a0c-af9c-2639ae9f2aeb-00005": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 209715200\n }\n },\n {\n "volume_b86cbab3-7c42-409e-b4f6-0ed61267a031/20260703094455/az_nova_backup_3087847d-58e1-4a0c-af9c-2639ae9f2aeb-00006": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 262144000\n }\n },\n {\n "volume_b86cbab3-7c42-409e-b4f6-0ed61267a031/20260703094455/az_nova_backup_3087847d-58e1-4a0c-af9c-2639ae9f2aeb-00007": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 314572800\n }\n },\n {\n "volume_b86cbab3-7c42-409e-b4f6-0ed61267a031/20260703094455/az_nova_backup_3087847d-58e1-4a0c-af9c-2639ae9f2aeb-00008": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 367001600\n }\n },\n {\n "volume_b86cbab3-7c42-409e-b4f6-0ed61267a031/20260703094455/az_nova_backup_3087847d-58e1-4a0c-af9c-2639ae9f2aeb-00009": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 419430400\n }\n },\n {\n "volume_b86cbab3-7c42-409e-b4f6-0ed61267a031/20260703094455/az_nova_backup_3087847d-58e1-4a0c-af9c-2639ae9f2aeb-00010": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 471859200\n }\n },\n {\n "volume_b86cbab3-7c42-409e-b4f6-0ed61267a031/20260703094455/az_nova_backup_3087847d-58e1-4a0c-af9c-2639ae9f2aeb-00011": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 524288000\n }\n },\n {\n "volume_b86cbab3-7c42-409e-b4f6-0ed61267a031/20260703094455/az_nova_backup_3087847d-58e1-4a0c-af9c-2639ae9f2aeb-00012": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 576716800\n }\n },\n {\n "volume_b86cbab3-7c42-409e-b4f6-0ed61267a031/20260703094455/az_nova_backup_3087847d-58e1-4a0c-af9c-2639ae9f2aeb-00013": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 629145600\n }\n },\n {\n "volume_b86cbab3-7c42-409e-b4f6-0ed61267a031/20260703094455/az_nova_backup_3087847d-58e1-4a0c-af9c-2639ae9f2aeb-00014": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 681574400\n }\n },\n {\n "volume_b86cbab3-7c42-409e-b4f6-0ed61267a031/20260703094455/az_nova_backup_3087847d-58e1-4a0c-af9c-2639ae9f2aeb-00015": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 734003200\n }\n },\n {\n "volume_b86cbab3-7c42-409e-b4f6-0ed61267a031/20260703094455/az_nova_backup_3087847d-58e1-4a0c-af9c-2639ae9f2aeb-00016": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 786432000\n }\n },\n {\n "volume_b86cbab3-7c42-409e-b4f6-0ed61267a031/20260703094455/az_nova_backup_3087847d-58e1-4a0c-af9c-2639ae9f2aeb-00017": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 838860800\n }\n },\n {\n "volume_b86cbab3-7c42-409e-b4f6-0ed61267a031/20260703094455/az_nova_backup_3087847d-58e1-4a0c-af9c-2639ae9f2aeb-00018": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 891289600\n }\n },\n {\n "volume_b86cbab3-7c42-409e-b4f6-0ed61267a031/20260703094455/az_nova_backup_3087847d-58e1-4a0c-af9c-2639ae9f2aeb-00019": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 943718400\n }\n },\n {\n "volume_b86cbab3-7c42-409e-b4f6-0ed61267a031/20260703094455/az_nova_backup_3087847d-58e1-4a0c-af9c-2639ae9f2aeb-00020": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 996147200\n }\n },\n {\n "volume_b86cbab3-7c42-409e-b4f6-0ed61267a031/20260703094455/az_nova_backup_3087847d-58e1-4a0c-af9c-2639ae9f2aeb-00021": {\n "compression": "zlib",\n "length": 25165824,\n "md5": "77377273b0a4b61febdbf7bbf52b9db9",\n "offset": 1048576000\n }\n }\n ],\n "parent_id": null,\n "version": "1.0.0",\n "volume_id": "b86cbab3-7c42-409e-b4f6-0ed61267a031",\n "volume_meta": "{\\"version\\": 2, \\"volume-base-metadata\\": {\\"id\\": \\"b86cbab3-7c42-409e-b4f6-0ed61267a031\\", \\"_name_id\\": null, \\"use_quota\\": true, \\"ec2_id\\": null, \\"user_id\\": \\"b861df2a13684334b293b1f348152e37\\", \\"project_id\\": \\"a484ec9218bf417bb9d7575ae6370646\\", \\"snapshot_id\\": null, \\"cluster_name\\": null, \\"host\\": \\"np0000004400@storpool#default\\", \\"size\\": 1, \\"availability_zone\\": \\"nova\\", \\"status\\": \\"backing-up\\", \\"attach_status\\": \\"detached\\", \\"migration_status\\": null, \\"scheduled_at\\": \\"2026-07-03T09:44:52.000000\\", \\"launched_at\\": \\"2026-07-03T09:44:52.000000\\", \\"terminated_at\\": null, \\"display_name\\": \\"tempest-VolumesBackupsTest-Volume-504009765\\", \\"display_description\\": null, \\"provider_location\\": null, \\"provider_auth\\": null, \\"provider_geometry\\": null, \\"provider_id\\": null, \\"volume_type_id\\": \\"03e13fe6-0e30-4803-ace0-725d38e6dc24\\", \\"source_volid\\": null, \\"encryption_key_id\\": null, \\"consistencygroup_id\\": null, \\"group_id\\": null, \\"bootable\\": false, \\"multiattach\\": false, \\"replication_status\\": null, \\"replication_extended_status\\": null, \\"replication_driver_data\\": null, \\"previous_status\\": \\"available\\", \\"service_uuid\\": \\"6d4b0e79-fefe-4744-b25f-34be05095200\\", \\"shared_targets\\": true, \\"deleted_at\\": null, \\"deleted\\": false, \\"created_at\\": \\"2026-07-03T09:44:51.000000\\", \\"updated_at\\": \\"2026-07-03T09:44:53.000000\\"}}"\n}'. {{(pid=101319) _write_metadata /opt/stack/cinder/cinder/backup/chunkeddriver.py:295}} Jul 03 09:45:09.055675 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-1b52199c-010f-4d91-967a-441d98ec32e0 tempest-VolumesBackupsTest-118275719 None] backup 3087847d-58e1-4a0c-af9c-2639ae9f2aeb finished. {{(pid=101319) _finalize_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:462}} Jul 03 09:45:09.177615 np0000004400 cinder-backup[101319]: DEBUG oslo_concurrency.processutils [None req-1b52199c-010f-4d91-967a-441d98ec32e0 tempest-VolumesBackupsTest-118275719 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chown 0 /dev/sdb {{(pid=101319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 09:45:09.189460 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-dd7cebed-c6db-4da9-be53-3cc828012d99 tempest-ProjectAdminTests33-1900627284 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101319) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 09:45:09.189728 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-dd7cebed-c6db-4da9-be53-3cc828012d99 tempest-ProjectAdminTests33-1900627284 None] About to put_object {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 09:45:09.206778 np0000004400 sudo[136010]: stack : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chown 0 /dev/sdb Jul 03 09:45:09.207579 np0000004400 sudo[136010]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1002) Jul 03 09:45:09.357723 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-dd7cebed-c6db-4da9-be53-3cc828012d99 tempest-ProjectAdminTests33-1900627284 None] backup MD5 for volume_4b68dad5-e9a3-4bd1-84e2-ba745cb7bb83/20260703094505/az_nova_backup_cfdc4925-e984-4da2-aa3e-e1e8a7c37558-00006: 25e317773f308e446cc84c503a6d1f85 {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 09:45:09.357908 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-dd7cebed-c6db-4da9-be53-3cc828012d99 tempest-ProjectAdminTests33-1900627284 None] Calling eventlet.sleep(0) {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 09:45:09.554264 np0000004400 sudo[136010]: pam_unix(sudo:session): session closed for user root Jul 03 09:45:09.558865 np0000004400 cinder-backup[101319]: DEBUG oslo_concurrency.processutils [None req-1b52199c-010f-4d91-967a-441d98ec32e0 tempest-VolumesBackupsTest-118275719 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chown 0 /dev/sdb" returned: 0 in 0.381s {{(pid=101319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 09:45:09.560131 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-1b52199c-010f-4d91-967a-441d98ec32e0 tempest-VolumesBackupsTest-118275719 None] ==> disconnect_volume: call "{'args': (, {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-b86cbab3-7c42-409e-b4f6-0ed61267a031', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'b86cbab3-7c42-409e-b4f6-0ed61267a031', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': False}, {'type': 'block', 'scsi_wwn': '1StorPooliSCSI_DISK_1034578903445799018', 'path': '/dev/sdb'}), 'kwargs': {'force': True, 'ignore_errors': True}}" {{(pid=101319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}} Jul 03 09:45:09.560131 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.base [None req-1b52199c-010f-4d91-967a-441d98ec32e0 tempest-VolumesBackupsTest-118275719 None] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=101319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jul 03 09:45:09.560327 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.base [None req-1b52199c-010f-4d91-967a-441d98ec32e0 tempest-VolumesBackupsTest-118275719 None] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=101319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jul 03 09:45:09.560707 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-1b52199c-010f-4d91-967a-441d98ec32e0 tempest-VolumesBackupsTest-118275719 None] _get_connection_devices called with parameters: connection_properties={'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-b86cbab3-7c42-409e-b4f6-0ed61267a031', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'b86cbab3-7c42-409e-b4f6-0ed61267a031', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': False}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=101319) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:847}} Jul 03 09:45:09.572783 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-5b578e84-b5bc-4a14-9ad7-6bb3bd07d595 tempest-VolumesBackupsTest-2142009639 None] restoring object. backup: a636aad8-67e3-4daa-ac42-7179916eefe7, container: tempest-volumesbackupstest-backup-container-313960817, object name: volume_b9d43525-b482-4d2d-8541-23ede348708e/20260703094447/az_nova_backup_a636aad8-67e3-4daa-ac42-7179916eefe7-00002, volume: d416aa2d-9214-4dcb-ba7c-32b834c4d794. {{(pid=101319) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:705}} Jul 03 09:45:09.576111 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-1b52199c-010f-4d91-967a-441d98ec32e0 tempest-VolumesBackupsTest-118275719 None] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS: Jul 03 09:45:09.576111 np0000004400 cinder-backup[101319]: No targets found. Jul 03 09:45:09.576111 np0000004400 cinder-backup[101319]: iSNS: Jul 03 09:45:09.576111 np0000004400 cinder-backup[101319]: No targets found. Jul 03 09:45:09.576111 np0000004400 cinder-backup[101319]: STATIC: Jul 03 09:45:09.576111 np0000004400 cinder-backup[101319]: Target: iqn.2023-03.storpool.com:os--volume-aecd73f6-86c7-4ae8-8bfa-b46655eb6efb Jul 03 09:45:09.576111 np0000004400 cinder-backup[101319]: Portal: 192.168.50.100:3260,-1 Jul 03 09:45:09.576111 np0000004400 cinder-backup[101319]: Iface Name: default Jul 03 09:45:09.576111 np0000004400 cinder-backup[101319]: Portal: 192.168.40.100:3260,-1 Jul 03 09:45:09.576111 np0000004400 cinder-backup[101319]: Iface Name: default Jul 03 09:45:09.576111 np0000004400 cinder-backup[101319]: Target: iqn.2023-03.storpool.com:os--volume-b86cbab3-7c42-409e-b4f6-0ed61267a031 Jul 03 09:45:09.576111 np0000004400 cinder-backup[101319]: Portal: 192.168.40.100:3260,-1 Jul 03 09:45:09.576111 np0000004400 cinder-backup[101319]: Iface Name: default Jul 03 09:45:09.576111 np0000004400 cinder-backup[101319]: Target: iqn.2023-03.storpool.com:os--volume-76320525-737e-4f58-8523-63ec9abbdc64 Jul 03 09:45:09.576111 np0000004400 cinder-backup[101319]: Portal: 192.168.50.100:3260,-1 Jul 03 09:45:09.576111 np0000004400 cinder-backup[101319]: Iface Name: default Jul 03 09:45:09.576111 np0000004400 cinder-backup[101319]: Portal: 192.168.40.100:3260,-1 Jul 03 09:45:09.576111 np0000004400 cinder-backup[101319]: Iface Name: default Jul 03 09:45:09.576111 np0000004400 cinder-backup[101319]: Target: iqn.2023-03.storpool.com:os--volume-b2e4f10c-8033-4c54-95a1-dfe45d6357a3 Jul 03 09:45:09.576111 np0000004400 cinder-backup[101319]: Portal: 192.168.50.100:3260,-1 Jul 03 09:45:09.576111 np0000004400 cinder-backup[101319]: Iface Name: default Jul 03 09:45:09.576111 np0000004400 cinder-backup[101319]: Portal: 192.168.40.100:3260,-1 Jul 03 09:45:09.576111 np0000004400 cinder-backup[101319]: Iface Name: default Jul 03 09:45:09.576111 np0000004400 cinder-backup[101319]: Target: iqn.2023-03.storpool.com:os--volume-4b68dad5-e9a3-4bd1-84e2-ba745cb7bb83 Jul 03 09:45:09.576111 np0000004400 cinder-backup[101319]: Portal: 192.168.40.100:3260,-1 Jul 03 09:45:09.576111 np0000004400 cinder-backup[101319]: Iface Name: default Jul 03 09:45:09.576111 np0000004400 cinder-backup[101319]: Target: iqn.2023-03.storpool.com:os--volume-8c32af3e-9a59-44d2-8663-514226151ed2 Jul 03 09:45:09.576111 np0000004400 cinder-backup[101319]: Portal: 192.168.50.100:3260,-1 Jul 03 09:45:09.576111 np0000004400 cinder-backup[101319]: Iface Name: default Jul 03 09:45:09.576111 np0000004400 cinder-backup[101319]: Portal: 192.168.40.100:3260,-1 Jul 03 09:45:09.576111 np0000004400 cinder-backup[101319]: Iface Name: default Jul 03 09:45:09.576111 np0000004400 cinder-backup[101319]: Target: iqn.2023-03.storpool.com:os--volume-d47f5d2f-dce5-42f7-a693-a654fd702622 Jul 03 09:45:09.576111 np0000004400 cinder-backup[101319]: Portal: 192.168.50.100:3260,-1 Jul 03 09:45:09.576111 np0000004400 cinder-backup[101319]: Iface Name: default Jul 03 09:45:09.576111 np0000004400 cinder-backup[101319]: Portal: 192.168.40.100:3260,-1 Jul 03 09:45:09.576111 np0000004400 cinder-backup[101319]: Iface Name: default Jul 03 09:45:09.576111 np0000004400 cinder-backup[101319]: Target: iqn.2023-03.storpool.com:os--volume-d416aa2d-9214-4dcb-ba7c-32b834c4d794 Jul 03 09:45:09.576111 np0000004400 cinder-backup[101319]: Portal: 192.168.40.100:3260,-1 Jul 03 09:45:09.576111 np0000004400 cinder-backup[101319]: Iface Name: default Jul 03 09:45:09.576111 np0000004400 cinder-backup[101319]: Target: iqn.2023-03.storpool.com:os--volume-dc2d662f-bc12-4338-8e3d-6565f72ba808 Jul 03 09:45:09.576111 np0000004400 cinder-backup[101319]: Portal: 192.168.50.100:3260,-1 Jul 03 09:45:09.576111 np0000004400 cinder-backup[101319]: Iface Name: default Jul 03 09:45:09.576111 np0000004400 cinder-backup[101319]: Portal: 192.168.40.100:3260,-1 Jul 03 09:45:09.576111 np0000004400 cinder-backup[101319]: Iface Name: default Jul 03 09:45:09.576111 np0000004400 cinder-backup[101319]: FIRMWARE: Jul 03 09:45:09.576111 np0000004400 cinder-backup[101319]: No targets found. Jul 03 09:45:09.576111 np0000004400 cinder-backup[101319]: stderr= {{(pid=101319) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jul 03 09:45:09.577325 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-1b52199c-010f-4d91-967a-441d98ec32e0 tempest-VolumesBackupsTest-118275719 None] Regex to get portals from discoverydb: ^SENDTARGETS: Jul 03 09:45:09.577325 np0000004400 cinder-backup[101319]: .*?^DiscoveryAddress: 192.168.40.100,3260.*? Jul 03 09:45:09.577325 np0000004400 cinder-backup[101319]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=101319) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:390}} Jul 03 09:45:09.579600 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-1b52199c-010f-4d91-967a-441d98ec32e0 tempest-VolumesBackupsTest-118275719 None] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-b86cbab3-7c42-409e-b4f6-0ed61267a031', 0)] {{(pid=101319) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:858}} Jul 03 09:45:09.591976 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-5b578e84-b5bc-4a14-9ad7-6bb3bd07d595 tempest-VolumesBackupsTest-2142009639 None] decompressing data using zlib algorithm {{(pid=101319) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:722}} Jul 03 09:45:09.615629 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-dd7cebed-c6db-4da9-be53-3cc828012d99 tempest-ProjectAdminTests33-1900627284 None] Backing up chunk of data from volume. {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 09:45:09.622354 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-1b52199c-010f-4d91-967a-441d98ec32e0 tempest-VolumesBackupsTest-118275719 None] iscsiadm ('-m', 'session'): stdout=tcp: [100] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8c32af3e-9a59-44d2-8663-514226151ed2 (non-flash) Jul 03 09:45:09.622354 np0000004400 cinder-backup[101319]: tcp: [101] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-4b68dad5-e9a3-4bd1-84e2-ba745cb7bb83 (non-flash) Jul 03 09:45:09.622354 np0000004400 cinder-backup[101319]: tcp: [102] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d416aa2d-9214-4dcb-ba7c-32b834c4d794 (non-flash) Jul 03 09:45:09.622354 np0000004400 cinder-backup[101319]: tcp: [49] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b2e4f10c-8033-4c54-95a1-dfe45d6357a3 (non-flash) Jul 03 09:45:09.622354 np0000004400 cinder-backup[101319]: tcp: [50] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b2e4f10c-8033-4c54-95a1-dfe45d6357a3 (non-flash) Jul 03 09:45:09.622354 np0000004400 cinder-backup[101319]: tcp: [82] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-76320525-737e-4f58-8523-63ec9abbdc64 (non-flash) Jul 03 09:45:09.622354 np0000004400 cinder-backup[101319]: tcp: [83] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-76320525-737e-4f58-8523-63ec9abbdc64 (non-flash) Jul 03 09:45:09.622354 np0000004400 cinder-backup[101319]: tcp: [87] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-dc2d662f-bc12-4338-8e3d-6565f72ba808 (non-flash) Jul 03 09:45:09.622354 np0000004400 cinder-backup[101319]: tcp: [88] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-dc2d662f-bc12-4338-8e3d-6565f72ba808 (non-flash) Jul 03 09:45:09.622354 np0000004400 cinder-backup[101319]: tcp: [93] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-aecd73f6-86c7-4ae8-8bfa-b46655eb6efb (non-flash) Jul 03 09:45:09.622354 np0000004400 cinder-backup[101319]: tcp: [94] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-aecd73f6-86c7-4ae8-8bfa-b46655eb6efb (non-flash) Jul 03 09:45:09.622354 np0000004400 cinder-backup[101319]: tcp: [96] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b86cbab3-7c42-409e-b4f6-0ed61267a031 (non-flash) Jul 03 09:45:09.622354 np0000004400 cinder-backup[101319]: tcp: [97] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d47f5d2f-dce5-42f7-a693-a654fd702622 (non-flash) Jul 03 09:45:09.622354 np0000004400 cinder-backup[101319]: tcp: [98] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d47f5d2f-dce5-42f7-a693-a654fd702622 (non-flash) Jul 03 09:45:09.622354 np0000004400 cinder-backup[101319]: tcp: [99] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8c32af3e-9a59-44d2-8663-514226151ed2 (non-flash) Jul 03 09:45:09.622354 np0000004400 cinder-backup[101319]: stderr= {{(pid=101319) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jul 03 09:45:09.622748 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-1b52199c-010f-4d91-967a-441d98ec32e0 tempest-VolumesBackupsTest-118275719 None] iscsi session list stdout=tcp: [100] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8c32af3e-9a59-44d2-8663-514226151ed2 (non-flash) Jul 03 09:45:09.622748 np0000004400 cinder-backup[101319]: tcp: [101] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-4b68dad5-e9a3-4bd1-84e2-ba745cb7bb83 (non-flash) Jul 03 09:45:09.622748 np0000004400 cinder-backup[101319]: tcp: [102] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d416aa2d-9214-4dcb-ba7c-32b834c4d794 (non-flash) Jul 03 09:45:09.622748 np0000004400 cinder-backup[101319]: tcp: [49] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b2e4f10c-8033-4c54-95a1-dfe45d6357a3 (non-flash) Jul 03 09:45:09.622748 np0000004400 cinder-backup[101319]: tcp: [50] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b2e4f10c-8033-4c54-95a1-dfe45d6357a3 (non-flash) Jul 03 09:45:09.622748 np0000004400 cinder-backup[101319]: tcp: [82] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-76320525-737e-4f58-8523-63ec9abbdc64 (non-flash) Jul 03 09:45:09.622748 np0000004400 cinder-backup[101319]: tcp: [83] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-76320525-737e-4f58-8523-63ec9abbdc64 (non-flash) Jul 03 09:45:09.622748 np0000004400 cinder-backup[101319]: tcp: [87] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-dc2d662f-bc12-4338-8e3d-6565f72ba808 (non-flash) Jul 03 09:45:09.622748 np0000004400 cinder-backup[101319]: tcp: [88] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-dc2d662f-bc12-4338-8e3d-6565f72ba808 (non-flash) Jul 03 09:45:09.622748 np0000004400 cinder-backup[101319]: tcp: [93] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-aecd73f6-86c7-4ae8-8bfa-b46655eb6efb (non-flash) Jul 03 09:45:09.622748 np0000004400 cinder-backup[101319]: tcp: [94] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-aecd73f6-86c7-4ae8-8bfa-b46655eb6efb (non-flash) Jul 03 09:45:09.622748 np0000004400 cinder-backup[101319]: tcp: [96] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b86cbab3-7c42-409e-b4f6-0ed61267a031 (non-flash) Jul 03 09:45:09.622748 np0000004400 cinder-backup[101319]: tcp: [97] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d47f5d2f-dce5-42f7-a693-a654fd702622 (non-flash) Jul 03 09:45:09.622748 np0000004400 cinder-backup[101319]: tcp: [98] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d47f5d2f-dce5-42f7-a693-a654fd702622 (non-flash) Jul 03 09:45:09.622748 np0000004400 cinder-backup[101319]: tcp: [99] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8c32af3e-9a59-44d2-8663-514226151ed2 (non-flash) Jul 03 09:45:09.622748 np0000004400 cinder-backup[101319]: stderr= {{(pid=101319) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jul 03 09:45:09.622748 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-1b52199c-010f-4d91-967a-441d98ec32e0 tempest-VolumesBackupsTest-118275719 None] Sessions list: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-8c32af3e-9a59-44d2-8663-514226151ed2', '100'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-4b68dad5-e9a3-4bd1-84e2-ba745cb7bb83', '101'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-d416aa2d-9214-4dcb-ba7c-32b834c4d794', '102'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-b2e4f10c-8033-4c54-95a1-dfe45d6357a3', '49'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-b2e4f10c-8033-4c54-95a1-dfe45d6357a3', '50'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-76320525-737e-4f58-8523-63ec9abbdc64', '82'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-76320525-737e-4f58-8523-63ec9abbdc64', '83'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-dc2d662f-bc12-4338-8e3d-6565f72ba808', '87'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-dc2d662f-bc12-4338-8e3d-6565f72ba808', '88'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-aecd73f6-86c7-4ae8-8bfa-b46655eb6efb', '93'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-aecd73f6-86c7-4ae8-8bfa-b46655eb6efb', '94'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-b86cbab3-7c42-409e-b4f6-0ed61267a031', '96'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-d47f5d2f-dce5-42f7-a693-a654fd702622', '97'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-d47f5d2f-dce5-42f7-a693-a654fd702622', '98'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-8c32af3e-9a59-44d2-8663-514226151ed2', '99')] {{(pid=101319) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:866}} Jul 03 09:45:09.623066 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-1b52199c-010f-4d91-967a-441d98ec32e0 tempest-VolumesBackupsTest-118275719 None] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-b86cbab3-7c42-409e-b4f6-0ed61267a031, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-b86cbab3-7c42-409e-b4f6-0ed61267a031', '96')] {{(pid=101319) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}} Jul 03 09:45:09.623971 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-1b52199c-010f-4d91-967a-441d98ec32e0 tempest-VolumesBackupsTest-118275719 None] Resulting device map defaultdict(. at 0x7e76e736eb60>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-b86cbab3-7c42-409e-b4f6-0ed61267a031'): ({'sdb'}, set())}) {{(pid=101319) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:912}} Jul 03 09:45:09.624166 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.linuxscsi [None req-1b52199c-010f-4d91-967a-441d98ec32e0 tempest-VolumesBackupsTest-118275719 None] Removing single pathed devices sdb {{(pid=101319) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}} Jul 03 09:45:09.636265 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.linuxscsi [None req-1b52199c-010f-4d91-967a-441d98ec32e0 tempest-VolumesBackupsTest-118275719 None] Flushing IO for device /dev/sdb {{(pid=101319) flush_device_io /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:461}} Jul 03 09:45:09.647625 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.linuxscsi [None req-1b52199c-010f-4d91-967a-441d98ec32e0 tempest-VolumesBackupsTest-118275719 None] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=101319) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}} Jul 03 09:45:09.694832 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.linuxscsi [None req-1b52199c-010f-4d91-967a-441d98ec32e0 tempest-VolumesBackupsTest-118275719 None] Checking to see if SCSI volumes sdb have been removed. {{(pid=101319) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}} Jul 03 09:45:09.694986 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.linuxscsi [None req-1b52199c-010f-4d91-967a-441d98ec32e0 tempest-VolumesBackupsTest-118275719 None] SCSI volumes sdb have been removed. {{(pid=101319) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}} Jul 03 09:45:09.696617 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.linuxscsi [None req-1b52199c-010f-4d91-967a-441d98ec32e0 tempest-VolumesBackupsTest-118275719 None] Checking to see if device paths {'sdb'} are still under multipathd monitoring {{(pid=101319) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}} Jul 03 09:45:09.710551 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.linuxscsi [None req-1b52199c-010f-4d91-967a-441d98ec32e0 tempest-VolumesBackupsTest-118275719 None] Device paths {'sdb'} have been removed from multipathd monitoring. {{(pid=101319) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}} Jul 03 09:45:09.710782 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-1b52199c-010f-4d91-967a-441d98ec32e0 tempest-VolumesBackupsTest-118275719 None] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-b86cbab3-7c42-409e-b4f6-0ed61267a031')] {{(pid=101319) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1225}} Jul 03 09:45:09.724222 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-1b52199c-010f-4d91-967a-441d98ec32e0 tempest-VolumesBackupsTest-118275719 None] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=101319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 03 09:45:09.768823 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-1b52199c-010f-4d91-967a-441d98ec32e0 tempest-VolumesBackupsTest-118275719 None] iscsiadm ('--logout',): stdout=Logging out of session [sid: 96, target: iqn.2023-03.storpool.com:os--volume-b86cbab3-7c42-409e-b4f6-0ed61267a031, portal: 192.168.40.100,3260] Jul 03 09:45:09.768823 np0000004400 cinder-backup[101319]: Logout of [sid: 96, target: iqn.2023-03.storpool.com:os--volume-b86cbab3-7c42-409e-b4f6-0ed61267a031, portal: 192.168.40.100,3260] successful. Jul 03 09:45:09.768823 np0000004400 cinder-backup[101319]: stderr= {{(pid=101319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 03 09:45:09.825430 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-1b52199c-010f-4d91-967a-441d98ec32e0 tempest-VolumesBackupsTest-118275719 None] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=101319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 03 09:45:09.825430 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.base [None req-1b52199c-010f-4d91-967a-441d98ec32e0 tempest-VolumesBackupsTest-118275719 None] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.263s {{(pid=101319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jul 03 09:45:09.825430 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-1b52199c-010f-4d91-967a-441d98ec32e0 tempest-VolumesBackupsTest-118275719 None] <== disconnect_volume: return (263ms) None {{(pid=101319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}} Jul 03 09:45:09.961669 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-dd7cebed-c6db-4da9-be53-3cc828012d99 tempest-ProjectAdminTests33-1900627284 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101319) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 09:45:09.962113 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-dd7cebed-c6db-4da9-be53-3cc828012d99 tempest-ProjectAdminTests33-1900627284 None] About to put_object {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 09:45:09.971632 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-5b578e84-b5bc-4a14-9ad7-6bb3bd07d595 tempest-VolumesBackupsTest-2142009639 None] restoring object. backup: a636aad8-67e3-4daa-ac42-7179916eefe7, container: tempest-volumesbackupstest-backup-container-313960817, object name: volume_b9d43525-b482-4d2d-8541-23ede348708e/20260703094447/az_nova_backup_a636aad8-67e3-4daa-ac42-7179916eefe7-00003, volume: d416aa2d-9214-4dcb-ba7c-32b834c4d794. {{(pid=101319) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:705}} Jul 03 09:45:10.001626 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-5b578e84-b5bc-4a14-9ad7-6bb3bd07d595 tempest-VolumesBackupsTest-2142009639 None] decompressing data using zlib algorithm {{(pid=101319) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:722}} Jul 03 09:45:10.089752 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-dd7cebed-c6db-4da9-be53-3cc828012d99 tempest-ProjectAdminTests33-1900627284 None] backup MD5 for volume_4b68dad5-e9a3-4bd1-84e2-ba745cb7bb83/20260703094505/az_nova_backup_cfdc4925-e984-4da2-aa3e-e1e8a7c37558-00007: 25e317773f308e446cc84c503a6d1f85 {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 09:45:10.089930 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-dd7cebed-c6db-4da9-be53-3cc828012d99 tempest-ProjectAdminTests33-1900627284 None] Calling eventlet.sleep(0) {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 09:45:10.380526 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-5b578e84-b5bc-4a14-9ad7-6bb3bd07d595 tempest-VolumesBackupsTest-2142009639 None] restoring object. backup: a636aad8-67e3-4daa-ac42-7179916eefe7, container: tempest-volumesbackupstest-backup-container-313960817, object name: volume_b9d43525-b482-4d2d-8541-23ede348708e/20260703094447/az_nova_backup_a636aad8-67e3-4daa-ac42-7179916eefe7-00004, volume: d416aa2d-9214-4dcb-ba7c-32b834c4d794. {{(pid=101319) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:705}} Jul 03 09:45:10.397324 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-5b578e84-b5bc-4a14-9ad7-6bb3bd07d595 tempest-VolumesBackupsTest-2142009639 None] decompressing data using zlib algorithm {{(pid=101319) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:722}} Jul 03 09:45:10.408139 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-dd7cebed-c6db-4da9-be53-3cc828012d99 tempest-ProjectAdminTests33-1900627284 None] Backing up chunk of data from volume. {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 09:45:10.482945 np0000004400 cinder-backup[101319]: INFO cinder.backup.manager [None req-1b52199c-010f-4d91-967a-441d98ec32e0 tempest-VolumesBackupsTest-118275719 None] Create backup finished. backup: 3087847d-58e1-4a0c-af9c-2639ae9f2aeb. Jul 03 09:45:10.741301 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-dd7cebed-c6db-4da9-be53-3cc828012d99 tempest-ProjectAdminTests33-1900627284 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101319) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 09:45:10.741563 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-dd7cebed-c6db-4da9-be53-3cc828012d99 tempest-ProjectAdminTests33-1900627284 None] About to put_object {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 09:45:10.747223 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-5b578e84-b5bc-4a14-9ad7-6bb3bd07d595 tempest-VolumesBackupsTest-2142009639 None] restoring object. backup: a636aad8-67e3-4daa-ac42-7179916eefe7, container: tempest-volumesbackupstest-backup-container-313960817, object name: volume_b9d43525-b482-4d2d-8541-23ede348708e/20260703094447/az_nova_backup_a636aad8-67e3-4daa-ac42-7179916eefe7-00005, volume: d416aa2d-9214-4dcb-ba7c-32b834c4d794. {{(pid=101319) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:705}} Jul 03 09:45:10.771605 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-5b578e84-b5bc-4a14-9ad7-6bb3bd07d595 tempest-VolumesBackupsTest-2142009639 None] decompressing data using zlib algorithm {{(pid=101319) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:722}} Jul 03 09:45:10.852082 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-dd7cebed-c6db-4da9-be53-3cc828012d99 tempest-ProjectAdminTests33-1900627284 None] backup MD5 for volume_4b68dad5-e9a3-4bd1-84e2-ba745cb7bb83/20260703094505/az_nova_backup_cfdc4925-e984-4da2-aa3e-e1e8a7c37558-00008: 25e317773f308e446cc84c503a6d1f85 {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 09:45:10.852204 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-dd7cebed-c6db-4da9-be53-3cc828012d99 tempest-ProjectAdminTests33-1900627284 None] Calling eventlet.sleep(0) {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 09:45:11.176080 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-5b578e84-b5bc-4a14-9ad7-6bb3bd07d595 tempest-VolumesBackupsTest-2142009639 None] restoring object. backup: a636aad8-67e3-4daa-ac42-7179916eefe7, container: tempest-volumesbackupstest-backup-container-313960817, object name: volume_b9d43525-b482-4d2d-8541-23ede348708e/20260703094447/az_nova_backup_a636aad8-67e3-4daa-ac42-7179916eefe7-00006, volume: d416aa2d-9214-4dcb-ba7c-32b834c4d794. {{(pid=101319) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:705}} Jul 03 09:45:11.201386 np0000004400 cinder-backup[101319]: INFO cinder.backup.manager [None req-e009ec27-4bef-44d5-8801-97ccc0ad8f75 tempest-VolumesBackupsTest-118275719 None] Create backup started, backup: 435094a5-f336-4be4-826b-fa363af35296 volume: b86cbab3-7c42-409e-b4f6-0ed61267a031. Jul 03 09:45:11.203470 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-5b578e84-b5bc-4a14-9ad7-6bb3bd07d595 tempest-VolumesBackupsTest-2142009639 None] decompressing data using zlib algorithm {{(pid=101319) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:722}} Jul 03 09:45:11.207395 np0000004400 cinder-backup[101319]: INFO cinder.backup.manager [None req-e009ec27-4bef-44d5-8801-97ccc0ad8f75 tempest-VolumesBackupsTest-118275719 None] Call Volume Manager to get_backup_device for Backup(availability_zone='nova',container=None,created_at=2026-07-03T09:45:11Z,data_timestamp=2026-07-03T09:45:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesBackupsTest-Backup-705531849',encryption_key_id=None,fail_reason=None,host='np0000004400',id=435094a5-f336-4be4-826b-fa363af35296,metadata={},num_dependent_backups=0,object_count=0,parent=Backup(3087847d-58e1-4a0c-af9c-2639ae9f2aeb),parent_id='3087847d-58e1-4a0c-af9c-2639ae9f2aeb',project_id='a484ec9218bf417bb9d7575ae6370646',restore_volume_id=None,service='cinder.backup.drivers.swift.SwiftBackupDriver',service_metadata=None,size=1,snapshot_id=None,status='creating',temp_snapshot_id=None,temp_volume_id=None,updated_at=None,user_id='b861df2a13684334b293b1f348152e37',volume_id=b86cbab3-7c42-409e-b4f6-0ed61267a031) Jul 03 09:45:11.237499 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.drivers.swift [None req-e009ec27-4bef-44d5-8801-97ccc0ad8f75 tempest-VolumesBackupsTest-118275719 None] Using swift URL https://10.4.3.95:8080/v1/AUTH_a484ec9218bf417bb9d7575ae6370646 {{(pid=101319) initialize /opt/stack/cinder/cinder/backup/drivers/swift.py:300}} Jul 03 09:45:11.237623 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.drivers.swift [None req-e009ec27-4bef-44d5-8801-97ccc0ad8f75 tempest-VolumesBackupsTest-118275719 None] Connect to https://10.4.3.95:8080/v1/AUTH_ in "per_user" mode {{(pid=101319) initialize /opt/stack/cinder/cinder/backup/drivers/swift.py:301}} Jul 03 09:45:11.238039 np0000004400 cinder-backup[101319]: DEBUG os_brick.utils [None req-e009ec27-4bef-44d5-8801-97ccc0ad8f75 tempest-VolumesBackupsTest-118275719 None] ==> get_connector_properties: call "{'root_helper': 'sudo cinder-rootwrap /etc/cinder/rootwrap.conf', 'my_ip': '10.4.3.95', 'multipath': False, 'enforce_multipath': False, 'host': None, 'execute': None}" {{(pid=101319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}} Jul 03 09:45:11.248957 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.scaleio [None req-e009ec27-4bef-44d5-8801-97ccc0ad8f75 tempest-VolumesBackupsTest-118275719 None] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=101319) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}} Jul 03 09:45:11.255976 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-dd7cebed-c6db-4da9-be53-3cc828012d99 tempest-ProjectAdminTests33-1900627284 None] Backing up chunk of data from volume. {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 09:45:11.279563 np0000004400 cinder-backup[101319]: DEBUG oslo_concurrency.processutils [None req-e009ec27-4bef-44d5-8801-97ccc0ad8f75 tempest-VolumesBackupsTest-118275719 None] Running cmd (subprocess): nvme version {{(pid=101319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 09:45:11.294864 np0000004400 cinder-backup[101319]: DEBUG oslo_concurrency.processutils [None req-e009ec27-4bef-44d5-8801-97ccc0ad8f75 tempest-VolumesBackupsTest-118275719 None] 'nvme version' failed. Not Retrying. {{(pid=101319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 03 09:45:11.295234 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.nvmeof [None req-e009ec27-4bef-44d5-8801-97ccc0ad8f75 tempest-VolumesBackupsTest-118275719 None] nvme not present on system {{(pid=101319) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}} Jul 03 09:45:11.303430 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.lightos [None req-e009ec27-4bef-44d5-8801-97ccc0ad8f75 tempest-VolumesBackupsTest-118275719 None] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=101319) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}} Jul 03 09:45:11.306144 np0000004400 cinder-backup[101319]: INFO os_brick.initiator.connectors.lightos [None req-e009ec27-4bef-44d5-8801-97ccc0ad8f75 tempest-VolumesBackupsTest-118275719 None] Current host hostNQN and IP(s) are ['10.4.3.95', 'fe80::f816:3eff:fe47:268c', '192.168.40.6', 'fe80::f816:3eff:febf:7be2', '192.168.50.6', 'fe80::f816:3eff:fe99:8914', '192.168.10.6', 'fe80::f816:3eff:fe2f:e696', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::bc9d:84ff:fec2:6b49', 'fe80::fc16:3eff:fe36:77bf', 'fe80::4c47:1ff:fe64:1879', 'fe80::fc16:3eff:fec6:c223', 'fe80::fc16:3eff:fef5:5e6e', 'fe80::94d0:62ff:fec5:3886', 'fe80::fc16:3eff:fe48:c24e', 'fe80::fc16:3eff:fea8:bf8b', 'fe80::fc16:3eff:fe42:afa1', 'fe80::fc16:3eff:fea0:4147', 'fe80::b0cf:48ff:fe29:caf0', 'fe80::fc16:3eff:fedf:37a6', 'fe80::fc16:3eff:fe63:d9db', 'fe80::fc16:3eff:fe3b:46af', 'fe80::28c1:27ff:fe3c:5528', 'fe80::fc16:3eff:fe91:aa0', 'fe80::fc16:3eff:fe6d:2d30'] Jul 03 09:45:11.306144 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.lightos [None req-e009ec27-4bef-44d5-8801-97ccc0ad8f75 tempest-VolumesBackupsTest-118275719 None] LIGHTOS: did not find dsc, continuing anyway. {{(pid=101319) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}} Jul 03 09:45:11.306144 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.lightos [None req-e009ec27-4bef-44d5-8801-97ccc0ad8f75 tempest-VolumesBackupsTest-118275719 None] LIGHTOS: no hostnqn found. {{(pid=101319) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}} Jul 03 09:45:11.306313 np0000004400 cinder-backup[101319]: DEBUG os_brick.utils [None req-e009ec27-4bef-44d5-8801-97ccc0ad8f75 tempest-VolumesBackupsTest-118275719 None] <== get_connector_properties: return (67ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.95', 'host': 'np0000004400', 'multipath': False, 'enforce_multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:ae7e5bb0ebe6', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': '6b284368-d0ba-4d18-af6f-4998d3955c52', 'nvme_native_multipath': False} {{(pid=101319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}} Jul 03 09:45:11.595995 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-dd7cebed-c6db-4da9-be53-3cc828012d99 tempest-ProjectAdminTests33-1900627284 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101319) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 09:45:11.596201 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-dd7cebed-c6db-4da9-be53-3cc828012d99 tempest-ProjectAdminTests33-1900627284 None] About to put_object {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 09:45:11.603042 np0000004400 cinder-backup[101319]: DEBUG oslo_db.sqlalchemy.engines [None req-5b578e84-b5bc-4a14-9ad7-6bb3bd07d595 tempest-VolumesBackupsTest-2142009639 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=101319) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 03 09:45:11.608094 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-5b578e84-b5bc-4a14-9ad7-6bb3bd07d595 tempest-VolumesBackupsTest-2142009639 None] restoring object. backup: a636aad8-67e3-4daa-ac42-7179916eefe7, container: tempest-volumesbackupstest-backup-container-313960817, object name: volume_b9d43525-b482-4d2d-8541-23ede348708e/20260703094447/az_nova_backup_a636aad8-67e3-4daa-ac42-7179916eefe7-00007, volume: d416aa2d-9214-4dcb-ba7c-32b834c4d794. {{(pid=101319) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:705}} Jul 03 09:45:11.624326 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-5b578e84-b5bc-4a14-9ad7-6bb3bd07d595 tempest-VolumesBackupsTest-2142009639 None] decompressing data using zlib algorithm {{(pid=101319) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:722}} Jul 03 09:45:11.710489 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-dd7cebed-c6db-4da9-be53-3cc828012d99 tempest-ProjectAdminTests33-1900627284 None] backup MD5 for volume_4b68dad5-e9a3-4bd1-84e2-ba745cb7bb83/20260703094505/az_nova_backup_cfdc4925-e984-4da2-aa3e-e1e8a7c37558-00009: 25e317773f308e446cc84c503a6d1f85 {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 09:45:11.710748 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-dd7cebed-c6db-4da9-be53-3cc828012d99 tempest-ProjectAdminTests33-1900627284 None] Calling eventlet.sleep(0) {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 09:45:11.836693 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connector [None req-e009ec27-4bef-44d5-8801-97ccc0ad8f75 tempest-VolumesBackupsTest-118275719 None] Factory for iscsi on None {{(pid=101319) factory /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connector.py:243}} Jul 03 09:45:11.837781 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-e009ec27-4bef-44d5-8801-97ccc0ad8f75 tempest-VolumesBackupsTest-118275719 None] ==> connect_volume: call "{'self': , 'connection_properties': {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-b86cbab3-7c42-409e-b4f6-0ed61267a031', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'b86cbab3-7c42-409e-b4f6-0ed61267a031', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': False}}" {{(pid=101319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}} Jul 03 09:45:11.838348 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.base [None req-e009ec27-4bef-44d5-8801-97ccc0ad8f75 tempest-VolumesBackupsTest-118275719 None] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=101319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jul 03 09:45:11.838869 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.base [None req-e009ec27-4bef-44d5-8801-97ccc0ad8f75 tempest-VolumesBackupsTest-118275719 None] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=101319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jul 03 09:45:11.839178 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.base [None req-e009ec27-4bef-44d5-8801-97ccc0ad8f75 tempest-VolumesBackupsTest-118275719 None] Connection properties {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-b86cbab3-7c42-409e-b4f6-0ed61267a031', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'b86cbab3-7c42-409e-b4f6-0ed61267a031', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': False} {{(pid=101319) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}} Jul 03 09:45:11.967648 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.base [None req-e009ec27-4bef-44d5-8801-97ccc0ad8f75 tempest-VolumesBackupsTest-118275719 None] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-b86cbab3-7c42-409e-b4f6-0ed61267a031" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=101319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jul 03 09:45:11.967978 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.base [None req-e009ec27-4bef-44d5-8801-97ccc0ad8f75 tempest-VolumesBackupsTest-118275719 None] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-b86cbab3-7c42-409e-b4f6-0ed61267a031" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.000s {{(pid=101319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jul 03 09:45:11.968177 np0000004400 cinder-backup[101319]: INFO os_brick.initiator.connectors.iscsi [None req-e009ec27-4bef-44d5-8801-97ccc0ad8f75 tempest-VolumesBackupsTest-118275719 None] Trying to connect to iSCSI portal 192.168.40.100:3260 Jul 03 09:45:11.977929 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-e009ec27-4bef-44d5-8801-97ccc0ad8f75 tempest-VolumesBackupsTest-118275719 None] iscsiadm (): stdout= stderr=iscsiadm: No records found Jul 03 09:45:11.977929 np0000004400 cinder-backup[101319]: {{(pid=101319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 03 09:45:11.980243 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-5b578e84-b5bc-4a14-9ad7-6bb3bd07d595 tempest-VolumesBackupsTest-2142009639 None] restoring object. backup: a636aad8-67e3-4daa-ac42-7179916eefe7, container: tempest-volumesbackupstest-backup-container-313960817, object name: volume_b9d43525-b482-4d2d-8541-23ede348708e/20260703094447/az_nova_backup_a636aad8-67e3-4daa-ac42-7179916eefe7-00008, volume: d416aa2d-9214-4dcb-ba7c-32b834c4d794. {{(pid=101319) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:705}} Jul 03 09:45:11.989122 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-e009ec27-4bef-44d5-8801-97ccc0ad8f75 tempest-VolumesBackupsTest-118275719 None] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-b86cbab3-7c42-409e-b4f6-0ed61267a031] added Jul 03 09:45:11.989122 np0000004400 cinder-backup[101319]: stderr=iscsiadm: Config file line 363 does not have value Jul 03 09:45:11.989122 np0000004400 cinder-backup[101319]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs' Jul 03 09:45:11.989122 np0000004400 cinder-backup[101319]: iscsiadm: Config file line 363 does not have value Jul 03 09:45:11.989122 np0000004400 cinder-backup[101319]: iscsiadm: Config file line 363 does not have value Jul 03 09:45:11.989122 np0000004400 cinder-backup[101319]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs' Jul 03 09:45:11.989122 np0000004400 cinder-backup[101319]: {{(pid=101319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 03 09:45:11.989290 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-e009ec27-4bef-44d5-8801-97ccc0ad8f75 tempest-VolumesBackupsTest-118275719 None] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=101319) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}} Jul 03 09:45:11.989632 np0000004400 cinder-backup[101319]: DEBUG os_brick.utils [None req-e009ec27-4bef-44d5-8801-97ccc0ad8f75 tempest-VolumesBackupsTest-118275719 None] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0214(s), this was the 1st time calling it. {{(pid=101319) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}} Jul 03 09:45:11.989831 np0000004400 cinder-backup[101319]: DEBUG os_brick.utils [None req-e009ec27-4bef-44d5-8801-97ccc0ad8f75 tempest-VolumesBackupsTest-118275719 None] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=101319) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}} Jul 03 09:45:11.996012 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-5b578e84-b5bc-4a14-9ad7-6bb3bd07d595 tempest-VolumesBackupsTest-2142009639 None] decompressing data using zlib algorithm {{(pid=101319) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:722}} Jul 03 09:45:12.029985 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-dd7cebed-c6db-4da9-be53-3cc828012d99 tempest-ProjectAdminTests33-1900627284 None] Backing up chunk of data from volume. {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 09:45:12.389271 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-dd7cebed-c6db-4da9-be53-3cc828012d99 tempest-ProjectAdminTests33-1900627284 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101319) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 09:45:12.389668 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-dd7cebed-c6db-4da9-be53-3cc828012d99 tempest-ProjectAdminTests33-1900627284 None] About to put_object {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 09:45:12.395878 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-5b578e84-b5bc-4a14-9ad7-6bb3bd07d595 tempest-VolumesBackupsTest-2142009639 None] restoring object. backup: a636aad8-67e3-4daa-ac42-7179916eefe7, container: tempest-volumesbackupstest-backup-container-313960817, object name: volume_b9d43525-b482-4d2d-8541-23ede348708e/20260703094447/az_nova_backup_a636aad8-67e3-4daa-ac42-7179916eefe7-00009, volume: d416aa2d-9214-4dcb-ba7c-32b834c4d794. {{(pid=101319) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:705}} Jul 03 09:45:12.417645 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-5b578e84-b5bc-4a14-9ad7-6bb3bd07d595 tempest-VolumesBackupsTest-2142009639 None] decompressing data using zlib algorithm {{(pid=101319) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:722}} Jul 03 09:45:12.496799 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-dd7cebed-c6db-4da9-be53-3cc828012d99 tempest-ProjectAdminTests33-1900627284 None] backup MD5 for volume_4b68dad5-e9a3-4bd1-84e2-ba745cb7bb83/20260703094505/az_nova_backup_cfdc4925-e984-4da2-aa3e-e1e8a7c37558-00010: 25e317773f308e446cc84c503a6d1f85 {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 09:45:12.496934 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-dd7cebed-c6db-4da9-be53-3cc828012d99 tempest-ProjectAdminTests33-1900627284 None] Calling eventlet.sleep(0) {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 09:45:12.798694 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-5b578e84-b5bc-4a14-9ad7-6bb3bd07d595 tempest-VolumesBackupsTest-2142009639 None] restoring object. backup: a636aad8-67e3-4daa-ac42-7179916eefe7, container: tempest-volumesbackupstest-backup-container-313960817, object name: volume_b9d43525-b482-4d2d-8541-23ede348708e/20260703094447/az_nova_backup_a636aad8-67e3-4daa-ac42-7179916eefe7-00010, volume: d416aa2d-9214-4dcb-ba7c-32b834c4d794. {{(pid=101319) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:705}} Jul 03 09:45:12.817918 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-5b578e84-b5bc-4a14-9ad7-6bb3bd07d595 tempest-VolumesBackupsTest-2142009639 None] decompressing data using zlib algorithm {{(pid=101319) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:722}} Jul 03 09:45:12.838936 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-dd7cebed-c6db-4da9-be53-3cc828012d99 tempest-ProjectAdminTests33-1900627284 None] Backing up chunk of data from volume. {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 09:45:12.990606 np0000004400 cinder-backup[101319]: INFO os_brick.initiator.connectors.iscsi [None req-e009ec27-4bef-44d5-8801-97ccc0ad8f75 tempest-VolumesBackupsTest-118275719 None] Trying to connect to iSCSI portal 192.168.40.100:3260 Jul 03 09:45:13.032112 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-e009ec27-4bef-44d5-8801-97ccc0ad8f75 tempest-VolumesBackupsTest-118275719 None] iscsiadm (): stdout=# BEGIN RECORD 2.1.9 Jul 03 09:45:13.032112 np0000004400 cinder-backup[101319]: node.name = iqn.2023-03.storpool.com:os--volume-b86cbab3-7c42-409e-b4f6-0ed61267a031 Jul 03 09:45:13.032112 np0000004400 cinder-backup[101319]: node.tpgt = -1 Jul 03 09:45:13.032112 np0000004400 cinder-backup[101319]: node.startup = manual Jul 03 09:45:13.032112 np0000004400 cinder-backup[101319]: node.leading_login = No Jul 03 09:45:13.032112 np0000004400 cinder-backup[101319]: iface.iscsi_ifacename = default Jul 03 09:45:13.032112 np0000004400 cinder-backup[101319]: iface.net_ifacename = Jul 03 09:45:13.032112 np0000004400 cinder-backup[101319]: iface.ipaddress = Jul 03 09:45:13.032112 np0000004400 cinder-backup[101319]: iface.prefix_len = 0 Jul 03 09:45:13.032112 np0000004400 cinder-backup[101319]: iface.hwaddress = Jul 03 09:45:13.032112 np0000004400 cinder-backup[101319]: iface.transport_name = tcp Jul 03 09:45:13.032112 np0000004400 cinder-backup[101319]: iface.initiatorname = Jul 03 09:45:13.032112 np0000004400 cinder-backup[101319]: iface.state = Jul 03 09:45:13.032112 np0000004400 cinder-backup[101319]: iface.vlan_id = 0 Jul 03 09:45:13.032112 np0000004400 cinder-backup[101319]: iface.vlan_priority = 0 Jul 03 09:45:13.032112 np0000004400 cinder-backup[101319]: iface.vlan_state = Jul 03 09:45:13.032112 np0000004400 cinder-backup[101319]: iface.iface_num = 0 Jul 03 09:45:13.032112 np0000004400 cinder-backup[101319]: iface.mtu = 0 Jul 03 09:45:13.032112 np0000004400 cinder-backup[101319]: iface.port = 0 Jul 03 09:45:13.032112 np0000004400 cinder-backup[101319]: iface.bootproto = Jul 03 09:45:13.032112 np0000004400 cinder-backup[101319]: iface.subnet_mask = Jul 03 09:45:13.032112 np0000004400 cinder-backup[101319]: iface.gateway = Jul 03 09:45:13.032112 np0000004400 cinder-backup[101319]: iface.dhcp_alt_client_id_state = Jul 03 09:45:13.032112 np0000004400 cinder-backup[101319]: iface.dhcp_alt_client_id = Jul 03 09:45:13.032112 np0000004400 cinder-backup[101319]: iface.dhcp_dns = Jul 03 09:45:13.032112 np0000004400 cinder-backup[101319]: iface.dhcp_learn_iqn = Jul 03 09:45:13.032112 np0000004400 cinder-backup[101319]: iface.dhcp_req_vendor_id_state = Jul 03 09:45:13.032112 np0000004400 cinder-backup[101319]: iface.dhcp_vendor_id_state = Jul 03 09:45:13.032112 np0000004400 cinder-backup[101319]: iface.dhcp_vendor_id = Jul 03 09:45:13.032112 np0000004400 cinder-backup[101319]: iface.dhcp_slp_da = Jul 03 09:45:13.032112 np0000004400 cinder-backup[101319]: iface.fragmentation = Jul 03 09:45:13.032112 np0000004400 cinder-backup[101319]: iface.gratuitous_arp = Jul 03 09:45:13.032112 np0000004400 cinder-backup[101319]: iface.incoming_forwarding = Jul 03 09:45:13.032112 np0000004400 cinder-backup[101319]: iface.tos_state = Jul 03 09:45:13.032112 np0000004400 cinder-backup[101319]: iface.tos = 0 Jul 03 09:45:13.032112 np0000004400 cinder-backup[101319]: iface.ttl = 0 Jul 03 09:45:13.032112 np0000004400 cinder-backup[101319]: iface.delayed_ack = Jul 03 09:45:13.032112 np0000004400 cinder-backup[101319]: iface.tcp_nagle = Jul 03 09:45:13.032112 np0000004400 cinder-backup[101319]: iface.tcp_wsf_state = Jul 03 09:45:13.032112 np0000004400 cinder-backup[101319]: iface.tcp_wsf = 0 Jul 03 09:45:13.032112 np0000004400 cinder-backup[101319]: iface.tcp_timer_scale = 0 Jul 03 09:45:13.032112 np0000004400 cinder-backup[101319]: iface.tcp_timestamp = Jul 03 09:45:13.032112 np0000004400 cinder-backup[101319]: iface.redirect = Jul 03 09:45:13.032112 np0000004400 cinder-backup[101319]: iface.def_task_mgmt_timeout = 0 Jul 03 09:45:13.032112 np0000004400 cinder-backup[101319]: iface.header_digest = Jul 03 09:45:13.032112 np0000004400 cinder-backup[101319]: iface.data_digest = Jul 03 09:45:13.032112 np0000004400 cinder-backup[101319]: iface.immediate_data = Jul 03 09:45:13.032112 np0000004400 cinder-backup[101319]: iface.initial_r2t = Jul 03 09:45:13.032112 np0000004400 cinder-backup[101319]: iface.data_seq_inorder = Jul 03 09:45:13.032112 np0000004400 cinder-backup[101319]: iface.data_pdu_inorder = Jul 03 09:45:13.032112 np0000004400 cinder-backup[101319]: iface.erl = 0 Jul 03 09:45:13.032112 np0000004400 cinder-backup[101319]: iface.max_receive_data_len = 0 Jul 03 09:45:13.032112 np0000004400 cinder-backup[101319]: iface.first_burst_len = 0 Jul 03 09:45:13.032112 np0000004400 cinder-backup[101319]: iface.max_outstanding_r2t = 0 Jul 03 09:45:13.032112 np0000004400 cinder-backup[101319]: iface.max_burst_len = 0 Jul 03 09:45:13.032112 np0000004400 cinder-backup[101319]: iface.chap_auth = Jul 03 09:45:13.032112 np0000004400 cinder-backup[101319]: iface.bidi_chap = Jul 03 09:45:13.032112 np0000004400 cinder-backup[101319]: iface.strict_login_compliance = Jul 03 09:45:13.032112 np0000004400 cinder-backup[101319]: iface.discovery_auth = Jul 03 09:45:13.032112 np0000004400 cinder-backup[101319]: iface.discovery_logout = Jul 03 09:45:13.032112 np0000004400 cinder-backup[101319]: node.discovery_address = Jul 03 09:45:13.032112 np0000004400 cinder-backup[101319]: node.discovery_port = 0 Jul 03 09:45:13.032112 np0000004400 cinder-backup[101319]: node.discovery_type = fw Jul 03 09:45:13.032112 np0000004400 cinder-backup[101319]: node.session.initial_cmdsn = 0 Jul 03 09:45:13.032112 np0000004400 cinder-backup[101319]: node.session.initial_login_retry_max = 8 Jul 03 09:45:13.032112 np0000004400 cinder-backup[101319]: node.session.xmit_thread_priority = 0 Jul 03 09:45:13.032112 np0000004400 cinder-backup[101319]: node.session.cmds_max = 128 Jul 03 09:45:13.032112 np0000004400 cinder-backup[101319]: node.session.queue_depth = 32 Jul 03 09:45:13.032112 np0000004400 cinder-backup[101319]: node.session.nr_sessions = 1 Jul 03 09:45:13.032112 np0000004400 cinder-backup[101319]: node.session.auth.authmethod = None Jul 03 09:45:13.032112 np0000004400 cinder-backup[101319]: node.session.auth.username = Jul 03 09:45:13.032112 np0000004400 cinder-backup[101319]: node.session.auth.password = *** Jul 03 09:45:13.032112 np0000004400 cinder-backup[101319]: node.session.auth.username_in = Jul 03 09:45:13.032112 np0000004400 cinder-backup[101319]: node.session.auth.password_in = Jul 03 09:45:13.032112 np0000004400 cinder-backup[101319]: node.session.auth.chap_algs = SHA256 Jul 03 09:45:13.032112 np0000004400 cinder-backup[101319]: node.session.timeo.replacement_timeout = 120 Jul 03 09:45:13.032112 np0000004400 cinder-backup[101319]: node.session.err_timeo.abort_timeout = 15 Jul 03 09:45:13.032112 np0000004400 cinder-backup[101319]: node.session.err_timeo.lu_reset_timeout = 30 Jul 03 09:45:13.032112 np0000004400 cinder-backup[101319]: node.session.err_timeo.tgt_reset_timeout = 30 Jul 03 09:45:13.032112 np0000004400 cinder-backup[101319]: node.session.err_timeo.host_reset_timeout = 60 Jul 03 09:45:13.032112 np0000004400 cinder-backup[101319]: node.session.iscsi.FastAbort = Yes Jul 03 09:45:13.032112 np0000004400 cinder-backup[101319]: node.session.iscsi.InitialR2T = No Jul 03 09:45:13.032112 np0000004400 cinder-backup[101319]: node.session.iscsi.ImmediateData = Yes Jul 03 09:45:13.032112 np0000004400 cinder-backup[101319]: node.session.iscsi.FirstBurstLength = 262144 Jul 03 09:45:13.032112 np0000004400 cinder-backup[101319]: node.session.iscsi.MaxBurstLength = 16776192 Jul 03 09:45:13.032112 np0000004400 cinder-backup[101319]: node.session.iscsi.DefaultTime2Retain = 0 Jul 03 09:45:13.032112 np0000004400 cinder-backup[101319]: node.session.iscsi.DefaultTime2Wait = 2 Jul 03 09:45:13.032112 np0000004400 cinder-backup[101319]: node.session.iscsi.MaxConnections = 1 Jul 03 09:45:13.032112 np0000004400 cinder-backup[101319]: node.session.iscsi.MaxOutstandingR2T = 1 Jul 03 09:45:13.032112 np0000004400 cinder-backup[101319]: node.session.iscsi.ERL = 0 Jul 03 09:45:13.032112 np0000004400 cinder-backup[101319]: node.session.scan = auto Jul 03 09:45:13.032112 np0000004400 cinder-backup[101319]: node.session.reopen_max = 0 Jul 03 09:45:13.032112 np0000004400 cinder-backup[101319]: node.conn[0].address = 192.168.40.100 Jul 03 09:45:13.032112 np0000004400 cinder-backup[101319]: node.conn[0].port = 3260 Jul 03 09:45:13.032112 np0000004400 cinder-backup[101319]: node.conn[0].startup = manual Jul 03 09:45:13.032112 np0000004400 cinder-backup[101319]: node.conn[0].tcp.window_size = 524288 Jul 03 09:45:13.032112 np0000004400 cinder-backup[101319]: node.conn[0].tcp.type_of_service = 0 Jul 03 09:45:13.032112 np0000004400 cinder-backup[101319]: node.conn[0].timeo.logout_timeout = 15 Jul 03 09:45:13.032112 np0000004400 cinder-backup[101319]: node.conn[0].timeo.login_timeout = 15 Jul 03 09:45:13.032112 np0000004400 cinder-backup[101319]: node.conn[0].timeo.auth_timeout = 45 Jul 03 09:45:13.032112 np0000004400 cinder-backup[101319]: node.conn[0].timeo.noop_out_interval = 5 Jul 03 09:45:13.032112 np0000004400 cinder-backup[101319]: node.conn[0].timeo.noop_out_timeout = 5 Jul 03 09:45:13.032112 np0000004400 cinder-backup[101319]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0 Jul 03 09:45:13.032112 np0000004400 cinder-backup[101319]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144 Jul 03 09:45:13.032112 np0000004400 cinder-backup[101319]: node.conn[0].iscsi.HeaderDigest = None Jul 03 09:45:13.032112 np0000004400 cinder-backup[101319]: node.conn[0].iscsi.DataDigest = None Jul 03 09:45:13.032112 np0000004400 cinder-backup[101319]: node.conn[0].iscsi.IFMarker = No Jul 03 09:45:13.032112 np0000004400 cinder-backup[101319]: node.conn[0].iscsi.OFMarker = No Jul 03 09:45:13.032112 np0000004400 cinder-backup[101319]: # END RECORD Jul 03 09:45:13.032112 np0000004400 cinder-backup[101319]: stderr= {{(pid=101319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 03 09:45:13.162881 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-dd7cebed-c6db-4da9-be53-3cc828012d99 tempest-ProjectAdminTests33-1900627284 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101319) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 09:45:13.163084 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-dd7cebed-c6db-4da9-be53-3cc828012d99 tempest-ProjectAdminTests33-1900627284 None] About to put_object {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 09:45:13.163425 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-e009ec27-4bef-44d5-8801-97ccc0ad8f75 tempest-VolumesBackupsTest-118275719 None] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=101319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 03 09:45:13.170002 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-5b578e84-b5bc-4a14-9ad7-6bb3bd07d595 tempest-VolumesBackupsTest-2142009639 None] restoring object. backup: a636aad8-67e3-4daa-ac42-7179916eefe7, container: tempest-volumesbackupstest-backup-container-313960817, object name: volume_b9d43525-b482-4d2d-8541-23ede348708e/20260703094447/az_nova_backup_a636aad8-67e3-4daa-ac42-7179916eefe7-00011, volume: d416aa2d-9214-4dcb-ba7c-32b834c4d794. {{(pid=101319) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:705}} Jul 03 09:45:13.181827 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-e009ec27-4bef-44d5-8801-97ccc0ad8f75 tempest-VolumesBackupsTest-118275719 None] iscsiadm ('-m', 'session'): stdout=tcp: [100] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8c32af3e-9a59-44d2-8663-514226151ed2 (non-flash) Jul 03 09:45:13.181827 np0000004400 cinder-backup[101319]: tcp: [101] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-4b68dad5-e9a3-4bd1-84e2-ba745cb7bb83 (non-flash) Jul 03 09:45:13.181827 np0000004400 cinder-backup[101319]: tcp: [102] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d416aa2d-9214-4dcb-ba7c-32b834c4d794 (non-flash) Jul 03 09:45:13.181827 np0000004400 cinder-backup[101319]: tcp: [49] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b2e4f10c-8033-4c54-95a1-dfe45d6357a3 (non-flash) Jul 03 09:45:13.181827 np0000004400 cinder-backup[101319]: tcp: [50] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b2e4f10c-8033-4c54-95a1-dfe45d6357a3 (non-flash) Jul 03 09:45:13.181827 np0000004400 cinder-backup[101319]: tcp: [82] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-76320525-737e-4f58-8523-63ec9abbdc64 (non-flash) Jul 03 09:45:13.181827 np0000004400 cinder-backup[101319]: tcp: [83] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-76320525-737e-4f58-8523-63ec9abbdc64 (non-flash) Jul 03 09:45:13.181827 np0000004400 cinder-backup[101319]: tcp: [93] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-aecd73f6-86c7-4ae8-8bfa-b46655eb6efb (non-flash) Jul 03 09:45:13.181827 np0000004400 cinder-backup[101319]: tcp: [94] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-aecd73f6-86c7-4ae8-8bfa-b46655eb6efb (non-flash) Jul 03 09:45:13.181827 np0000004400 cinder-backup[101319]: tcp: [97] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d47f5d2f-dce5-42f7-a693-a654fd702622 (non-flash) Jul 03 09:45:13.181827 np0000004400 cinder-backup[101319]: tcp: [98] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d47f5d2f-dce5-42f7-a693-a654fd702622 (non-flash) Jul 03 09:45:13.181827 np0000004400 cinder-backup[101319]: tcp: [99] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8c32af3e-9a59-44d2-8663-514226151ed2 (non-flash) Jul 03 09:45:13.181827 np0000004400 cinder-backup[101319]: stderr= {{(pid=101319) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jul 03 09:45:13.182219 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-e009ec27-4bef-44d5-8801-97ccc0ad8f75 tempest-VolumesBackupsTest-118275719 None] iscsi session list stdout=tcp: [100] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8c32af3e-9a59-44d2-8663-514226151ed2 (non-flash) Jul 03 09:45:13.182219 np0000004400 cinder-backup[101319]: tcp: [101] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-4b68dad5-e9a3-4bd1-84e2-ba745cb7bb83 (non-flash) Jul 03 09:45:13.182219 np0000004400 cinder-backup[101319]: tcp: [102] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d416aa2d-9214-4dcb-ba7c-32b834c4d794 (non-flash) Jul 03 09:45:13.182219 np0000004400 cinder-backup[101319]: tcp: [49] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b2e4f10c-8033-4c54-95a1-dfe45d6357a3 (non-flash) Jul 03 09:45:13.182219 np0000004400 cinder-backup[101319]: tcp: [50] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b2e4f10c-8033-4c54-95a1-dfe45d6357a3 (non-flash) Jul 03 09:45:13.182219 np0000004400 cinder-backup[101319]: tcp: [82] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-76320525-737e-4f58-8523-63ec9abbdc64 (non-flash) Jul 03 09:45:13.182219 np0000004400 cinder-backup[101319]: tcp: [83] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-76320525-737e-4f58-8523-63ec9abbdc64 (non-flash) Jul 03 09:45:13.182219 np0000004400 cinder-backup[101319]: tcp: [93] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-aecd73f6-86c7-4ae8-8bfa-b46655eb6efb (non-flash) Jul 03 09:45:13.182219 np0000004400 cinder-backup[101319]: tcp: [94] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-aecd73f6-86c7-4ae8-8bfa-b46655eb6efb (non-flash) Jul 03 09:45:13.182219 np0000004400 cinder-backup[101319]: tcp: [97] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d47f5d2f-dce5-42f7-a693-a654fd702622 (non-flash) Jul 03 09:45:13.182219 np0000004400 cinder-backup[101319]: tcp: [98] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d47f5d2f-dce5-42f7-a693-a654fd702622 (non-flash) Jul 03 09:45:13.182219 np0000004400 cinder-backup[101319]: tcp: [99] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8c32af3e-9a59-44d2-8663-514226151ed2 (non-flash) Jul 03 09:45:13.182219 np0000004400 cinder-backup[101319]: stderr= {{(pid=101319) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jul 03 09:45:13.197265 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-5b578e84-b5bc-4a14-9ad7-6bb3bd07d595 tempest-VolumesBackupsTest-2142009639 None] decompressing data using zlib algorithm {{(pid=101319) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:722}} Jul 03 09:45:13.232089 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-e009ec27-4bef-44d5-8801-97ccc0ad8f75 tempest-VolumesBackupsTest-118275719 None] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-b86cbab3-7c42-409e-b4f6-0ed61267a031, portal: 192.168.40.100,3260] Jul 03 09:45:13.232089 np0000004400 cinder-backup[101319]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-b86cbab3-7c42-409e-b4f6-0ed61267a031, portal: 192.168.40.100,3260] successful. Jul 03 09:45:13.232089 np0000004400 cinder-backup[101319]: stderr= {{(pid=101319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 03 09:45:13.245221 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-e009ec27-4bef-44d5-8801-97ccc0ad8f75 tempest-VolumesBackupsTest-118275719 None] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=101319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 03 09:45:13.269558 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-e009ec27-4bef-44d5-8801-97ccc0ad8f75 tempest-VolumesBackupsTest-118275719 None] iscsiadm ('-m', 'session'): stdout=tcp: [100] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8c32af3e-9a59-44d2-8663-514226151ed2 (non-flash) Jul 03 09:45:13.269558 np0000004400 cinder-backup[101319]: tcp: [101] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-4b68dad5-e9a3-4bd1-84e2-ba745cb7bb83 (non-flash) Jul 03 09:45:13.269558 np0000004400 cinder-backup[101319]: tcp: [102] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d416aa2d-9214-4dcb-ba7c-32b834c4d794 (non-flash) Jul 03 09:45:13.269558 np0000004400 cinder-backup[101319]: tcp: [103] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b86cbab3-7c42-409e-b4f6-0ed61267a031 (non-flash) Jul 03 09:45:13.269558 np0000004400 cinder-backup[101319]: tcp: [49] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b2e4f10c-8033-4c54-95a1-dfe45d6357a3 (non-flash) Jul 03 09:45:13.269558 np0000004400 cinder-backup[101319]: tcp: [50] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b2e4f10c-8033-4c54-95a1-dfe45d6357a3 (non-flash) Jul 03 09:45:13.269558 np0000004400 cinder-backup[101319]: tcp: [82] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-76320525-737e-4f58-8523-63ec9abbdc64 (non-flash) Jul 03 09:45:13.269558 np0000004400 cinder-backup[101319]: tcp: [83] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-76320525-737e-4f58-8523-63ec9abbdc64 (non-flash) Jul 03 09:45:13.269558 np0000004400 cinder-backup[101319]: tcp: [93] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-aecd73f6-86c7-4ae8-8bfa-b46655eb6efb (non-flash) Jul 03 09:45:13.269558 np0000004400 cinder-backup[101319]: tcp: [94] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-aecd73f6-86c7-4ae8-8bfa-b46655eb6efb (non-flash) Jul 03 09:45:13.269558 np0000004400 cinder-backup[101319]: tcp: [97] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d47f5d2f-dce5-42f7-a693-a654fd702622 (non-flash) Jul 03 09:45:13.269558 np0000004400 cinder-backup[101319]: tcp: [98] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d47f5d2f-dce5-42f7-a693-a654fd702622 (non-flash) Jul 03 09:45:13.269558 np0000004400 cinder-backup[101319]: tcp: [99] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8c32af3e-9a59-44d2-8663-514226151ed2 (non-flash) Jul 03 09:45:13.269558 np0000004400 cinder-backup[101319]: stderr= {{(pid=101319) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jul 03 09:45:13.269878 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-e009ec27-4bef-44d5-8801-97ccc0ad8f75 tempest-VolumesBackupsTest-118275719 None] iscsi session list stdout=tcp: [100] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8c32af3e-9a59-44d2-8663-514226151ed2 (non-flash) Jul 03 09:45:13.269878 np0000004400 cinder-backup[101319]: tcp: [101] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-4b68dad5-e9a3-4bd1-84e2-ba745cb7bb83 (non-flash) Jul 03 09:45:13.269878 np0000004400 cinder-backup[101319]: tcp: [102] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d416aa2d-9214-4dcb-ba7c-32b834c4d794 (non-flash) Jul 03 09:45:13.269878 np0000004400 cinder-backup[101319]: tcp: [103] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b86cbab3-7c42-409e-b4f6-0ed61267a031 (non-flash) Jul 03 09:45:13.269878 np0000004400 cinder-backup[101319]: tcp: [49] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b2e4f10c-8033-4c54-95a1-dfe45d6357a3 (non-flash) Jul 03 09:45:13.269878 np0000004400 cinder-backup[101319]: tcp: [50] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b2e4f10c-8033-4c54-95a1-dfe45d6357a3 (non-flash) Jul 03 09:45:13.269878 np0000004400 cinder-backup[101319]: tcp: [82] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-76320525-737e-4f58-8523-63ec9abbdc64 (non-flash) Jul 03 09:45:13.269878 np0000004400 cinder-backup[101319]: tcp: [83] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-76320525-737e-4f58-8523-63ec9abbdc64 (non-flash) Jul 03 09:45:13.269878 np0000004400 cinder-backup[101319]: tcp: [93] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-aecd73f6-86c7-4ae8-8bfa-b46655eb6efb (non-flash) Jul 03 09:45:13.269878 np0000004400 cinder-backup[101319]: tcp: [94] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-aecd73f6-86c7-4ae8-8bfa-b46655eb6efb (non-flash) Jul 03 09:45:13.269878 np0000004400 cinder-backup[101319]: tcp: [97] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d47f5d2f-dce5-42f7-a693-a654fd702622 (non-flash) Jul 03 09:45:13.269878 np0000004400 cinder-backup[101319]: tcp: [98] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d47f5d2f-dce5-42f7-a693-a654fd702622 (non-flash) Jul 03 09:45:13.269878 np0000004400 cinder-backup[101319]: tcp: [99] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8c32af3e-9a59-44d2-8663-514226151ed2 (non-flash) Jul 03 09:45:13.269878 np0000004400 cinder-backup[101319]: stderr= {{(pid=101319) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jul 03 09:45:13.270177 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.base [None req-e009ec27-4bef-44d5-8801-97ccc0ad8f75 tempest-VolumesBackupsTest-118275719 None] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-b86cbab3-7c42-409e-b4f6-0ed61267a031" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.302s {{(pid=101319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jul 03 09:45:13.270235 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-e009ec27-4bef-44d5-8801-97ccc0ad8f75 tempest-VolumesBackupsTest-118275719 None] Connected to 192.168.40.100:3260 {{(pid=101319) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}} Jul 03 09:45:13.271498 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.linuxscsi [None req-e009ec27-4bef-44d5-8801-97ccc0ad8f75 tempest-VolumesBackupsTest-118275719 None] HCTL ('7', '-', '-', 0) found on session 103 with lun 0 {{(pid=101319) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}} Jul 03 09:45:13.271622 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.linuxscsi [None req-e009ec27-4bef-44d5-8801-97ccc0ad8f75 tempest-VolumesBackupsTest-118275719 None] Scanning host 7 c: -, t: -, l: 0) {{(pid=101319) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}} Jul 03 09:45:13.289265 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.linuxscsi [None req-e009ec27-4bef-44d5-8801-97ccc0ad8f75 tempest-VolumesBackupsTest-118275719 None] Searching for a device in session 103 and hctl ['7', '*', '*', 0] yield: sdb {{(pid=101319) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}} Jul 03 09:45:13.289478 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-e009ec27-4bef-44d5-8801-97ccc0ad8f75 tempest-VolumesBackupsTest-118275719 None] Connected to sdb using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-b86cbab3-7c42-409e-b4f6-0ed61267a031', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'b86cbab3-7c42-409e-b4f6-0ed61267a031', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': False} {{(pid=101319) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}} Jul 03 09:45:13.294701 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-dd7cebed-c6db-4da9-be53-3cc828012d99 tempest-ProjectAdminTests33-1900627284 None] backup MD5 for volume_4b68dad5-e9a3-4bd1-84e2-ba745cb7bb83/20260703094505/az_nova_backup_cfdc4925-e984-4da2-aa3e-e1e8a7c37558-00011: 25e317773f308e446cc84c503a6d1f85 {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 09:45:13.294896 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-dd7cebed-c6db-4da9-be53-3cc828012d99 tempest-ProjectAdminTests33-1900627284 None] Calling eventlet.sleep(0) {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 09:45:13.567320 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-5b578e84-b5bc-4a14-9ad7-6bb3bd07d595 tempest-VolumesBackupsTest-2142009639 None] restoring object. backup: a636aad8-67e3-4daa-ac42-7179916eefe7, container: tempest-volumesbackupstest-backup-container-313960817, object name: volume_b9d43525-b482-4d2d-8541-23ede348708e/20260703094447/az_nova_backup_a636aad8-67e3-4daa-ac42-7179916eefe7-00012, volume: d416aa2d-9214-4dcb-ba7c-32b834c4d794. {{(pid=101319) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:705}} Jul 03 09:45:13.581823 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-5b578e84-b5bc-4a14-9ad7-6bb3bd07d595 tempest-VolumesBackupsTest-2142009639 None] decompressing data using zlib algorithm {{(pid=101319) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:722}} Jul 03 09:45:13.605747 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-dd7cebed-c6db-4da9-be53-3cc828012d99 tempest-ProjectAdminTests33-1900627284 None] Backing up chunk of data from volume. {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 09:45:13.911642 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-dd7cebed-c6db-4da9-be53-3cc828012d99 tempest-ProjectAdminTests33-1900627284 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101319) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 09:45:13.912096 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-dd7cebed-c6db-4da9-be53-3cc828012d99 tempest-ProjectAdminTests33-1900627284 None] About to put_object {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 09:45:13.917482 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-5b578e84-b5bc-4a14-9ad7-6bb3bd07d595 tempest-VolumesBackupsTest-2142009639 None] restoring object. backup: a636aad8-67e3-4daa-ac42-7179916eefe7, container: tempest-volumesbackupstest-backup-container-313960817, object name: volume_b9d43525-b482-4d2d-8541-23ede348708e/20260703094447/az_nova_backup_a636aad8-67e3-4daa-ac42-7179916eefe7-00013, volume: d416aa2d-9214-4dcb-ba7c-32b834c4d794. {{(pid=101319) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:705}} Jul 03 09:45:13.935950 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-5b578e84-b5bc-4a14-9ad7-6bb3bd07d595 tempest-VolumesBackupsTest-2142009639 None] decompressing data using zlib algorithm {{(pid=101319) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:722}} Jul 03 09:45:14.025478 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-dd7cebed-c6db-4da9-be53-3cc828012d99 tempest-ProjectAdminTests33-1900627284 None] backup MD5 for volume_4b68dad5-e9a3-4bd1-84e2-ba745cb7bb83/20260703094505/az_nova_backup_cfdc4925-e984-4da2-aa3e-e1e8a7c37558-00012: 25e317773f308e446cc84c503a6d1f85 {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 09:45:14.025539 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-dd7cebed-c6db-4da9-be53-3cc828012d99 tempest-ProjectAdminTests33-1900627284 None] Calling eventlet.sleep(0) {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 09:45:14.296873 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.base [None req-e009ec27-4bef-44d5-8801-97ccc0ad8f75 tempest-VolumesBackupsTest-118275719 None] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 2.458s {{(pid=101319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jul 03 09:45:14.297113 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-e009ec27-4bef-44d5-8801-97ccc0ad8f75 tempest-VolumesBackupsTest-118275719 None] <== connect_volume: return (2459ms) {'type': 'block', 'scsi_wwn': 'SStorPool_iSCSI_DISK_1034578903445799018', 'path': '/dev/sdb'} {{(pid=101319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}} Jul 03 09:45:14.297557 np0000004400 cinder-backup[101319]: DEBUG oslo_concurrency.processutils [None req-e009ec27-4bef-44d5-8801-97ccc0ad8f75 tempest-VolumesBackupsTest-118275719 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chown 1002 /dev/sdb {{(pid=101319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 09:45:14.321945 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-5b578e84-b5bc-4a14-9ad7-6bb3bd07d595 tempest-VolumesBackupsTest-2142009639 None] restoring object. backup: a636aad8-67e3-4daa-ac42-7179916eefe7, container: tempest-volumesbackupstest-backup-container-313960817, object name: volume_b9d43525-b482-4d2d-8541-23ede348708e/20260703094447/az_nova_backup_a636aad8-67e3-4daa-ac42-7179916eefe7-00014, volume: d416aa2d-9214-4dcb-ba7c-32b834c4d794. {{(pid=101319) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:705}} Jul 03 09:45:14.326871 np0000004400 sudo[136260]: stack : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chown 1002 /dev/sdb Jul 03 09:45:14.327689 np0000004400 sudo[136260]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1002) Jul 03 09:45:14.341187 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-5b578e84-b5bc-4a14-9ad7-6bb3bd07d595 tempest-VolumesBackupsTest-2142009639 None] decompressing data using zlib algorithm {{(pid=101319) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:722}} Jul 03 09:45:14.359982 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-dd7cebed-c6db-4da9-be53-3cc828012d99 tempest-ProjectAdminTests33-1900627284 None] Backing up chunk of data from volume. {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 09:45:14.670271 np0000004400 sudo[136260]: pam_unix(sudo:session): session closed for user root Jul 03 09:45:14.723346 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-dd7cebed-c6db-4da9-be53-3cc828012d99 tempest-ProjectAdminTests33-1900627284 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101319) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 09:45:14.723879 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-dd7cebed-c6db-4da9-be53-3cc828012d99 tempest-ProjectAdminTests33-1900627284 None] About to put_object {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 09:45:14.726529 np0000004400 cinder-backup[101319]: DEBUG oslo_concurrency.processutils [None req-e009ec27-4bef-44d5-8801-97ccc0ad8f75 tempest-VolumesBackupsTest-118275719 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chown 1002 /dev/sdb" returned: 0 in 0.429s {{(pid=101319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 09:45:14.756567 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-5b578e84-b5bc-4a14-9ad7-6bb3bd07d595 tempest-VolumesBackupsTest-2142009639 None] restoring object. backup: a636aad8-67e3-4daa-ac42-7179916eefe7, container: tempest-volumesbackupstest-backup-container-313960817, object name: volume_b9d43525-b482-4d2d-8541-23ede348708e/20260703094447/az_nova_backup_a636aad8-67e3-4daa-ac42-7179916eefe7-00015, volume: d416aa2d-9214-4dcb-ba7c-32b834c4d794. {{(pid=101319) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:705}} Jul 03 09:45:14.770010 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-e009ec27-4bef-44d5-8801-97ccc0ad8f75 tempest-VolumesBackupsTest-118275719 None] _read_sha256file started, container name: volumebackups, sha256 filename: volume_b86cbab3-7c42-409e-b4f6-0ed61267a031/20260703094455/az_nova_backup_3087847d-58e1-4a0c-af9c-2639ae9f2aeb_sha256file. {{(pid=101319) _read_sha256file /opt/stack/cinder/cinder/backup/chunkeddriver.py:333}} Jul 03 09:45:14.784092 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-5b578e84-b5bc-4a14-9ad7-6bb3bd07d595 tempest-VolumesBackupsTest-2142009639 None] decompressing data using zlib algorithm {{(pid=101319) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:722}} Jul 03 09:45:14.808502 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-e009ec27-4bef-44d5-8801-97ccc0ad8f75 tempest-VolumesBackupsTest-118275719 None] _read_sha256file finished. {{(pid=101319) _read_sha256file /opt/stack/cinder/cinder/backup/chunkeddriver.py:340}} Jul 03 09:45:14.815175 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-e009ec27-4bef-44d5-8801-97ccc0ad8f75 tempest-VolumesBackupsTest-118275719 None] _create_container started, container: volumebackups,backup: 435094a5-f336-4be4-826b-fa363af35296. {{(pid=101319) _create_container /opt/stack/cinder/cinder/backup/chunkeddriver.py:249}} Jul 03 09:45:14.847820 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-dd7cebed-c6db-4da9-be53-3cc828012d99 tempest-ProjectAdminTests33-1900627284 None] backup MD5 for volume_4b68dad5-e9a3-4bd1-84e2-ba745cb7bb83/20260703094505/az_nova_backup_cfdc4925-e984-4da2-aa3e-e1e8a7c37558-00013: 25e317773f308e446cc84c503a6d1f85 {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 09:45:14.848343 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-dd7cebed-c6db-4da9-be53-3cc828012d99 tempest-ProjectAdminTests33-1900627284 None] Calling eventlet.sleep(0) {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 09:45:14.851875 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.drivers.swift [None req-e009ec27-4bef-44d5-8801-97ccc0ad8f75 tempest-VolumesBackupsTest-118275719 None] generate_object_name_prefix: volume_b86cbab3-7c42-409e-b4f6-0ed61267a031/20260703094514/az_nova_backup_435094a5-f336-4be4-826b-fa363af35296 {{(pid=101319) _generate_object_name_prefix /opt/stack/cinder/cinder/backup/drivers/swift.py:452}} Jul 03 09:45:14.858631 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-e009ec27-4bef-44d5-8801-97ccc0ad8f75 tempest-VolumesBackupsTest-118275719 None] starting backup of volume: b86cbab3-7c42-409e-b4f6-0ed61267a031, volume size: 1073741824, object names prefix volume_b86cbab3-7c42-409e-b4f6-0ed61267a031/20260703094514/az_nova_backup_435094a5-f336-4be4-826b-fa363af35296, availability zone: nova {{(pid=101319) _prepare_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:359}} Jul 03 09:45:15.131880 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-5b578e84-b5bc-4a14-9ad7-6bb3bd07d595 tempest-VolumesBackupsTest-2142009639 None] restoring object. backup: a636aad8-67e3-4daa-ac42-7179916eefe7, container: tempest-volumesbackupstest-backup-container-313960817, object name: volume_b9d43525-b482-4d2d-8541-23ede348708e/20260703094447/az_nova_backup_a636aad8-67e3-4daa-ac42-7179916eefe7-00016, volume: d416aa2d-9214-4dcb-ba7c-32b834c4d794. {{(pid=101319) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:705}} Jul 03 09:45:15.149462 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-5b578e84-b5bc-4a14-9ad7-6bb3bd07d595 tempest-VolumesBackupsTest-2142009639 None] decompressing data using zlib algorithm {{(pid=101319) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:722}} Jul 03 09:45:15.187268 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-dd7cebed-c6db-4da9-be53-3cc828012d99 tempest-ProjectAdminTests33-1900627284 None] Backing up chunk of data from volume. {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 09:45:15.526258 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-dd7cebed-c6db-4da9-be53-3cc828012d99 tempest-ProjectAdminTests33-1900627284 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101319) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 09:45:15.526518 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-dd7cebed-c6db-4da9-be53-3cc828012d99 tempest-ProjectAdminTests33-1900627284 None] About to put_object {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 09:45:15.532272 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-5b578e84-b5bc-4a14-9ad7-6bb3bd07d595 tempest-VolumesBackupsTest-2142009639 None] restoring object. backup: a636aad8-67e3-4daa-ac42-7179916eefe7, container: tempest-volumesbackupstest-backup-container-313960817, object name: volume_b9d43525-b482-4d2d-8541-23ede348708e/20260703094447/az_nova_backup_a636aad8-67e3-4daa-ac42-7179916eefe7-00017, volume: d416aa2d-9214-4dcb-ba7c-32b834c4d794. {{(pid=101319) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:705}} Jul 03 09:45:15.555483 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-5b578e84-b5bc-4a14-9ad7-6bb3bd07d595 tempest-VolumesBackupsTest-2142009639 None] decompressing data using zlib algorithm {{(pid=101319) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:722}} Jul 03 09:45:15.651039 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-dd7cebed-c6db-4da9-be53-3cc828012d99 tempest-ProjectAdminTests33-1900627284 None] backup MD5 for volume_4b68dad5-e9a3-4bd1-84e2-ba745cb7bb83/20260703094505/az_nova_backup_cfdc4925-e984-4da2-aa3e-e1e8a7c37558-00014: 25e317773f308e446cc84c503a6d1f85 {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 09:45:15.651212 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-dd7cebed-c6db-4da9-be53-3cc828012d99 tempest-ProjectAdminTests33-1900627284 None] Calling eventlet.sleep(0) {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 09:45:15.950429 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-5b578e84-b5bc-4a14-9ad7-6bb3bd07d595 tempest-VolumesBackupsTest-2142009639 None] restoring object. backup: a636aad8-67e3-4daa-ac42-7179916eefe7, container: tempest-volumesbackupstest-backup-container-313960817, object name: volume_b9d43525-b482-4d2d-8541-23ede348708e/20260703094447/az_nova_backup_a636aad8-67e3-4daa-ac42-7179916eefe7-00018, volume: d416aa2d-9214-4dcb-ba7c-32b834c4d794. {{(pid=101319) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:705}} Jul 03 09:45:15.968380 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-5b578e84-b5bc-4a14-9ad7-6bb3bd07d595 tempest-VolumesBackupsTest-2142009639 None] decompressing data using zlib algorithm {{(pid=101319) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:722}} Jul 03 09:45:15.992298 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-dd7cebed-c6db-4da9-be53-3cc828012d99 tempest-ProjectAdminTests33-1900627284 None] Backing up chunk of data from volume. {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 09:45:16.315100 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-5b578e84-b5bc-4a14-9ad7-6bb3bd07d595 tempest-VolumesBackupsTest-2142009639 None] restoring object. backup: a636aad8-67e3-4daa-ac42-7179916eefe7, container: tempest-volumesbackupstest-backup-container-313960817, object name: volume_b9d43525-b482-4d2d-8541-23ede348708e/20260703094447/az_nova_backup_a636aad8-67e3-4daa-ac42-7179916eefe7-00019, volume: d416aa2d-9214-4dcb-ba7c-32b834c4d794. {{(pid=101319) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:705}} Jul 03 09:45:16.328648 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-dd7cebed-c6db-4da9-be53-3cc828012d99 tempest-ProjectAdminTests33-1900627284 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101319) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 09:45:16.328872 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-dd7cebed-c6db-4da9-be53-3cc828012d99 tempest-ProjectAdminTests33-1900627284 None] About to put_object {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 09:45:16.337691 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-5b578e84-b5bc-4a14-9ad7-6bb3bd07d595 tempest-VolumesBackupsTest-2142009639 None] decompressing data using zlib algorithm {{(pid=101319) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:722}} Jul 03 09:45:16.434072 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-dd7cebed-c6db-4da9-be53-3cc828012d99 tempest-ProjectAdminTests33-1900627284 None] backup MD5 for volume_4b68dad5-e9a3-4bd1-84e2-ba745cb7bb83/20260703094505/az_nova_backup_cfdc4925-e984-4da2-aa3e-e1e8a7c37558-00015: 25e317773f308e446cc84c503a6d1f85 {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 09:45:16.434266 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-dd7cebed-c6db-4da9-be53-3cc828012d99 tempest-ProjectAdminTests33-1900627284 None] Calling eventlet.sleep(0) {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 09:45:16.704389 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-5b578e84-b5bc-4a14-9ad7-6bb3bd07d595 tempest-VolumesBackupsTest-2142009639 None] restoring object. backup: a636aad8-67e3-4daa-ac42-7179916eefe7, container: tempest-volumesbackupstest-backup-container-313960817, object name: volume_b9d43525-b482-4d2d-8541-23ede348708e/20260703094447/az_nova_backup_a636aad8-67e3-4daa-ac42-7179916eefe7-00020, volume: d416aa2d-9214-4dcb-ba7c-32b834c4d794. {{(pid=101319) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:705}} Jul 03 09:45:16.719170 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-5b578e84-b5bc-4a14-9ad7-6bb3bd07d595 tempest-VolumesBackupsTest-2142009639 None] decompressing data using zlib algorithm {{(pid=101319) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:722}} Jul 03 09:45:16.752029 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-dd7cebed-c6db-4da9-be53-3cc828012d99 tempest-ProjectAdminTests33-1900627284 None] Backing up chunk of data from volume. {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 09:45:17.075326 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-dd7cebed-c6db-4da9-be53-3cc828012d99 tempest-ProjectAdminTests33-1900627284 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101319) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 09:45:17.075670 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-dd7cebed-c6db-4da9-be53-3cc828012d99 tempest-ProjectAdminTests33-1900627284 None] About to put_object {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 09:45:17.085949 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-5b578e84-b5bc-4a14-9ad7-6bb3bd07d595 tempest-VolumesBackupsTest-2142009639 None] restoring object. backup: a636aad8-67e3-4daa-ac42-7179916eefe7, container: tempest-volumesbackupstest-backup-container-313960817, object name: volume_b9d43525-b482-4d2d-8541-23ede348708e/20260703094447/az_nova_backup_a636aad8-67e3-4daa-ac42-7179916eefe7-00021, volume: d416aa2d-9214-4dcb-ba7c-32b834c4d794. {{(pid=101319) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:705}} Jul 03 09:45:17.104648 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-5b578e84-b5bc-4a14-9ad7-6bb3bd07d595 tempest-VolumesBackupsTest-2142009639 None] decompressing data using zlib algorithm {{(pid=101319) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:722}} Jul 03 09:45:17.190347 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-dd7cebed-c6db-4da9-be53-3cc828012d99 tempest-ProjectAdminTests33-1900627284 None] backup MD5 for volume_4b68dad5-e9a3-4bd1-84e2-ba745cb7bb83/20260703094505/az_nova_backup_cfdc4925-e984-4da2-aa3e-e1e8a7c37558-00016: 25e317773f308e446cc84c503a6d1f85 {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 09:45:17.190347 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-dd7cebed-c6db-4da9-be53-3cc828012d99 tempest-ProjectAdminTests33-1900627284 None] Calling eventlet.sleep(0) {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 09:45:17.310781 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-5b578e84-b5bc-4a14-9ad7-6bb3bd07d595 tempest-VolumesBackupsTest-2142009639 None] v1 volume backup restore of a636aad8-67e3-4daa-ac42-7179916eefe7 finished. {{(pid=101319) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:750}} Jul 03 09:45:17.311083 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.driver [None req-5b578e84-b5bc-4a14-9ad7-6bb3bd07d595 tempest-VolumesBackupsTest-2142009639 None] Restoring volume base metadata {{(pid=101319) _restore_vol_base_meta /opt/stack/cinder/cinder/backup/driver.py:177}} Jul 03 09:45:17.322790 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.driver [None req-5b578e84-b5bc-4a14-9ad7-6bb3bd07d595 tempest-VolumesBackupsTest-2142009639 None] No metadata of type 'volume-metadata' to restore {{(pid=101319) put /opt/stack/cinder/cinder/backup/driver.py:345}} Jul 03 09:45:17.323487 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.driver [None req-5b578e84-b5bc-4a14-9ad7-6bb3bd07d595 tempest-VolumesBackupsTest-2142009639 None] Restoring volume glance metadata {{(pid=101319) _restore_vol_glance_meta /opt/stack/cinder/cinder/backup/driver.py:258}} Jul 03 09:45:17.480931 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-5b578e84-b5bc-4a14-9ad7-6bb3bd07d595 tempest-VolumesBackupsTest-2142009639 None] restore a636aad8-67e3-4daa-ac42-7179916eefe7 to d416aa2d-9214-4dcb-ba7c-32b834c4d794 finished. {{(pid=101319) restore /opt/stack/cinder/cinder/backup/chunkeddriver.py:815}} Jul 03 09:45:17.489375 np0000004400 cinder-backup[101319]: DEBUG oslo_concurrency.processutils [None req-5b578e84-b5bc-4a14-9ad7-6bb3bd07d595 tempest-VolumesBackupsTest-2142009639 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chown 0 /dev/sdn {{(pid=101319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 09:45:17.509821 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-dd7cebed-c6db-4da9-be53-3cc828012d99 tempest-ProjectAdminTests33-1900627284 None] Backing up chunk of data from volume. {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 09:45:17.510352 np0000004400 sudo[136339]: stack : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chown 0 /dev/sdn Jul 03 09:45:17.510996 np0000004400 sudo[136339]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1002) Jul 03 09:45:17.763701 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-dd7cebed-c6db-4da9-be53-3cc828012d99 tempest-ProjectAdminTests33-1900627284 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101319) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 09:45:17.763701 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-dd7cebed-c6db-4da9-be53-3cc828012d99 tempest-ProjectAdminTests33-1900627284 None] About to put_object {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 09:45:17.830905 np0000004400 sudo[136339]: pam_unix(sudo:session): session closed for user root Jul 03 09:45:17.832951 np0000004400 cinder-backup[101319]: DEBUG oslo_concurrency.processutils [None req-5b578e84-b5bc-4a14-9ad7-6bb3bd07d595 tempest-VolumesBackupsTest-2142009639 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chown 0 /dev/sdn" returned: 0 in 0.343s {{(pid=101319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 09:45:17.833257 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b578e84-b5bc-4a14-9ad7-6bb3bd07d595 tempest-VolumesBackupsTest-2142009639 None] ==> disconnect_volume: call "{'args': (, {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-d416aa2d-9214-4dcb-ba7c-32b834c4d794', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'd416aa2d-9214-4dcb-ba7c-32b834c4d794', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': False}, {'type': 'block', 'scsi_wwn': 'SStorPool_iSCSI_DISK_1034578903445799025', 'path': '/dev/sdn'}), 'kwargs': {'force': True, 'ignore_errors': False}}" {{(pid=101319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}} Jul 03 09:45:17.833422 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.base [None req-5b578e84-b5bc-4a14-9ad7-6bb3bd07d595 tempest-VolumesBackupsTest-2142009639 None] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=101319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jul 03 09:45:17.833839 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.base [None req-5b578e84-b5bc-4a14-9ad7-6bb3bd07d595 tempest-VolumesBackupsTest-2142009639 None] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.000s {{(pid=101319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jul 03 09:45:17.834156 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b578e84-b5bc-4a14-9ad7-6bb3bd07d595 tempest-VolumesBackupsTest-2142009639 None] _get_connection_devices called with parameters: connection_properties={'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-d416aa2d-9214-4dcb-ba7c-32b834c4d794', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'd416aa2d-9214-4dcb-ba7c-32b834c4d794', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': False}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=101319) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:847}} Jul 03 09:45:17.847150 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b578e84-b5bc-4a14-9ad7-6bb3bd07d595 tempest-VolumesBackupsTest-2142009639 None] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS: Jul 03 09:45:17.847150 np0000004400 cinder-backup[101319]: No targets found. Jul 03 09:45:17.847150 np0000004400 cinder-backup[101319]: iSNS: Jul 03 09:45:17.847150 np0000004400 cinder-backup[101319]: No targets found. Jul 03 09:45:17.847150 np0000004400 cinder-backup[101319]: STATIC: Jul 03 09:45:17.847150 np0000004400 cinder-backup[101319]: Target: iqn.2023-03.storpool.com:os--volume-aecd73f6-86c7-4ae8-8bfa-b46655eb6efb Jul 03 09:45:17.847150 np0000004400 cinder-backup[101319]: Portal: 192.168.50.100:3260,-1 Jul 03 09:45:17.847150 np0000004400 cinder-backup[101319]: Iface Name: default Jul 03 09:45:17.847150 np0000004400 cinder-backup[101319]: Portal: 192.168.40.100:3260,-1 Jul 03 09:45:17.847150 np0000004400 cinder-backup[101319]: Iface Name: default Jul 03 09:45:17.847150 np0000004400 cinder-backup[101319]: Target: iqn.2023-03.storpool.com:os--volume-b86cbab3-7c42-409e-b4f6-0ed61267a031 Jul 03 09:45:17.847150 np0000004400 cinder-backup[101319]: Portal: 192.168.40.100:3260,-1 Jul 03 09:45:17.847150 np0000004400 cinder-backup[101319]: Iface Name: default Jul 03 09:45:17.847150 np0000004400 cinder-backup[101319]: Target: iqn.2023-03.storpool.com:os--volume-76320525-737e-4f58-8523-63ec9abbdc64 Jul 03 09:45:17.847150 np0000004400 cinder-backup[101319]: Portal: 192.168.50.100:3260,-1 Jul 03 09:45:17.847150 np0000004400 cinder-backup[101319]: Iface Name: default Jul 03 09:45:17.847150 np0000004400 cinder-backup[101319]: Portal: 192.168.40.100:3260,-1 Jul 03 09:45:17.847150 np0000004400 cinder-backup[101319]: Iface Name: default Jul 03 09:45:17.847150 np0000004400 cinder-backup[101319]: Target: iqn.2023-03.storpool.com:os--volume-b2e4f10c-8033-4c54-95a1-dfe45d6357a3 Jul 03 09:45:17.847150 np0000004400 cinder-backup[101319]: Portal: 192.168.50.100:3260,-1 Jul 03 09:45:17.847150 np0000004400 cinder-backup[101319]: Iface Name: default Jul 03 09:45:17.847150 np0000004400 cinder-backup[101319]: Portal: 192.168.40.100:3260,-1 Jul 03 09:45:17.847150 np0000004400 cinder-backup[101319]: Iface Name: default Jul 03 09:45:17.847150 np0000004400 cinder-backup[101319]: Target: iqn.2023-03.storpool.com:os--volume-4b68dad5-e9a3-4bd1-84e2-ba745cb7bb83 Jul 03 09:45:17.847150 np0000004400 cinder-backup[101319]: Portal: 192.168.40.100:3260,-1 Jul 03 09:45:17.847150 np0000004400 cinder-backup[101319]: Iface Name: default Jul 03 09:45:17.847150 np0000004400 cinder-backup[101319]: Target: iqn.2023-03.storpool.com:os--volume-d47f5d2f-dce5-42f7-a693-a654fd702622 Jul 03 09:45:17.847150 np0000004400 cinder-backup[101319]: Portal: 192.168.50.100:3260,-1 Jul 03 09:45:17.847150 np0000004400 cinder-backup[101319]: Iface Name: default Jul 03 09:45:17.847150 np0000004400 cinder-backup[101319]: Portal: 192.168.40.100:3260,-1 Jul 03 09:45:17.847150 np0000004400 cinder-backup[101319]: Iface Name: default Jul 03 09:45:17.847150 np0000004400 cinder-backup[101319]: Target: iqn.2023-03.storpool.com:os--volume-d416aa2d-9214-4dcb-ba7c-32b834c4d794 Jul 03 09:45:17.847150 np0000004400 cinder-backup[101319]: Portal: 192.168.40.100:3260,-1 Jul 03 09:45:17.847150 np0000004400 cinder-backup[101319]: Iface Name: default Jul 03 09:45:17.847150 np0000004400 cinder-backup[101319]: FIRMWARE: Jul 03 09:45:17.847150 np0000004400 cinder-backup[101319]: No targets found. Jul 03 09:45:17.847150 np0000004400 cinder-backup[101319]: stderr= {{(pid=101319) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jul 03 09:45:17.847150 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b578e84-b5bc-4a14-9ad7-6bb3bd07d595 tempest-VolumesBackupsTest-2142009639 None] Regex to get portals from discoverydb: ^SENDTARGETS: Jul 03 09:45:17.847150 np0000004400 cinder-backup[101319]: .*?^DiscoveryAddress: 192.168.40.100,3260.*? Jul 03 09:45:17.847150 np0000004400 cinder-backup[101319]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=101319) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:390}} Jul 03 09:45:17.849394 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b578e84-b5bc-4a14-9ad7-6bb3bd07d595 tempest-VolumesBackupsTest-2142009639 None] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-d416aa2d-9214-4dcb-ba7c-32b834c4d794', 0)] {{(pid=101319) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:858}} Jul 03 09:45:17.874851 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b578e84-b5bc-4a14-9ad7-6bb3bd07d595 tempest-VolumesBackupsTest-2142009639 None] iscsiadm ('-m', 'session'): stdout=tcp: [101] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-4b68dad5-e9a3-4bd1-84e2-ba745cb7bb83 (non-flash) Jul 03 09:45:17.874851 np0000004400 cinder-backup[101319]: tcp: [102] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d416aa2d-9214-4dcb-ba7c-32b834c4d794 (non-flash) Jul 03 09:45:17.874851 np0000004400 cinder-backup[101319]: tcp: [103] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b86cbab3-7c42-409e-b4f6-0ed61267a031 (non-flash) Jul 03 09:45:17.874851 np0000004400 cinder-backup[101319]: tcp: [49] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b2e4f10c-8033-4c54-95a1-dfe45d6357a3 (non-flash) Jul 03 09:45:17.874851 np0000004400 cinder-backup[101319]: tcp: [50] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b2e4f10c-8033-4c54-95a1-dfe45d6357a3 (non-flash) Jul 03 09:45:17.874851 np0000004400 cinder-backup[101319]: tcp: [82] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-76320525-737e-4f58-8523-63ec9abbdc64 (non-flash) Jul 03 09:45:17.874851 np0000004400 cinder-backup[101319]: tcp: [83] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-76320525-737e-4f58-8523-63ec9abbdc64 (non-flash) Jul 03 09:45:17.874851 np0000004400 cinder-backup[101319]: tcp: [93] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-aecd73f6-86c7-4ae8-8bfa-b46655eb6efb (non-flash) Jul 03 09:45:17.874851 np0000004400 cinder-backup[101319]: tcp: [94] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-aecd73f6-86c7-4ae8-8bfa-b46655eb6efb (non-flash) Jul 03 09:45:17.874851 np0000004400 cinder-backup[101319]: tcp: [97] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d47f5d2f-dce5-42f7-a693-a654fd702622 (non-flash) Jul 03 09:45:17.874851 np0000004400 cinder-backup[101319]: tcp: [98] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d47f5d2f-dce5-42f7-a693-a654fd702622 (non-flash) Jul 03 09:45:17.874851 np0000004400 cinder-backup[101319]: stderr= {{(pid=101319) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jul 03 09:45:17.874851 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b578e84-b5bc-4a14-9ad7-6bb3bd07d595 tempest-VolumesBackupsTest-2142009639 None] iscsi session list stdout=tcp: [101] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-4b68dad5-e9a3-4bd1-84e2-ba745cb7bb83 (non-flash) Jul 03 09:45:17.874851 np0000004400 cinder-backup[101319]: tcp: [102] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d416aa2d-9214-4dcb-ba7c-32b834c4d794 (non-flash) Jul 03 09:45:17.874851 np0000004400 cinder-backup[101319]: tcp: [103] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b86cbab3-7c42-409e-b4f6-0ed61267a031 (non-flash) Jul 03 09:45:17.874851 np0000004400 cinder-backup[101319]: tcp: [49] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b2e4f10c-8033-4c54-95a1-dfe45d6357a3 (non-flash) Jul 03 09:45:17.874851 np0000004400 cinder-backup[101319]: tcp: [50] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b2e4f10c-8033-4c54-95a1-dfe45d6357a3 (non-flash) Jul 03 09:45:17.874851 np0000004400 cinder-backup[101319]: tcp: [82] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-76320525-737e-4f58-8523-63ec9abbdc64 (non-flash) Jul 03 09:45:17.874851 np0000004400 cinder-backup[101319]: tcp: [83] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-76320525-737e-4f58-8523-63ec9abbdc64 (non-flash) Jul 03 09:45:17.874851 np0000004400 cinder-backup[101319]: tcp: [93] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-aecd73f6-86c7-4ae8-8bfa-b46655eb6efb (non-flash) Jul 03 09:45:17.874851 np0000004400 cinder-backup[101319]: tcp: [94] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-aecd73f6-86c7-4ae8-8bfa-b46655eb6efb (non-flash) Jul 03 09:45:17.874851 np0000004400 cinder-backup[101319]: tcp: [97] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d47f5d2f-dce5-42f7-a693-a654fd702622 (non-flash) Jul 03 09:45:17.874851 np0000004400 cinder-backup[101319]: tcp: [98] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d47f5d2f-dce5-42f7-a693-a654fd702622 (non-flash) Jul 03 09:45:17.874851 np0000004400 cinder-backup[101319]: stderr= {{(pid=101319) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jul 03 09:45:17.874851 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b578e84-b5bc-4a14-9ad7-6bb3bd07d595 tempest-VolumesBackupsTest-2142009639 None] Sessions list: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-4b68dad5-e9a3-4bd1-84e2-ba745cb7bb83', '101'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-d416aa2d-9214-4dcb-ba7c-32b834c4d794', '102'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-b86cbab3-7c42-409e-b4f6-0ed61267a031', '103'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-b2e4f10c-8033-4c54-95a1-dfe45d6357a3', '49'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-b2e4f10c-8033-4c54-95a1-dfe45d6357a3', '50'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-76320525-737e-4f58-8523-63ec9abbdc64', '82'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-76320525-737e-4f58-8523-63ec9abbdc64', '83'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-aecd73f6-86c7-4ae8-8bfa-b46655eb6efb', '93'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-aecd73f6-86c7-4ae8-8bfa-b46655eb6efb', '94'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-d47f5d2f-dce5-42f7-a693-a654fd702622', '97'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-d47f5d2f-dce5-42f7-a693-a654fd702622', '98')] {{(pid=101319) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:866}} Jul 03 09:45:17.874851 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b578e84-b5bc-4a14-9ad7-6bb3bd07d595 tempest-VolumesBackupsTest-2142009639 None] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-d416aa2d-9214-4dcb-ba7c-32b834c4d794, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-d416aa2d-9214-4dcb-ba7c-32b834c4d794', '102')] {{(pid=101319) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}} Jul 03 09:45:17.876226 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b578e84-b5bc-4a14-9ad7-6bb3bd07d595 tempest-VolumesBackupsTest-2142009639 None] Resulting device map defaultdict(. at 0x7e76e71f0900>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-d416aa2d-9214-4dcb-ba7c-32b834c4d794'): ({'sdn'}, set())}) {{(pid=101319) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:912}} Jul 03 09:45:17.876307 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.linuxscsi [None req-5b578e84-b5bc-4a14-9ad7-6bb3bd07d595 tempest-VolumesBackupsTest-2142009639 None] Removing single pathed devices sdn {{(pid=101319) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}} Jul 03 09:45:17.877640 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-dd7cebed-c6db-4da9-be53-3cc828012d99 tempest-ProjectAdminTests33-1900627284 None] backup MD5 for volume_4b68dad5-e9a3-4bd1-84e2-ba745cb7bb83/20260703094505/az_nova_backup_cfdc4925-e984-4da2-aa3e-e1e8a7c37558-00017: 25e317773f308e446cc84c503a6d1f85 {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 09:45:17.877640 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-dd7cebed-c6db-4da9-be53-3cc828012d99 tempest-ProjectAdminTests33-1900627284 None] Calling eventlet.sleep(0) {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 09:45:17.890052 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.linuxscsi [None req-5b578e84-b5bc-4a14-9ad7-6bb3bd07d595 tempest-VolumesBackupsTest-2142009639 None] Flushing IO for device /dev/sdn {{(pid=101319) flush_device_io /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:461}} Jul 03 09:45:17.899505 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.linuxscsi [None req-5b578e84-b5bc-4a14-9ad7-6bb3bd07d595 tempest-VolumesBackupsTest-2142009639 None] Remove SCSI device /dev/sdn with /sys/block/sdn/device/delete {{(pid=101319) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}} Jul 03 09:45:17.960972 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.linuxscsi [None req-5b578e84-b5bc-4a14-9ad7-6bb3bd07d595 tempest-VolumesBackupsTest-2142009639 None] Checking to see if SCSI volumes sdn have been removed. {{(pid=101319) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}} Jul 03 09:45:17.961426 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.linuxscsi [None req-5b578e84-b5bc-4a14-9ad7-6bb3bd07d595 tempest-VolumesBackupsTest-2142009639 None] SCSI volumes sdn have been removed. {{(pid=101319) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}} Jul 03 09:45:17.963091 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.linuxscsi [None req-5b578e84-b5bc-4a14-9ad7-6bb3bd07d595 tempest-VolumesBackupsTest-2142009639 None] Checking to see if device paths {'sdn'} are still under multipathd monitoring {{(pid=101319) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}} Jul 03 09:45:17.974908 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.linuxscsi [None req-5b578e84-b5bc-4a14-9ad7-6bb3bd07d595 tempest-VolumesBackupsTest-2142009639 None] Device paths {'sdn'} have been removed from multipathd monitoring. {{(pid=101319) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}} Jul 03 09:45:17.974908 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b578e84-b5bc-4a14-9ad7-6bb3bd07d595 tempest-VolumesBackupsTest-2142009639 None] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-d416aa2d-9214-4dcb-ba7c-32b834c4d794')] {{(pid=101319) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1225}} Jul 03 09:45:17.986358 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b578e84-b5bc-4a14-9ad7-6bb3bd07d595 tempest-VolumesBackupsTest-2142009639 None] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=101319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 03 09:45:18.028055 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b578e84-b5bc-4a14-9ad7-6bb3bd07d595 tempest-VolumesBackupsTest-2142009639 None] iscsiadm ('--logout',): stdout=Logging out of session [sid: 102, target: iqn.2023-03.storpool.com:os--volume-d416aa2d-9214-4dcb-ba7c-32b834c4d794, portal: 192.168.40.100,3260] Jul 03 09:45:18.028055 np0000004400 cinder-backup[101319]: Logout of [sid: 102, target: iqn.2023-03.storpool.com:os--volume-d416aa2d-9214-4dcb-ba7c-32b834c4d794, portal: 192.168.40.100,3260] successful. Jul 03 09:45:18.028055 np0000004400 cinder-backup[101319]: stderr= {{(pid=101319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 03 09:45:18.051986 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b578e84-b5bc-4a14-9ad7-6bb3bd07d595 tempest-VolumesBackupsTest-2142009639 None] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=101319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 03 09:45:18.051986 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.base [None req-5b578e84-b5bc-4a14-9ad7-6bb3bd07d595 tempest-VolumesBackupsTest-2142009639 None] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.218s {{(pid=101319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jul 03 09:45:18.051986 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b578e84-b5bc-4a14-9ad7-6bb3bd07d595 tempest-VolumesBackupsTest-2142009639 None] <== disconnect_volume: return (218ms) None {{(pid=101319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}} Jul 03 09:45:18.226165 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-dd7cebed-c6db-4da9-be53-3cc828012d99 tempest-ProjectAdminTests33-1900627284 None] Backing up chunk of data from volume. {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 09:45:18.511975 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-dd7cebed-c6db-4da9-be53-3cc828012d99 tempest-ProjectAdminTests33-1900627284 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101319) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 09:45:18.512115 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-dd7cebed-c6db-4da9-be53-3cc828012d99 tempest-ProjectAdminTests33-1900627284 None] About to put_object {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 09:45:18.639153 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-dd7cebed-c6db-4da9-be53-3cc828012d99 tempest-ProjectAdminTests33-1900627284 None] backup MD5 for volume_4b68dad5-e9a3-4bd1-84e2-ba745cb7bb83/20260703094505/az_nova_backup_cfdc4925-e984-4da2-aa3e-e1e8a7c37558-00018: 25e317773f308e446cc84c503a6d1f85 {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 09:45:18.639416 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-dd7cebed-c6db-4da9-be53-3cc828012d99 tempest-ProjectAdminTests33-1900627284 None] Calling eventlet.sleep(0) {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 09:45:18.875118 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-dd7cebed-c6db-4da9-be53-3cc828012d99 tempest-ProjectAdminTests33-1900627284 None] Backing up chunk of data from volume. {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 09:45:19.065532 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.manager [None req-5b578e84-b5bc-4a14-9ad7-6bb3bd07d595 tempest-VolumesBackupsTest-2142009639 None] Encryption key ID for volume d416aa2d-9214-4dcb-ba7c-32b834c4d794 already matches encryption key ID in backup a636aad8-67e3-4daa-ac42-7179916eefe7. {{(pid=101319) _run_restore /opt/stack/cinder/cinder/backup/manager.py:873}} Jul 03 09:45:19.103791 np0000004400 cinder-backup[101319]: INFO cinder.backup.manager [None req-5b578e84-b5bc-4a14-9ad7-6bb3bd07d595 tempest-VolumesBackupsTest-2142009639 None] Finished restoring backup a636aad8-67e3-4daa-ac42-7179916eefe7 to volume d416aa2d-9214-4dcb-ba7c-32b834c4d794. Jul 03 09:45:19.130652 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-dd7cebed-c6db-4da9-be53-3cc828012d99 tempest-ProjectAdminTests33-1900627284 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101319) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 09:45:19.130780 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-dd7cebed-c6db-4da9-be53-3cc828012d99 tempest-ProjectAdminTests33-1900627284 None] About to put_object {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 09:45:19.233461 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-dd7cebed-c6db-4da9-be53-3cc828012d99 tempest-ProjectAdminTests33-1900627284 None] backup MD5 for volume_4b68dad5-e9a3-4bd1-84e2-ba745cb7bb83/20260703094505/az_nova_backup_cfdc4925-e984-4da2-aa3e-e1e8a7c37558-00019: 25e317773f308e446cc84c503a6d1f85 {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 09:45:19.233817 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-dd7cebed-c6db-4da9-be53-3cc828012d99 tempest-ProjectAdminTests33-1900627284 None] Calling eventlet.sleep(0) {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 09:45:19.556751 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-dd7cebed-c6db-4da9-be53-3cc828012d99 tempest-ProjectAdminTests33-1900627284 None] Backing up chunk of data from volume. {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 09:45:19.826396 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-dd7cebed-c6db-4da9-be53-3cc828012d99 tempest-ProjectAdminTests33-1900627284 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101319) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 09:45:19.826640 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-dd7cebed-c6db-4da9-be53-3cc828012d99 tempest-ProjectAdminTests33-1900627284 None] About to put_object {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 09:45:19.943726 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-dd7cebed-c6db-4da9-be53-3cc828012d99 tempest-ProjectAdminTests33-1900627284 None] backup MD5 for volume_4b68dad5-e9a3-4bd1-84e2-ba745cb7bb83/20260703094505/az_nova_backup_cfdc4925-e984-4da2-aa3e-e1e8a7c37558-00020: 25e317773f308e446cc84c503a6d1f85 {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 09:45:19.943994 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-dd7cebed-c6db-4da9-be53-3cc828012d99 tempest-ProjectAdminTests33-1900627284 None] Calling eventlet.sleep(0) {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 09:45:20.072436 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-dd7cebed-c6db-4da9-be53-3cc828012d99 tempest-ProjectAdminTests33-1900627284 None] Backing up chunk of data from volume. {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 09:45:20.214274 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-dd7cebed-c6db-4da9-be53-3cc828012d99 tempest-ProjectAdminTests33-1900627284 None] Compressed 25165824 bytes of data to 24470 bytes using zlib. {{(pid=101319) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 09:45:20.214447 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-dd7cebed-c6db-4da9-be53-3cc828012d99 tempest-ProjectAdminTests33-1900627284 None] About to put_object {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 09:45:20.282868 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-dd7cebed-c6db-4da9-be53-3cc828012d99 tempest-ProjectAdminTests33-1900627284 None] backup MD5 for volume_4b68dad5-e9a3-4bd1-84e2-ba745cb7bb83/20260703094505/az_nova_backup_cfdc4925-e984-4da2-aa3e-e1e8a7c37558-00021: 77377273b0a4b61febdbf7bbf52b9db9 {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 09:45:20.283295 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-dd7cebed-c6db-4da9-be53-3cc828012d99 tempest-ProjectAdminTests33-1900627284 None] Calling eventlet.sleep(0) {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 09:45:20.290226 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.driver [None req-dd7cebed-c6db-4da9-be53-3cc828012d99 tempest-ProjectAdminTests33-1900627284 None] Getting metadata type 'volume-base-metadata' {{(pid=101319) _save_vol_base_meta /opt/stack/cinder/cinder/backup/driver.py:79}} Jul 03 09:45:20.296289 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.driver [None req-dd7cebed-c6db-4da9-be53-3cc828012d99 tempest-ProjectAdminTests33-1900627284 None] Completed fetching metadata type 'volume-base-metadata' {{(pid=101319) _save_vol_base_meta /opt/stack/cinder/cinder/backup/driver.py:98}} Jul 03 09:45:20.296461 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.driver [None req-dd7cebed-c6db-4da9-be53-3cc828012d99 tempest-ProjectAdminTests33-1900627284 None] Getting metadata type 'volume-metadata' {{(pid=101319) _save_vol_meta /opt/stack/cinder/cinder/backup/driver.py:109}} Jul 03 09:45:20.301030 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.driver [None req-dd7cebed-c6db-4da9-be53-3cc828012d99 tempest-ProjectAdminTests33-1900627284 None] No metadata type 'volume-metadata' available {{(pid=101319) _save_vol_meta /opt/stack/cinder/cinder/backup/driver.py:123}} Jul 03 09:45:20.301188 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.driver [None req-dd7cebed-c6db-4da9-be53-3cc828012d99 tempest-ProjectAdminTests33-1900627284 None] Getting metadata type 'volume-glance-metadata' {{(pid=101319) _save_vol_glance_meta /opt/stack/cinder/cinder/backup/driver.py:132}} Jul 03 09:45:20.304151 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.driver [None req-dd7cebed-c6db-4da9-be53-3cc828012d99 tempest-ProjectAdminTests33-1900627284 None] No metadata type 'volume-glance-metadata' available {{(pid=101319) _save_vol_glance_meta /opt/stack/cinder/cinder/backup/driver.py:147}} Jul 03 09:45:20.304336 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-dd7cebed-c6db-4da9-be53-3cc828012d99 tempest-ProjectAdminTests33-1900627284 None] _write_sha256file started, container name: volumebackups, sha256file filename: volume_4b68dad5-e9a3-4bd1-84e2-ba745cb7bb83/20260703094505/az_nova_backup_cfdc4925-e984-4da2-aa3e-e1e8a7c37558_sha256file. {{(pid=101319) _write_sha256file /opt/stack/cinder/cinder/backup/chunkeddriver.py:299}} Jul 03 09:45:20.373937 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-dd7cebed-c6db-4da9-be53-3cc828012d99 tempest-ProjectAdminTests33-1900627284 None] _write_sha256file finished. {{(pid=101319) _write_sha256file /opt/stack/cinder/cinder/backup/chunkeddriver.py:315}} Jul 03 09:45:20.374604 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-dd7cebed-c6db-4da9-be53-3cc828012d99 tempest-ProjectAdminTests33-1900627284 None] _write_metadata started, container name: volumebackups, metadata filename: volume_4b68dad5-e9a3-4bd1-84e2-ba745cb7bb83/20260703094505/az_nova_backup_cfdc4925-e984-4da2-aa3e-e1e8a7c37558_metadata. {{(pid=101319) _write_metadata /opt/stack/cinder/cinder/backup/chunkeddriver.py:276}} Jul 03 09:45:20.401593 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-dd7cebed-c6db-4da9-be53-3cc828012d99 tempest-ProjectAdminTests33-1900627284 None] _write_metadata finished. Metadata: b'{\n "backup_description": null,\n "backup_id": "cfdc4925-e984-4da2-aa3e-e1e8a7c37558",\n "backup_name": "tempest-type-Backup-880845111",\n "created_at": "2026-07-03 09:45:01+00:00",\n "objects": [\n {\n "volume_4b68dad5-e9a3-4bd1-84e2-ba745cb7bb83/20260703094505/az_nova_backup_cfdc4925-e984-4da2-aa3e-e1e8a7c37558-00001": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 0\n }\n },\n {\n "volume_4b68dad5-e9a3-4bd1-84e2-ba745cb7bb83/20260703094505/az_nova_backup_cfdc4925-e984-4da2-aa3e-e1e8a7c37558-00002": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 52428800\n }\n },\n {\n "volume_4b68dad5-e9a3-4bd1-84e2-ba745cb7bb83/20260703094505/az_nova_backup_cfdc4925-e984-4da2-aa3e-e1e8a7c37558-00003": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 104857600\n }\n },\n {\n "volume_4b68dad5-e9a3-4bd1-84e2-ba745cb7bb83/20260703094505/az_nova_backup_cfdc4925-e984-4da2-aa3e-e1e8a7c37558-00004": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 157286400\n }\n },\n {\n "volume_4b68dad5-e9a3-4bd1-84e2-ba745cb7bb83/20260703094505/az_nova_backup_cfdc4925-e984-4da2-aa3e-e1e8a7c37558-00005": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 209715200\n }\n },\n {\n "volume_4b68dad5-e9a3-4bd1-84e2-ba745cb7bb83/20260703094505/az_nova_backup_cfdc4925-e984-4da2-aa3e-e1e8a7c37558-00006": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 262144000\n }\n },\n {\n "volume_4b68dad5-e9a3-4bd1-84e2-ba745cb7bb83/20260703094505/az_nova_backup_cfdc4925-e984-4da2-aa3e-e1e8a7c37558-00007": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 314572800\n }\n },\n {\n "volume_4b68dad5-e9a3-4bd1-84e2-ba745cb7bb83/20260703094505/az_nova_backup_cfdc4925-e984-4da2-aa3e-e1e8a7c37558-00008": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 367001600\n }\n },\n {\n "volume_4b68dad5-e9a3-4bd1-84e2-ba745cb7bb83/20260703094505/az_nova_backup_cfdc4925-e984-4da2-aa3e-e1e8a7c37558-00009": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 419430400\n }\n },\n {\n "volume_4b68dad5-e9a3-4bd1-84e2-ba745cb7bb83/20260703094505/az_nova_backup_cfdc4925-e984-4da2-aa3e-e1e8a7c37558-00010": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 471859200\n }\n },\n {\n "volume_4b68dad5-e9a3-4bd1-84e2-ba745cb7bb83/20260703094505/az_nova_backup_cfdc4925-e984-4da2-aa3e-e1e8a7c37558-00011": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 524288000\n }\n },\n {\n "volume_4b68dad5-e9a3-4bd1-84e2-ba745cb7bb83/20260703094505/az_nova_backup_cfdc4925-e984-4da2-aa3e-e1e8a7c37558-00012": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 576716800\n }\n },\n {\n "volume_4b68dad5-e9a3-4bd1-84e2-ba745cb7bb83/20260703094505/az_nova_backup_cfdc4925-e984-4da2-aa3e-e1e8a7c37558-00013": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 629145600\n }\n },\n {\n "volume_4b68dad5-e9a3-4bd1-84e2-ba745cb7bb83/20260703094505/az_nova_backup_cfdc4925-e984-4da2-aa3e-e1e8a7c37558-00014": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 681574400\n }\n },\n {\n "volume_4b68dad5-e9a3-4bd1-84e2-ba745cb7bb83/20260703094505/az_nova_backup_cfdc4925-e984-4da2-aa3e-e1e8a7c37558-00015": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 734003200\n }\n },\n {\n "volume_4b68dad5-e9a3-4bd1-84e2-ba745cb7bb83/20260703094505/az_nova_backup_cfdc4925-e984-4da2-aa3e-e1e8a7c37558-00016": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 786432000\n }\n },\n {\n "volume_4b68dad5-e9a3-4bd1-84e2-ba745cb7bb83/20260703094505/az_nova_backup_cfdc4925-e984-4da2-aa3e-e1e8a7c37558-00017": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 838860800\n }\n },\n {\n "volume_4b68dad5-e9a3-4bd1-84e2-ba745cb7bb83/20260703094505/az_nova_backup_cfdc4925-e984-4da2-aa3e-e1e8a7c37558-00018": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 891289600\n }\n },\n {\n "volume_4b68dad5-e9a3-4bd1-84e2-ba745cb7bb83/20260703094505/az_nova_backup_cfdc4925-e984-4da2-aa3e-e1e8a7c37558-00019": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 943718400\n }\n },\n {\n "volume_4b68dad5-e9a3-4bd1-84e2-ba745cb7bb83/20260703094505/az_nova_backup_cfdc4925-e984-4da2-aa3e-e1e8a7c37558-00020": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 996147200\n }\n },\n {\n "volume_4b68dad5-e9a3-4bd1-84e2-ba745cb7bb83/20260703094505/az_nova_backup_cfdc4925-e984-4da2-aa3e-e1e8a7c37558-00021": {\n "compression": "zlib",\n "length": 25165824,\n "md5": "77377273b0a4b61febdbf7bbf52b9db9",\n "offset": 1048576000\n }\n }\n ],\n "parent_id": null,\n "version": "1.0.0",\n "volume_id": "4b68dad5-e9a3-4bd1-84e2-ba745cb7bb83",\n "volume_meta": "{\\"version\\": 2, \\"volume-base-metadata\\": {\\"id\\": \\"4b68dad5-e9a3-4bd1-84e2-ba745cb7bb83\\", \\"_name_id\\": null, \\"use_quota\\": true, \\"ec2_id\\": null, \\"user_id\\": \\"23ba560f6eed465495956e82c26b6f69\\", \\"project_id\\": \\"a2309d0555a742279b4a5017d94ebf02\\", \\"snapshot_id\\": null, \\"cluster_name\\": null, \\"host\\": \\"np0000004400@storpool#template_virtual\\", \\"size\\": 1, \\"availability_zone\\": \\"nova\\", \\"status\\": \\"backing-up\\", \\"attach_status\\": \\"detached\\", \\"migration_status\\": null, \\"scheduled_at\\": \\"2026-07-03T09:45:00.000000\\", \\"launched_at\\": \\"2026-07-03T09:45:00.000000\\", \\"terminated_at\\": null, \\"display_name\\": \\"tempest-VolumeV3RbacBaseTests-Volume-1547982480\\", \\"display_description\\": null, \\"provider_location\\": null, \\"provider_auth\\": null, \\"provider_geometry\\": null, \\"provider_id\\": null, \\"volume_type_id\\": \\"03e13fe6-0e30-4803-ace0-725d38e6dc24\\", \\"source_volid\\": null, \\"encryption_key_id\\": null, \\"consistencygroup_id\\": null, \\"group_id\\": null, \\"bootable\\": false, \\"multiattach\\": false, \\"replication_status\\": null, \\"replication_extended_status\\": null, \\"replication_driver_data\\": null, \\"previous_status\\": \\"available\\", \\"service_uuid\\": \\"6d4b0e79-fefe-4744-b25f-34be05095200\\", \\"shared_targets\\": true, \\"deleted_at\\": null, \\"deleted\\": false, \\"created_at\\": \\"2026-07-03T09:45:00.000000\\", \\"updated_at\\": \\"2026-07-03T09:45:01.000000\\"}}"\n}'. {{(pid=101319) _write_metadata /opt/stack/cinder/cinder/backup/chunkeddriver.py:295}} Jul 03 09:45:20.407315 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-dd7cebed-c6db-4da9-be53-3cc828012d99 tempest-ProjectAdminTests33-1900627284 None] backup cfdc4925-e984-4da2-aa3e-e1e8a7c37558 finished. {{(pid=101319) _finalize_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:462}} Jul 03 09:45:20.537343 np0000004400 cinder-backup[101319]: DEBUG oslo_concurrency.processutils [None req-dd7cebed-c6db-4da9-be53-3cc828012d99 tempest-ProjectAdminTests33-1900627284 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chown 0 /dev/sde {{(pid=101319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 09:45:20.558282 np0000004400 sudo[136396]: stack : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chown 0 /dev/sde Jul 03 09:45:20.559699 np0000004400 sudo[136396]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1002) Jul 03 09:45:20.652003 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.driver [None req-e009ec27-4bef-44d5-8801-97ccc0ad8f75 tempest-VolumesBackupsTest-118275719 None] Getting metadata type 'volume-base-metadata' {{(pid=101319) _save_vol_base_meta /opt/stack/cinder/cinder/backup/driver.py:79}} Jul 03 09:45:20.658304 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.driver [None req-e009ec27-4bef-44d5-8801-97ccc0ad8f75 tempest-VolumesBackupsTest-118275719 None] Completed fetching metadata type 'volume-base-metadata' {{(pid=101319) _save_vol_base_meta /opt/stack/cinder/cinder/backup/driver.py:98}} Jul 03 09:45:20.658511 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.driver [None req-e009ec27-4bef-44d5-8801-97ccc0ad8f75 tempest-VolumesBackupsTest-118275719 None] Getting metadata type 'volume-metadata' {{(pid=101319) _save_vol_meta /opt/stack/cinder/cinder/backup/driver.py:109}} Jul 03 09:45:20.662597 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.driver [None req-e009ec27-4bef-44d5-8801-97ccc0ad8f75 tempest-VolumesBackupsTest-118275719 None] No metadata type 'volume-metadata' available {{(pid=101319) _save_vol_meta /opt/stack/cinder/cinder/backup/driver.py:123}} Jul 03 09:45:20.662768 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.driver [None req-e009ec27-4bef-44d5-8801-97ccc0ad8f75 tempest-VolumesBackupsTest-118275719 None] Getting metadata type 'volume-glance-metadata' {{(pid=101319) _save_vol_glance_meta /opt/stack/cinder/cinder/backup/driver.py:132}} Jul 03 09:45:20.665816 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.driver [None req-e009ec27-4bef-44d5-8801-97ccc0ad8f75 tempest-VolumesBackupsTest-118275719 None] No metadata type 'volume-glance-metadata' available {{(pid=101319) _save_vol_glance_meta /opt/stack/cinder/cinder/backup/driver.py:147}} Jul 03 09:45:20.666136 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-e009ec27-4bef-44d5-8801-97ccc0ad8f75 tempest-VolumesBackupsTest-118275719 None] _write_sha256file started, container name: volumebackups, sha256file filename: volume_b86cbab3-7c42-409e-b4f6-0ed61267a031/20260703094514/az_nova_backup_435094a5-f336-4be4-826b-fa363af35296_sha256file. {{(pid=101319) _write_sha256file /opt/stack/cinder/cinder/backup/chunkeddriver.py:299}} Jul 03 09:45:20.719166 np0000004400 cinder-backup[101319]: INFO cinder.backup.manager [None req-97d75019-b038-42f5-953e-f68f76157eba tempest-VolumesBackupsTest-2142009639 None] Delete backup started, backup: a636aad8-67e3-4daa-ac42-7179916eefe7. Jul 03 09:45:20.726971 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.drivers.swift [None req-97d75019-b038-42f5-953e-f68f76157eba tempest-VolumesBackupsTest-2142009639 None] Using swift URL https://10.4.3.95:8080/v1/AUTH_59044e18a5b24b19a7b9b8a380f2e1a0 {{(pid=101319) initialize /opt/stack/cinder/cinder/backup/drivers/swift.py:300}} Jul 03 09:45:20.728186 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.drivers.swift [None req-97d75019-b038-42f5-953e-f68f76157eba tempest-VolumesBackupsTest-2142009639 None] Connect to https://10.4.3.95:8080/v1/AUTH_ in "per_user" mode {{(pid=101319) initialize /opt/stack/cinder/cinder/backup/drivers/swift.py:301}} Jul 03 09:45:20.728479 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-97d75019-b038-42f5-953e-f68f76157eba tempest-VolumesBackupsTest-2142009639 None] delete started, backup: a636aad8-67e3-4daa-ac42-7179916eefe7, container: tempest-volumesbackupstest-backup-container-313960817, prefix: volume_b9d43525-b482-4d2d-8541-23ede348708e/20260703094447/az_nova_backup_a636aad8-67e3-4daa-ac42-7179916eefe7. {{(pid=101319) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:822}} Jul 03 09:45:20.737299 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-e009ec27-4bef-44d5-8801-97ccc0ad8f75 tempest-VolumesBackupsTest-118275719 None] _write_sha256file finished. {{(pid=101319) _write_sha256file /opt/stack/cinder/cinder/backup/chunkeddriver.py:315}} Jul 03 09:45:20.738160 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-e009ec27-4bef-44d5-8801-97ccc0ad8f75 tempest-VolumesBackupsTest-118275719 None] _write_metadata started, container name: volumebackups, metadata filename: volume_b86cbab3-7c42-409e-b4f6-0ed61267a031/20260703094514/az_nova_backup_435094a5-f336-4be4-826b-fa363af35296_metadata. {{(pid=101319) _write_metadata /opt/stack/cinder/cinder/backup/chunkeddriver.py:276}} Jul 03 09:45:20.767665 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-97d75019-b038-42f5-953e-f68f76157eba tempest-VolumesBackupsTest-2142009639 None] generated object list: ['volume_b9d43525-b482-4d2d-8541-23ede348708e/20260703094447/az_nova_backup_a636aad8-67e3-4daa-ac42-7179916eefe7-00001', 'volume_b9d43525-b482-4d2d-8541-23ede348708e/20260703094447/az_nova_backup_a636aad8-67e3-4daa-ac42-7179916eefe7-00002', 'volume_b9d43525-b482-4d2d-8541-23ede348708e/20260703094447/az_nova_backup_a636aad8-67e3-4daa-ac42-7179916eefe7-00003', 'volume_b9d43525-b482-4d2d-8541-23ede348708e/20260703094447/az_nova_backup_a636aad8-67e3-4daa-ac42-7179916eefe7-00004', 'volume_b9d43525-b482-4d2d-8541-23ede348708e/20260703094447/az_nova_backup_a636aad8-67e3-4daa-ac42-7179916eefe7-00005', 'volume_b9d43525-b482-4d2d-8541-23ede348708e/20260703094447/az_nova_backup_a636aad8-67e3-4daa-ac42-7179916eefe7-00006', 'volume_b9d43525-b482-4d2d-8541-23ede348708e/20260703094447/az_nova_backup_a636aad8-67e3-4daa-ac42-7179916eefe7-00007', 'volume_b9d43525-b482-4d2d-8541-23ede348708e/20260703094447/az_nova_backup_a636aad8-67e3-4daa-ac42-7179916eefe7-00008', 'volume_b9d43525-b482-4d2d-8541-23ede348708e/20260703094447/az_nova_backup_a636aad8-67e3-4daa-ac42-7179916eefe7-00009', 'volume_b9d43525-b482-4d2d-8541-23ede348708e/20260703094447/az_nova_backup_a636aad8-67e3-4daa-ac42-7179916eefe7-00010', 'volume_b9d43525-b482-4d2d-8541-23ede348708e/20260703094447/az_nova_backup_a636aad8-67e3-4daa-ac42-7179916eefe7-00011', 'volume_b9d43525-b482-4d2d-8541-23ede348708e/20260703094447/az_nova_backup_a636aad8-67e3-4daa-ac42-7179916eefe7-00012', 'volume_b9d43525-b482-4d2d-8541-23ede348708e/20260703094447/az_nova_backup_a636aad8-67e3-4daa-ac42-7179916eefe7-00013', 'volume_b9d43525-b482-4d2d-8541-23ede348708e/20260703094447/az_nova_backup_a636aad8-67e3-4daa-ac42-7179916eefe7-00014', 'volume_b9d43525-b482-4d2d-8541-23ede348708e/20260703094447/az_nova_backup_a636aad8-67e3-4daa-ac42-7179916eefe7-00015', 'volume_b9d43525-b482-4d2d-8541-23ede348708e/20260703094447/az_nova_backup_a636aad8-67e3-4daa-ac42-7179916eefe7-00016', 'volume_b9d43525-b482-4d2d-8541-23ede348708e/20260703094447/az_nova_backup_a636aad8-67e3-4daa-ac42-7179916eefe7-00017', 'volume_b9d43525-b482-4d2d-8541-23ede348708e/20260703094447/az_nova_backup_a636aad8-67e3-4daa-ac42-7179916eefe7-00018', 'volume_b9d43525-b482-4d2d-8541-23ede348708e/20260703094447/az_nova_backup_a636aad8-67e3-4daa-ac42-7179916eefe7-00019', 'volume_b9d43525-b482-4d2d-8541-23ede348708e/20260703094447/az_nova_backup_a636aad8-67e3-4daa-ac42-7179916eefe7-00020', 'volume_b9d43525-b482-4d2d-8541-23ede348708e/20260703094447/az_nova_backup_a636aad8-67e3-4daa-ac42-7179916eefe7-00021', 'volume_b9d43525-b482-4d2d-8541-23ede348708e/20260703094447/az_nova_backup_a636aad8-67e3-4daa-ac42-7179916eefe7_metadata', 'volume_b9d43525-b482-4d2d-8541-23ede348708e/20260703094447/az_nova_backup_a636aad8-67e3-4daa-ac42-7179916eefe7_sha256file']. {{(pid=101319) _generate_object_names /opt/stack/cinder/cinder/backup/chunkeddriver.py:260}} Jul 03 09:45:20.771223 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-e009ec27-4bef-44d5-8801-97ccc0ad8f75 tempest-VolumesBackupsTest-118275719 None] _write_metadata finished. Metadata: b'{\n "backup_description": null,\n "backup_id": "435094a5-f336-4be4-826b-fa363af35296",\n "backup_name": "tempest-VolumesBackupsTest-Backup-705531849",\n "created_at": "2026-07-03 09:45:11+00:00",\n "objects": [],\n "parent_id": "3087847d-58e1-4a0c-af9c-2639ae9f2aeb",\n "version": "1.0.0",\n "volume_id": "b86cbab3-7c42-409e-b4f6-0ed61267a031",\n "volume_meta": "{\\"version\\": 2, \\"volume-base-metadata\\": {\\"id\\": \\"b86cbab3-7c42-409e-b4f6-0ed61267a031\\", \\"_name_id\\": null, \\"use_quota\\": true, \\"ec2_id\\": null, \\"user_id\\": \\"b861df2a13684334b293b1f348152e37\\", \\"project_id\\": \\"a484ec9218bf417bb9d7575ae6370646\\", \\"snapshot_id\\": null, \\"cluster_name\\": null, \\"host\\": \\"np0000004400@storpool#default\\", \\"size\\": 1, \\"availability_zone\\": \\"nova\\", \\"status\\": \\"backing-up\\", \\"attach_status\\": \\"detached\\", \\"migration_status\\": null, \\"scheduled_at\\": \\"2026-07-03T09:44:52.000000\\", \\"launched_at\\": \\"2026-07-03T09:44:52.000000\\", \\"terminated_at\\": null, \\"display_name\\": \\"tempest-VolumesBackupsTest-Volume-504009765\\", \\"display_description\\": null, \\"provider_location\\": null, \\"provider_auth\\": null, \\"provider_geometry\\": null, \\"provider_id\\": null, \\"volume_type_id\\": \\"03e13fe6-0e30-4803-ace0-725d38e6dc24\\", \\"source_volid\\": null, \\"encryption_key_id\\": null, \\"consistencygroup_id\\": null, \\"group_id\\": null, \\"bootable\\": false, \\"multiattach\\": false, \\"replication_status\\": null, \\"replication_extended_status\\": null, \\"replication_driver_data\\": null, \\"previous_status\\": \\"available\\", \\"service_uuid\\": \\"6d4b0e79-fefe-4744-b25f-34be05095200\\", \\"shared_targets\\": true, \\"deleted_at\\": null, \\"deleted\\": false, \\"created_at\\": \\"2026-07-03T09:44:51.000000\\", \\"updated_at\\": \\"2026-07-03T09:45:11.000000\\"}}"\n}'. {{(pid=101319) _write_metadata /opt/stack/cinder/cinder/backup/chunkeddriver.py:295}} Jul 03 09:45:20.803930 np0000004400 cinder-backup[101319]: DEBUG oslo_db.sqlalchemy.engines [None req-e009ec27-4bef-44d5-8801-97ccc0ad8f75 tempest-VolumesBackupsTest-118275719 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=101319) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 03 09:45:20.809318 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-e009ec27-4bef-44d5-8801-97ccc0ad8f75 tempest-VolumesBackupsTest-118275719 None] backup 435094a5-f336-4be4-826b-fa363af35296 finished. {{(pid=101319) _finalize_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:462}} Jul 03 09:45:20.920775 np0000004400 sudo[136396]: pam_unix(sudo:session): session closed for user root Jul 03 09:45:20.932354 np0000004400 cinder-backup[101319]: DEBUG oslo_concurrency.processutils [None req-e009ec27-4bef-44d5-8801-97ccc0ad8f75 tempest-VolumesBackupsTest-118275719 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chown 0 /dev/sdb {{(pid=101319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 09:45:20.943282 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-97d75019-b038-42f5-953e-f68f76157eba tempest-VolumesBackupsTest-2142009639 None] deleted object: volume_b9d43525-b482-4d2d-8541-23ede348708e/20260703094447/az_nova_backup_a636aad8-67e3-4daa-ac42-7179916eefe7-00001 in container: tempest-volumesbackupstest-backup-container-313960817. {{(pid=101319) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 09:45:20.949686 np0000004400 cinder-backup[101319]: DEBUG oslo_concurrency.processutils [None req-dd7cebed-c6db-4da9-be53-3cc828012d99 tempest-ProjectAdminTests33-1900627284 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chown 0 /dev/sde" returned: 0 in 0.412s {{(pid=101319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 09:45:20.950385 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-dd7cebed-c6db-4da9-be53-3cc828012d99 tempest-ProjectAdminTests33-1900627284 None] ==> disconnect_volume: call "{'args': (, {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-4b68dad5-e9a3-4bd1-84e2-ba745cb7bb83', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '4b68dad5-e9a3-4bd1-84e2-ba745cb7bb83', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': False}, {'type': 'block', 'scsi_wwn': '3300000003c4ac265', 'path': '/dev/sde'}), 'kwargs': {'force': True, 'ignore_errors': True}}" {{(pid=101319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}} Jul 03 09:45:20.950680 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.base [None req-dd7cebed-c6db-4da9-be53-3cc828012d99 tempest-ProjectAdminTests33-1900627284 None] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=101319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jul 03 09:45:20.951245 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.base [None req-dd7cebed-c6db-4da9-be53-3cc828012d99 tempest-ProjectAdminTests33-1900627284 None] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=101319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jul 03 09:45:20.951786 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-dd7cebed-c6db-4da9-be53-3cc828012d99 tempest-ProjectAdminTests33-1900627284 None] _get_connection_devices called with parameters: connection_properties={'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-4b68dad5-e9a3-4bd1-84e2-ba745cb7bb83', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '4b68dad5-e9a3-4bd1-84e2-ba745cb7bb83', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': False}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=101319) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:847}} Jul 03 09:45:20.954358 np0000004400 sudo[136399]: stack : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chown 0 /dev/sdb Jul 03 09:45:20.955023 np0000004400 sudo[136399]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1002) Jul 03 09:45:20.967043 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-dd7cebed-c6db-4da9-be53-3cc828012d99 tempest-ProjectAdminTests33-1900627284 None] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS: Jul 03 09:45:20.967043 np0000004400 cinder-backup[101319]: No targets found. Jul 03 09:45:20.967043 np0000004400 cinder-backup[101319]: iSNS: Jul 03 09:45:20.967043 np0000004400 cinder-backup[101319]: No targets found. Jul 03 09:45:20.967043 np0000004400 cinder-backup[101319]: STATIC: Jul 03 09:45:20.967043 np0000004400 cinder-backup[101319]: Target: iqn.2023-03.storpool.com:os--volume-aecd73f6-86c7-4ae8-8bfa-b46655eb6efb Jul 03 09:45:20.967043 np0000004400 cinder-backup[101319]: Portal: 192.168.50.100:3260,-1 Jul 03 09:45:20.967043 np0000004400 cinder-backup[101319]: Iface Name: default Jul 03 09:45:20.967043 np0000004400 cinder-backup[101319]: Portal: 192.168.40.100:3260,-1 Jul 03 09:45:20.967043 np0000004400 cinder-backup[101319]: Iface Name: default Jul 03 09:45:20.967043 np0000004400 cinder-backup[101319]: Target: iqn.2023-03.storpool.com:os--volume-b86cbab3-7c42-409e-b4f6-0ed61267a031 Jul 03 09:45:20.967043 np0000004400 cinder-backup[101319]: Portal: 192.168.40.100:3260,-1 Jul 03 09:45:20.967043 np0000004400 cinder-backup[101319]: Iface Name: default Jul 03 09:45:20.967043 np0000004400 cinder-backup[101319]: Target: iqn.2023-03.storpool.com:os--volume-76320525-737e-4f58-8523-63ec9abbdc64 Jul 03 09:45:20.967043 np0000004400 cinder-backup[101319]: Portal: 192.168.50.100:3260,-1 Jul 03 09:45:20.967043 np0000004400 cinder-backup[101319]: Iface Name: default Jul 03 09:45:20.967043 np0000004400 cinder-backup[101319]: Portal: 192.168.40.100:3260,-1 Jul 03 09:45:20.967043 np0000004400 cinder-backup[101319]: Iface Name: default Jul 03 09:45:20.967043 np0000004400 cinder-backup[101319]: Target: iqn.2023-03.storpool.com:os--volume-b2e4f10c-8033-4c54-95a1-dfe45d6357a3 Jul 03 09:45:20.967043 np0000004400 cinder-backup[101319]: Portal: 192.168.50.100:3260,-1 Jul 03 09:45:20.967043 np0000004400 cinder-backup[101319]: Iface Name: default Jul 03 09:45:20.967043 np0000004400 cinder-backup[101319]: Portal: 192.168.40.100:3260,-1 Jul 03 09:45:20.967043 np0000004400 cinder-backup[101319]: Iface Name: default Jul 03 09:45:20.967043 np0000004400 cinder-backup[101319]: Target: iqn.2023-03.storpool.com:os--volume-4b68dad5-e9a3-4bd1-84e2-ba745cb7bb83 Jul 03 09:45:20.967043 np0000004400 cinder-backup[101319]: Portal: 192.168.40.100:3260,-1 Jul 03 09:45:20.967043 np0000004400 cinder-backup[101319]: Iface Name: default Jul 03 09:45:20.967043 np0000004400 cinder-backup[101319]: Target: iqn.2023-03.storpool.com:os--volume-d47f5d2f-dce5-42f7-a693-a654fd702622 Jul 03 09:45:20.967043 np0000004400 cinder-backup[101319]: Portal: 192.168.50.100:3260,-1 Jul 03 09:45:20.967043 np0000004400 cinder-backup[101319]: Iface Name: default Jul 03 09:45:20.967043 np0000004400 cinder-backup[101319]: Portal: 192.168.40.100:3260,-1 Jul 03 09:45:20.967043 np0000004400 cinder-backup[101319]: Iface Name: default Jul 03 09:45:20.967043 np0000004400 cinder-backup[101319]: FIRMWARE: Jul 03 09:45:20.967043 np0000004400 cinder-backup[101319]: No targets found. Jul 03 09:45:20.967043 np0000004400 cinder-backup[101319]: stderr= {{(pid=101319) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jul 03 09:45:20.968136 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-dd7cebed-c6db-4da9-be53-3cc828012d99 tempest-ProjectAdminTests33-1900627284 None] Regex to get portals from discoverydb: ^SENDTARGETS: Jul 03 09:45:20.968136 np0000004400 cinder-backup[101319]: .*?^DiscoveryAddress: 192.168.40.100,3260.*? Jul 03 09:45:20.968136 np0000004400 cinder-backup[101319]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=101319) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:390}} Jul 03 09:45:20.968136 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-dd7cebed-c6db-4da9-be53-3cc828012d99 tempest-ProjectAdminTests33-1900627284 None] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-4b68dad5-e9a3-4bd1-84e2-ba745cb7bb83', 0)] {{(pid=101319) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:858}} Jul 03 09:45:20.975391 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-97d75019-b038-42f5-953e-f68f76157eba tempest-VolumesBackupsTest-2142009639 None] deleted object: volume_b9d43525-b482-4d2d-8541-23ede348708e/20260703094447/az_nova_backup_a636aad8-67e3-4daa-ac42-7179916eefe7-00002 in container: tempest-volumesbackupstest-backup-container-313960817. {{(pid=101319) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 09:45:20.994337 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-97d75019-b038-42f5-953e-f68f76157eba tempest-VolumesBackupsTest-2142009639 None] deleted object: volume_b9d43525-b482-4d2d-8541-23ede348708e/20260703094447/az_nova_backup_a636aad8-67e3-4daa-ac42-7179916eefe7-00003 in container: tempest-volumesbackupstest-backup-container-313960817. {{(pid=101319) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 09:45:21.000115 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-dd7cebed-c6db-4da9-be53-3cc828012d99 tempest-ProjectAdminTests33-1900627284 None] iscsiadm ('-m', 'session'): stdout=tcp: [101] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-4b68dad5-e9a3-4bd1-84e2-ba745cb7bb83 (non-flash) Jul 03 09:45:21.000115 np0000004400 cinder-backup[101319]: tcp: [103] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b86cbab3-7c42-409e-b4f6-0ed61267a031 (non-flash) Jul 03 09:45:21.000115 np0000004400 cinder-backup[101319]: tcp: [49] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b2e4f10c-8033-4c54-95a1-dfe45d6357a3 (non-flash) Jul 03 09:45:21.000115 np0000004400 cinder-backup[101319]: tcp: [50] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b2e4f10c-8033-4c54-95a1-dfe45d6357a3 (non-flash) Jul 03 09:45:21.000115 np0000004400 cinder-backup[101319]: tcp: [82] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-76320525-737e-4f58-8523-63ec9abbdc64 (non-flash) Jul 03 09:45:21.000115 np0000004400 cinder-backup[101319]: tcp: [83] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-76320525-737e-4f58-8523-63ec9abbdc64 (non-flash) Jul 03 09:45:21.000115 np0000004400 cinder-backup[101319]: tcp: [93] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-aecd73f6-86c7-4ae8-8bfa-b46655eb6efb (non-flash) Jul 03 09:45:21.000115 np0000004400 cinder-backup[101319]: tcp: [94] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-aecd73f6-86c7-4ae8-8bfa-b46655eb6efb (non-flash) Jul 03 09:45:21.000115 np0000004400 cinder-backup[101319]: tcp: [97] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d47f5d2f-dce5-42f7-a693-a654fd702622 (non-flash) Jul 03 09:45:21.000115 np0000004400 cinder-backup[101319]: tcp: [98] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d47f5d2f-dce5-42f7-a693-a654fd702622 (non-flash) Jul 03 09:45:21.000115 np0000004400 cinder-backup[101319]: stderr= {{(pid=101319) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jul 03 09:45:21.000491 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-dd7cebed-c6db-4da9-be53-3cc828012d99 tempest-ProjectAdminTests33-1900627284 None] iscsi session list stdout=tcp: [101] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-4b68dad5-e9a3-4bd1-84e2-ba745cb7bb83 (non-flash) Jul 03 09:45:21.000491 np0000004400 cinder-backup[101319]: tcp: [103] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b86cbab3-7c42-409e-b4f6-0ed61267a031 (non-flash) Jul 03 09:45:21.000491 np0000004400 cinder-backup[101319]: tcp: [49] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b2e4f10c-8033-4c54-95a1-dfe45d6357a3 (non-flash) Jul 03 09:45:21.000491 np0000004400 cinder-backup[101319]: tcp: [50] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b2e4f10c-8033-4c54-95a1-dfe45d6357a3 (non-flash) Jul 03 09:45:21.000491 np0000004400 cinder-backup[101319]: tcp: [82] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-76320525-737e-4f58-8523-63ec9abbdc64 (non-flash) Jul 03 09:45:21.000491 np0000004400 cinder-backup[101319]: tcp: [83] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-76320525-737e-4f58-8523-63ec9abbdc64 (non-flash) Jul 03 09:45:21.000491 np0000004400 cinder-backup[101319]: tcp: [93] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-aecd73f6-86c7-4ae8-8bfa-b46655eb6efb (non-flash) Jul 03 09:45:21.000491 np0000004400 cinder-backup[101319]: tcp: [94] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-aecd73f6-86c7-4ae8-8bfa-b46655eb6efb (non-flash) Jul 03 09:45:21.000491 np0000004400 cinder-backup[101319]: tcp: [97] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d47f5d2f-dce5-42f7-a693-a654fd702622 (non-flash) Jul 03 09:45:21.000491 np0000004400 cinder-backup[101319]: tcp: [98] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d47f5d2f-dce5-42f7-a693-a654fd702622 (non-flash) Jul 03 09:45:21.000491 np0000004400 cinder-backup[101319]: stderr= {{(pid=101319) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jul 03 09:45:21.000491 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-dd7cebed-c6db-4da9-be53-3cc828012d99 tempest-ProjectAdminTests33-1900627284 None] Sessions list: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-4b68dad5-e9a3-4bd1-84e2-ba745cb7bb83', '101'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-b86cbab3-7c42-409e-b4f6-0ed61267a031', '103'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-b2e4f10c-8033-4c54-95a1-dfe45d6357a3', '49'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-b2e4f10c-8033-4c54-95a1-dfe45d6357a3', '50'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-76320525-737e-4f58-8523-63ec9abbdc64', '82'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-76320525-737e-4f58-8523-63ec9abbdc64', '83'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-aecd73f6-86c7-4ae8-8bfa-b46655eb6efb', '93'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-aecd73f6-86c7-4ae8-8bfa-b46655eb6efb', '94'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-d47f5d2f-dce5-42f7-a693-a654fd702622', '97'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-d47f5d2f-dce5-42f7-a693-a654fd702622', '98')] {{(pid=101319) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:866}} Jul 03 09:45:21.000807 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-dd7cebed-c6db-4da9-be53-3cc828012d99 tempest-ProjectAdminTests33-1900627284 None] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-4b68dad5-e9a3-4bd1-84e2-ba745cb7bb83, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-4b68dad5-e9a3-4bd1-84e2-ba745cb7bb83', '101')] {{(pid=101319) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}} Jul 03 09:45:21.001570 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-dd7cebed-c6db-4da9-be53-3cc828012d99 tempest-ProjectAdminTests33-1900627284 None] Resulting device map defaultdict(. at 0x7e76e7584a40>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-4b68dad5-e9a3-4bd1-84e2-ba745cb7bb83'): ({'sde'}, set())}) {{(pid=101319) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:912}} Jul 03 09:45:21.001817 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.linuxscsi [None req-dd7cebed-c6db-4da9-be53-3cc828012d99 tempest-ProjectAdminTests33-1900627284 None] Removing single pathed devices sde {{(pid=101319) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}} Jul 03 09:45:21.014418 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.linuxscsi [None req-dd7cebed-c6db-4da9-be53-3cc828012d99 tempest-ProjectAdminTests33-1900627284 None] Flushing IO for device /dev/sde {{(pid=101319) flush_device_io /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:461}} Jul 03 09:45:21.017793 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-97d75019-b038-42f5-953e-f68f76157eba tempest-VolumesBackupsTest-2142009639 None] deleted object: volume_b9d43525-b482-4d2d-8541-23ede348708e/20260703094447/az_nova_backup_a636aad8-67e3-4daa-ac42-7179916eefe7-00004 in container: tempest-volumesbackupstest-backup-container-313960817. {{(pid=101319) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 09:45:21.022882 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.linuxscsi [None req-dd7cebed-c6db-4da9-be53-3cc828012d99 tempest-ProjectAdminTests33-1900627284 None] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=101319) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}} Jul 03 09:45:21.042047 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-97d75019-b038-42f5-953e-f68f76157eba tempest-VolumesBackupsTest-2142009639 None] deleted object: volume_b9d43525-b482-4d2d-8541-23ede348708e/20260703094447/az_nova_backup_a636aad8-67e3-4daa-ac42-7179916eefe7-00005 in container: tempest-volumesbackupstest-backup-container-313960817. {{(pid=101319) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 09:45:21.061548 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-97d75019-b038-42f5-953e-f68f76157eba tempest-VolumesBackupsTest-2142009639 None] deleted object: volume_b9d43525-b482-4d2d-8541-23ede348708e/20260703094447/az_nova_backup_a636aad8-67e3-4daa-ac42-7179916eefe7-00006 in container: tempest-volumesbackupstest-backup-container-313960817. {{(pid=101319) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 09:45:21.076869 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.linuxscsi [None req-dd7cebed-c6db-4da9-be53-3cc828012d99 tempest-ProjectAdminTests33-1900627284 None] Checking to see if SCSI volumes sde have been removed. {{(pid=101319) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}} Jul 03 09:45:21.077088 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.linuxscsi [None req-dd7cebed-c6db-4da9-be53-3cc828012d99 tempest-ProjectAdminTests33-1900627284 None] SCSI volumes sde have been removed. {{(pid=101319) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}} Jul 03 09:45:21.078889 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.linuxscsi [None req-dd7cebed-c6db-4da9-be53-3cc828012d99 tempest-ProjectAdminTests33-1900627284 None] Checking to see if device paths {'sde'} are still under multipathd monitoring {{(pid=101319) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}} Jul 03 09:45:21.088177 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-97d75019-b038-42f5-953e-f68f76157eba tempest-VolumesBackupsTest-2142009639 None] deleted object: volume_b9d43525-b482-4d2d-8541-23ede348708e/20260703094447/az_nova_backup_a636aad8-67e3-4daa-ac42-7179916eefe7-00007 in container: tempest-volumesbackupstest-backup-container-313960817. {{(pid=101319) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 09:45:21.091063 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.linuxscsi [None req-dd7cebed-c6db-4da9-be53-3cc828012d99 tempest-ProjectAdminTests33-1900627284 None] Device paths {'sde'} have been removed from multipathd monitoring. {{(pid=101319) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}} Jul 03 09:45:21.091143 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-dd7cebed-c6db-4da9-be53-3cc828012d99 tempest-ProjectAdminTests33-1900627284 None] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-4b68dad5-e9a3-4bd1-84e2-ba745cb7bb83')] {{(pid=101319) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1225}} Jul 03 09:45:21.105136 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-dd7cebed-c6db-4da9-be53-3cc828012d99 tempest-ProjectAdminTests33-1900627284 None] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=101319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 03 09:45:21.111808 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-97d75019-b038-42f5-953e-f68f76157eba tempest-VolumesBackupsTest-2142009639 None] deleted object: volume_b9d43525-b482-4d2d-8541-23ede348708e/20260703094447/az_nova_backup_a636aad8-67e3-4daa-ac42-7179916eefe7-00008 in container: tempest-volumesbackupstest-backup-container-313960817. {{(pid=101319) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 09:45:21.130874 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-97d75019-b038-42f5-953e-f68f76157eba tempest-VolumesBackupsTest-2142009639 None] deleted object: volume_b9d43525-b482-4d2d-8541-23ede348708e/20260703094447/az_nova_backup_a636aad8-67e3-4daa-ac42-7179916eefe7-00009 in container: tempest-volumesbackupstest-backup-container-313960817. {{(pid=101319) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 09:45:21.138469 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-dd7cebed-c6db-4da9-be53-3cc828012d99 tempest-ProjectAdminTests33-1900627284 None] iscsiadm ('--logout',): stdout=Logging out of session [sid: 101, target: iqn.2023-03.storpool.com:os--volume-4b68dad5-e9a3-4bd1-84e2-ba745cb7bb83, portal: 192.168.40.100,3260] Jul 03 09:45:21.138469 np0000004400 cinder-backup[101319]: Logout of [sid: 101, target: iqn.2023-03.storpool.com:os--volume-4b68dad5-e9a3-4bd1-84e2-ba745cb7bb83, portal: 192.168.40.100,3260] successful. Jul 03 09:45:21.138469 np0000004400 cinder-backup[101319]: stderr= {{(pid=101319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 03 09:45:21.159173 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-97d75019-b038-42f5-953e-f68f76157eba tempest-VolumesBackupsTest-2142009639 None] deleted object: volume_b9d43525-b482-4d2d-8541-23ede348708e/20260703094447/az_nova_backup_a636aad8-67e3-4daa-ac42-7179916eefe7-00010 in container: tempest-volumesbackupstest-backup-container-313960817. {{(pid=101319) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 09:45:21.162229 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-dd7cebed-c6db-4da9-be53-3cc828012d99 tempest-ProjectAdminTests33-1900627284 None] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=101319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 03 09:45:21.162516 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.base [None req-dd7cebed-c6db-4da9-be53-3cc828012d99 tempest-ProjectAdminTests33-1900627284 None] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.211s {{(pid=101319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jul 03 09:45:21.162674 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-dd7cebed-c6db-4da9-be53-3cc828012d99 tempest-ProjectAdminTests33-1900627284 None] <== disconnect_volume: return (212ms) None {{(pid=101319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}} Jul 03 09:45:21.178646 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-97d75019-b038-42f5-953e-f68f76157eba tempest-VolumesBackupsTest-2142009639 None] deleted object: volume_b9d43525-b482-4d2d-8541-23ede348708e/20260703094447/az_nova_backup_a636aad8-67e3-4daa-ac42-7179916eefe7-00011 in container: tempest-volumesbackupstest-backup-container-313960817. {{(pid=101319) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 09:45:21.199574 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-97d75019-b038-42f5-953e-f68f76157eba tempest-VolumesBackupsTest-2142009639 None] deleted object: volume_b9d43525-b482-4d2d-8541-23ede348708e/20260703094447/az_nova_backup_a636aad8-67e3-4daa-ac42-7179916eefe7-00012 in container: tempest-volumesbackupstest-backup-container-313960817. {{(pid=101319) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 09:45:21.219221 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-97d75019-b038-42f5-953e-f68f76157eba tempest-VolumesBackupsTest-2142009639 None] deleted object: volume_b9d43525-b482-4d2d-8541-23ede348708e/20260703094447/az_nova_backup_a636aad8-67e3-4daa-ac42-7179916eefe7-00013 in container: tempest-volumesbackupstest-backup-container-313960817. {{(pid=101319) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 09:45:21.242529 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-97d75019-b038-42f5-953e-f68f76157eba tempest-VolumesBackupsTest-2142009639 None] deleted object: volume_b9d43525-b482-4d2d-8541-23ede348708e/20260703094447/az_nova_backup_a636aad8-67e3-4daa-ac42-7179916eefe7-00014 in container: tempest-volumesbackupstest-backup-container-313960817. {{(pid=101319) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 09:45:21.262645 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-97d75019-b038-42f5-953e-f68f76157eba tempest-VolumesBackupsTest-2142009639 None] deleted object: volume_b9d43525-b482-4d2d-8541-23ede348708e/20260703094447/az_nova_backup_a636aad8-67e3-4daa-ac42-7179916eefe7-00015 in container: tempest-volumesbackupstest-backup-container-313960817. {{(pid=101319) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 09:45:21.287129 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-97d75019-b038-42f5-953e-f68f76157eba tempest-VolumesBackupsTest-2142009639 None] deleted object: volume_b9d43525-b482-4d2d-8541-23ede348708e/20260703094447/az_nova_backup_a636aad8-67e3-4daa-ac42-7179916eefe7-00016 in container: tempest-volumesbackupstest-backup-container-313960817. {{(pid=101319) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 09:45:21.287827 np0000004400 sudo[136399]: pam_unix(sudo:session): session closed for user root Jul 03 09:45:21.289934 np0000004400 cinder-backup[101319]: DEBUG oslo_concurrency.processutils [None req-e009ec27-4bef-44d5-8801-97ccc0ad8f75 tempest-VolumesBackupsTest-118275719 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chown 0 /dev/sdb" returned: 0 in 0.358s {{(pid=101319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 09:45:21.290366 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-e009ec27-4bef-44d5-8801-97ccc0ad8f75 tempest-VolumesBackupsTest-118275719 None] ==> disconnect_volume: call "{'args': (, {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-b86cbab3-7c42-409e-b4f6-0ed61267a031', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'b86cbab3-7c42-409e-b4f6-0ed61267a031', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': False}, {'type': 'block', 'scsi_wwn': 'SStorPool_iSCSI_DISK_1034578903445799018', 'path': '/dev/sdb'}), 'kwargs': {'force': True, 'ignore_errors': True}}" {{(pid=101319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}} Jul 03 09:45:21.290488 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.base [None req-e009ec27-4bef-44d5-8801-97ccc0ad8f75 tempest-VolumesBackupsTest-118275719 None] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=101319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jul 03 09:45:21.290782 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.base [None req-e009ec27-4bef-44d5-8801-97ccc0ad8f75 tempest-VolumesBackupsTest-118275719 None] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.000s {{(pid=101319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jul 03 09:45:21.291069 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-e009ec27-4bef-44d5-8801-97ccc0ad8f75 tempest-VolumesBackupsTest-118275719 None] _get_connection_devices called with parameters: connection_properties={'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-b86cbab3-7c42-409e-b4f6-0ed61267a031', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'b86cbab3-7c42-409e-b4f6-0ed61267a031', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': False}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=101319) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:847}} Jul 03 09:45:21.302631 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-e009ec27-4bef-44d5-8801-97ccc0ad8f75 tempest-VolumesBackupsTest-118275719 None] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS: Jul 03 09:45:21.302631 np0000004400 cinder-backup[101319]: No targets found. Jul 03 09:45:21.302631 np0000004400 cinder-backup[101319]: iSNS: Jul 03 09:45:21.302631 np0000004400 cinder-backup[101319]: No targets found. Jul 03 09:45:21.302631 np0000004400 cinder-backup[101319]: STATIC: Jul 03 09:45:21.302631 np0000004400 cinder-backup[101319]: Target: iqn.2023-03.storpool.com:os--volume-aecd73f6-86c7-4ae8-8bfa-b46655eb6efb Jul 03 09:45:21.302631 np0000004400 cinder-backup[101319]: Portal: 192.168.50.100:3260,-1 Jul 03 09:45:21.302631 np0000004400 cinder-backup[101319]: Iface Name: default Jul 03 09:45:21.302631 np0000004400 cinder-backup[101319]: Portal: 192.168.40.100:3260,-1 Jul 03 09:45:21.302631 np0000004400 cinder-backup[101319]: Iface Name: default Jul 03 09:45:21.302631 np0000004400 cinder-backup[101319]: Target: iqn.2023-03.storpool.com:os--volume-b86cbab3-7c42-409e-b4f6-0ed61267a031 Jul 03 09:45:21.302631 np0000004400 cinder-backup[101319]: Portal: 192.168.40.100:3260,-1 Jul 03 09:45:21.302631 np0000004400 cinder-backup[101319]: Iface Name: default Jul 03 09:45:21.302631 np0000004400 cinder-backup[101319]: Target: iqn.2023-03.storpool.com:os--volume-76320525-737e-4f58-8523-63ec9abbdc64 Jul 03 09:45:21.302631 np0000004400 cinder-backup[101319]: Portal: 192.168.50.100:3260,-1 Jul 03 09:45:21.302631 np0000004400 cinder-backup[101319]: Iface Name: default Jul 03 09:45:21.302631 np0000004400 cinder-backup[101319]: Portal: 192.168.40.100:3260,-1 Jul 03 09:45:21.302631 np0000004400 cinder-backup[101319]: Iface Name: default Jul 03 09:45:21.302631 np0000004400 cinder-backup[101319]: Target: iqn.2023-03.storpool.com:os--volume-b2e4f10c-8033-4c54-95a1-dfe45d6357a3 Jul 03 09:45:21.302631 np0000004400 cinder-backup[101319]: Portal: 192.168.50.100:3260,-1 Jul 03 09:45:21.302631 np0000004400 cinder-backup[101319]: Iface Name: default Jul 03 09:45:21.302631 np0000004400 cinder-backup[101319]: Portal: 192.168.40.100:3260,-1 Jul 03 09:45:21.302631 np0000004400 cinder-backup[101319]: Iface Name: default Jul 03 09:45:21.302631 np0000004400 cinder-backup[101319]: Target: iqn.2023-03.storpool.com:os--volume-d47f5d2f-dce5-42f7-a693-a654fd702622 Jul 03 09:45:21.302631 np0000004400 cinder-backup[101319]: Portal: 192.168.50.100:3260,-1 Jul 03 09:45:21.302631 np0000004400 cinder-backup[101319]: Iface Name: default Jul 03 09:45:21.302631 np0000004400 cinder-backup[101319]: Portal: 192.168.40.100:3260,-1 Jul 03 09:45:21.302631 np0000004400 cinder-backup[101319]: Iface Name: default Jul 03 09:45:21.302631 np0000004400 cinder-backup[101319]: FIRMWARE: Jul 03 09:45:21.302631 np0000004400 cinder-backup[101319]: No targets found. Jul 03 09:45:21.302631 np0000004400 cinder-backup[101319]: stderr= {{(pid=101319) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jul 03 09:45:21.303208 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-e009ec27-4bef-44d5-8801-97ccc0ad8f75 tempest-VolumesBackupsTest-118275719 None] Regex to get portals from discoverydb: ^SENDTARGETS: Jul 03 09:45:21.303208 np0000004400 cinder-backup[101319]: .*?^DiscoveryAddress: 192.168.40.100,3260.*? Jul 03 09:45:21.303208 np0000004400 cinder-backup[101319]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=101319) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:390}} Jul 03 09:45:21.303208 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-e009ec27-4bef-44d5-8801-97ccc0ad8f75 tempest-VolumesBackupsTest-118275719 None] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-b86cbab3-7c42-409e-b4f6-0ed61267a031', 0)] {{(pid=101319) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:858}} Jul 03 09:45:21.321747 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-97d75019-b038-42f5-953e-f68f76157eba tempest-VolumesBackupsTest-2142009639 None] deleted object: volume_b9d43525-b482-4d2d-8541-23ede348708e/20260703094447/az_nova_backup_a636aad8-67e3-4daa-ac42-7179916eefe7-00017 in container: tempest-volumesbackupstest-backup-container-313960817. {{(pid=101319) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 09:45:21.337919 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-e009ec27-4bef-44d5-8801-97ccc0ad8f75 tempest-VolumesBackupsTest-118275719 None] iscsiadm ('-m', 'session'): stdout=tcp: [103] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b86cbab3-7c42-409e-b4f6-0ed61267a031 (non-flash) Jul 03 09:45:21.337919 np0000004400 cinder-backup[101319]: tcp: [49] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b2e4f10c-8033-4c54-95a1-dfe45d6357a3 (non-flash) Jul 03 09:45:21.337919 np0000004400 cinder-backup[101319]: tcp: [50] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b2e4f10c-8033-4c54-95a1-dfe45d6357a3 (non-flash) Jul 03 09:45:21.337919 np0000004400 cinder-backup[101319]: tcp: [82] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-76320525-737e-4f58-8523-63ec9abbdc64 (non-flash) Jul 03 09:45:21.337919 np0000004400 cinder-backup[101319]: tcp: [83] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-76320525-737e-4f58-8523-63ec9abbdc64 (non-flash) Jul 03 09:45:21.337919 np0000004400 cinder-backup[101319]: tcp: [93] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-aecd73f6-86c7-4ae8-8bfa-b46655eb6efb (non-flash) Jul 03 09:45:21.337919 np0000004400 cinder-backup[101319]: tcp: [94] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-aecd73f6-86c7-4ae8-8bfa-b46655eb6efb (non-flash) Jul 03 09:45:21.337919 np0000004400 cinder-backup[101319]: tcp: [97] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d47f5d2f-dce5-42f7-a693-a654fd702622 (non-flash) Jul 03 09:45:21.337919 np0000004400 cinder-backup[101319]: tcp: [98] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d47f5d2f-dce5-42f7-a693-a654fd702622 (non-flash) Jul 03 09:45:21.337919 np0000004400 cinder-backup[101319]: stderr= {{(pid=101319) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jul 03 09:45:21.338140 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-e009ec27-4bef-44d5-8801-97ccc0ad8f75 tempest-VolumesBackupsTest-118275719 None] iscsi session list stdout=tcp: [103] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b86cbab3-7c42-409e-b4f6-0ed61267a031 (non-flash) Jul 03 09:45:21.338140 np0000004400 cinder-backup[101319]: tcp: [49] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b2e4f10c-8033-4c54-95a1-dfe45d6357a3 (non-flash) Jul 03 09:45:21.338140 np0000004400 cinder-backup[101319]: tcp: [50] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b2e4f10c-8033-4c54-95a1-dfe45d6357a3 (non-flash) Jul 03 09:45:21.338140 np0000004400 cinder-backup[101319]: tcp: [82] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-76320525-737e-4f58-8523-63ec9abbdc64 (non-flash) Jul 03 09:45:21.338140 np0000004400 cinder-backup[101319]: tcp: [83] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-76320525-737e-4f58-8523-63ec9abbdc64 (non-flash) Jul 03 09:45:21.338140 np0000004400 cinder-backup[101319]: tcp: [93] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-aecd73f6-86c7-4ae8-8bfa-b46655eb6efb (non-flash) Jul 03 09:45:21.338140 np0000004400 cinder-backup[101319]: tcp: [94] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-aecd73f6-86c7-4ae8-8bfa-b46655eb6efb (non-flash) Jul 03 09:45:21.338140 np0000004400 cinder-backup[101319]: tcp: [97] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d47f5d2f-dce5-42f7-a693-a654fd702622 (non-flash) Jul 03 09:45:21.338140 np0000004400 cinder-backup[101319]: tcp: [98] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d47f5d2f-dce5-42f7-a693-a654fd702622 (non-flash) Jul 03 09:45:21.338140 np0000004400 cinder-backup[101319]: stderr= {{(pid=101319) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jul 03 09:45:21.338470 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-e009ec27-4bef-44d5-8801-97ccc0ad8f75 tempest-VolumesBackupsTest-118275719 None] Sessions list: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-b86cbab3-7c42-409e-b4f6-0ed61267a031', '103'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-b2e4f10c-8033-4c54-95a1-dfe45d6357a3', '49'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-b2e4f10c-8033-4c54-95a1-dfe45d6357a3', '50'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-76320525-737e-4f58-8523-63ec9abbdc64', '82'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-76320525-737e-4f58-8523-63ec9abbdc64', '83'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-aecd73f6-86c7-4ae8-8bfa-b46655eb6efb', '93'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-aecd73f6-86c7-4ae8-8bfa-b46655eb6efb', '94'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-d47f5d2f-dce5-42f7-a693-a654fd702622', '97'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-d47f5d2f-dce5-42f7-a693-a654fd702622', '98')] {{(pid=101319) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:866}} Jul 03 09:45:21.338470 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-e009ec27-4bef-44d5-8801-97ccc0ad8f75 tempest-VolumesBackupsTest-118275719 None] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-b86cbab3-7c42-409e-b4f6-0ed61267a031, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-b86cbab3-7c42-409e-b4f6-0ed61267a031', '103')] {{(pid=101319) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}} Jul 03 09:45:21.339305 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-e009ec27-4bef-44d5-8801-97ccc0ad8f75 tempest-VolumesBackupsTest-118275719 None] Resulting device map defaultdict(. at 0x7e76e6d1f420>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-b86cbab3-7c42-409e-b4f6-0ed61267a031'): ({'sdb'}, set())}) {{(pid=101319) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:912}} Jul 03 09:45:21.339518 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.linuxscsi [None req-e009ec27-4bef-44d5-8801-97ccc0ad8f75 tempest-VolumesBackupsTest-118275719 None] Removing single pathed devices sdb {{(pid=101319) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}} Jul 03 09:45:21.350172 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.linuxscsi [None req-e009ec27-4bef-44d5-8801-97ccc0ad8f75 tempest-VolumesBackupsTest-118275719 None] Flushing IO for device /dev/sdb {{(pid=101319) flush_device_io /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:461}} Jul 03 09:45:21.353605 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-97d75019-b038-42f5-953e-f68f76157eba tempest-VolumesBackupsTest-2142009639 None] deleted object: volume_b9d43525-b482-4d2d-8541-23ede348708e/20260703094447/az_nova_backup_a636aad8-67e3-4daa-ac42-7179916eefe7-00018 in container: tempest-volumesbackupstest-backup-container-313960817. {{(pid=101319) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 09:45:21.360231 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.linuxscsi [None req-e009ec27-4bef-44d5-8801-97ccc0ad8f75 tempest-VolumesBackupsTest-118275719 None] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=101319) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}} Jul 03 09:45:21.372750 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-97d75019-b038-42f5-953e-f68f76157eba tempest-VolumesBackupsTest-2142009639 None] deleted object: volume_b9d43525-b482-4d2d-8541-23ede348708e/20260703094447/az_nova_backup_a636aad8-67e3-4daa-ac42-7179916eefe7-00019 in container: tempest-volumesbackupstest-backup-container-313960817. {{(pid=101319) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 09:45:21.392050 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-97d75019-b038-42f5-953e-f68f76157eba tempest-VolumesBackupsTest-2142009639 None] deleted object: volume_b9d43525-b482-4d2d-8541-23ede348708e/20260703094447/az_nova_backup_a636aad8-67e3-4daa-ac42-7179916eefe7-00020 in container: tempest-volumesbackupstest-backup-container-313960817. {{(pid=101319) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 09:45:21.401920 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.linuxscsi [None req-e009ec27-4bef-44d5-8801-97ccc0ad8f75 tempest-VolumesBackupsTest-118275719 None] Checking to see if SCSI volumes sdb have been removed. {{(pid=101319) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}} Jul 03 09:45:21.402137 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.linuxscsi [None req-e009ec27-4bef-44d5-8801-97ccc0ad8f75 tempest-VolumesBackupsTest-118275719 None] SCSI volumes sdb have been removed. {{(pid=101319) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}} Jul 03 09:45:21.403648 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.linuxscsi [None req-e009ec27-4bef-44d5-8801-97ccc0ad8f75 tempest-VolumesBackupsTest-118275719 None] Checking to see if device paths {'sdb'} are still under multipathd monitoring {{(pid=101319) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}} Jul 03 09:45:21.415587 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.linuxscsi [None req-e009ec27-4bef-44d5-8801-97ccc0ad8f75 tempest-VolumesBackupsTest-118275719 None] Device paths {'sdb'} have been removed from multipathd monitoring. {{(pid=101319) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}} Jul 03 09:45:21.415911 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-e009ec27-4bef-44d5-8801-97ccc0ad8f75 tempest-VolumesBackupsTest-118275719 None] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-b86cbab3-7c42-409e-b4f6-0ed61267a031')] {{(pid=101319) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1225}} Jul 03 09:45:21.423475 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-97d75019-b038-42f5-953e-f68f76157eba tempest-VolumesBackupsTest-2142009639 None] deleted object: volume_b9d43525-b482-4d2d-8541-23ede348708e/20260703094447/az_nova_backup_a636aad8-67e3-4daa-ac42-7179916eefe7-00021 in container: tempest-volumesbackupstest-backup-container-313960817. {{(pid=101319) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 09:45:21.426474 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-e009ec27-4bef-44d5-8801-97ccc0ad8f75 tempest-VolumesBackupsTest-118275719 None] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=101319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 03 09:45:21.442010 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-97d75019-b038-42f5-953e-f68f76157eba tempest-VolumesBackupsTest-2142009639 None] deleted object: volume_b9d43525-b482-4d2d-8541-23ede348708e/20260703094447/az_nova_backup_a636aad8-67e3-4daa-ac42-7179916eefe7_metadata in container: tempest-volumesbackupstest-backup-container-313960817. {{(pid=101319) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 09:45:21.456664 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-e009ec27-4bef-44d5-8801-97ccc0ad8f75 tempest-VolumesBackupsTest-118275719 None] iscsiadm ('--logout',): stdout=Logging out of session [sid: 103, target: iqn.2023-03.storpool.com:os--volume-b86cbab3-7c42-409e-b4f6-0ed61267a031, portal: 192.168.40.100,3260] Jul 03 09:45:21.456664 np0000004400 cinder-backup[101319]: Logout of [sid: 103, target: iqn.2023-03.storpool.com:os--volume-b86cbab3-7c42-409e-b4f6-0ed61267a031, portal: 192.168.40.100,3260] successful. Jul 03 09:45:21.456664 np0000004400 cinder-backup[101319]: stderr= {{(pid=101319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 03 09:45:21.460803 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-97d75019-b038-42f5-953e-f68f76157eba tempest-VolumesBackupsTest-2142009639 None] deleted object: volume_b9d43525-b482-4d2d-8541-23ede348708e/20260703094447/az_nova_backup_a636aad8-67e3-4daa-ac42-7179916eefe7_sha256file in container: tempest-volumesbackupstest-backup-container-313960817. {{(pid=101319) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 09:45:21.461002 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-97d75019-b038-42f5-953e-f68f76157eba tempest-VolumesBackupsTest-2142009639 None] delete a636aad8-67e3-4daa-ac42-7179916eefe7 finished. {{(pid=101319) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:848}} Jul 03 09:45:21.474848 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-e009ec27-4bef-44d5-8801-97ccc0ad8f75 tempest-VolumesBackupsTest-118275719 None] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=101319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 03 09:45:21.475082 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.base [None req-e009ec27-4bef-44d5-8801-97ccc0ad8f75 tempest-VolumesBackupsTest-118275719 None] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.184s {{(pid=101319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jul 03 09:45:21.475238 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-e009ec27-4bef-44d5-8801-97ccc0ad8f75 tempest-VolumesBackupsTest-118275719 None] <== disconnect_volume: return (184ms) None {{(pid=101319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}} Jul 03 09:45:21.483249 np0000004400 cinder-backup[101319]: DEBUG cinder.quota [None req-97d75019-b038-42f5-953e-f68f76157eba tempest-VolumesBackupsTest-2142009639 None] Created reservations ['61a28469-2d60-4001-ad4f-a8068a8a026b', 'a88f50c8-50ba-4b59-8fae-dbd8d06b7358'] {{(pid=101319) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 09:45:21.501784 np0000004400 cinder-backup[101319]: INFO cinder.backup.manager [None req-97d75019-b038-42f5-953e-f68f76157eba tempest-VolumesBackupsTest-2142009639 None] Delete backup finished, backup a636aad8-67e3-4daa-ac42-7179916eefe7 deleted. Jul 03 09:45:22.183641 np0000004400 cinder-backup[101319]: INFO cinder.backup.manager [None req-dd7cebed-c6db-4da9-be53-3cc828012d99 tempest-ProjectAdminTests33-1900627284 None] Create backup finished. backup: cfdc4925-e984-4da2-aa3e-e1e8a7c37558. Jul 03 09:45:22.506714 np0000004400 cinder-backup[101319]: INFO cinder.backup.manager [None req-e009ec27-4bef-44d5-8801-97ccc0ad8f75 tempest-VolumesBackupsTest-118275719 None] Create backup finished. backup: 435094a5-f336-4be4-826b-fa363af35296. Jul 03 09:45:22.685803 np0000004400 cinder-backup[101319]: INFO cinder.backup.manager [None req-39edf0dd-1bcf-42e2-baa1-b2115392f537 tempest-ProjectAdminTests33-1900627284 None] Create backup started, backup: 3d538c5e-b79f-4328-82e9-e76f89c22158 volume: 4b68dad5-e9a3-4bd1-84e2-ba745cb7bb83. Jul 03 09:45:22.692413 np0000004400 cinder-backup[101319]: INFO cinder.backup.manager [None req-39edf0dd-1bcf-42e2-baa1-b2115392f537 tempest-ProjectAdminTests33-1900627284 None] Call Volume Manager to get_backup_device for Backup(availability_zone='nova',container=None,created_at=2026-07-03T09:45:22Z,data_timestamp=2026-07-03T09:45:22Z,deleted=False,deleted_at=None,display_description=None,display_name=None,encryption_key_id=None,fail_reason=None,host='np0000004400',id=3d538c5e-b79f-4328-82e9-e76f89c22158,metadata={},num_dependent_backups=0,object_count=0,parent=None,parent_id=None,project_id='a2309d0555a742279b4a5017d94ebf02',restore_volume_id=None,service='cinder.backup.drivers.swift.SwiftBackupDriver',service_metadata=None,size=1,snapshot_id=None,status='creating',temp_snapshot_id=None,temp_volume_id=None,updated_at=None,user_id='23ba560f6eed465495956e82c26b6f69',volume_id=4b68dad5-e9a3-4bd1-84e2-ba745cb7bb83) Jul 03 09:45:22.723976 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.drivers.swift [None req-39edf0dd-1bcf-42e2-baa1-b2115392f537 tempest-ProjectAdminTests33-1900627284 None] Using swift URL https://10.4.3.95:8080/v1/AUTH_a2309d0555a742279b4a5017d94ebf02 {{(pid=101319) initialize /opt/stack/cinder/cinder/backup/drivers/swift.py:300}} Jul 03 09:45:22.723976 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.drivers.swift [None req-39edf0dd-1bcf-42e2-baa1-b2115392f537 tempest-ProjectAdminTests33-1900627284 None] Connect to https://10.4.3.95:8080/v1/AUTH_ in "per_user" mode {{(pid=101319) initialize /opt/stack/cinder/cinder/backup/drivers/swift.py:301}} Jul 03 09:45:22.723976 np0000004400 cinder-backup[101319]: DEBUG os_brick.utils [None req-39edf0dd-1bcf-42e2-baa1-b2115392f537 tempest-ProjectAdminTests33-1900627284 None] ==> get_connector_properties: call "{'root_helper': 'sudo cinder-rootwrap /etc/cinder/rootwrap.conf', 'my_ip': '10.4.3.95', 'multipath': False, 'enforce_multipath': False, 'host': None, 'execute': None}" {{(pid=101319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}} Jul 03 09:45:22.736584 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.scaleio [None req-39edf0dd-1bcf-42e2-baa1-b2115392f537 tempest-ProjectAdminTests33-1900627284 None] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=101319) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}} Jul 03 09:45:22.758526 np0000004400 cinder-backup[101319]: DEBUG oslo_concurrency.processutils [None req-39edf0dd-1bcf-42e2-baa1-b2115392f537 tempest-ProjectAdminTests33-1900627284 None] Running cmd (subprocess): nvme version {{(pid=101319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 09:45:22.774177 np0000004400 cinder-backup[101319]: DEBUG oslo_concurrency.processutils [None req-39edf0dd-1bcf-42e2-baa1-b2115392f537 tempest-ProjectAdminTests33-1900627284 None] 'nvme version' failed. Not Retrying. {{(pid=101319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 03 09:45:22.775127 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.nvmeof [None req-39edf0dd-1bcf-42e2-baa1-b2115392f537 tempest-ProjectAdminTests33-1900627284 None] nvme not present on system {{(pid=101319) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}} Jul 03 09:45:22.782478 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.lightos [None req-39edf0dd-1bcf-42e2-baa1-b2115392f537 tempest-ProjectAdminTests33-1900627284 None] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=101319) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}} Jul 03 09:45:22.784210 np0000004400 cinder-backup[101319]: INFO os_brick.initiator.connectors.lightos [None req-39edf0dd-1bcf-42e2-baa1-b2115392f537 tempest-ProjectAdminTests33-1900627284 None] Current host hostNQN and IP(s) are ['10.4.3.95', 'fe80::f816:3eff:fe47:268c', '192.168.40.6', 'fe80::f816:3eff:febf:7be2', '192.168.50.6', 'fe80::f816:3eff:fe99:8914', '192.168.10.6', 'fe80::f816:3eff:fe2f:e696', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::bc9d:84ff:fec2:6b49', 'fe80::fc16:3eff:fe36:77bf', 'fe80::4c47:1ff:fe64:1879', 'fe80::fc16:3eff:fec6:c223', 'fe80::fc16:3eff:fef5:5e6e', 'fe80::94d0:62ff:fec5:3886', 'fe80::fc16:3eff:fe48:c24e', 'fe80::fc16:3eff:fea8:bf8b', 'fe80::fc16:3eff:fe42:afa1', 'fe80::fc16:3eff:fea0:4147', 'fe80::b0cf:48ff:fe29:caf0', 'fe80::fc16:3eff:fedf:37a6', 'fe80::fc16:3eff:fe3b:46af', 'fe80::28c1:27ff:fe3c:5528', 'fe80::fc16:3eff:fe91:aa0'] Jul 03 09:45:22.784419 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.lightos [None req-39edf0dd-1bcf-42e2-baa1-b2115392f537 tempest-ProjectAdminTests33-1900627284 None] LIGHTOS: did not find dsc, continuing anyway. {{(pid=101319) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}} Jul 03 09:45:22.784718 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.lightos [None req-39edf0dd-1bcf-42e2-baa1-b2115392f537 tempest-ProjectAdminTests33-1900627284 None] LIGHTOS: no hostnqn found. {{(pid=101319) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}} Jul 03 09:45:22.784951 np0000004400 cinder-backup[101319]: DEBUG os_brick.utils [None req-39edf0dd-1bcf-42e2-baa1-b2115392f537 tempest-ProjectAdminTests33-1900627284 None] <== get_connector_properties: return (62ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.95', 'host': 'np0000004400', 'multipath': False, 'enforce_multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:ae7e5bb0ebe6', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': '6b284368-d0ba-4d18-af6f-4998d3955c52', 'nvme_native_multipath': False} {{(pid=101319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}} Jul 03 09:45:23.289384 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connector [None req-39edf0dd-1bcf-42e2-baa1-b2115392f537 tempest-ProjectAdminTests33-1900627284 None] Factory for iscsi on None {{(pid=101319) factory /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connector.py:243}} Jul 03 09:45:23.289846 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-39edf0dd-1bcf-42e2-baa1-b2115392f537 tempest-ProjectAdminTests33-1900627284 None] ==> connect_volume: call "{'self': , 'connection_properties': {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-4b68dad5-e9a3-4bd1-84e2-ba745cb7bb83', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '4b68dad5-e9a3-4bd1-84e2-ba745cb7bb83', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': False}}" {{(pid=101319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}} Jul 03 09:45:23.290027 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.base [None req-39edf0dd-1bcf-42e2-baa1-b2115392f537 tempest-ProjectAdminTests33-1900627284 None] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=101319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jul 03 09:45:23.290504 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.base [None req-39edf0dd-1bcf-42e2-baa1-b2115392f537 tempest-ProjectAdminTests33-1900627284 None] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.000s {{(pid=101319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jul 03 09:45:23.290718 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.base [None req-39edf0dd-1bcf-42e2-baa1-b2115392f537 tempest-ProjectAdminTests33-1900627284 None] Connection properties {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-4b68dad5-e9a3-4bd1-84e2-ba745cb7bb83', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '4b68dad5-e9a3-4bd1-84e2-ba745cb7bb83', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': False} {{(pid=101319) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}} Jul 03 09:45:23.300977 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.base [None req-39edf0dd-1bcf-42e2-baa1-b2115392f537 tempest-ProjectAdminTests33-1900627284 None] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-4b68dad5-e9a3-4bd1-84e2-ba745cb7bb83" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=101319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jul 03 09:45:23.301291 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.base [None req-39edf0dd-1bcf-42e2-baa1-b2115392f537 tempest-ProjectAdminTests33-1900627284 None] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-4b68dad5-e9a3-4bd1-84e2-ba745cb7bb83" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.000s {{(pid=101319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jul 03 09:45:23.301492 np0000004400 cinder-backup[101319]: INFO os_brick.initiator.connectors.iscsi [None req-39edf0dd-1bcf-42e2-baa1-b2115392f537 tempest-ProjectAdminTests33-1900627284 None] Trying to connect to iSCSI portal 192.168.40.100:3260 Jul 03 09:45:23.311577 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-39edf0dd-1bcf-42e2-baa1-b2115392f537 tempest-ProjectAdminTests33-1900627284 None] iscsiadm (): stdout= stderr=iscsiadm: No records found Jul 03 09:45:23.311577 np0000004400 cinder-backup[101319]: {{(pid=101319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 03 09:45:23.322120 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-39edf0dd-1bcf-42e2-baa1-b2115392f537 tempest-ProjectAdminTests33-1900627284 None] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-4b68dad5-e9a3-4bd1-84e2-ba745cb7bb83] added Jul 03 09:45:23.322120 np0000004400 cinder-backup[101319]: stderr=iscsiadm: Config file line 363 does not have value Jul 03 09:45:23.322120 np0000004400 cinder-backup[101319]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs' Jul 03 09:45:23.322120 np0000004400 cinder-backup[101319]: iscsiadm: Config file line 363 does not have value Jul 03 09:45:23.322120 np0000004400 cinder-backup[101319]: iscsiadm: Config file line 363 does not have value Jul 03 09:45:23.322120 np0000004400 cinder-backup[101319]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs' Jul 03 09:45:23.322120 np0000004400 cinder-backup[101319]: {{(pid=101319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 03 09:45:23.322519 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-39edf0dd-1bcf-42e2-baa1-b2115392f537 tempest-ProjectAdminTests33-1900627284 None] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=101319) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}} Jul 03 09:45:23.322720 np0000004400 cinder-backup[101319]: DEBUG os_brick.utils [None req-39edf0dd-1bcf-42e2-baa1-b2115392f537 tempest-ProjectAdminTests33-1900627284 None] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0211(s), this was the 1st time calling it. {{(pid=101319) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}} Jul 03 09:45:23.322900 np0000004400 cinder-backup[101319]: DEBUG os_brick.utils [None req-39edf0dd-1bcf-42e2-baa1-b2115392f537 tempest-ProjectAdminTests33-1900627284 None] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=101319) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}} Jul 03 09:45:23.500628 np0000004400 cinder-backup[101319]: INFO cinder.backup.manager [None req-7f8b3484-81fc-4e9e-84e6-f701b522ee42 tempest-VolumesBackupsTest-118275719 None] Restore backup started, backup: 435094a5-f336-4be4-826b-fa363af35296 volume: b86cbab3-7c42-409e-b4f6-0ed61267a031. Jul 03 09:45:23.539167 np0000004400 cinder-backup[101319]: DEBUG oslo_db.sqlalchemy.engines [None req-7f8b3484-81fc-4e9e-84e6-f701b522ee42 tempest-VolumesBackupsTest-118275719 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=101319) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 03 09:45:23.547707 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.drivers.swift [None req-7f8b3484-81fc-4e9e-84e6-f701b522ee42 tempest-VolumesBackupsTest-118275719 None] Using swift URL https://10.4.3.95:8080/v1/AUTH_a484ec9218bf417bb9d7575ae6370646 {{(pid=101319) initialize /opt/stack/cinder/cinder/backup/drivers/swift.py:300}} Jul 03 09:45:23.547904 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.drivers.swift [None req-7f8b3484-81fc-4e9e-84e6-f701b522ee42 tempest-VolumesBackupsTest-118275719 None] Connect to https://10.4.3.95:8080/v1/AUTH_ in "per_user" mode {{(pid=101319) initialize /opt/stack/cinder/cinder/backup/drivers/swift.py:301}} Jul 03 09:45:23.548135 np0000004400 cinder-backup[101319]: DEBUG os_brick.utils [None req-7f8b3484-81fc-4e9e-84e6-f701b522ee42 tempest-VolumesBackupsTest-118275719 None] ==> get_connector_properties: call "{'root_helper': 'sudo cinder-rootwrap /etc/cinder/rootwrap.conf', 'my_ip': '10.4.3.95', 'multipath': False, 'enforce_multipath': False, 'host': None, 'execute': None}" {{(pid=101319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}} Jul 03 09:45:23.557601 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.scaleio [None req-7f8b3484-81fc-4e9e-84e6-f701b522ee42 tempest-VolumesBackupsTest-118275719 None] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=101319) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}} Jul 03 09:45:23.574385 np0000004400 cinder-backup[101319]: DEBUG oslo_concurrency.processutils [None req-7f8b3484-81fc-4e9e-84e6-f701b522ee42 tempest-VolumesBackupsTest-118275719 None] Running cmd (subprocess): nvme version {{(pid=101319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 09:45:23.587962 np0000004400 cinder-backup[101319]: DEBUG oslo_concurrency.processutils [None req-7f8b3484-81fc-4e9e-84e6-f701b522ee42 tempest-VolumesBackupsTest-118275719 None] 'nvme version' failed. Not Retrying. {{(pid=101319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 03 09:45:23.588327 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.nvmeof [None req-7f8b3484-81fc-4e9e-84e6-f701b522ee42 tempest-VolumesBackupsTest-118275719 None] nvme not present on system {{(pid=101319) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}} Jul 03 09:45:23.596191 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.lightos [None req-7f8b3484-81fc-4e9e-84e6-f701b522ee42 tempest-VolumesBackupsTest-118275719 None] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=101319) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}} Jul 03 09:45:23.598136 np0000004400 cinder-backup[101319]: INFO os_brick.initiator.connectors.lightos [None req-7f8b3484-81fc-4e9e-84e6-f701b522ee42 tempest-VolumesBackupsTest-118275719 None] Current host hostNQN and IP(s) are ['10.4.3.95', 'fe80::f816:3eff:fe47:268c', '192.168.40.6', 'fe80::f816:3eff:febf:7be2', '192.168.50.6', 'fe80::f816:3eff:fe99:8914', '192.168.10.6', 'fe80::f816:3eff:fe2f:e696', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::bc9d:84ff:fec2:6b49', 'fe80::fc16:3eff:fe36:77bf', 'fe80::4c47:1ff:fe64:1879', 'fe80::fc16:3eff:fec6:c223', 'fe80::fc16:3eff:fef5:5e6e', 'fe80::94d0:62ff:fec5:3886', 'fe80::fc16:3eff:fe48:c24e', 'fe80::fc16:3eff:fea8:bf8b', 'fe80::fc16:3eff:fe42:afa1', 'fe80::fc16:3eff:fea0:4147', 'fe80::b0cf:48ff:fe29:caf0', 'fe80::fc16:3eff:fedf:37a6', 'fe80::fc16:3eff:fe3b:46af', 'fe80::28c1:27ff:fe3c:5528', 'fe80::fc16:3eff:fe91:aa0'] Jul 03 09:45:23.598349 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.lightos [None req-7f8b3484-81fc-4e9e-84e6-f701b522ee42 tempest-VolumesBackupsTest-118275719 None] LIGHTOS: did not find dsc, continuing anyway. {{(pid=101319) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}} Jul 03 09:45:23.598570 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.lightos [None req-7f8b3484-81fc-4e9e-84e6-f701b522ee42 tempest-VolumesBackupsTest-118275719 None] LIGHTOS: no hostnqn found. {{(pid=101319) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}} Jul 03 09:45:23.598931 np0000004400 cinder-backup[101319]: DEBUG os_brick.utils [None req-7f8b3484-81fc-4e9e-84e6-f701b522ee42 tempest-VolumesBackupsTest-118275719 None] <== get_connector_properties: return (50ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.95', 'host': 'np0000004400', 'multipath': False, 'enforce_multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:ae7e5bb0ebe6', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': '6b284368-d0ba-4d18-af6f-4998d3955c52', 'nvme_native_multipath': False} {{(pid=101319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}} Jul 03 09:45:24.311443 np0000004400 cinder-backup[101319]: DEBUG oslo_db.sqlalchemy.engines [None req-327bc060-a9c1-4783-a969-79ebb1b84e7c tempest-VolumesBackupsTest-2142009639 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=101319) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 03 09:45:24.317725 np0000004400 cinder-backup[101319]: INFO cinder.backup.manager [None req-327bc060-a9c1-4783-a969-79ebb1b84e7c tempest-VolumesBackupsTest-2142009639 None] Create backup started, backup: e353b2b2-ecff-4fe0-8148-bf9d1d84a8bf volume: b1fc0d58-7747-4bcf-99a7-fb482aacb945. Jul 03 09:45:24.323188 np0000004400 cinder-backup[101319]: INFO cinder.backup.manager [None req-327bc060-a9c1-4783-a969-79ebb1b84e7c tempest-VolumesBackupsTest-2142009639 None] Call Volume Manager to get_backup_device for Backup(availability_zone='nova',container='tempest-volumesbackupstest-backup-container-1320776190',created_at=2026-07-03T09:45:24Z,data_timestamp=2026-07-03T09:45:24Z,deleted=False,deleted_at=None,display_description='tempest-backup-description-721862093',display_name='tempest-VolumesBackupsTest-Backup-1542290489',encryption_key_id=None,fail_reason=None,host='np0000004400',id=e353b2b2-ecff-4fe0-8148-bf9d1d84a8bf,metadata={},num_dependent_backups=0,object_count=0,parent=None,parent_id=None,project_id='59044e18a5b24b19a7b9b8a380f2e1a0',restore_volume_id=None,service='cinder.backup.drivers.swift.SwiftBackupDriver',service_metadata=None,size=1,snapshot_id=None,status='creating',temp_snapshot_id=None,temp_volume_id=None,updated_at=None,user_id='91463b6c437c4711a49d3c31c513a101',volume_id=b1fc0d58-7747-4bcf-99a7-fb482aacb945) Jul 03 09:45:24.324262 np0000004400 cinder-backup[101319]: INFO os_brick.initiator.connectors.iscsi [None req-39edf0dd-1bcf-42e2-baa1-b2115392f537 tempest-ProjectAdminTests33-1900627284 None] Trying to connect to iSCSI portal 192.168.40.100:3260 Jul 03 09:45:24.334228 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-39edf0dd-1bcf-42e2-baa1-b2115392f537 tempest-ProjectAdminTests33-1900627284 None] iscsiadm (): stdout=# BEGIN RECORD 2.1.9 Jul 03 09:45:24.334228 np0000004400 cinder-backup[101319]: node.name = iqn.2023-03.storpool.com:os--volume-4b68dad5-e9a3-4bd1-84e2-ba745cb7bb83 Jul 03 09:45:24.334228 np0000004400 cinder-backup[101319]: node.tpgt = -1 Jul 03 09:45:24.334228 np0000004400 cinder-backup[101319]: node.startup = manual Jul 03 09:45:24.334228 np0000004400 cinder-backup[101319]: node.leading_login = No Jul 03 09:45:24.334228 np0000004400 cinder-backup[101319]: iface.iscsi_ifacename = default Jul 03 09:45:24.334228 np0000004400 cinder-backup[101319]: iface.net_ifacename = Jul 03 09:45:24.334228 np0000004400 cinder-backup[101319]: iface.ipaddress = Jul 03 09:45:24.334228 np0000004400 cinder-backup[101319]: iface.prefix_len = 0 Jul 03 09:45:24.334228 np0000004400 cinder-backup[101319]: iface.hwaddress = Jul 03 09:45:24.334228 np0000004400 cinder-backup[101319]: iface.transport_name = tcp Jul 03 09:45:24.334228 np0000004400 cinder-backup[101319]: iface.initiatorname = Jul 03 09:45:24.334228 np0000004400 cinder-backup[101319]: iface.state = Jul 03 09:45:24.334228 np0000004400 cinder-backup[101319]: iface.vlan_id = 0 Jul 03 09:45:24.334228 np0000004400 cinder-backup[101319]: iface.vlan_priority = 0 Jul 03 09:45:24.334228 np0000004400 cinder-backup[101319]: iface.vlan_state = Jul 03 09:45:24.334228 np0000004400 cinder-backup[101319]: iface.iface_num = 0 Jul 03 09:45:24.334228 np0000004400 cinder-backup[101319]: iface.mtu = 0 Jul 03 09:45:24.334228 np0000004400 cinder-backup[101319]: iface.port = 0 Jul 03 09:45:24.334228 np0000004400 cinder-backup[101319]: iface.bootproto = Jul 03 09:45:24.334228 np0000004400 cinder-backup[101319]: iface.subnet_mask = Jul 03 09:45:24.334228 np0000004400 cinder-backup[101319]: iface.gateway = Jul 03 09:45:24.334228 np0000004400 cinder-backup[101319]: iface.dhcp_alt_client_id_state = Jul 03 09:45:24.334228 np0000004400 cinder-backup[101319]: iface.dhcp_alt_client_id = Jul 03 09:45:24.334228 np0000004400 cinder-backup[101319]: iface.dhcp_dns = Jul 03 09:45:24.334228 np0000004400 cinder-backup[101319]: iface.dhcp_learn_iqn = Jul 03 09:45:24.334228 np0000004400 cinder-backup[101319]: iface.dhcp_req_vendor_id_state = Jul 03 09:45:24.334228 np0000004400 cinder-backup[101319]: iface.dhcp_vendor_id_state = Jul 03 09:45:24.334228 np0000004400 cinder-backup[101319]: iface.dhcp_vendor_id = Jul 03 09:45:24.334228 np0000004400 cinder-backup[101319]: iface.dhcp_slp_da = Jul 03 09:45:24.334228 np0000004400 cinder-backup[101319]: iface.fragmentation = Jul 03 09:45:24.334228 np0000004400 cinder-backup[101319]: iface.gratuitous_arp = Jul 03 09:45:24.334228 np0000004400 cinder-backup[101319]: iface.incoming_forwarding = Jul 03 09:45:24.334228 np0000004400 cinder-backup[101319]: iface.tos_state = Jul 03 09:45:24.334228 np0000004400 cinder-backup[101319]: iface.tos = 0 Jul 03 09:45:24.334228 np0000004400 cinder-backup[101319]: iface.ttl = 0 Jul 03 09:45:24.334228 np0000004400 cinder-backup[101319]: iface.delayed_ack = Jul 03 09:45:24.334228 np0000004400 cinder-backup[101319]: iface.tcp_nagle = Jul 03 09:45:24.334228 np0000004400 cinder-backup[101319]: iface.tcp_wsf_state = Jul 03 09:45:24.334228 np0000004400 cinder-backup[101319]: iface.tcp_wsf = 0 Jul 03 09:45:24.334228 np0000004400 cinder-backup[101319]: iface.tcp_timer_scale = 0 Jul 03 09:45:24.334228 np0000004400 cinder-backup[101319]: iface.tcp_timestamp = Jul 03 09:45:24.334228 np0000004400 cinder-backup[101319]: iface.redirect = Jul 03 09:45:24.334228 np0000004400 cinder-backup[101319]: iface.def_task_mgmt_timeout = 0 Jul 03 09:45:24.334228 np0000004400 cinder-backup[101319]: iface.header_digest = Jul 03 09:45:24.334228 np0000004400 cinder-backup[101319]: iface.data_digest = Jul 03 09:45:24.334228 np0000004400 cinder-backup[101319]: iface.immediate_data = Jul 03 09:45:24.334228 np0000004400 cinder-backup[101319]: iface.initial_r2t = Jul 03 09:45:24.334228 np0000004400 cinder-backup[101319]: iface.data_seq_inorder = Jul 03 09:45:24.334228 np0000004400 cinder-backup[101319]: iface.data_pdu_inorder = Jul 03 09:45:24.334228 np0000004400 cinder-backup[101319]: iface.erl = 0 Jul 03 09:45:24.334228 np0000004400 cinder-backup[101319]: iface.max_receive_data_len = 0 Jul 03 09:45:24.334228 np0000004400 cinder-backup[101319]: iface.first_burst_len = 0 Jul 03 09:45:24.334228 np0000004400 cinder-backup[101319]: iface.max_outstanding_r2t = 0 Jul 03 09:45:24.334228 np0000004400 cinder-backup[101319]: iface.max_burst_len = 0 Jul 03 09:45:24.334228 np0000004400 cinder-backup[101319]: iface.chap_auth = Jul 03 09:45:24.334228 np0000004400 cinder-backup[101319]: iface.bidi_chap = Jul 03 09:45:24.334228 np0000004400 cinder-backup[101319]: iface.strict_login_compliance = Jul 03 09:45:24.334228 np0000004400 cinder-backup[101319]: iface.discovery_auth = Jul 03 09:45:24.334228 np0000004400 cinder-backup[101319]: iface.discovery_logout = Jul 03 09:45:24.334228 np0000004400 cinder-backup[101319]: node.discovery_address = Jul 03 09:45:24.334228 np0000004400 cinder-backup[101319]: node.discovery_port = 0 Jul 03 09:45:24.334228 np0000004400 cinder-backup[101319]: node.discovery_type = fw Jul 03 09:45:24.334228 np0000004400 cinder-backup[101319]: node.session.initial_cmdsn = 0 Jul 03 09:45:24.334228 np0000004400 cinder-backup[101319]: node.session.initial_login_retry_max = 8 Jul 03 09:45:24.334228 np0000004400 cinder-backup[101319]: node.session.xmit_thread_priority = 0 Jul 03 09:45:24.334228 np0000004400 cinder-backup[101319]: node.session.cmds_max = 128 Jul 03 09:45:24.334228 np0000004400 cinder-backup[101319]: node.session.queue_depth = 32 Jul 03 09:45:24.334228 np0000004400 cinder-backup[101319]: node.session.nr_sessions = 1 Jul 03 09:45:24.334228 np0000004400 cinder-backup[101319]: node.session.auth.authmethod = None Jul 03 09:45:24.334228 np0000004400 cinder-backup[101319]: node.session.auth.username = Jul 03 09:45:24.334228 np0000004400 cinder-backup[101319]: node.session.auth.password = *** Jul 03 09:45:24.334228 np0000004400 cinder-backup[101319]: node.session.auth.username_in = Jul 03 09:45:24.334228 np0000004400 cinder-backup[101319]: node.session.auth.password_in = Jul 03 09:45:24.334228 np0000004400 cinder-backup[101319]: node.session.auth.chap_algs = SHA256 Jul 03 09:45:24.334228 np0000004400 cinder-backup[101319]: node.session.timeo.replacement_timeout = 120 Jul 03 09:45:24.334228 np0000004400 cinder-backup[101319]: node.session.err_timeo.abort_timeout = 15 Jul 03 09:45:24.334228 np0000004400 cinder-backup[101319]: node.session.err_timeo.lu_reset_timeout = 30 Jul 03 09:45:24.334228 np0000004400 cinder-backup[101319]: node.session.err_timeo.tgt_reset_timeout = 30 Jul 03 09:45:24.334228 np0000004400 cinder-backup[101319]: node.session.err_timeo.host_reset_timeout = 60 Jul 03 09:45:24.334228 np0000004400 cinder-backup[101319]: node.session.iscsi.FastAbort = Yes Jul 03 09:45:24.334228 np0000004400 cinder-backup[101319]: node.session.iscsi.InitialR2T = No Jul 03 09:45:24.334228 np0000004400 cinder-backup[101319]: node.session.iscsi.ImmediateData = Yes Jul 03 09:45:24.334228 np0000004400 cinder-backup[101319]: node.session.iscsi.FirstBurstLength = 262144 Jul 03 09:45:24.334228 np0000004400 cinder-backup[101319]: node.session.iscsi.MaxBurstLength = 16776192 Jul 03 09:45:24.334228 np0000004400 cinder-backup[101319]: node.session.iscsi.DefaultTime2Retain = 0 Jul 03 09:45:24.334228 np0000004400 cinder-backup[101319]: node.session.iscsi.DefaultTime2Wait = 2 Jul 03 09:45:24.334228 np0000004400 cinder-backup[101319]: node.session.iscsi.MaxConnections = 1 Jul 03 09:45:24.334228 np0000004400 cinder-backup[101319]: node.session.iscsi.MaxOutstandingR2T = 1 Jul 03 09:45:24.334228 np0000004400 cinder-backup[101319]: node.session.iscsi.ERL = 0 Jul 03 09:45:24.334228 np0000004400 cinder-backup[101319]: node.session.scan = auto Jul 03 09:45:24.334228 np0000004400 cinder-backup[101319]: node.session.reopen_max = 0 Jul 03 09:45:24.334228 np0000004400 cinder-backup[101319]: node.conn[0].address = 192.168.40.100 Jul 03 09:45:24.334228 np0000004400 cinder-backup[101319]: node.conn[0].port = 3260 Jul 03 09:45:24.334228 np0000004400 cinder-backup[101319]: node.conn[0].startup = manual Jul 03 09:45:24.334228 np0000004400 cinder-backup[101319]: node.conn[0].tcp.window_size = 524288 Jul 03 09:45:24.334228 np0000004400 cinder-backup[101319]: node.conn[0].tcp.type_of_service = 0 Jul 03 09:45:24.334228 np0000004400 cinder-backup[101319]: node.conn[0].timeo.logout_timeout = 15 Jul 03 09:45:24.334228 np0000004400 cinder-backup[101319]: node.conn[0].timeo.login_timeout = 15 Jul 03 09:45:24.334228 np0000004400 cinder-backup[101319]: node.conn[0].timeo.auth_timeout = 45 Jul 03 09:45:24.334228 np0000004400 cinder-backup[101319]: node.conn[0].timeo.noop_out_interval = 5 Jul 03 09:45:24.334228 np0000004400 cinder-backup[101319]: node.conn[0].timeo.noop_out_timeout = 5 Jul 03 09:45:24.334228 np0000004400 cinder-backup[101319]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0 Jul 03 09:45:24.334228 np0000004400 cinder-backup[101319]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144 Jul 03 09:45:24.334228 np0000004400 cinder-backup[101319]: node.conn[0].iscsi.HeaderDigest = None Jul 03 09:45:24.334228 np0000004400 cinder-backup[101319]: node.conn[0].iscsi.DataDigest = None Jul 03 09:45:24.334228 np0000004400 cinder-backup[101319]: node.conn[0].iscsi.IFMarker = No Jul 03 09:45:24.334228 np0000004400 cinder-backup[101319]: node.conn[0].iscsi.OFMarker = No Jul 03 09:45:24.334228 np0000004400 cinder-backup[101319]: # END RECORD Jul 03 09:45:24.334228 np0000004400 cinder-backup[101319]: stderr= {{(pid=101319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 03 09:45:24.346673 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.drivers.swift [None req-327bc060-a9c1-4783-a969-79ebb1b84e7c tempest-VolumesBackupsTest-2142009639 None] Using swift URL https://10.4.3.95:8080/v1/AUTH_59044e18a5b24b19a7b9b8a380f2e1a0 {{(pid=101319) initialize /opt/stack/cinder/cinder/backup/drivers/swift.py:300}} Jul 03 09:45:24.346884 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.drivers.swift [None req-327bc060-a9c1-4783-a969-79ebb1b84e7c tempest-VolumesBackupsTest-2142009639 None] Connect to https://10.4.3.95:8080/v1/AUTH_ in "per_user" mode {{(pid=101319) initialize /opt/stack/cinder/cinder/backup/drivers/swift.py:301}} Jul 03 09:45:24.347231 np0000004400 cinder-backup[101319]: DEBUG os_brick.utils [None req-327bc060-a9c1-4783-a969-79ebb1b84e7c tempest-VolumesBackupsTest-2142009639 None] ==> get_connector_properties: call "{'root_helper': 'sudo cinder-rootwrap /etc/cinder/rootwrap.conf', 'my_ip': '10.4.3.95', 'multipath': False, 'enforce_multipath': False, 'host': None, 'execute': None}" {{(pid=101319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}} Jul 03 09:45:24.348063 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-39edf0dd-1bcf-42e2-baa1-b2115392f537 tempest-ProjectAdminTests33-1900627284 None] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=101319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 03 09:45:24.357821 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.scaleio [None req-327bc060-a9c1-4783-a969-79ebb1b84e7c tempest-VolumesBackupsTest-2142009639 None] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=101319) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}} Jul 03 09:45:24.364464 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-39edf0dd-1bcf-42e2-baa1-b2115392f537 tempest-ProjectAdminTests33-1900627284 None] iscsiadm ('-m', 'session'): stdout=tcp: [49] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b2e4f10c-8033-4c54-95a1-dfe45d6357a3 (non-flash) Jul 03 09:45:24.364464 np0000004400 cinder-backup[101319]: tcp: [50] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b2e4f10c-8033-4c54-95a1-dfe45d6357a3 (non-flash) Jul 03 09:45:24.364464 np0000004400 cinder-backup[101319]: tcp: [82] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-76320525-737e-4f58-8523-63ec9abbdc64 (non-flash) Jul 03 09:45:24.364464 np0000004400 cinder-backup[101319]: tcp: [83] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-76320525-737e-4f58-8523-63ec9abbdc64 (non-flash) Jul 03 09:45:24.364464 np0000004400 cinder-backup[101319]: tcp: [93] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-aecd73f6-86c7-4ae8-8bfa-b46655eb6efb (non-flash) Jul 03 09:45:24.364464 np0000004400 cinder-backup[101319]: tcp: [94] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-aecd73f6-86c7-4ae8-8bfa-b46655eb6efb (non-flash) Jul 03 09:45:24.364464 np0000004400 cinder-backup[101319]: tcp: [97] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d47f5d2f-dce5-42f7-a693-a654fd702622 (non-flash) Jul 03 09:45:24.364464 np0000004400 cinder-backup[101319]: tcp: [98] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d47f5d2f-dce5-42f7-a693-a654fd702622 (non-flash) Jul 03 09:45:24.364464 np0000004400 cinder-backup[101319]: stderr= {{(pid=101319) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jul 03 09:45:24.364813 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-39edf0dd-1bcf-42e2-baa1-b2115392f537 tempest-ProjectAdminTests33-1900627284 None] iscsi session list stdout=tcp: [49] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b2e4f10c-8033-4c54-95a1-dfe45d6357a3 (non-flash) Jul 03 09:45:24.364813 np0000004400 cinder-backup[101319]: tcp: [50] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b2e4f10c-8033-4c54-95a1-dfe45d6357a3 (non-flash) Jul 03 09:45:24.364813 np0000004400 cinder-backup[101319]: tcp: [82] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-76320525-737e-4f58-8523-63ec9abbdc64 (non-flash) Jul 03 09:45:24.364813 np0000004400 cinder-backup[101319]: tcp: [83] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-76320525-737e-4f58-8523-63ec9abbdc64 (non-flash) Jul 03 09:45:24.364813 np0000004400 cinder-backup[101319]: tcp: [93] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-aecd73f6-86c7-4ae8-8bfa-b46655eb6efb (non-flash) Jul 03 09:45:24.364813 np0000004400 cinder-backup[101319]: tcp: [94] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-aecd73f6-86c7-4ae8-8bfa-b46655eb6efb (non-flash) Jul 03 09:45:24.364813 np0000004400 cinder-backup[101319]: tcp: [97] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d47f5d2f-dce5-42f7-a693-a654fd702622 (non-flash) Jul 03 09:45:24.364813 np0000004400 cinder-backup[101319]: tcp: [98] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d47f5d2f-dce5-42f7-a693-a654fd702622 (non-flash) Jul 03 09:45:24.364813 np0000004400 cinder-backup[101319]: stderr= {{(pid=101319) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jul 03 09:45:24.377338 np0000004400 cinder-backup[101319]: DEBUG oslo_concurrency.processutils [None req-327bc060-a9c1-4783-a969-79ebb1b84e7c tempest-VolumesBackupsTest-2142009639 None] Running cmd (subprocess): nvme version {{(pid=101319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 09:45:24.389871 np0000004400 cinder-backup[101319]: DEBUG oslo_concurrency.processutils [None req-327bc060-a9c1-4783-a969-79ebb1b84e7c tempest-VolumesBackupsTest-2142009639 None] 'nvme version' failed. Not Retrying. {{(pid=101319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 03 09:45:24.390175 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.nvmeof [None req-327bc060-a9c1-4783-a969-79ebb1b84e7c tempest-VolumesBackupsTest-2142009639 None] nvme not present on system {{(pid=101319) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}} Jul 03 09:45:24.397291 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.lightos [None req-327bc060-a9c1-4783-a969-79ebb1b84e7c tempest-VolumesBackupsTest-2142009639 None] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=101319) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}} Jul 03 09:45:24.398587 np0000004400 cinder-backup[101319]: INFO os_brick.initiator.connectors.lightos [None req-327bc060-a9c1-4783-a969-79ebb1b84e7c tempest-VolumesBackupsTest-2142009639 None] Current host hostNQN and IP(s) are ['10.4.3.95', 'fe80::f816:3eff:fe47:268c', '192.168.40.6', 'fe80::f816:3eff:febf:7be2', '192.168.50.6', 'fe80::f816:3eff:fe99:8914', '192.168.10.6', 'fe80::f816:3eff:fe2f:e696', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::bc9d:84ff:fec2:6b49', 'fe80::fc16:3eff:fe36:77bf', 'fe80::4c47:1ff:fe64:1879', 'fe80::fc16:3eff:fec6:c223', 'fe80::fc16:3eff:fef5:5e6e', 'fe80::94d0:62ff:fec5:3886', 'fe80::fc16:3eff:fe48:c24e', 'fe80::fc16:3eff:fea8:bf8b', 'fe80::fc16:3eff:fe42:afa1', 'fe80::fc16:3eff:fea0:4147', 'fe80::b0cf:48ff:fe29:caf0', 'fe80::fc16:3eff:fe3b:46af', 'fe80::28c1:27ff:fe3c:5528', 'fe80::fc16:3eff:fe91:aa0'] Jul 03 09:45:24.398748 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.lightos [None req-327bc060-a9c1-4783-a969-79ebb1b84e7c tempest-VolumesBackupsTest-2142009639 None] LIGHTOS: did not find dsc, continuing anyway. {{(pid=101319) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}} Jul 03 09:45:24.398872 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.lightos [None req-327bc060-a9c1-4783-a969-79ebb1b84e7c tempest-VolumesBackupsTest-2142009639 None] LIGHTOS: no hostnqn found. {{(pid=101319) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}} Jul 03 09:45:24.399126 np0000004400 cinder-backup[101319]: DEBUG os_brick.utils [None req-327bc060-a9c1-4783-a969-79ebb1b84e7c tempest-VolumesBackupsTest-2142009639 None] <== get_connector_properties: return (51ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.95', 'host': 'np0000004400', 'multipath': False, 'enforce_multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:ae7e5bb0ebe6', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': '6b284368-d0ba-4d18-af6f-4998d3955c52', 'nvme_native_multipath': False} {{(pid=101319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}} Jul 03 09:45:24.405638 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-39edf0dd-1bcf-42e2-baa1-b2115392f537 tempest-ProjectAdminTests33-1900627284 None] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-4b68dad5-e9a3-4bd1-84e2-ba745cb7bb83, portal: 192.168.40.100,3260] Jul 03 09:45:24.405638 np0000004400 cinder-backup[101319]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-4b68dad5-e9a3-4bd1-84e2-ba745cb7bb83, portal: 192.168.40.100,3260] successful. Jul 03 09:45:24.405638 np0000004400 cinder-backup[101319]: stderr= {{(pid=101319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 03 09:45:24.415899 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-39edf0dd-1bcf-42e2-baa1-b2115392f537 tempest-ProjectAdminTests33-1900627284 None] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=101319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 03 09:45:24.433478 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-39edf0dd-1bcf-42e2-baa1-b2115392f537 tempest-ProjectAdminTests33-1900627284 None] iscsiadm ('-m', 'session'): stdout=tcp: [104] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-4b68dad5-e9a3-4bd1-84e2-ba745cb7bb83 (non-flash) Jul 03 09:45:24.433478 np0000004400 cinder-backup[101319]: tcp: [49] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b2e4f10c-8033-4c54-95a1-dfe45d6357a3 (non-flash) Jul 03 09:45:24.433478 np0000004400 cinder-backup[101319]: tcp: [50] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b2e4f10c-8033-4c54-95a1-dfe45d6357a3 (non-flash) Jul 03 09:45:24.433478 np0000004400 cinder-backup[101319]: tcp: [82] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-76320525-737e-4f58-8523-63ec9abbdc64 (non-flash) Jul 03 09:45:24.433478 np0000004400 cinder-backup[101319]: tcp: [83] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-76320525-737e-4f58-8523-63ec9abbdc64 (non-flash) Jul 03 09:45:24.433478 np0000004400 cinder-backup[101319]: tcp: [93] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-aecd73f6-86c7-4ae8-8bfa-b46655eb6efb (non-flash) Jul 03 09:45:24.433478 np0000004400 cinder-backup[101319]: tcp: [94] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-aecd73f6-86c7-4ae8-8bfa-b46655eb6efb (non-flash) Jul 03 09:45:24.433478 np0000004400 cinder-backup[101319]: tcp: [97] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d47f5d2f-dce5-42f7-a693-a654fd702622 (non-flash) Jul 03 09:45:24.433478 np0000004400 cinder-backup[101319]: tcp: [98] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d47f5d2f-dce5-42f7-a693-a654fd702622 (non-flash) Jul 03 09:45:24.433478 np0000004400 cinder-backup[101319]: stderr= {{(pid=101319) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jul 03 09:45:24.433775 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-39edf0dd-1bcf-42e2-baa1-b2115392f537 tempest-ProjectAdminTests33-1900627284 None] iscsi session list stdout=tcp: [104] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-4b68dad5-e9a3-4bd1-84e2-ba745cb7bb83 (non-flash) Jul 03 09:45:24.433775 np0000004400 cinder-backup[101319]: tcp: [49] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b2e4f10c-8033-4c54-95a1-dfe45d6357a3 (non-flash) Jul 03 09:45:24.433775 np0000004400 cinder-backup[101319]: tcp: [50] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b2e4f10c-8033-4c54-95a1-dfe45d6357a3 (non-flash) Jul 03 09:45:24.433775 np0000004400 cinder-backup[101319]: tcp: [82] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-76320525-737e-4f58-8523-63ec9abbdc64 (non-flash) Jul 03 09:45:24.433775 np0000004400 cinder-backup[101319]: tcp: [83] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-76320525-737e-4f58-8523-63ec9abbdc64 (non-flash) Jul 03 09:45:24.433775 np0000004400 cinder-backup[101319]: tcp: [93] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-aecd73f6-86c7-4ae8-8bfa-b46655eb6efb (non-flash) Jul 03 09:45:24.433775 np0000004400 cinder-backup[101319]: tcp: [94] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-aecd73f6-86c7-4ae8-8bfa-b46655eb6efb (non-flash) Jul 03 09:45:24.433775 np0000004400 cinder-backup[101319]: tcp: [97] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d47f5d2f-dce5-42f7-a693-a654fd702622 (non-flash) Jul 03 09:45:24.433775 np0000004400 cinder-backup[101319]: tcp: [98] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d47f5d2f-dce5-42f7-a693-a654fd702622 (non-flash) Jul 03 09:45:24.433775 np0000004400 cinder-backup[101319]: stderr= {{(pid=101319) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jul 03 09:45:24.434125 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.base [None req-39edf0dd-1bcf-42e2-baa1-b2115392f537 tempest-ProjectAdminTests33-1900627284 None] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-4b68dad5-e9a3-4bd1-84e2-ba745cb7bb83" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.133s {{(pid=101319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jul 03 09:45:24.434273 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-39edf0dd-1bcf-42e2-baa1-b2115392f537 tempest-ProjectAdminTests33-1900627284 None] Connected to 192.168.40.100:3260 {{(pid=101319) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}} Jul 03 09:45:24.435266 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.linuxscsi [None req-39edf0dd-1bcf-42e2-baa1-b2115392f537 tempest-ProjectAdminTests33-1900627284 None] HCTL ('7', '-', '-', 0) found on session 104 with lun 0 {{(pid=101319) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}} Jul 03 09:45:24.435395 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.linuxscsi [None req-39edf0dd-1bcf-42e2-baa1-b2115392f537 tempest-ProjectAdminTests33-1900627284 None] Scanning host 7 c: -, t: -, l: 0) {{(pid=101319) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}} Jul 03 09:45:24.447863 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.linuxscsi [None req-39edf0dd-1bcf-42e2-baa1-b2115392f537 tempest-ProjectAdminTests33-1900627284 None] Searching for a device in session 104 and hctl ['7', '*', '*', 0] yield: sdb {{(pid=101319) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}} Jul 03 09:45:24.448226 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-39edf0dd-1bcf-42e2-baa1-b2115392f537 tempest-ProjectAdminTests33-1900627284 None] Connected to sdb using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-4b68dad5-e9a3-4bd1-84e2-ba745cb7bb83', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '4b68dad5-e9a3-4bd1-84e2-ba745cb7bb83', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': False} {{(pid=101319) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}} Jul 03 09:45:24.606104 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connector [None req-7f8b3484-81fc-4e9e-84e6-f701b522ee42 tempest-VolumesBackupsTest-118275719 None] Factory for iscsi on None {{(pid=101319) factory /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connector.py:243}} Jul 03 09:45:24.606569 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-7f8b3484-81fc-4e9e-84e6-f701b522ee42 tempest-VolumesBackupsTest-118275719 None] ==> connect_volume: call "{'self': , 'connection_properties': {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-b86cbab3-7c42-409e-b4f6-0ed61267a031', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'b86cbab3-7c42-409e-b4f6-0ed61267a031', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': False}}" {{(pid=101319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}} Jul 03 09:45:24.606772 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.base [None req-7f8b3484-81fc-4e9e-84e6-f701b522ee42 tempest-VolumesBackupsTest-118275719 None] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=101319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jul 03 09:45:24.902461 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connector [None req-327bc060-a9c1-4783-a969-79ebb1b84e7c tempest-VolumesBackupsTest-2142009639 None] Factory for iscsi on None {{(pid=101319) factory /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connector.py:243}} Jul 03 09:45:24.902796 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-327bc060-a9c1-4783-a969-79ebb1b84e7c tempest-VolumesBackupsTest-2142009639 None] ==> connect_volume: call "{'self': , 'connection_properties': {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-b1fc0d58-7747-4bcf-99a7-fb482aacb945', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'b1fc0d58-7747-4bcf-99a7-fb482aacb945', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': False}}" {{(pid=101319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}} Jul 03 09:45:24.902955 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.base [None req-327bc060-a9c1-4783-a969-79ebb1b84e7c tempest-VolumesBackupsTest-2142009639 None] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=101319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jul 03 09:45:25.453209 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.base [None req-39edf0dd-1bcf-42e2-baa1-b2115392f537 tempest-ProjectAdminTests33-1900627284 None] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 2.161s {{(pid=101319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jul 03 09:45:25.453209 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-39edf0dd-1bcf-42e2-baa1-b2115392f537 tempest-ProjectAdminTests33-1900627284 None] <== connect_volume: return (2162ms) {'type': 'block', 'scsi_wwn': '1StorPooliSCSI_DISK_1034578903445799024', 'path': '/dev/sdb'} {{(pid=101319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}} Jul 03 09:45:25.453209 np0000004400 cinder-backup[101319]: DEBUG oslo_concurrency.processutils [None req-39edf0dd-1bcf-42e2-baa1-b2115392f537 tempest-ProjectAdminTests33-1900627284 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chown 1002 /dev/sdb {{(pid=101319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 09:45:25.459831 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.base [None req-7f8b3484-81fc-4e9e-84e6-f701b522ee42 tempest-VolumesBackupsTest-118275719 None] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.852s {{(pid=101319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jul 03 09:45:25.460947 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.base [None req-7f8b3484-81fc-4e9e-84e6-f701b522ee42 tempest-VolumesBackupsTest-118275719 None] Connection properties {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-b86cbab3-7c42-409e-b4f6-0ed61267a031', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'b86cbab3-7c42-409e-b4f6-0ed61267a031', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': False} {{(pid=101319) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}} Jul 03 09:45:25.472252 np0000004400 sudo[136566]: stack : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chown 1002 /dev/sdb Jul 03 09:45:25.472961 np0000004400 sudo[136566]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1002) Jul 03 09:45:25.475592 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.base [None req-7f8b3484-81fc-4e9e-84e6-f701b522ee42 tempest-VolumesBackupsTest-118275719 None] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-b86cbab3-7c42-409e-b4f6-0ed61267a031" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=101319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jul 03 09:45:25.475592 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.base [None req-7f8b3484-81fc-4e9e-84e6-f701b522ee42 tempest-VolumesBackupsTest-118275719 None] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-b86cbab3-7c42-409e-b4f6-0ed61267a031" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.000s {{(pid=101319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jul 03 09:45:25.475592 np0000004400 cinder-backup[101319]: INFO os_brick.initiator.connectors.iscsi [None req-7f8b3484-81fc-4e9e-84e6-f701b522ee42 tempest-VolumesBackupsTest-118275719 None] Trying to connect to iSCSI portal 192.168.40.100:3260 Jul 03 09:45:25.485461 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-7f8b3484-81fc-4e9e-84e6-f701b522ee42 tempest-VolumesBackupsTest-118275719 None] iscsiadm (): stdout= stderr=iscsiadm: No records found Jul 03 09:45:25.485461 np0000004400 cinder-backup[101319]: {{(pid=101319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 03 09:45:25.501096 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-7f8b3484-81fc-4e9e-84e6-f701b522ee42 tempest-VolumesBackupsTest-118275719 None] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-b86cbab3-7c42-409e-b4f6-0ed61267a031] added Jul 03 09:45:25.501096 np0000004400 cinder-backup[101319]: stderr=iscsiadm: Config file line 363 does not have value Jul 03 09:45:25.501096 np0000004400 cinder-backup[101319]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs' Jul 03 09:45:25.501096 np0000004400 cinder-backup[101319]: iscsiadm: Config file line 363 does not have value Jul 03 09:45:25.501096 np0000004400 cinder-backup[101319]: iscsiadm: Config file line 363 does not have value Jul 03 09:45:25.501096 np0000004400 cinder-backup[101319]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs' Jul 03 09:45:25.501096 np0000004400 cinder-backup[101319]: {{(pid=101319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 03 09:45:25.501259 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-7f8b3484-81fc-4e9e-84e6-f701b522ee42 tempest-VolumesBackupsTest-118275719 None] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=101319) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}} Jul 03 09:45:25.501767 np0000004400 cinder-backup[101319]: DEBUG os_brick.utils [None req-7f8b3484-81fc-4e9e-84e6-f701b522ee42 tempest-VolumesBackupsTest-118275719 None] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0263(s), this was the 1st time calling it. {{(pid=101319) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}} Jul 03 09:45:25.507116 np0000004400 cinder-backup[101319]: DEBUG os_brick.utils [None req-7f8b3484-81fc-4e9e-84e6-f701b522ee42 tempest-VolumesBackupsTest-118275719 None] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=101319) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}} Jul 03 09:45:25.782452 np0000004400 sudo[136566]: pam_unix(sudo:session): session closed for user root Jul 03 09:45:25.784816 np0000004400 cinder-backup[101319]: DEBUG oslo_concurrency.processutils [None req-39edf0dd-1bcf-42e2-baa1-b2115392f537 tempest-ProjectAdminTests33-1900627284 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chown 1002 /dev/sdb" returned: 0 in 0.332s {{(pid=101319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 09:45:25.821834 np0000004400 cinder-backup[101319]: DEBUG oslo_db.sqlalchemy.engines [None req-39edf0dd-1bcf-42e2-baa1-b2115392f537 tempest-ProjectAdminTests33-1900627284 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=101319) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 03 09:45:25.829101 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-39edf0dd-1bcf-42e2-baa1-b2115392f537 tempest-ProjectAdminTests33-1900627284 None] _create_container started, container: volumebackups,backup: 3d538c5e-b79f-4328-82e9-e76f89c22158. {{(pid=101319) _create_container /opt/stack/cinder/cinder/backup/chunkeddriver.py:249}} Jul 03 09:45:25.858928 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.drivers.swift [None req-39edf0dd-1bcf-42e2-baa1-b2115392f537 tempest-ProjectAdminTests33-1900627284 None] generate_object_name_prefix: volume_4b68dad5-e9a3-4bd1-84e2-ba745cb7bb83/20260703094525/az_nova_backup_3d538c5e-b79f-4328-82e9-e76f89c22158 {{(pid=101319) _generate_object_name_prefix /opt/stack/cinder/cinder/backup/drivers/swift.py:452}} Jul 03 09:45:25.866055 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-39edf0dd-1bcf-42e2-baa1-b2115392f537 tempest-ProjectAdminTests33-1900627284 None] starting backup of volume: 4b68dad5-e9a3-4bd1-84e2-ba745cb7bb83, volume size: 1073741824, object names prefix volume_4b68dad5-e9a3-4bd1-84e2-ba745cb7bb83/20260703094525/az_nova_backup_3d538c5e-b79f-4328-82e9-e76f89c22158, availability zone: nova {{(pid=101319) _prepare_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:359}} Jul 03 09:45:26.044422 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-39edf0dd-1bcf-42e2-baa1-b2115392f537 tempest-ProjectAdminTests33-1900627284 None] Backing up chunk of data from volume. {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 09:45:26.293918 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-39edf0dd-1bcf-42e2-baa1-b2115392f537 tempest-ProjectAdminTests33-1900627284 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101319) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 09:45:26.294355 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-39edf0dd-1bcf-42e2-baa1-b2115392f537 tempest-ProjectAdminTests33-1900627284 None] About to put_object {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 09:45:26.416011 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-39edf0dd-1bcf-42e2-baa1-b2115392f537 tempest-ProjectAdminTests33-1900627284 None] backup MD5 for volume_4b68dad5-e9a3-4bd1-84e2-ba745cb7bb83/20260703094525/az_nova_backup_3d538c5e-b79f-4328-82e9-e76f89c22158-00001: 25e317773f308e446cc84c503a6d1f85 {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 09:45:26.416309 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-39edf0dd-1bcf-42e2-baa1-b2115392f537 tempest-ProjectAdminTests33-1900627284 None] Calling eventlet.sleep(0) {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 09:45:26.503551 np0000004400 cinder-backup[101319]: INFO os_brick.initiator.connectors.iscsi [None req-7f8b3484-81fc-4e9e-84e6-f701b522ee42 tempest-VolumesBackupsTest-118275719 None] Trying to connect to iSCSI portal 192.168.40.100:3260 Jul 03 09:45:26.516677 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-7f8b3484-81fc-4e9e-84e6-f701b522ee42 tempest-VolumesBackupsTest-118275719 None] iscsiadm (): stdout=# BEGIN RECORD 2.1.9 Jul 03 09:45:26.516677 np0000004400 cinder-backup[101319]: node.name = iqn.2023-03.storpool.com:os--volume-b86cbab3-7c42-409e-b4f6-0ed61267a031 Jul 03 09:45:26.516677 np0000004400 cinder-backup[101319]: node.tpgt = -1 Jul 03 09:45:26.516677 np0000004400 cinder-backup[101319]: node.startup = manual Jul 03 09:45:26.516677 np0000004400 cinder-backup[101319]: node.leading_login = No Jul 03 09:45:26.516677 np0000004400 cinder-backup[101319]: iface.iscsi_ifacename = default Jul 03 09:45:26.516677 np0000004400 cinder-backup[101319]: iface.net_ifacename = Jul 03 09:45:26.516677 np0000004400 cinder-backup[101319]: iface.ipaddress = Jul 03 09:45:26.516677 np0000004400 cinder-backup[101319]: iface.prefix_len = 0 Jul 03 09:45:26.516677 np0000004400 cinder-backup[101319]: iface.hwaddress = Jul 03 09:45:26.516677 np0000004400 cinder-backup[101319]: iface.transport_name = tcp Jul 03 09:45:26.516677 np0000004400 cinder-backup[101319]: iface.initiatorname = Jul 03 09:45:26.516677 np0000004400 cinder-backup[101319]: iface.state = Jul 03 09:45:26.516677 np0000004400 cinder-backup[101319]: iface.vlan_id = 0 Jul 03 09:45:26.516677 np0000004400 cinder-backup[101319]: iface.vlan_priority = 0 Jul 03 09:45:26.516677 np0000004400 cinder-backup[101319]: iface.vlan_state = Jul 03 09:45:26.516677 np0000004400 cinder-backup[101319]: iface.iface_num = 0 Jul 03 09:45:26.516677 np0000004400 cinder-backup[101319]: iface.mtu = 0 Jul 03 09:45:26.516677 np0000004400 cinder-backup[101319]: iface.port = 0 Jul 03 09:45:26.516677 np0000004400 cinder-backup[101319]: iface.bootproto = Jul 03 09:45:26.516677 np0000004400 cinder-backup[101319]: iface.subnet_mask = Jul 03 09:45:26.516677 np0000004400 cinder-backup[101319]: iface.gateway = Jul 03 09:45:26.516677 np0000004400 cinder-backup[101319]: iface.dhcp_alt_client_id_state = Jul 03 09:45:26.516677 np0000004400 cinder-backup[101319]: iface.dhcp_alt_client_id = Jul 03 09:45:26.516677 np0000004400 cinder-backup[101319]: iface.dhcp_dns = Jul 03 09:45:26.516677 np0000004400 cinder-backup[101319]: iface.dhcp_learn_iqn = Jul 03 09:45:26.516677 np0000004400 cinder-backup[101319]: iface.dhcp_req_vendor_id_state = Jul 03 09:45:26.516677 np0000004400 cinder-backup[101319]: iface.dhcp_vendor_id_state = Jul 03 09:45:26.516677 np0000004400 cinder-backup[101319]: iface.dhcp_vendor_id = Jul 03 09:45:26.516677 np0000004400 cinder-backup[101319]: iface.dhcp_slp_da = Jul 03 09:45:26.516677 np0000004400 cinder-backup[101319]: iface.fragmentation = Jul 03 09:45:26.516677 np0000004400 cinder-backup[101319]: iface.gratuitous_arp = Jul 03 09:45:26.516677 np0000004400 cinder-backup[101319]: iface.incoming_forwarding = Jul 03 09:45:26.516677 np0000004400 cinder-backup[101319]: iface.tos_state = Jul 03 09:45:26.516677 np0000004400 cinder-backup[101319]: iface.tos = 0 Jul 03 09:45:26.516677 np0000004400 cinder-backup[101319]: iface.ttl = 0 Jul 03 09:45:26.516677 np0000004400 cinder-backup[101319]: iface.delayed_ack = Jul 03 09:45:26.516677 np0000004400 cinder-backup[101319]: iface.tcp_nagle = Jul 03 09:45:26.516677 np0000004400 cinder-backup[101319]: iface.tcp_wsf_state = Jul 03 09:45:26.516677 np0000004400 cinder-backup[101319]: iface.tcp_wsf = 0 Jul 03 09:45:26.516677 np0000004400 cinder-backup[101319]: iface.tcp_timer_scale = 0 Jul 03 09:45:26.516677 np0000004400 cinder-backup[101319]: iface.tcp_timestamp = Jul 03 09:45:26.516677 np0000004400 cinder-backup[101319]: iface.redirect = Jul 03 09:45:26.516677 np0000004400 cinder-backup[101319]: iface.def_task_mgmt_timeout = 0 Jul 03 09:45:26.516677 np0000004400 cinder-backup[101319]: iface.header_digest = Jul 03 09:45:26.516677 np0000004400 cinder-backup[101319]: iface.data_digest = Jul 03 09:45:26.516677 np0000004400 cinder-backup[101319]: iface.immediate_data = Jul 03 09:45:26.516677 np0000004400 cinder-backup[101319]: iface.initial_r2t = Jul 03 09:45:26.516677 np0000004400 cinder-backup[101319]: iface.data_seq_inorder = Jul 03 09:45:26.516677 np0000004400 cinder-backup[101319]: iface.data_pdu_inorder = Jul 03 09:45:26.516677 np0000004400 cinder-backup[101319]: iface.erl = 0 Jul 03 09:45:26.516677 np0000004400 cinder-backup[101319]: iface.max_receive_data_len = 0 Jul 03 09:45:26.516677 np0000004400 cinder-backup[101319]: iface.first_burst_len = 0 Jul 03 09:45:26.516677 np0000004400 cinder-backup[101319]: iface.max_outstanding_r2t = 0 Jul 03 09:45:26.516677 np0000004400 cinder-backup[101319]: iface.max_burst_len = 0 Jul 03 09:45:26.516677 np0000004400 cinder-backup[101319]: iface.chap_auth = Jul 03 09:45:26.516677 np0000004400 cinder-backup[101319]: iface.bidi_chap = Jul 03 09:45:26.516677 np0000004400 cinder-backup[101319]: iface.strict_login_compliance = Jul 03 09:45:26.516677 np0000004400 cinder-backup[101319]: iface.discovery_auth = Jul 03 09:45:26.516677 np0000004400 cinder-backup[101319]: iface.discovery_logout = Jul 03 09:45:26.516677 np0000004400 cinder-backup[101319]: node.discovery_address = Jul 03 09:45:26.516677 np0000004400 cinder-backup[101319]: node.discovery_port = 0 Jul 03 09:45:26.516677 np0000004400 cinder-backup[101319]: node.discovery_type = fw Jul 03 09:45:26.516677 np0000004400 cinder-backup[101319]: node.session.initial_cmdsn = 0 Jul 03 09:45:26.516677 np0000004400 cinder-backup[101319]: node.session.initial_login_retry_max = 8 Jul 03 09:45:26.516677 np0000004400 cinder-backup[101319]: node.session.xmit_thread_priority = 0 Jul 03 09:45:26.516677 np0000004400 cinder-backup[101319]: node.session.cmds_max = 128 Jul 03 09:45:26.516677 np0000004400 cinder-backup[101319]: node.session.queue_depth = 32 Jul 03 09:45:26.516677 np0000004400 cinder-backup[101319]: node.session.nr_sessions = 1 Jul 03 09:45:26.516677 np0000004400 cinder-backup[101319]: node.session.auth.authmethod = None Jul 03 09:45:26.516677 np0000004400 cinder-backup[101319]: node.session.auth.username = Jul 03 09:45:26.516677 np0000004400 cinder-backup[101319]: node.session.auth.password = *** Jul 03 09:45:26.516677 np0000004400 cinder-backup[101319]: node.session.auth.username_in = Jul 03 09:45:26.516677 np0000004400 cinder-backup[101319]: node.session.auth.password_in = Jul 03 09:45:26.516677 np0000004400 cinder-backup[101319]: node.session.auth.chap_algs = SHA256 Jul 03 09:45:26.516677 np0000004400 cinder-backup[101319]: node.session.timeo.replacement_timeout = 120 Jul 03 09:45:26.516677 np0000004400 cinder-backup[101319]: node.session.err_timeo.abort_timeout = 15 Jul 03 09:45:26.516677 np0000004400 cinder-backup[101319]: node.session.err_timeo.lu_reset_timeout = 30 Jul 03 09:45:26.516677 np0000004400 cinder-backup[101319]: node.session.err_timeo.tgt_reset_timeout = 30 Jul 03 09:45:26.516677 np0000004400 cinder-backup[101319]: node.session.err_timeo.host_reset_timeout = 60 Jul 03 09:45:26.516677 np0000004400 cinder-backup[101319]: node.session.iscsi.FastAbort = Yes Jul 03 09:45:26.516677 np0000004400 cinder-backup[101319]: node.session.iscsi.InitialR2T = No Jul 03 09:45:26.516677 np0000004400 cinder-backup[101319]: node.session.iscsi.ImmediateData = Yes Jul 03 09:45:26.516677 np0000004400 cinder-backup[101319]: node.session.iscsi.FirstBurstLength = 262144 Jul 03 09:45:26.516677 np0000004400 cinder-backup[101319]: node.session.iscsi.MaxBurstLength = 16776192 Jul 03 09:45:26.516677 np0000004400 cinder-backup[101319]: node.session.iscsi.DefaultTime2Retain = 0 Jul 03 09:45:26.516677 np0000004400 cinder-backup[101319]: node.session.iscsi.DefaultTime2Wait = 2 Jul 03 09:45:26.516677 np0000004400 cinder-backup[101319]: node.session.iscsi.MaxConnections = 1 Jul 03 09:45:26.516677 np0000004400 cinder-backup[101319]: node.session.iscsi.MaxOutstandingR2T = 1 Jul 03 09:45:26.516677 np0000004400 cinder-backup[101319]: node.session.iscsi.ERL = 0 Jul 03 09:45:26.516677 np0000004400 cinder-backup[101319]: node.session.scan = auto Jul 03 09:45:26.516677 np0000004400 cinder-backup[101319]: node.session.reopen_max = 0 Jul 03 09:45:26.516677 np0000004400 cinder-backup[101319]: node.conn[0].address = 192.168.40.100 Jul 03 09:45:26.516677 np0000004400 cinder-backup[101319]: node.conn[0].port = 3260 Jul 03 09:45:26.516677 np0000004400 cinder-backup[101319]: node.conn[0].startup = manual Jul 03 09:45:26.516677 np0000004400 cinder-backup[101319]: node.conn[0].tcp.window_size = 524288 Jul 03 09:45:26.516677 np0000004400 cinder-backup[101319]: node.conn[0].tcp.type_of_service = 0 Jul 03 09:45:26.516677 np0000004400 cinder-backup[101319]: node.conn[0].timeo.logout_timeout = 15 Jul 03 09:45:26.516677 np0000004400 cinder-backup[101319]: node.conn[0].timeo.login_timeout = 15 Jul 03 09:45:26.516677 np0000004400 cinder-backup[101319]: node.conn[0].timeo.auth_timeout = 45 Jul 03 09:45:26.516677 np0000004400 cinder-backup[101319]: node.conn[0].timeo.noop_out_interval = 5 Jul 03 09:45:26.516677 np0000004400 cinder-backup[101319]: node.conn[0].timeo.noop_out_timeout = 5 Jul 03 09:45:26.516677 np0000004400 cinder-backup[101319]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0 Jul 03 09:45:26.516677 np0000004400 cinder-backup[101319]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144 Jul 03 09:45:26.516677 np0000004400 cinder-backup[101319]: node.conn[0].iscsi.HeaderDigest = None Jul 03 09:45:26.516677 np0000004400 cinder-backup[101319]: node.conn[0].iscsi.DataDigest = None Jul 03 09:45:26.516677 np0000004400 cinder-backup[101319]: node.conn[0].iscsi.IFMarker = No Jul 03 09:45:26.516677 np0000004400 cinder-backup[101319]: node.conn[0].iscsi.OFMarker = No Jul 03 09:45:26.516677 np0000004400 cinder-backup[101319]: # END RECORD Jul 03 09:45:26.516677 np0000004400 cinder-backup[101319]: stderr= {{(pid=101319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 03 09:45:26.531208 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-7f8b3484-81fc-4e9e-84e6-f701b522ee42 tempest-VolumesBackupsTest-118275719 None] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=101319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 03 09:45:26.549674 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-7f8b3484-81fc-4e9e-84e6-f701b522ee42 tempest-VolumesBackupsTest-118275719 None] iscsiadm ('-m', 'session'): stdout=tcp: [104] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-4b68dad5-e9a3-4bd1-84e2-ba745cb7bb83 (non-flash) Jul 03 09:45:26.549674 np0000004400 cinder-backup[101319]: tcp: [49] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b2e4f10c-8033-4c54-95a1-dfe45d6357a3 (non-flash) Jul 03 09:45:26.549674 np0000004400 cinder-backup[101319]: tcp: [50] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b2e4f10c-8033-4c54-95a1-dfe45d6357a3 (non-flash) Jul 03 09:45:26.549674 np0000004400 cinder-backup[101319]: tcp: [82] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-76320525-737e-4f58-8523-63ec9abbdc64 (non-flash) Jul 03 09:45:26.549674 np0000004400 cinder-backup[101319]: tcp: [83] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-76320525-737e-4f58-8523-63ec9abbdc64 (non-flash) Jul 03 09:45:26.549674 np0000004400 cinder-backup[101319]: tcp: [93] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-aecd73f6-86c7-4ae8-8bfa-b46655eb6efb (non-flash) Jul 03 09:45:26.549674 np0000004400 cinder-backup[101319]: tcp: [94] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-aecd73f6-86c7-4ae8-8bfa-b46655eb6efb (non-flash) Jul 03 09:45:26.549674 np0000004400 cinder-backup[101319]: tcp: [97] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d47f5d2f-dce5-42f7-a693-a654fd702622 (non-flash) Jul 03 09:45:26.549674 np0000004400 cinder-backup[101319]: tcp: [98] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d47f5d2f-dce5-42f7-a693-a654fd702622 (non-flash) Jul 03 09:45:26.549674 np0000004400 cinder-backup[101319]: stderr= {{(pid=101319) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jul 03 09:45:26.550098 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-7f8b3484-81fc-4e9e-84e6-f701b522ee42 tempest-VolumesBackupsTest-118275719 None] iscsi session list stdout=tcp: [104] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-4b68dad5-e9a3-4bd1-84e2-ba745cb7bb83 (non-flash) Jul 03 09:45:26.550098 np0000004400 cinder-backup[101319]: tcp: [49] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b2e4f10c-8033-4c54-95a1-dfe45d6357a3 (non-flash) Jul 03 09:45:26.550098 np0000004400 cinder-backup[101319]: tcp: [50] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b2e4f10c-8033-4c54-95a1-dfe45d6357a3 (non-flash) Jul 03 09:45:26.550098 np0000004400 cinder-backup[101319]: tcp: [82] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-76320525-737e-4f58-8523-63ec9abbdc64 (non-flash) Jul 03 09:45:26.550098 np0000004400 cinder-backup[101319]: tcp: [83] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-76320525-737e-4f58-8523-63ec9abbdc64 (non-flash) Jul 03 09:45:26.550098 np0000004400 cinder-backup[101319]: tcp: [93] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-aecd73f6-86c7-4ae8-8bfa-b46655eb6efb (non-flash) Jul 03 09:45:26.550098 np0000004400 cinder-backup[101319]: tcp: [94] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-aecd73f6-86c7-4ae8-8bfa-b46655eb6efb (non-flash) Jul 03 09:45:26.550098 np0000004400 cinder-backup[101319]: tcp: [97] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d47f5d2f-dce5-42f7-a693-a654fd702622 (non-flash) Jul 03 09:45:26.550098 np0000004400 cinder-backup[101319]: tcp: [98] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d47f5d2f-dce5-42f7-a693-a654fd702622 (non-flash) Jul 03 09:45:26.550098 np0000004400 cinder-backup[101319]: stderr= {{(pid=101319) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jul 03 09:45:26.596792 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-7f8b3484-81fc-4e9e-84e6-f701b522ee42 tempest-VolumesBackupsTest-118275719 None] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-b86cbab3-7c42-409e-b4f6-0ed61267a031, portal: 192.168.40.100,3260] Jul 03 09:45:26.596792 np0000004400 cinder-backup[101319]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-b86cbab3-7c42-409e-b4f6-0ed61267a031, portal: 192.168.40.100,3260] successful. Jul 03 09:45:26.596792 np0000004400 cinder-backup[101319]: stderr= {{(pid=101319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 03 09:45:26.608806 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-7f8b3484-81fc-4e9e-84e6-f701b522ee42 tempest-VolumesBackupsTest-118275719 None] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=101319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 03 09:45:26.627064 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-7f8b3484-81fc-4e9e-84e6-f701b522ee42 tempest-VolumesBackupsTest-118275719 None] iscsiadm ('-m', 'session'): stdout=tcp: [104] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-4b68dad5-e9a3-4bd1-84e2-ba745cb7bb83 (non-flash) Jul 03 09:45:26.627064 np0000004400 cinder-backup[101319]: tcp: [105] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b86cbab3-7c42-409e-b4f6-0ed61267a031 (non-flash) Jul 03 09:45:26.627064 np0000004400 cinder-backup[101319]: tcp: [49] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b2e4f10c-8033-4c54-95a1-dfe45d6357a3 (non-flash) Jul 03 09:45:26.627064 np0000004400 cinder-backup[101319]: tcp: [50] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b2e4f10c-8033-4c54-95a1-dfe45d6357a3 (non-flash) Jul 03 09:45:26.627064 np0000004400 cinder-backup[101319]: tcp: [82] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-76320525-737e-4f58-8523-63ec9abbdc64 (non-flash) Jul 03 09:45:26.627064 np0000004400 cinder-backup[101319]: tcp: [83] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-76320525-737e-4f58-8523-63ec9abbdc64 (non-flash) Jul 03 09:45:26.627064 np0000004400 cinder-backup[101319]: tcp: [93] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-aecd73f6-86c7-4ae8-8bfa-b46655eb6efb (non-flash) Jul 03 09:45:26.627064 np0000004400 cinder-backup[101319]: tcp: [94] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-aecd73f6-86c7-4ae8-8bfa-b46655eb6efb (non-flash) Jul 03 09:45:26.627064 np0000004400 cinder-backup[101319]: tcp: [97] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d47f5d2f-dce5-42f7-a693-a654fd702622 (non-flash) Jul 03 09:45:26.627064 np0000004400 cinder-backup[101319]: tcp: [98] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d47f5d2f-dce5-42f7-a693-a654fd702622 (non-flash) Jul 03 09:45:26.627064 np0000004400 cinder-backup[101319]: stderr= {{(pid=101319) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jul 03 09:45:26.627312 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-7f8b3484-81fc-4e9e-84e6-f701b522ee42 tempest-VolumesBackupsTest-118275719 None] iscsi session list stdout=tcp: [104] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-4b68dad5-e9a3-4bd1-84e2-ba745cb7bb83 (non-flash) Jul 03 09:45:26.627312 np0000004400 cinder-backup[101319]: tcp: [105] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b86cbab3-7c42-409e-b4f6-0ed61267a031 (non-flash) Jul 03 09:45:26.627312 np0000004400 cinder-backup[101319]: tcp: [49] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b2e4f10c-8033-4c54-95a1-dfe45d6357a3 (non-flash) Jul 03 09:45:26.627312 np0000004400 cinder-backup[101319]: tcp: [50] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b2e4f10c-8033-4c54-95a1-dfe45d6357a3 (non-flash) Jul 03 09:45:26.627312 np0000004400 cinder-backup[101319]: tcp: [82] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-76320525-737e-4f58-8523-63ec9abbdc64 (non-flash) Jul 03 09:45:26.627312 np0000004400 cinder-backup[101319]: tcp: [83] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-76320525-737e-4f58-8523-63ec9abbdc64 (non-flash) Jul 03 09:45:26.627312 np0000004400 cinder-backup[101319]: tcp: [93] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-aecd73f6-86c7-4ae8-8bfa-b46655eb6efb (non-flash) Jul 03 09:45:26.627312 np0000004400 cinder-backup[101319]: tcp: [94] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-aecd73f6-86c7-4ae8-8bfa-b46655eb6efb (non-flash) Jul 03 09:45:26.627312 np0000004400 cinder-backup[101319]: tcp: [97] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d47f5d2f-dce5-42f7-a693-a654fd702622 (non-flash) Jul 03 09:45:26.627312 np0000004400 cinder-backup[101319]: tcp: [98] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d47f5d2f-dce5-42f7-a693-a654fd702622 (non-flash) Jul 03 09:45:26.627312 np0000004400 cinder-backup[101319]: stderr= {{(pid=101319) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jul 03 09:45:26.627706 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.base [None req-7f8b3484-81fc-4e9e-84e6-f701b522ee42 tempest-VolumesBackupsTest-118275719 None] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-b86cbab3-7c42-409e-b4f6-0ed61267a031" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.153s {{(pid=101319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jul 03 09:45:26.627970 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-7f8b3484-81fc-4e9e-84e6-f701b522ee42 tempest-VolumesBackupsTest-118275719 None] Connected to 192.168.40.100:3260 {{(pid=101319) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}} Jul 03 09:45:26.629194 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.linuxscsi [None req-7f8b3484-81fc-4e9e-84e6-f701b522ee42 tempest-VolumesBackupsTest-118275719 None] HCTL ('10', '-', '-', 0) found on session 105 with lun 0 {{(pid=101319) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}} Jul 03 09:45:26.629335 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.linuxscsi [None req-7f8b3484-81fc-4e9e-84e6-f701b522ee42 tempest-VolumesBackupsTest-118275719 None] Scanning host 10 c: -, t: -, l: 0) {{(pid=101319) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}} Jul 03 09:45:26.635051 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-39edf0dd-1bcf-42e2-baa1-b2115392f537 tempest-ProjectAdminTests33-1900627284 None] Backing up chunk of data from volume. {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 09:45:26.641989 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.linuxscsi [None req-7f8b3484-81fc-4e9e-84e6-f701b522ee42 tempest-VolumesBackupsTest-118275719 None] Searching for a device in session 105 and hctl ['10', '*', '*', 0] yield: None {{(pid=101319) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}} Jul 03 09:45:26.877050 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-39edf0dd-1bcf-42e2-baa1-b2115392f537 tempest-ProjectAdminTests33-1900627284 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101319) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 09:45:26.877483 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-39edf0dd-1bcf-42e2-baa1-b2115392f537 tempest-ProjectAdminTests33-1900627284 None] About to put_object {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 09:45:26.974331 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-39edf0dd-1bcf-42e2-baa1-b2115392f537 tempest-ProjectAdminTests33-1900627284 None] backup MD5 for volume_4b68dad5-e9a3-4bd1-84e2-ba745cb7bb83/20260703094525/az_nova_backup_3d538c5e-b79f-4328-82e9-e76f89c22158-00002: 25e317773f308e446cc84c503a6d1f85 {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 09:45:26.974528 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-39edf0dd-1bcf-42e2-baa1-b2115392f537 tempest-ProjectAdminTests33-1900627284 None] Calling eventlet.sleep(0) {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 09:45:27.154111 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-39edf0dd-1bcf-42e2-baa1-b2115392f537 tempest-ProjectAdminTests33-1900627284 None] Backing up chunk of data from volume. {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 09:45:27.402132 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-39edf0dd-1bcf-42e2-baa1-b2115392f537 tempest-ProjectAdminTests33-1900627284 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101319) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 09:45:27.402251 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-39edf0dd-1bcf-42e2-baa1-b2115392f537 tempest-ProjectAdminTests33-1900627284 None] About to put_object {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 09:45:27.507873 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-39edf0dd-1bcf-42e2-baa1-b2115392f537 tempest-ProjectAdminTests33-1900627284 None] backup MD5 for volume_4b68dad5-e9a3-4bd1-84e2-ba745cb7bb83/20260703094525/az_nova_backup_3d538c5e-b79f-4328-82e9-e76f89c22158-00003: 25e317773f308e446cc84c503a6d1f85 {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 09:45:27.507873 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-39edf0dd-1bcf-42e2-baa1-b2115392f537 tempest-ProjectAdminTests33-1900627284 None] Calling eventlet.sleep(0) {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 09:45:27.643607 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.linuxscsi [None req-7f8b3484-81fc-4e9e-84e6-f701b522ee42 tempest-VolumesBackupsTest-118275719 None] Searching for a device in session 105 and hctl ['10', '*', '*', 0] yield: sde {{(pid=101319) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}} Jul 03 09:45:27.643756 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-7f8b3484-81fc-4e9e-84e6-f701b522ee42 tempest-VolumesBackupsTest-118275719 None] Connected to sde using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-b86cbab3-7c42-409e-b4f6-0ed61267a031', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'b86cbab3-7c42-409e-b4f6-0ed61267a031', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': False} {{(pid=101319) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}} Jul 03 09:45:27.644399 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.base [None req-7f8b3484-81fc-4e9e-84e6-f701b522ee42 tempest-VolumesBackupsTest-118275719 None] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 2.186s {{(pid=101319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jul 03 09:45:27.644578 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-7f8b3484-81fc-4e9e-84e6-f701b522ee42 tempest-VolumesBackupsTest-118275719 None] <== connect_volume: return (3037ms) {'type': 'block', 'scsi_wwn': '1StorPooliSCSI_DISK_1034578903445799018', 'path': '/dev/sde'} {{(pid=101319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}} Jul 03 09:45:27.644899 np0000004400 cinder-backup[101319]: DEBUG oslo_concurrency.processutils [None req-7f8b3484-81fc-4e9e-84e6-f701b522ee42 tempest-VolumesBackupsTest-118275719 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chown 1002 /dev/sde {{(pid=101319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 09:45:27.657036 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.base [None req-327bc060-a9c1-4783-a969-79ebb1b84e7c tempest-VolumesBackupsTest-2142009639 None] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 2.753s {{(pid=101319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jul 03 09:45:27.657695 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.base [None req-327bc060-a9c1-4783-a969-79ebb1b84e7c tempest-VolumesBackupsTest-2142009639 None] Connection properties {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-b1fc0d58-7747-4bcf-99a7-fb482aacb945', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'b1fc0d58-7747-4bcf-99a7-fb482aacb945', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': False} {{(pid=101319) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}} Jul 03 09:45:27.669588 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.base [None req-327bc060-a9c1-4783-a969-79ebb1b84e7c tempest-VolumesBackupsTest-2142009639 None] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-b1fc0d58-7747-4bcf-99a7-fb482aacb945" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=101319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jul 03 09:45:27.670138 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.base [None req-327bc060-a9c1-4783-a969-79ebb1b84e7c tempest-VolumesBackupsTest-2142009639 None] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-b1fc0d58-7747-4bcf-99a7-fb482aacb945" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=101319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jul 03 09:45:27.670384 np0000004400 cinder-backup[101319]: INFO os_brick.initiator.connectors.iscsi [None req-327bc060-a9c1-4783-a969-79ebb1b84e7c tempest-VolumesBackupsTest-2142009639 None] Trying to connect to iSCSI portal 192.168.40.100:3260 Jul 03 09:45:27.671758 np0000004400 sudo[136664]: stack : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chown 1002 /dev/sde Jul 03 09:45:27.672339 np0000004400 sudo[136664]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1002) Jul 03 09:45:27.684320 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-327bc060-a9c1-4783-a969-79ebb1b84e7c tempest-VolumesBackupsTest-2142009639 None] iscsiadm (): stdout= stderr=iscsiadm: No records found Jul 03 09:45:27.684320 np0000004400 cinder-backup[101319]: {{(pid=101319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 03 09:45:27.696720 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-327bc060-a9c1-4783-a969-79ebb1b84e7c tempest-VolumesBackupsTest-2142009639 None] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-b1fc0d58-7747-4bcf-99a7-fb482aacb945] added Jul 03 09:45:27.696720 np0000004400 cinder-backup[101319]: stderr=iscsiadm: Config file line 363 does not have value Jul 03 09:45:27.696720 np0000004400 cinder-backup[101319]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs' Jul 03 09:45:27.696720 np0000004400 cinder-backup[101319]: iscsiadm: Config file line 363 does not have value Jul 03 09:45:27.696720 np0000004400 cinder-backup[101319]: iscsiadm: Config file line 363 does not have value Jul 03 09:45:27.696720 np0000004400 cinder-backup[101319]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs' Jul 03 09:45:27.696720 np0000004400 cinder-backup[101319]: {{(pid=101319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 03 09:45:27.696971 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-327bc060-a9c1-4783-a969-79ebb1b84e7c tempest-VolumesBackupsTest-2142009639 None] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=101319) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}} Jul 03 09:45:27.697483 np0000004400 cinder-backup[101319]: DEBUG os_brick.utils [None req-327bc060-a9c1-4783-a969-79ebb1b84e7c tempest-VolumesBackupsTest-2142009639 None] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.027(s), this was the 1st time calling it. {{(pid=101319) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}} Jul 03 09:45:27.697746 np0000004400 cinder-backup[101319]: DEBUG os_brick.utils [None req-327bc060-a9c1-4783-a969-79ebb1b84e7c tempest-VolumesBackupsTest-2142009639 None] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=101319) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}} Jul 03 09:45:27.726861 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-39edf0dd-1bcf-42e2-baa1-b2115392f537 tempest-ProjectAdminTests33-1900627284 None] Backing up chunk of data from volume. {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 09:45:27.985623 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-39edf0dd-1bcf-42e2-baa1-b2115392f537 tempest-ProjectAdminTests33-1900627284 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101319) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 09:45:27.986184 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-39edf0dd-1bcf-42e2-baa1-b2115392f537 tempest-ProjectAdminTests33-1900627284 None] About to put_object {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 09:45:28.004083 np0000004400 sudo[136664]: pam_unix(sudo:session): session closed for user root Jul 03 09:45:28.005809 np0000004400 cinder-backup[101319]: DEBUG oslo_concurrency.processutils [None req-7f8b3484-81fc-4e9e-84e6-f701b522ee42 tempest-VolumesBackupsTest-118275719 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chown 1002 /dev/sde" returned: 0 in 0.361s {{(pid=101319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 09:45:28.006149 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-7f8b3484-81fc-4e9e-84e6-f701b522ee42 tempest-VolumesBackupsTest-118275719 None] starting restore of backup volume_b86cbab3-7c42-409e-b4f6-0ed61267a031/20260703094514/az_nova_backup_435094a5-f336-4be4-826b-fa363af35296 container: volumebackups, to existing volume b86cbab3-7c42-409e-b4f6-0ed61267a031, backup: 435094a5-f336-4be4-826b-fa363af35296. {{(pid=101319) restore /opt/stack/cinder/cinder/backup/chunkeddriver.py:761}} Jul 03 09:45:28.006458 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-7f8b3484-81fc-4e9e-84e6-f701b522ee42 tempest-VolumesBackupsTest-118275719 None] _read_metadata started, container name: volumebackups, metadata filename: volume_b86cbab3-7c42-409e-b4f6-0ed61267a031/20260703094514/az_nova_backup_435094a5-f336-4be4-826b-fa363af35296_metadata. {{(pid=101319) _read_metadata /opt/stack/cinder/cinder/backup/chunkeddriver.py:320}} Jul 03 09:45:28.032322 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-7f8b3484-81fc-4e9e-84e6-f701b522ee42 tempest-VolumesBackupsTest-118275719 None] _read_metadata finished. Metadata: { Jul 03 09:45:28.032322 np0000004400 cinder-backup[101319]: "backup_description": null, Jul 03 09:45:28.032322 np0000004400 cinder-backup[101319]: "backup_id": "435094a5-f336-4be4-826b-fa363af35296", Jul 03 09:45:28.032322 np0000004400 cinder-backup[101319]: "backup_name": "tempest-VolumesBackupsTest-Backup-705531849", Jul 03 09:45:28.032322 np0000004400 cinder-backup[101319]: "created_at": "2026-07-03 09:45:11+00:00", Jul 03 09:45:28.032322 np0000004400 cinder-backup[101319]: "objects": [], Jul 03 09:45:28.032322 np0000004400 cinder-backup[101319]: "parent_id": "3087847d-58e1-4a0c-af9c-2639ae9f2aeb", Jul 03 09:45:28.032322 np0000004400 cinder-backup[101319]: "version": "1.0.0", Jul 03 09:45:28.032322 np0000004400 cinder-backup[101319]: "volume_id": "b86cbab3-7c42-409e-b4f6-0ed61267a031", Jul 03 09:45:28.032322 np0000004400 cinder-backup[101319]: "volume_meta": "{\"version\": 2, \"volume-base-metadata\": {\"id\": \"b86cbab3-7c42-409e-b4f6-0ed61267a031\", \"_name_id\": null, \"use_quota\": true, \"ec2_id\": null, \"user_id\": \"b861df2a13684334b293b1f348152e37\", \"project_id\": \"a484ec9218bf417bb9d7575ae6370646\", \"snapshot_id\": null, \"cluster_name\": null, \"host\": \"np0000004400@storpool#default\", \"size\": 1, \"availability_zone\": \"nova\", \"status\": \"backing-up\", \"attach_status\": \"detached\", \"migration_status\": null, \"scheduled_at\": \"2026-07-03T09:44:52.000000\", \"launched_at\": \"2026-07-03T09:44:52.000000\", \"terminated_at\": null, \"display_name\": \"tempest-VolumesBackupsTest-Volume-504009765\", \"display_description\": null, \"provider_location\": null, \"provider_auth\": null, \"provider_geometry\": null, \"provider_id\": null, \"volume_type_id\": \"03e13fe6-0e30-4803-ace0-725d38e6dc24\", \"source_volid\": null, \"encryption_key_id\": null, \"consistencygroup_id\": null, \"group_id\": null, \"bootable\": false, \"multiattach\": false, \"replication_status\": null, \"replication_extended_status\": null, \"replication_driver_data\": null, \"previous_status\": \"available\", \"service_uuid\": \"6d4b0e79-fefe-4744-b25f-34be05095200\", \"shared_targets\": true, \"deleted_at\": null, \"deleted\": false, \"created_at\": \"2026-07-03T09:44:51.000000\", \"updated_at\": \"2026-07-03T09:45:11.000000\"}}" Jul 03 09:45:28.032322 np0000004400 cinder-backup[101319]: }. {{(pid=101319) _read_metadata /opt/stack/cinder/cinder/backup/chunkeddriver.py:327}} Jul 03 09:45:28.032680 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-7f8b3484-81fc-4e9e-84e6-f701b522ee42 tempest-VolumesBackupsTest-118275719 None] Restoring backup version 1.0.0 {{(pid=101319) restore /opt/stack/cinder/cinder/backup/chunkeddriver.py:774}} Jul 03 09:45:28.037904 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-7f8b3484-81fc-4e9e-84e6-f701b522ee42 tempest-VolumesBackupsTest-118275719 None] _read_metadata started, container name: volumebackups, metadata filename: volume_b86cbab3-7c42-409e-b4f6-0ed61267a031/20260703094455/az_nova_backup_3087847d-58e1-4a0c-af9c-2639ae9f2aeb_metadata. {{(pid=101319) _read_metadata /opt/stack/cinder/cinder/backup/chunkeddriver.py:320}} Jul 03 09:45:28.052327 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-7f8b3484-81fc-4e9e-84e6-f701b522ee42 tempest-VolumesBackupsTest-118275719 None] _read_metadata finished. Metadata: { Jul 03 09:45:28.052327 np0000004400 cinder-backup[101319]: "backup_description": null, Jul 03 09:45:28.052327 np0000004400 cinder-backup[101319]: "backup_id": "3087847d-58e1-4a0c-af9c-2639ae9f2aeb", Jul 03 09:45:28.052327 np0000004400 cinder-backup[101319]: "backup_name": "tempest-VolumesBackupsTest-Backup-2010155406", Jul 03 09:45:28.052327 np0000004400 cinder-backup[101319]: "created_at": "2026-07-03 09:44:53+00:00", Jul 03 09:45:28.052327 np0000004400 cinder-backup[101319]: "objects": [ Jul 03 09:45:28.052327 np0000004400 cinder-backup[101319]: { Jul 03 09:45:28.052327 np0000004400 cinder-backup[101319]: "volume_b86cbab3-7c42-409e-b4f6-0ed61267a031/20260703094455/az_nova_backup_3087847d-58e1-4a0c-af9c-2639ae9f2aeb-00001": { Jul 03 09:45:28.052327 np0000004400 cinder-backup[101319]: "compression": "zlib", Jul 03 09:45:28.052327 np0000004400 cinder-backup[101319]: "length": 52428800, Jul 03 09:45:28.052327 np0000004400 cinder-backup[101319]: "md5": "25e317773f308e446cc84c503a6d1f85", Jul 03 09:45:28.052327 np0000004400 cinder-backup[101319]: "offset": 0 Jul 03 09:45:28.052327 np0000004400 cinder-backup[101319]: } Jul 03 09:45:28.052327 np0000004400 cinder-backup[101319]: }, Jul 03 09:45:28.052327 np0000004400 cinder-backup[101319]: { Jul 03 09:45:28.052327 np0000004400 cinder-backup[101319]: "volume_b86cbab3-7c42-409e-b4f6-0ed61267a031/20260703094455/az_nova_backup_3087847d-58e1-4a0c-af9c-2639ae9f2aeb-00002": { Jul 03 09:45:28.052327 np0000004400 cinder-backup[101319]: "compression": "zlib", Jul 03 09:45:28.052327 np0000004400 cinder-backup[101319]: "length": 52428800, Jul 03 09:45:28.052327 np0000004400 cinder-backup[101319]: "md5": "25e317773f308e446cc84c503a6d1f85", Jul 03 09:45:28.052327 np0000004400 cinder-backup[101319]: "offset": 52428800 Jul 03 09:45:28.052327 np0000004400 cinder-backup[101319]: } Jul 03 09:45:28.052327 np0000004400 cinder-backup[101319]: }, Jul 03 09:45:28.052327 np0000004400 cinder-backup[101319]: { Jul 03 09:45:28.052327 np0000004400 cinder-backup[101319]: "volume_b86cbab3-7c42-409e-b4f6-0ed61267a031/20260703094455/az_nova_backup_3087847d-58e1-4a0c-af9c-2639ae9f2aeb-00003": { Jul 03 09:45:28.052327 np0000004400 cinder-backup[101319]: "compression": "zlib", Jul 03 09:45:28.052327 np0000004400 cinder-backup[101319]: "length": 52428800, Jul 03 09:45:28.052327 np0000004400 cinder-backup[101319]: "md5": "25e317773f308e446cc84c503a6d1f85", Jul 03 09:45:28.052327 np0000004400 cinder-backup[101319]: "offset": 104857600 Jul 03 09:45:28.052327 np0000004400 cinder-backup[101319]: } Jul 03 09:45:28.052327 np0000004400 cinder-backup[101319]: }, Jul 03 09:45:28.052327 np0000004400 cinder-backup[101319]: { Jul 03 09:45:28.052327 np0000004400 cinder-backup[101319]: "volume_b86cbab3-7c42-409e-b4f6-0ed61267a031/20260703094455/az_nova_backup_3087847d-58e1-4a0c-af9c-2639ae9f2aeb-00004": { Jul 03 09:45:28.052327 np0000004400 cinder-backup[101319]: "compression": "zlib", Jul 03 09:45:28.052327 np0000004400 cinder-backup[101319]: "length": 52428800, Jul 03 09:45:28.052327 np0000004400 cinder-backup[101319]: "md5": "25e317773f308e446cc84c503a6d1f85", Jul 03 09:45:28.052327 np0000004400 cinder-backup[101319]: "offset": 157286400 Jul 03 09:45:28.052327 np0000004400 cinder-backup[101319]: } Jul 03 09:45:28.052327 np0000004400 cinder-backup[101319]: }, Jul 03 09:45:28.052327 np0000004400 cinder-backup[101319]: { Jul 03 09:45:28.052327 np0000004400 cinder-backup[101319]: "volume_b86cbab3-7c42-409e-b4f6-0ed61267a031/20260703094455/az_nova_backup_3087847d-58e1-4a0c-af9c-2639ae9f2aeb-00005": { Jul 03 09:45:28.052327 np0000004400 cinder-backup[101319]: "compression": "zlib", Jul 03 09:45:28.052327 np0000004400 cinder-backup[101319]: "length": 52428800, Jul 03 09:45:28.052327 np0000004400 cinder-backup[101319]: "md5": "25e317773f308e446cc84c503a6d1f85", Jul 03 09:45:28.052327 np0000004400 cinder-backup[101319]: "offset": 209715200 Jul 03 09:45:28.052327 np0000004400 cinder-backup[101319]: } Jul 03 09:45:28.052327 np0000004400 cinder-backup[101319]: }, Jul 03 09:45:28.052327 np0000004400 cinder-backup[101319]: { Jul 03 09:45:28.052327 np0000004400 cinder-backup[101319]: "volume_b86cbab3-7c42-409e-b4f6-0ed61267a031/20260703094455/az_nova_backup_3087847d-58e1-4a0c-af9c-2639ae9f2aeb-00006": { Jul 03 09:45:28.052327 np0000004400 cinder-backup[101319]: "compression": "zlib", Jul 03 09:45:28.052327 np0000004400 cinder-backup[101319]: "length": 52428800, Jul 03 09:45:28.052327 np0000004400 cinder-backup[101319]: "md5": "25e317773f308e446cc84c503a6d1f85", Jul 03 09:45:28.052327 np0000004400 cinder-backup[101319]: "offset": 262144000 Jul 03 09:45:28.052327 np0000004400 cinder-backup[101319]: } Jul 03 09:45:28.052327 np0000004400 cinder-backup[101319]: }, Jul 03 09:45:28.052327 np0000004400 cinder-backup[101319]: { Jul 03 09:45:28.052327 np0000004400 cinder-backup[101319]: "volume_b86cbab3-7c42-409e-b4f6-0ed61267a031/20260703094455/az_nova_backup_3087847d-58e1-4a0c-af9c-2639ae9f2aeb-00007": { Jul 03 09:45:28.052327 np0000004400 cinder-backup[101319]: "compression": "zlib", Jul 03 09:45:28.052327 np0000004400 cinder-backup[101319]: "length": 52428800, Jul 03 09:45:28.052327 np0000004400 cinder-backup[101319]: "md5": "25e317773f308e446cc84c503a6d1f85", Jul 03 09:45:28.052327 np0000004400 cinder-backup[101319]: "offset": 314572800 Jul 03 09:45:28.052327 np0000004400 cinder-backup[101319]: } Jul 03 09:45:28.052327 np0000004400 cinder-backup[101319]: }, Jul 03 09:45:28.052327 np0000004400 cinder-backup[101319]: { Jul 03 09:45:28.052327 np0000004400 cinder-backup[101319]: "volume_b86cbab3-7c42-409e-b4f6-0ed61267a031/20260703094455/az_nova_backup_3087847d-58e1-4a0c-af9c-2639ae9f2aeb-00008": { Jul 03 09:45:28.052327 np0000004400 cinder-backup[101319]: "compression": "zlib", Jul 03 09:45:28.052327 np0000004400 cinder-backup[101319]: "length": 52428800, Jul 03 09:45:28.052327 np0000004400 cinder-backup[101319]: "md5": "25e317773f308e446cc84c503a6d1f85", Jul 03 09:45:28.052327 np0000004400 cinder-backup[101319]: "offset": 367001600 Jul 03 09:45:28.052327 np0000004400 cinder-backup[101319]: } Jul 03 09:45:28.052327 np0000004400 cinder-backup[101319]: }, Jul 03 09:45:28.052327 np0000004400 cinder-backup[101319]: { Jul 03 09:45:28.052327 np0000004400 cinder-backup[101319]: "volume_b86cbab3-7c42-409e-b4f6-0ed61267a031/20260703094455/az_nova_backup_3087847d-58e1-4a0c-af9c-2639ae9f2aeb-00009": { Jul 03 09:45:28.052327 np0000004400 cinder-backup[101319]: "compression": "zlib", Jul 03 09:45:28.052327 np0000004400 cinder-backup[101319]: "length": 52428800, Jul 03 09:45:28.052327 np0000004400 cinder-backup[101319]: "md5": "25e317773f308e446cc84c503a6d1f85", Jul 03 09:45:28.052327 np0000004400 cinder-backup[101319]: "offset": 419430400 Jul 03 09:45:28.052327 np0000004400 cinder-backup[101319]: } Jul 03 09:45:28.052327 np0000004400 cinder-backup[101319]: }, Jul 03 09:45:28.052327 np0000004400 cinder-backup[101319]: { Jul 03 09:45:28.052327 np0000004400 cinder-backup[101319]: "volume_b86cbab3-7c42-409e-b4f6-0ed61267a031/20260703094455/az_nova_backup_3087847d-58e1-4a0c-af9c-2639ae9f2aeb-00010": { Jul 03 09:45:28.052327 np0000004400 cinder-backup[101319]: "compression": "zlib", Jul 03 09:45:28.052327 np0000004400 cinder-backup[101319]: "length": 52428800, Jul 03 09:45:28.052327 np0000004400 cinder-backup[101319]: "md5": "25e317773f308e446cc84c503a6d1f85", Jul 03 09:45:28.052327 np0000004400 cinder-backup[101319]: "offset": 471859200 Jul 03 09:45:28.052327 np0000004400 cinder-backup[101319]: } Jul 03 09:45:28.052327 np0000004400 cinder-backup[101319]: }, Jul 03 09:45:28.052327 np0000004400 cinder-backup[101319]: { Jul 03 09:45:28.052327 np0000004400 cinder-backup[101319]: "volume_b86cbab3-7c42-409e-b4f6-0ed61267a031/20260703094455/az_nova_backup_3087847d-58e1-4a0c-af9c-2639ae9f2aeb-00011": { Jul 03 09:45:28.052327 np0000004400 cinder-backup[101319]: "compression": "zlib", Jul 03 09:45:28.052327 np0000004400 cinder-backup[101319]: "length": 52428800, Jul 03 09:45:28.052327 np0000004400 cinder-backup[101319]: "md5": "25e317773f308e446cc84c503a6d1f85", Jul 03 09:45:28.052327 np0000004400 cinder-backup[101319]: "offset": 524288000 Jul 03 09:45:28.052327 np0000004400 cinder-backup[101319]: } Jul 03 09:45:28.052327 np0000004400 cinder-backup[101319]: }, Jul 03 09:45:28.052327 np0000004400 cinder-backup[101319]: { Jul 03 09:45:28.052327 np0000004400 cinder-backup[101319]: "volume_b86cbab3-7c42-409e-b4f6-0ed61267a031/20260703094455/az_nova_backup_3087847d-58e1-4a0c-af9c-2639ae9f2aeb-00012": { Jul 03 09:45:28.052327 np0000004400 cinder-backup[101319]: "compression": "zlib", Jul 03 09:45:28.052327 np0000004400 cinder-backup[101319]: "length": 52428800, Jul 03 09:45:28.052327 np0000004400 cinder-backup[101319]: "md5": "25e317773f308e446cc84c503a6d1f85", Jul 03 09:45:28.052327 np0000004400 cinder-backup[101319]: "offset": 576716800 Jul 03 09:45:28.052327 np0000004400 cinder-backup[101319]: } Jul 03 09:45:28.052327 np0000004400 cinder-backup[101319]: }, Jul 03 09:45:28.052327 np0000004400 cinder-backup[101319]: { Jul 03 09:45:28.052327 np0000004400 cinder-backup[101319]: "volume_b86cbab3-7c42-409e-b4f6-0ed61267a031/20260703094455/az_nova_backup_3087847d-58e1-4a0c-af9c-2639ae9f2aeb-00013": { Jul 03 09:45:28.052327 np0000004400 cinder-backup[101319]: "compression": "zlib", Jul 03 09:45:28.052327 np0000004400 cinder-backup[101319]: "length": 52428800, Jul 03 09:45:28.052327 np0000004400 cinder-backup[101319]: "md5": "25e317773f308e446cc84c503a6d1f85", Jul 03 09:45:28.052327 np0000004400 cinder-backup[101319]: "offset": 629145600 Jul 03 09:45:28.052327 np0000004400 cinder-backup[101319]: } Jul 03 09:45:28.052327 np0000004400 cinder-backup[101319]: }, Jul 03 09:45:28.052327 np0000004400 cinder-backup[101319]: { Jul 03 09:45:28.052327 np0000004400 cinder-backup[101319]: "volume_b86cbab3-7c42-409e-b4f6-0ed61267a031/20260703094455/az_nova_backup_3087847d-58e1-4a0c-af9c-2639ae9f2aeb-00014": { Jul 03 09:45:28.052327 np0000004400 cinder-backup[101319]: "compression": "zlib", Jul 03 09:45:28.052327 np0000004400 cinder-backup[101319]: "length": 52428800, Jul 03 09:45:28.052327 np0000004400 cinder-backup[101319]: "md5": "25e317773f308e446cc84c503a6d1f85", Jul 03 09:45:28.052327 np0000004400 cinder-backup[101319]: "offset": 681574400 Jul 03 09:45:28.052327 np0000004400 cinder-backup[101319]: } Jul 03 09:45:28.052327 np0000004400 cinder-backup[101319]: }, Jul 03 09:45:28.052327 np0000004400 cinder-backup[101319]: { Jul 03 09:45:28.052327 np0000004400 cinder-backup[101319]: "volume_b86cbab3-7c42-409e-b4f6-0ed61267a031/20260703094455/az_nova_backup_3087847d-58e1-4a0c-af9c-2639ae9f2aeb-00015": { Jul 03 09:45:28.052327 np0000004400 cinder-backup[101319]: "compression": "zlib", Jul 03 09:45:28.052327 np0000004400 cinder-backup[101319]: "length": 52428800, Jul 03 09:45:28.052327 np0000004400 cinder-backup[101319]: "md5": "25e317773f308e446cc84c503a6d1f85", Jul 03 09:45:28.052327 np0000004400 cinder-backup[101319]: "offset": 734003200 Jul 03 09:45:28.052327 np0000004400 cinder-backup[101319]: } Jul 03 09:45:28.052327 np0000004400 cinder-backup[101319]: }, Jul 03 09:45:28.052327 np0000004400 cinder-backup[101319]: { Jul 03 09:45:28.052327 np0000004400 cinder-backup[101319]: "volume_b86cbab3-7c42-409e-b4f6-0ed61267a031/20260703094455/az_nova_backup_3087847d-58e1-4a0c-af9c-2639ae9f2aeb-00016": { Jul 03 09:45:28.052327 np0000004400 cinder-backup[101319]: "compression": "zlib", Jul 03 09:45:28.052327 np0000004400 cinder-backup[101319]: "length": 52428800, Jul 03 09:45:28.052327 np0000004400 cinder-backup[101319]: "md5": "25e317773f308e446cc84c503a6d1f85", Jul 03 09:45:28.052327 np0000004400 cinder-backup[101319]: "offset": 786432000 Jul 03 09:45:28.052327 np0000004400 cinder-backup[101319]: } Jul 03 09:45:28.052327 np0000004400 cinder-backup[101319]: }, Jul 03 09:45:28.052327 np0000004400 cinder-backup[101319]: { Jul 03 09:45:28.052327 np0000004400 cinder-backup[101319]: "volume_b86cbab3-7c42-409e-b4f6-0ed61267a031/20260703094455/az_nova_backup_3087847d-58e1-4a0c-af9c-2639ae9f2aeb-00017": { Jul 03 09:45:28.052327 np0000004400 cinder-backup[101319]: "compression": "zlib", Jul 03 09:45:28.052327 np0000004400 cinder-backup[101319]: "length": 52428800, Jul 03 09:45:28.052327 np0000004400 cinder-backup[101319]: "md5": "25e317773f308e446cc84c503a6d1f85", Jul 03 09:45:28.052327 np0000004400 cinder-backup[101319]: "offset": 838860800 Jul 03 09:45:28.052327 np0000004400 cinder-backup[101319]: } Jul 03 09:45:28.052327 np0000004400 cinder-backup[101319]: }, Jul 03 09:45:28.052327 np0000004400 cinder-backup[101319]: { Jul 03 09:45:28.052327 np0000004400 cinder-backup[101319]: "volume_b86cbab3-7c42-409e-b4f6-0ed61267a031/20260703094455/az_nova_backup_3087847d-58e1-4a0c-af9c-2639ae9f2aeb-00018": { Jul 03 09:45:28.052327 np0000004400 cinder-backup[101319]: "compression": "zlib", Jul 03 09:45:28.052327 np0000004400 cinder-backup[101319]: "length": 52428800, Jul 03 09:45:28.052327 np0000004400 cinder-backup[101319]: "md5": "25e317773f308e446cc84c503a6d1f85", Jul 03 09:45:28.052327 np0000004400 cinder-backup[101319]: "offset": 891289600 Jul 03 09:45:28.052327 np0000004400 cinder-backup[101319]: } Jul 03 09:45:28.052327 np0000004400 cinder-backup[101319]: }, Jul 03 09:45:28.052327 np0000004400 cinder-backup[101319]: { Jul 03 09:45:28.052327 np0000004400 cinder-backup[101319]: "volume_b86cbab3-7c42-409e-b4f6-0ed61267a031/20260703094455/az_nova_backup_3087847d-58e1-4a0c-af9c-2639ae9f2aeb-00019": { Jul 03 09:45:28.052327 np0000004400 cinder-backup[101319]: "compression": "zlib", Jul 03 09:45:28.052327 np0000004400 cinder-backup[101319]: "length": 52428800, Jul 03 09:45:28.052327 np0000004400 cinder-backup[101319]: "md5": "25e317773f308e446cc84c503a6d1f85", Jul 03 09:45:28.052327 np0000004400 cinder-backup[101319]: "offset": 943718400 Jul 03 09:45:28.052327 np0000004400 cinder-backup[101319]: } Jul 03 09:45:28.052327 np0000004400 cinder-backup[101319]: }, Jul 03 09:45:28.052327 np0000004400 cinder-backup[101319]: { Jul 03 09:45:28.052327 np0000004400 cinder-backup[101319]: "volume_b86cbab3-7c42-409e-b4f6-0ed61267a031/20260703094455/az_nova_backup_3087847d-58e1-4a0c-af9c-2639ae9f2aeb-00020": { Jul 03 09:45:28.052327 np0000004400 cinder-backup[101319]: "compression": "zlib", Jul 03 09:45:28.052327 np0000004400 cinder-backup[101319]: "length": 52428800, Jul 03 09:45:28.052327 np0000004400 cinder-backup[101319]: "md5": "25e317773f308e446cc84c503a6d1f85", Jul 03 09:45:28.052327 np0000004400 cinder-backup[101319]: "offset": 996147200 Jul 03 09:45:28.052327 np0000004400 cinder-backup[101319]: } Jul 03 09:45:28.052327 np0000004400 cinder-backup[101319]: }, Jul 03 09:45:28.052327 np0000004400 cinder-backup[101319]: { Jul 03 09:45:28.052327 np0000004400 cinder-backup[101319]: "volume_b86cbab3-7c42-409e-b4f6-0ed61267a031/20260703094455/az_nova_backup_3087847d-58e1-4a0c-af9c-2639ae9f2aeb-00021": { Jul 03 09:45:28.052327 np0000004400 cinder-backup[101319]: "compression": "zlib", Jul 03 09:45:28.052327 np0000004400 cinder-backup[101319]: "length": 25165824, Jul 03 09:45:28.052327 np0000004400 cinder-backup[101319]: "md5": "77377273b0a4b61febdbf7bbf52b9db9", Jul 03 09:45:28.052327 np0000004400 cinder-backup[101319]: "offset": 1048576000 Jul 03 09:45:28.052327 np0000004400 cinder-backup[101319]: } Jul 03 09:45:28.052327 np0000004400 cinder-backup[101319]: } Jul 03 09:45:28.052327 np0000004400 cinder-backup[101319]: ], Jul 03 09:45:28.052327 np0000004400 cinder-backup[101319]: "parent_id": null, Jul 03 09:45:28.052327 np0000004400 cinder-backup[101319]: "version": "1.0.0", Jul 03 09:45:28.052327 np0000004400 cinder-backup[101319]: "volume_id": "b86cbab3-7c42-409e-b4f6-0ed61267a031", Jul 03 09:45:28.052327 np0000004400 cinder-backup[101319]: "volume_meta": "{\"version\": 2, \"volume-base-metadata\": {\"id\": \"b86cbab3-7c42-409e-b4f6-0ed61267a031\", \"_name_id\": null, \"use_quota\": true, \"ec2_id\": null, \"user_id\": \"b861df2a13684334b293b1f348152e37\", \"project_id\": \"a484ec9218bf417bb9d7575ae6370646\", \"snapshot_id\": null, \"cluster_name\": null, \"host\": \"np0000004400@storpool#default\", \"size\": 1, \"availability_zone\": \"nova\", \"status\": \"backing-up\", \"attach_status\": \"detached\", \"migration_status\": null, \"scheduled_at\": \"2026-07-03T09:44:52.000000\", \"launched_at\": \"2026-07-03T09:44:52.000000\", \"terminated_at\": null, \"display_name\": \"tempest-VolumesBackupsTest-Volume-504009765\", \"display_description\": null, \"provider_location\": null, \"provider_auth\": null, \"provider_geometry\": null, \"provider_id\": null, \"volume_type_id\": \"03e13fe6-0e30-4803-ace0-725d38e6dc24\", \"source_volid\": null, \"encryption_key_id\": null, \"consistencygroup_id\": null, \"group_id\": null, \"bootable\": false, \"multiattach\": false, \"replication_status\": null, \"replication_extended_status\": null, \"replication_driver_data\": null, \"previous_status\": \"available\", \"service_uuid\": \"6d4b0e79-fefe-4744-b25f-34be05095200\", \"shared_targets\": true, \"deleted_at\": null, \"deleted\": false, \"created_at\": \"2026-07-03T09:44:51.000000\", \"updated_at\": \"2026-07-03T09:44:53.000000\"}}" Jul 03 09:45:28.052327 np0000004400 cinder-backup[101319]: }. {{(pid=101319) _read_metadata /opt/stack/cinder/cinder/backup/chunkeddriver.py:327}} Jul 03 09:45:28.056753 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-7f8b3484-81fc-4e9e-84e6-f701b522ee42 tempest-VolumesBackupsTest-118275719 None] v1 volume backup restore of 3087847d-58e1-4a0c-af9c-2639ae9f2aeb started. {{(pid=101319) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:678}} Jul 03 09:45:28.056753 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-7f8b3484-81fc-4e9e-84e6-f701b522ee42 tempest-VolumesBackupsTest-118275719 None] metadata_object_names = ['volume_b86cbab3-7c42-409e-b4f6-0ed61267a031/20260703094455/az_nova_backup_3087847d-58e1-4a0c-af9c-2639ae9f2aeb-00001', 'volume_b86cbab3-7c42-409e-b4f6-0ed61267a031/20260703094455/az_nova_backup_3087847d-58e1-4a0c-af9c-2639ae9f2aeb-00002', 'volume_b86cbab3-7c42-409e-b4f6-0ed61267a031/20260703094455/az_nova_backup_3087847d-58e1-4a0c-af9c-2639ae9f2aeb-00003', 'volume_b86cbab3-7c42-409e-b4f6-0ed61267a031/20260703094455/az_nova_backup_3087847d-58e1-4a0c-af9c-2639ae9f2aeb-00004', 'volume_b86cbab3-7c42-409e-b4f6-0ed61267a031/20260703094455/az_nova_backup_3087847d-58e1-4a0c-af9c-2639ae9f2aeb-00005', 'volume_b86cbab3-7c42-409e-b4f6-0ed61267a031/20260703094455/az_nova_backup_3087847d-58e1-4a0c-af9c-2639ae9f2aeb-00006', 'volume_b86cbab3-7c42-409e-b4f6-0ed61267a031/20260703094455/az_nova_backup_3087847d-58e1-4a0c-af9c-2639ae9f2aeb-00007', 'volume_b86cbab3-7c42-409e-b4f6-0ed61267a031/20260703094455/az_nova_backup_3087847d-58e1-4a0c-af9c-2639ae9f2aeb-00008', 'volume_b86cbab3-7c42-409e-b4f6-0ed61267a031/20260703094455/az_nova_backup_3087847d-58e1-4a0c-af9c-2639ae9f2aeb-00009', 'volume_b86cbab3-7c42-409e-b4f6-0ed61267a031/20260703094455/az_nova_backup_3087847d-58e1-4a0c-af9c-2639ae9f2aeb-00010', 'volume_b86cbab3-7c42-409e-b4f6-0ed61267a031/20260703094455/az_nova_backup_3087847d-58e1-4a0c-af9c-2639ae9f2aeb-00011', 'volume_b86cbab3-7c42-409e-b4f6-0ed61267a031/20260703094455/az_nova_backup_3087847d-58e1-4a0c-af9c-2639ae9f2aeb-00012', 'volume_b86cbab3-7c42-409e-b4f6-0ed61267a031/20260703094455/az_nova_backup_3087847d-58e1-4a0c-af9c-2639ae9f2aeb-00013', 'volume_b86cbab3-7c42-409e-b4f6-0ed61267a031/20260703094455/az_nova_backup_3087847d-58e1-4a0c-af9c-2639ae9f2aeb-00014', 'volume_b86cbab3-7c42-409e-b4f6-0ed61267a031/20260703094455/az_nova_backup_3087847d-58e1-4a0c-af9c-2639ae9f2aeb-00015', 'volume_b86cbab3-7c42-409e-b4f6-0ed61267a031/20260703094455/az_nova_backup_3087847d-58e1-4a0c-af9c-2639ae9f2aeb-00016', 'volume_b86cbab3-7c42-409e-b4f6-0ed61267a031/20260703094455/az_nova_backup_3087847d-58e1-4a0c-af9c-2639ae9f2aeb-00017', 'volume_b86cbab3-7c42-409e-b4f6-0ed61267a031/20260703094455/az_nova_backup_3087847d-58e1-4a0c-af9c-2639ae9f2aeb-00018', 'volume_b86cbab3-7c42-409e-b4f6-0ed61267a031/20260703094455/az_nova_backup_3087847d-58e1-4a0c-af9c-2639ae9f2aeb-00019', 'volume_b86cbab3-7c42-409e-b4f6-0ed61267a031/20260703094455/az_nova_backup_3087847d-58e1-4a0c-af9c-2639ae9f2aeb-00020', 'volume_b86cbab3-7c42-409e-b4f6-0ed61267a031/20260703094455/az_nova_backup_3087847d-58e1-4a0c-af9c-2639ae9f2aeb-00021']. {{(pid=101319) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:685}} Jul 03 09:45:28.090849 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-7f8b3484-81fc-4e9e-84e6-f701b522ee42 tempest-VolumesBackupsTest-118275719 None] generated object list: ['volume_b86cbab3-7c42-409e-b4f6-0ed61267a031/20260703094455/az_nova_backup_3087847d-58e1-4a0c-af9c-2639ae9f2aeb-00001', 'volume_b86cbab3-7c42-409e-b4f6-0ed61267a031/20260703094455/az_nova_backup_3087847d-58e1-4a0c-af9c-2639ae9f2aeb-00002', 'volume_b86cbab3-7c42-409e-b4f6-0ed61267a031/20260703094455/az_nova_backup_3087847d-58e1-4a0c-af9c-2639ae9f2aeb-00003', 'volume_b86cbab3-7c42-409e-b4f6-0ed61267a031/20260703094455/az_nova_backup_3087847d-58e1-4a0c-af9c-2639ae9f2aeb-00004', 'volume_b86cbab3-7c42-409e-b4f6-0ed61267a031/20260703094455/az_nova_backup_3087847d-58e1-4a0c-af9c-2639ae9f2aeb-00005', 'volume_b86cbab3-7c42-409e-b4f6-0ed61267a031/20260703094455/az_nova_backup_3087847d-58e1-4a0c-af9c-2639ae9f2aeb-00006', 'volume_b86cbab3-7c42-409e-b4f6-0ed61267a031/20260703094455/az_nova_backup_3087847d-58e1-4a0c-af9c-2639ae9f2aeb-00007', 'volume_b86cbab3-7c42-409e-b4f6-0ed61267a031/20260703094455/az_nova_backup_3087847d-58e1-4a0c-af9c-2639ae9f2aeb-00008', 'volume_b86cbab3-7c42-409e-b4f6-0ed61267a031/20260703094455/az_nova_backup_3087847d-58e1-4a0c-af9c-2639ae9f2aeb-00009', 'volume_b86cbab3-7c42-409e-b4f6-0ed61267a031/20260703094455/az_nova_backup_3087847d-58e1-4a0c-af9c-2639ae9f2aeb-00010', 'volume_b86cbab3-7c42-409e-b4f6-0ed61267a031/20260703094455/az_nova_backup_3087847d-58e1-4a0c-af9c-2639ae9f2aeb-00011', 'volume_b86cbab3-7c42-409e-b4f6-0ed61267a031/20260703094455/az_nova_backup_3087847d-58e1-4a0c-af9c-2639ae9f2aeb-00012', 'volume_b86cbab3-7c42-409e-b4f6-0ed61267a031/20260703094455/az_nova_backup_3087847d-58e1-4a0c-af9c-2639ae9f2aeb-00013', 'volume_b86cbab3-7c42-409e-b4f6-0ed61267a031/20260703094455/az_nova_backup_3087847d-58e1-4a0c-af9c-2639ae9f2aeb-00014', 'volume_b86cbab3-7c42-409e-b4f6-0ed61267a031/20260703094455/az_nova_backup_3087847d-58e1-4a0c-af9c-2639ae9f2aeb-00015', 'volume_b86cbab3-7c42-409e-b4f6-0ed61267a031/20260703094455/az_nova_backup_3087847d-58e1-4a0c-af9c-2639ae9f2aeb-00016', 'volume_b86cbab3-7c42-409e-b4f6-0ed61267a031/20260703094455/az_nova_backup_3087847d-58e1-4a0c-af9c-2639ae9f2aeb-00017', 'volume_b86cbab3-7c42-409e-b4f6-0ed61267a031/20260703094455/az_nova_backup_3087847d-58e1-4a0c-af9c-2639ae9f2aeb-00018', 'volume_b86cbab3-7c42-409e-b4f6-0ed61267a031/20260703094455/az_nova_backup_3087847d-58e1-4a0c-af9c-2639ae9f2aeb-00019', 'volume_b86cbab3-7c42-409e-b4f6-0ed61267a031/20260703094455/az_nova_backup_3087847d-58e1-4a0c-af9c-2639ae9f2aeb-00020', 'volume_b86cbab3-7c42-409e-b4f6-0ed61267a031/20260703094455/az_nova_backup_3087847d-58e1-4a0c-af9c-2639ae9f2aeb-00021', 'volume_b86cbab3-7c42-409e-b4f6-0ed61267a031/20260703094455/az_nova_backup_3087847d-58e1-4a0c-af9c-2639ae9f2aeb_metadata', 'volume_b86cbab3-7c42-409e-b4f6-0ed61267a031/20260703094455/az_nova_backup_3087847d-58e1-4a0c-af9c-2639ae9f2aeb_sha256file']. {{(pid=101319) _generate_object_names /opt/stack/cinder/cinder/backup/chunkeddriver.py:260}} Jul 03 09:45:28.094494 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-7f8b3484-81fc-4e9e-84e6-f701b522ee42 tempest-VolumesBackupsTest-118275719 None] restoring object. backup: 3087847d-58e1-4a0c-af9c-2639ae9f2aeb, container: volumebackups, object name: volume_b86cbab3-7c42-409e-b4f6-0ed61267a031/20260703094455/az_nova_backup_3087847d-58e1-4a0c-af9c-2639ae9f2aeb-00001, volume: b86cbab3-7c42-409e-b4f6-0ed61267a031. {{(pid=101319) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:705}} Jul 03 09:45:28.094576 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-39edf0dd-1bcf-42e2-baa1-b2115392f537 tempest-ProjectAdminTests33-1900627284 None] backup MD5 for volume_4b68dad5-e9a3-4bd1-84e2-ba745cb7bb83/20260703094525/az_nova_backup_3d538c5e-b79f-4328-82e9-e76f89c22158-00004: 25e317773f308e446cc84c503a6d1f85 {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 09:45:28.094722 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-39edf0dd-1bcf-42e2-baa1-b2115392f537 tempest-ProjectAdminTests33-1900627284 None] Calling eventlet.sleep(0) {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 09:45:28.116376 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-7f8b3484-81fc-4e9e-84e6-f701b522ee42 tempest-VolumesBackupsTest-118275719 None] decompressing data using zlib algorithm {{(pid=101319) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:722}} Jul 03 09:45:28.343877 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-39edf0dd-1bcf-42e2-baa1-b2115392f537 tempest-ProjectAdminTests33-1900627284 None] Backing up chunk of data from volume. {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 09:45:28.536815 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-7f8b3484-81fc-4e9e-84e6-f701b522ee42 tempest-VolumesBackupsTest-118275719 None] restoring object. backup: 3087847d-58e1-4a0c-af9c-2639ae9f2aeb, container: volumebackups, object name: volume_b86cbab3-7c42-409e-b4f6-0ed61267a031/20260703094455/az_nova_backup_3087847d-58e1-4a0c-af9c-2639ae9f2aeb-00002, volume: b86cbab3-7c42-409e-b4f6-0ed61267a031. {{(pid=101319) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:705}} Jul 03 09:45:28.555390 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-7f8b3484-81fc-4e9e-84e6-f701b522ee42 tempest-VolumesBackupsTest-118275719 None] decompressing data using zlib algorithm {{(pid=101319) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:722}} Jul 03 09:45:28.621352 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-39edf0dd-1bcf-42e2-baa1-b2115392f537 tempest-ProjectAdminTests33-1900627284 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101319) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 09:45:28.621591 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-39edf0dd-1bcf-42e2-baa1-b2115392f537 tempest-ProjectAdminTests33-1900627284 None] About to put_object {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 09:45:28.699507 np0000004400 cinder-backup[101319]: INFO os_brick.initiator.connectors.iscsi [None req-327bc060-a9c1-4783-a969-79ebb1b84e7c tempest-VolumesBackupsTest-2142009639 None] Trying to connect to iSCSI portal 192.168.40.100:3260 Jul 03 09:45:28.711116 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-327bc060-a9c1-4783-a969-79ebb1b84e7c tempest-VolumesBackupsTest-2142009639 None] iscsiadm (): stdout=# BEGIN RECORD 2.1.9 Jul 03 09:45:28.711116 np0000004400 cinder-backup[101319]: node.name = iqn.2023-03.storpool.com:os--volume-b1fc0d58-7747-4bcf-99a7-fb482aacb945 Jul 03 09:45:28.711116 np0000004400 cinder-backup[101319]: node.tpgt = -1 Jul 03 09:45:28.711116 np0000004400 cinder-backup[101319]: node.startup = manual Jul 03 09:45:28.711116 np0000004400 cinder-backup[101319]: node.leading_login = No Jul 03 09:45:28.711116 np0000004400 cinder-backup[101319]: iface.iscsi_ifacename = default Jul 03 09:45:28.711116 np0000004400 cinder-backup[101319]: iface.net_ifacename = Jul 03 09:45:28.711116 np0000004400 cinder-backup[101319]: iface.ipaddress = Jul 03 09:45:28.711116 np0000004400 cinder-backup[101319]: iface.prefix_len = 0 Jul 03 09:45:28.711116 np0000004400 cinder-backup[101319]: iface.hwaddress = Jul 03 09:45:28.711116 np0000004400 cinder-backup[101319]: iface.transport_name = tcp Jul 03 09:45:28.711116 np0000004400 cinder-backup[101319]: iface.initiatorname = Jul 03 09:45:28.711116 np0000004400 cinder-backup[101319]: iface.state = Jul 03 09:45:28.711116 np0000004400 cinder-backup[101319]: iface.vlan_id = 0 Jul 03 09:45:28.711116 np0000004400 cinder-backup[101319]: iface.vlan_priority = 0 Jul 03 09:45:28.711116 np0000004400 cinder-backup[101319]: iface.vlan_state = Jul 03 09:45:28.711116 np0000004400 cinder-backup[101319]: iface.iface_num = 0 Jul 03 09:45:28.711116 np0000004400 cinder-backup[101319]: iface.mtu = 0 Jul 03 09:45:28.711116 np0000004400 cinder-backup[101319]: iface.port = 0 Jul 03 09:45:28.711116 np0000004400 cinder-backup[101319]: iface.bootproto = Jul 03 09:45:28.711116 np0000004400 cinder-backup[101319]: iface.subnet_mask = Jul 03 09:45:28.711116 np0000004400 cinder-backup[101319]: iface.gateway = Jul 03 09:45:28.711116 np0000004400 cinder-backup[101319]: iface.dhcp_alt_client_id_state = Jul 03 09:45:28.711116 np0000004400 cinder-backup[101319]: iface.dhcp_alt_client_id = Jul 03 09:45:28.711116 np0000004400 cinder-backup[101319]: iface.dhcp_dns = Jul 03 09:45:28.711116 np0000004400 cinder-backup[101319]: iface.dhcp_learn_iqn = Jul 03 09:45:28.711116 np0000004400 cinder-backup[101319]: iface.dhcp_req_vendor_id_state = Jul 03 09:45:28.711116 np0000004400 cinder-backup[101319]: iface.dhcp_vendor_id_state = Jul 03 09:45:28.711116 np0000004400 cinder-backup[101319]: iface.dhcp_vendor_id = Jul 03 09:45:28.711116 np0000004400 cinder-backup[101319]: iface.dhcp_slp_da = Jul 03 09:45:28.711116 np0000004400 cinder-backup[101319]: iface.fragmentation = Jul 03 09:45:28.711116 np0000004400 cinder-backup[101319]: iface.gratuitous_arp = Jul 03 09:45:28.711116 np0000004400 cinder-backup[101319]: iface.incoming_forwarding = Jul 03 09:45:28.711116 np0000004400 cinder-backup[101319]: iface.tos_state = Jul 03 09:45:28.711116 np0000004400 cinder-backup[101319]: iface.tos = 0 Jul 03 09:45:28.711116 np0000004400 cinder-backup[101319]: iface.ttl = 0 Jul 03 09:45:28.711116 np0000004400 cinder-backup[101319]: iface.delayed_ack = Jul 03 09:45:28.711116 np0000004400 cinder-backup[101319]: iface.tcp_nagle = Jul 03 09:45:28.711116 np0000004400 cinder-backup[101319]: iface.tcp_wsf_state = Jul 03 09:45:28.711116 np0000004400 cinder-backup[101319]: iface.tcp_wsf = 0 Jul 03 09:45:28.711116 np0000004400 cinder-backup[101319]: iface.tcp_timer_scale = 0 Jul 03 09:45:28.711116 np0000004400 cinder-backup[101319]: iface.tcp_timestamp = Jul 03 09:45:28.711116 np0000004400 cinder-backup[101319]: iface.redirect = Jul 03 09:45:28.711116 np0000004400 cinder-backup[101319]: iface.def_task_mgmt_timeout = 0 Jul 03 09:45:28.711116 np0000004400 cinder-backup[101319]: iface.header_digest = Jul 03 09:45:28.711116 np0000004400 cinder-backup[101319]: iface.data_digest = Jul 03 09:45:28.711116 np0000004400 cinder-backup[101319]: iface.immediate_data = Jul 03 09:45:28.711116 np0000004400 cinder-backup[101319]: iface.initial_r2t = Jul 03 09:45:28.711116 np0000004400 cinder-backup[101319]: iface.data_seq_inorder = Jul 03 09:45:28.711116 np0000004400 cinder-backup[101319]: iface.data_pdu_inorder = Jul 03 09:45:28.711116 np0000004400 cinder-backup[101319]: iface.erl = 0 Jul 03 09:45:28.711116 np0000004400 cinder-backup[101319]: iface.max_receive_data_len = 0 Jul 03 09:45:28.711116 np0000004400 cinder-backup[101319]: iface.first_burst_len = 0 Jul 03 09:45:28.711116 np0000004400 cinder-backup[101319]: iface.max_outstanding_r2t = 0 Jul 03 09:45:28.711116 np0000004400 cinder-backup[101319]: iface.max_burst_len = 0 Jul 03 09:45:28.711116 np0000004400 cinder-backup[101319]: iface.chap_auth = Jul 03 09:45:28.711116 np0000004400 cinder-backup[101319]: iface.bidi_chap = Jul 03 09:45:28.711116 np0000004400 cinder-backup[101319]: iface.strict_login_compliance = Jul 03 09:45:28.711116 np0000004400 cinder-backup[101319]: iface.discovery_auth = Jul 03 09:45:28.711116 np0000004400 cinder-backup[101319]: iface.discovery_logout = Jul 03 09:45:28.711116 np0000004400 cinder-backup[101319]: node.discovery_address = Jul 03 09:45:28.711116 np0000004400 cinder-backup[101319]: node.discovery_port = 0 Jul 03 09:45:28.711116 np0000004400 cinder-backup[101319]: node.discovery_type = fw Jul 03 09:45:28.711116 np0000004400 cinder-backup[101319]: node.session.initial_cmdsn = 0 Jul 03 09:45:28.711116 np0000004400 cinder-backup[101319]: node.session.initial_login_retry_max = 8 Jul 03 09:45:28.711116 np0000004400 cinder-backup[101319]: node.session.xmit_thread_priority = 0 Jul 03 09:45:28.711116 np0000004400 cinder-backup[101319]: node.session.cmds_max = 128 Jul 03 09:45:28.711116 np0000004400 cinder-backup[101319]: node.session.queue_depth = 32 Jul 03 09:45:28.711116 np0000004400 cinder-backup[101319]: node.session.nr_sessions = 1 Jul 03 09:45:28.711116 np0000004400 cinder-backup[101319]: node.session.auth.authmethod = None Jul 03 09:45:28.711116 np0000004400 cinder-backup[101319]: node.session.auth.username = Jul 03 09:45:28.711116 np0000004400 cinder-backup[101319]: node.session.auth.password = *** Jul 03 09:45:28.711116 np0000004400 cinder-backup[101319]: node.session.auth.username_in = Jul 03 09:45:28.711116 np0000004400 cinder-backup[101319]: node.session.auth.password_in = Jul 03 09:45:28.711116 np0000004400 cinder-backup[101319]: node.session.auth.chap_algs = SHA256 Jul 03 09:45:28.711116 np0000004400 cinder-backup[101319]: node.session.timeo.replacement_timeout = 120 Jul 03 09:45:28.711116 np0000004400 cinder-backup[101319]: node.session.err_timeo.abort_timeout = 15 Jul 03 09:45:28.711116 np0000004400 cinder-backup[101319]: node.session.err_timeo.lu_reset_timeout = 30 Jul 03 09:45:28.711116 np0000004400 cinder-backup[101319]: node.session.err_timeo.tgt_reset_timeout = 30 Jul 03 09:45:28.711116 np0000004400 cinder-backup[101319]: node.session.err_timeo.host_reset_timeout = 60 Jul 03 09:45:28.711116 np0000004400 cinder-backup[101319]: node.session.iscsi.FastAbort = Yes Jul 03 09:45:28.711116 np0000004400 cinder-backup[101319]: node.session.iscsi.InitialR2T = No Jul 03 09:45:28.711116 np0000004400 cinder-backup[101319]: node.session.iscsi.ImmediateData = Yes Jul 03 09:45:28.711116 np0000004400 cinder-backup[101319]: node.session.iscsi.FirstBurstLength = 262144 Jul 03 09:45:28.711116 np0000004400 cinder-backup[101319]: node.session.iscsi.MaxBurstLength = 16776192 Jul 03 09:45:28.711116 np0000004400 cinder-backup[101319]: node.session.iscsi.DefaultTime2Retain = 0 Jul 03 09:45:28.711116 np0000004400 cinder-backup[101319]: node.session.iscsi.DefaultTime2Wait = 2 Jul 03 09:45:28.711116 np0000004400 cinder-backup[101319]: node.session.iscsi.MaxConnections = 1 Jul 03 09:45:28.711116 np0000004400 cinder-backup[101319]: node.session.iscsi.MaxOutstandingR2T = 1 Jul 03 09:45:28.711116 np0000004400 cinder-backup[101319]: node.session.iscsi.ERL = 0 Jul 03 09:45:28.711116 np0000004400 cinder-backup[101319]: node.session.scan = auto Jul 03 09:45:28.711116 np0000004400 cinder-backup[101319]: node.session.reopen_max = 0 Jul 03 09:45:28.711116 np0000004400 cinder-backup[101319]: node.conn[0].address = 192.168.40.100 Jul 03 09:45:28.711116 np0000004400 cinder-backup[101319]: node.conn[0].port = 3260 Jul 03 09:45:28.711116 np0000004400 cinder-backup[101319]: node.conn[0].startup = manual Jul 03 09:45:28.711116 np0000004400 cinder-backup[101319]: node.conn[0].tcp.window_size = 524288 Jul 03 09:45:28.711116 np0000004400 cinder-backup[101319]: node.conn[0].tcp.type_of_service = 0 Jul 03 09:45:28.711116 np0000004400 cinder-backup[101319]: node.conn[0].timeo.logout_timeout = 15 Jul 03 09:45:28.711116 np0000004400 cinder-backup[101319]: node.conn[0].timeo.login_timeout = 15 Jul 03 09:45:28.711116 np0000004400 cinder-backup[101319]: node.conn[0].timeo.auth_timeout = 45 Jul 03 09:45:28.711116 np0000004400 cinder-backup[101319]: node.conn[0].timeo.noop_out_interval = 5 Jul 03 09:45:28.711116 np0000004400 cinder-backup[101319]: node.conn[0].timeo.noop_out_timeout = 5 Jul 03 09:45:28.711116 np0000004400 cinder-backup[101319]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0 Jul 03 09:45:28.711116 np0000004400 cinder-backup[101319]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144 Jul 03 09:45:28.711116 np0000004400 cinder-backup[101319]: node.conn[0].iscsi.HeaderDigest = None Jul 03 09:45:28.711116 np0000004400 cinder-backup[101319]: node.conn[0].iscsi.DataDigest = None Jul 03 09:45:28.711116 np0000004400 cinder-backup[101319]: node.conn[0].iscsi.IFMarker = No Jul 03 09:45:28.711116 np0000004400 cinder-backup[101319]: node.conn[0].iscsi.OFMarker = No Jul 03 09:45:28.711116 np0000004400 cinder-backup[101319]: # END RECORD Jul 03 09:45:28.711116 np0000004400 cinder-backup[101319]: stderr= {{(pid=101319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 03 09:45:28.760485 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-327bc060-a9c1-4783-a969-79ebb1b84e7c tempest-VolumesBackupsTest-2142009639 None] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=101319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 03 09:45:28.761245 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-39edf0dd-1bcf-42e2-baa1-b2115392f537 tempest-ProjectAdminTests33-1900627284 None] backup MD5 for volume_4b68dad5-e9a3-4bd1-84e2-ba745cb7bb83/20260703094525/az_nova_backup_3d538c5e-b79f-4328-82e9-e76f89c22158-00005: 25e317773f308e446cc84c503a6d1f85 {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 09:45:28.761461 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-39edf0dd-1bcf-42e2-baa1-b2115392f537 tempest-ProjectAdminTests33-1900627284 None] Calling eventlet.sleep(0) {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 09:45:28.788535 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-327bc060-a9c1-4783-a969-79ebb1b84e7c tempest-VolumesBackupsTest-2142009639 None] iscsiadm ('-m', 'session'): stdout=tcp: [104] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-4b68dad5-e9a3-4bd1-84e2-ba745cb7bb83 (non-flash) Jul 03 09:45:28.788535 np0000004400 cinder-backup[101319]: tcp: [105] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b86cbab3-7c42-409e-b4f6-0ed61267a031 (non-flash) Jul 03 09:45:28.788535 np0000004400 cinder-backup[101319]: tcp: [49] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b2e4f10c-8033-4c54-95a1-dfe45d6357a3 (non-flash) Jul 03 09:45:28.788535 np0000004400 cinder-backup[101319]: tcp: [50] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b2e4f10c-8033-4c54-95a1-dfe45d6357a3 (non-flash) Jul 03 09:45:28.788535 np0000004400 cinder-backup[101319]: tcp: [82] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-76320525-737e-4f58-8523-63ec9abbdc64 (non-flash) Jul 03 09:45:28.788535 np0000004400 cinder-backup[101319]: tcp: [83] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-76320525-737e-4f58-8523-63ec9abbdc64 (non-flash) Jul 03 09:45:28.788535 np0000004400 cinder-backup[101319]: tcp: [93] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-aecd73f6-86c7-4ae8-8bfa-b46655eb6efb (non-flash) Jul 03 09:45:28.788535 np0000004400 cinder-backup[101319]: tcp: [94] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-aecd73f6-86c7-4ae8-8bfa-b46655eb6efb (non-flash) Jul 03 09:45:28.788535 np0000004400 cinder-backup[101319]: tcp: [97] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d47f5d2f-dce5-42f7-a693-a654fd702622 (non-flash) Jul 03 09:45:28.788535 np0000004400 cinder-backup[101319]: tcp: [98] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d47f5d2f-dce5-42f7-a693-a654fd702622 (non-flash) Jul 03 09:45:28.788535 np0000004400 cinder-backup[101319]: stderr= {{(pid=101319) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jul 03 09:45:28.788535 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-327bc060-a9c1-4783-a969-79ebb1b84e7c tempest-VolumesBackupsTest-2142009639 None] iscsi session list stdout=tcp: [104] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-4b68dad5-e9a3-4bd1-84e2-ba745cb7bb83 (non-flash) Jul 03 09:45:28.788535 np0000004400 cinder-backup[101319]: tcp: [105] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b86cbab3-7c42-409e-b4f6-0ed61267a031 (non-flash) Jul 03 09:45:28.788535 np0000004400 cinder-backup[101319]: tcp: [49] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b2e4f10c-8033-4c54-95a1-dfe45d6357a3 (non-flash) Jul 03 09:45:28.788535 np0000004400 cinder-backup[101319]: tcp: [50] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b2e4f10c-8033-4c54-95a1-dfe45d6357a3 (non-flash) Jul 03 09:45:28.788535 np0000004400 cinder-backup[101319]: tcp: [82] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-76320525-737e-4f58-8523-63ec9abbdc64 (non-flash) Jul 03 09:45:28.788535 np0000004400 cinder-backup[101319]: tcp: [83] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-76320525-737e-4f58-8523-63ec9abbdc64 (non-flash) Jul 03 09:45:28.788535 np0000004400 cinder-backup[101319]: tcp: [93] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-aecd73f6-86c7-4ae8-8bfa-b46655eb6efb (non-flash) Jul 03 09:45:28.788535 np0000004400 cinder-backup[101319]: tcp: [94] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-aecd73f6-86c7-4ae8-8bfa-b46655eb6efb (non-flash) Jul 03 09:45:28.788535 np0000004400 cinder-backup[101319]: tcp: [97] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d47f5d2f-dce5-42f7-a693-a654fd702622 (non-flash) Jul 03 09:45:28.788535 np0000004400 cinder-backup[101319]: tcp: [98] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d47f5d2f-dce5-42f7-a693-a654fd702622 (non-flash) Jul 03 09:45:28.788535 np0000004400 cinder-backup[101319]: stderr= {{(pid=101319) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jul 03 09:45:29.010320 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-327bc060-a9c1-4783-a969-79ebb1b84e7c tempest-VolumesBackupsTest-2142009639 None] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-b1fc0d58-7747-4bcf-99a7-fb482aacb945, portal: 192.168.40.100,3260] Jul 03 09:45:29.010320 np0000004400 cinder-backup[101319]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-b1fc0d58-7747-4bcf-99a7-fb482aacb945, portal: 192.168.40.100,3260] successful. Jul 03 09:45:29.010320 np0000004400 cinder-backup[101319]: stderr= {{(pid=101319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 03 09:45:29.021054 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-7f8b3484-81fc-4e9e-84e6-f701b522ee42 tempest-VolumesBackupsTest-118275719 None] restoring object. backup: 3087847d-58e1-4a0c-af9c-2639ae9f2aeb, container: volumebackups, object name: volume_b86cbab3-7c42-409e-b4f6-0ed61267a031/20260703094455/az_nova_backup_3087847d-58e1-4a0c-af9c-2639ae9f2aeb-00003, volume: b86cbab3-7c42-409e-b4f6-0ed61267a031. {{(pid=101319) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:705}} Jul 03 09:45:29.023846 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-327bc060-a9c1-4783-a969-79ebb1b84e7c tempest-VolumesBackupsTest-2142009639 None] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=101319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 03 09:45:29.034644 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-7f8b3484-81fc-4e9e-84e6-f701b522ee42 tempest-VolumesBackupsTest-118275719 None] decompressing data using zlib algorithm {{(pid=101319) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:722}} Jul 03 09:45:29.044523 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-327bc060-a9c1-4783-a969-79ebb1b84e7c tempest-VolumesBackupsTest-2142009639 None] iscsiadm ('-m', 'session'): stdout=tcp: [104] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-4b68dad5-e9a3-4bd1-84e2-ba745cb7bb83 (non-flash) Jul 03 09:45:29.044523 np0000004400 cinder-backup[101319]: tcp: [105] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b86cbab3-7c42-409e-b4f6-0ed61267a031 (non-flash) Jul 03 09:45:29.044523 np0000004400 cinder-backup[101319]: tcp: [106] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b1fc0d58-7747-4bcf-99a7-fb482aacb945 (non-flash) Jul 03 09:45:29.044523 np0000004400 cinder-backup[101319]: tcp: [49] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b2e4f10c-8033-4c54-95a1-dfe45d6357a3 (non-flash) Jul 03 09:45:29.044523 np0000004400 cinder-backup[101319]: tcp: [50] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b2e4f10c-8033-4c54-95a1-dfe45d6357a3 (non-flash) Jul 03 09:45:29.044523 np0000004400 cinder-backup[101319]: tcp: [82] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-76320525-737e-4f58-8523-63ec9abbdc64 (non-flash) Jul 03 09:45:29.044523 np0000004400 cinder-backup[101319]: tcp: [83] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-76320525-737e-4f58-8523-63ec9abbdc64 (non-flash) Jul 03 09:45:29.044523 np0000004400 cinder-backup[101319]: tcp: [93] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-aecd73f6-86c7-4ae8-8bfa-b46655eb6efb (non-flash) Jul 03 09:45:29.044523 np0000004400 cinder-backup[101319]: tcp: [94] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-aecd73f6-86c7-4ae8-8bfa-b46655eb6efb (non-flash) Jul 03 09:45:29.044523 np0000004400 cinder-backup[101319]: tcp: [97] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d47f5d2f-dce5-42f7-a693-a654fd702622 (non-flash) Jul 03 09:45:29.044523 np0000004400 cinder-backup[101319]: tcp: [98] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d47f5d2f-dce5-42f7-a693-a654fd702622 (non-flash) Jul 03 09:45:29.044523 np0000004400 cinder-backup[101319]: stderr= {{(pid=101319) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jul 03 09:45:29.044880 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-327bc060-a9c1-4783-a969-79ebb1b84e7c tempest-VolumesBackupsTest-2142009639 None] iscsi session list stdout=tcp: [104] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-4b68dad5-e9a3-4bd1-84e2-ba745cb7bb83 (non-flash) Jul 03 09:45:29.044880 np0000004400 cinder-backup[101319]: tcp: [105] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b86cbab3-7c42-409e-b4f6-0ed61267a031 (non-flash) Jul 03 09:45:29.044880 np0000004400 cinder-backup[101319]: tcp: [106] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b1fc0d58-7747-4bcf-99a7-fb482aacb945 (non-flash) Jul 03 09:45:29.044880 np0000004400 cinder-backup[101319]: tcp: [49] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b2e4f10c-8033-4c54-95a1-dfe45d6357a3 (non-flash) Jul 03 09:45:29.044880 np0000004400 cinder-backup[101319]: tcp: [50] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b2e4f10c-8033-4c54-95a1-dfe45d6357a3 (non-flash) Jul 03 09:45:29.044880 np0000004400 cinder-backup[101319]: tcp: [82] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-76320525-737e-4f58-8523-63ec9abbdc64 (non-flash) Jul 03 09:45:29.044880 np0000004400 cinder-backup[101319]: tcp: [83] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-76320525-737e-4f58-8523-63ec9abbdc64 (non-flash) Jul 03 09:45:29.044880 np0000004400 cinder-backup[101319]: tcp: [93] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-aecd73f6-86c7-4ae8-8bfa-b46655eb6efb (non-flash) Jul 03 09:45:29.044880 np0000004400 cinder-backup[101319]: tcp: [94] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-aecd73f6-86c7-4ae8-8bfa-b46655eb6efb (non-flash) Jul 03 09:45:29.044880 np0000004400 cinder-backup[101319]: tcp: [97] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d47f5d2f-dce5-42f7-a693-a654fd702622 (non-flash) Jul 03 09:45:29.044880 np0000004400 cinder-backup[101319]: tcp: [98] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d47f5d2f-dce5-42f7-a693-a654fd702622 (non-flash) Jul 03 09:45:29.044880 np0000004400 cinder-backup[101319]: stderr= {{(pid=101319) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jul 03 09:45:29.045112 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.base [None req-327bc060-a9c1-4783-a969-79ebb1b84e7c tempest-VolumesBackupsTest-2142009639 None] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-b1fc0d58-7747-4bcf-99a7-fb482aacb945" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.375s {{(pid=101319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jul 03 09:45:29.045112 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-327bc060-a9c1-4783-a969-79ebb1b84e7c tempest-VolumesBackupsTest-2142009639 None] Connected to 192.168.40.100:3260 {{(pid=101319) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}} Jul 03 09:45:29.046859 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.linuxscsi [None req-327bc060-a9c1-4783-a969-79ebb1b84e7c tempest-VolumesBackupsTest-2142009639 None] HCTL ('15', '-', '-', 0) found on session 106 with lun 0 {{(pid=101319) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}} Jul 03 09:45:29.047011 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.linuxscsi [None req-327bc060-a9c1-4783-a969-79ebb1b84e7c tempest-VolumesBackupsTest-2142009639 None] Scanning host 15 c: -, t: -, l: 0) {{(pid=101319) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}} Jul 03 09:45:29.061305 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.linuxscsi [None req-327bc060-a9c1-4783-a969-79ebb1b84e7c tempest-VolumesBackupsTest-2142009639 None] Searching for a device in session 106 and hctl ['15', '*', '*', 0] yield: sdj {{(pid=101319) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}} Jul 03 09:45:29.061305 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-327bc060-a9c1-4783-a969-79ebb1b84e7c tempest-VolumesBackupsTest-2142009639 None] Connected to sdj using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-b1fc0d58-7747-4bcf-99a7-fb482aacb945', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'b1fc0d58-7747-4bcf-99a7-fb482aacb945', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': False} {{(pid=101319) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}} Jul 03 09:45:29.064677 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-39edf0dd-1bcf-42e2-baa1-b2115392f537 tempest-ProjectAdminTests33-1900627284 None] Backing up chunk of data from volume. {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 09:45:29.408424 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-39edf0dd-1bcf-42e2-baa1-b2115392f537 tempest-ProjectAdminTests33-1900627284 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101319) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 09:45:29.408632 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-39edf0dd-1bcf-42e2-baa1-b2115392f537 tempest-ProjectAdminTests33-1900627284 None] About to put_object {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 09:45:29.412677 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-7f8b3484-81fc-4e9e-84e6-f701b522ee42 tempest-VolumesBackupsTest-118275719 None] restoring object. backup: 3087847d-58e1-4a0c-af9c-2639ae9f2aeb, container: volumebackups, object name: volume_b86cbab3-7c42-409e-b4f6-0ed61267a031/20260703094455/az_nova_backup_3087847d-58e1-4a0c-af9c-2639ae9f2aeb-00004, volume: b86cbab3-7c42-409e-b4f6-0ed61267a031. {{(pid=101319) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:705}} Jul 03 09:45:29.430098 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-7f8b3484-81fc-4e9e-84e6-f701b522ee42 tempest-VolumesBackupsTest-118275719 None] decompressing data using zlib algorithm {{(pid=101319) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:722}} Jul 03 09:45:29.514067 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-39edf0dd-1bcf-42e2-baa1-b2115392f537 tempest-ProjectAdminTests33-1900627284 None] backup MD5 for volume_4b68dad5-e9a3-4bd1-84e2-ba745cb7bb83/20260703094525/az_nova_backup_3d538c5e-b79f-4328-82e9-e76f89c22158-00006: 25e317773f308e446cc84c503a6d1f85 {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 09:45:29.514228 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-39edf0dd-1bcf-42e2-baa1-b2115392f537 tempest-ProjectAdminTests33-1900627284 None] Calling eventlet.sleep(0) {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 09:45:29.812500 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-39edf0dd-1bcf-42e2-baa1-b2115392f537 tempest-ProjectAdminTests33-1900627284 None] Backing up chunk of data from volume. {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 09:45:29.817330 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-7f8b3484-81fc-4e9e-84e6-f701b522ee42 tempest-VolumesBackupsTest-118275719 None] restoring object. backup: 3087847d-58e1-4a0c-af9c-2639ae9f2aeb, container: volumebackups, object name: volume_b86cbab3-7c42-409e-b4f6-0ed61267a031/20260703094455/az_nova_backup_3087847d-58e1-4a0c-af9c-2639ae9f2aeb-00005, volume: b86cbab3-7c42-409e-b4f6-0ed61267a031. {{(pid=101319) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:705}} Jul 03 09:45:29.831596 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-7f8b3484-81fc-4e9e-84e6-f701b522ee42 tempest-VolumesBackupsTest-118275719 None] decompressing data using zlib algorithm {{(pid=101319) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:722}} Jul 03 09:45:30.069960 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.base [None req-327bc060-a9c1-4783-a969-79ebb1b84e7c tempest-VolumesBackupsTest-2142009639 None] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 2.414s {{(pid=101319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jul 03 09:45:30.070323 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-327bc060-a9c1-4783-a969-79ebb1b84e7c tempest-VolumesBackupsTest-2142009639 None] <== connect_volume: return (5167ms) {'type': 'block', 'scsi_wwn': '330000000e176745f', 'path': '/dev/sdj'} {{(pid=101319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}} Jul 03 09:45:30.070483 np0000004400 cinder-backup[101319]: DEBUG oslo_concurrency.processutils [None req-327bc060-a9c1-4783-a969-79ebb1b84e7c tempest-VolumesBackupsTest-2142009639 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chown 1002 /dev/sdj {{(pid=101319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 09:45:30.077176 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-39edf0dd-1bcf-42e2-baa1-b2115392f537 tempest-ProjectAdminTests33-1900627284 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101319) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 09:45:30.077419 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-39edf0dd-1bcf-42e2-baa1-b2115392f537 tempest-ProjectAdminTests33-1900627284 None] About to put_object {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 09:45:30.089948 np0000004400 sudo[136729]: stack : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chown 1002 /dev/sdj Jul 03 09:45:30.090560 np0000004400 sudo[136729]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1002) Jul 03 09:45:30.233019 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-7f8b3484-81fc-4e9e-84e6-f701b522ee42 tempest-VolumesBackupsTest-118275719 None] restoring object. backup: 3087847d-58e1-4a0c-af9c-2639ae9f2aeb, container: volumebackups, object name: volume_b86cbab3-7c42-409e-b4f6-0ed61267a031/20260703094455/az_nova_backup_3087847d-58e1-4a0c-af9c-2639ae9f2aeb-00006, volume: b86cbab3-7c42-409e-b4f6-0ed61267a031. {{(pid=101319) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:705}} Jul 03 09:45:30.249662 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-7f8b3484-81fc-4e9e-84e6-f701b522ee42 tempest-VolumesBackupsTest-118275719 None] decompressing data using zlib algorithm {{(pid=101319) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:722}} Jul 03 09:45:30.314933 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-39edf0dd-1bcf-42e2-baa1-b2115392f537 tempest-ProjectAdminTests33-1900627284 None] backup MD5 for volume_4b68dad5-e9a3-4bd1-84e2-ba745cb7bb83/20260703094525/az_nova_backup_3d538c5e-b79f-4328-82e9-e76f89c22158-00007: 25e317773f308e446cc84c503a6d1f85 {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 09:45:30.315141 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-39edf0dd-1bcf-42e2-baa1-b2115392f537 tempest-ProjectAdminTests33-1900627284 None] Calling eventlet.sleep(0) {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 09:45:30.394531 np0000004400 sudo[136729]: pam_unix(sudo:session): session closed for user root Jul 03 09:45:30.396503 np0000004400 cinder-backup[101319]: DEBUG oslo_concurrency.processutils [None req-327bc060-a9c1-4783-a969-79ebb1b84e7c tempest-VolumesBackupsTest-2142009639 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chown 1002 /dev/sdj" returned: 0 in 0.326s {{(pid=101319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 09:45:30.404289 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-327bc060-a9c1-4783-a969-79ebb1b84e7c tempest-VolumesBackupsTest-2142009639 None] _create_container started, container: tempest-volumesbackupstest-backup-container-1320776190,backup: e353b2b2-ecff-4fe0-8148-bf9d1d84a8bf. {{(pid=101319) _create_container /opt/stack/cinder/cinder/backup/chunkeddriver.py:249}} Jul 03 09:45:30.486416 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.drivers.swift [None req-327bc060-a9c1-4783-a969-79ebb1b84e7c tempest-VolumesBackupsTest-2142009639 None] generate_object_name_prefix: volume_b1fc0d58-7747-4bcf-99a7-fb482aacb945/20260703094530/az_nova_backup_e353b2b2-ecff-4fe0-8148-bf9d1d84a8bf {{(pid=101319) _generate_object_name_prefix /opt/stack/cinder/cinder/backup/drivers/swift.py:452}} Jul 03 09:45:30.497099 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-327bc060-a9c1-4783-a969-79ebb1b84e7c tempest-VolumesBackupsTest-2142009639 None] starting backup of volume: b1fc0d58-7747-4bcf-99a7-fb482aacb945, volume size: 1073741824, object names prefix volume_b1fc0d58-7747-4bcf-99a7-fb482aacb945/20260703094530/az_nova_backup_e353b2b2-ecff-4fe0-8148-bf9d1d84a8bf, availability zone: nova {{(pid=101319) _prepare_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:359}} Jul 03 09:45:30.681865 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-39edf0dd-1bcf-42e2-baa1-b2115392f537 tempest-ProjectAdminTests33-1900627284 None] Backing up chunk of data from volume. {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 09:45:30.691433 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-7f8b3484-81fc-4e9e-84e6-f701b522ee42 tempest-VolumesBackupsTest-118275719 None] restoring object. backup: 3087847d-58e1-4a0c-af9c-2639ae9f2aeb, container: volumebackups, object name: volume_b86cbab3-7c42-409e-b4f6-0ed61267a031/20260703094455/az_nova_backup_3087847d-58e1-4a0c-af9c-2639ae9f2aeb-00007, volume: b86cbab3-7c42-409e-b4f6-0ed61267a031. {{(pid=101319) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:705}} Jul 03 09:45:30.706725 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-7f8b3484-81fc-4e9e-84e6-f701b522ee42 tempest-VolumesBackupsTest-118275719 None] decompressing data using zlib algorithm {{(pid=101319) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:722}} Jul 03 09:45:30.926051 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-327bc060-a9c1-4783-a969-79ebb1b84e7c tempest-VolumesBackupsTest-2142009639 None] Backing up chunk of data from volume. {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 09:45:30.943495 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-39edf0dd-1bcf-42e2-baa1-b2115392f537 tempest-ProjectAdminTests33-1900627284 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101319) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 09:45:30.943826 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-39edf0dd-1bcf-42e2-baa1-b2115392f537 tempest-ProjectAdminTests33-1900627284 None] About to put_object {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 09:45:31.109029 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-7f8b3484-81fc-4e9e-84e6-f701b522ee42 tempest-VolumesBackupsTest-118275719 None] restoring object. backup: 3087847d-58e1-4a0c-af9c-2639ae9f2aeb, container: volumebackups, object name: volume_b86cbab3-7c42-409e-b4f6-0ed61267a031/20260703094455/az_nova_backup_3087847d-58e1-4a0c-af9c-2639ae9f2aeb-00008, volume: b86cbab3-7c42-409e-b4f6-0ed61267a031. {{(pid=101319) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:705}} Jul 03 09:45:31.126536 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-7f8b3484-81fc-4e9e-84e6-f701b522ee42 tempest-VolumesBackupsTest-118275719 None] decompressing data using zlib algorithm {{(pid=101319) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:722}} Jul 03 09:45:31.185778 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-327bc060-a9c1-4783-a969-79ebb1b84e7c tempest-VolumesBackupsTest-2142009639 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101319) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 09:45:31.185966 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-327bc060-a9c1-4783-a969-79ebb1b84e7c tempest-VolumesBackupsTest-2142009639 None] About to put_object {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 09:45:31.191701 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-39edf0dd-1bcf-42e2-baa1-b2115392f537 tempest-ProjectAdminTests33-1900627284 None] backup MD5 for volume_4b68dad5-e9a3-4bd1-84e2-ba745cb7bb83/20260703094525/az_nova_backup_3d538c5e-b79f-4328-82e9-e76f89c22158-00008: 25e317773f308e446cc84c503a6d1f85 {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 09:45:31.192436 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-39edf0dd-1bcf-42e2-baa1-b2115392f537 tempest-ProjectAdminTests33-1900627284 None] Calling eventlet.sleep(0) {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 09:45:31.328570 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-327bc060-a9c1-4783-a969-79ebb1b84e7c tempest-VolumesBackupsTest-2142009639 None] backup MD5 for volume_b1fc0d58-7747-4bcf-99a7-fb482aacb945/20260703094530/az_nova_backup_e353b2b2-ecff-4fe0-8148-bf9d1d84a8bf-00001: 25e317773f308e446cc84c503a6d1f85 {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 09:45:31.329231 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-327bc060-a9c1-4783-a969-79ebb1b84e7c tempest-VolumesBackupsTest-2142009639 None] Calling eventlet.sleep(0) {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 09:45:31.607427 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-39edf0dd-1bcf-42e2-baa1-b2115392f537 tempest-ProjectAdminTests33-1900627284 None] Backing up chunk of data from volume. {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 09:45:31.615488 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-7f8b3484-81fc-4e9e-84e6-f701b522ee42 tempest-VolumesBackupsTest-118275719 None] restoring object. backup: 3087847d-58e1-4a0c-af9c-2639ae9f2aeb, container: volumebackups, object name: volume_b86cbab3-7c42-409e-b4f6-0ed61267a031/20260703094455/az_nova_backup_3087847d-58e1-4a0c-af9c-2639ae9f2aeb-00009, volume: b86cbab3-7c42-409e-b4f6-0ed61267a031. {{(pid=101319) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:705}} Jul 03 09:45:31.634467 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-7f8b3484-81fc-4e9e-84e6-f701b522ee42 tempest-VolumesBackupsTest-118275719 None] decompressing data using zlib algorithm {{(pid=101319) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:722}} Jul 03 09:45:31.656719 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-327bc060-a9c1-4783-a969-79ebb1b84e7c tempest-VolumesBackupsTest-2142009639 None] Backing up chunk of data from volume. {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 09:45:31.862322 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-39edf0dd-1bcf-42e2-baa1-b2115392f537 tempest-ProjectAdminTests33-1900627284 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101319) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 09:45:31.862509 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-39edf0dd-1bcf-42e2-baa1-b2115392f537 tempest-ProjectAdminTests33-1900627284 None] About to put_object {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 09:45:32.008498 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-327bc060-a9c1-4783-a969-79ebb1b84e7c tempest-VolumesBackupsTest-2142009639 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101319) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 09:45:32.008734 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-327bc060-a9c1-4783-a969-79ebb1b84e7c tempest-VolumesBackupsTest-2142009639 None] About to put_object {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 09:45:32.013519 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-7f8b3484-81fc-4e9e-84e6-f701b522ee42 tempest-VolumesBackupsTest-118275719 None] restoring object. backup: 3087847d-58e1-4a0c-af9c-2639ae9f2aeb, container: volumebackups, object name: volume_b86cbab3-7c42-409e-b4f6-0ed61267a031/20260703094455/az_nova_backup_3087847d-58e1-4a0c-af9c-2639ae9f2aeb-00010, volume: b86cbab3-7c42-409e-b4f6-0ed61267a031. {{(pid=101319) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:705}} Jul 03 09:45:32.030953 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-7f8b3484-81fc-4e9e-84e6-f701b522ee42 tempest-VolumesBackupsTest-118275719 None] decompressing data using zlib algorithm {{(pid=101319) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:722}} Jul 03 09:45:32.089500 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-39edf0dd-1bcf-42e2-baa1-b2115392f537 tempest-ProjectAdminTests33-1900627284 None] backup MD5 for volume_4b68dad5-e9a3-4bd1-84e2-ba745cb7bb83/20260703094525/az_nova_backup_3d538c5e-b79f-4328-82e9-e76f89c22158-00009: 25e317773f308e446cc84c503a6d1f85 {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 09:45:32.089714 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-39edf0dd-1bcf-42e2-baa1-b2115392f537 tempest-ProjectAdminTests33-1900627284 None] Calling eventlet.sleep(0) {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 09:45:32.124499 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-327bc060-a9c1-4783-a969-79ebb1b84e7c tempest-VolumesBackupsTest-2142009639 None] backup MD5 for volume_b1fc0d58-7747-4bcf-99a7-fb482aacb945/20260703094530/az_nova_backup_e353b2b2-ecff-4fe0-8148-bf9d1d84a8bf-00002: 25e317773f308e446cc84c503a6d1f85 {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 09:45:32.124499 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-327bc060-a9c1-4783-a969-79ebb1b84e7c tempest-VolumesBackupsTest-2142009639 None] Calling eventlet.sleep(0) {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 09:45:32.473124 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-7f8b3484-81fc-4e9e-84e6-f701b522ee42 tempest-VolumesBackupsTest-118275719 None] restoring object. backup: 3087847d-58e1-4a0c-af9c-2639ae9f2aeb, container: volumebackups, object name: volume_b86cbab3-7c42-409e-b4f6-0ed61267a031/20260703094455/az_nova_backup_3087847d-58e1-4a0c-af9c-2639ae9f2aeb-00011, volume: b86cbab3-7c42-409e-b4f6-0ed61267a031. {{(pid=101319) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:705}} Jul 03 09:45:32.497486 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-7f8b3484-81fc-4e9e-84e6-f701b522ee42 tempest-VolumesBackupsTest-118275719 None] decompressing data using zlib algorithm {{(pid=101319) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:722}} Jul 03 09:45:32.521667 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-39edf0dd-1bcf-42e2-baa1-b2115392f537 tempest-ProjectAdminTests33-1900627284 None] Backing up chunk of data from volume. {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 09:45:32.524149 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-327bc060-a9c1-4783-a969-79ebb1b84e7c tempest-VolumesBackupsTest-2142009639 None] Backing up chunk of data from volume. {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 09:45:32.906284 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-39edf0dd-1bcf-42e2-baa1-b2115392f537 tempest-ProjectAdminTests33-1900627284 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101319) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 09:45:32.917609 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-39edf0dd-1bcf-42e2-baa1-b2115392f537 tempest-ProjectAdminTests33-1900627284 None] About to put_object {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 09:45:32.917609 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-327bc060-a9c1-4783-a969-79ebb1b84e7c tempest-VolumesBackupsTest-2142009639 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101319) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 09:45:32.917609 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-327bc060-a9c1-4783-a969-79ebb1b84e7c tempest-VolumesBackupsTest-2142009639 None] About to put_object {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 09:45:32.917609 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-7f8b3484-81fc-4e9e-84e6-f701b522ee42 tempest-VolumesBackupsTest-118275719 None] restoring object. backup: 3087847d-58e1-4a0c-af9c-2639ae9f2aeb, container: volumebackups, object name: volume_b86cbab3-7c42-409e-b4f6-0ed61267a031/20260703094455/az_nova_backup_3087847d-58e1-4a0c-af9c-2639ae9f2aeb-00012, volume: b86cbab3-7c42-409e-b4f6-0ed61267a031. {{(pid=101319) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:705}} Jul 03 09:45:32.936257 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-7f8b3484-81fc-4e9e-84e6-f701b522ee42 tempest-VolumesBackupsTest-118275719 None] decompressing data using zlib algorithm {{(pid=101319) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:722}} Jul 03 09:45:33.131036 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-39edf0dd-1bcf-42e2-baa1-b2115392f537 tempest-ProjectAdminTests33-1900627284 None] backup MD5 for volume_4b68dad5-e9a3-4bd1-84e2-ba745cb7bb83/20260703094525/az_nova_backup_3d538c5e-b79f-4328-82e9-e76f89c22158-00010: 25e317773f308e446cc84c503a6d1f85 {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 09:45:33.131036 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-39edf0dd-1bcf-42e2-baa1-b2115392f537 tempest-ProjectAdminTests33-1900627284 None] Calling eventlet.sleep(0) {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 09:45:33.131036 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-327bc060-a9c1-4783-a969-79ebb1b84e7c tempest-VolumesBackupsTest-2142009639 None] backup MD5 for volume_b1fc0d58-7747-4bcf-99a7-fb482aacb945/20260703094530/az_nova_backup_e353b2b2-ecff-4fe0-8148-bf9d1d84a8bf-00003: 25e317773f308e446cc84c503a6d1f85 {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 09:45:33.131036 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-327bc060-a9c1-4783-a969-79ebb1b84e7c tempest-VolumesBackupsTest-2142009639 None] Calling eventlet.sleep(0) {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 09:45:33.530902 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-7f8b3484-81fc-4e9e-84e6-f701b522ee42 tempest-VolumesBackupsTest-118275719 None] restoring object. backup: 3087847d-58e1-4a0c-af9c-2639ae9f2aeb, container: volumebackups, object name: volume_b86cbab3-7c42-409e-b4f6-0ed61267a031/20260703094455/az_nova_backup_3087847d-58e1-4a0c-af9c-2639ae9f2aeb-00013, volume: b86cbab3-7c42-409e-b4f6-0ed61267a031. {{(pid=101319) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:705}} Jul 03 09:45:33.555799 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-7f8b3484-81fc-4e9e-84e6-f701b522ee42 tempest-VolumesBackupsTest-118275719 None] decompressing data using zlib algorithm {{(pid=101319) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:722}} Jul 03 09:45:33.580098 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-327bc060-a9c1-4783-a969-79ebb1b84e7c tempest-VolumesBackupsTest-2142009639 None] Backing up chunk of data from volume. {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 09:45:33.592480 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-39edf0dd-1bcf-42e2-baa1-b2115392f537 tempest-ProjectAdminTests33-1900627284 None] Backing up chunk of data from volume. {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 09:45:33.957249 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-327bc060-a9c1-4783-a969-79ebb1b84e7c tempest-VolumesBackupsTest-2142009639 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101319) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 09:45:33.957393 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-327bc060-a9c1-4783-a969-79ebb1b84e7c tempest-VolumesBackupsTest-2142009639 None] About to put_object {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 09:45:33.957612 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-39edf0dd-1bcf-42e2-baa1-b2115392f537 tempest-ProjectAdminTests33-1900627284 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101319) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 09:45:33.957742 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-39edf0dd-1bcf-42e2-baa1-b2115392f537 tempest-ProjectAdminTests33-1900627284 None] About to put_object {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 09:45:33.962372 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-7f8b3484-81fc-4e9e-84e6-f701b522ee42 tempest-VolumesBackupsTest-118275719 None] restoring object. backup: 3087847d-58e1-4a0c-af9c-2639ae9f2aeb, container: volumebackups, object name: volume_b86cbab3-7c42-409e-b4f6-0ed61267a031/20260703094455/az_nova_backup_3087847d-58e1-4a0c-af9c-2639ae9f2aeb-00014, volume: b86cbab3-7c42-409e-b4f6-0ed61267a031. {{(pid=101319) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:705}} Jul 03 09:45:33.994888 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-7f8b3484-81fc-4e9e-84e6-f701b522ee42 tempest-VolumesBackupsTest-118275719 None] decompressing data using zlib algorithm {{(pid=101319) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:722}} Jul 03 09:45:34.131509 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-327bc060-a9c1-4783-a969-79ebb1b84e7c tempest-VolumesBackupsTest-2142009639 None] backup MD5 for volume_b1fc0d58-7747-4bcf-99a7-fb482aacb945/20260703094530/az_nova_backup_e353b2b2-ecff-4fe0-8148-bf9d1d84a8bf-00004: 25e317773f308e446cc84c503a6d1f85 {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 09:45:34.131761 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-327bc060-a9c1-4783-a969-79ebb1b84e7c tempest-VolumesBackupsTest-2142009639 None] Calling eventlet.sleep(0) {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 09:45:34.151434 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-39edf0dd-1bcf-42e2-baa1-b2115392f537 tempest-ProjectAdminTests33-1900627284 None] backup MD5 for volume_4b68dad5-e9a3-4bd1-84e2-ba745cb7bb83/20260703094525/az_nova_backup_3d538c5e-b79f-4328-82e9-e76f89c22158-00011: 25e317773f308e446cc84c503a6d1f85 {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 09:45:34.151434 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-39edf0dd-1bcf-42e2-baa1-b2115392f537 tempest-ProjectAdminTests33-1900627284 None] Calling eventlet.sleep(0) {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 09:45:34.522769 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-7f8b3484-81fc-4e9e-84e6-f701b522ee42 tempest-VolumesBackupsTest-118275719 None] restoring object. backup: 3087847d-58e1-4a0c-af9c-2639ae9f2aeb, container: volumebackups, object name: volume_b86cbab3-7c42-409e-b4f6-0ed61267a031/20260703094455/az_nova_backup_3087847d-58e1-4a0c-af9c-2639ae9f2aeb-00015, volume: b86cbab3-7c42-409e-b4f6-0ed61267a031. {{(pid=101319) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:705}} Jul 03 09:45:34.541561 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-7f8b3484-81fc-4e9e-84e6-f701b522ee42 tempest-VolumesBackupsTest-118275719 None] decompressing data using zlib algorithm {{(pid=101319) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:722}} Jul 03 09:45:34.564880 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-39edf0dd-1bcf-42e2-baa1-b2115392f537 tempest-ProjectAdminTests33-1900627284 None] Backing up chunk of data from volume. {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 09:45:34.568806 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-327bc060-a9c1-4783-a969-79ebb1b84e7c tempest-VolumesBackupsTest-2142009639 None] Backing up chunk of data from volume. {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 09:45:34.951475 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-327bc060-a9c1-4783-a969-79ebb1b84e7c tempest-VolumesBackupsTest-2142009639 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101319) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 09:45:34.951622 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-327bc060-a9c1-4783-a969-79ebb1b84e7c tempest-VolumesBackupsTest-2142009639 None] About to put_object {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 09:45:34.951839 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-39edf0dd-1bcf-42e2-baa1-b2115392f537 tempest-ProjectAdminTests33-1900627284 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101319) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 09:45:34.951966 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-39edf0dd-1bcf-42e2-baa1-b2115392f537 tempest-ProjectAdminTests33-1900627284 None] About to put_object {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 09:45:34.969749 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-7f8b3484-81fc-4e9e-84e6-f701b522ee42 tempest-VolumesBackupsTest-118275719 None] restoring object. backup: 3087847d-58e1-4a0c-af9c-2639ae9f2aeb, container: volumebackups, object name: volume_b86cbab3-7c42-409e-b4f6-0ed61267a031/20260703094455/az_nova_backup_3087847d-58e1-4a0c-af9c-2639ae9f2aeb-00016, volume: b86cbab3-7c42-409e-b4f6-0ed61267a031. {{(pid=101319) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:705}} Jul 03 09:45:34.983126 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-7f8b3484-81fc-4e9e-84e6-f701b522ee42 tempest-VolumesBackupsTest-118275719 None] decompressing data using zlib algorithm {{(pid=101319) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:722}} Jul 03 09:45:35.081570 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-39edf0dd-1bcf-42e2-baa1-b2115392f537 tempest-ProjectAdminTests33-1900627284 None] backup MD5 for volume_4b68dad5-e9a3-4bd1-84e2-ba745cb7bb83/20260703094525/az_nova_backup_3d538c5e-b79f-4328-82e9-e76f89c22158-00012: 25e317773f308e446cc84c503a6d1f85 {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 09:45:35.081570 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-39edf0dd-1bcf-42e2-baa1-b2115392f537 tempest-ProjectAdminTests33-1900627284 None] Calling eventlet.sleep(0) {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 09:45:35.089565 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-327bc060-a9c1-4783-a969-79ebb1b84e7c tempest-VolumesBackupsTest-2142009639 None] backup MD5 for volume_b1fc0d58-7747-4bcf-99a7-fb482aacb945/20260703094530/az_nova_backup_e353b2b2-ecff-4fe0-8148-bf9d1d84a8bf-00005: 25e317773f308e446cc84c503a6d1f85 {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 09:45:35.089768 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-327bc060-a9c1-4783-a969-79ebb1b84e7c tempest-VolumesBackupsTest-2142009639 None] Calling eventlet.sleep(0) {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 09:45:35.454631 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-7f8b3484-81fc-4e9e-84e6-f701b522ee42 tempest-VolumesBackupsTest-118275719 None] restoring object. backup: 3087847d-58e1-4a0c-af9c-2639ae9f2aeb, container: volumebackups, object name: volume_b86cbab3-7c42-409e-b4f6-0ed61267a031/20260703094455/az_nova_backup_3087847d-58e1-4a0c-af9c-2639ae9f2aeb-00017, volume: b86cbab3-7c42-409e-b4f6-0ed61267a031. {{(pid=101319) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:705}} Jul 03 09:45:35.475661 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-7f8b3484-81fc-4e9e-84e6-f701b522ee42 tempest-VolumesBackupsTest-118275719 None] decompressing data using zlib algorithm {{(pid=101319) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:722}} Jul 03 09:45:35.498527 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-327bc060-a9c1-4783-a969-79ebb1b84e7c tempest-VolumesBackupsTest-2142009639 None] Backing up chunk of data from volume. {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 09:45:35.501529 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-39edf0dd-1bcf-42e2-baa1-b2115392f537 tempest-ProjectAdminTests33-1900627284 None] Backing up chunk of data from volume. {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 09:45:35.851258 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-39edf0dd-1bcf-42e2-baa1-b2115392f537 tempest-ProjectAdminTests33-1900627284 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101319) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 09:45:35.851489 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-39edf0dd-1bcf-42e2-baa1-b2115392f537 tempest-ProjectAdminTests33-1900627284 None] About to put_object {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 09:45:35.851675 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-327bc060-a9c1-4783-a969-79ebb1b84e7c tempest-VolumesBackupsTest-2142009639 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101319) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 09:45:35.851872 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-327bc060-a9c1-4783-a969-79ebb1b84e7c tempest-VolumesBackupsTest-2142009639 None] About to put_object {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 09:45:35.863474 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-7f8b3484-81fc-4e9e-84e6-f701b522ee42 tempest-VolumesBackupsTest-118275719 None] restoring object. backup: 3087847d-58e1-4a0c-af9c-2639ae9f2aeb, container: volumebackups, object name: volume_b86cbab3-7c42-409e-b4f6-0ed61267a031/20260703094455/az_nova_backup_3087847d-58e1-4a0c-af9c-2639ae9f2aeb-00018, volume: b86cbab3-7c42-409e-b4f6-0ed61267a031. {{(pid=101319) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:705}} Jul 03 09:45:35.885952 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-7f8b3484-81fc-4e9e-84e6-f701b522ee42 tempest-VolumesBackupsTest-118275719 None] decompressing data using zlib algorithm {{(pid=101319) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:722}} Jul 03 09:45:36.011961 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-327bc060-a9c1-4783-a969-79ebb1b84e7c tempest-VolumesBackupsTest-2142009639 None] backup MD5 for volume_b1fc0d58-7747-4bcf-99a7-fb482aacb945/20260703094530/az_nova_backup_e353b2b2-ecff-4fe0-8148-bf9d1d84a8bf-00006: 25e317773f308e446cc84c503a6d1f85 {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 09:45:36.013113 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-327bc060-a9c1-4783-a969-79ebb1b84e7c tempest-VolumesBackupsTest-2142009639 None] Calling eventlet.sleep(0) {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 09:45:36.022131 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-39edf0dd-1bcf-42e2-baa1-b2115392f537 tempest-ProjectAdminTests33-1900627284 None] backup MD5 for volume_4b68dad5-e9a3-4bd1-84e2-ba745cb7bb83/20260703094525/az_nova_backup_3d538c5e-b79f-4328-82e9-e76f89c22158-00013: 25e317773f308e446cc84c503a6d1f85 {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 09:45:36.022131 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-39edf0dd-1bcf-42e2-baa1-b2115392f537 tempest-ProjectAdminTests33-1900627284 None] Calling eventlet.sleep(0) {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 09:45:36.382191 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-7f8b3484-81fc-4e9e-84e6-f701b522ee42 tempest-VolumesBackupsTest-118275719 None] restoring object. backup: 3087847d-58e1-4a0c-af9c-2639ae9f2aeb, container: volumebackups, object name: volume_b86cbab3-7c42-409e-b4f6-0ed61267a031/20260703094455/az_nova_backup_3087847d-58e1-4a0c-af9c-2639ae9f2aeb-00019, volume: b86cbab3-7c42-409e-b4f6-0ed61267a031. {{(pid=101319) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:705}} Jul 03 09:45:36.399906 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-7f8b3484-81fc-4e9e-84e6-f701b522ee42 tempest-VolumesBackupsTest-118275719 None] decompressing data using zlib algorithm {{(pid=101319) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:722}} Jul 03 09:45:36.422525 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-327bc060-a9c1-4783-a969-79ebb1b84e7c tempest-VolumesBackupsTest-2142009639 None] Backing up chunk of data from volume. {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 09:45:36.423242 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-39edf0dd-1bcf-42e2-baa1-b2115392f537 tempest-ProjectAdminTests33-1900627284 None] Backing up chunk of data from volume. {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 09:45:36.793319 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-327bc060-a9c1-4783-a969-79ebb1b84e7c tempest-VolumesBackupsTest-2142009639 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101319) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 09:45:36.795041 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-327bc060-a9c1-4783-a969-79ebb1b84e7c tempest-VolumesBackupsTest-2142009639 None] About to put_object {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 09:45:36.795041 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-39edf0dd-1bcf-42e2-baa1-b2115392f537 tempest-ProjectAdminTests33-1900627284 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101319) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 09:45:36.795041 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-39edf0dd-1bcf-42e2-baa1-b2115392f537 tempest-ProjectAdminTests33-1900627284 None] About to put_object {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 09:45:36.800057 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-7f8b3484-81fc-4e9e-84e6-f701b522ee42 tempest-VolumesBackupsTest-118275719 None] restoring object. backup: 3087847d-58e1-4a0c-af9c-2639ae9f2aeb, container: volumebackups, object name: volume_b86cbab3-7c42-409e-b4f6-0ed61267a031/20260703094455/az_nova_backup_3087847d-58e1-4a0c-af9c-2639ae9f2aeb-00020, volume: b86cbab3-7c42-409e-b4f6-0ed61267a031. {{(pid=101319) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:705}} Jul 03 09:45:36.823299 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-7f8b3484-81fc-4e9e-84e6-f701b522ee42 tempest-VolumesBackupsTest-118275719 None] decompressing data using zlib algorithm {{(pid=101319) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:722}} Jul 03 09:45:36.934794 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-327bc060-a9c1-4783-a969-79ebb1b84e7c tempest-VolumesBackupsTest-2142009639 None] backup MD5 for volume_b1fc0d58-7747-4bcf-99a7-fb482aacb945/20260703094530/az_nova_backup_e353b2b2-ecff-4fe0-8148-bf9d1d84a8bf-00007: 25e317773f308e446cc84c503a6d1f85 {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 09:45:36.934920 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-327bc060-a9c1-4783-a969-79ebb1b84e7c tempest-VolumesBackupsTest-2142009639 None] Calling eventlet.sleep(0) {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 09:45:36.942921 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-39edf0dd-1bcf-42e2-baa1-b2115392f537 tempest-ProjectAdminTests33-1900627284 None] backup MD5 for volume_4b68dad5-e9a3-4bd1-84e2-ba745cb7bb83/20260703094525/az_nova_backup_3d538c5e-b79f-4328-82e9-e76f89c22158-00014: 25e317773f308e446cc84c503a6d1f85 {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 09:45:36.943125 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-39edf0dd-1bcf-42e2-baa1-b2115392f537 tempest-ProjectAdminTests33-1900627284 None] Calling eventlet.sleep(0) {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 09:45:37.350528 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-7f8b3484-81fc-4e9e-84e6-f701b522ee42 tempest-VolumesBackupsTest-118275719 None] restoring object. backup: 3087847d-58e1-4a0c-af9c-2639ae9f2aeb, container: volumebackups, object name: volume_b86cbab3-7c42-409e-b4f6-0ed61267a031/20260703094455/az_nova_backup_3087847d-58e1-4a0c-af9c-2639ae9f2aeb-00021, volume: b86cbab3-7c42-409e-b4f6-0ed61267a031. {{(pid=101319) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:705}} Jul 03 09:45:37.367163 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-7f8b3484-81fc-4e9e-84e6-f701b522ee42 tempest-VolumesBackupsTest-118275719 None] decompressing data using zlib algorithm {{(pid=101319) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:722}} Jul 03 09:45:37.405710 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-39edf0dd-1bcf-42e2-baa1-b2115392f537 tempest-ProjectAdminTests33-1900627284 None] Backing up chunk of data from volume. {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 09:45:37.413711 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-327bc060-a9c1-4783-a969-79ebb1b84e7c tempest-VolumesBackupsTest-2142009639 None] Backing up chunk of data from volume. {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 09:45:37.558241 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-7f8b3484-81fc-4e9e-84e6-f701b522ee42 tempest-VolumesBackupsTest-118275719 None] v1 volume backup restore of 3087847d-58e1-4a0c-af9c-2639ae9f2aeb finished. {{(pid=101319) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:750}} Jul 03 09:45:37.558619 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.driver [None req-7f8b3484-81fc-4e9e-84e6-f701b522ee42 tempest-VolumesBackupsTest-118275719 None] Restoring volume base metadata {{(pid=101319) _restore_vol_base_meta /opt/stack/cinder/cinder/backup/driver.py:177}} Jul 03 09:45:37.564949 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.driver [None req-7f8b3484-81fc-4e9e-84e6-f701b522ee42 tempest-VolumesBackupsTest-118275719 None] Excluding field 'display_name' {{(pid=101319) _filter /opt/stack/cinder/cinder/backup/driver.py:171}} Jul 03 09:45:37.565108 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.driver [None req-7f8b3484-81fc-4e9e-84e6-f701b522ee42 tempest-VolumesBackupsTest-118275719 None] Excluding field 'display_description' {{(pid=101319) _filter /opt/stack/cinder/cinder/backup/driver.py:171}} Jul 03 09:45:37.581143 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.driver [None req-7f8b3484-81fc-4e9e-84e6-f701b522ee42 tempest-VolumesBackupsTest-118275719 None] No metadata of type 'volume-metadata' to restore {{(pid=101319) put /opt/stack/cinder/cinder/backup/driver.py:345}} Jul 03 09:45:37.581316 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.driver [None req-7f8b3484-81fc-4e9e-84e6-f701b522ee42 tempest-VolumesBackupsTest-118275719 None] No metadata of type 'volume-glance-metadata' to restore {{(pid=101319) put /opt/stack/cinder/cinder/backup/driver.py:345}} Jul 03 09:45:37.581631 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-7f8b3484-81fc-4e9e-84e6-f701b522ee42 tempest-VolumesBackupsTest-118275719 None] _read_metadata started, container name: volumebackups, metadata filename: volume_b86cbab3-7c42-409e-b4f6-0ed61267a031/20260703094514/az_nova_backup_435094a5-f336-4be4-826b-fa363af35296_metadata. {{(pid=101319) _read_metadata /opt/stack/cinder/cinder/backup/chunkeddriver.py:320}} Jul 03 09:45:37.601759 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-7f8b3484-81fc-4e9e-84e6-f701b522ee42 tempest-VolumesBackupsTest-118275719 None] _read_metadata finished. Metadata: { Jul 03 09:45:37.601759 np0000004400 cinder-backup[101319]: "backup_description": null, Jul 03 09:45:37.601759 np0000004400 cinder-backup[101319]: "backup_id": "435094a5-f336-4be4-826b-fa363af35296", Jul 03 09:45:37.601759 np0000004400 cinder-backup[101319]: "backup_name": "tempest-VolumesBackupsTest-Backup-705531849", Jul 03 09:45:37.601759 np0000004400 cinder-backup[101319]: "created_at": "2026-07-03 09:45:11+00:00", Jul 03 09:45:37.601759 np0000004400 cinder-backup[101319]: "objects": [], Jul 03 09:45:37.601759 np0000004400 cinder-backup[101319]: "parent_id": "3087847d-58e1-4a0c-af9c-2639ae9f2aeb", Jul 03 09:45:37.601759 np0000004400 cinder-backup[101319]: "version": "1.0.0", Jul 03 09:45:37.601759 np0000004400 cinder-backup[101319]: "volume_id": "b86cbab3-7c42-409e-b4f6-0ed61267a031", Jul 03 09:45:37.601759 np0000004400 cinder-backup[101319]: "volume_meta": "{\"version\": 2, \"volume-base-metadata\": {\"id\": \"b86cbab3-7c42-409e-b4f6-0ed61267a031\", \"_name_id\": null, \"use_quota\": true, \"ec2_id\": null, \"user_id\": \"b861df2a13684334b293b1f348152e37\", \"project_id\": \"a484ec9218bf417bb9d7575ae6370646\", \"snapshot_id\": null, \"cluster_name\": null, \"host\": \"np0000004400@storpool#default\", \"size\": 1, \"availability_zone\": \"nova\", \"status\": \"backing-up\", \"attach_status\": \"detached\", \"migration_status\": null, \"scheduled_at\": \"2026-07-03T09:44:52.000000\", \"launched_at\": \"2026-07-03T09:44:52.000000\", \"terminated_at\": null, \"display_name\": \"tempest-VolumesBackupsTest-Volume-504009765\", \"display_description\": null, \"provider_location\": null, \"provider_auth\": null, \"provider_geometry\": null, \"provider_id\": null, \"volume_type_id\": \"03e13fe6-0e30-4803-ace0-725d38e6dc24\", \"source_volid\": null, \"encryption_key_id\": null, \"consistencygroup_id\": null, \"group_id\": null, \"bootable\": false, \"multiattach\": false, \"replication_status\": null, \"replication_extended_status\": null, \"replication_driver_data\": null, \"previous_status\": \"available\", \"service_uuid\": \"6d4b0e79-fefe-4744-b25f-34be05095200\", \"shared_targets\": true, \"deleted_at\": null, \"deleted\": false, \"created_at\": \"2026-07-03T09:44:51.000000\", \"updated_at\": \"2026-07-03T09:45:11.000000\"}}" Jul 03 09:45:37.601759 np0000004400 cinder-backup[101319]: }. {{(pid=101319) _read_metadata /opt/stack/cinder/cinder/backup/chunkeddriver.py:327}} Jul 03 09:45:37.602117 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-7f8b3484-81fc-4e9e-84e6-f701b522ee42 tempest-VolumesBackupsTest-118275719 None] v1 volume backup restore of 435094a5-f336-4be4-826b-fa363af35296 started. {{(pid=101319) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:678}} Jul 03 09:45:37.602117 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-7f8b3484-81fc-4e9e-84e6-f701b522ee42 tempest-VolumesBackupsTest-118275719 None] metadata_object_names = []. {{(pid=101319) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:685}} Jul 03 09:45:37.633542 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-7f8b3484-81fc-4e9e-84e6-f701b522ee42 tempest-VolumesBackupsTest-118275719 None] generated object list: ['volume_b86cbab3-7c42-409e-b4f6-0ed61267a031/20260703094514/az_nova_backup_435094a5-f336-4be4-826b-fa363af35296_metadata', 'volume_b86cbab3-7c42-409e-b4f6-0ed61267a031/20260703094514/az_nova_backup_435094a5-f336-4be4-826b-fa363af35296_sha256file']. {{(pid=101319) _generate_object_names /opt/stack/cinder/cinder/backup/chunkeddriver.py:260}} Jul 03 09:45:37.633542 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-7f8b3484-81fc-4e9e-84e6-f701b522ee42 tempest-VolumesBackupsTest-118275719 None] v1 volume backup restore of 435094a5-f336-4be4-826b-fa363af35296 finished. {{(pid=101319) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:750}} Jul 03 09:45:37.633542 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.driver [None req-7f8b3484-81fc-4e9e-84e6-f701b522ee42 tempest-VolumesBackupsTest-118275719 None] Restoring volume base metadata {{(pid=101319) _restore_vol_base_meta /opt/stack/cinder/cinder/backup/driver.py:177}} Jul 03 09:45:37.639638 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.driver [None req-7f8b3484-81fc-4e9e-84e6-f701b522ee42 tempest-VolumesBackupsTest-118275719 None] Excluding field 'display_name' {{(pid=101319) _filter /opt/stack/cinder/cinder/backup/driver.py:171}} Jul 03 09:45:37.639803 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.driver [None req-7f8b3484-81fc-4e9e-84e6-f701b522ee42 tempest-VolumesBackupsTest-118275719 None] Excluding field 'display_description' {{(pid=101319) _filter /opt/stack/cinder/cinder/backup/driver.py:171}} Jul 03 09:45:37.642169 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.driver [None req-7f8b3484-81fc-4e9e-84e6-f701b522ee42 tempest-VolumesBackupsTest-118275719 None] No metadata of type 'volume-metadata' to restore {{(pid=101319) put /opt/stack/cinder/cinder/backup/driver.py:345}} Jul 03 09:45:37.642350 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.driver [None req-7f8b3484-81fc-4e9e-84e6-f701b522ee42 tempest-VolumesBackupsTest-118275719 None] No metadata of type 'volume-glance-metadata' to restore {{(pid=101319) put /opt/stack/cinder/cinder/backup/driver.py:345}} Jul 03 09:45:37.642500 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-7f8b3484-81fc-4e9e-84e6-f701b522ee42 tempest-VolumesBackupsTest-118275719 None] restore 435094a5-f336-4be4-826b-fa363af35296 to b86cbab3-7c42-409e-b4f6-0ed61267a031 finished. {{(pid=101319) restore /opt/stack/cinder/cinder/backup/chunkeddriver.py:815}} Jul 03 09:45:37.839255 np0000004400 cinder-backup[101319]: DEBUG oslo_concurrency.processutils [None req-7f8b3484-81fc-4e9e-84e6-f701b522ee42 tempest-VolumesBackupsTest-118275719 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chown 0 /dev/sde {{(pid=101319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 09:45:37.848389 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-39edf0dd-1bcf-42e2-baa1-b2115392f537 tempest-ProjectAdminTests33-1900627284 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101319) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 09:45:37.848698 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-39edf0dd-1bcf-42e2-baa1-b2115392f537 tempest-ProjectAdminTests33-1900627284 None] About to put_object {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 09:45:37.849212 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-327bc060-a9c1-4783-a969-79ebb1b84e7c tempest-VolumesBackupsTest-2142009639 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101319) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 09:45:37.849427 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-327bc060-a9c1-4783-a969-79ebb1b84e7c tempest-VolumesBackupsTest-2142009639 None] About to put_object {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 09:45:37.862382 np0000004400 sudo[136913]: stack : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chown 0 /dev/sde Jul 03 09:45:37.863009 np0000004400 sudo[136913]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1002) Jul 03 09:45:37.963357 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-327bc060-a9c1-4783-a969-79ebb1b84e7c tempest-VolumesBackupsTest-2142009639 None] backup MD5 for volume_b1fc0d58-7747-4bcf-99a7-fb482aacb945/20260703094530/az_nova_backup_e353b2b2-ecff-4fe0-8148-bf9d1d84a8bf-00008: 25e317773f308e446cc84c503a6d1f85 {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 09:45:37.963561 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-327bc060-a9c1-4783-a969-79ebb1b84e7c tempest-VolumesBackupsTest-2142009639 None] Calling eventlet.sleep(0) {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 09:45:37.966372 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-39edf0dd-1bcf-42e2-baa1-b2115392f537 tempest-ProjectAdminTests33-1900627284 None] backup MD5 for volume_4b68dad5-e9a3-4bd1-84e2-ba745cb7bb83/20260703094525/az_nova_backup_3d538c5e-b79f-4328-82e9-e76f89c22158-00015: 25e317773f308e446cc84c503a6d1f85 {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 09:45:37.966561 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-39edf0dd-1bcf-42e2-baa1-b2115392f537 tempest-ProjectAdminTests33-1900627284 None] Calling eventlet.sleep(0) {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 09:45:38.207207 np0000004400 sudo[136913]: pam_unix(sudo:session): session closed for user root Jul 03 09:45:38.209364 np0000004400 cinder-backup[101319]: DEBUG oslo_concurrency.processutils [None req-7f8b3484-81fc-4e9e-84e6-f701b522ee42 tempest-VolumesBackupsTest-118275719 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chown 0 /dev/sde" returned: 0 in 0.370s {{(pid=101319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 09:45:38.210143 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-7f8b3484-81fc-4e9e-84e6-f701b522ee42 tempest-VolumesBackupsTest-118275719 None] ==> disconnect_volume: call "{'args': (, {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-b86cbab3-7c42-409e-b4f6-0ed61267a031', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'b86cbab3-7c42-409e-b4f6-0ed61267a031', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': False}, {'type': 'block', 'scsi_wwn': '1StorPooliSCSI_DISK_1034578903445799018', 'path': '/dev/sde'}), 'kwargs': {'force': True, 'ignore_errors': False}}" {{(pid=101319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}} Jul 03 09:45:38.210143 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.base [None req-7f8b3484-81fc-4e9e-84e6-f701b522ee42 tempest-VolumesBackupsTest-118275719 None] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=101319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jul 03 09:45:38.210883 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.base [None req-7f8b3484-81fc-4e9e-84e6-f701b522ee42 tempest-VolumesBackupsTest-118275719 None] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=101319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jul 03 09:45:38.212280 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-7f8b3484-81fc-4e9e-84e6-f701b522ee42 tempest-VolumesBackupsTest-118275719 None] _get_connection_devices called with parameters: connection_properties={'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-b86cbab3-7c42-409e-b4f6-0ed61267a031', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'b86cbab3-7c42-409e-b4f6-0ed61267a031', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': False}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=101319) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:847}} Jul 03 09:45:38.230097 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-7f8b3484-81fc-4e9e-84e6-f701b522ee42 tempest-VolumesBackupsTest-118275719 None] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS: Jul 03 09:45:38.230097 np0000004400 cinder-backup[101319]: No targets found. Jul 03 09:45:38.230097 np0000004400 cinder-backup[101319]: iSNS: Jul 03 09:45:38.230097 np0000004400 cinder-backup[101319]: No targets found. Jul 03 09:45:38.230097 np0000004400 cinder-backup[101319]: STATIC: Jul 03 09:45:38.230097 np0000004400 cinder-backup[101319]: Target: iqn.2023-03.storpool.com:os--volume-b86cbab3-7c42-409e-b4f6-0ed61267a031 Jul 03 09:45:38.230097 np0000004400 cinder-backup[101319]: Portal: 192.168.40.100:3260,-1 Jul 03 09:45:38.230097 np0000004400 cinder-backup[101319]: Iface Name: default Jul 03 09:45:38.230097 np0000004400 cinder-backup[101319]: Target: iqn.2023-03.storpool.com:os--volume-76320525-737e-4f58-8523-63ec9abbdc64 Jul 03 09:45:38.230097 np0000004400 cinder-backup[101319]: Portal: 192.168.50.100:3260,-1 Jul 03 09:45:38.230097 np0000004400 cinder-backup[101319]: Iface Name: default Jul 03 09:45:38.230097 np0000004400 cinder-backup[101319]: Portal: 192.168.40.100:3260,-1 Jul 03 09:45:38.230097 np0000004400 cinder-backup[101319]: Iface Name: default Jul 03 09:45:38.230097 np0000004400 cinder-backup[101319]: Target: iqn.2023-03.storpool.com:os--volume-b2e4f10c-8033-4c54-95a1-dfe45d6357a3 Jul 03 09:45:38.230097 np0000004400 cinder-backup[101319]: Portal: 192.168.50.100:3260,-1 Jul 03 09:45:38.230097 np0000004400 cinder-backup[101319]: Iface Name: default Jul 03 09:45:38.230097 np0000004400 cinder-backup[101319]: Portal: 192.168.40.100:3260,-1 Jul 03 09:45:38.230097 np0000004400 cinder-backup[101319]: Iface Name: default Jul 03 09:45:38.230097 np0000004400 cinder-backup[101319]: Target: iqn.2023-03.storpool.com:os--volume-4b68dad5-e9a3-4bd1-84e2-ba745cb7bb83 Jul 03 09:45:38.230097 np0000004400 cinder-backup[101319]: Portal: 192.168.40.100:3260,-1 Jul 03 09:45:38.230097 np0000004400 cinder-backup[101319]: Iface Name: default Jul 03 09:45:38.230097 np0000004400 cinder-backup[101319]: Target: iqn.2023-03.storpool.com:os--volume-d47f5d2f-dce5-42f7-a693-a654fd702622 Jul 03 09:45:38.230097 np0000004400 cinder-backup[101319]: Portal: 192.168.50.100:3260,-1 Jul 03 09:45:38.230097 np0000004400 cinder-backup[101319]: Iface Name: default Jul 03 09:45:38.230097 np0000004400 cinder-backup[101319]: Portal: 192.168.40.100:3260,-1 Jul 03 09:45:38.230097 np0000004400 cinder-backup[101319]: Iface Name: default Jul 03 09:45:38.230097 np0000004400 cinder-backup[101319]: Target: iqn.2023-03.storpool.com:os--volume-b1fc0d58-7747-4bcf-99a7-fb482aacb945 Jul 03 09:45:38.230097 np0000004400 cinder-backup[101319]: Portal: 192.168.40.100:3260,-1 Jul 03 09:45:38.230097 np0000004400 cinder-backup[101319]: Iface Name: default Jul 03 09:45:38.230097 np0000004400 cinder-backup[101319]: FIRMWARE: Jul 03 09:45:38.230097 np0000004400 cinder-backup[101319]: No targets found. Jul 03 09:45:38.230097 np0000004400 cinder-backup[101319]: stderr= {{(pid=101319) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jul 03 09:45:38.231414 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-7f8b3484-81fc-4e9e-84e6-f701b522ee42 tempest-VolumesBackupsTest-118275719 None] Regex to get portals from discoverydb: ^SENDTARGETS: Jul 03 09:45:38.231414 np0000004400 cinder-backup[101319]: .*?^DiscoveryAddress: 192.168.40.100,3260.*? Jul 03 09:45:38.231414 np0000004400 cinder-backup[101319]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=101319) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:390}} Jul 03 09:45:38.231853 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-7f8b3484-81fc-4e9e-84e6-f701b522ee42 tempest-VolumesBackupsTest-118275719 None] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-b86cbab3-7c42-409e-b4f6-0ed61267a031', 0)] {{(pid=101319) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:858}} Jul 03 09:45:38.263115 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-7f8b3484-81fc-4e9e-84e6-f701b522ee42 tempest-VolumesBackupsTest-118275719 None] iscsiadm ('-m', 'session'): stdout=tcp: [104] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-4b68dad5-e9a3-4bd1-84e2-ba745cb7bb83 (non-flash) Jul 03 09:45:38.263115 np0000004400 cinder-backup[101319]: tcp: [105] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b86cbab3-7c42-409e-b4f6-0ed61267a031 (non-flash) Jul 03 09:45:38.263115 np0000004400 cinder-backup[101319]: tcp: [106] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b1fc0d58-7747-4bcf-99a7-fb482aacb945 (non-flash) Jul 03 09:45:38.263115 np0000004400 cinder-backup[101319]: tcp: [49] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b2e4f10c-8033-4c54-95a1-dfe45d6357a3 (non-flash) Jul 03 09:45:38.263115 np0000004400 cinder-backup[101319]: tcp: [50] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b2e4f10c-8033-4c54-95a1-dfe45d6357a3 (non-flash) Jul 03 09:45:38.263115 np0000004400 cinder-backup[101319]: tcp: [82] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-76320525-737e-4f58-8523-63ec9abbdc64 (non-flash) Jul 03 09:45:38.263115 np0000004400 cinder-backup[101319]: tcp: [83] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-76320525-737e-4f58-8523-63ec9abbdc64 (non-flash) Jul 03 09:45:38.263115 np0000004400 cinder-backup[101319]: tcp: [97] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d47f5d2f-dce5-42f7-a693-a654fd702622 (non-flash) Jul 03 09:45:38.263115 np0000004400 cinder-backup[101319]: tcp: [98] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d47f5d2f-dce5-42f7-a693-a654fd702622 (non-flash) Jul 03 09:45:38.263115 np0000004400 cinder-backup[101319]: stderr= {{(pid=101319) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jul 03 09:45:38.263352 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-7f8b3484-81fc-4e9e-84e6-f701b522ee42 tempest-VolumesBackupsTest-118275719 None] iscsi session list stdout=tcp: [104] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-4b68dad5-e9a3-4bd1-84e2-ba745cb7bb83 (non-flash) Jul 03 09:45:38.263352 np0000004400 cinder-backup[101319]: tcp: [105] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b86cbab3-7c42-409e-b4f6-0ed61267a031 (non-flash) Jul 03 09:45:38.263352 np0000004400 cinder-backup[101319]: tcp: [106] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b1fc0d58-7747-4bcf-99a7-fb482aacb945 (non-flash) Jul 03 09:45:38.263352 np0000004400 cinder-backup[101319]: tcp: [49] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b2e4f10c-8033-4c54-95a1-dfe45d6357a3 (non-flash) Jul 03 09:45:38.263352 np0000004400 cinder-backup[101319]: tcp: [50] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b2e4f10c-8033-4c54-95a1-dfe45d6357a3 (non-flash) Jul 03 09:45:38.263352 np0000004400 cinder-backup[101319]: tcp: [82] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-76320525-737e-4f58-8523-63ec9abbdc64 (non-flash) Jul 03 09:45:38.263352 np0000004400 cinder-backup[101319]: tcp: [83] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-76320525-737e-4f58-8523-63ec9abbdc64 (non-flash) Jul 03 09:45:38.263352 np0000004400 cinder-backup[101319]: tcp: [97] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d47f5d2f-dce5-42f7-a693-a654fd702622 (non-flash) Jul 03 09:45:38.263352 np0000004400 cinder-backup[101319]: tcp: [98] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d47f5d2f-dce5-42f7-a693-a654fd702622 (non-flash) Jul 03 09:45:38.263352 np0000004400 cinder-backup[101319]: stderr= {{(pid=101319) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jul 03 09:45:38.263538 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-7f8b3484-81fc-4e9e-84e6-f701b522ee42 tempest-VolumesBackupsTest-118275719 None] Sessions list: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-4b68dad5-e9a3-4bd1-84e2-ba745cb7bb83', '104'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-b86cbab3-7c42-409e-b4f6-0ed61267a031', '105'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-b1fc0d58-7747-4bcf-99a7-fb482aacb945', '106'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-b2e4f10c-8033-4c54-95a1-dfe45d6357a3', '49'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-b2e4f10c-8033-4c54-95a1-dfe45d6357a3', '50'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-76320525-737e-4f58-8523-63ec9abbdc64', '82'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-76320525-737e-4f58-8523-63ec9abbdc64', '83'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-d47f5d2f-dce5-42f7-a693-a654fd702622', '97'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-d47f5d2f-dce5-42f7-a693-a654fd702622', '98')] {{(pid=101319) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:866}} Jul 03 09:45:38.263607 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-7f8b3484-81fc-4e9e-84e6-f701b522ee42 tempest-VolumesBackupsTest-118275719 None] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-b86cbab3-7c42-409e-b4f6-0ed61267a031, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-b86cbab3-7c42-409e-b4f6-0ed61267a031', '105')] {{(pid=101319) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}} Jul 03 09:45:38.268980 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-7f8b3484-81fc-4e9e-84e6-f701b522ee42 tempest-VolumesBackupsTest-118275719 None] Resulting device map defaultdict(. at 0x7e76e6d31440>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-b86cbab3-7c42-409e-b4f6-0ed61267a031'): ({'sde'}, set())}) {{(pid=101319) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:912}} Jul 03 09:45:38.269157 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.linuxscsi [None req-7f8b3484-81fc-4e9e-84e6-f701b522ee42 tempest-VolumesBackupsTest-118275719 None] Removing single pathed devices sde {{(pid=101319) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}} Jul 03 09:45:38.273482 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-39edf0dd-1bcf-42e2-baa1-b2115392f537 tempest-ProjectAdminTests33-1900627284 None] Backing up chunk of data from volume. {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 09:45:38.273753 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-327bc060-a9c1-4783-a969-79ebb1b84e7c tempest-VolumesBackupsTest-2142009639 None] Backing up chunk of data from volume. {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 09:45:38.284074 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.linuxscsi [None req-7f8b3484-81fc-4e9e-84e6-f701b522ee42 tempest-VolumesBackupsTest-118275719 None] Flushing IO for device /dev/sde {{(pid=101319) flush_device_io /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:461}} Jul 03 09:45:38.291298 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.linuxscsi [None req-7f8b3484-81fc-4e9e-84e6-f701b522ee42 tempest-VolumesBackupsTest-118275719 None] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=101319) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}} Jul 03 09:45:38.337915 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.linuxscsi [None req-7f8b3484-81fc-4e9e-84e6-f701b522ee42 tempest-VolumesBackupsTest-118275719 None] Checking to see if SCSI volumes sde have been removed. {{(pid=101319) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}} Jul 03 09:45:38.338108 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.linuxscsi [None req-7f8b3484-81fc-4e9e-84e6-f701b522ee42 tempest-VolumesBackupsTest-118275719 None] SCSI volumes sde have been removed. {{(pid=101319) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}} Jul 03 09:45:38.339324 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.linuxscsi [None req-7f8b3484-81fc-4e9e-84e6-f701b522ee42 tempest-VolumesBackupsTest-118275719 None] Checking to see if device paths {'sde'} are still under multipathd monitoring {{(pid=101319) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}} Jul 03 09:45:38.350982 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.linuxscsi [None req-7f8b3484-81fc-4e9e-84e6-f701b522ee42 tempest-VolumesBackupsTest-118275719 None] Device paths {'sde'} have been removed from multipathd monitoring. {{(pid=101319) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}} Jul 03 09:45:38.351221 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-7f8b3484-81fc-4e9e-84e6-f701b522ee42 tempest-VolumesBackupsTest-118275719 None] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-b86cbab3-7c42-409e-b4f6-0ed61267a031')] {{(pid=101319) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1225}} Jul 03 09:45:38.361817 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-7f8b3484-81fc-4e9e-84e6-f701b522ee42 tempest-VolumesBackupsTest-118275719 None] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=101319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 03 09:45:38.396639 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-7f8b3484-81fc-4e9e-84e6-f701b522ee42 tempest-VolumesBackupsTest-118275719 None] iscsiadm ('--logout',): stdout=Logging out of session [sid: 105, target: iqn.2023-03.storpool.com:os--volume-b86cbab3-7c42-409e-b4f6-0ed61267a031, portal: 192.168.40.100,3260] Jul 03 09:45:38.396639 np0000004400 cinder-backup[101319]: Logout of [sid: 105, target: iqn.2023-03.storpool.com:os--volume-b86cbab3-7c42-409e-b4f6-0ed61267a031, portal: 192.168.40.100,3260] successful. Jul 03 09:45:38.396639 np0000004400 cinder-backup[101319]: stderr= {{(pid=101319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 03 09:45:38.416990 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-7f8b3484-81fc-4e9e-84e6-f701b522ee42 tempest-VolumesBackupsTest-118275719 None] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=101319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 03 09:45:38.417313 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.base [None req-7f8b3484-81fc-4e9e-84e6-f701b522ee42 tempest-VolumesBackupsTest-118275719 None] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.206s {{(pid=101319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jul 03 09:45:38.417515 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-7f8b3484-81fc-4e9e-84e6-f701b522ee42 tempest-VolumesBackupsTest-118275719 None] <== disconnect_volume: return (207ms) None {{(pid=101319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}} Jul 03 09:45:38.517769 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-39edf0dd-1bcf-42e2-baa1-b2115392f537 tempest-ProjectAdminTests33-1900627284 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101319) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 09:45:38.517923 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-39edf0dd-1bcf-42e2-baa1-b2115392f537 tempest-ProjectAdminTests33-1900627284 None] About to put_object {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 09:45:38.521242 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-327bc060-a9c1-4783-a969-79ebb1b84e7c tempest-VolumesBackupsTest-2142009639 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101319) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 09:45:38.521372 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-327bc060-a9c1-4783-a969-79ebb1b84e7c tempest-VolumesBackupsTest-2142009639 None] About to put_object {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 09:45:38.627764 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-39edf0dd-1bcf-42e2-baa1-b2115392f537 tempest-ProjectAdminTests33-1900627284 None] backup MD5 for volume_4b68dad5-e9a3-4bd1-84e2-ba745cb7bb83/20260703094525/az_nova_backup_3d538c5e-b79f-4328-82e9-e76f89c22158-00016: 25e317773f308e446cc84c503a6d1f85 {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 09:45:38.627881 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-39edf0dd-1bcf-42e2-baa1-b2115392f537 tempest-ProjectAdminTests33-1900627284 None] Calling eventlet.sleep(0) {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 09:45:38.631061 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-327bc060-a9c1-4783-a969-79ebb1b84e7c tempest-VolumesBackupsTest-2142009639 None] backup MD5 for volume_b1fc0d58-7747-4bcf-99a7-fb482aacb945/20260703094530/az_nova_backup_e353b2b2-ecff-4fe0-8148-bf9d1d84a8bf-00009: 25e317773f308e446cc84c503a6d1f85 {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 09:45:38.631162 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-327bc060-a9c1-4783-a969-79ebb1b84e7c tempest-VolumesBackupsTest-2142009639 None] Calling eventlet.sleep(0) {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 09:45:38.914660 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-39edf0dd-1bcf-42e2-baa1-b2115392f537 tempest-ProjectAdminTests33-1900627284 None] Backing up chunk of data from volume. {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 09:45:38.916300 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-327bc060-a9c1-4783-a969-79ebb1b84e7c tempest-VolumesBackupsTest-2142009639 None] Backing up chunk of data from volume. {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 09:45:39.161175 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-39edf0dd-1bcf-42e2-baa1-b2115392f537 tempest-ProjectAdminTests33-1900627284 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101319) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 09:45:39.161424 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-39edf0dd-1bcf-42e2-baa1-b2115392f537 tempest-ProjectAdminTests33-1900627284 None] About to put_object {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 09:45:39.161867 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-327bc060-a9c1-4783-a969-79ebb1b84e7c tempest-VolumesBackupsTest-2142009639 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101319) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 09:45:39.162002 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-327bc060-a9c1-4783-a969-79ebb1b84e7c tempest-VolumesBackupsTest-2142009639 None] About to put_object {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 09:45:39.271155 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-327bc060-a9c1-4783-a969-79ebb1b84e7c tempest-VolumesBackupsTest-2142009639 None] backup MD5 for volume_b1fc0d58-7747-4bcf-99a7-fb482aacb945/20260703094530/az_nova_backup_e353b2b2-ecff-4fe0-8148-bf9d1d84a8bf-00010: 25e317773f308e446cc84c503a6d1f85 {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 09:45:39.271438 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-327bc060-a9c1-4783-a969-79ebb1b84e7c tempest-VolumesBackupsTest-2142009639 None] Calling eventlet.sleep(0) {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 09:45:39.272957 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-39edf0dd-1bcf-42e2-baa1-b2115392f537 tempest-ProjectAdminTests33-1900627284 None] backup MD5 for volume_4b68dad5-e9a3-4bd1-84e2-ba745cb7bb83/20260703094525/az_nova_backup_3d538c5e-b79f-4328-82e9-e76f89c22158-00017: 25e317773f308e446cc84c503a6d1f85 {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 09:45:39.272957 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-39edf0dd-1bcf-42e2-baa1-b2115392f537 tempest-ProjectAdminTests33-1900627284 None] Calling eventlet.sleep(0) {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 09:45:39.429752 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.manager [None req-7f8b3484-81fc-4e9e-84e6-f701b522ee42 tempest-VolumesBackupsTest-118275719 None] Encryption key ID for volume b86cbab3-7c42-409e-b4f6-0ed61267a031 already matches encryption key ID in backup 435094a5-f336-4be4-826b-fa363af35296. {{(pid=101319) _run_restore /opt/stack/cinder/cinder/backup/manager.py:873}} Jul 03 09:45:39.443611 np0000004400 cinder-backup[101319]: INFO cinder.backup.manager [None req-7f8b3484-81fc-4e9e-84e6-f701b522ee42 tempest-VolumesBackupsTest-118275719 None] Finished restoring backup 435094a5-f336-4be4-826b-fa363af35296 to volume b86cbab3-7c42-409e-b4f6-0ed61267a031. Jul 03 09:45:39.547813 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-39edf0dd-1bcf-42e2-baa1-b2115392f537 tempest-ProjectAdminTests33-1900627284 None] Backing up chunk of data from volume. {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 09:45:39.560872 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-327bc060-a9c1-4783-a969-79ebb1b84e7c tempest-VolumesBackupsTest-2142009639 None] Backing up chunk of data from volume. {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 09:45:39.796394 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-39edf0dd-1bcf-42e2-baa1-b2115392f537 tempest-ProjectAdminTests33-1900627284 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101319) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 09:45:39.796536 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-39edf0dd-1bcf-42e2-baa1-b2115392f537 tempest-ProjectAdminTests33-1900627284 None] About to put_object {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 09:45:39.817335 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-327bc060-a9c1-4783-a969-79ebb1b84e7c tempest-VolumesBackupsTest-2142009639 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101319) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 09:45:39.817478 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-327bc060-a9c1-4783-a969-79ebb1b84e7c tempest-VolumesBackupsTest-2142009639 None] About to put_object {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 09:45:39.904393 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-39edf0dd-1bcf-42e2-baa1-b2115392f537 tempest-ProjectAdminTests33-1900627284 None] backup MD5 for volume_4b68dad5-e9a3-4bd1-84e2-ba745cb7bb83/20260703094525/az_nova_backup_3d538c5e-b79f-4328-82e9-e76f89c22158-00018: 25e317773f308e446cc84c503a6d1f85 {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 09:45:39.904567 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-39edf0dd-1bcf-42e2-baa1-b2115392f537 tempest-ProjectAdminTests33-1900627284 None] Calling eventlet.sleep(0) {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 09:45:39.918705 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-327bc060-a9c1-4783-a969-79ebb1b84e7c tempest-VolumesBackupsTest-2142009639 None] backup MD5 for volume_b1fc0d58-7747-4bcf-99a7-fb482aacb945/20260703094530/az_nova_backup_e353b2b2-ecff-4fe0-8148-bf9d1d84a8bf-00011: 25e317773f308e446cc84c503a6d1f85 {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 09:45:39.918705 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-327bc060-a9c1-4783-a969-79ebb1b84e7c tempest-VolumesBackupsTest-2142009639 None] Calling eventlet.sleep(0) {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 09:45:39.937834 np0000004400 cinder-backup[101319]: INFO cinder.backup.manager [None req-4101c1d9-2380-48d7-a652-77c81d76aaff tempest-VolumesBackupsTest-118275719 None] Delete backup started, backup: 435094a5-f336-4be4-826b-fa363af35296. Jul 03 09:45:39.939819 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.drivers.swift [None req-4101c1d9-2380-48d7-a652-77c81d76aaff tempest-VolumesBackupsTest-118275719 None] Using swift URL https://10.4.3.95:8080/v1/AUTH_a484ec9218bf417bb9d7575ae6370646 {{(pid=101319) initialize /opt/stack/cinder/cinder/backup/drivers/swift.py:300}} Jul 03 09:45:39.939819 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.drivers.swift [None req-4101c1d9-2380-48d7-a652-77c81d76aaff tempest-VolumesBackupsTest-118275719 None] Connect to https://10.4.3.95:8080/v1/AUTH_ in "per_user" mode {{(pid=101319) initialize /opt/stack/cinder/cinder/backup/drivers/swift.py:301}} Jul 03 09:45:39.940146 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-4101c1d9-2380-48d7-a652-77c81d76aaff tempest-VolumesBackupsTest-118275719 None] delete started, backup: 435094a5-f336-4be4-826b-fa363af35296, container: volumebackups, prefix: volume_b86cbab3-7c42-409e-b4f6-0ed61267a031/20260703094514/az_nova_backup_435094a5-f336-4be4-826b-fa363af35296. {{(pid=101319) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:822}} Jul 03 09:45:39.975122 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-4101c1d9-2380-48d7-a652-77c81d76aaff tempest-VolumesBackupsTest-118275719 None] generated object list: ['volume_b86cbab3-7c42-409e-b4f6-0ed61267a031/20260703094514/az_nova_backup_435094a5-f336-4be4-826b-fa363af35296_metadata', 'volume_b86cbab3-7c42-409e-b4f6-0ed61267a031/20260703094514/az_nova_backup_435094a5-f336-4be4-826b-fa363af35296_sha256file']. {{(pid=101319) _generate_object_names /opt/stack/cinder/cinder/backup/chunkeddriver.py:260}} Jul 03 09:45:39.996762 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-4101c1d9-2380-48d7-a652-77c81d76aaff tempest-VolumesBackupsTest-118275719 None] deleted object: volume_b86cbab3-7c42-409e-b4f6-0ed61267a031/20260703094514/az_nova_backup_435094a5-f336-4be4-826b-fa363af35296_metadata in container: volumebackups. {{(pid=101319) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 09:45:40.024244 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-4101c1d9-2380-48d7-a652-77c81d76aaff tempest-VolumesBackupsTest-118275719 None] deleted object: volume_b86cbab3-7c42-409e-b4f6-0ed61267a031/20260703094514/az_nova_backup_435094a5-f336-4be4-826b-fa363af35296_sha256file in container: volumebackups. {{(pid=101319) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 09:45:40.024568 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-4101c1d9-2380-48d7-a652-77c81d76aaff tempest-VolumesBackupsTest-118275719 None] delete 435094a5-f336-4be4-826b-fa363af35296 finished. {{(pid=101319) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:848}} Jul 03 09:45:40.060450 np0000004400 cinder-backup[101319]: DEBUG oslo_db.sqlalchemy.engines [None req-4101c1d9-2380-48d7-a652-77c81d76aaff tempest-VolumesBackupsTest-118275719 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=101319) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 03 09:45:40.087709 np0000004400 cinder-backup[101319]: DEBUG cinder.quota [None req-4101c1d9-2380-48d7-a652-77c81d76aaff tempest-VolumesBackupsTest-118275719 None] Created reservations ['c36170c3-0559-4f54-b6d5-ba969eae7d55', 'a0609f7d-9872-41ae-89c7-a4776aae8a01'] {{(pid=101319) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 09:45:40.117467 np0000004400 cinder-backup[101319]: INFO cinder.backup.manager [None req-4101c1d9-2380-48d7-a652-77c81d76aaff tempest-VolumesBackupsTest-118275719 None] Delete backup finished, backup 435094a5-f336-4be4-826b-fa363af35296 deleted. Jul 03 09:45:40.198966 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-39edf0dd-1bcf-42e2-baa1-b2115392f537 tempest-ProjectAdminTests33-1900627284 None] Backing up chunk of data from volume. {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 09:45:40.205871 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-327bc060-a9c1-4783-a969-79ebb1b84e7c tempest-VolumesBackupsTest-2142009639 None] Backing up chunk of data from volume. {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 09:45:40.360431 np0000004400 cinder-backup[101319]: DEBUG oslo_service.periodic_task [None req-ffd932d2-122c-4e68-b5ba-628aff7ae7b8 None None] Running periodic task BackupManager.publish_service_capabilities {{(pid=101319) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 03 09:45:40.360527 np0000004400 cinder-backup[101319]: DEBUG cinder.manager [None req-ffd932d2-122c-4e68-b5ba-628aff7ae7b8 None None] Notifying Schedulers of capabilities ... {{(pid=101319) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 03 09:45:40.441054 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-39edf0dd-1bcf-42e2-baa1-b2115392f537 tempest-ProjectAdminTests33-1900627284 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101319) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 09:45:40.441175 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-39edf0dd-1bcf-42e2-baa1-b2115392f537 tempest-ProjectAdminTests33-1900627284 None] About to put_object {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 09:45:40.443624 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-327bc060-a9c1-4783-a969-79ebb1b84e7c tempest-VolumesBackupsTest-2142009639 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101319) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 09:45:40.443822 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-327bc060-a9c1-4783-a969-79ebb1b84e7c tempest-VolumesBackupsTest-2142009639 None] About to put_object {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 09:45:40.550926 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-39edf0dd-1bcf-42e2-baa1-b2115392f537 tempest-ProjectAdminTests33-1900627284 None] backup MD5 for volume_4b68dad5-e9a3-4bd1-84e2-ba745cb7bb83/20260703094525/az_nova_backup_3d538c5e-b79f-4328-82e9-e76f89c22158-00019: 25e317773f308e446cc84c503a6d1f85 {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 09:45:40.551083 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-39edf0dd-1bcf-42e2-baa1-b2115392f537 tempest-ProjectAdminTests33-1900627284 None] Calling eventlet.sleep(0) {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 09:45:40.555055 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-327bc060-a9c1-4783-a969-79ebb1b84e7c tempest-VolumesBackupsTest-2142009639 None] backup MD5 for volume_b1fc0d58-7747-4bcf-99a7-fb482aacb945/20260703094530/az_nova_backup_e353b2b2-ecff-4fe0-8148-bf9d1d84a8bf-00012: 25e317773f308e446cc84c503a6d1f85 {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 09:45:40.555226 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-327bc060-a9c1-4783-a969-79ebb1b84e7c tempest-VolumesBackupsTest-2142009639 None] Calling eventlet.sleep(0) {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 09:45:40.829349 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-39edf0dd-1bcf-42e2-baa1-b2115392f537 tempest-ProjectAdminTests33-1900627284 None] Backing up chunk of data from volume. {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 09:45:40.863214 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-327bc060-a9c1-4783-a969-79ebb1b84e7c tempest-VolumesBackupsTest-2142009639 None] Backing up chunk of data from volume. {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 09:45:41.018425 np0000004400 cinder-backup[101319]: INFO cinder.backup.manager [None req-d928b2e9-cd2a-4f87-a3f8-a0de2f32bcd1 tempest-VolumesBackupsTest-118275719 None] Delete backup started, backup: 3087847d-58e1-4a0c-af9c-2639ae9f2aeb. Jul 03 09:45:41.022192 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.drivers.swift [None req-d928b2e9-cd2a-4f87-a3f8-a0de2f32bcd1 tempest-VolumesBackupsTest-118275719 None] Using swift URL https://10.4.3.95:8080/v1/AUTH_a484ec9218bf417bb9d7575ae6370646 {{(pid=101319) initialize /opt/stack/cinder/cinder/backup/drivers/swift.py:300}} Jul 03 09:45:41.022192 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.drivers.swift [None req-d928b2e9-cd2a-4f87-a3f8-a0de2f32bcd1 tempest-VolumesBackupsTest-118275719 None] Connect to https://10.4.3.95:8080/v1/AUTH_ in "per_user" mode {{(pid=101319) initialize /opt/stack/cinder/cinder/backup/drivers/swift.py:301}} Jul 03 09:45:41.022577 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-d928b2e9-cd2a-4f87-a3f8-a0de2f32bcd1 tempest-VolumesBackupsTest-118275719 None] delete started, backup: 3087847d-58e1-4a0c-af9c-2639ae9f2aeb, container: volumebackups, prefix: volume_b86cbab3-7c42-409e-b4f6-0ed61267a031/20260703094455/az_nova_backup_3087847d-58e1-4a0c-af9c-2639ae9f2aeb. {{(pid=101319) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:822}} Jul 03 09:45:41.086084 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-d928b2e9-cd2a-4f87-a3f8-a0de2f32bcd1 tempest-VolumesBackupsTest-118275719 None] generated object list: ['volume_b86cbab3-7c42-409e-b4f6-0ed61267a031/20260703094455/az_nova_backup_3087847d-58e1-4a0c-af9c-2639ae9f2aeb-00001', 'volume_b86cbab3-7c42-409e-b4f6-0ed61267a031/20260703094455/az_nova_backup_3087847d-58e1-4a0c-af9c-2639ae9f2aeb-00002', 'volume_b86cbab3-7c42-409e-b4f6-0ed61267a031/20260703094455/az_nova_backup_3087847d-58e1-4a0c-af9c-2639ae9f2aeb-00003', 'volume_b86cbab3-7c42-409e-b4f6-0ed61267a031/20260703094455/az_nova_backup_3087847d-58e1-4a0c-af9c-2639ae9f2aeb-00004', 'volume_b86cbab3-7c42-409e-b4f6-0ed61267a031/20260703094455/az_nova_backup_3087847d-58e1-4a0c-af9c-2639ae9f2aeb-00005', 'volume_b86cbab3-7c42-409e-b4f6-0ed61267a031/20260703094455/az_nova_backup_3087847d-58e1-4a0c-af9c-2639ae9f2aeb-00006', 'volume_b86cbab3-7c42-409e-b4f6-0ed61267a031/20260703094455/az_nova_backup_3087847d-58e1-4a0c-af9c-2639ae9f2aeb-00007', 'volume_b86cbab3-7c42-409e-b4f6-0ed61267a031/20260703094455/az_nova_backup_3087847d-58e1-4a0c-af9c-2639ae9f2aeb-00008', 'volume_b86cbab3-7c42-409e-b4f6-0ed61267a031/20260703094455/az_nova_backup_3087847d-58e1-4a0c-af9c-2639ae9f2aeb-00009', 'volume_b86cbab3-7c42-409e-b4f6-0ed61267a031/20260703094455/az_nova_backup_3087847d-58e1-4a0c-af9c-2639ae9f2aeb-00010', 'volume_b86cbab3-7c42-409e-b4f6-0ed61267a031/20260703094455/az_nova_backup_3087847d-58e1-4a0c-af9c-2639ae9f2aeb-00011', 'volume_b86cbab3-7c42-409e-b4f6-0ed61267a031/20260703094455/az_nova_backup_3087847d-58e1-4a0c-af9c-2639ae9f2aeb-00012', 'volume_b86cbab3-7c42-409e-b4f6-0ed61267a031/20260703094455/az_nova_backup_3087847d-58e1-4a0c-af9c-2639ae9f2aeb-00013', 'volume_b86cbab3-7c42-409e-b4f6-0ed61267a031/20260703094455/az_nova_backup_3087847d-58e1-4a0c-af9c-2639ae9f2aeb-00014', 'volume_b86cbab3-7c42-409e-b4f6-0ed61267a031/20260703094455/az_nova_backup_3087847d-58e1-4a0c-af9c-2639ae9f2aeb-00015', 'volume_b86cbab3-7c42-409e-b4f6-0ed61267a031/20260703094455/az_nova_backup_3087847d-58e1-4a0c-af9c-2639ae9f2aeb-00016', 'volume_b86cbab3-7c42-409e-b4f6-0ed61267a031/20260703094455/az_nova_backup_3087847d-58e1-4a0c-af9c-2639ae9f2aeb-00017', 'volume_b86cbab3-7c42-409e-b4f6-0ed61267a031/20260703094455/az_nova_backup_3087847d-58e1-4a0c-af9c-2639ae9f2aeb-00018', 'volume_b86cbab3-7c42-409e-b4f6-0ed61267a031/20260703094455/az_nova_backup_3087847d-58e1-4a0c-af9c-2639ae9f2aeb-00019', 'volume_b86cbab3-7c42-409e-b4f6-0ed61267a031/20260703094455/az_nova_backup_3087847d-58e1-4a0c-af9c-2639ae9f2aeb-00020', 'volume_b86cbab3-7c42-409e-b4f6-0ed61267a031/20260703094455/az_nova_backup_3087847d-58e1-4a0c-af9c-2639ae9f2aeb-00021', 'volume_b86cbab3-7c42-409e-b4f6-0ed61267a031/20260703094455/az_nova_backup_3087847d-58e1-4a0c-af9c-2639ae9f2aeb_metadata', 'volume_b86cbab3-7c42-409e-b4f6-0ed61267a031/20260703094455/az_nova_backup_3087847d-58e1-4a0c-af9c-2639ae9f2aeb_sha256file']. {{(pid=101319) _generate_object_names /opt/stack/cinder/cinder/backup/chunkeddriver.py:260}} Jul 03 09:45:41.100378 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-39edf0dd-1bcf-42e2-baa1-b2115392f537 tempest-ProjectAdminTests33-1900627284 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101319) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 09:45:41.101479 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-39edf0dd-1bcf-42e2-baa1-b2115392f537 tempest-ProjectAdminTests33-1900627284 None] About to put_object {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 09:45:41.116572 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-d928b2e9-cd2a-4f87-a3f8-a0de2f32bcd1 tempest-VolumesBackupsTest-118275719 None] deleted object: volume_b86cbab3-7c42-409e-b4f6-0ed61267a031/20260703094455/az_nova_backup_3087847d-58e1-4a0c-af9c-2639ae9f2aeb-00001 in container: volumebackups. {{(pid=101319) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 09:45:41.120590 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-327bc060-a9c1-4783-a969-79ebb1b84e7c tempest-VolumesBackupsTest-2142009639 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101319) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 09:45:41.120800 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-327bc060-a9c1-4783-a969-79ebb1b84e7c tempest-VolumesBackupsTest-2142009639 None] About to put_object {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 09:45:41.146603 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-d928b2e9-cd2a-4f87-a3f8-a0de2f32bcd1 tempest-VolumesBackupsTest-118275719 None] deleted object: volume_b86cbab3-7c42-409e-b4f6-0ed61267a031/20260703094455/az_nova_backup_3087847d-58e1-4a0c-af9c-2639ae9f2aeb-00002 in container: volumebackups. {{(pid=101319) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 09:45:41.168033 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-d928b2e9-cd2a-4f87-a3f8-a0de2f32bcd1 tempest-VolumesBackupsTest-118275719 None] deleted object: volume_b86cbab3-7c42-409e-b4f6-0ed61267a031/20260703094455/az_nova_backup_3087847d-58e1-4a0c-af9c-2639ae9f2aeb-00003 in container: volumebackups. {{(pid=101319) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 09:45:41.192454 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-d928b2e9-cd2a-4f87-a3f8-a0de2f32bcd1 tempest-VolumesBackupsTest-118275719 None] deleted object: volume_b86cbab3-7c42-409e-b4f6-0ed61267a031/20260703094455/az_nova_backup_3087847d-58e1-4a0c-af9c-2639ae9f2aeb-00004 in container: volumebackups. {{(pid=101319) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 09:45:41.212689 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-d928b2e9-cd2a-4f87-a3f8-a0de2f32bcd1 tempest-VolumesBackupsTest-118275719 None] deleted object: volume_b86cbab3-7c42-409e-b4f6-0ed61267a031/20260703094455/az_nova_backup_3087847d-58e1-4a0c-af9c-2639ae9f2aeb-00005 in container: volumebackups. {{(pid=101319) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 09:45:41.230336 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-39edf0dd-1bcf-42e2-baa1-b2115392f537 tempest-ProjectAdminTests33-1900627284 None] backup MD5 for volume_4b68dad5-e9a3-4bd1-84e2-ba745cb7bb83/20260703094525/az_nova_backup_3d538c5e-b79f-4328-82e9-e76f89c22158-00020: 25e317773f308e446cc84c503a6d1f85 {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 09:45:41.230705 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-39edf0dd-1bcf-42e2-baa1-b2115392f537 tempest-ProjectAdminTests33-1900627284 None] Calling eventlet.sleep(0) {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 09:45:41.266280 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-d928b2e9-cd2a-4f87-a3f8-a0de2f32bcd1 tempest-VolumesBackupsTest-118275719 None] deleted object: volume_b86cbab3-7c42-409e-b4f6-0ed61267a031/20260703094455/az_nova_backup_3087847d-58e1-4a0c-af9c-2639ae9f2aeb-00006 in container: volumebackups. {{(pid=101319) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 09:45:41.267864 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-327bc060-a9c1-4783-a969-79ebb1b84e7c tempest-VolumesBackupsTest-2142009639 None] backup MD5 for volume_b1fc0d58-7747-4bcf-99a7-fb482aacb945/20260703094530/az_nova_backup_e353b2b2-ecff-4fe0-8148-bf9d1d84a8bf-00013: 25e317773f308e446cc84c503a6d1f85 {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 09:45:41.268012 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-327bc060-a9c1-4783-a969-79ebb1b84e7c tempest-VolumesBackupsTest-2142009639 None] Calling eventlet.sleep(0) {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 09:45:41.299864 np0000004400 cinder-backup[101319]: DEBUG oslo_db.sqlalchemy.engines [None req-39edf0dd-1bcf-42e2-baa1-b2115392f537 tempest-ProjectAdminTests33-1900627284 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=101319) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 03 09:45:41.312654 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-d928b2e9-cd2a-4f87-a3f8-a0de2f32bcd1 tempest-VolumesBackupsTest-118275719 None] deleted object: volume_b86cbab3-7c42-409e-b4f6-0ed61267a031/20260703094455/az_nova_backup_3087847d-58e1-4a0c-af9c-2639ae9f2aeb-00007 in container: volumebackups. {{(pid=101319) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 09:45:41.346105 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-d928b2e9-cd2a-4f87-a3f8-a0de2f32bcd1 tempest-VolumesBackupsTest-118275719 None] deleted object: volume_b86cbab3-7c42-409e-b4f6-0ed61267a031/20260703094455/az_nova_backup_3087847d-58e1-4a0c-af9c-2639ae9f2aeb-00008 in container: volumebackups. {{(pid=101319) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 09:45:41.370760 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-d928b2e9-cd2a-4f87-a3f8-a0de2f32bcd1 tempest-VolumesBackupsTest-118275719 None] deleted object: volume_b86cbab3-7c42-409e-b4f6-0ed61267a031/20260703094455/az_nova_backup_3087847d-58e1-4a0c-af9c-2639ae9f2aeb-00009 in container: volumebackups. {{(pid=101319) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 09:45:41.400116 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-d928b2e9-cd2a-4f87-a3f8-a0de2f32bcd1 tempest-VolumesBackupsTest-118275719 None] deleted object: volume_b86cbab3-7c42-409e-b4f6-0ed61267a031/20260703094455/az_nova_backup_3087847d-58e1-4a0c-af9c-2639ae9f2aeb-00010 in container: volumebackups. {{(pid=101319) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 09:45:41.438464 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-d928b2e9-cd2a-4f87-a3f8-a0de2f32bcd1 tempest-VolumesBackupsTest-118275719 None] deleted object: volume_b86cbab3-7c42-409e-b4f6-0ed61267a031/20260703094455/az_nova_backup_3087847d-58e1-4a0c-af9c-2639ae9f2aeb-00011 in container: volumebackups. {{(pid=101319) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 09:45:41.456141 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-39edf0dd-1bcf-42e2-baa1-b2115392f537 tempest-ProjectAdminTests33-1900627284 None] Backing up chunk of data from volume. {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 09:45:41.479433 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-d928b2e9-cd2a-4f87-a3f8-a0de2f32bcd1 tempest-VolumesBackupsTest-118275719 None] deleted object: volume_b86cbab3-7c42-409e-b4f6-0ed61267a031/20260703094455/az_nova_backup_3087847d-58e1-4a0c-af9c-2639ae9f2aeb-00012 in container: volumebackups. {{(pid=101319) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 09:45:41.530842 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-d928b2e9-cd2a-4f87-a3f8-a0de2f32bcd1 tempest-VolumesBackupsTest-118275719 None] deleted object: volume_b86cbab3-7c42-409e-b4f6-0ed61267a031/20260703094455/az_nova_backup_3087847d-58e1-4a0c-af9c-2639ae9f2aeb-00013 in container: volumebackups. {{(pid=101319) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 09:45:41.560420 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-d928b2e9-cd2a-4f87-a3f8-a0de2f32bcd1 tempest-VolumesBackupsTest-118275719 None] deleted object: volume_b86cbab3-7c42-409e-b4f6-0ed61267a031/20260703094455/az_nova_backup_3087847d-58e1-4a0c-af9c-2639ae9f2aeb-00014 in container: volumebackups. {{(pid=101319) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 09:45:41.563351 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-327bc060-a9c1-4783-a969-79ebb1b84e7c tempest-VolumesBackupsTest-2142009639 None] Backing up chunk of data from volume. {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 09:45:41.592171 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-d928b2e9-cd2a-4f87-a3f8-a0de2f32bcd1 tempest-VolumesBackupsTest-118275719 None] deleted object: volume_b86cbab3-7c42-409e-b4f6-0ed61267a031/20260703094455/az_nova_backup_3087847d-58e1-4a0c-af9c-2639ae9f2aeb-00015 in container: volumebackups. {{(pid=101319) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 09:45:41.594663 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-39edf0dd-1bcf-42e2-baa1-b2115392f537 tempest-ProjectAdminTests33-1900627284 None] Compressed 25165824 bytes of data to 24470 bytes using zlib. {{(pid=101319) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 09:45:41.596545 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-39edf0dd-1bcf-42e2-baa1-b2115392f537 tempest-ProjectAdminTests33-1900627284 None] About to put_object {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 09:45:41.618770 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-d928b2e9-cd2a-4f87-a3f8-a0de2f32bcd1 tempest-VolumesBackupsTest-118275719 None] deleted object: volume_b86cbab3-7c42-409e-b4f6-0ed61267a031/20260703094455/az_nova_backup_3087847d-58e1-4a0c-af9c-2639ae9f2aeb-00016 in container: volumebackups. {{(pid=101319) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 09:45:41.642089 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-d928b2e9-cd2a-4f87-a3f8-a0de2f32bcd1 tempest-VolumesBackupsTest-118275719 None] deleted object: volume_b86cbab3-7c42-409e-b4f6-0ed61267a031/20260703094455/az_nova_backup_3087847d-58e1-4a0c-af9c-2639ae9f2aeb-00017 in container: volumebackups. {{(pid=101319) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 09:45:41.667447 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-39edf0dd-1bcf-42e2-baa1-b2115392f537 tempest-ProjectAdminTests33-1900627284 None] backup MD5 for volume_4b68dad5-e9a3-4bd1-84e2-ba745cb7bb83/20260703094525/az_nova_backup_3d538c5e-b79f-4328-82e9-e76f89c22158-00021: 77377273b0a4b61febdbf7bbf52b9db9 {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 09:45:41.667619 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-39edf0dd-1bcf-42e2-baa1-b2115392f537 tempest-ProjectAdminTests33-1900627284 None] Calling eventlet.sleep(0) {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 09:45:41.668550 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-d928b2e9-cd2a-4f87-a3f8-a0de2f32bcd1 tempest-VolumesBackupsTest-118275719 None] deleted object: volume_b86cbab3-7c42-409e-b4f6-0ed61267a031/20260703094455/az_nova_backup_3087847d-58e1-4a0c-af9c-2639ae9f2aeb-00018 in container: volumebackups. {{(pid=101319) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 09:45:41.679629 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.driver [None req-39edf0dd-1bcf-42e2-baa1-b2115392f537 tempest-ProjectAdminTests33-1900627284 None] Getting metadata type 'volume-base-metadata' {{(pid=101319) _save_vol_base_meta /opt/stack/cinder/cinder/backup/driver.py:79}} Jul 03 09:45:41.684564 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.driver [None req-39edf0dd-1bcf-42e2-baa1-b2115392f537 tempest-ProjectAdminTests33-1900627284 None] Completed fetching metadata type 'volume-base-metadata' {{(pid=101319) _save_vol_base_meta /opt/stack/cinder/cinder/backup/driver.py:98}} Jul 03 09:45:41.684749 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.driver [None req-39edf0dd-1bcf-42e2-baa1-b2115392f537 tempest-ProjectAdminTests33-1900627284 None] Getting metadata type 'volume-metadata' {{(pid=101319) _save_vol_meta /opt/stack/cinder/cinder/backup/driver.py:109}} Jul 03 09:45:41.688708 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.driver [None req-39edf0dd-1bcf-42e2-baa1-b2115392f537 tempest-ProjectAdminTests33-1900627284 None] No metadata type 'volume-metadata' available {{(pid=101319) _save_vol_meta /opt/stack/cinder/cinder/backup/driver.py:123}} Jul 03 09:45:41.688890 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.driver [None req-39edf0dd-1bcf-42e2-baa1-b2115392f537 tempest-ProjectAdminTests33-1900627284 None] Getting metadata type 'volume-glance-metadata' {{(pid=101319) _save_vol_glance_meta /opt/stack/cinder/cinder/backup/driver.py:132}} Jul 03 09:45:41.692019 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.driver [None req-39edf0dd-1bcf-42e2-baa1-b2115392f537 tempest-ProjectAdminTests33-1900627284 None] No metadata type 'volume-glance-metadata' available {{(pid=101319) _save_vol_glance_meta /opt/stack/cinder/cinder/backup/driver.py:147}} Jul 03 09:45:41.692272 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-39edf0dd-1bcf-42e2-baa1-b2115392f537 tempest-ProjectAdminTests33-1900627284 None] _write_sha256file started, container name: volumebackups, sha256file filename: volume_4b68dad5-e9a3-4bd1-84e2-ba745cb7bb83/20260703094525/az_nova_backup_3d538c5e-b79f-4328-82e9-e76f89c22158_sha256file. {{(pid=101319) _write_sha256file /opt/stack/cinder/cinder/backup/chunkeddriver.py:299}} Jul 03 09:45:41.708810 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-d928b2e9-cd2a-4f87-a3f8-a0de2f32bcd1 tempest-VolumesBackupsTest-118275719 None] deleted object: volume_b86cbab3-7c42-409e-b4f6-0ed61267a031/20260703094455/az_nova_backup_3087847d-58e1-4a0c-af9c-2639ae9f2aeb-00019 in container: volumebackups. {{(pid=101319) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 09:45:41.729626 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-d928b2e9-cd2a-4f87-a3f8-a0de2f32bcd1 tempest-VolumesBackupsTest-118275719 None] deleted object: volume_b86cbab3-7c42-409e-b4f6-0ed61267a031/20260703094455/az_nova_backup_3087847d-58e1-4a0c-af9c-2639ae9f2aeb-00020 in container: volumebackups. {{(pid=101319) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 09:45:41.753316 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-39edf0dd-1bcf-42e2-baa1-b2115392f537 tempest-ProjectAdminTests33-1900627284 None] _write_sha256file finished. {{(pid=101319) _write_sha256file /opt/stack/cinder/cinder/backup/chunkeddriver.py:315}} Jul 03 09:45:41.754230 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-39edf0dd-1bcf-42e2-baa1-b2115392f537 tempest-ProjectAdminTests33-1900627284 None] _write_metadata started, container name: volumebackups, metadata filename: volume_4b68dad5-e9a3-4bd1-84e2-ba745cb7bb83/20260703094525/az_nova_backup_3d538c5e-b79f-4328-82e9-e76f89c22158_metadata. {{(pid=101319) _write_metadata /opt/stack/cinder/cinder/backup/chunkeddriver.py:276}} Jul 03 09:45:41.758871 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-d928b2e9-cd2a-4f87-a3f8-a0de2f32bcd1 tempest-VolumesBackupsTest-118275719 None] deleted object: volume_b86cbab3-7c42-409e-b4f6-0ed61267a031/20260703094455/az_nova_backup_3087847d-58e1-4a0c-af9c-2639ae9f2aeb-00021 in container: volumebackups. {{(pid=101319) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 09:45:41.784165 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-d928b2e9-cd2a-4f87-a3f8-a0de2f32bcd1 tempest-VolumesBackupsTest-118275719 None] deleted object: volume_b86cbab3-7c42-409e-b4f6-0ed61267a031/20260703094455/az_nova_backup_3087847d-58e1-4a0c-af9c-2639ae9f2aeb_metadata in container: volumebackups. {{(pid=101319) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 09:45:41.785675 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-39edf0dd-1bcf-42e2-baa1-b2115392f537 tempest-ProjectAdminTests33-1900627284 None] _write_metadata finished. Metadata: b'{\n "backup_description": null,\n "backup_id": "3d538c5e-b79f-4328-82e9-e76f89c22158",\n "backup_name": null,\n "created_at": "2026-07-03 09:45:23+00:00",\n "objects": [\n {\n "volume_4b68dad5-e9a3-4bd1-84e2-ba745cb7bb83/20260703094525/az_nova_backup_3d538c5e-b79f-4328-82e9-e76f89c22158-00001": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 0\n }\n },\n {\n "volume_4b68dad5-e9a3-4bd1-84e2-ba745cb7bb83/20260703094525/az_nova_backup_3d538c5e-b79f-4328-82e9-e76f89c22158-00002": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 52428800\n }\n },\n {\n "volume_4b68dad5-e9a3-4bd1-84e2-ba745cb7bb83/20260703094525/az_nova_backup_3d538c5e-b79f-4328-82e9-e76f89c22158-00003": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 104857600\n }\n },\n {\n "volume_4b68dad5-e9a3-4bd1-84e2-ba745cb7bb83/20260703094525/az_nova_backup_3d538c5e-b79f-4328-82e9-e76f89c22158-00004": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 157286400\n }\n },\n {\n "volume_4b68dad5-e9a3-4bd1-84e2-ba745cb7bb83/20260703094525/az_nova_backup_3d538c5e-b79f-4328-82e9-e76f89c22158-00005": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 209715200\n }\n },\n {\n "volume_4b68dad5-e9a3-4bd1-84e2-ba745cb7bb83/20260703094525/az_nova_backup_3d538c5e-b79f-4328-82e9-e76f89c22158-00006": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 262144000\n }\n },\n {\n "volume_4b68dad5-e9a3-4bd1-84e2-ba745cb7bb83/20260703094525/az_nova_backup_3d538c5e-b79f-4328-82e9-e76f89c22158-00007": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 314572800\n }\n },\n {\n "volume_4b68dad5-e9a3-4bd1-84e2-ba745cb7bb83/20260703094525/az_nova_backup_3d538c5e-b79f-4328-82e9-e76f89c22158-00008": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 367001600\n }\n },\n {\n "volume_4b68dad5-e9a3-4bd1-84e2-ba745cb7bb83/20260703094525/az_nova_backup_3d538c5e-b79f-4328-82e9-e76f89c22158-00009": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 419430400\n }\n },\n {\n "volume_4b68dad5-e9a3-4bd1-84e2-ba745cb7bb83/20260703094525/az_nova_backup_3d538c5e-b79f-4328-82e9-e76f89c22158-00010": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 471859200\n }\n },\n {\n "volume_4b68dad5-e9a3-4bd1-84e2-ba745cb7bb83/20260703094525/az_nova_backup_3d538c5e-b79f-4328-82e9-e76f89c22158-00011": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 524288000\n }\n },\n {\n "volume_4b68dad5-e9a3-4bd1-84e2-ba745cb7bb83/20260703094525/az_nova_backup_3d538c5e-b79f-4328-82e9-e76f89c22158-00012": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 576716800\n }\n },\n {\n "volume_4b68dad5-e9a3-4bd1-84e2-ba745cb7bb83/20260703094525/az_nova_backup_3d538c5e-b79f-4328-82e9-e76f89c22158-00013": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 629145600\n }\n },\n {\n "volume_4b68dad5-e9a3-4bd1-84e2-ba745cb7bb83/20260703094525/az_nova_backup_3d538c5e-b79f-4328-82e9-e76f89c22158-00014": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 681574400\n }\n },\n {\n "volume_4b68dad5-e9a3-4bd1-84e2-ba745cb7bb83/20260703094525/az_nova_backup_3d538c5e-b79f-4328-82e9-e76f89c22158-00015": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 734003200\n }\n },\n {\n "volume_4b68dad5-e9a3-4bd1-84e2-ba745cb7bb83/20260703094525/az_nova_backup_3d538c5e-b79f-4328-82e9-e76f89c22158-00016": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 786432000\n }\n },\n {\n "volume_4b68dad5-e9a3-4bd1-84e2-ba745cb7bb83/20260703094525/az_nova_backup_3d538c5e-b79f-4328-82e9-e76f89c22158-00017": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 838860800\n }\n },\n {\n "volume_4b68dad5-e9a3-4bd1-84e2-ba745cb7bb83/20260703094525/az_nova_backup_3d538c5e-b79f-4328-82e9-e76f89c22158-00018": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 891289600\n }\n },\n {\n "volume_4b68dad5-e9a3-4bd1-84e2-ba745cb7bb83/20260703094525/az_nova_backup_3d538c5e-b79f-4328-82e9-e76f89c22158-00019": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 943718400\n }\n },\n {\n "volume_4b68dad5-e9a3-4bd1-84e2-ba745cb7bb83/20260703094525/az_nova_backup_3d538c5e-b79f-4328-82e9-e76f89c22158-00020": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 996147200\n }\n },\n {\n "volume_4b68dad5-e9a3-4bd1-84e2-ba745cb7bb83/20260703094525/az_nova_backup_3d538c5e-b79f-4328-82e9-e76f89c22158-00021": {\n "compression": "zlib",\n "length": 25165824,\n "md5": "77377273b0a4b61febdbf7bbf52b9db9",\n "offset": 1048576000\n }\n }\n ],\n "parent_id": null,\n "version": "1.0.0",\n "volume_id": "4b68dad5-e9a3-4bd1-84e2-ba745cb7bb83",\n "volume_meta": "{\\"version\\": 2, \\"volume-base-metadata\\": {\\"id\\": \\"4b68dad5-e9a3-4bd1-84e2-ba745cb7bb83\\", \\"_name_id\\": null, \\"use_quota\\": true, \\"ec2_id\\": null, \\"user_id\\": \\"23ba560f6eed465495956e82c26b6f69\\", \\"project_id\\": \\"a2309d0555a742279b4a5017d94ebf02\\", \\"snapshot_id\\": null, \\"cluster_name\\": null, \\"host\\": \\"np0000004400@storpool#template_virtual\\", \\"size\\": 1, \\"availability_zone\\": \\"nova\\", \\"status\\": \\"backing-up\\", \\"attach_status\\": \\"detached\\", \\"migration_status\\": null, \\"scheduled_at\\": \\"2026-07-03T09:45:00.000000\\", \\"launched_at\\": \\"2026-07-03T09:45:00.000000\\", \\"terminated_at\\": null, \\"display_name\\": \\"tempest-VolumeV3RbacBaseTests-Volume-1547982480\\", \\"display_description\\": null, \\"provider_location\\": null, \\"provider_auth\\": null, \\"provider_geometry\\": null, \\"provider_id\\": null, \\"volume_type_id\\": \\"03e13fe6-0e30-4803-ace0-725d38e6dc24\\", \\"source_volid\\": null, \\"encryption_key_id\\": null, \\"consistencygroup_id\\": null, \\"group_id\\": null, \\"bootable\\": false, \\"multiattach\\": false, \\"replication_status\\": null, \\"replication_extended_status\\": null, \\"replication_driver_data\\": null, \\"previous_status\\": \\"available\\", \\"service_uuid\\": \\"6d4b0e79-fefe-4744-b25f-34be05095200\\", \\"shared_targets\\": true, \\"deleted_at\\": null, \\"deleted\\": false, \\"created_at\\": \\"2026-07-03T09:45:00.000000\\", \\"updated_at\\": \\"2026-07-03T09:45:23.000000\\"}}"\n}'. {{(pid=101319) _write_metadata /opt/stack/cinder/cinder/backup/chunkeddriver.py:295}} Jul 03 09:45:41.805935 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-39edf0dd-1bcf-42e2-baa1-b2115392f537 tempest-ProjectAdminTests33-1900627284 None] backup 3d538c5e-b79f-4328-82e9-e76f89c22158 finished. {{(pid=101319) _finalize_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:462}} Jul 03 09:45:41.938368 np0000004400 cinder-backup[101319]: DEBUG oslo_concurrency.processutils [None req-39edf0dd-1bcf-42e2-baa1-b2115392f537 tempest-ProjectAdminTests33-1900627284 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chown 0 /dev/sdb {{(pid=101319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 09:45:41.949560 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-d928b2e9-cd2a-4f87-a3f8-a0de2f32bcd1 tempest-VolumesBackupsTest-118275719 None] deleted object: volume_b86cbab3-7c42-409e-b4f6-0ed61267a031/20260703094455/az_nova_backup_3087847d-58e1-4a0c-af9c-2639ae9f2aeb_sha256file in container: volumebackups. {{(pid=101319) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 09:45:41.949983 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-327bc060-a9c1-4783-a969-79ebb1b84e7c tempest-VolumesBackupsTest-2142009639 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101319) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 09:45:41.950139 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-327bc060-a9c1-4783-a969-79ebb1b84e7c tempest-VolumesBackupsTest-2142009639 None] About to put_object {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 09:45:41.950452 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-d928b2e9-cd2a-4f87-a3f8-a0de2f32bcd1 tempest-VolumesBackupsTest-118275719 None] delete 3087847d-58e1-4a0c-af9c-2639ae9f2aeb finished. {{(pid=101319) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:848}} Jul 03 09:45:41.957440 np0000004400 sudo[137025]: stack : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chown 0 /dev/sdb Jul 03 09:45:41.958069 np0000004400 sudo[137025]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1002) Jul 03 09:45:41.990188 np0000004400 cinder-backup[101319]: DEBUG cinder.quota [None req-d928b2e9-cd2a-4f87-a3f8-a0de2f32bcd1 tempest-VolumesBackupsTest-118275719 None] Created reservations ['4ba7a7b3-67c9-4551-a5e1-bcc1cac3cce8', '738831ef-8922-4100-9aae-fc7a6e54f198'] {{(pid=101319) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 09:45:42.021712 np0000004400 cinder-backup[101319]: INFO cinder.backup.manager [None req-d928b2e9-cd2a-4f87-a3f8-a0de2f32bcd1 tempest-VolumesBackupsTest-118275719 None] Delete backup finished, backup 3087847d-58e1-4a0c-af9c-2639ae9f2aeb deleted. Jul 03 09:45:42.070811 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-327bc060-a9c1-4783-a969-79ebb1b84e7c tempest-VolumesBackupsTest-2142009639 None] backup MD5 for volume_b1fc0d58-7747-4bcf-99a7-fb482aacb945/20260703094530/az_nova_backup_e353b2b2-ecff-4fe0-8148-bf9d1d84a8bf-00014: 25e317773f308e446cc84c503a6d1f85 {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 09:45:42.071066 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-327bc060-a9c1-4783-a969-79ebb1b84e7c tempest-VolumesBackupsTest-2142009639 None] Calling eventlet.sleep(0) {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 09:45:42.276355 np0000004400 sudo[137025]: pam_unix(sudo:session): session closed for user root Jul 03 09:45:42.278001 np0000004400 cinder-backup[101319]: DEBUG oslo_concurrency.processutils [None req-39edf0dd-1bcf-42e2-baa1-b2115392f537 tempest-ProjectAdminTests33-1900627284 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chown 0 /dev/sdb" returned: 0 in 0.340s {{(pid=101319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 09:45:42.278565 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-39edf0dd-1bcf-42e2-baa1-b2115392f537 tempest-ProjectAdminTests33-1900627284 None] ==> disconnect_volume: call "{'args': (, {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-4b68dad5-e9a3-4bd1-84e2-ba745cb7bb83', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '4b68dad5-e9a3-4bd1-84e2-ba745cb7bb83', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': False}, {'type': 'block', 'scsi_wwn': '1StorPooliSCSI_DISK_1034578903445799024', 'path': '/dev/sdb'}), 'kwargs': {'force': True, 'ignore_errors': True}}" {{(pid=101319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}} Jul 03 09:45:42.278999 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.base [None req-39edf0dd-1bcf-42e2-baa1-b2115392f537 tempest-ProjectAdminTests33-1900627284 None] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=101319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jul 03 09:45:42.279326 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.base [None req-39edf0dd-1bcf-42e2-baa1-b2115392f537 tempest-ProjectAdminTests33-1900627284 None] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=101319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jul 03 09:45:42.279693 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-39edf0dd-1bcf-42e2-baa1-b2115392f537 tempest-ProjectAdminTests33-1900627284 None] _get_connection_devices called with parameters: connection_properties={'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-4b68dad5-e9a3-4bd1-84e2-ba745cb7bb83', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '4b68dad5-e9a3-4bd1-84e2-ba745cb7bb83', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': False}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=101319) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:847}} Jul 03 09:45:42.287287 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-327bc060-a9c1-4783-a969-79ebb1b84e7c tempest-VolumesBackupsTest-2142009639 None] Backing up chunk of data from volume. {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 09:45:42.292285 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-39edf0dd-1bcf-42e2-baa1-b2115392f537 tempest-ProjectAdminTests33-1900627284 None] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS: Jul 03 09:45:42.292285 np0000004400 cinder-backup[101319]: No targets found. Jul 03 09:45:42.292285 np0000004400 cinder-backup[101319]: iSNS: Jul 03 09:45:42.292285 np0000004400 cinder-backup[101319]: No targets found. Jul 03 09:45:42.292285 np0000004400 cinder-backup[101319]: STATIC: Jul 03 09:45:42.292285 np0000004400 cinder-backup[101319]: Target: iqn.2023-03.storpool.com:os--volume-76320525-737e-4f58-8523-63ec9abbdc64 Jul 03 09:45:42.292285 np0000004400 cinder-backup[101319]: Portal: 192.168.50.100:3260,-1 Jul 03 09:45:42.292285 np0000004400 cinder-backup[101319]: Iface Name: default Jul 03 09:45:42.292285 np0000004400 cinder-backup[101319]: Portal: 192.168.40.100:3260,-1 Jul 03 09:45:42.292285 np0000004400 cinder-backup[101319]: Iface Name: default Jul 03 09:45:42.292285 np0000004400 cinder-backup[101319]: Target: iqn.2023-03.storpool.com:os--volume-b2e4f10c-8033-4c54-95a1-dfe45d6357a3 Jul 03 09:45:42.292285 np0000004400 cinder-backup[101319]: Portal: 192.168.50.100:3260,-1 Jul 03 09:45:42.292285 np0000004400 cinder-backup[101319]: Iface Name: default Jul 03 09:45:42.292285 np0000004400 cinder-backup[101319]: Portal: 192.168.40.100:3260,-1 Jul 03 09:45:42.292285 np0000004400 cinder-backup[101319]: Iface Name: default Jul 03 09:45:42.292285 np0000004400 cinder-backup[101319]: Target: iqn.2023-03.storpool.com:os--volume-4b68dad5-e9a3-4bd1-84e2-ba745cb7bb83 Jul 03 09:45:42.292285 np0000004400 cinder-backup[101319]: Portal: 192.168.40.100:3260,-1 Jul 03 09:45:42.292285 np0000004400 cinder-backup[101319]: Iface Name: default Jul 03 09:45:42.292285 np0000004400 cinder-backup[101319]: Target: iqn.2023-03.storpool.com:os--volume-d47f5d2f-dce5-42f7-a693-a654fd702622 Jul 03 09:45:42.292285 np0000004400 cinder-backup[101319]: Portal: 192.168.50.100:3260,-1 Jul 03 09:45:42.292285 np0000004400 cinder-backup[101319]: Iface Name: default Jul 03 09:45:42.292285 np0000004400 cinder-backup[101319]: Portal: 192.168.40.100:3260,-1 Jul 03 09:45:42.292285 np0000004400 cinder-backup[101319]: Iface Name: default Jul 03 09:45:42.292285 np0000004400 cinder-backup[101319]: Target: iqn.2023-03.storpool.com:os--volume-b1fc0d58-7747-4bcf-99a7-fb482aacb945 Jul 03 09:45:42.292285 np0000004400 cinder-backup[101319]: Portal: 192.168.40.100:3260,-1 Jul 03 09:45:42.292285 np0000004400 cinder-backup[101319]: Iface Name: default Jul 03 09:45:42.292285 np0000004400 cinder-backup[101319]: FIRMWARE: Jul 03 09:45:42.292285 np0000004400 cinder-backup[101319]: No targets found. Jul 03 09:45:42.292285 np0000004400 cinder-backup[101319]: stderr= {{(pid=101319) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jul 03 09:45:42.292872 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-39edf0dd-1bcf-42e2-baa1-b2115392f537 tempest-ProjectAdminTests33-1900627284 None] Regex to get portals from discoverydb: ^SENDTARGETS: Jul 03 09:45:42.292872 np0000004400 cinder-backup[101319]: .*?^DiscoveryAddress: 192.168.40.100,3260.*? Jul 03 09:45:42.292872 np0000004400 cinder-backup[101319]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=101319) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:390}} Jul 03 09:45:42.292872 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-39edf0dd-1bcf-42e2-baa1-b2115392f537 tempest-ProjectAdminTests33-1900627284 None] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-4b68dad5-e9a3-4bd1-84e2-ba745cb7bb83', 0)] {{(pid=101319) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:858}} Jul 03 09:45:42.321535 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-39edf0dd-1bcf-42e2-baa1-b2115392f537 tempest-ProjectAdminTests33-1900627284 None] iscsiadm ('-m', 'session'): stdout=tcp: [104] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-4b68dad5-e9a3-4bd1-84e2-ba745cb7bb83 (non-flash) Jul 03 09:45:42.321535 np0000004400 cinder-backup[101319]: tcp: [106] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b1fc0d58-7747-4bcf-99a7-fb482aacb945 (non-flash) Jul 03 09:45:42.321535 np0000004400 cinder-backup[101319]: tcp: [49] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b2e4f10c-8033-4c54-95a1-dfe45d6357a3 (non-flash) Jul 03 09:45:42.321535 np0000004400 cinder-backup[101319]: tcp: [50] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b2e4f10c-8033-4c54-95a1-dfe45d6357a3 (non-flash) Jul 03 09:45:42.321535 np0000004400 cinder-backup[101319]: tcp: [82] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-76320525-737e-4f58-8523-63ec9abbdc64 (non-flash) Jul 03 09:45:42.321535 np0000004400 cinder-backup[101319]: tcp: [83] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-76320525-737e-4f58-8523-63ec9abbdc64 (non-flash) Jul 03 09:45:42.321535 np0000004400 cinder-backup[101319]: tcp: [97] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d47f5d2f-dce5-42f7-a693-a654fd702622 (non-flash) Jul 03 09:45:42.321535 np0000004400 cinder-backup[101319]: tcp: [98] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d47f5d2f-dce5-42f7-a693-a654fd702622 (non-flash) Jul 03 09:45:42.321535 np0000004400 cinder-backup[101319]: stderr= {{(pid=101319) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jul 03 09:45:42.321829 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-39edf0dd-1bcf-42e2-baa1-b2115392f537 tempest-ProjectAdminTests33-1900627284 None] iscsi session list stdout=tcp: [104] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-4b68dad5-e9a3-4bd1-84e2-ba745cb7bb83 (non-flash) Jul 03 09:45:42.321829 np0000004400 cinder-backup[101319]: tcp: [106] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b1fc0d58-7747-4bcf-99a7-fb482aacb945 (non-flash) Jul 03 09:45:42.321829 np0000004400 cinder-backup[101319]: tcp: [49] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b2e4f10c-8033-4c54-95a1-dfe45d6357a3 (non-flash) Jul 03 09:45:42.321829 np0000004400 cinder-backup[101319]: tcp: [50] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b2e4f10c-8033-4c54-95a1-dfe45d6357a3 (non-flash) Jul 03 09:45:42.321829 np0000004400 cinder-backup[101319]: tcp: [82] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-76320525-737e-4f58-8523-63ec9abbdc64 (non-flash) Jul 03 09:45:42.321829 np0000004400 cinder-backup[101319]: tcp: [83] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-76320525-737e-4f58-8523-63ec9abbdc64 (non-flash) Jul 03 09:45:42.321829 np0000004400 cinder-backup[101319]: tcp: [97] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d47f5d2f-dce5-42f7-a693-a654fd702622 (non-flash) Jul 03 09:45:42.321829 np0000004400 cinder-backup[101319]: tcp: [98] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d47f5d2f-dce5-42f7-a693-a654fd702622 (non-flash) Jul 03 09:45:42.321829 np0000004400 cinder-backup[101319]: stderr= {{(pid=101319) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jul 03 09:45:42.321829 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-39edf0dd-1bcf-42e2-baa1-b2115392f537 tempest-ProjectAdminTests33-1900627284 None] Sessions list: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-4b68dad5-e9a3-4bd1-84e2-ba745cb7bb83', '104'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-b1fc0d58-7747-4bcf-99a7-fb482aacb945', '106'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-b2e4f10c-8033-4c54-95a1-dfe45d6357a3', '49'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-b2e4f10c-8033-4c54-95a1-dfe45d6357a3', '50'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-76320525-737e-4f58-8523-63ec9abbdc64', '82'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-76320525-737e-4f58-8523-63ec9abbdc64', '83'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-d47f5d2f-dce5-42f7-a693-a654fd702622', '97'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-d47f5d2f-dce5-42f7-a693-a654fd702622', '98')] {{(pid=101319) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:866}} Jul 03 09:45:42.322027 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-39edf0dd-1bcf-42e2-baa1-b2115392f537 tempest-ProjectAdminTests33-1900627284 None] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-4b68dad5-e9a3-4bd1-84e2-ba745cb7bb83, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-4b68dad5-e9a3-4bd1-84e2-ba745cb7bb83', '104')] {{(pid=101319) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}} Jul 03 09:45:42.323007 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-39edf0dd-1bcf-42e2-baa1-b2115392f537 tempest-ProjectAdminTests33-1900627284 None] Resulting device map defaultdict(. at 0x7e76e71a7600>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-4b68dad5-e9a3-4bd1-84e2-ba745cb7bb83'): ({'sdb'}, set())}) {{(pid=101319) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:912}} Jul 03 09:45:42.323291 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.linuxscsi [None req-39edf0dd-1bcf-42e2-baa1-b2115392f537 tempest-ProjectAdminTests33-1900627284 None] Removing single pathed devices sdb {{(pid=101319) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}} Jul 03 09:45:42.340291 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.linuxscsi [None req-39edf0dd-1bcf-42e2-baa1-b2115392f537 tempest-ProjectAdminTests33-1900627284 None] Flushing IO for device /dev/sdb {{(pid=101319) flush_device_io /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:461}} Jul 03 09:45:42.348840 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.linuxscsi [None req-39edf0dd-1bcf-42e2-baa1-b2115392f537 tempest-ProjectAdminTests33-1900627284 None] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=101319) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}} Jul 03 09:45:42.410354 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.linuxscsi [None req-39edf0dd-1bcf-42e2-baa1-b2115392f537 tempest-ProjectAdminTests33-1900627284 None] Checking to see if SCSI volumes sdb have been removed. {{(pid=101319) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}} Jul 03 09:45:42.410646 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.linuxscsi [None req-39edf0dd-1bcf-42e2-baa1-b2115392f537 tempest-ProjectAdminTests33-1900627284 None] SCSI volumes sdb have been removed. {{(pid=101319) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}} Jul 03 09:45:42.413727 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.linuxscsi [None req-39edf0dd-1bcf-42e2-baa1-b2115392f537 tempest-ProjectAdminTests33-1900627284 None] Checking to see if device paths {'sdb'} are still under multipathd monitoring {{(pid=101319) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}} Jul 03 09:45:42.432253 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.linuxscsi [None req-39edf0dd-1bcf-42e2-baa1-b2115392f537 tempest-ProjectAdminTests33-1900627284 None] Device paths {'sdb'} have been removed from multipathd monitoring. {{(pid=101319) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}} Jul 03 09:45:42.432253 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-39edf0dd-1bcf-42e2-baa1-b2115392f537 tempest-ProjectAdminTests33-1900627284 None] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-4b68dad5-e9a3-4bd1-84e2-ba745cb7bb83')] {{(pid=101319) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1225}} Jul 03 09:45:42.443350 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-39edf0dd-1bcf-42e2-baa1-b2115392f537 tempest-ProjectAdminTests33-1900627284 None] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=101319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 03 09:45:42.492901 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-39edf0dd-1bcf-42e2-baa1-b2115392f537 tempest-ProjectAdminTests33-1900627284 None] iscsiadm ('--logout',): stdout=Logging out of session [sid: 104, target: iqn.2023-03.storpool.com:os--volume-4b68dad5-e9a3-4bd1-84e2-ba745cb7bb83, portal: 192.168.40.100,3260] Jul 03 09:45:42.492901 np0000004400 cinder-backup[101319]: Logout of [sid: 104, target: iqn.2023-03.storpool.com:os--volume-4b68dad5-e9a3-4bd1-84e2-ba745cb7bb83, portal: 192.168.40.100,3260] successful. Jul 03 09:45:42.492901 np0000004400 cinder-backup[101319]: stderr= {{(pid=101319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 03 09:45:42.510115 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-39edf0dd-1bcf-42e2-baa1-b2115392f537 tempest-ProjectAdminTests33-1900627284 None] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=101319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 03 09:45:42.510115 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.base [None req-39edf0dd-1bcf-42e2-baa1-b2115392f537 tempest-ProjectAdminTests33-1900627284 None] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.230s {{(pid=101319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jul 03 09:45:42.510115 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-39edf0dd-1bcf-42e2-baa1-b2115392f537 tempest-ProjectAdminTests33-1900627284 None] <== disconnect_volume: return (230ms) None {{(pid=101319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}} Jul 03 09:45:42.532483 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-327bc060-a9c1-4783-a969-79ebb1b84e7c tempest-VolumesBackupsTest-2142009639 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101319) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 09:45:42.532734 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-327bc060-a9c1-4783-a969-79ebb1b84e7c tempest-VolumesBackupsTest-2142009639 None] About to put_object {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 09:45:42.656849 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-327bc060-a9c1-4783-a969-79ebb1b84e7c tempest-VolumesBackupsTest-2142009639 None] backup MD5 for volume_b1fc0d58-7747-4bcf-99a7-fb482aacb945/20260703094530/az_nova_backup_e353b2b2-ecff-4fe0-8148-bf9d1d84a8bf-00015: 25e317773f308e446cc84c503a6d1f85 {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 09:45:42.656849 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-327bc060-a9c1-4783-a969-79ebb1b84e7c tempest-VolumesBackupsTest-2142009639 None] Calling eventlet.sleep(0) {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 09:45:42.873653 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-327bc060-a9c1-4783-a969-79ebb1b84e7c tempest-VolumesBackupsTest-2142009639 None] Backing up chunk of data from volume. {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 09:45:43.127065 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-327bc060-a9c1-4783-a969-79ebb1b84e7c tempest-VolumesBackupsTest-2142009639 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101319) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 09:45:43.127468 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-327bc060-a9c1-4783-a969-79ebb1b84e7c tempest-VolumesBackupsTest-2142009639 None] About to put_object {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 09:45:43.235010 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-327bc060-a9c1-4783-a969-79ebb1b84e7c tempest-VolumesBackupsTest-2142009639 None] backup MD5 for volume_b1fc0d58-7747-4bcf-99a7-fb482aacb945/20260703094530/az_nova_backup_e353b2b2-ecff-4fe0-8148-bf9d1d84a8bf-00016: 25e317773f308e446cc84c503a6d1f85 {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 09:45:43.235209 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-327bc060-a9c1-4783-a969-79ebb1b84e7c tempest-VolumesBackupsTest-2142009639 None] Calling eventlet.sleep(0) {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 09:45:43.428219 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-327bc060-a9c1-4783-a969-79ebb1b84e7c tempest-VolumesBackupsTest-2142009639 None] Backing up chunk of data from volume. {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 09:45:43.556892 np0000004400 cinder-backup[101319]: INFO cinder.backup.manager [None req-39edf0dd-1bcf-42e2-baa1-b2115392f537 tempest-ProjectAdminTests33-1900627284 None] Create backup finished. backup: 3d538c5e-b79f-4328-82e9-e76f89c22158. Jul 03 09:45:43.671451 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-327bc060-a9c1-4783-a969-79ebb1b84e7c tempest-VolumesBackupsTest-2142009639 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101319) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 09:45:43.671648 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-327bc060-a9c1-4783-a969-79ebb1b84e7c tempest-VolumesBackupsTest-2142009639 None] About to put_object {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 09:45:43.684101 np0000004400 cinder-backup[101319]: INFO cinder.backup.manager [None req-6ef928da-3670-4523-823a-3443e2d91692 tempest-VolumesBackupsTest-118275719 None] Create backup started, backup: 8b377d15-3804-4a9c-ad2d-e8e1359c0ee5 volume: 72e07e1e-1567-4071-8204-c29cb26d2660. Jul 03 09:45:43.692770 np0000004400 cinder-backup[101319]: INFO cinder.backup.manager [None req-6ef928da-3670-4523-823a-3443e2d91692 tempest-VolumesBackupsTest-118275719 None] Call Volume Manager to get_backup_device for Backup(availability_zone='nova',container=None,created_at=2026-07-03T09:45:43Z,data_timestamp=2026-07-03T09:45:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesBackupsTest-Backup-1747870483',encryption_key_id=None,fail_reason=None,host='np0000004400',id=8b377d15-3804-4a9c-ad2d-e8e1359c0ee5,metadata={},num_dependent_backups=0,object_count=0,parent=None,parent_id=None,project_id='a484ec9218bf417bb9d7575ae6370646',restore_volume_id=None,service='cinder.backup.drivers.swift.SwiftBackupDriver',service_metadata=None,size=1,snapshot_id=None,status='creating',temp_snapshot_id=None,temp_volume_id=None,updated_at=None,user_id='b861df2a13684334b293b1f348152e37',volume_id=72e07e1e-1567-4071-8204-c29cb26d2660) Jul 03 09:45:43.723049 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.drivers.swift [None req-6ef928da-3670-4523-823a-3443e2d91692 tempest-VolumesBackupsTest-118275719 None] Using swift URL https://10.4.3.95:8080/v1/AUTH_a484ec9218bf417bb9d7575ae6370646 {{(pid=101319) initialize /opt/stack/cinder/cinder/backup/drivers/swift.py:300}} Jul 03 09:45:43.723271 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.drivers.swift [None req-6ef928da-3670-4523-823a-3443e2d91692 tempest-VolumesBackupsTest-118275719 None] Connect to https://10.4.3.95:8080/v1/AUTH_ in "per_user" mode {{(pid=101319) initialize /opt/stack/cinder/cinder/backup/drivers/swift.py:301}} Jul 03 09:45:43.723595 np0000004400 cinder-backup[101319]: DEBUG os_brick.utils [None req-6ef928da-3670-4523-823a-3443e2d91692 tempest-VolumesBackupsTest-118275719 None] ==> get_connector_properties: call "{'root_helper': 'sudo cinder-rootwrap /etc/cinder/rootwrap.conf', 'my_ip': '10.4.3.95', 'multipath': False, 'enforce_multipath': False, 'host': None, 'execute': None}" {{(pid=101319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}} Jul 03 09:45:43.736103 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.scaleio [None req-6ef928da-3670-4523-823a-3443e2d91692 tempest-VolumesBackupsTest-118275719 None] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=101319) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}} Jul 03 09:45:43.757609 np0000004400 cinder-backup[101319]: DEBUG oslo_concurrency.processutils [None req-6ef928da-3670-4523-823a-3443e2d91692 tempest-VolumesBackupsTest-118275719 None] Running cmd (subprocess): nvme version {{(pid=101319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 09:45:43.778312 np0000004400 cinder-backup[101319]: DEBUG oslo_concurrency.processutils [None req-6ef928da-3670-4523-823a-3443e2d91692 tempest-VolumesBackupsTest-118275719 None] 'nvme version' failed. Not Retrying. {{(pid=101319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 03 09:45:43.778699 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.nvmeof [None req-6ef928da-3670-4523-823a-3443e2d91692 tempest-VolumesBackupsTest-118275719 None] nvme not present on system {{(pid=101319) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}} Jul 03 09:45:43.786592 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.lightos [None req-6ef928da-3670-4523-823a-3443e2d91692 tempest-VolumesBackupsTest-118275719 None] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=101319) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}} Jul 03 09:45:43.787992 np0000004400 cinder-backup[101319]: INFO os_brick.initiator.connectors.lightos [None req-6ef928da-3670-4523-823a-3443e2d91692 tempest-VolumesBackupsTest-118275719 None] Current host hostNQN and IP(s) are ['10.4.3.95', 'fe80::f816:3eff:fe47:268c', '192.168.40.6', 'fe80::f816:3eff:febf:7be2', '192.168.50.6', 'fe80::f816:3eff:fe99:8914', '192.168.10.6', 'fe80::f816:3eff:fe2f:e696', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::bc9d:84ff:fec2:6b49', 'fe80::fc16:3eff:fe36:77bf', 'fe80::4c47:1ff:fe64:1879', 'fe80::fc16:3eff:fec6:c223', 'fe80::fc16:3eff:fea0:4147', 'fe80::b0cf:48ff:fe29:caf0', 'fe80::fc16:3eff:fe91:aa0', 'fe80::fc16:3eff:fe3b:46af', 'fe80::28c1:27ff:fe3c:5528'] Jul 03 09:45:43.788152 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.lightos [None req-6ef928da-3670-4523-823a-3443e2d91692 tempest-VolumesBackupsTest-118275719 None] LIGHTOS: did not find dsc, continuing anyway. {{(pid=101319) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}} Jul 03 09:45:43.788318 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.lightos [None req-6ef928da-3670-4523-823a-3443e2d91692 tempest-VolumesBackupsTest-118275719 None] LIGHTOS: no hostnqn found. {{(pid=101319) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}} Jul 03 09:45:43.788635 np0000004400 cinder-backup[101319]: DEBUG os_brick.utils [None req-6ef928da-3670-4523-823a-3443e2d91692 tempest-VolumesBackupsTest-118275719 None] <== get_connector_properties: return (64ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.95', 'host': 'np0000004400', 'multipath': False, 'enforce_multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:ae7e5bb0ebe6', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': '6b284368-d0ba-4d18-af6f-4998d3955c52', 'nvme_native_multipath': False} {{(pid=101319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}} Jul 03 09:45:43.793338 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-327bc060-a9c1-4783-a969-79ebb1b84e7c tempest-VolumesBackupsTest-2142009639 None] backup MD5 for volume_b1fc0d58-7747-4bcf-99a7-fb482aacb945/20260703094530/az_nova_backup_e353b2b2-ecff-4fe0-8148-bf9d1d84a8bf-00017: 25e317773f308e446cc84c503a6d1f85 {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 09:45:43.793479 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-327bc060-a9c1-4783-a969-79ebb1b84e7c tempest-VolumesBackupsTest-2142009639 None] Calling eventlet.sleep(0) {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 09:45:43.840092 np0000004400 cinder-backup[101319]: DEBUG oslo_db.sqlalchemy.engines [None req-327bc060-a9c1-4783-a969-79ebb1b84e7c tempest-VolumesBackupsTest-2142009639 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=101319) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 03 09:45:44.032072 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-327bc060-a9c1-4783-a969-79ebb1b84e7c tempest-VolumesBackupsTest-2142009639 None] Backing up chunk of data from volume. {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 09:45:44.225126 np0000004400 cinder-backup[101319]: INFO cinder.backup.manager [None req-0db52c99-132a-463f-af7e-a012eb1f3d41 tempest-ProjectAdminTests33-1900627284 None] Delete backup started, backup: 3d538c5e-b79f-4328-82e9-e76f89c22158. Jul 03 09:45:44.229812 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.drivers.swift [None req-0db52c99-132a-463f-af7e-a012eb1f3d41 tempest-ProjectAdminTests33-1900627284 None] Using swift URL https://10.4.3.95:8080/v1/AUTH_a2309d0555a742279b4a5017d94ebf02 {{(pid=101319) initialize /opt/stack/cinder/cinder/backup/drivers/swift.py:300}} Jul 03 09:45:44.229812 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.drivers.swift [None req-0db52c99-132a-463f-af7e-a012eb1f3d41 tempest-ProjectAdminTests33-1900627284 None] Connect to https://10.4.3.95:8080/v1/AUTH_ in "per_user" mode {{(pid=101319) initialize /opt/stack/cinder/cinder/backup/drivers/swift.py:301}} Jul 03 09:45:44.229812 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-0db52c99-132a-463f-af7e-a012eb1f3d41 tempest-ProjectAdminTests33-1900627284 None] delete started, backup: 3d538c5e-b79f-4328-82e9-e76f89c22158, container: volumebackups, prefix: volume_4b68dad5-e9a3-4bd1-84e2-ba745cb7bb83/20260703094525/az_nova_backup_3d538c5e-b79f-4328-82e9-e76f89c22158. {{(pid=101319) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:822}} Jul 03 09:45:44.275156 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-327bc060-a9c1-4783-a969-79ebb1b84e7c tempest-VolumesBackupsTest-2142009639 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101319) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 09:45:44.275325 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-327bc060-a9c1-4783-a969-79ebb1b84e7c tempest-VolumesBackupsTest-2142009639 None] About to put_object {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 09:45:44.285240 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-0db52c99-132a-463f-af7e-a012eb1f3d41 tempest-ProjectAdminTests33-1900627284 None] generated object list: ['volume_4b68dad5-e9a3-4bd1-84e2-ba745cb7bb83/20260703094525/az_nova_backup_3d538c5e-b79f-4328-82e9-e76f89c22158-00001', 'volume_4b68dad5-e9a3-4bd1-84e2-ba745cb7bb83/20260703094525/az_nova_backup_3d538c5e-b79f-4328-82e9-e76f89c22158-00002', 'volume_4b68dad5-e9a3-4bd1-84e2-ba745cb7bb83/20260703094525/az_nova_backup_3d538c5e-b79f-4328-82e9-e76f89c22158-00003', 'volume_4b68dad5-e9a3-4bd1-84e2-ba745cb7bb83/20260703094525/az_nova_backup_3d538c5e-b79f-4328-82e9-e76f89c22158-00004', 'volume_4b68dad5-e9a3-4bd1-84e2-ba745cb7bb83/20260703094525/az_nova_backup_3d538c5e-b79f-4328-82e9-e76f89c22158-00005', 'volume_4b68dad5-e9a3-4bd1-84e2-ba745cb7bb83/20260703094525/az_nova_backup_3d538c5e-b79f-4328-82e9-e76f89c22158-00006', 'volume_4b68dad5-e9a3-4bd1-84e2-ba745cb7bb83/20260703094525/az_nova_backup_3d538c5e-b79f-4328-82e9-e76f89c22158-00007', 'volume_4b68dad5-e9a3-4bd1-84e2-ba745cb7bb83/20260703094525/az_nova_backup_3d538c5e-b79f-4328-82e9-e76f89c22158-00008', 'volume_4b68dad5-e9a3-4bd1-84e2-ba745cb7bb83/20260703094525/az_nova_backup_3d538c5e-b79f-4328-82e9-e76f89c22158-00009', 'volume_4b68dad5-e9a3-4bd1-84e2-ba745cb7bb83/20260703094525/az_nova_backup_3d538c5e-b79f-4328-82e9-e76f89c22158-00010', 'volume_4b68dad5-e9a3-4bd1-84e2-ba745cb7bb83/20260703094525/az_nova_backup_3d538c5e-b79f-4328-82e9-e76f89c22158-00011', 'volume_4b68dad5-e9a3-4bd1-84e2-ba745cb7bb83/20260703094525/az_nova_backup_3d538c5e-b79f-4328-82e9-e76f89c22158-00012', 'volume_4b68dad5-e9a3-4bd1-84e2-ba745cb7bb83/20260703094525/az_nova_backup_3d538c5e-b79f-4328-82e9-e76f89c22158-00013', 'volume_4b68dad5-e9a3-4bd1-84e2-ba745cb7bb83/20260703094525/az_nova_backup_3d538c5e-b79f-4328-82e9-e76f89c22158-00014', 'volume_4b68dad5-e9a3-4bd1-84e2-ba745cb7bb83/20260703094525/az_nova_backup_3d538c5e-b79f-4328-82e9-e76f89c22158-00015', 'volume_4b68dad5-e9a3-4bd1-84e2-ba745cb7bb83/20260703094525/az_nova_backup_3d538c5e-b79f-4328-82e9-e76f89c22158-00016', 'volume_4b68dad5-e9a3-4bd1-84e2-ba745cb7bb83/20260703094525/az_nova_backup_3d538c5e-b79f-4328-82e9-e76f89c22158-00017', 'volume_4b68dad5-e9a3-4bd1-84e2-ba745cb7bb83/20260703094525/az_nova_backup_3d538c5e-b79f-4328-82e9-e76f89c22158-00018', 'volume_4b68dad5-e9a3-4bd1-84e2-ba745cb7bb83/20260703094525/az_nova_backup_3d538c5e-b79f-4328-82e9-e76f89c22158-00019', 'volume_4b68dad5-e9a3-4bd1-84e2-ba745cb7bb83/20260703094525/az_nova_backup_3d538c5e-b79f-4328-82e9-e76f89c22158-00020', 'volume_4b68dad5-e9a3-4bd1-84e2-ba745cb7bb83/20260703094525/az_nova_backup_3d538c5e-b79f-4328-82e9-e76f89c22158-00021', 'volume_4b68dad5-e9a3-4bd1-84e2-ba745cb7bb83/20260703094525/az_nova_backup_3d538c5e-b79f-4328-82e9-e76f89c22158_metadata', 'volume_4b68dad5-e9a3-4bd1-84e2-ba745cb7bb83/20260703094525/az_nova_backup_3d538c5e-b79f-4328-82e9-e76f89c22158_sha256file']. {{(pid=101319) _generate_object_names /opt/stack/cinder/cinder/backup/chunkeddriver.py:260}} Jul 03 09:45:44.296578 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connector [None req-6ef928da-3670-4523-823a-3443e2d91692 tempest-VolumesBackupsTest-118275719 None] Factory for iscsi on None {{(pid=101319) factory /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connector.py:243}} Jul 03 09:45:44.296578 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-6ef928da-3670-4523-823a-3443e2d91692 tempest-VolumesBackupsTest-118275719 None] ==> connect_volume: call "{'self': , 'connection_properties': {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-72e07e1e-1567-4071-8204-c29cb26d2660', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '72e07e1e-1567-4071-8204-c29cb26d2660', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': False}}" {{(pid=101319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}} Jul 03 09:45:44.296578 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.base [None req-6ef928da-3670-4523-823a-3443e2d91692 tempest-VolumesBackupsTest-118275719 None] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=101319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jul 03 09:45:44.296578 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.base [None req-6ef928da-3670-4523-823a-3443e2d91692 tempest-VolumesBackupsTest-118275719 None] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.000s {{(pid=101319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jul 03 09:45:44.296578 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.base [None req-6ef928da-3670-4523-823a-3443e2d91692 tempest-VolumesBackupsTest-118275719 None] Connection properties {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-72e07e1e-1567-4071-8204-c29cb26d2660', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '72e07e1e-1567-4071-8204-c29cb26d2660', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': False} {{(pid=101319) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}} Jul 03 09:45:44.306829 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.base [None req-6ef928da-3670-4523-823a-3443e2d91692 tempest-VolumesBackupsTest-118275719 None] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-72e07e1e-1567-4071-8204-c29cb26d2660" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=101319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jul 03 09:45:44.306829 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.base [None req-6ef928da-3670-4523-823a-3443e2d91692 tempest-VolumesBackupsTest-118275719 None] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-72e07e1e-1567-4071-8204-c29cb26d2660" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=101319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jul 03 09:45:44.306829 np0000004400 cinder-backup[101319]: INFO os_brick.initiator.connectors.iscsi [None req-6ef928da-3670-4523-823a-3443e2d91692 tempest-VolumesBackupsTest-118275719 None] Trying to connect to iSCSI portal 192.168.40.100:3260 Jul 03 09:45:44.316497 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-6ef928da-3670-4523-823a-3443e2d91692 tempest-VolumesBackupsTest-118275719 None] iscsiadm (): stdout= stderr=iscsiadm: No records found Jul 03 09:45:44.316497 np0000004400 cinder-backup[101319]: {{(pid=101319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 03 09:45:44.327141 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-6ef928da-3670-4523-823a-3443e2d91692 tempest-VolumesBackupsTest-118275719 None] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-72e07e1e-1567-4071-8204-c29cb26d2660] added Jul 03 09:45:44.327141 np0000004400 cinder-backup[101319]: stderr=iscsiadm: Config file line 363 does not have value Jul 03 09:45:44.327141 np0000004400 cinder-backup[101319]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs' Jul 03 09:45:44.327141 np0000004400 cinder-backup[101319]: iscsiadm: Config file line 363 does not have value Jul 03 09:45:44.327141 np0000004400 cinder-backup[101319]: iscsiadm: Config file line 363 does not have value Jul 03 09:45:44.327141 np0000004400 cinder-backup[101319]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs' Jul 03 09:45:44.327141 np0000004400 cinder-backup[101319]: {{(pid=101319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 03 09:45:44.327141 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-6ef928da-3670-4523-823a-3443e2d91692 tempest-VolumesBackupsTest-118275719 None] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=101319) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}} Jul 03 09:45:44.327563 np0000004400 cinder-backup[101319]: DEBUG os_brick.utils [None req-6ef928da-3670-4523-823a-3443e2d91692 tempest-VolumesBackupsTest-118275719 None] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0208(s), this was the 1st time calling it. {{(pid=101319) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}} Jul 03 09:45:44.327818 np0000004400 cinder-backup[101319]: DEBUG os_brick.utils [None req-6ef928da-3670-4523-823a-3443e2d91692 tempest-VolumesBackupsTest-118275719 None] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=101319) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}} Jul 03 09:45:44.339834 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-0db52c99-132a-463f-af7e-a012eb1f3d41 tempest-ProjectAdminTests33-1900627284 None] deleted object: volume_4b68dad5-e9a3-4bd1-84e2-ba745cb7bb83/20260703094525/az_nova_backup_3d538c5e-b79f-4328-82e9-e76f89c22158-00001 in container: volumebackups. {{(pid=101319) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 09:45:44.363315 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-0db52c99-132a-463f-af7e-a012eb1f3d41 tempest-ProjectAdminTests33-1900627284 None] deleted object: volume_4b68dad5-e9a3-4bd1-84e2-ba745cb7bb83/20260703094525/az_nova_backup_3d538c5e-b79f-4328-82e9-e76f89c22158-00002 in container: volumebackups. {{(pid=101319) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 09:45:44.387229 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-0db52c99-132a-463f-af7e-a012eb1f3d41 tempest-ProjectAdminTests33-1900627284 None] deleted object: volume_4b68dad5-e9a3-4bd1-84e2-ba745cb7bb83/20260703094525/az_nova_backup_3d538c5e-b79f-4328-82e9-e76f89c22158-00003 in container: volumebackups. {{(pid=101319) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 09:45:44.428419 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-0db52c99-132a-463f-af7e-a012eb1f3d41 tempest-ProjectAdminTests33-1900627284 None] deleted object: volume_4b68dad5-e9a3-4bd1-84e2-ba745cb7bb83/20260703094525/az_nova_backup_3d538c5e-b79f-4328-82e9-e76f89c22158-00004 in container: volumebackups. {{(pid=101319) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 09:45:44.429935 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-327bc060-a9c1-4783-a969-79ebb1b84e7c tempest-VolumesBackupsTest-2142009639 None] backup MD5 for volume_b1fc0d58-7747-4bcf-99a7-fb482aacb945/20260703094530/az_nova_backup_e353b2b2-ecff-4fe0-8148-bf9d1d84a8bf-00018: 25e317773f308e446cc84c503a6d1f85 {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 09:45:44.430094 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-327bc060-a9c1-4783-a969-79ebb1b84e7c tempest-VolumesBackupsTest-2142009639 None] Calling eventlet.sleep(0) {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 09:45:44.483691 np0000004400 cinder-backup[101319]: DEBUG oslo_db.sqlalchemy.engines [None req-327bc060-a9c1-4783-a969-79ebb1b84e7c tempest-VolumesBackupsTest-2142009639 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=101319) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 03 09:45:44.514109 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-0db52c99-132a-463f-af7e-a012eb1f3d41 tempest-ProjectAdminTests33-1900627284 None] deleted object: volume_4b68dad5-e9a3-4bd1-84e2-ba745cb7bb83/20260703094525/az_nova_backup_3d538c5e-b79f-4328-82e9-e76f89c22158-00005 in container: volumebackups. {{(pid=101319) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 09:45:44.538855 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-0db52c99-132a-463f-af7e-a012eb1f3d41 tempest-ProjectAdminTests33-1900627284 None] deleted object: volume_4b68dad5-e9a3-4bd1-84e2-ba745cb7bb83/20260703094525/az_nova_backup_3d538c5e-b79f-4328-82e9-e76f89c22158-00006 in container: volumebackups. {{(pid=101319) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 09:45:44.568600 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-0db52c99-132a-463f-af7e-a012eb1f3d41 tempest-ProjectAdminTests33-1900627284 None] deleted object: volume_4b68dad5-e9a3-4bd1-84e2-ba745cb7bb83/20260703094525/az_nova_backup_3d538c5e-b79f-4328-82e9-e76f89c22158-00007 in container: volumebackups. {{(pid=101319) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 09:45:44.599493 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-0db52c99-132a-463f-af7e-a012eb1f3d41 tempest-ProjectAdminTests33-1900627284 None] deleted object: volume_4b68dad5-e9a3-4bd1-84e2-ba745cb7bb83/20260703094525/az_nova_backup_3d538c5e-b79f-4328-82e9-e76f89c22158-00008 in container: volumebackups. {{(pid=101319) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 09:45:44.666824 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-0db52c99-132a-463f-af7e-a012eb1f3d41 tempest-ProjectAdminTests33-1900627284 None] deleted object: volume_4b68dad5-e9a3-4bd1-84e2-ba745cb7bb83/20260703094525/az_nova_backup_3d538c5e-b79f-4328-82e9-e76f89c22158-00009 in container: volumebackups. {{(pid=101319) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 09:45:44.714553 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-327bc060-a9c1-4783-a969-79ebb1b84e7c tempest-VolumesBackupsTest-2142009639 None] Backing up chunk of data from volume. {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 09:45:44.736545 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-0db52c99-132a-463f-af7e-a012eb1f3d41 tempest-ProjectAdminTests33-1900627284 None] deleted object: volume_4b68dad5-e9a3-4bd1-84e2-ba745cb7bb83/20260703094525/az_nova_backup_3d538c5e-b79f-4328-82e9-e76f89c22158-00010 in container: volumebackups. {{(pid=101319) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 09:45:44.783350 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-0db52c99-132a-463f-af7e-a012eb1f3d41 tempest-ProjectAdminTests33-1900627284 None] deleted object: volume_4b68dad5-e9a3-4bd1-84e2-ba745cb7bb83/20260703094525/az_nova_backup_3d538c5e-b79f-4328-82e9-e76f89c22158-00011 in container: volumebackups. {{(pid=101319) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 09:45:44.825171 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-0db52c99-132a-463f-af7e-a012eb1f3d41 tempest-ProjectAdminTests33-1900627284 None] deleted object: volume_4b68dad5-e9a3-4bd1-84e2-ba745cb7bb83/20260703094525/az_nova_backup_3d538c5e-b79f-4328-82e9-e76f89c22158-00012 in container: volumebackups. {{(pid=101319) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 09:45:44.854424 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-0db52c99-132a-463f-af7e-a012eb1f3d41 tempest-ProjectAdminTests33-1900627284 None] deleted object: volume_4b68dad5-e9a3-4bd1-84e2-ba745cb7bb83/20260703094525/az_nova_backup_3d538c5e-b79f-4328-82e9-e76f89c22158-00013 in container: volumebackups. {{(pid=101319) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 09:45:44.874846 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-0db52c99-132a-463f-af7e-a012eb1f3d41 tempest-ProjectAdminTests33-1900627284 None] deleted object: volume_4b68dad5-e9a3-4bd1-84e2-ba745cb7bb83/20260703094525/az_nova_backup_3d538c5e-b79f-4328-82e9-e76f89c22158-00014 in container: volumebackups. {{(pid=101319) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 09:45:44.893243 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-0db52c99-132a-463f-af7e-a012eb1f3d41 tempest-ProjectAdminTests33-1900627284 None] deleted object: volume_4b68dad5-e9a3-4bd1-84e2-ba745cb7bb83/20260703094525/az_nova_backup_3d538c5e-b79f-4328-82e9-e76f89c22158-00015 in container: volumebackups. {{(pid=101319) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 09:45:44.911664 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-0db52c99-132a-463f-af7e-a012eb1f3d41 tempest-ProjectAdminTests33-1900627284 None] deleted object: volume_4b68dad5-e9a3-4bd1-84e2-ba745cb7bb83/20260703094525/az_nova_backup_3d538c5e-b79f-4328-82e9-e76f89c22158-00016 in container: volumebackups. {{(pid=101319) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 09:45:44.934669 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-0db52c99-132a-463f-af7e-a012eb1f3d41 tempest-ProjectAdminTests33-1900627284 None] deleted object: volume_4b68dad5-e9a3-4bd1-84e2-ba745cb7bb83/20260703094525/az_nova_backup_3d538c5e-b79f-4328-82e9-e76f89c22158-00017 in container: volumebackups. {{(pid=101319) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 09:45:44.954530 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-0db52c99-132a-463f-af7e-a012eb1f3d41 tempest-ProjectAdminTests33-1900627284 None] deleted object: volume_4b68dad5-e9a3-4bd1-84e2-ba745cb7bb83/20260703094525/az_nova_backup_3d538c5e-b79f-4328-82e9-e76f89c22158-00018 in container: volumebackups. {{(pid=101319) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 09:45:44.967453 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-327bc060-a9c1-4783-a969-79ebb1b84e7c tempest-VolumesBackupsTest-2142009639 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101319) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 09:45:44.967605 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-327bc060-a9c1-4783-a969-79ebb1b84e7c tempest-VolumesBackupsTest-2142009639 None] About to put_object {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 09:45:44.984856 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-0db52c99-132a-463f-af7e-a012eb1f3d41 tempest-ProjectAdminTests33-1900627284 None] deleted object: volume_4b68dad5-e9a3-4bd1-84e2-ba745cb7bb83/20260703094525/az_nova_backup_3d538c5e-b79f-4328-82e9-e76f89c22158-00019 in container: volumebackups. {{(pid=101319) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 09:45:45.016041 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-0db52c99-132a-463f-af7e-a012eb1f3d41 tempest-ProjectAdminTests33-1900627284 None] deleted object: volume_4b68dad5-e9a3-4bd1-84e2-ba745cb7bb83/20260703094525/az_nova_backup_3d538c5e-b79f-4328-82e9-e76f89c22158-00020 in container: volumebackups. {{(pid=101319) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 09:45:45.082951 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-0db52c99-132a-463f-af7e-a012eb1f3d41 tempest-ProjectAdminTests33-1900627284 None] deleted object: volume_4b68dad5-e9a3-4bd1-84e2-ba745cb7bb83/20260703094525/az_nova_backup_3d538c5e-b79f-4328-82e9-e76f89c22158-00021 in container: volumebackups. {{(pid=101319) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 09:45:45.082951 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-327bc060-a9c1-4783-a969-79ebb1b84e7c tempest-VolumesBackupsTest-2142009639 None] backup MD5 for volume_b1fc0d58-7747-4bcf-99a7-fb482aacb945/20260703094530/az_nova_backup_e353b2b2-ecff-4fe0-8148-bf9d1d84a8bf-00019: 25e317773f308e446cc84c503a6d1f85 {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 09:45:45.082951 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-327bc060-a9c1-4783-a969-79ebb1b84e7c tempest-VolumesBackupsTest-2142009639 None] Calling eventlet.sleep(0) {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 09:45:45.124957 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-0db52c99-132a-463f-af7e-a012eb1f3d41 tempest-ProjectAdminTests33-1900627284 None] deleted object: volume_4b68dad5-e9a3-4bd1-84e2-ba745cb7bb83/20260703094525/az_nova_backup_3d538c5e-b79f-4328-82e9-e76f89c22158_metadata in container: volumebackups. {{(pid=101319) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 09:45:45.161778 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-0db52c99-132a-463f-af7e-a012eb1f3d41 tempest-ProjectAdminTests33-1900627284 None] deleted object: volume_4b68dad5-e9a3-4bd1-84e2-ba745cb7bb83/20260703094525/az_nova_backup_3d538c5e-b79f-4328-82e9-e76f89c22158_sha256file in container: volumebackups. {{(pid=101319) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 09:45:45.162172 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-0db52c99-132a-463f-af7e-a012eb1f3d41 tempest-ProjectAdminTests33-1900627284 None] delete 3d538c5e-b79f-4328-82e9-e76f89c22158 finished. {{(pid=101319) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:848}} Jul 03 09:45:45.196210 np0000004400 cinder-backup[101319]: DEBUG cinder.quota [None req-0db52c99-132a-463f-af7e-a012eb1f3d41 tempest-ProjectAdminTests33-1900627284 None] Created reservations ['3c0021f9-7df7-4f60-8c02-32c96b3dd24e', 'ee69db14-9cfb-4ab3-a477-410c59a9a647'] {{(pid=101319) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 09:45:45.239587 np0000004400 cinder-backup[101319]: INFO cinder.backup.manager [None req-0db52c99-132a-463f-af7e-a012eb1f3d41 tempest-ProjectAdminTests33-1900627284 None] Delete backup finished, backup 3d538c5e-b79f-4328-82e9-e76f89c22158 deleted. Jul 03 09:45:45.285739 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-327bc060-a9c1-4783-a969-79ebb1b84e7c tempest-VolumesBackupsTest-2142009639 None] Backing up chunk of data from volume. {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 09:45:45.329866 np0000004400 cinder-backup[101319]: INFO os_brick.initiator.connectors.iscsi [None req-6ef928da-3670-4523-823a-3443e2d91692 tempest-VolumesBackupsTest-118275719 None] Trying to connect to iSCSI portal 192.168.40.100:3260 Jul 03 09:45:45.341100 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-6ef928da-3670-4523-823a-3443e2d91692 tempest-VolumesBackupsTest-118275719 None] iscsiadm (): stdout=# BEGIN RECORD 2.1.9 Jul 03 09:45:45.341100 np0000004400 cinder-backup[101319]: node.name = iqn.2023-03.storpool.com:os--volume-72e07e1e-1567-4071-8204-c29cb26d2660 Jul 03 09:45:45.341100 np0000004400 cinder-backup[101319]: node.tpgt = -1 Jul 03 09:45:45.341100 np0000004400 cinder-backup[101319]: node.startup = manual Jul 03 09:45:45.341100 np0000004400 cinder-backup[101319]: node.leading_login = No Jul 03 09:45:45.341100 np0000004400 cinder-backup[101319]: iface.iscsi_ifacename = default Jul 03 09:45:45.341100 np0000004400 cinder-backup[101319]: iface.net_ifacename = Jul 03 09:45:45.341100 np0000004400 cinder-backup[101319]: iface.ipaddress = Jul 03 09:45:45.341100 np0000004400 cinder-backup[101319]: iface.prefix_len = 0 Jul 03 09:45:45.341100 np0000004400 cinder-backup[101319]: iface.hwaddress = Jul 03 09:45:45.341100 np0000004400 cinder-backup[101319]: iface.transport_name = tcp Jul 03 09:45:45.341100 np0000004400 cinder-backup[101319]: iface.initiatorname = Jul 03 09:45:45.341100 np0000004400 cinder-backup[101319]: iface.state = Jul 03 09:45:45.341100 np0000004400 cinder-backup[101319]: iface.vlan_id = 0 Jul 03 09:45:45.341100 np0000004400 cinder-backup[101319]: iface.vlan_priority = 0 Jul 03 09:45:45.341100 np0000004400 cinder-backup[101319]: iface.vlan_state = Jul 03 09:45:45.341100 np0000004400 cinder-backup[101319]: iface.iface_num = 0 Jul 03 09:45:45.341100 np0000004400 cinder-backup[101319]: iface.mtu = 0 Jul 03 09:45:45.341100 np0000004400 cinder-backup[101319]: iface.port = 0 Jul 03 09:45:45.341100 np0000004400 cinder-backup[101319]: iface.bootproto = Jul 03 09:45:45.341100 np0000004400 cinder-backup[101319]: iface.subnet_mask = Jul 03 09:45:45.341100 np0000004400 cinder-backup[101319]: iface.gateway = Jul 03 09:45:45.341100 np0000004400 cinder-backup[101319]: iface.dhcp_alt_client_id_state = Jul 03 09:45:45.341100 np0000004400 cinder-backup[101319]: iface.dhcp_alt_client_id = Jul 03 09:45:45.341100 np0000004400 cinder-backup[101319]: iface.dhcp_dns = Jul 03 09:45:45.341100 np0000004400 cinder-backup[101319]: iface.dhcp_learn_iqn = Jul 03 09:45:45.341100 np0000004400 cinder-backup[101319]: iface.dhcp_req_vendor_id_state = Jul 03 09:45:45.341100 np0000004400 cinder-backup[101319]: iface.dhcp_vendor_id_state = Jul 03 09:45:45.341100 np0000004400 cinder-backup[101319]: iface.dhcp_vendor_id = Jul 03 09:45:45.341100 np0000004400 cinder-backup[101319]: iface.dhcp_slp_da = Jul 03 09:45:45.341100 np0000004400 cinder-backup[101319]: iface.fragmentation = Jul 03 09:45:45.341100 np0000004400 cinder-backup[101319]: iface.gratuitous_arp = Jul 03 09:45:45.341100 np0000004400 cinder-backup[101319]: iface.incoming_forwarding = Jul 03 09:45:45.341100 np0000004400 cinder-backup[101319]: iface.tos_state = Jul 03 09:45:45.341100 np0000004400 cinder-backup[101319]: iface.tos = 0 Jul 03 09:45:45.341100 np0000004400 cinder-backup[101319]: iface.ttl = 0 Jul 03 09:45:45.341100 np0000004400 cinder-backup[101319]: iface.delayed_ack = Jul 03 09:45:45.341100 np0000004400 cinder-backup[101319]: iface.tcp_nagle = Jul 03 09:45:45.341100 np0000004400 cinder-backup[101319]: iface.tcp_wsf_state = Jul 03 09:45:45.341100 np0000004400 cinder-backup[101319]: iface.tcp_wsf = 0 Jul 03 09:45:45.341100 np0000004400 cinder-backup[101319]: iface.tcp_timer_scale = 0 Jul 03 09:45:45.341100 np0000004400 cinder-backup[101319]: iface.tcp_timestamp = Jul 03 09:45:45.341100 np0000004400 cinder-backup[101319]: iface.redirect = Jul 03 09:45:45.341100 np0000004400 cinder-backup[101319]: iface.def_task_mgmt_timeout = 0 Jul 03 09:45:45.341100 np0000004400 cinder-backup[101319]: iface.header_digest = Jul 03 09:45:45.341100 np0000004400 cinder-backup[101319]: iface.data_digest = Jul 03 09:45:45.341100 np0000004400 cinder-backup[101319]: iface.immediate_data = Jul 03 09:45:45.341100 np0000004400 cinder-backup[101319]: iface.initial_r2t = Jul 03 09:45:45.341100 np0000004400 cinder-backup[101319]: iface.data_seq_inorder = Jul 03 09:45:45.341100 np0000004400 cinder-backup[101319]: iface.data_pdu_inorder = Jul 03 09:45:45.341100 np0000004400 cinder-backup[101319]: iface.erl = 0 Jul 03 09:45:45.341100 np0000004400 cinder-backup[101319]: iface.max_receive_data_len = 0 Jul 03 09:45:45.341100 np0000004400 cinder-backup[101319]: iface.first_burst_len = 0 Jul 03 09:45:45.341100 np0000004400 cinder-backup[101319]: iface.max_outstanding_r2t = 0 Jul 03 09:45:45.341100 np0000004400 cinder-backup[101319]: iface.max_burst_len = 0 Jul 03 09:45:45.341100 np0000004400 cinder-backup[101319]: iface.chap_auth = Jul 03 09:45:45.341100 np0000004400 cinder-backup[101319]: iface.bidi_chap = Jul 03 09:45:45.341100 np0000004400 cinder-backup[101319]: iface.strict_login_compliance = Jul 03 09:45:45.341100 np0000004400 cinder-backup[101319]: iface.discovery_auth = Jul 03 09:45:45.341100 np0000004400 cinder-backup[101319]: iface.discovery_logout = Jul 03 09:45:45.341100 np0000004400 cinder-backup[101319]: node.discovery_address = Jul 03 09:45:45.341100 np0000004400 cinder-backup[101319]: node.discovery_port = 0 Jul 03 09:45:45.341100 np0000004400 cinder-backup[101319]: node.discovery_type = fw Jul 03 09:45:45.341100 np0000004400 cinder-backup[101319]: node.session.initial_cmdsn = 0 Jul 03 09:45:45.341100 np0000004400 cinder-backup[101319]: node.session.initial_login_retry_max = 8 Jul 03 09:45:45.341100 np0000004400 cinder-backup[101319]: node.session.xmit_thread_priority = 0 Jul 03 09:45:45.341100 np0000004400 cinder-backup[101319]: node.session.cmds_max = 128 Jul 03 09:45:45.341100 np0000004400 cinder-backup[101319]: node.session.queue_depth = 32 Jul 03 09:45:45.341100 np0000004400 cinder-backup[101319]: node.session.nr_sessions = 1 Jul 03 09:45:45.341100 np0000004400 cinder-backup[101319]: node.session.auth.authmethod = None Jul 03 09:45:45.341100 np0000004400 cinder-backup[101319]: node.session.auth.username = Jul 03 09:45:45.341100 np0000004400 cinder-backup[101319]: node.session.auth.password = *** Jul 03 09:45:45.341100 np0000004400 cinder-backup[101319]: node.session.auth.username_in = Jul 03 09:45:45.341100 np0000004400 cinder-backup[101319]: node.session.auth.password_in = Jul 03 09:45:45.341100 np0000004400 cinder-backup[101319]: node.session.auth.chap_algs = SHA256 Jul 03 09:45:45.341100 np0000004400 cinder-backup[101319]: node.session.timeo.replacement_timeout = 120 Jul 03 09:45:45.341100 np0000004400 cinder-backup[101319]: node.session.err_timeo.abort_timeout = 15 Jul 03 09:45:45.341100 np0000004400 cinder-backup[101319]: node.session.err_timeo.lu_reset_timeout = 30 Jul 03 09:45:45.341100 np0000004400 cinder-backup[101319]: node.session.err_timeo.tgt_reset_timeout = 30 Jul 03 09:45:45.341100 np0000004400 cinder-backup[101319]: node.session.err_timeo.host_reset_timeout = 60 Jul 03 09:45:45.341100 np0000004400 cinder-backup[101319]: node.session.iscsi.FastAbort = Yes Jul 03 09:45:45.341100 np0000004400 cinder-backup[101319]: node.session.iscsi.InitialR2T = No Jul 03 09:45:45.341100 np0000004400 cinder-backup[101319]: node.session.iscsi.ImmediateData = Yes Jul 03 09:45:45.341100 np0000004400 cinder-backup[101319]: node.session.iscsi.FirstBurstLength = 262144 Jul 03 09:45:45.341100 np0000004400 cinder-backup[101319]: node.session.iscsi.MaxBurstLength = 16776192 Jul 03 09:45:45.341100 np0000004400 cinder-backup[101319]: node.session.iscsi.DefaultTime2Retain = 0 Jul 03 09:45:45.341100 np0000004400 cinder-backup[101319]: node.session.iscsi.DefaultTime2Wait = 2 Jul 03 09:45:45.341100 np0000004400 cinder-backup[101319]: node.session.iscsi.MaxConnections = 1 Jul 03 09:45:45.341100 np0000004400 cinder-backup[101319]: node.session.iscsi.MaxOutstandingR2T = 1 Jul 03 09:45:45.341100 np0000004400 cinder-backup[101319]: node.session.iscsi.ERL = 0 Jul 03 09:45:45.341100 np0000004400 cinder-backup[101319]: node.session.scan = auto Jul 03 09:45:45.341100 np0000004400 cinder-backup[101319]: node.session.reopen_max = 0 Jul 03 09:45:45.341100 np0000004400 cinder-backup[101319]: node.conn[0].address = 192.168.40.100 Jul 03 09:45:45.341100 np0000004400 cinder-backup[101319]: node.conn[0].port = 3260 Jul 03 09:45:45.341100 np0000004400 cinder-backup[101319]: node.conn[0].startup = manual Jul 03 09:45:45.341100 np0000004400 cinder-backup[101319]: node.conn[0].tcp.window_size = 524288 Jul 03 09:45:45.341100 np0000004400 cinder-backup[101319]: node.conn[0].tcp.type_of_service = 0 Jul 03 09:45:45.341100 np0000004400 cinder-backup[101319]: node.conn[0].timeo.logout_timeout = 15 Jul 03 09:45:45.341100 np0000004400 cinder-backup[101319]: node.conn[0].timeo.login_timeout = 15 Jul 03 09:45:45.341100 np0000004400 cinder-backup[101319]: node.conn[0].timeo.auth_timeout = 45 Jul 03 09:45:45.341100 np0000004400 cinder-backup[101319]: node.conn[0].timeo.noop_out_interval = 5 Jul 03 09:45:45.341100 np0000004400 cinder-backup[101319]: node.conn[0].timeo.noop_out_timeout = 5 Jul 03 09:45:45.341100 np0000004400 cinder-backup[101319]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0 Jul 03 09:45:45.341100 np0000004400 cinder-backup[101319]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144 Jul 03 09:45:45.341100 np0000004400 cinder-backup[101319]: node.conn[0].iscsi.HeaderDigest = None Jul 03 09:45:45.341100 np0000004400 cinder-backup[101319]: node.conn[0].iscsi.DataDigest = None Jul 03 09:45:45.341100 np0000004400 cinder-backup[101319]: node.conn[0].iscsi.IFMarker = No Jul 03 09:45:45.341100 np0000004400 cinder-backup[101319]: node.conn[0].iscsi.OFMarker = No Jul 03 09:45:45.341100 np0000004400 cinder-backup[101319]: # END RECORD Jul 03 09:45:45.341100 np0000004400 cinder-backup[101319]: stderr= {{(pid=101319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 03 09:45:45.356546 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-6ef928da-3670-4523-823a-3443e2d91692 tempest-VolumesBackupsTest-118275719 None] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=101319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 03 09:45:45.372216 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-6ef928da-3670-4523-823a-3443e2d91692 tempest-VolumesBackupsTest-118275719 None] iscsiadm ('-m', 'session'): stdout=tcp: [106] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b1fc0d58-7747-4bcf-99a7-fb482aacb945 (non-flash) Jul 03 09:45:45.372216 np0000004400 cinder-backup[101319]: tcp: [49] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b2e4f10c-8033-4c54-95a1-dfe45d6357a3 (non-flash) Jul 03 09:45:45.372216 np0000004400 cinder-backup[101319]: tcp: [50] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b2e4f10c-8033-4c54-95a1-dfe45d6357a3 (non-flash) Jul 03 09:45:45.372216 np0000004400 cinder-backup[101319]: tcp: [82] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-76320525-737e-4f58-8523-63ec9abbdc64 (non-flash) Jul 03 09:45:45.372216 np0000004400 cinder-backup[101319]: tcp: [83] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-76320525-737e-4f58-8523-63ec9abbdc64 (non-flash) Jul 03 09:45:45.372216 np0000004400 cinder-backup[101319]: tcp: [97] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d47f5d2f-dce5-42f7-a693-a654fd702622 (non-flash) Jul 03 09:45:45.372216 np0000004400 cinder-backup[101319]: tcp: [98] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d47f5d2f-dce5-42f7-a693-a654fd702622 (non-flash) Jul 03 09:45:45.372216 np0000004400 cinder-backup[101319]: stderr= {{(pid=101319) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jul 03 09:45:45.372473 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-6ef928da-3670-4523-823a-3443e2d91692 tempest-VolumesBackupsTest-118275719 None] iscsi session list stdout=tcp: [106] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b1fc0d58-7747-4bcf-99a7-fb482aacb945 (non-flash) Jul 03 09:45:45.372473 np0000004400 cinder-backup[101319]: tcp: [49] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b2e4f10c-8033-4c54-95a1-dfe45d6357a3 (non-flash) Jul 03 09:45:45.372473 np0000004400 cinder-backup[101319]: tcp: [50] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b2e4f10c-8033-4c54-95a1-dfe45d6357a3 (non-flash) Jul 03 09:45:45.372473 np0000004400 cinder-backup[101319]: tcp: [82] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-76320525-737e-4f58-8523-63ec9abbdc64 (non-flash) Jul 03 09:45:45.372473 np0000004400 cinder-backup[101319]: tcp: [83] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-76320525-737e-4f58-8523-63ec9abbdc64 (non-flash) Jul 03 09:45:45.372473 np0000004400 cinder-backup[101319]: tcp: [97] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d47f5d2f-dce5-42f7-a693-a654fd702622 (non-flash) Jul 03 09:45:45.372473 np0000004400 cinder-backup[101319]: tcp: [98] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d47f5d2f-dce5-42f7-a693-a654fd702622 (non-flash) Jul 03 09:45:45.372473 np0000004400 cinder-backup[101319]: stderr= {{(pid=101319) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jul 03 09:45:45.404815 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-6ef928da-3670-4523-823a-3443e2d91692 tempest-VolumesBackupsTest-118275719 None] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-72e07e1e-1567-4071-8204-c29cb26d2660, portal: 192.168.40.100,3260] Jul 03 09:45:45.404815 np0000004400 cinder-backup[101319]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-72e07e1e-1567-4071-8204-c29cb26d2660, portal: 192.168.40.100,3260] successful. Jul 03 09:45:45.404815 np0000004400 cinder-backup[101319]: stderr= {{(pid=101319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 03 09:45:45.415046 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-6ef928da-3670-4523-823a-3443e2d91692 tempest-VolumesBackupsTest-118275719 None] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=101319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 03 09:45:45.431030 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-6ef928da-3670-4523-823a-3443e2d91692 tempest-VolumesBackupsTest-118275719 None] iscsiadm ('-m', 'session'): stdout=tcp: [106] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b1fc0d58-7747-4bcf-99a7-fb482aacb945 (non-flash) Jul 03 09:45:45.431030 np0000004400 cinder-backup[101319]: tcp: [107] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-72e07e1e-1567-4071-8204-c29cb26d2660 (non-flash) Jul 03 09:45:45.431030 np0000004400 cinder-backup[101319]: tcp: [49] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b2e4f10c-8033-4c54-95a1-dfe45d6357a3 (non-flash) Jul 03 09:45:45.431030 np0000004400 cinder-backup[101319]: tcp: [50] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b2e4f10c-8033-4c54-95a1-dfe45d6357a3 (non-flash) Jul 03 09:45:45.431030 np0000004400 cinder-backup[101319]: tcp: [82] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-76320525-737e-4f58-8523-63ec9abbdc64 (non-flash) Jul 03 09:45:45.431030 np0000004400 cinder-backup[101319]: tcp: [83] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-76320525-737e-4f58-8523-63ec9abbdc64 (non-flash) Jul 03 09:45:45.431030 np0000004400 cinder-backup[101319]: tcp: [97] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d47f5d2f-dce5-42f7-a693-a654fd702622 (non-flash) Jul 03 09:45:45.431030 np0000004400 cinder-backup[101319]: tcp: [98] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d47f5d2f-dce5-42f7-a693-a654fd702622 (non-flash) Jul 03 09:45:45.431030 np0000004400 cinder-backup[101319]: stderr= {{(pid=101319) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jul 03 09:45:45.431279 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-6ef928da-3670-4523-823a-3443e2d91692 tempest-VolumesBackupsTest-118275719 None] iscsi session list stdout=tcp: [106] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b1fc0d58-7747-4bcf-99a7-fb482aacb945 (non-flash) Jul 03 09:45:45.431279 np0000004400 cinder-backup[101319]: tcp: [107] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-72e07e1e-1567-4071-8204-c29cb26d2660 (non-flash) Jul 03 09:45:45.431279 np0000004400 cinder-backup[101319]: tcp: [49] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b2e4f10c-8033-4c54-95a1-dfe45d6357a3 (non-flash) Jul 03 09:45:45.431279 np0000004400 cinder-backup[101319]: tcp: [50] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b2e4f10c-8033-4c54-95a1-dfe45d6357a3 (non-flash) Jul 03 09:45:45.431279 np0000004400 cinder-backup[101319]: tcp: [82] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-76320525-737e-4f58-8523-63ec9abbdc64 (non-flash) Jul 03 09:45:45.431279 np0000004400 cinder-backup[101319]: tcp: [83] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-76320525-737e-4f58-8523-63ec9abbdc64 (non-flash) Jul 03 09:45:45.431279 np0000004400 cinder-backup[101319]: tcp: [97] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d47f5d2f-dce5-42f7-a693-a654fd702622 (non-flash) Jul 03 09:45:45.431279 np0000004400 cinder-backup[101319]: tcp: [98] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d47f5d2f-dce5-42f7-a693-a654fd702622 (non-flash) Jul 03 09:45:45.431279 np0000004400 cinder-backup[101319]: stderr= {{(pid=101319) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jul 03 09:45:45.431725 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.base [None req-6ef928da-3670-4523-823a-3443e2d91692 tempest-VolumesBackupsTest-118275719 None] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-72e07e1e-1567-4071-8204-c29cb26d2660" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.125s {{(pid=101319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jul 03 09:45:45.431923 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-6ef928da-3670-4523-823a-3443e2d91692 tempest-VolumesBackupsTest-118275719 None] Connected to 192.168.40.100:3260 {{(pid=101319) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}} Jul 03 09:45:45.433099 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.linuxscsi [None req-6ef928da-3670-4523-823a-3443e2d91692 tempest-VolumesBackupsTest-118275719 None] HCTL ('7', '-', '-', 0) found on session 107 with lun 0 {{(pid=101319) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}} Jul 03 09:45:45.433291 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.linuxscsi [None req-6ef928da-3670-4523-823a-3443e2d91692 tempest-VolumesBackupsTest-118275719 None] Scanning host 7 c: -, t: -, l: 0) {{(pid=101319) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}} Jul 03 09:45:45.444938 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.linuxscsi [None req-6ef928da-3670-4523-823a-3443e2d91692 tempest-VolumesBackupsTest-118275719 None] Searching for a device in session 107 and hctl ['7', '*', '*', 0] yield: sdb {{(pid=101319) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}} Jul 03 09:45:45.445219 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-6ef928da-3670-4523-823a-3443e2d91692 tempest-VolumesBackupsTest-118275719 None] Connected to sdb using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-72e07e1e-1567-4071-8204-c29cb26d2660', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '72e07e1e-1567-4071-8204-c29cb26d2660', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': False} {{(pid=101319) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}} Jul 03 09:45:45.536822 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-327bc060-a9c1-4783-a969-79ebb1b84e7c tempest-VolumesBackupsTest-2142009639 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101319) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 09:45:45.536995 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-327bc060-a9c1-4783-a969-79ebb1b84e7c tempest-VolumesBackupsTest-2142009639 None] About to put_object {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 09:45:45.653145 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-327bc060-a9c1-4783-a969-79ebb1b84e7c tempest-VolumesBackupsTest-2142009639 None] backup MD5 for volume_b1fc0d58-7747-4bcf-99a7-fb482aacb945/20260703094530/az_nova_backup_e353b2b2-ecff-4fe0-8148-bf9d1d84a8bf-00020: 25e317773f308e446cc84c503a6d1f85 {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 09:45:45.653312 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-327bc060-a9c1-4783-a969-79ebb1b84e7c tempest-VolumesBackupsTest-2142009639 None] Calling eventlet.sleep(0) {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 09:45:45.751210 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-327bc060-a9c1-4783-a969-79ebb1b84e7c tempest-VolumesBackupsTest-2142009639 None] Backing up chunk of data from volume. {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 09:45:45.880858 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-327bc060-a9c1-4783-a969-79ebb1b84e7c tempest-VolumesBackupsTest-2142009639 None] Compressed 25165824 bytes of data to 24470 bytes using zlib. {{(pid=101319) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 09:45:45.880858 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-327bc060-a9c1-4783-a969-79ebb1b84e7c tempest-VolumesBackupsTest-2142009639 None] About to put_object {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 09:45:45.921082 np0000004400 cinder-backup[101319]: INFO cinder.backup.manager [None req-9a399181-d884-4e46-a928-590766ad92c9 tempest-ProjectAdminTests33-1900627284 None] Create backup started, backup: ec711725-25f0-4982-afe6-3b48b0e50917 volume: 52be2cf8-1f6a-47e1-910d-17cdde3abb60. Jul 03 09:45:45.925879 np0000004400 cinder-backup[101319]: INFO cinder.backup.manager [None req-9a399181-d884-4e46-a928-590766ad92c9 tempest-ProjectAdminTests33-1900627284 None] Call Volume Manager to get_backup_device for Backup(availability_zone='nova',container=None,created_at=2026-07-03T09:45:45Z,data_timestamp=2026-07-03T09:45:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-type-Backup-1661276233',encryption_key_id=None,fail_reason=None,host='np0000004400',id=ec711725-25f0-4982-afe6-3b48b0e50917,metadata={},num_dependent_backups=0,object_count=0,parent=None,parent_id=None,project_id='a2309d0555a742279b4a5017d94ebf02',restore_volume_id=None,service='cinder.backup.drivers.swift.SwiftBackupDriver',service_metadata=None,size=1,snapshot_id=None,status='creating',temp_snapshot_id=None,temp_volume_id=None,updated_at=None,user_id='23ba560f6eed465495956e82c26b6f69',volume_id=52be2cf8-1f6a-47e1-910d-17cdde3abb60) Jul 03 09:45:45.953673 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.drivers.swift [None req-9a399181-d884-4e46-a928-590766ad92c9 tempest-ProjectAdminTests33-1900627284 None] Using swift URL https://10.4.3.95:8080/v1/AUTH_a2309d0555a742279b4a5017d94ebf02 {{(pid=101319) initialize /opt/stack/cinder/cinder/backup/drivers/swift.py:300}} Jul 03 09:45:45.953926 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.drivers.swift [None req-9a399181-d884-4e46-a928-590766ad92c9 tempest-ProjectAdminTests33-1900627284 None] Connect to https://10.4.3.95:8080/v1/AUTH_ in "per_user" mode {{(pid=101319) initialize /opt/stack/cinder/cinder/backup/drivers/swift.py:301}} Jul 03 09:45:45.954158 np0000004400 cinder-backup[101319]: DEBUG os_brick.utils [None req-9a399181-d884-4e46-a928-590766ad92c9 tempest-ProjectAdminTests33-1900627284 None] ==> get_connector_properties: call "{'root_helper': 'sudo cinder-rootwrap /etc/cinder/rootwrap.conf', 'my_ip': '10.4.3.95', 'multipath': False, 'enforce_multipath': False, 'host': None, 'execute': None}" {{(pid=101319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}} Jul 03 09:45:45.965984 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.scaleio [None req-9a399181-d884-4e46-a928-590766ad92c9 tempest-ProjectAdminTests33-1900627284 None] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=101319) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}} Jul 03 09:45:45.971219 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-327bc060-a9c1-4783-a969-79ebb1b84e7c tempest-VolumesBackupsTest-2142009639 None] backup MD5 for volume_b1fc0d58-7747-4bcf-99a7-fb482aacb945/20260703094530/az_nova_backup_e353b2b2-ecff-4fe0-8148-bf9d1d84a8bf-00021: 77377273b0a4b61febdbf7bbf52b9db9 {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 09:45:45.971330 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-327bc060-a9c1-4783-a969-79ebb1b84e7c tempest-VolumesBackupsTest-2142009639 None] Calling eventlet.sleep(0) {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 09:45:46.016163 np0000004400 cinder-backup[101319]: DEBUG oslo_db.sqlalchemy.engines [None req-327bc060-a9c1-4783-a969-79ebb1b84e7c tempest-VolumesBackupsTest-2142009639 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=101319) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 03 09:45:46.022263 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.driver [None req-327bc060-a9c1-4783-a969-79ebb1b84e7c tempest-VolumesBackupsTest-2142009639 None] Getting metadata type 'volume-base-metadata' {{(pid=101319) _save_vol_base_meta /opt/stack/cinder/cinder/backup/driver.py:79}} Jul 03 09:45:46.026749 np0000004400 cinder-backup[101319]: DEBUG oslo_concurrency.processutils [None req-9a399181-d884-4e46-a928-590766ad92c9 tempest-ProjectAdminTests33-1900627284 None] Running cmd (subprocess): nvme version {{(pid=101319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 09:45:46.035024 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.driver [None req-327bc060-a9c1-4783-a969-79ebb1b84e7c tempest-VolumesBackupsTest-2142009639 None] Completed fetching metadata type 'volume-base-metadata' {{(pid=101319) _save_vol_base_meta /opt/stack/cinder/cinder/backup/driver.py:98}} Jul 03 09:45:46.035460 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.driver [None req-327bc060-a9c1-4783-a969-79ebb1b84e7c tempest-VolumesBackupsTest-2142009639 None] Getting metadata type 'volume-metadata' {{(pid=101319) _save_vol_meta /opt/stack/cinder/cinder/backup/driver.py:109}} Jul 03 09:45:46.039417 np0000004400 cinder-backup[101319]: DEBUG oslo_concurrency.processutils [None req-9a399181-d884-4e46-a928-590766ad92c9 tempest-ProjectAdminTests33-1900627284 None] 'nvme version' failed. Not Retrying. {{(pid=101319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 03 09:45:46.039630 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.nvmeof [None req-9a399181-d884-4e46-a928-590766ad92c9 tempest-ProjectAdminTests33-1900627284 None] nvme not present on system {{(pid=101319) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}} Jul 03 09:45:46.043064 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.driver [None req-327bc060-a9c1-4783-a969-79ebb1b84e7c tempest-VolumesBackupsTest-2142009639 None] Completed fetching metadata type 'volume-metadata' {{(pid=101319) _save_vol_meta /opt/stack/cinder/cinder/backup/driver.py:121}} Jul 03 09:45:46.043207 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.driver [None req-327bc060-a9c1-4783-a969-79ebb1b84e7c tempest-VolumesBackupsTest-2142009639 None] Getting metadata type 'volume-glance-metadata' {{(pid=101319) _save_vol_glance_meta /opt/stack/cinder/cinder/backup/driver.py:132}} Jul 03 09:45:46.046754 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.lightos [None req-9a399181-d884-4e46-a928-590766ad92c9 tempest-ProjectAdminTests33-1900627284 None] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=101319) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}} Jul 03 09:45:46.048056 np0000004400 cinder-backup[101319]: INFO os_brick.initiator.connectors.lightos [None req-9a399181-d884-4e46-a928-590766ad92c9 tempest-ProjectAdminTests33-1900627284 None] Current host hostNQN and IP(s) are ['10.4.3.95', 'fe80::f816:3eff:fe47:268c', '192.168.40.6', 'fe80::f816:3eff:febf:7be2', '192.168.50.6', 'fe80::f816:3eff:fe99:8914', '192.168.10.6', 'fe80::f816:3eff:fe2f:e696', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::bc9d:84ff:fec2:6b49', 'fe80::fc16:3eff:fe36:77bf', 'fe80::4c47:1ff:fe64:1879', 'fe80::fc16:3eff:fec6:c223', 'fe80::fc16:3eff:fea0:4147', 'fe80::b0cf:48ff:fe29:caf0', 'fe80::fc16:3eff:fe91:aa0', 'fe80::fc16:3eff:fe3b:46af', 'fe80::28c1:27ff:fe3c:5528'] Jul 03 09:45:46.048183 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.lightos [None req-9a399181-d884-4e46-a928-590766ad92c9 tempest-ProjectAdminTests33-1900627284 None] LIGHTOS: did not find dsc, continuing anyway. {{(pid=101319) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}} Jul 03 09:45:46.048296 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.lightos [None req-9a399181-d884-4e46-a928-590766ad92c9 tempest-ProjectAdminTests33-1900627284 None] LIGHTOS: no hostnqn found. {{(pid=101319) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}} Jul 03 09:45:46.048534 np0000004400 cinder-backup[101319]: DEBUG os_brick.utils [None req-9a399181-d884-4e46-a928-590766ad92c9 tempest-ProjectAdminTests33-1900627284 None] <== get_connector_properties: return (93ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.95', 'host': 'np0000004400', 'multipath': False, 'enforce_multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:ae7e5bb0ebe6', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': '6b284368-d0ba-4d18-af6f-4998d3955c52', 'nvme_native_multipath': False} {{(pid=101319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}} Jul 03 09:45:46.062416 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.driver [None req-327bc060-a9c1-4783-a969-79ebb1b84e7c tempest-VolumesBackupsTest-2142009639 None] No metadata type 'volume-glance-metadata' available {{(pid=101319) _save_vol_glance_meta /opt/stack/cinder/cinder/backup/driver.py:147}} Jul 03 09:45:46.062832 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-327bc060-a9c1-4783-a969-79ebb1b84e7c tempest-VolumesBackupsTest-2142009639 None] _write_sha256file started, container name: tempest-volumesbackupstest-backup-container-1320776190, sha256file filename: volume_b1fc0d58-7747-4bcf-99a7-fb482aacb945/20260703094530/az_nova_backup_e353b2b2-ecff-4fe0-8148-bf9d1d84a8bf_sha256file. {{(pid=101319) _write_sha256file /opt/stack/cinder/cinder/backup/chunkeddriver.py:299}} Jul 03 09:45:46.170538 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-327bc060-a9c1-4783-a969-79ebb1b84e7c tempest-VolumesBackupsTest-2142009639 None] _write_sha256file finished. {{(pid=101319) _write_sha256file /opt/stack/cinder/cinder/backup/chunkeddriver.py:315}} Jul 03 09:45:46.171380 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-327bc060-a9c1-4783-a969-79ebb1b84e7c tempest-VolumesBackupsTest-2142009639 None] _write_metadata started, container name: tempest-volumesbackupstest-backup-container-1320776190, metadata filename: volume_b1fc0d58-7747-4bcf-99a7-fb482aacb945/20260703094530/az_nova_backup_e353b2b2-ecff-4fe0-8148-bf9d1d84a8bf_metadata. {{(pid=101319) _write_metadata /opt/stack/cinder/cinder/backup/chunkeddriver.py:276}} Jul 03 09:45:46.242512 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-327bc060-a9c1-4783-a969-79ebb1b84e7c tempest-VolumesBackupsTest-2142009639 None] _write_metadata finished. Metadata: b'{\n "backup_description": "tempest-backup-description-721862093",\n "backup_id": "e353b2b2-ecff-4fe0-8148-bf9d1d84a8bf",\n "backup_name": "tempest-VolumesBackupsTest-Backup-1542290489",\n "created_at": "2026-07-03 09:45:24+00:00",\n "objects": [\n {\n "volume_b1fc0d58-7747-4bcf-99a7-fb482aacb945/20260703094530/az_nova_backup_e353b2b2-ecff-4fe0-8148-bf9d1d84a8bf-00001": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 0\n }\n },\n {\n "volume_b1fc0d58-7747-4bcf-99a7-fb482aacb945/20260703094530/az_nova_backup_e353b2b2-ecff-4fe0-8148-bf9d1d84a8bf-00002": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 52428800\n }\n },\n {\n "volume_b1fc0d58-7747-4bcf-99a7-fb482aacb945/20260703094530/az_nova_backup_e353b2b2-ecff-4fe0-8148-bf9d1d84a8bf-00003": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 104857600\n }\n },\n {\n "volume_b1fc0d58-7747-4bcf-99a7-fb482aacb945/20260703094530/az_nova_backup_e353b2b2-ecff-4fe0-8148-bf9d1d84a8bf-00004": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 157286400\n }\n },\n {\n "volume_b1fc0d58-7747-4bcf-99a7-fb482aacb945/20260703094530/az_nova_backup_e353b2b2-ecff-4fe0-8148-bf9d1d84a8bf-00005": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 209715200\n }\n },\n {\n "volume_b1fc0d58-7747-4bcf-99a7-fb482aacb945/20260703094530/az_nova_backup_e353b2b2-ecff-4fe0-8148-bf9d1d84a8bf-00006": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 262144000\n }\n },\n {\n "volume_b1fc0d58-7747-4bcf-99a7-fb482aacb945/20260703094530/az_nova_backup_e353b2b2-ecff-4fe0-8148-bf9d1d84a8bf-00007": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 314572800\n }\n },\n {\n "volume_b1fc0d58-7747-4bcf-99a7-fb482aacb945/20260703094530/az_nova_backup_e353b2b2-ecff-4fe0-8148-bf9d1d84a8bf-00008": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 367001600\n }\n },\n {\n "volume_b1fc0d58-7747-4bcf-99a7-fb482aacb945/20260703094530/az_nova_backup_e353b2b2-ecff-4fe0-8148-bf9d1d84a8bf-00009": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 419430400\n }\n },\n {\n "volume_b1fc0d58-7747-4bcf-99a7-fb482aacb945/20260703094530/az_nova_backup_e353b2b2-ecff-4fe0-8148-bf9d1d84a8bf-00010": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 471859200\n }\n },\n {\n "volume_b1fc0d58-7747-4bcf-99a7-fb482aacb945/20260703094530/az_nova_backup_e353b2b2-ecff-4fe0-8148-bf9d1d84a8bf-00011": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 524288000\n }\n },\n {\n "volume_b1fc0d58-7747-4bcf-99a7-fb482aacb945/20260703094530/az_nova_backup_e353b2b2-ecff-4fe0-8148-bf9d1d84a8bf-00012": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 576716800\n }\n },\n {\n "volume_b1fc0d58-7747-4bcf-99a7-fb482aacb945/20260703094530/az_nova_backup_e353b2b2-ecff-4fe0-8148-bf9d1d84a8bf-00013": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 629145600\n }\n },\n {\n "volume_b1fc0d58-7747-4bcf-99a7-fb482aacb945/20260703094530/az_nova_backup_e353b2b2-ecff-4fe0-8148-bf9d1d84a8bf-00014": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 681574400\n }\n },\n {\n "volume_b1fc0d58-7747-4bcf-99a7-fb482aacb945/20260703094530/az_nova_backup_e353b2b2-ecff-4fe0-8148-bf9d1d84a8bf-00015": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 734003200\n }\n },\n {\n "volume_b1fc0d58-7747-4bcf-99a7-fb482aacb945/20260703094530/az_nova_backup_e353b2b2-ecff-4fe0-8148-bf9d1d84a8bf-00016": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 786432000\n }\n },\n {\n "volume_b1fc0d58-7747-4bcf-99a7-fb482aacb945/20260703094530/az_nova_backup_e353b2b2-ecff-4fe0-8148-bf9d1d84a8bf-00017": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 838860800\n }\n },\n {\n "volume_b1fc0d58-7747-4bcf-99a7-fb482aacb945/20260703094530/az_nova_backup_e353b2b2-ecff-4fe0-8148-bf9d1d84a8bf-00018": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 891289600\n }\n },\n {\n "volume_b1fc0d58-7747-4bcf-99a7-fb482aacb945/20260703094530/az_nova_backup_e353b2b2-ecff-4fe0-8148-bf9d1d84a8bf-00019": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 943718400\n }\n },\n {\n "volume_b1fc0d58-7747-4bcf-99a7-fb482aacb945/20260703094530/az_nova_backup_e353b2b2-ecff-4fe0-8148-bf9d1d84a8bf-00020": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 996147200\n }\n },\n {\n "volume_b1fc0d58-7747-4bcf-99a7-fb482aacb945/20260703094530/az_nova_backup_e353b2b2-ecff-4fe0-8148-bf9d1d84a8bf-00021": {\n "compression": "zlib",\n "length": 25165824,\n "md5": "77377273b0a4b61febdbf7bbf52b9db9",\n "offset": 1048576000\n }\n }\n ],\n "parent_id": null,\n "version": "1.0.0",\n "volume_id": "b1fc0d58-7747-4bcf-99a7-fb482aacb945",\n "volume_meta": "{\\"version\\": 2, \\"volume-base-metadata\\": {\\"id\\": \\"b1fc0d58-7747-4bcf-99a7-fb482aacb945\\", \\"_name_id\\": null, \\"use_quota\\": true, \\"ec2_id\\": null, \\"user_id\\": \\"91463b6c437c4711a49d3c31c513a101\\", \\"project_id\\": \\"59044e18a5b24b19a7b9b8a380f2e1a0\\", \\"snapshot_id\\": null, \\"cluster_name\\": null, \\"host\\": \\"np0000004400@storpool#default\\", \\"size\\": 1, \\"availability_zone\\": \\"nova\\", \\"status\\": \\"backing-up\\", \\"attach_status\\": \\"detached\\", \\"migration_status\\": null, \\"scheduled_at\\": \\"2026-07-03T09:45:23.000000\\", \\"launched_at\\": \\"2026-07-03T09:45:23.000000\\", \\"terminated_at\\": null, \\"display_name\\": \\"tempest-VolumesBackupsTest-Volume-334161830\\", \\"display_description\\": null, \\"provider_location\\": null, \\"provider_auth\\": null, \\"provider_geometry\\": null, \\"provider_id\\": null, \\"volume_type_id\\": \\"03e13fe6-0e30-4803-ace0-725d38e6dc24\\", \\"source_volid\\": null, \\"encryption_key_id\\": null, \\"consistencygroup_id\\": null, \\"group_id\\": null, \\"bootable\\": false, \\"multiattach\\": false, \\"replication_status\\": null, \\"replication_extended_status\\": null, \\"replication_driver_data\\": null, \\"previous_status\\": \\"available\\", \\"service_uuid\\": \\"6d4b0e79-fefe-4744-b25f-34be05095200\\", \\"shared_targets\\": true, \\"deleted_at\\": null, \\"deleted\\": false, \\"created_at\\": \\"2026-07-03T09:45:23.000000\\", \\"updated_at\\": \\"2026-07-03T09:45:24.000000\\"}, \\"volume-metadata\\": {\\"vol-meta1\\": \\"value1\\", \\"vol-meta2\\": \\"value2\\", \\"vol-meta3\\": \\"value3\\"}}"\n}'. {{(pid=101319) _write_metadata /opt/stack/cinder/cinder/backup/chunkeddriver.py:295}} Jul 03 09:45:46.247569 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-327bc060-a9c1-4783-a969-79ebb1b84e7c tempest-VolumesBackupsTest-2142009639 None] backup e353b2b2-ecff-4fe0-8148-bf9d1d84a8bf finished. {{(pid=101319) _finalize_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:462}} Jul 03 09:45:46.370166 np0000004400 cinder-backup[101319]: DEBUG oslo_concurrency.processutils [None req-327bc060-a9c1-4783-a969-79ebb1b84e7c tempest-VolumesBackupsTest-2142009639 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chown 0 /dev/sdj {{(pid=101319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 09:45:46.388398 np0000004400 sudo[137313]: stack : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chown 0 /dev/sdj Jul 03 09:45:46.389065 np0000004400 sudo[137313]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1002) Jul 03 09:45:46.450036 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.base [None req-6ef928da-3670-4523-823a-3443e2d91692 tempest-VolumesBackupsTest-118275719 None] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 2.155s {{(pid=101319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jul 03 09:45:46.450473 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-6ef928da-3670-4523-823a-3443e2d91692 tempest-VolumesBackupsTest-118275719 None] <== connect_volume: return (2156ms) {'type': 'block', 'scsi_wwn': 'SStorPool_iSCSI_DISK_1034578903445799033', 'path': '/dev/sdb'} {{(pid=101319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}} Jul 03 09:45:46.450792 np0000004400 cinder-backup[101319]: DEBUG oslo_concurrency.processutils [None req-6ef928da-3670-4523-823a-3443e2d91692 tempest-VolumesBackupsTest-118275719 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chown 1002 /dev/sdb {{(pid=101319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 09:45:46.477790 np0000004400 sudo[137320]: stack : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chown 1002 /dev/sdb Jul 03 09:45:46.478459 np0000004400 sudo[137320]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1002) Jul 03 09:45:46.554437 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connector [None req-9a399181-d884-4e46-a928-590766ad92c9 tempest-ProjectAdminTests33-1900627284 None] Factory for iscsi on None {{(pid=101319) factory /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connector.py:243}} Jul 03 09:45:46.554437 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-9a399181-d884-4e46-a928-590766ad92c9 tempest-ProjectAdminTests33-1900627284 None] ==> connect_volume: call "{'self': , 'connection_properties': {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-52be2cf8-1f6a-47e1-910d-17cdde3abb60', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '52be2cf8-1f6a-47e1-910d-17cdde3abb60', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': False}}" {{(pid=101319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}} Jul 03 09:45:46.554437 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.base [None req-9a399181-d884-4e46-a928-590766ad92c9 tempest-ProjectAdminTests33-1900627284 None] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=101319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jul 03 09:45:46.554437 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.base [None req-9a399181-d884-4e46-a928-590766ad92c9 tempest-ProjectAdminTests33-1900627284 None] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=101319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jul 03 09:45:46.554437 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.base [None req-9a399181-d884-4e46-a928-590766ad92c9 tempest-ProjectAdminTests33-1900627284 None] Connection properties {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-52be2cf8-1f6a-47e1-910d-17cdde3abb60', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '52be2cf8-1f6a-47e1-910d-17cdde3abb60', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': False} {{(pid=101319) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}} Jul 03 09:45:46.567397 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.base [None req-9a399181-d884-4e46-a928-590766ad92c9 tempest-ProjectAdminTests33-1900627284 None] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-52be2cf8-1f6a-47e1-910d-17cdde3abb60" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=101319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jul 03 09:45:46.567397 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.base [None req-9a399181-d884-4e46-a928-590766ad92c9 tempest-ProjectAdminTests33-1900627284 None] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-52be2cf8-1f6a-47e1-910d-17cdde3abb60" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=101319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jul 03 09:45:46.567397 np0000004400 cinder-backup[101319]: INFO os_brick.initiator.connectors.iscsi [None req-9a399181-d884-4e46-a928-590766ad92c9 tempest-ProjectAdminTests33-1900627284 None] Trying to connect to iSCSI portal 192.168.40.100:3260 Jul 03 09:45:46.578374 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-9a399181-d884-4e46-a928-590766ad92c9 tempest-ProjectAdminTests33-1900627284 None] iscsiadm (): stdout= stderr=iscsiadm: No records found Jul 03 09:45:46.578374 np0000004400 cinder-backup[101319]: {{(pid=101319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 03 09:45:46.589682 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-9a399181-d884-4e46-a928-590766ad92c9 tempest-ProjectAdminTests33-1900627284 None] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-52be2cf8-1f6a-47e1-910d-17cdde3abb60] added Jul 03 09:45:46.589682 np0000004400 cinder-backup[101319]: stderr=iscsiadm: Config file line 363 does not have value Jul 03 09:45:46.589682 np0000004400 cinder-backup[101319]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs' Jul 03 09:45:46.589682 np0000004400 cinder-backup[101319]: iscsiadm: Config file line 363 does not have value Jul 03 09:45:46.589682 np0000004400 cinder-backup[101319]: iscsiadm: Config file line 363 does not have value Jul 03 09:45:46.589682 np0000004400 cinder-backup[101319]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs' Jul 03 09:45:46.589682 np0000004400 cinder-backup[101319]: {{(pid=101319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 03 09:45:46.589682 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-9a399181-d884-4e46-a928-590766ad92c9 tempest-ProjectAdminTests33-1900627284 None] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=101319) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}} Jul 03 09:45:46.589682 np0000004400 cinder-backup[101319]: DEBUG os_brick.utils [None req-9a399181-d884-4e46-a928-590766ad92c9 tempest-ProjectAdminTests33-1900627284 None] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0227(s), this was the 1st time calling it. {{(pid=101319) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}} Jul 03 09:45:46.589682 np0000004400 cinder-backup[101319]: DEBUG os_brick.utils [None req-9a399181-d884-4e46-a928-590766ad92c9 tempest-ProjectAdminTests33-1900627284 None] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=101319) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}} Jul 03 09:45:46.719254 np0000004400 sudo[137313]: pam_unix(sudo:session): session closed for user root Jul 03 09:45:46.721805 np0000004400 cinder-backup[101319]: DEBUG oslo_concurrency.processutils [None req-327bc060-a9c1-4783-a969-79ebb1b84e7c tempest-VolumesBackupsTest-2142009639 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chown 0 /dev/sdj" returned: 0 in 0.351s {{(pid=101319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 09:45:46.721805 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-327bc060-a9c1-4783-a969-79ebb1b84e7c tempest-VolumesBackupsTest-2142009639 None] ==> disconnect_volume: call "{'args': (, {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-b1fc0d58-7747-4bcf-99a7-fb482aacb945', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'b1fc0d58-7747-4bcf-99a7-fb482aacb945', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': False}, {'type': 'block', 'scsi_wwn': '330000000e176745f', 'path': '/dev/sdj'}), 'kwargs': {'force': True, 'ignore_errors': True}}" {{(pid=101319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}} Jul 03 09:45:46.721805 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.base [None req-327bc060-a9c1-4783-a969-79ebb1b84e7c tempest-VolumesBackupsTest-2142009639 None] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=101319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jul 03 09:45:46.817175 np0000004400 sudo[137320]: pam_unix(sudo:session): session closed for user root Jul 03 09:45:46.819036 np0000004400 cinder-backup[101319]: DEBUG oslo_concurrency.processutils [None req-6ef928da-3670-4523-823a-3443e2d91692 tempest-VolumesBackupsTest-118275719 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chown 1002 /dev/sdb" returned: 0 in 0.368s {{(pid=101319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 09:45:46.826452 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-6ef928da-3670-4523-823a-3443e2d91692 tempest-VolumesBackupsTest-118275719 None] _create_container started, container: volumebackups,backup: 8b377d15-3804-4a9c-ad2d-e8e1359c0ee5. {{(pid=101319) _create_container /opt/stack/cinder/cinder/backup/chunkeddriver.py:249}} Jul 03 09:45:46.911529 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.drivers.swift [None req-6ef928da-3670-4523-823a-3443e2d91692 tempest-VolumesBackupsTest-118275719 None] generate_object_name_prefix: volume_72e07e1e-1567-4071-8204-c29cb26d2660/20260703094546/az_nova_backup_8b377d15-3804-4a9c-ad2d-e8e1359c0ee5 {{(pid=101319) _generate_object_name_prefix /opt/stack/cinder/cinder/backup/drivers/swift.py:452}} Jul 03 09:45:46.924236 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-6ef928da-3670-4523-823a-3443e2d91692 tempest-VolumesBackupsTest-118275719 None] starting backup of volume: 72e07e1e-1567-4071-8204-c29cb26d2660, volume size: 1073741824, object names prefix volume_72e07e1e-1567-4071-8204-c29cb26d2660/20260703094546/az_nova_backup_8b377d15-3804-4a9c-ad2d-e8e1359c0ee5, availability zone: nova {{(pid=101319) _prepare_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:359}} Jul 03 09:45:47.141306 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-6ef928da-3670-4523-823a-3443e2d91692 tempest-VolumesBackupsTest-118275719 None] Backing up chunk of data from volume. {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 09:45:47.590974 np0000004400 cinder-backup[101319]: INFO os_brick.initiator.connectors.iscsi [None req-9a399181-d884-4e46-a928-590766ad92c9 tempest-ProjectAdminTests33-1900627284 None] Trying to connect to iSCSI portal 192.168.40.100:3260 Jul 03 09:45:47.602135 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-9a399181-d884-4e46-a928-590766ad92c9 tempest-ProjectAdminTests33-1900627284 None] iscsiadm (): stdout=# BEGIN RECORD 2.1.9 Jul 03 09:45:47.602135 np0000004400 cinder-backup[101319]: node.name = iqn.2023-03.storpool.com:os--volume-52be2cf8-1f6a-47e1-910d-17cdde3abb60 Jul 03 09:45:47.602135 np0000004400 cinder-backup[101319]: node.tpgt = -1 Jul 03 09:45:47.602135 np0000004400 cinder-backup[101319]: node.startup = manual Jul 03 09:45:47.602135 np0000004400 cinder-backup[101319]: node.leading_login = No Jul 03 09:45:47.602135 np0000004400 cinder-backup[101319]: iface.iscsi_ifacename = default Jul 03 09:45:47.602135 np0000004400 cinder-backup[101319]: iface.net_ifacename = Jul 03 09:45:47.602135 np0000004400 cinder-backup[101319]: iface.ipaddress = Jul 03 09:45:47.602135 np0000004400 cinder-backup[101319]: iface.prefix_len = 0 Jul 03 09:45:47.602135 np0000004400 cinder-backup[101319]: iface.hwaddress = Jul 03 09:45:47.602135 np0000004400 cinder-backup[101319]: iface.transport_name = tcp Jul 03 09:45:47.602135 np0000004400 cinder-backup[101319]: iface.initiatorname = Jul 03 09:45:47.602135 np0000004400 cinder-backup[101319]: iface.state = Jul 03 09:45:47.602135 np0000004400 cinder-backup[101319]: iface.vlan_id = 0 Jul 03 09:45:47.602135 np0000004400 cinder-backup[101319]: iface.vlan_priority = 0 Jul 03 09:45:47.602135 np0000004400 cinder-backup[101319]: iface.vlan_state = Jul 03 09:45:47.602135 np0000004400 cinder-backup[101319]: iface.iface_num = 0 Jul 03 09:45:47.602135 np0000004400 cinder-backup[101319]: iface.mtu = 0 Jul 03 09:45:47.602135 np0000004400 cinder-backup[101319]: iface.port = 0 Jul 03 09:45:47.602135 np0000004400 cinder-backup[101319]: iface.bootproto = Jul 03 09:45:47.602135 np0000004400 cinder-backup[101319]: iface.subnet_mask = Jul 03 09:45:47.602135 np0000004400 cinder-backup[101319]: iface.gateway = Jul 03 09:45:47.602135 np0000004400 cinder-backup[101319]: iface.dhcp_alt_client_id_state = Jul 03 09:45:47.602135 np0000004400 cinder-backup[101319]: iface.dhcp_alt_client_id = Jul 03 09:45:47.602135 np0000004400 cinder-backup[101319]: iface.dhcp_dns = Jul 03 09:45:47.602135 np0000004400 cinder-backup[101319]: iface.dhcp_learn_iqn = Jul 03 09:45:47.602135 np0000004400 cinder-backup[101319]: iface.dhcp_req_vendor_id_state = Jul 03 09:45:47.602135 np0000004400 cinder-backup[101319]: iface.dhcp_vendor_id_state = Jul 03 09:45:47.602135 np0000004400 cinder-backup[101319]: iface.dhcp_vendor_id = Jul 03 09:45:47.602135 np0000004400 cinder-backup[101319]: iface.dhcp_slp_da = Jul 03 09:45:47.602135 np0000004400 cinder-backup[101319]: iface.fragmentation = Jul 03 09:45:47.602135 np0000004400 cinder-backup[101319]: iface.gratuitous_arp = Jul 03 09:45:47.602135 np0000004400 cinder-backup[101319]: iface.incoming_forwarding = Jul 03 09:45:47.602135 np0000004400 cinder-backup[101319]: iface.tos_state = Jul 03 09:45:47.602135 np0000004400 cinder-backup[101319]: iface.tos = 0 Jul 03 09:45:47.602135 np0000004400 cinder-backup[101319]: iface.ttl = 0 Jul 03 09:45:47.602135 np0000004400 cinder-backup[101319]: iface.delayed_ack = Jul 03 09:45:47.602135 np0000004400 cinder-backup[101319]: iface.tcp_nagle = Jul 03 09:45:47.602135 np0000004400 cinder-backup[101319]: iface.tcp_wsf_state = Jul 03 09:45:47.602135 np0000004400 cinder-backup[101319]: iface.tcp_wsf = 0 Jul 03 09:45:47.602135 np0000004400 cinder-backup[101319]: iface.tcp_timer_scale = 0 Jul 03 09:45:47.602135 np0000004400 cinder-backup[101319]: iface.tcp_timestamp = Jul 03 09:45:47.602135 np0000004400 cinder-backup[101319]: iface.redirect = Jul 03 09:45:47.602135 np0000004400 cinder-backup[101319]: iface.def_task_mgmt_timeout = 0 Jul 03 09:45:47.602135 np0000004400 cinder-backup[101319]: iface.header_digest = Jul 03 09:45:47.602135 np0000004400 cinder-backup[101319]: iface.data_digest = Jul 03 09:45:47.602135 np0000004400 cinder-backup[101319]: iface.immediate_data = Jul 03 09:45:47.602135 np0000004400 cinder-backup[101319]: iface.initial_r2t = Jul 03 09:45:47.602135 np0000004400 cinder-backup[101319]: iface.data_seq_inorder = Jul 03 09:45:47.602135 np0000004400 cinder-backup[101319]: iface.data_pdu_inorder = Jul 03 09:45:47.602135 np0000004400 cinder-backup[101319]: iface.erl = 0 Jul 03 09:45:47.602135 np0000004400 cinder-backup[101319]: iface.max_receive_data_len = 0 Jul 03 09:45:47.602135 np0000004400 cinder-backup[101319]: iface.first_burst_len = 0 Jul 03 09:45:47.602135 np0000004400 cinder-backup[101319]: iface.max_outstanding_r2t = 0 Jul 03 09:45:47.602135 np0000004400 cinder-backup[101319]: iface.max_burst_len = 0 Jul 03 09:45:47.602135 np0000004400 cinder-backup[101319]: iface.chap_auth = Jul 03 09:45:47.602135 np0000004400 cinder-backup[101319]: iface.bidi_chap = Jul 03 09:45:47.602135 np0000004400 cinder-backup[101319]: iface.strict_login_compliance = Jul 03 09:45:47.602135 np0000004400 cinder-backup[101319]: iface.discovery_auth = Jul 03 09:45:47.602135 np0000004400 cinder-backup[101319]: iface.discovery_logout = Jul 03 09:45:47.602135 np0000004400 cinder-backup[101319]: node.discovery_address = Jul 03 09:45:47.602135 np0000004400 cinder-backup[101319]: node.discovery_port = 0 Jul 03 09:45:47.602135 np0000004400 cinder-backup[101319]: node.discovery_type = fw Jul 03 09:45:47.602135 np0000004400 cinder-backup[101319]: node.session.initial_cmdsn = 0 Jul 03 09:45:47.602135 np0000004400 cinder-backup[101319]: node.session.initial_login_retry_max = 8 Jul 03 09:45:47.602135 np0000004400 cinder-backup[101319]: node.session.xmit_thread_priority = 0 Jul 03 09:45:47.602135 np0000004400 cinder-backup[101319]: node.session.cmds_max = 128 Jul 03 09:45:47.602135 np0000004400 cinder-backup[101319]: node.session.queue_depth = 32 Jul 03 09:45:47.602135 np0000004400 cinder-backup[101319]: node.session.nr_sessions = 1 Jul 03 09:45:47.602135 np0000004400 cinder-backup[101319]: node.session.auth.authmethod = None Jul 03 09:45:47.602135 np0000004400 cinder-backup[101319]: node.session.auth.username = Jul 03 09:45:47.602135 np0000004400 cinder-backup[101319]: node.session.auth.password = *** Jul 03 09:45:47.602135 np0000004400 cinder-backup[101319]: node.session.auth.username_in = Jul 03 09:45:47.602135 np0000004400 cinder-backup[101319]: node.session.auth.password_in = Jul 03 09:45:47.602135 np0000004400 cinder-backup[101319]: node.session.auth.chap_algs = SHA256 Jul 03 09:45:47.602135 np0000004400 cinder-backup[101319]: node.session.timeo.replacement_timeout = 120 Jul 03 09:45:47.602135 np0000004400 cinder-backup[101319]: node.session.err_timeo.abort_timeout = 15 Jul 03 09:45:47.602135 np0000004400 cinder-backup[101319]: node.session.err_timeo.lu_reset_timeout = 30 Jul 03 09:45:47.602135 np0000004400 cinder-backup[101319]: node.session.err_timeo.tgt_reset_timeout = 30 Jul 03 09:45:47.602135 np0000004400 cinder-backup[101319]: node.session.err_timeo.host_reset_timeout = 60 Jul 03 09:45:47.602135 np0000004400 cinder-backup[101319]: node.session.iscsi.FastAbort = Yes Jul 03 09:45:47.602135 np0000004400 cinder-backup[101319]: node.session.iscsi.InitialR2T = No Jul 03 09:45:47.602135 np0000004400 cinder-backup[101319]: node.session.iscsi.ImmediateData = Yes Jul 03 09:45:47.602135 np0000004400 cinder-backup[101319]: node.session.iscsi.FirstBurstLength = 262144 Jul 03 09:45:47.602135 np0000004400 cinder-backup[101319]: node.session.iscsi.MaxBurstLength = 16776192 Jul 03 09:45:47.602135 np0000004400 cinder-backup[101319]: node.session.iscsi.DefaultTime2Retain = 0 Jul 03 09:45:47.602135 np0000004400 cinder-backup[101319]: node.session.iscsi.DefaultTime2Wait = 2 Jul 03 09:45:47.602135 np0000004400 cinder-backup[101319]: node.session.iscsi.MaxConnections = 1 Jul 03 09:45:47.602135 np0000004400 cinder-backup[101319]: node.session.iscsi.MaxOutstandingR2T = 1 Jul 03 09:45:47.602135 np0000004400 cinder-backup[101319]: node.session.iscsi.ERL = 0 Jul 03 09:45:47.602135 np0000004400 cinder-backup[101319]: node.session.scan = auto Jul 03 09:45:47.602135 np0000004400 cinder-backup[101319]: node.session.reopen_max = 0 Jul 03 09:45:47.602135 np0000004400 cinder-backup[101319]: node.conn[0].address = 192.168.40.100 Jul 03 09:45:47.602135 np0000004400 cinder-backup[101319]: node.conn[0].port = 3260 Jul 03 09:45:47.602135 np0000004400 cinder-backup[101319]: node.conn[0].startup = manual Jul 03 09:45:47.602135 np0000004400 cinder-backup[101319]: node.conn[0].tcp.window_size = 524288 Jul 03 09:45:47.602135 np0000004400 cinder-backup[101319]: node.conn[0].tcp.type_of_service = 0 Jul 03 09:45:47.602135 np0000004400 cinder-backup[101319]: node.conn[0].timeo.logout_timeout = 15 Jul 03 09:45:47.602135 np0000004400 cinder-backup[101319]: node.conn[0].timeo.login_timeout = 15 Jul 03 09:45:47.602135 np0000004400 cinder-backup[101319]: node.conn[0].timeo.auth_timeout = 45 Jul 03 09:45:47.602135 np0000004400 cinder-backup[101319]: node.conn[0].timeo.noop_out_interval = 5 Jul 03 09:45:47.602135 np0000004400 cinder-backup[101319]: node.conn[0].timeo.noop_out_timeout = 5 Jul 03 09:45:47.602135 np0000004400 cinder-backup[101319]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0 Jul 03 09:45:47.602135 np0000004400 cinder-backup[101319]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144 Jul 03 09:45:47.602135 np0000004400 cinder-backup[101319]: node.conn[0].iscsi.HeaderDigest = None Jul 03 09:45:47.602135 np0000004400 cinder-backup[101319]: node.conn[0].iscsi.DataDigest = None Jul 03 09:45:47.602135 np0000004400 cinder-backup[101319]: node.conn[0].iscsi.IFMarker = No Jul 03 09:45:47.602135 np0000004400 cinder-backup[101319]: node.conn[0].iscsi.OFMarker = No Jul 03 09:45:47.602135 np0000004400 cinder-backup[101319]: # END RECORD Jul 03 09:45:47.602135 np0000004400 cinder-backup[101319]: stderr= {{(pid=101319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 03 09:45:47.613698 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-9a399181-d884-4e46-a928-590766ad92c9 tempest-ProjectAdminTests33-1900627284 None] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=101319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 03 09:45:47.628114 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-9a399181-d884-4e46-a928-590766ad92c9 tempest-ProjectAdminTests33-1900627284 None] iscsiadm ('-m', 'session'): stdout=tcp: [106] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b1fc0d58-7747-4bcf-99a7-fb482aacb945 (non-flash) Jul 03 09:45:47.628114 np0000004400 cinder-backup[101319]: tcp: [107] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-72e07e1e-1567-4071-8204-c29cb26d2660 (non-flash) Jul 03 09:45:47.628114 np0000004400 cinder-backup[101319]: tcp: [49] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b2e4f10c-8033-4c54-95a1-dfe45d6357a3 (non-flash) Jul 03 09:45:47.628114 np0000004400 cinder-backup[101319]: tcp: [50] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b2e4f10c-8033-4c54-95a1-dfe45d6357a3 (non-flash) Jul 03 09:45:47.628114 np0000004400 cinder-backup[101319]: tcp: [82] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-76320525-737e-4f58-8523-63ec9abbdc64 (non-flash) Jul 03 09:45:47.628114 np0000004400 cinder-backup[101319]: tcp: [83] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-76320525-737e-4f58-8523-63ec9abbdc64 (non-flash) Jul 03 09:45:47.628114 np0000004400 cinder-backup[101319]: tcp: [97] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d47f5d2f-dce5-42f7-a693-a654fd702622 (non-flash) Jul 03 09:45:47.628114 np0000004400 cinder-backup[101319]: tcp: [98] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d47f5d2f-dce5-42f7-a693-a654fd702622 (non-flash) Jul 03 09:45:47.628114 np0000004400 cinder-backup[101319]: stderr= {{(pid=101319) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jul 03 09:45:47.628323 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-9a399181-d884-4e46-a928-590766ad92c9 tempest-ProjectAdminTests33-1900627284 None] iscsi session list stdout=tcp: [106] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b1fc0d58-7747-4bcf-99a7-fb482aacb945 (non-flash) Jul 03 09:45:47.628323 np0000004400 cinder-backup[101319]: tcp: [107] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-72e07e1e-1567-4071-8204-c29cb26d2660 (non-flash) Jul 03 09:45:47.628323 np0000004400 cinder-backup[101319]: tcp: [49] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b2e4f10c-8033-4c54-95a1-dfe45d6357a3 (non-flash) Jul 03 09:45:47.628323 np0000004400 cinder-backup[101319]: tcp: [50] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b2e4f10c-8033-4c54-95a1-dfe45d6357a3 (non-flash) Jul 03 09:45:47.628323 np0000004400 cinder-backup[101319]: tcp: [82] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-76320525-737e-4f58-8523-63ec9abbdc64 (non-flash) Jul 03 09:45:47.628323 np0000004400 cinder-backup[101319]: tcp: [83] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-76320525-737e-4f58-8523-63ec9abbdc64 (non-flash) Jul 03 09:45:47.628323 np0000004400 cinder-backup[101319]: tcp: [97] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d47f5d2f-dce5-42f7-a693-a654fd702622 (non-flash) Jul 03 09:45:47.628323 np0000004400 cinder-backup[101319]: tcp: [98] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d47f5d2f-dce5-42f7-a693-a654fd702622 (non-flash) Jul 03 09:45:47.628323 np0000004400 cinder-backup[101319]: stderr= {{(pid=101319) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jul 03 09:45:47.663760 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-9a399181-d884-4e46-a928-590766ad92c9 tempest-ProjectAdminTests33-1900627284 None] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-52be2cf8-1f6a-47e1-910d-17cdde3abb60, portal: 192.168.40.100,3260] Jul 03 09:45:47.663760 np0000004400 cinder-backup[101319]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-52be2cf8-1f6a-47e1-910d-17cdde3abb60, portal: 192.168.40.100,3260] successful. Jul 03 09:45:47.663760 np0000004400 cinder-backup[101319]: stderr= {{(pid=101319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 03 09:45:47.673367 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-9a399181-d884-4e46-a928-590766ad92c9 tempest-ProjectAdminTests33-1900627284 None] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=101319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 03 09:45:47.692372 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-9a399181-d884-4e46-a928-590766ad92c9 tempest-ProjectAdminTests33-1900627284 None] iscsiadm ('-m', 'session'): stdout=tcp: [106] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b1fc0d58-7747-4bcf-99a7-fb482aacb945 (non-flash) Jul 03 09:45:47.692372 np0000004400 cinder-backup[101319]: tcp: [107] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-72e07e1e-1567-4071-8204-c29cb26d2660 (non-flash) Jul 03 09:45:47.692372 np0000004400 cinder-backup[101319]: tcp: [108] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-52be2cf8-1f6a-47e1-910d-17cdde3abb60 (non-flash) Jul 03 09:45:47.692372 np0000004400 cinder-backup[101319]: tcp: [49] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b2e4f10c-8033-4c54-95a1-dfe45d6357a3 (non-flash) Jul 03 09:45:47.692372 np0000004400 cinder-backup[101319]: tcp: [50] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b2e4f10c-8033-4c54-95a1-dfe45d6357a3 (non-flash) Jul 03 09:45:47.692372 np0000004400 cinder-backup[101319]: tcp: [82] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-76320525-737e-4f58-8523-63ec9abbdc64 (non-flash) Jul 03 09:45:47.692372 np0000004400 cinder-backup[101319]: tcp: [83] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-76320525-737e-4f58-8523-63ec9abbdc64 (non-flash) Jul 03 09:45:47.692372 np0000004400 cinder-backup[101319]: tcp: [97] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d47f5d2f-dce5-42f7-a693-a654fd702622 (non-flash) Jul 03 09:45:47.692372 np0000004400 cinder-backup[101319]: tcp: [98] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d47f5d2f-dce5-42f7-a693-a654fd702622 (non-flash) Jul 03 09:45:47.692372 np0000004400 cinder-backup[101319]: stderr= {{(pid=101319) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jul 03 09:45:47.692821 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-9a399181-d884-4e46-a928-590766ad92c9 tempest-ProjectAdminTests33-1900627284 None] iscsi session list stdout=tcp: [106] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b1fc0d58-7747-4bcf-99a7-fb482aacb945 (non-flash) Jul 03 09:45:47.692821 np0000004400 cinder-backup[101319]: tcp: [107] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-72e07e1e-1567-4071-8204-c29cb26d2660 (non-flash) Jul 03 09:45:47.692821 np0000004400 cinder-backup[101319]: tcp: [108] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-52be2cf8-1f6a-47e1-910d-17cdde3abb60 (non-flash) Jul 03 09:45:47.692821 np0000004400 cinder-backup[101319]: tcp: [49] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b2e4f10c-8033-4c54-95a1-dfe45d6357a3 (non-flash) Jul 03 09:45:47.692821 np0000004400 cinder-backup[101319]: tcp: [50] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b2e4f10c-8033-4c54-95a1-dfe45d6357a3 (non-flash) Jul 03 09:45:47.692821 np0000004400 cinder-backup[101319]: tcp: [82] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-76320525-737e-4f58-8523-63ec9abbdc64 (non-flash) Jul 03 09:45:47.692821 np0000004400 cinder-backup[101319]: tcp: [83] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-76320525-737e-4f58-8523-63ec9abbdc64 (non-flash) Jul 03 09:45:47.692821 np0000004400 cinder-backup[101319]: tcp: [97] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d47f5d2f-dce5-42f7-a693-a654fd702622 (non-flash) Jul 03 09:45:47.692821 np0000004400 cinder-backup[101319]: tcp: [98] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d47f5d2f-dce5-42f7-a693-a654fd702622 (non-flash) Jul 03 09:45:47.692821 np0000004400 cinder-backup[101319]: stderr= {{(pid=101319) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jul 03 09:45:47.693088 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.base [None req-9a399181-d884-4e46-a928-590766ad92c9 tempest-ProjectAdminTests33-1900627284 None] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-52be2cf8-1f6a-47e1-910d-17cdde3abb60" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.127s {{(pid=101319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jul 03 09:45:47.693088 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-9a399181-d884-4e46-a928-590766ad92c9 tempest-ProjectAdminTests33-1900627284 None] Connected to 192.168.40.100:3260 {{(pid=101319) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}} Jul 03 09:45:47.694237 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.linuxscsi [None req-9a399181-d884-4e46-a928-590766ad92c9 tempest-ProjectAdminTests33-1900627284 None] HCTL ('8', '-', '-', 0) found on session 108 with lun 0 {{(pid=101319) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}} Jul 03 09:45:47.694393 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.linuxscsi [None req-9a399181-d884-4e46-a928-590766ad92c9 tempest-ProjectAdminTests33-1900627284 None] Scanning host 8 c: -, t: -, l: 0) {{(pid=101319) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}} Jul 03 09:45:47.706859 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.linuxscsi [None req-9a399181-d884-4e46-a928-590766ad92c9 tempest-ProjectAdminTests33-1900627284 None] Searching for a device in session 108 and hctl ['8', '*', '*', 0] yield: sdc {{(pid=101319) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}} Jul 03 09:45:47.707120 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-9a399181-d884-4e46-a928-590766ad92c9 tempest-ProjectAdminTests33-1900627284 None] Connected to sdc using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-52be2cf8-1f6a-47e1-910d-17cdde3abb60', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '52be2cf8-1f6a-47e1-910d-17cdde3abb60', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': False} {{(pid=101319) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}} Jul 03 09:45:47.844000 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-6ef928da-3670-4523-823a-3443e2d91692 tempest-VolumesBackupsTest-118275719 None] Compressed 52428800 bytes of data to 19825286 bytes using zlib. {{(pid=101319) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 09:45:47.844167 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-6ef928da-3670-4523-823a-3443e2d91692 tempest-VolumesBackupsTest-118275719 None] About to put_object {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 09:45:48.139095 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-6ef928da-3670-4523-823a-3443e2d91692 tempest-VolumesBackupsTest-118275719 None] backup MD5 for volume_72e07e1e-1567-4071-8204-c29cb26d2660/20260703094546/az_nova_backup_8b377d15-3804-4a9c-ad2d-e8e1359c0ee5-00001: 82571f7121cb9475563edde615e4e4df {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 09:45:48.139234 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-6ef928da-3670-4523-823a-3443e2d91692 tempest-VolumesBackupsTest-118275719 None] Calling eventlet.sleep(0) {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 09:45:48.381928 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-6ef928da-3670-4523-823a-3443e2d91692 tempest-VolumesBackupsTest-118275719 None] Backing up chunk of data from volume. {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 09:45:48.661651 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-6ef928da-3670-4523-823a-3443e2d91692 tempest-VolumesBackupsTest-118275719 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101319) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 09:45:48.661976 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-6ef928da-3670-4523-823a-3443e2d91692 tempest-VolumesBackupsTest-118275719 None] About to put_object {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 09:45:48.713211 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.base [None req-9a399181-d884-4e46-a928-590766ad92c9 tempest-ProjectAdminTests33-1900627284 None] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 2.159s {{(pid=101319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jul 03 09:45:48.713484 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-9a399181-d884-4e46-a928-590766ad92c9 tempest-ProjectAdminTests33-1900627284 None] <== connect_volume: return (2159ms) {'type': 'block', 'scsi_wwn': '330000000eefb6614', 'path': '/dev/sdc'} {{(pid=101319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}} Jul 03 09:45:48.713903 np0000004400 cinder-backup[101319]: DEBUG oslo_concurrency.processutils [None req-9a399181-d884-4e46-a928-590766ad92c9 tempest-ProjectAdminTests33-1900627284 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chown 1002 /dev/sdc {{(pid=101319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 09:45:48.729382 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.base [None req-327bc060-a9c1-4783-a969-79ebb1b84e7c tempest-VolumesBackupsTest-2142009639 None] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 2.005s {{(pid=101319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jul 03 09:45:48.730249 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-327bc060-a9c1-4783-a969-79ebb1b84e7c tempest-VolumesBackupsTest-2142009639 None] _get_connection_devices called with parameters: connection_properties={'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-b1fc0d58-7747-4bcf-99a7-fb482aacb945', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'b1fc0d58-7747-4bcf-99a7-fb482aacb945', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': False}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=101319) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:847}} Jul 03 09:45:48.741796 np0000004400 sudo[137462]: stack : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chown 1002 /dev/sdc Jul 03 09:45:48.742515 np0000004400 sudo[137462]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1002) Jul 03 09:45:48.750246 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-327bc060-a9c1-4783-a969-79ebb1b84e7c tempest-VolumesBackupsTest-2142009639 None] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS: Jul 03 09:45:48.750246 np0000004400 cinder-backup[101319]: No targets found. Jul 03 09:45:48.750246 np0000004400 cinder-backup[101319]: iSNS: Jul 03 09:45:48.750246 np0000004400 cinder-backup[101319]: No targets found. Jul 03 09:45:48.750246 np0000004400 cinder-backup[101319]: STATIC: Jul 03 09:45:48.750246 np0000004400 cinder-backup[101319]: Target: iqn.2023-03.storpool.com:os--volume-52be2cf8-1f6a-47e1-910d-17cdde3abb60 Jul 03 09:45:48.750246 np0000004400 cinder-backup[101319]: Portal: 192.168.40.100:3260,-1 Jul 03 09:45:48.750246 np0000004400 cinder-backup[101319]: Iface Name: default Jul 03 09:45:48.750246 np0000004400 cinder-backup[101319]: Target: iqn.2023-03.storpool.com:os--volume-76320525-737e-4f58-8523-63ec9abbdc64 Jul 03 09:45:48.750246 np0000004400 cinder-backup[101319]: Portal: 192.168.50.100:3260,-1 Jul 03 09:45:48.750246 np0000004400 cinder-backup[101319]: Iface Name: default Jul 03 09:45:48.750246 np0000004400 cinder-backup[101319]: Portal: 192.168.40.100:3260,-1 Jul 03 09:45:48.750246 np0000004400 cinder-backup[101319]: Iface Name: default Jul 03 09:45:48.750246 np0000004400 cinder-backup[101319]: Target: iqn.2023-03.storpool.com:os--volume-b2e4f10c-8033-4c54-95a1-dfe45d6357a3 Jul 03 09:45:48.750246 np0000004400 cinder-backup[101319]: Portal: 192.168.50.100:3260,-1 Jul 03 09:45:48.750246 np0000004400 cinder-backup[101319]: Iface Name: default Jul 03 09:45:48.750246 np0000004400 cinder-backup[101319]: Portal: 192.168.40.100:3260,-1 Jul 03 09:45:48.750246 np0000004400 cinder-backup[101319]: Iface Name: default Jul 03 09:45:48.750246 np0000004400 cinder-backup[101319]: Target: iqn.2023-03.storpool.com:os--volume-72e07e1e-1567-4071-8204-c29cb26d2660 Jul 03 09:45:48.750246 np0000004400 cinder-backup[101319]: Portal: 192.168.40.100:3260,-1 Jul 03 09:45:48.750246 np0000004400 cinder-backup[101319]: Iface Name: default Jul 03 09:45:48.750246 np0000004400 cinder-backup[101319]: Target: iqn.2023-03.storpool.com:os--volume-d47f5d2f-dce5-42f7-a693-a654fd702622 Jul 03 09:45:48.750246 np0000004400 cinder-backup[101319]: Portal: 192.168.50.100:3260,-1 Jul 03 09:45:48.750246 np0000004400 cinder-backup[101319]: Iface Name: default Jul 03 09:45:48.750246 np0000004400 cinder-backup[101319]: Portal: 192.168.40.100:3260,-1 Jul 03 09:45:48.750246 np0000004400 cinder-backup[101319]: Iface Name: default Jul 03 09:45:48.750246 np0000004400 cinder-backup[101319]: Target: iqn.2023-03.storpool.com:os--volume-b1fc0d58-7747-4bcf-99a7-fb482aacb945 Jul 03 09:45:48.750246 np0000004400 cinder-backup[101319]: Portal: 192.168.40.100:3260,-1 Jul 03 09:45:48.750246 np0000004400 cinder-backup[101319]: Iface Name: default Jul 03 09:45:48.750246 np0000004400 cinder-backup[101319]: FIRMWARE: Jul 03 09:45:48.750246 np0000004400 cinder-backup[101319]: No targets found. Jul 03 09:45:48.750246 np0000004400 cinder-backup[101319]: stderr= {{(pid=101319) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jul 03 09:45:48.753830 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-327bc060-a9c1-4783-a969-79ebb1b84e7c tempest-VolumesBackupsTest-2142009639 None] Regex to get portals from discoverydb: ^SENDTARGETS: Jul 03 09:45:48.753830 np0000004400 cinder-backup[101319]: .*?^DiscoveryAddress: 192.168.40.100,3260.*? Jul 03 09:45:48.753830 np0000004400 cinder-backup[101319]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=101319) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:390}} Jul 03 09:45:48.753830 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-327bc060-a9c1-4783-a969-79ebb1b84e7c tempest-VolumesBackupsTest-2142009639 None] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-b1fc0d58-7747-4bcf-99a7-fb482aacb945', 0)] {{(pid=101319) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:858}} Jul 03 09:45:48.788687 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-327bc060-a9c1-4783-a969-79ebb1b84e7c tempest-VolumesBackupsTest-2142009639 None] iscsiadm ('-m', 'session'): stdout=tcp: [106] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b1fc0d58-7747-4bcf-99a7-fb482aacb945 (non-flash) Jul 03 09:45:48.788687 np0000004400 cinder-backup[101319]: tcp: [107] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-72e07e1e-1567-4071-8204-c29cb26d2660 (non-flash) Jul 03 09:45:48.788687 np0000004400 cinder-backup[101319]: tcp: [108] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-52be2cf8-1f6a-47e1-910d-17cdde3abb60 (non-flash) Jul 03 09:45:48.788687 np0000004400 cinder-backup[101319]: tcp: [49] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b2e4f10c-8033-4c54-95a1-dfe45d6357a3 (non-flash) Jul 03 09:45:48.788687 np0000004400 cinder-backup[101319]: tcp: [50] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b2e4f10c-8033-4c54-95a1-dfe45d6357a3 (non-flash) Jul 03 09:45:48.788687 np0000004400 cinder-backup[101319]: tcp: [82] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-76320525-737e-4f58-8523-63ec9abbdc64 (non-flash) Jul 03 09:45:48.788687 np0000004400 cinder-backup[101319]: tcp: [83] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-76320525-737e-4f58-8523-63ec9abbdc64 (non-flash) Jul 03 09:45:48.788687 np0000004400 cinder-backup[101319]: tcp: [97] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d47f5d2f-dce5-42f7-a693-a654fd702622 (non-flash) Jul 03 09:45:48.788687 np0000004400 cinder-backup[101319]: tcp: [98] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d47f5d2f-dce5-42f7-a693-a654fd702622 (non-flash) Jul 03 09:45:48.788687 np0000004400 cinder-backup[101319]: stderr= {{(pid=101319) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jul 03 09:45:48.789378 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-327bc060-a9c1-4783-a969-79ebb1b84e7c tempest-VolumesBackupsTest-2142009639 None] iscsi session list stdout=tcp: [106] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b1fc0d58-7747-4bcf-99a7-fb482aacb945 (non-flash) Jul 03 09:45:48.789378 np0000004400 cinder-backup[101319]: tcp: [107] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-72e07e1e-1567-4071-8204-c29cb26d2660 (non-flash) Jul 03 09:45:48.789378 np0000004400 cinder-backup[101319]: tcp: [108] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-52be2cf8-1f6a-47e1-910d-17cdde3abb60 (non-flash) Jul 03 09:45:48.789378 np0000004400 cinder-backup[101319]: tcp: [49] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b2e4f10c-8033-4c54-95a1-dfe45d6357a3 (non-flash) Jul 03 09:45:48.789378 np0000004400 cinder-backup[101319]: tcp: [50] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b2e4f10c-8033-4c54-95a1-dfe45d6357a3 (non-flash) Jul 03 09:45:48.789378 np0000004400 cinder-backup[101319]: tcp: [82] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-76320525-737e-4f58-8523-63ec9abbdc64 (non-flash) Jul 03 09:45:48.789378 np0000004400 cinder-backup[101319]: tcp: [83] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-76320525-737e-4f58-8523-63ec9abbdc64 (non-flash) Jul 03 09:45:48.789378 np0000004400 cinder-backup[101319]: tcp: [97] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d47f5d2f-dce5-42f7-a693-a654fd702622 (non-flash) Jul 03 09:45:48.789378 np0000004400 cinder-backup[101319]: tcp: [98] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d47f5d2f-dce5-42f7-a693-a654fd702622 (non-flash) Jul 03 09:45:48.789378 np0000004400 cinder-backup[101319]: stderr= {{(pid=101319) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jul 03 09:45:48.789758 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-327bc060-a9c1-4783-a969-79ebb1b84e7c tempest-VolumesBackupsTest-2142009639 None] Sessions list: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-b1fc0d58-7747-4bcf-99a7-fb482aacb945', '106'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-72e07e1e-1567-4071-8204-c29cb26d2660', '107'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-52be2cf8-1f6a-47e1-910d-17cdde3abb60', '108'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-b2e4f10c-8033-4c54-95a1-dfe45d6357a3', '49'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-b2e4f10c-8033-4c54-95a1-dfe45d6357a3', '50'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-76320525-737e-4f58-8523-63ec9abbdc64', '82'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-76320525-737e-4f58-8523-63ec9abbdc64', '83'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-d47f5d2f-dce5-42f7-a693-a654fd702622', '97'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-d47f5d2f-dce5-42f7-a693-a654fd702622', '98')] {{(pid=101319) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:866}} Jul 03 09:45:48.790245 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-327bc060-a9c1-4783-a969-79ebb1b84e7c tempest-VolumesBackupsTest-2142009639 None] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-b1fc0d58-7747-4bcf-99a7-fb482aacb945, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-b1fc0d58-7747-4bcf-99a7-fb482aacb945', '106')] {{(pid=101319) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}} Jul 03 09:45:48.792530 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-327bc060-a9c1-4783-a969-79ebb1b84e7c tempest-VolumesBackupsTest-2142009639 None] Resulting device map defaultdict(. at 0x7e76e71a5a80>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-b1fc0d58-7747-4bcf-99a7-fb482aacb945'): ({'sdj'}, set())}) {{(pid=101319) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:912}} Jul 03 09:45:48.792864 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.linuxscsi [None req-327bc060-a9c1-4783-a969-79ebb1b84e7c tempest-VolumesBackupsTest-2142009639 None] Removing single pathed devices sdj {{(pid=101319) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}} Jul 03 09:45:48.798808 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-6ef928da-3670-4523-823a-3443e2d91692 tempest-VolumesBackupsTest-118275719 None] backup MD5 for volume_72e07e1e-1567-4071-8204-c29cb26d2660/20260703094546/az_nova_backup_8b377d15-3804-4a9c-ad2d-e8e1359c0ee5-00002: 25e317773f308e446cc84c503a6d1f85 {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 09:45:48.798991 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-6ef928da-3670-4523-823a-3443e2d91692 tempest-VolumesBackupsTest-118275719 None] Calling eventlet.sleep(0) {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 09:45:48.808112 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.linuxscsi [None req-327bc060-a9c1-4783-a969-79ebb1b84e7c tempest-VolumesBackupsTest-2142009639 None] Flushing IO for device /dev/sdj {{(pid=101319) flush_device_io /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:461}} Jul 03 09:45:48.818449 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.linuxscsi [None req-327bc060-a9c1-4783-a969-79ebb1b84e7c tempest-VolumesBackupsTest-2142009639 None] Remove SCSI device /dev/sdj with /sys/block/sdj/device/delete {{(pid=101319) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}} Jul 03 09:45:48.871014 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.linuxscsi [None req-327bc060-a9c1-4783-a969-79ebb1b84e7c tempest-VolumesBackupsTest-2142009639 None] Checking to see if SCSI volumes sdj have been removed. {{(pid=101319) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}} Jul 03 09:45:48.871014 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.linuxscsi [None req-327bc060-a9c1-4783-a969-79ebb1b84e7c tempest-VolumesBackupsTest-2142009639 None] SCSI volumes sdj have been removed. {{(pid=101319) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}} Jul 03 09:45:48.872824 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.linuxscsi [None req-327bc060-a9c1-4783-a969-79ebb1b84e7c tempest-VolumesBackupsTest-2142009639 None] Checking to see if device paths {'sdj'} are still under multipathd monitoring {{(pid=101319) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}} Jul 03 09:45:48.891656 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.linuxscsi [None req-327bc060-a9c1-4783-a969-79ebb1b84e7c tempest-VolumesBackupsTest-2142009639 None] Device paths {'sdj'} have been removed from multipathd monitoring. {{(pid=101319) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}} Jul 03 09:45:48.891941 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-327bc060-a9c1-4783-a969-79ebb1b84e7c tempest-VolumesBackupsTest-2142009639 None] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-b1fc0d58-7747-4bcf-99a7-fb482aacb945')] {{(pid=101319) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1225}} Jul 03 09:45:48.905655 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-327bc060-a9c1-4783-a969-79ebb1b84e7c tempest-VolumesBackupsTest-2142009639 None] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=101319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 03 09:45:48.949579 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-327bc060-a9c1-4783-a969-79ebb1b84e7c tempest-VolumesBackupsTest-2142009639 None] iscsiadm ('--logout',): stdout=Logging out of session [sid: 106, target: iqn.2023-03.storpool.com:os--volume-b1fc0d58-7747-4bcf-99a7-fb482aacb945, portal: 192.168.40.100,3260] Jul 03 09:45:48.949579 np0000004400 cinder-backup[101319]: Logout of [sid: 106, target: iqn.2023-03.storpool.com:os--volume-b1fc0d58-7747-4bcf-99a7-fb482aacb945, portal: 192.168.40.100,3260] successful. Jul 03 09:45:48.949579 np0000004400 cinder-backup[101319]: stderr= {{(pid=101319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 03 09:45:48.969722 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-327bc060-a9c1-4783-a969-79ebb1b84e7c tempest-VolumesBackupsTest-2142009639 None] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=101319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 03 09:45:48.970028 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.base [None req-327bc060-a9c1-4783-a969-79ebb1b84e7c tempest-VolumesBackupsTest-2142009639 None] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.243s {{(pid=101319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jul 03 09:45:48.970193 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-327bc060-a9c1-4783-a969-79ebb1b84e7c tempest-VolumesBackupsTest-2142009639 None] <== disconnect_volume: return (2248ms) None {{(pid=101319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}} Jul 03 09:45:49.090191 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-6ef928da-3670-4523-823a-3443e2d91692 tempest-VolumesBackupsTest-118275719 None] Backing up chunk of data from volume. {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 09:45:49.127037 np0000004400 sudo[137462]: pam_unix(sudo:session): session closed for user root Jul 03 09:45:49.131066 np0000004400 cinder-backup[101319]: DEBUG oslo_concurrency.processutils [None req-9a399181-d884-4e46-a928-590766ad92c9 tempest-ProjectAdminTests33-1900627284 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chown 1002 /dev/sdc" returned: 0 in 0.417s {{(pid=101319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 09:45:49.144064 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-9a399181-d884-4e46-a928-590766ad92c9 tempest-ProjectAdminTests33-1900627284 None] _create_container started, container: volumebackups,backup: ec711725-25f0-4982-afe6-3b48b0e50917. {{(pid=101319) _create_container /opt/stack/cinder/cinder/backup/chunkeddriver.py:249}} Jul 03 09:45:49.194037 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.drivers.swift [None req-9a399181-d884-4e46-a928-590766ad92c9 tempest-ProjectAdminTests33-1900627284 None] generate_object_name_prefix: volume_52be2cf8-1f6a-47e1-910d-17cdde3abb60/20260703094549/az_nova_backup_ec711725-25f0-4982-afe6-3b48b0e50917 {{(pid=101319) _generate_object_name_prefix /opt/stack/cinder/cinder/backup/drivers/swift.py:452}} Jul 03 09:45:49.206557 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-9a399181-d884-4e46-a928-590766ad92c9 tempest-ProjectAdminTests33-1900627284 None] starting backup of volume: 52be2cf8-1f6a-47e1-910d-17cdde3abb60, volume size: 1073741824, object names prefix volume_52be2cf8-1f6a-47e1-910d-17cdde3abb60/20260703094549/az_nova_backup_ec711725-25f0-4982-afe6-3b48b0e50917, availability zone: nova {{(pid=101319) _prepare_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:359}} Jul 03 09:45:49.381891 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-6ef928da-3670-4523-823a-3443e2d91692 tempest-VolumesBackupsTest-118275719 None] Compressed 52428800 bytes of data to 1362154 bytes using zlib. {{(pid=101319) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 09:45:49.382226 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-6ef928da-3670-4523-823a-3443e2d91692 tempest-VolumesBackupsTest-118275719 None] About to put_object {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 09:45:49.399179 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-9a399181-d884-4e46-a928-590766ad92c9 tempest-ProjectAdminTests33-1900627284 None] Backing up chunk of data from volume. {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 09:45:49.502145 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-6ef928da-3670-4523-823a-3443e2d91692 tempest-VolumesBackupsTest-118275719 None] backup MD5 for volume_72e07e1e-1567-4071-8204-c29cb26d2660/20260703094546/az_nova_backup_8b377d15-3804-4a9c-ad2d-e8e1359c0ee5-00003: a35891500449df17e893f84bd88472fb {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 09:45:49.502322 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-6ef928da-3670-4523-823a-3443e2d91692 tempest-VolumesBackupsTest-118275719 None] Calling eventlet.sleep(0) {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 09:45:49.653898 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-9a399181-d884-4e46-a928-590766ad92c9 tempest-ProjectAdminTests33-1900627284 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101319) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 09:45:49.653898 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-9a399181-d884-4e46-a928-590766ad92c9 tempest-ProjectAdminTests33-1900627284 None] About to put_object {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 09:45:49.717046 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-6ef928da-3670-4523-823a-3443e2d91692 tempest-VolumesBackupsTest-118275719 None] Backing up chunk of data from volume. {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 09:45:49.775740 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-9a399181-d884-4e46-a928-590766ad92c9 tempest-ProjectAdminTests33-1900627284 None] backup MD5 for volume_52be2cf8-1f6a-47e1-910d-17cdde3abb60/20260703094549/az_nova_backup_ec711725-25f0-4982-afe6-3b48b0e50917-00001: 25e317773f308e446cc84c503a6d1f85 {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 09:45:49.775984 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-9a399181-d884-4e46-a928-590766ad92c9 tempest-ProjectAdminTests33-1900627284 None] Calling eventlet.sleep(0) {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 09:45:49.957906 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-9a399181-d884-4e46-a928-590766ad92c9 tempest-ProjectAdminTests33-1900627284 None] Backing up chunk of data from volume. {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 09:45:49.988161 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-6ef928da-3670-4523-823a-3443e2d91692 tempest-VolumesBackupsTest-118275719 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101319) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 09:45:49.988287 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-6ef928da-3670-4523-823a-3443e2d91692 tempest-VolumesBackupsTest-118275719 None] About to put_object {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 09:45:50.009583 np0000004400 cinder-backup[101319]: INFO cinder.backup.manager [None req-327bc060-a9c1-4783-a969-79ebb1b84e7c tempest-VolumesBackupsTest-2142009639 None] Create backup finished. backup: e353b2b2-ecff-4fe0-8148-bf9d1d84a8bf. Jul 03 09:45:50.091624 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-6ef928da-3670-4523-823a-3443e2d91692 tempest-VolumesBackupsTest-118275719 None] backup MD5 for volume_72e07e1e-1567-4071-8204-c29cb26d2660/20260703094546/az_nova_backup_8b377d15-3804-4a9c-ad2d-e8e1359c0ee5-00004: 25e317773f308e446cc84c503a6d1f85 {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 09:45:50.091801 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-6ef928da-3670-4523-823a-3443e2d91692 tempest-VolumesBackupsTest-118275719 None] Calling eventlet.sleep(0) {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 09:45:50.232005 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-9a399181-d884-4e46-a928-590766ad92c9 tempest-ProjectAdminTests33-1900627284 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101319) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 09:45:50.232250 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-9a399181-d884-4e46-a928-590766ad92c9 tempest-ProjectAdminTests33-1900627284 None] About to put_object {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 09:45:50.334287 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-6ef928da-3670-4523-823a-3443e2d91692 tempest-VolumesBackupsTest-118275719 None] Backing up chunk of data from volume. {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 09:45:50.384221 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-9a399181-d884-4e46-a928-590766ad92c9 tempest-ProjectAdminTests33-1900627284 None] backup MD5 for volume_52be2cf8-1f6a-47e1-910d-17cdde3abb60/20260703094549/az_nova_backup_ec711725-25f0-4982-afe6-3b48b0e50917-00002: 25e317773f308e446cc84c503a6d1f85 {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 09:45:50.384463 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-9a399181-d884-4e46-a928-590766ad92c9 tempest-ProjectAdminTests33-1900627284 None] Calling eventlet.sleep(0) {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 09:45:50.575241 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-9a399181-d884-4e46-a928-590766ad92c9 tempest-ProjectAdminTests33-1900627284 None] Backing up chunk of data from volume. {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 09:45:50.603809 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-6ef928da-3670-4523-823a-3443e2d91692 tempest-VolumesBackupsTest-118275719 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101319) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 09:45:50.603909 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-6ef928da-3670-4523-823a-3443e2d91692 tempest-VolumesBackupsTest-118275719 None] About to put_object {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 09:45:50.715560 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-6ef928da-3670-4523-823a-3443e2d91692 tempest-VolumesBackupsTest-118275719 None] backup MD5 for volume_72e07e1e-1567-4071-8204-c29cb26d2660/20260703094546/az_nova_backup_8b377d15-3804-4a9c-ad2d-e8e1359c0ee5-00005: 25e317773f308e446cc84c503a6d1f85 {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 09:45:50.715840 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-6ef928da-3670-4523-823a-3443e2d91692 tempest-VolumesBackupsTest-118275719 None] Calling eventlet.sleep(0) {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 09:45:50.829429 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-9a399181-d884-4e46-a928-590766ad92c9 tempest-ProjectAdminTests33-1900627284 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101319) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 09:45:50.829429 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-9a399181-d884-4e46-a928-590766ad92c9 tempest-ProjectAdminTests33-1900627284 None] About to put_object {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 09:45:50.911565 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-6ef928da-3670-4523-823a-3443e2d91692 tempest-VolumesBackupsTest-118275719 None] Backing up chunk of data from volume. {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 09:45:50.959509 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-9a399181-d884-4e46-a928-590766ad92c9 tempest-ProjectAdminTests33-1900627284 None] backup MD5 for volume_52be2cf8-1f6a-47e1-910d-17cdde3abb60/20260703094549/az_nova_backup_ec711725-25f0-4982-afe6-3b48b0e50917-00003: 25e317773f308e446cc84c503a6d1f85 {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 09:45:50.959682 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-9a399181-d884-4e46-a928-590766ad92c9 tempest-ProjectAdminTests33-1900627284 None] Calling eventlet.sleep(0) {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 09:45:51.144880 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-9a399181-d884-4e46-a928-590766ad92c9 tempest-ProjectAdminTests33-1900627284 None] Backing up chunk of data from volume. {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 09:45:51.185956 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-6ef928da-3670-4523-823a-3443e2d91692 tempest-VolumesBackupsTest-118275719 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101319) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 09:45:51.186186 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-6ef928da-3670-4523-823a-3443e2d91692 tempest-VolumesBackupsTest-118275719 None] About to put_object {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 09:45:51.289082 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-6ef928da-3670-4523-823a-3443e2d91692 tempest-VolumesBackupsTest-118275719 None] backup MD5 for volume_72e07e1e-1567-4071-8204-c29cb26d2660/20260703094546/az_nova_backup_8b377d15-3804-4a9c-ad2d-e8e1359c0ee5-00006: 25e317773f308e446cc84c503a6d1f85 {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 09:45:51.289272 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-6ef928da-3670-4523-823a-3443e2d91692 tempest-VolumesBackupsTest-118275719 None] Calling eventlet.sleep(0) {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 09:45:51.396098 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-9a399181-d884-4e46-a928-590766ad92c9 tempest-ProjectAdminTests33-1900627284 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101319) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 09:45:51.396223 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-9a399181-d884-4e46-a928-590766ad92c9 tempest-ProjectAdminTests33-1900627284 None] About to put_object {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 09:45:51.501680 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-6ef928da-3670-4523-823a-3443e2d91692 tempest-VolumesBackupsTest-118275719 None] Backing up chunk of data from volume. {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 09:45:51.528020 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-9a399181-d884-4e46-a928-590766ad92c9 tempest-ProjectAdminTests33-1900627284 None] backup MD5 for volume_52be2cf8-1f6a-47e1-910d-17cdde3abb60/20260703094549/az_nova_backup_ec711725-25f0-4982-afe6-3b48b0e50917-00004: 25e317773f308e446cc84c503a6d1f85 {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 09:45:51.528205 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-9a399181-d884-4e46-a928-590766ad92c9 tempest-ProjectAdminTests33-1900627284 None] Calling eventlet.sleep(0) {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 09:45:51.724353 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-9a399181-d884-4e46-a928-590766ad92c9 tempest-ProjectAdminTests33-1900627284 None] Backing up chunk of data from volume. {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 09:45:51.751895 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-6ef928da-3670-4523-823a-3443e2d91692 tempest-VolumesBackupsTest-118275719 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101319) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 09:45:51.752041 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-6ef928da-3670-4523-823a-3443e2d91692 tempest-VolumesBackupsTest-118275719 None] About to put_object {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 09:45:51.876986 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-6ef928da-3670-4523-823a-3443e2d91692 tempest-VolumesBackupsTest-118275719 None] backup MD5 for volume_72e07e1e-1567-4071-8204-c29cb26d2660/20260703094546/az_nova_backup_8b377d15-3804-4a9c-ad2d-e8e1359c0ee5-00007: 25e317773f308e446cc84c503a6d1f85 {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 09:45:51.877396 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-6ef928da-3670-4523-823a-3443e2d91692 tempest-VolumesBackupsTest-118275719 None] Calling eventlet.sleep(0) {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 09:45:51.992203 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-9a399181-d884-4e46-a928-590766ad92c9 tempest-ProjectAdminTests33-1900627284 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101319) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 09:45:51.992371 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-9a399181-d884-4e46-a928-590766ad92c9 tempest-ProjectAdminTests33-1900627284 None] About to put_object {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 09:45:52.068659 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-6ef928da-3670-4523-823a-3443e2d91692 tempest-VolumesBackupsTest-118275719 None] Backing up chunk of data from volume. {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 09:45:52.116868 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-9a399181-d884-4e46-a928-590766ad92c9 tempest-ProjectAdminTests33-1900627284 None] backup MD5 for volume_52be2cf8-1f6a-47e1-910d-17cdde3abb60/20260703094549/az_nova_backup_ec711725-25f0-4982-afe6-3b48b0e50917-00005: 25e317773f308e446cc84c503a6d1f85 {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 09:45:52.117092 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-9a399181-d884-4e46-a928-590766ad92c9 tempest-ProjectAdminTests33-1900627284 None] Calling eventlet.sleep(0) {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 09:45:52.255092 np0000004400 cinder-backup[101319]: INFO cinder.backup.manager [None req-888e3f93-d9e9-47ce-a144-629fa57e40f8 tempest-VolumesBackupsTest-2142009639 None] Restore backup started, backup: e353b2b2-ecff-4fe0-8148-bf9d1d84a8bf volume: 2a67969a-282a-431e-9fb2-763d3c62eab0. Jul 03 09:45:52.269707 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.drivers.swift [None req-888e3f93-d9e9-47ce-a144-629fa57e40f8 tempest-VolumesBackupsTest-2142009639 None] Using swift URL https://10.4.3.95:8080/v1/AUTH_59044e18a5b24b19a7b9b8a380f2e1a0 {{(pid=101319) initialize /opt/stack/cinder/cinder/backup/drivers/swift.py:300}} Jul 03 09:45:52.269935 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.drivers.swift [None req-888e3f93-d9e9-47ce-a144-629fa57e40f8 tempest-VolumesBackupsTest-2142009639 None] Connect to https://10.4.3.95:8080/v1/AUTH_ in "per_user" mode {{(pid=101319) initialize /opt/stack/cinder/cinder/backup/drivers/swift.py:301}} Jul 03 09:45:52.271150 np0000004400 cinder-backup[101319]: DEBUG os_brick.utils [None req-888e3f93-d9e9-47ce-a144-629fa57e40f8 tempest-VolumesBackupsTest-2142009639 None] ==> get_connector_properties: call "{'root_helper': 'sudo cinder-rootwrap /etc/cinder/rootwrap.conf', 'my_ip': '10.4.3.95', 'multipath': False, 'enforce_multipath': False, 'host': None, 'execute': None}" {{(pid=101319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}} Jul 03 09:45:52.284231 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.scaleio [None req-888e3f93-d9e9-47ce-a144-629fa57e40f8 tempest-VolumesBackupsTest-2142009639 None] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=101319) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}} Jul 03 09:45:52.314238 np0000004400 cinder-backup[101319]: DEBUG oslo_concurrency.processutils [None req-888e3f93-d9e9-47ce-a144-629fa57e40f8 tempest-VolumesBackupsTest-2142009639 None] Running cmd (subprocess): nvme version {{(pid=101319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 09:45:52.336870 np0000004400 cinder-backup[101319]: DEBUG oslo_concurrency.processutils [None req-888e3f93-d9e9-47ce-a144-629fa57e40f8 tempest-VolumesBackupsTest-2142009639 None] 'nvme version' failed. Not Retrying. {{(pid=101319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 03 09:45:52.337153 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.nvmeof [None req-888e3f93-d9e9-47ce-a144-629fa57e40f8 tempest-VolumesBackupsTest-2142009639 None] nvme not present on system {{(pid=101319) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}} Jul 03 09:45:52.340801 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-9a399181-d884-4e46-a928-590766ad92c9 tempest-ProjectAdminTests33-1900627284 None] Backing up chunk of data from volume. {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 09:45:52.345492 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-6ef928da-3670-4523-823a-3443e2d91692 tempest-VolumesBackupsTest-118275719 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101319) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 09:45:52.345651 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-6ef928da-3670-4523-823a-3443e2d91692 tempest-VolumesBackupsTest-118275719 None] About to put_object {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 09:45:52.346719 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.lightos [None req-888e3f93-d9e9-47ce-a144-629fa57e40f8 tempest-VolumesBackupsTest-2142009639 None] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=101319) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}} Jul 03 09:45:52.347860 np0000004400 cinder-backup[101319]: INFO os_brick.initiator.connectors.lightos [None req-888e3f93-d9e9-47ce-a144-629fa57e40f8 tempest-VolumesBackupsTest-2142009639 None] Current host hostNQN and IP(s) are ['10.4.3.95', 'fe80::f816:3eff:fe47:268c', '192.168.40.6', 'fe80::f816:3eff:febf:7be2', '192.168.50.6', 'fe80::f816:3eff:fe99:8914', '192.168.10.6', 'fe80::f816:3eff:fe2f:e696', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::bc9d:84ff:fec2:6b49', 'fe80::fc16:3eff:fe36:77bf', 'fe80::4c47:1ff:fe64:1879', 'fe80::fc16:3eff:fea0:4147', 'fe80::b0cf:48ff:fe29:caf0', 'fe80::fc16:3eff:fe91:aa0', 'fe80::fc16:3eff:fe3b:46af', 'fe80::28c1:27ff:fe3c:5528', 'fe80::fc16:3eff:fe6b:be86', 'fe80::4007:baff:fe0f:8f44'] Jul 03 09:45:52.347978 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.lightos [None req-888e3f93-d9e9-47ce-a144-629fa57e40f8 tempest-VolumesBackupsTest-2142009639 None] LIGHTOS: did not find dsc, continuing anyway. {{(pid=101319) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}} Jul 03 09:45:52.348120 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.lightos [None req-888e3f93-d9e9-47ce-a144-629fa57e40f8 tempest-VolumesBackupsTest-2142009639 None] LIGHTOS: no hostnqn found. {{(pid=101319) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}} Jul 03 09:45:52.348351 np0000004400 cinder-backup[101319]: DEBUG os_brick.utils [None req-888e3f93-d9e9-47ce-a144-629fa57e40f8 tempest-VolumesBackupsTest-2142009639 None] <== get_connector_properties: return (77ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.95', 'host': 'np0000004400', 'multipath': False, 'enforce_multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:ae7e5bb0ebe6', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': '6b284368-d0ba-4d18-af6f-4998d3955c52', 'nvme_native_multipath': False} {{(pid=101319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}} Jul 03 09:45:52.457598 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-6ef928da-3670-4523-823a-3443e2d91692 tempest-VolumesBackupsTest-118275719 None] backup MD5 for volume_72e07e1e-1567-4071-8204-c29cb26d2660/20260703094546/az_nova_backup_8b377d15-3804-4a9c-ad2d-e8e1359c0ee5-00008: 25e317773f308e446cc84c503a6d1f85 {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 09:45:52.457757 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-6ef928da-3670-4523-823a-3443e2d91692 tempest-VolumesBackupsTest-118275719 None] Calling eventlet.sleep(0) {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 09:45:52.494055 np0000004400 cinder-backup[101319]: DEBUG oslo_db.sqlalchemy.engines [None req-6ef928da-3670-4523-823a-3443e2d91692 tempest-VolumesBackupsTest-118275719 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=101319) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 03 09:45:52.588963 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-9a399181-d884-4e46-a928-590766ad92c9 tempest-ProjectAdminTests33-1900627284 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101319) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 09:45:52.589148 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-9a399181-d884-4e46-a928-590766ad92c9 tempest-ProjectAdminTests33-1900627284 None] About to put_object {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 09:45:52.672462 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-6ef928da-3670-4523-823a-3443e2d91692 tempest-VolumesBackupsTest-118275719 None] Backing up chunk of data from volume. {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 09:45:52.726975 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-9a399181-d884-4e46-a928-590766ad92c9 tempest-ProjectAdminTests33-1900627284 None] backup MD5 for volume_52be2cf8-1f6a-47e1-910d-17cdde3abb60/20260703094549/az_nova_backup_ec711725-25f0-4982-afe6-3b48b0e50917-00006: 25e317773f308e446cc84c503a6d1f85 {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 09:45:52.726975 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-9a399181-d884-4e46-a928-590766ad92c9 tempest-ProjectAdminTests33-1900627284 None] Calling eventlet.sleep(0) {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 09:45:52.997022 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-9a399181-d884-4e46-a928-590766ad92c9 tempest-ProjectAdminTests33-1900627284 None] Backing up chunk of data from volume. {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 09:45:53.043057 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-6ef928da-3670-4523-823a-3443e2d91692 tempest-VolumesBackupsTest-118275719 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101319) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 09:45:53.043057 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-6ef928da-3670-4523-823a-3443e2d91692 tempest-VolumesBackupsTest-118275719 None] About to put_object {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 09:45:53.152955 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-6ef928da-3670-4523-823a-3443e2d91692 tempest-VolumesBackupsTest-118275719 None] backup MD5 for volume_72e07e1e-1567-4071-8204-c29cb26d2660/20260703094546/az_nova_backup_8b377d15-3804-4a9c-ad2d-e8e1359c0ee5-00009: 25e317773f308e446cc84c503a6d1f85 {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 09:45:53.153116 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-6ef928da-3670-4523-823a-3443e2d91692 tempest-VolumesBackupsTest-118275719 None] Calling eventlet.sleep(0) {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 09:45:53.265886 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-9a399181-d884-4e46-a928-590766ad92c9 tempest-ProjectAdminTests33-1900627284 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101319) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 09:45:53.266026 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-9a399181-d884-4e46-a928-590766ad92c9 tempest-ProjectAdminTests33-1900627284 None] About to put_object {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 09:45:53.343418 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-6ef928da-3670-4523-823a-3443e2d91692 tempest-VolumesBackupsTest-118275719 None] Backing up chunk of data from volume. {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 09:45:53.358917 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connector [None req-888e3f93-d9e9-47ce-a144-629fa57e40f8 tempest-VolumesBackupsTest-2142009639 None] Factory for iscsi on None {{(pid=101319) factory /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connector.py:243}} Jul 03 09:45:53.359274 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-888e3f93-d9e9-47ce-a144-629fa57e40f8 tempest-VolumesBackupsTest-2142009639 None] ==> connect_volume: call "{'self': , 'connection_properties': {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-2a67969a-282a-431e-9fb2-763d3c62eab0', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '2a67969a-282a-431e-9fb2-763d3c62eab0', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': False}}" {{(pid=101319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}} Jul 03 09:45:53.359448 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.base [None req-888e3f93-d9e9-47ce-a144-629fa57e40f8 tempest-VolumesBackupsTest-2142009639 None] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=101319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jul 03 09:45:53.359887 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.base [None req-888e3f93-d9e9-47ce-a144-629fa57e40f8 tempest-VolumesBackupsTest-2142009639 None] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.000s {{(pid=101319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jul 03 09:45:53.360081 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.base [None req-888e3f93-d9e9-47ce-a144-629fa57e40f8 tempest-VolumesBackupsTest-2142009639 None] Connection properties {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-2a67969a-282a-431e-9fb2-763d3c62eab0', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '2a67969a-282a-431e-9fb2-763d3c62eab0', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': False} {{(pid=101319) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}} Jul 03 09:45:53.369954 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-9a399181-d884-4e46-a928-590766ad92c9 tempest-ProjectAdminTests33-1900627284 None] backup MD5 for volume_52be2cf8-1f6a-47e1-910d-17cdde3abb60/20260703094549/az_nova_backup_ec711725-25f0-4982-afe6-3b48b0e50917-00007: 25e317773f308e446cc84c503a6d1f85 {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 09:45:53.370129 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-9a399181-d884-4e46-a928-590766ad92c9 tempest-ProjectAdminTests33-1900627284 None] Calling eventlet.sleep(0) {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 09:45:53.372459 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.base [None req-888e3f93-d9e9-47ce-a144-629fa57e40f8 tempest-VolumesBackupsTest-2142009639 None] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-2a67969a-282a-431e-9fb2-763d3c62eab0" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=101319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jul 03 09:45:53.373134 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.base [None req-888e3f93-d9e9-47ce-a144-629fa57e40f8 tempest-VolumesBackupsTest-2142009639 None] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-2a67969a-282a-431e-9fb2-763d3c62eab0" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=101319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jul 03 09:45:53.373134 np0000004400 cinder-backup[101319]: INFO os_brick.initiator.connectors.iscsi [None req-888e3f93-d9e9-47ce-a144-629fa57e40f8 tempest-VolumesBackupsTest-2142009639 None] Trying to connect to iSCSI portal 192.168.40.100:3260 Jul 03 09:45:53.386878 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-888e3f93-d9e9-47ce-a144-629fa57e40f8 tempest-VolumesBackupsTest-2142009639 None] iscsiadm (): stdout= stderr=iscsiadm: No records found Jul 03 09:45:53.386878 np0000004400 cinder-backup[101319]: {{(pid=101319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 03 09:45:53.402427 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-888e3f93-d9e9-47ce-a144-629fa57e40f8 tempest-VolumesBackupsTest-2142009639 None] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-2a67969a-282a-431e-9fb2-763d3c62eab0] added Jul 03 09:45:53.402427 np0000004400 cinder-backup[101319]: stderr=iscsiadm: Config file line 363 does not have value Jul 03 09:45:53.402427 np0000004400 cinder-backup[101319]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs' Jul 03 09:45:53.402427 np0000004400 cinder-backup[101319]: iscsiadm: Config file line 363 does not have value Jul 03 09:45:53.402427 np0000004400 cinder-backup[101319]: iscsiadm: Config file line 363 does not have value Jul 03 09:45:53.402427 np0000004400 cinder-backup[101319]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs' Jul 03 09:45:53.402427 np0000004400 cinder-backup[101319]: {{(pid=101319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 03 09:45:53.402427 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-888e3f93-d9e9-47ce-a144-629fa57e40f8 tempest-VolumesBackupsTest-2142009639 None] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=101319) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}} Jul 03 09:45:53.402427 np0000004400 cinder-backup[101319]: DEBUG os_brick.utils [None req-888e3f93-d9e9-47ce-a144-629fa57e40f8 tempest-VolumesBackupsTest-2142009639 None] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0271(s), this was the 1st time calling it. {{(pid=101319) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}} Jul 03 09:45:53.402427 np0000004400 cinder-backup[101319]: DEBUG os_brick.utils [None req-888e3f93-d9e9-47ce-a144-629fa57e40f8 tempest-VolumesBackupsTest-2142009639 None] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=101319) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}} Jul 03 09:45:53.554863 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-9a399181-d884-4e46-a928-590766ad92c9 tempest-ProjectAdminTests33-1900627284 None] Backing up chunk of data from volume. {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 09:45:53.599449 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-6ef928da-3670-4523-823a-3443e2d91692 tempest-VolumesBackupsTest-118275719 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101319) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 09:45:53.599449 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-6ef928da-3670-4523-823a-3443e2d91692 tempest-VolumesBackupsTest-118275719 None] About to put_object {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 09:45:53.707164 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-6ef928da-3670-4523-823a-3443e2d91692 tempest-VolumesBackupsTest-118275719 None] backup MD5 for volume_72e07e1e-1567-4071-8204-c29cb26d2660/20260703094546/az_nova_backup_8b377d15-3804-4a9c-ad2d-e8e1359c0ee5-00010: 25e317773f308e446cc84c503a6d1f85 {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 09:45:53.707164 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-6ef928da-3670-4523-823a-3443e2d91692 tempest-VolumesBackupsTest-118275719 None] Calling eventlet.sleep(0) {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 09:45:53.817113 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-9a399181-d884-4e46-a928-590766ad92c9 tempest-ProjectAdminTests33-1900627284 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101319) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 09:45:53.817113 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-9a399181-d884-4e46-a928-590766ad92c9 tempest-ProjectAdminTests33-1900627284 None] About to put_object {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 09:45:53.896168 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-6ef928da-3670-4523-823a-3443e2d91692 tempest-VolumesBackupsTest-118275719 None] Backing up chunk of data from volume. {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 09:45:53.920430 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-9a399181-d884-4e46-a928-590766ad92c9 tempest-ProjectAdminTests33-1900627284 None] backup MD5 for volume_52be2cf8-1f6a-47e1-910d-17cdde3abb60/20260703094549/az_nova_backup_ec711725-25f0-4982-afe6-3b48b0e50917-00008: 25e317773f308e446cc84c503a6d1f85 {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 09:45:53.920430 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-9a399181-d884-4e46-a928-590766ad92c9 tempest-ProjectAdminTests33-1900627284 None] Calling eventlet.sleep(0) {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 09:45:54.100967 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-9a399181-d884-4e46-a928-590766ad92c9 tempest-ProjectAdminTests33-1900627284 None] Backing up chunk of data from volume. {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 09:45:54.140675 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-6ef928da-3670-4523-823a-3443e2d91692 tempest-VolumesBackupsTest-118275719 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101319) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 09:45:54.140675 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-6ef928da-3670-4523-823a-3443e2d91692 tempest-VolumesBackupsTest-118275719 None] About to put_object {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 09:45:54.270287 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-6ef928da-3670-4523-823a-3443e2d91692 tempest-VolumesBackupsTest-118275719 None] backup MD5 for volume_72e07e1e-1567-4071-8204-c29cb26d2660/20260703094546/az_nova_backup_8b377d15-3804-4a9c-ad2d-e8e1359c0ee5-00011: 25e317773f308e446cc84c503a6d1f85 {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 09:45:54.270287 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-6ef928da-3670-4523-823a-3443e2d91692 tempest-VolumesBackupsTest-118275719 None] Calling eventlet.sleep(0) {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 09:45:54.378899 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-9a399181-d884-4e46-a928-590766ad92c9 tempest-ProjectAdminTests33-1900627284 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101319) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 09:45:54.379507 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-9a399181-d884-4e46-a928-590766ad92c9 tempest-ProjectAdminTests33-1900627284 None] About to put_object {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 09:45:54.401816 np0000004400 cinder-backup[101319]: INFO os_brick.initiator.connectors.iscsi [None req-888e3f93-d9e9-47ce-a144-629fa57e40f8 tempest-VolumesBackupsTest-2142009639 None] Trying to connect to iSCSI portal 192.168.40.100:3260 Jul 03 09:45:54.424082 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-888e3f93-d9e9-47ce-a144-629fa57e40f8 tempest-VolumesBackupsTest-2142009639 None] iscsiadm (): stdout=# BEGIN RECORD 2.1.9 Jul 03 09:45:54.424082 np0000004400 cinder-backup[101319]: node.name = iqn.2023-03.storpool.com:os--volume-2a67969a-282a-431e-9fb2-763d3c62eab0 Jul 03 09:45:54.424082 np0000004400 cinder-backup[101319]: node.tpgt = -1 Jul 03 09:45:54.424082 np0000004400 cinder-backup[101319]: node.startup = manual Jul 03 09:45:54.424082 np0000004400 cinder-backup[101319]: node.leading_login = No Jul 03 09:45:54.424082 np0000004400 cinder-backup[101319]: iface.iscsi_ifacename = default Jul 03 09:45:54.424082 np0000004400 cinder-backup[101319]: iface.net_ifacename = Jul 03 09:45:54.424082 np0000004400 cinder-backup[101319]: iface.ipaddress = Jul 03 09:45:54.424082 np0000004400 cinder-backup[101319]: iface.prefix_len = 0 Jul 03 09:45:54.424082 np0000004400 cinder-backup[101319]: iface.hwaddress = Jul 03 09:45:54.424082 np0000004400 cinder-backup[101319]: iface.transport_name = tcp Jul 03 09:45:54.424082 np0000004400 cinder-backup[101319]: iface.initiatorname = Jul 03 09:45:54.424082 np0000004400 cinder-backup[101319]: iface.state = Jul 03 09:45:54.424082 np0000004400 cinder-backup[101319]: iface.vlan_id = 0 Jul 03 09:45:54.424082 np0000004400 cinder-backup[101319]: iface.vlan_priority = 0 Jul 03 09:45:54.424082 np0000004400 cinder-backup[101319]: iface.vlan_state = Jul 03 09:45:54.424082 np0000004400 cinder-backup[101319]: iface.iface_num = 0 Jul 03 09:45:54.424082 np0000004400 cinder-backup[101319]: iface.mtu = 0 Jul 03 09:45:54.424082 np0000004400 cinder-backup[101319]: iface.port = 0 Jul 03 09:45:54.424082 np0000004400 cinder-backup[101319]: iface.bootproto = Jul 03 09:45:54.424082 np0000004400 cinder-backup[101319]: iface.subnet_mask = Jul 03 09:45:54.424082 np0000004400 cinder-backup[101319]: iface.gateway = Jul 03 09:45:54.424082 np0000004400 cinder-backup[101319]: iface.dhcp_alt_client_id_state = Jul 03 09:45:54.424082 np0000004400 cinder-backup[101319]: iface.dhcp_alt_client_id = Jul 03 09:45:54.424082 np0000004400 cinder-backup[101319]: iface.dhcp_dns = Jul 03 09:45:54.424082 np0000004400 cinder-backup[101319]: iface.dhcp_learn_iqn = Jul 03 09:45:54.424082 np0000004400 cinder-backup[101319]: iface.dhcp_req_vendor_id_state = Jul 03 09:45:54.424082 np0000004400 cinder-backup[101319]: iface.dhcp_vendor_id_state = Jul 03 09:45:54.424082 np0000004400 cinder-backup[101319]: iface.dhcp_vendor_id = Jul 03 09:45:54.424082 np0000004400 cinder-backup[101319]: iface.dhcp_slp_da = Jul 03 09:45:54.424082 np0000004400 cinder-backup[101319]: iface.fragmentation = Jul 03 09:45:54.424082 np0000004400 cinder-backup[101319]: iface.gratuitous_arp = Jul 03 09:45:54.424082 np0000004400 cinder-backup[101319]: iface.incoming_forwarding = Jul 03 09:45:54.424082 np0000004400 cinder-backup[101319]: iface.tos_state = Jul 03 09:45:54.424082 np0000004400 cinder-backup[101319]: iface.tos = 0 Jul 03 09:45:54.424082 np0000004400 cinder-backup[101319]: iface.ttl = 0 Jul 03 09:45:54.424082 np0000004400 cinder-backup[101319]: iface.delayed_ack = Jul 03 09:45:54.424082 np0000004400 cinder-backup[101319]: iface.tcp_nagle = Jul 03 09:45:54.424082 np0000004400 cinder-backup[101319]: iface.tcp_wsf_state = Jul 03 09:45:54.424082 np0000004400 cinder-backup[101319]: iface.tcp_wsf = 0 Jul 03 09:45:54.424082 np0000004400 cinder-backup[101319]: iface.tcp_timer_scale = 0 Jul 03 09:45:54.424082 np0000004400 cinder-backup[101319]: iface.tcp_timestamp = Jul 03 09:45:54.424082 np0000004400 cinder-backup[101319]: iface.redirect = Jul 03 09:45:54.424082 np0000004400 cinder-backup[101319]: iface.def_task_mgmt_timeout = 0 Jul 03 09:45:54.424082 np0000004400 cinder-backup[101319]: iface.header_digest = Jul 03 09:45:54.424082 np0000004400 cinder-backup[101319]: iface.data_digest = Jul 03 09:45:54.424082 np0000004400 cinder-backup[101319]: iface.immediate_data = Jul 03 09:45:54.424082 np0000004400 cinder-backup[101319]: iface.initial_r2t = Jul 03 09:45:54.424082 np0000004400 cinder-backup[101319]: iface.data_seq_inorder = Jul 03 09:45:54.424082 np0000004400 cinder-backup[101319]: iface.data_pdu_inorder = Jul 03 09:45:54.424082 np0000004400 cinder-backup[101319]: iface.erl = 0 Jul 03 09:45:54.424082 np0000004400 cinder-backup[101319]: iface.max_receive_data_len = 0 Jul 03 09:45:54.424082 np0000004400 cinder-backup[101319]: iface.first_burst_len = 0 Jul 03 09:45:54.424082 np0000004400 cinder-backup[101319]: iface.max_outstanding_r2t = 0 Jul 03 09:45:54.424082 np0000004400 cinder-backup[101319]: iface.max_burst_len = 0 Jul 03 09:45:54.424082 np0000004400 cinder-backup[101319]: iface.chap_auth = Jul 03 09:45:54.424082 np0000004400 cinder-backup[101319]: iface.bidi_chap = Jul 03 09:45:54.424082 np0000004400 cinder-backup[101319]: iface.strict_login_compliance = Jul 03 09:45:54.424082 np0000004400 cinder-backup[101319]: iface.discovery_auth = Jul 03 09:45:54.424082 np0000004400 cinder-backup[101319]: iface.discovery_logout = Jul 03 09:45:54.424082 np0000004400 cinder-backup[101319]: node.discovery_address = Jul 03 09:45:54.424082 np0000004400 cinder-backup[101319]: node.discovery_port = 0 Jul 03 09:45:54.424082 np0000004400 cinder-backup[101319]: node.discovery_type = fw Jul 03 09:45:54.424082 np0000004400 cinder-backup[101319]: node.session.initial_cmdsn = 0 Jul 03 09:45:54.424082 np0000004400 cinder-backup[101319]: node.session.initial_login_retry_max = 8 Jul 03 09:45:54.424082 np0000004400 cinder-backup[101319]: node.session.xmit_thread_priority = 0 Jul 03 09:45:54.424082 np0000004400 cinder-backup[101319]: node.session.cmds_max = 128 Jul 03 09:45:54.424082 np0000004400 cinder-backup[101319]: node.session.queue_depth = 32 Jul 03 09:45:54.424082 np0000004400 cinder-backup[101319]: node.session.nr_sessions = 1 Jul 03 09:45:54.424082 np0000004400 cinder-backup[101319]: node.session.auth.authmethod = None Jul 03 09:45:54.424082 np0000004400 cinder-backup[101319]: node.session.auth.username = Jul 03 09:45:54.424082 np0000004400 cinder-backup[101319]: node.session.auth.password = *** Jul 03 09:45:54.424082 np0000004400 cinder-backup[101319]: node.session.auth.username_in = Jul 03 09:45:54.424082 np0000004400 cinder-backup[101319]: node.session.auth.password_in = Jul 03 09:45:54.424082 np0000004400 cinder-backup[101319]: node.session.auth.chap_algs = SHA256 Jul 03 09:45:54.424082 np0000004400 cinder-backup[101319]: node.session.timeo.replacement_timeout = 120 Jul 03 09:45:54.424082 np0000004400 cinder-backup[101319]: node.session.err_timeo.abort_timeout = 15 Jul 03 09:45:54.424082 np0000004400 cinder-backup[101319]: node.session.err_timeo.lu_reset_timeout = 30 Jul 03 09:45:54.424082 np0000004400 cinder-backup[101319]: node.session.err_timeo.tgt_reset_timeout = 30 Jul 03 09:45:54.424082 np0000004400 cinder-backup[101319]: node.session.err_timeo.host_reset_timeout = 60 Jul 03 09:45:54.424082 np0000004400 cinder-backup[101319]: node.session.iscsi.FastAbort = Yes Jul 03 09:45:54.424082 np0000004400 cinder-backup[101319]: node.session.iscsi.InitialR2T = No Jul 03 09:45:54.424082 np0000004400 cinder-backup[101319]: node.session.iscsi.ImmediateData = Yes Jul 03 09:45:54.424082 np0000004400 cinder-backup[101319]: node.session.iscsi.FirstBurstLength = 262144 Jul 03 09:45:54.424082 np0000004400 cinder-backup[101319]: node.session.iscsi.MaxBurstLength = 16776192 Jul 03 09:45:54.424082 np0000004400 cinder-backup[101319]: node.session.iscsi.DefaultTime2Retain = 0 Jul 03 09:45:54.424082 np0000004400 cinder-backup[101319]: node.session.iscsi.DefaultTime2Wait = 2 Jul 03 09:45:54.424082 np0000004400 cinder-backup[101319]: node.session.iscsi.MaxConnections = 1 Jul 03 09:45:54.424082 np0000004400 cinder-backup[101319]: node.session.iscsi.MaxOutstandingR2T = 1 Jul 03 09:45:54.424082 np0000004400 cinder-backup[101319]: node.session.iscsi.ERL = 0 Jul 03 09:45:54.424082 np0000004400 cinder-backup[101319]: node.session.scan = auto Jul 03 09:45:54.424082 np0000004400 cinder-backup[101319]: node.session.reopen_max = 0 Jul 03 09:45:54.424082 np0000004400 cinder-backup[101319]: node.conn[0].address = 192.168.40.100 Jul 03 09:45:54.424082 np0000004400 cinder-backup[101319]: node.conn[0].port = 3260 Jul 03 09:45:54.424082 np0000004400 cinder-backup[101319]: node.conn[0].startup = manual Jul 03 09:45:54.424082 np0000004400 cinder-backup[101319]: node.conn[0].tcp.window_size = 524288 Jul 03 09:45:54.424082 np0000004400 cinder-backup[101319]: node.conn[0].tcp.type_of_service = 0 Jul 03 09:45:54.424082 np0000004400 cinder-backup[101319]: node.conn[0].timeo.logout_timeout = 15 Jul 03 09:45:54.424082 np0000004400 cinder-backup[101319]: node.conn[0].timeo.login_timeout = 15 Jul 03 09:45:54.424082 np0000004400 cinder-backup[101319]: node.conn[0].timeo.auth_timeout = 45 Jul 03 09:45:54.424082 np0000004400 cinder-backup[101319]: node.conn[0].timeo.noop_out_interval = 5 Jul 03 09:45:54.424082 np0000004400 cinder-backup[101319]: node.conn[0].timeo.noop_out_timeout = 5 Jul 03 09:45:54.424082 np0000004400 cinder-backup[101319]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0 Jul 03 09:45:54.424082 np0000004400 cinder-backup[101319]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144 Jul 03 09:45:54.424082 np0000004400 cinder-backup[101319]: node.conn[0].iscsi.HeaderDigest = None Jul 03 09:45:54.424082 np0000004400 cinder-backup[101319]: node.conn[0].iscsi.DataDigest = None Jul 03 09:45:54.424082 np0000004400 cinder-backup[101319]: node.conn[0].iscsi.IFMarker = No Jul 03 09:45:54.424082 np0000004400 cinder-backup[101319]: node.conn[0].iscsi.OFMarker = No Jul 03 09:45:54.424082 np0000004400 cinder-backup[101319]: # END RECORD Jul 03 09:45:54.424082 np0000004400 cinder-backup[101319]: stderr= {{(pid=101319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 03 09:45:54.440041 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-888e3f93-d9e9-47ce-a144-629fa57e40f8 tempest-VolumesBackupsTest-2142009639 None] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=101319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 03 09:45:54.458953 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-888e3f93-d9e9-47ce-a144-629fa57e40f8 tempest-VolumesBackupsTest-2142009639 None] iscsiadm ('-m', 'session'): stdout=tcp: [107] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-72e07e1e-1567-4071-8204-c29cb26d2660 (non-flash) Jul 03 09:45:54.458953 np0000004400 cinder-backup[101319]: tcp: [108] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-52be2cf8-1f6a-47e1-910d-17cdde3abb60 (non-flash) Jul 03 09:45:54.458953 np0000004400 cinder-backup[101319]: tcp: [49] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b2e4f10c-8033-4c54-95a1-dfe45d6357a3 (non-flash) Jul 03 09:45:54.458953 np0000004400 cinder-backup[101319]: tcp: [50] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b2e4f10c-8033-4c54-95a1-dfe45d6357a3 (non-flash) Jul 03 09:45:54.458953 np0000004400 cinder-backup[101319]: tcp: [82] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-76320525-737e-4f58-8523-63ec9abbdc64 (non-flash) Jul 03 09:45:54.458953 np0000004400 cinder-backup[101319]: tcp: [83] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-76320525-737e-4f58-8523-63ec9abbdc64 (non-flash) Jul 03 09:45:54.458953 np0000004400 cinder-backup[101319]: tcp: [97] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d47f5d2f-dce5-42f7-a693-a654fd702622 (non-flash) Jul 03 09:45:54.458953 np0000004400 cinder-backup[101319]: tcp: [98] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d47f5d2f-dce5-42f7-a693-a654fd702622 (non-flash) Jul 03 09:45:54.458953 np0000004400 cinder-backup[101319]: stderr= {{(pid=101319) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jul 03 09:45:54.459186 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-888e3f93-d9e9-47ce-a144-629fa57e40f8 tempest-VolumesBackupsTest-2142009639 None] iscsi session list stdout=tcp: [107] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-72e07e1e-1567-4071-8204-c29cb26d2660 (non-flash) Jul 03 09:45:54.459186 np0000004400 cinder-backup[101319]: tcp: [108] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-52be2cf8-1f6a-47e1-910d-17cdde3abb60 (non-flash) Jul 03 09:45:54.459186 np0000004400 cinder-backup[101319]: tcp: [49] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b2e4f10c-8033-4c54-95a1-dfe45d6357a3 (non-flash) Jul 03 09:45:54.459186 np0000004400 cinder-backup[101319]: tcp: [50] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b2e4f10c-8033-4c54-95a1-dfe45d6357a3 (non-flash) Jul 03 09:45:54.459186 np0000004400 cinder-backup[101319]: tcp: [82] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-76320525-737e-4f58-8523-63ec9abbdc64 (non-flash) Jul 03 09:45:54.459186 np0000004400 cinder-backup[101319]: tcp: [83] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-76320525-737e-4f58-8523-63ec9abbdc64 (non-flash) Jul 03 09:45:54.459186 np0000004400 cinder-backup[101319]: tcp: [97] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d47f5d2f-dce5-42f7-a693-a654fd702622 (non-flash) Jul 03 09:45:54.459186 np0000004400 cinder-backup[101319]: tcp: [98] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d47f5d2f-dce5-42f7-a693-a654fd702622 (non-flash) Jul 03 09:45:54.459186 np0000004400 cinder-backup[101319]: stderr= {{(pid=101319) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jul 03 09:45:54.469426 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-6ef928da-3670-4523-823a-3443e2d91692 tempest-VolumesBackupsTest-118275719 None] Backing up chunk of data from volume. {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 09:45:54.510445 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-9a399181-d884-4e46-a928-590766ad92c9 tempest-ProjectAdminTests33-1900627284 None] backup MD5 for volume_52be2cf8-1f6a-47e1-910d-17cdde3abb60/20260703094549/az_nova_backup_ec711725-25f0-4982-afe6-3b48b0e50917-00009: 25e317773f308e446cc84c503a6d1f85 {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 09:45:54.510771 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-9a399181-d884-4e46-a928-590766ad92c9 tempest-ProjectAdminTests33-1900627284 None] Calling eventlet.sleep(0) {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 09:45:54.515253 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-888e3f93-d9e9-47ce-a144-629fa57e40f8 tempest-VolumesBackupsTest-2142009639 None] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-2a67969a-282a-431e-9fb2-763d3c62eab0, portal: 192.168.40.100,3260] Jul 03 09:45:54.515253 np0000004400 cinder-backup[101319]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-2a67969a-282a-431e-9fb2-763d3c62eab0, portal: 192.168.40.100,3260] successful. Jul 03 09:45:54.515253 np0000004400 cinder-backup[101319]: stderr= {{(pid=101319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 03 09:45:54.526043 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-888e3f93-d9e9-47ce-a144-629fa57e40f8 tempest-VolumesBackupsTest-2142009639 None] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=101319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 03 09:45:54.551225 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-888e3f93-d9e9-47ce-a144-629fa57e40f8 tempest-VolumesBackupsTest-2142009639 None] iscsiadm ('-m', 'session'): stdout=tcp: [107] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-72e07e1e-1567-4071-8204-c29cb26d2660 (non-flash) Jul 03 09:45:54.551225 np0000004400 cinder-backup[101319]: tcp: [108] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-52be2cf8-1f6a-47e1-910d-17cdde3abb60 (non-flash) Jul 03 09:45:54.551225 np0000004400 cinder-backup[101319]: tcp: [109] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2a67969a-282a-431e-9fb2-763d3c62eab0 (non-flash) Jul 03 09:45:54.551225 np0000004400 cinder-backup[101319]: tcp: [49] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b2e4f10c-8033-4c54-95a1-dfe45d6357a3 (non-flash) Jul 03 09:45:54.551225 np0000004400 cinder-backup[101319]: tcp: [50] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b2e4f10c-8033-4c54-95a1-dfe45d6357a3 (non-flash) Jul 03 09:45:54.551225 np0000004400 cinder-backup[101319]: tcp: [82] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-76320525-737e-4f58-8523-63ec9abbdc64 (non-flash) Jul 03 09:45:54.551225 np0000004400 cinder-backup[101319]: tcp: [83] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-76320525-737e-4f58-8523-63ec9abbdc64 (non-flash) Jul 03 09:45:54.551225 np0000004400 cinder-backup[101319]: tcp: [97] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d47f5d2f-dce5-42f7-a693-a654fd702622 (non-flash) Jul 03 09:45:54.551225 np0000004400 cinder-backup[101319]: tcp: [98] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d47f5d2f-dce5-42f7-a693-a654fd702622 (non-flash) Jul 03 09:45:54.551225 np0000004400 cinder-backup[101319]: stderr= {{(pid=101319) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jul 03 09:45:54.551922 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-888e3f93-d9e9-47ce-a144-629fa57e40f8 tempest-VolumesBackupsTest-2142009639 None] iscsi session list stdout=tcp: [107] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-72e07e1e-1567-4071-8204-c29cb26d2660 (non-flash) Jul 03 09:45:54.551922 np0000004400 cinder-backup[101319]: tcp: [108] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-52be2cf8-1f6a-47e1-910d-17cdde3abb60 (non-flash) Jul 03 09:45:54.551922 np0000004400 cinder-backup[101319]: tcp: [109] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2a67969a-282a-431e-9fb2-763d3c62eab0 (non-flash) Jul 03 09:45:54.551922 np0000004400 cinder-backup[101319]: tcp: [49] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b2e4f10c-8033-4c54-95a1-dfe45d6357a3 (non-flash) Jul 03 09:45:54.551922 np0000004400 cinder-backup[101319]: tcp: [50] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b2e4f10c-8033-4c54-95a1-dfe45d6357a3 (non-flash) Jul 03 09:45:54.551922 np0000004400 cinder-backup[101319]: tcp: [82] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-76320525-737e-4f58-8523-63ec9abbdc64 (non-flash) Jul 03 09:45:54.551922 np0000004400 cinder-backup[101319]: tcp: [83] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-76320525-737e-4f58-8523-63ec9abbdc64 (non-flash) Jul 03 09:45:54.551922 np0000004400 cinder-backup[101319]: tcp: [97] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d47f5d2f-dce5-42f7-a693-a654fd702622 (non-flash) Jul 03 09:45:54.551922 np0000004400 cinder-backup[101319]: tcp: [98] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d47f5d2f-dce5-42f7-a693-a654fd702622 (non-flash) Jul 03 09:45:54.551922 np0000004400 cinder-backup[101319]: stderr= {{(pid=101319) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jul 03 09:45:54.551922 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.base [None req-888e3f93-d9e9-47ce-a144-629fa57e40f8 tempest-VolumesBackupsTest-2142009639 None] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-2a67969a-282a-431e-9fb2-763d3c62eab0" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.179s {{(pid=101319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jul 03 09:45:54.552825 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-888e3f93-d9e9-47ce-a144-629fa57e40f8 tempest-VolumesBackupsTest-2142009639 None] Connected to 192.168.40.100:3260 {{(pid=101319) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}} Jul 03 09:45:54.552942 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.linuxscsi [None req-888e3f93-d9e9-47ce-a144-629fa57e40f8 tempest-VolumesBackupsTest-2142009639 None] HCTL ('9', '-', '-', 0) found on session 109 with lun 0 {{(pid=101319) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}} Jul 03 09:45:54.553080 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.linuxscsi [None req-888e3f93-d9e9-47ce-a144-629fa57e40f8 tempest-VolumesBackupsTest-2142009639 None] Scanning host 9 c: -, t: -, l: 0) {{(pid=101319) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}} Jul 03 09:45:54.572305 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.linuxscsi [None req-888e3f93-d9e9-47ce-a144-629fa57e40f8 tempest-VolumesBackupsTest-2142009639 None] Searching for a device in session 109 and hctl ['9', '*', '*', 0] yield: None {{(pid=101319) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}} Jul 03 09:45:54.715460 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-9a399181-d884-4e46-a928-590766ad92c9 tempest-ProjectAdminTests33-1900627284 None] Backing up chunk of data from volume. {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 09:45:54.718837 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-6ef928da-3670-4523-823a-3443e2d91692 tempest-VolumesBackupsTest-118275719 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101319) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 09:45:54.718978 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-6ef928da-3670-4523-823a-3443e2d91692 tempest-VolumesBackupsTest-118275719 None] About to put_object {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 09:45:54.825298 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-6ef928da-3670-4523-823a-3443e2d91692 tempest-VolumesBackupsTest-118275719 None] backup MD5 for volume_72e07e1e-1567-4071-8204-c29cb26d2660/20260703094546/az_nova_backup_8b377d15-3804-4a9c-ad2d-e8e1359c0ee5-00012: 25e317773f308e446cc84c503a6d1f85 {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 09:45:54.825495 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-6ef928da-3670-4523-823a-3443e2d91692 tempest-VolumesBackupsTest-118275719 None] Calling eventlet.sleep(0) {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 09:45:54.958650 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-9a399181-d884-4e46-a928-590766ad92c9 tempest-ProjectAdminTests33-1900627284 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101319) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 09:45:54.958742 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-9a399181-d884-4e46-a928-590766ad92c9 tempest-ProjectAdminTests33-1900627284 None] About to put_object {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 09:45:55.009951 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-6ef928da-3670-4523-823a-3443e2d91692 tempest-VolumesBackupsTest-118275719 None] Backing up chunk of data from volume. {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 09:45:55.068494 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-9a399181-d884-4e46-a928-590766ad92c9 tempest-ProjectAdminTests33-1900627284 None] backup MD5 for volume_52be2cf8-1f6a-47e1-910d-17cdde3abb60/20260703094549/az_nova_backup_ec711725-25f0-4982-afe6-3b48b0e50917-00010: 25e317773f308e446cc84c503a6d1f85 {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 09:45:55.068696 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-9a399181-d884-4e46-a928-590766ad92c9 tempest-ProjectAdminTests33-1900627284 None] Calling eventlet.sleep(0) {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 09:45:55.276837 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-6ef928da-3670-4523-823a-3443e2d91692 tempest-VolumesBackupsTest-118275719 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101319) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 09:45:55.277237 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-6ef928da-3670-4523-823a-3443e2d91692 tempest-VolumesBackupsTest-118275719 None] About to put_object {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 09:45:55.292379 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-9a399181-d884-4e46-a928-590766ad92c9 tempest-ProjectAdminTests33-1900627284 None] Backing up chunk of data from volume. {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 09:45:55.396334 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-6ef928da-3670-4523-823a-3443e2d91692 tempest-VolumesBackupsTest-118275719 None] backup MD5 for volume_72e07e1e-1567-4071-8204-c29cb26d2660/20260703094546/az_nova_backup_8b377d15-3804-4a9c-ad2d-e8e1359c0ee5-00013: 25e317773f308e446cc84c503a6d1f85 {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 09:45:55.396547 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-6ef928da-3670-4523-823a-3443e2d91692 tempest-VolumesBackupsTest-118275719 None] Calling eventlet.sleep(0) {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 09:45:55.541858 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-9a399181-d884-4e46-a928-590766ad92c9 tempest-ProjectAdminTests33-1900627284 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101319) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 09:45:55.541992 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-9a399181-d884-4e46-a928-590766ad92c9 tempest-ProjectAdminTests33-1900627284 None] About to put_object {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 09:45:55.573948 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.linuxscsi [None req-888e3f93-d9e9-47ce-a144-629fa57e40f8 tempest-VolumesBackupsTest-2142009639 None] Searching for a device in session 109 and hctl ['9', '*', '*', 0] yield: sdd {{(pid=101319) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}} Jul 03 09:45:55.573948 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-888e3f93-d9e9-47ce-a144-629fa57e40f8 tempest-VolumesBackupsTest-2142009639 None] Connected to sdd using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-2a67969a-282a-431e-9fb2-763d3c62eab0', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '2a67969a-282a-431e-9fb2-763d3c62eab0', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': False} {{(pid=101319) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}} Jul 03 09:45:55.574221 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.base [None req-888e3f93-d9e9-47ce-a144-629fa57e40f8 tempest-VolumesBackupsTest-2142009639 None] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 2.214s {{(pid=101319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jul 03 09:45:55.574221 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-888e3f93-d9e9-47ce-a144-629fa57e40f8 tempest-VolumesBackupsTest-2142009639 None] <== connect_volume: return (2214ms) {'type': 'block', 'scsi_wwn': '3300000000921b172', 'path': '/dev/sdd'} {{(pid=101319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}} Jul 03 09:45:55.574797 np0000004400 cinder-backup[101319]: DEBUG oslo_concurrency.processutils [None req-888e3f93-d9e9-47ce-a144-629fa57e40f8 tempest-VolumesBackupsTest-2142009639 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chown 1002 /dev/sdd {{(pid=101319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 09:45:55.599987 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-6ef928da-3670-4523-823a-3443e2d91692 tempest-VolumesBackupsTest-118275719 None] Backing up chunk of data from volume. {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 09:45:55.599035 np0000004400 sudo[137663]: stack : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chown 1002 /dev/sdd Jul 03 09:45:55.599635 np0000004400 sudo[137663]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1002) Jul 03 09:45:55.680789 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-9a399181-d884-4e46-a928-590766ad92c9 tempest-ProjectAdminTests33-1900627284 None] backup MD5 for volume_52be2cf8-1f6a-47e1-910d-17cdde3abb60/20260703094549/az_nova_backup_ec711725-25f0-4982-afe6-3b48b0e50917-00011: 25e317773f308e446cc84c503a6d1f85 {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 09:45:55.681078 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-9a399181-d884-4e46-a928-590766ad92c9 tempest-ProjectAdminTests33-1900627284 None] Calling eventlet.sleep(0) {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 09:45:55.684130 np0000004400 cinder-backup[101319]: DEBUG dbcounter [-] [101319] Writing DB stats cinder:SELECT=316,cinder:UPDATE=72,cinder:INSERT=23 {{(pid=101319) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 03 09:45:55.862688 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-6ef928da-3670-4523-823a-3443e2d91692 tempest-VolumesBackupsTest-118275719 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101319) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 09:45:55.866429 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-6ef928da-3670-4523-823a-3443e2d91692 tempest-VolumesBackupsTest-118275719 None] About to put_object {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 09:45:55.898476 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-9a399181-d884-4e46-a928-590766ad92c9 tempest-ProjectAdminTests33-1900627284 None] Backing up chunk of data from volume. {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 09:45:55.926683 np0000004400 sudo[137663]: pam_unix(sudo:session): session closed for user root Jul 03 09:45:55.928698 np0000004400 cinder-backup[101319]: DEBUG oslo_concurrency.processutils [None req-888e3f93-d9e9-47ce-a144-629fa57e40f8 tempest-VolumesBackupsTest-2142009639 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chown 1002 /dev/sdd" returned: 0 in 0.354s {{(pid=101319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 09:45:55.929072 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-888e3f93-d9e9-47ce-a144-629fa57e40f8 tempest-VolumesBackupsTest-2142009639 None] starting restore of backup volume_b1fc0d58-7747-4bcf-99a7-fb482aacb945/20260703094530/az_nova_backup_e353b2b2-ecff-4fe0-8148-bf9d1d84a8bf container: tempest-volumesbackupstest-backup-container-1320776190, to new volume 2a67969a-282a-431e-9fb2-763d3c62eab0, backup: e353b2b2-ecff-4fe0-8148-bf9d1d84a8bf. {{(pid=101319) restore /opt/stack/cinder/cinder/backup/chunkeddriver.py:761}} Jul 03 09:45:55.929256 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-888e3f93-d9e9-47ce-a144-629fa57e40f8 tempest-VolumesBackupsTest-2142009639 None] _read_metadata started, container name: tempest-volumesbackupstest-backup-container-1320776190, metadata filename: volume_b1fc0d58-7747-4bcf-99a7-fb482aacb945/20260703094530/az_nova_backup_e353b2b2-ecff-4fe0-8148-bf9d1d84a8bf_metadata. {{(pid=101319) _read_metadata /opt/stack/cinder/cinder/backup/chunkeddriver.py:320}} Jul 03 09:45:55.946651 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-888e3f93-d9e9-47ce-a144-629fa57e40f8 tempest-VolumesBackupsTest-2142009639 None] _read_metadata finished. Metadata: { Jul 03 09:45:55.946651 np0000004400 cinder-backup[101319]: "backup_description": "tempest-backup-description-721862093", Jul 03 09:45:55.946651 np0000004400 cinder-backup[101319]: "backup_id": "e353b2b2-ecff-4fe0-8148-bf9d1d84a8bf", Jul 03 09:45:55.946651 np0000004400 cinder-backup[101319]: "backup_name": "tempest-VolumesBackupsTest-Backup-1542290489", Jul 03 09:45:55.946651 np0000004400 cinder-backup[101319]: "created_at": "2026-07-03 09:45:24+00:00", Jul 03 09:45:55.946651 np0000004400 cinder-backup[101319]: "objects": [ Jul 03 09:45:55.946651 np0000004400 cinder-backup[101319]: { Jul 03 09:45:55.946651 np0000004400 cinder-backup[101319]: "volume_b1fc0d58-7747-4bcf-99a7-fb482aacb945/20260703094530/az_nova_backup_e353b2b2-ecff-4fe0-8148-bf9d1d84a8bf-00001": { Jul 03 09:45:55.946651 np0000004400 cinder-backup[101319]: "compression": "zlib", Jul 03 09:45:55.946651 np0000004400 cinder-backup[101319]: "length": 52428800, Jul 03 09:45:55.946651 np0000004400 cinder-backup[101319]: "md5": "25e317773f308e446cc84c503a6d1f85", Jul 03 09:45:55.946651 np0000004400 cinder-backup[101319]: "offset": 0 Jul 03 09:45:55.946651 np0000004400 cinder-backup[101319]: } Jul 03 09:45:55.946651 np0000004400 cinder-backup[101319]: }, Jul 03 09:45:55.946651 np0000004400 cinder-backup[101319]: { Jul 03 09:45:55.946651 np0000004400 cinder-backup[101319]: "volume_b1fc0d58-7747-4bcf-99a7-fb482aacb945/20260703094530/az_nova_backup_e353b2b2-ecff-4fe0-8148-bf9d1d84a8bf-00002": { Jul 03 09:45:55.946651 np0000004400 cinder-backup[101319]: "compression": "zlib", Jul 03 09:45:55.946651 np0000004400 cinder-backup[101319]: "length": 52428800, Jul 03 09:45:55.946651 np0000004400 cinder-backup[101319]: "md5": "25e317773f308e446cc84c503a6d1f85", Jul 03 09:45:55.946651 np0000004400 cinder-backup[101319]: "offset": 52428800 Jul 03 09:45:55.946651 np0000004400 cinder-backup[101319]: } Jul 03 09:45:55.946651 np0000004400 cinder-backup[101319]: }, Jul 03 09:45:55.946651 np0000004400 cinder-backup[101319]: { Jul 03 09:45:55.946651 np0000004400 cinder-backup[101319]: "volume_b1fc0d58-7747-4bcf-99a7-fb482aacb945/20260703094530/az_nova_backup_e353b2b2-ecff-4fe0-8148-bf9d1d84a8bf-00003": { Jul 03 09:45:55.946651 np0000004400 cinder-backup[101319]: "compression": "zlib", Jul 03 09:45:55.946651 np0000004400 cinder-backup[101319]: "length": 52428800, Jul 03 09:45:55.946651 np0000004400 cinder-backup[101319]: "md5": "25e317773f308e446cc84c503a6d1f85", Jul 03 09:45:55.946651 np0000004400 cinder-backup[101319]: "offset": 104857600 Jul 03 09:45:55.946651 np0000004400 cinder-backup[101319]: } Jul 03 09:45:55.946651 np0000004400 cinder-backup[101319]: }, Jul 03 09:45:55.946651 np0000004400 cinder-backup[101319]: { Jul 03 09:45:55.946651 np0000004400 cinder-backup[101319]: "volume_b1fc0d58-7747-4bcf-99a7-fb482aacb945/20260703094530/az_nova_backup_e353b2b2-ecff-4fe0-8148-bf9d1d84a8bf-00004": { Jul 03 09:45:55.946651 np0000004400 cinder-backup[101319]: "compression": "zlib", Jul 03 09:45:55.946651 np0000004400 cinder-backup[101319]: "length": 52428800, Jul 03 09:45:55.946651 np0000004400 cinder-backup[101319]: "md5": "25e317773f308e446cc84c503a6d1f85", Jul 03 09:45:55.946651 np0000004400 cinder-backup[101319]: "offset": 157286400 Jul 03 09:45:55.946651 np0000004400 cinder-backup[101319]: } Jul 03 09:45:55.946651 np0000004400 cinder-backup[101319]: }, Jul 03 09:45:55.946651 np0000004400 cinder-backup[101319]: { Jul 03 09:45:55.946651 np0000004400 cinder-backup[101319]: "volume_b1fc0d58-7747-4bcf-99a7-fb482aacb945/20260703094530/az_nova_backup_e353b2b2-ecff-4fe0-8148-bf9d1d84a8bf-00005": { Jul 03 09:45:55.946651 np0000004400 cinder-backup[101319]: "compression": "zlib", Jul 03 09:45:55.946651 np0000004400 cinder-backup[101319]: "length": 52428800, Jul 03 09:45:55.946651 np0000004400 cinder-backup[101319]: "md5": "25e317773f308e446cc84c503a6d1f85", Jul 03 09:45:55.946651 np0000004400 cinder-backup[101319]: "offset": 209715200 Jul 03 09:45:55.946651 np0000004400 cinder-backup[101319]: } Jul 03 09:45:55.946651 np0000004400 cinder-backup[101319]: }, Jul 03 09:45:55.946651 np0000004400 cinder-backup[101319]: { Jul 03 09:45:55.946651 np0000004400 cinder-backup[101319]: "volume_b1fc0d58-7747-4bcf-99a7-fb482aacb945/20260703094530/az_nova_backup_e353b2b2-ecff-4fe0-8148-bf9d1d84a8bf-00006": { Jul 03 09:45:55.946651 np0000004400 cinder-backup[101319]: "compression": "zlib", Jul 03 09:45:55.946651 np0000004400 cinder-backup[101319]: "length": 52428800, Jul 03 09:45:55.946651 np0000004400 cinder-backup[101319]: "md5": "25e317773f308e446cc84c503a6d1f85", Jul 03 09:45:55.946651 np0000004400 cinder-backup[101319]: "offset": 262144000 Jul 03 09:45:55.946651 np0000004400 cinder-backup[101319]: } Jul 03 09:45:55.946651 np0000004400 cinder-backup[101319]: }, Jul 03 09:45:55.946651 np0000004400 cinder-backup[101319]: { Jul 03 09:45:55.946651 np0000004400 cinder-backup[101319]: "volume_b1fc0d58-7747-4bcf-99a7-fb482aacb945/20260703094530/az_nova_backup_e353b2b2-ecff-4fe0-8148-bf9d1d84a8bf-00007": { Jul 03 09:45:55.946651 np0000004400 cinder-backup[101319]: "compression": "zlib", Jul 03 09:45:55.946651 np0000004400 cinder-backup[101319]: "length": 52428800, Jul 03 09:45:55.946651 np0000004400 cinder-backup[101319]: "md5": "25e317773f308e446cc84c503a6d1f85", Jul 03 09:45:55.946651 np0000004400 cinder-backup[101319]: "offset": 314572800 Jul 03 09:45:55.946651 np0000004400 cinder-backup[101319]: } Jul 03 09:45:55.946651 np0000004400 cinder-backup[101319]: }, Jul 03 09:45:55.946651 np0000004400 cinder-backup[101319]: { Jul 03 09:45:55.946651 np0000004400 cinder-backup[101319]: "volume_b1fc0d58-7747-4bcf-99a7-fb482aacb945/20260703094530/az_nova_backup_e353b2b2-ecff-4fe0-8148-bf9d1d84a8bf-00008": { Jul 03 09:45:55.946651 np0000004400 cinder-backup[101319]: "compression": "zlib", Jul 03 09:45:55.946651 np0000004400 cinder-backup[101319]: "length": 52428800, Jul 03 09:45:55.946651 np0000004400 cinder-backup[101319]: "md5": "25e317773f308e446cc84c503a6d1f85", Jul 03 09:45:55.946651 np0000004400 cinder-backup[101319]: "offset": 367001600 Jul 03 09:45:55.946651 np0000004400 cinder-backup[101319]: } Jul 03 09:45:55.946651 np0000004400 cinder-backup[101319]: }, Jul 03 09:45:55.946651 np0000004400 cinder-backup[101319]: { Jul 03 09:45:55.946651 np0000004400 cinder-backup[101319]: "volume_b1fc0d58-7747-4bcf-99a7-fb482aacb945/20260703094530/az_nova_backup_e353b2b2-ecff-4fe0-8148-bf9d1d84a8bf-00009": { Jul 03 09:45:55.946651 np0000004400 cinder-backup[101319]: "compression": "zlib", Jul 03 09:45:55.946651 np0000004400 cinder-backup[101319]: "length": 52428800, Jul 03 09:45:55.946651 np0000004400 cinder-backup[101319]: "md5": "25e317773f308e446cc84c503a6d1f85", Jul 03 09:45:55.946651 np0000004400 cinder-backup[101319]: "offset": 419430400 Jul 03 09:45:55.946651 np0000004400 cinder-backup[101319]: } Jul 03 09:45:55.946651 np0000004400 cinder-backup[101319]: }, Jul 03 09:45:55.946651 np0000004400 cinder-backup[101319]: { Jul 03 09:45:55.946651 np0000004400 cinder-backup[101319]: "volume_b1fc0d58-7747-4bcf-99a7-fb482aacb945/20260703094530/az_nova_backup_e353b2b2-ecff-4fe0-8148-bf9d1d84a8bf-00010": { Jul 03 09:45:55.946651 np0000004400 cinder-backup[101319]: "compression": "zlib", Jul 03 09:45:55.946651 np0000004400 cinder-backup[101319]: "length": 52428800, Jul 03 09:45:55.946651 np0000004400 cinder-backup[101319]: "md5": "25e317773f308e446cc84c503a6d1f85", Jul 03 09:45:55.946651 np0000004400 cinder-backup[101319]: "offset": 471859200 Jul 03 09:45:55.946651 np0000004400 cinder-backup[101319]: } Jul 03 09:45:55.946651 np0000004400 cinder-backup[101319]: }, Jul 03 09:45:55.946651 np0000004400 cinder-backup[101319]: { Jul 03 09:45:55.946651 np0000004400 cinder-backup[101319]: "volume_b1fc0d58-7747-4bcf-99a7-fb482aacb945/20260703094530/az_nova_backup_e353b2b2-ecff-4fe0-8148-bf9d1d84a8bf-00011": { Jul 03 09:45:55.946651 np0000004400 cinder-backup[101319]: "compression": "zlib", Jul 03 09:45:55.946651 np0000004400 cinder-backup[101319]: "length": 52428800, Jul 03 09:45:55.946651 np0000004400 cinder-backup[101319]: "md5": "25e317773f308e446cc84c503a6d1f85", Jul 03 09:45:55.946651 np0000004400 cinder-backup[101319]: "offset": 524288000 Jul 03 09:45:55.946651 np0000004400 cinder-backup[101319]: } Jul 03 09:45:55.946651 np0000004400 cinder-backup[101319]: }, Jul 03 09:45:55.946651 np0000004400 cinder-backup[101319]: { Jul 03 09:45:55.946651 np0000004400 cinder-backup[101319]: "volume_b1fc0d58-7747-4bcf-99a7-fb482aacb945/20260703094530/az_nova_backup_e353b2b2-ecff-4fe0-8148-bf9d1d84a8bf-00012": { Jul 03 09:45:55.946651 np0000004400 cinder-backup[101319]: "compression": "zlib", Jul 03 09:45:55.946651 np0000004400 cinder-backup[101319]: "length": 52428800, Jul 03 09:45:55.946651 np0000004400 cinder-backup[101319]: "md5": "25e317773f308e446cc84c503a6d1f85", Jul 03 09:45:55.946651 np0000004400 cinder-backup[101319]: "offset": 576716800 Jul 03 09:45:55.946651 np0000004400 cinder-backup[101319]: } Jul 03 09:45:55.946651 np0000004400 cinder-backup[101319]: }, Jul 03 09:45:55.946651 np0000004400 cinder-backup[101319]: { Jul 03 09:45:55.946651 np0000004400 cinder-backup[101319]: "volume_b1fc0d58-7747-4bcf-99a7-fb482aacb945/20260703094530/az_nova_backup_e353b2b2-ecff-4fe0-8148-bf9d1d84a8bf-00013": { Jul 03 09:45:55.946651 np0000004400 cinder-backup[101319]: "compression": "zlib", Jul 03 09:45:55.946651 np0000004400 cinder-backup[101319]: "length": 52428800, Jul 03 09:45:55.946651 np0000004400 cinder-backup[101319]: "md5": "25e317773f308e446cc84c503a6d1f85", Jul 03 09:45:55.946651 np0000004400 cinder-backup[101319]: "offset": 629145600 Jul 03 09:45:55.946651 np0000004400 cinder-backup[101319]: } Jul 03 09:45:55.946651 np0000004400 cinder-backup[101319]: }, Jul 03 09:45:55.946651 np0000004400 cinder-backup[101319]: { Jul 03 09:45:55.946651 np0000004400 cinder-backup[101319]: "volume_b1fc0d58-7747-4bcf-99a7-fb482aacb945/20260703094530/az_nova_backup_e353b2b2-ecff-4fe0-8148-bf9d1d84a8bf-00014": { Jul 03 09:45:55.946651 np0000004400 cinder-backup[101319]: "compression": "zlib", Jul 03 09:45:55.946651 np0000004400 cinder-backup[101319]: "length": 52428800, Jul 03 09:45:55.946651 np0000004400 cinder-backup[101319]: "md5": "25e317773f308e446cc84c503a6d1f85", Jul 03 09:45:55.946651 np0000004400 cinder-backup[101319]: "offset": 681574400 Jul 03 09:45:55.946651 np0000004400 cinder-backup[101319]: } Jul 03 09:45:55.946651 np0000004400 cinder-backup[101319]: }, Jul 03 09:45:55.946651 np0000004400 cinder-backup[101319]: { Jul 03 09:45:55.946651 np0000004400 cinder-backup[101319]: "volume_b1fc0d58-7747-4bcf-99a7-fb482aacb945/20260703094530/az_nova_backup_e353b2b2-ecff-4fe0-8148-bf9d1d84a8bf-00015": { Jul 03 09:45:55.946651 np0000004400 cinder-backup[101319]: "compression": "zlib", Jul 03 09:45:55.946651 np0000004400 cinder-backup[101319]: "length": 52428800, Jul 03 09:45:55.946651 np0000004400 cinder-backup[101319]: "md5": "25e317773f308e446cc84c503a6d1f85", Jul 03 09:45:55.946651 np0000004400 cinder-backup[101319]: "offset": 734003200 Jul 03 09:45:55.946651 np0000004400 cinder-backup[101319]: } Jul 03 09:45:55.946651 np0000004400 cinder-backup[101319]: }, Jul 03 09:45:55.946651 np0000004400 cinder-backup[101319]: { Jul 03 09:45:55.946651 np0000004400 cinder-backup[101319]: "volume_b1fc0d58-7747-4bcf-99a7-fb482aacb945/20260703094530/az_nova_backup_e353b2b2-ecff-4fe0-8148-bf9d1d84a8bf-00016": { Jul 03 09:45:55.946651 np0000004400 cinder-backup[101319]: "compression": "zlib", Jul 03 09:45:55.946651 np0000004400 cinder-backup[101319]: "length": 52428800, Jul 03 09:45:55.946651 np0000004400 cinder-backup[101319]: "md5": "25e317773f308e446cc84c503a6d1f85", Jul 03 09:45:55.946651 np0000004400 cinder-backup[101319]: "offset": 786432000 Jul 03 09:45:55.946651 np0000004400 cinder-backup[101319]: } Jul 03 09:45:55.946651 np0000004400 cinder-backup[101319]: }, Jul 03 09:45:55.946651 np0000004400 cinder-backup[101319]: { Jul 03 09:45:55.946651 np0000004400 cinder-backup[101319]: "volume_b1fc0d58-7747-4bcf-99a7-fb482aacb945/20260703094530/az_nova_backup_e353b2b2-ecff-4fe0-8148-bf9d1d84a8bf-00017": { Jul 03 09:45:55.946651 np0000004400 cinder-backup[101319]: "compression": "zlib", Jul 03 09:45:55.946651 np0000004400 cinder-backup[101319]: "length": 52428800, Jul 03 09:45:55.946651 np0000004400 cinder-backup[101319]: "md5": "25e317773f308e446cc84c503a6d1f85", Jul 03 09:45:55.946651 np0000004400 cinder-backup[101319]: "offset": 838860800 Jul 03 09:45:55.946651 np0000004400 cinder-backup[101319]: } Jul 03 09:45:55.946651 np0000004400 cinder-backup[101319]: }, Jul 03 09:45:55.946651 np0000004400 cinder-backup[101319]: { Jul 03 09:45:55.946651 np0000004400 cinder-backup[101319]: "volume_b1fc0d58-7747-4bcf-99a7-fb482aacb945/20260703094530/az_nova_backup_e353b2b2-ecff-4fe0-8148-bf9d1d84a8bf-00018": { Jul 03 09:45:55.946651 np0000004400 cinder-backup[101319]: "compression": "zlib", Jul 03 09:45:55.946651 np0000004400 cinder-backup[101319]: "length": 52428800, Jul 03 09:45:55.946651 np0000004400 cinder-backup[101319]: "md5": "25e317773f308e446cc84c503a6d1f85", Jul 03 09:45:55.946651 np0000004400 cinder-backup[101319]: "offset": 891289600 Jul 03 09:45:55.946651 np0000004400 cinder-backup[101319]: } Jul 03 09:45:55.946651 np0000004400 cinder-backup[101319]: }, Jul 03 09:45:55.946651 np0000004400 cinder-backup[101319]: { Jul 03 09:45:55.946651 np0000004400 cinder-backup[101319]: "volume_b1fc0d58-7747-4bcf-99a7-fb482aacb945/20260703094530/az_nova_backup_e353b2b2-ecff-4fe0-8148-bf9d1d84a8bf-00019": { Jul 03 09:45:55.946651 np0000004400 cinder-backup[101319]: "compression": "zlib", Jul 03 09:45:55.946651 np0000004400 cinder-backup[101319]: "length": 52428800, Jul 03 09:45:55.946651 np0000004400 cinder-backup[101319]: "md5": "25e317773f308e446cc84c503a6d1f85", Jul 03 09:45:55.946651 np0000004400 cinder-backup[101319]: "offset": 943718400 Jul 03 09:45:55.946651 np0000004400 cinder-backup[101319]: } Jul 03 09:45:55.946651 np0000004400 cinder-backup[101319]: }, Jul 03 09:45:55.946651 np0000004400 cinder-backup[101319]: { Jul 03 09:45:55.946651 np0000004400 cinder-backup[101319]: "volume_b1fc0d58-7747-4bcf-99a7-fb482aacb945/20260703094530/az_nova_backup_e353b2b2-ecff-4fe0-8148-bf9d1d84a8bf-00020": { Jul 03 09:45:55.946651 np0000004400 cinder-backup[101319]: "compression": "zlib", Jul 03 09:45:55.946651 np0000004400 cinder-backup[101319]: "length": 52428800, Jul 03 09:45:55.946651 np0000004400 cinder-backup[101319]: "md5": "25e317773f308e446cc84c503a6d1f85", Jul 03 09:45:55.946651 np0000004400 cinder-backup[101319]: "offset": 996147200 Jul 03 09:45:55.946651 np0000004400 cinder-backup[101319]: } Jul 03 09:45:55.946651 np0000004400 cinder-backup[101319]: }, Jul 03 09:45:55.946651 np0000004400 cinder-backup[101319]: { Jul 03 09:45:55.946651 np0000004400 cinder-backup[101319]: "volume_b1fc0d58-7747-4bcf-99a7-fb482aacb945/20260703094530/az_nova_backup_e353b2b2-ecff-4fe0-8148-bf9d1d84a8bf-00021": { Jul 03 09:45:55.946651 np0000004400 cinder-backup[101319]: "compression": "zlib", Jul 03 09:45:55.946651 np0000004400 cinder-backup[101319]: "length": 25165824, Jul 03 09:45:55.946651 np0000004400 cinder-backup[101319]: "md5": "77377273b0a4b61febdbf7bbf52b9db9", Jul 03 09:45:55.946651 np0000004400 cinder-backup[101319]: "offset": 1048576000 Jul 03 09:45:55.946651 np0000004400 cinder-backup[101319]: } Jul 03 09:45:55.946651 np0000004400 cinder-backup[101319]: } Jul 03 09:45:55.946651 np0000004400 cinder-backup[101319]: ], Jul 03 09:45:55.946651 np0000004400 cinder-backup[101319]: "parent_id": null, Jul 03 09:45:55.946651 np0000004400 cinder-backup[101319]: "version": "1.0.0", Jul 03 09:45:55.946651 np0000004400 cinder-backup[101319]: "volume_id": "b1fc0d58-7747-4bcf-99a7-fb482aacb945", Jul 03 09:45:55.946651 np0000004400 cinder-backup[101319]: "volume_meta": "{\"version\": 2, \"volume-base-metadata\": {\"id\": \"b1fc0d58-7747-4bcf-99a7-fb482aacb945\", \"_name_id\": null, \"use_quota\": true, \"ec2_id\": null, \"user_id\": \"91463b6c437c4711a49d3c31c513a101\", \"project_id\": \"59044e18a5b24b19a7b9b8a380f2e1a0\", \"snapshot_id\": null, \"cluster_name\": null, \"host\": \"np0000004400@storpool#default\", \"size\": 1, \"availability_zone\": \"nova\", \"status\": \"backing-up\", \"attach_status\": \"detached\", \"migration_status\": null, \"scheduled_at\": \"2026-07-03T09:45:23.000000\", \"launched_at\": \"2026-07-03T09:45:23.000000\", \"terminated_at\": null, \"display_name\": \"tempest-VolumesBackupsTest-Volume-334161830\", \"display_description\": null, \"provider_location\": null, \"provider_auth\": null, \"provider_geometry\": null, \"provider_id\": null, \"volume_type_id\": \"03e13fe6-0e30-4803-ace0-725d38e6dc24\", \"source_volid\": null, \"encryption_key_id\": null, \"consistencygroup_id\": null, \"group_id\": null, \"bootable\": false, \"multiattach\": false, \"replication_status\": null, \"replication_extended_status\": null, \"replication_driver_data\": null, \"previous_status\": \"available\", \"service_uuid\": \"6d4b0e79-fefe-4744-b25f-34be05095200\", \"shared_targets\": true, \"deleted_at\": null, \"deleted\": false, \"created_at\": \"2026-07-03T09:45:23.000000\", \"updated_at\": \"2026-07-03T09:45:24.000000\"}, \"volume-metadata\": {\"vol-meta1\": \"value1\", \"vol-meta2\": \"value2\", \"vol-meta3\": \"value3\"}}" Jul 03 09:45:55.946651 np0000004400 cinder-backup[101319]: }. {{(pid=101319) _read_metadata /opt/stack/cinder/cinder/backup/chunkeddriver.py:327}} Jul 03 09:45:55.951749 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-888e3f93-d9e9-47ce-a144-629fa57e40f8 tempest-VolumesBackupsTest-2142009639 None] Restoring backup version 1.0.0 {{(pid=101319) restore /opt/stack/cinder/cinder/backup/chunkeddriver.py:774}} Jul 03 09:45:55.951749 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-888e3f93-d9e9-47ce-a144-629fa57e40f8 tempest-VolumesBackupsTest-2142009639 None] _read_metadata started, container name: tempest-volumesbackupstest-backup-container-1320776190, metadata filename: volume_b1fc0d58-7747-4bcf-99a7-fb482aacb945/20260703094530/az_nova_backup_e353b2b2-ecff-4fe0-8148-bf9d1d84a8bf_metadata. {{(pid=101319) _read_metadata /opt/stack/cinder/cinder/backup/chunkeddriver.py:320}} Jul 03 09:45:55.970965 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-888e3f93-d9e9-47ce-a144-629fa57e40f8 tempest-VolumesBackupsTest-2142009639 None] _read_metadata finished. Metadata: { Jul 03 09:45:55.970965 np0000004400 cinder-backup[101319]: "backup_description": "tempest-backup-description-721862093", Jul 03 09:45:55.970965 np0000004400 cinder-backup[101319]: "backup_id": "e353b2b2-ecff-4fe0-8148-bf9d1d84a8bf", Jul 03 09:45:55.970965 np0000004400 cinder-backup[101319]: "backup_name": "tempest-VolumesBackupsTest-Backup-1542290489", Jul 03 09:45:55.970965 np0000004400 cinder-backup[101319]: "created_at": "2026-07-03 09:45:24+00:00", Jul 03 09:45:55.970965 np0000004400 cinder-backup[101319]: "objects": [ Jul 03 09:45:55.970965 np0000004400 cinder-backup[101319]: { Jul 03 09:45:55.970965 np0000004400 cinder-backup[101319]: "volume_b1fc0d58-7747-4bcf-99a7-fb482aacb945/20260703094530/az_nova_backup_e353b2b2-ecff-4fe0-8148-bf9d1d84a8bf-00001": { Jul 03 09:45:55.970965 np0000004400 cinder-backup[101319]: "compression": "zlib", Jul 03 09:45:55.970965 np0000004400 cinder-backup[101319]: "length": 52428800, Jul 03 09:45:55.970965 np0000004400 cinder-backup[101319]: "md5": "25e317773f308e446cc84c503a6d1f85", Jul 03 09:45:55.970965 np0000004400 cinder-backup[101319]: "offset": 0 Jul 03 09:45:55.970965 np0000004400 cinder-backup[101319]: } Jul 03 09:45:55.970965 np0000004400 cinder-backup[101319]: }, Jul 03 09:45:55.970965 np0000004400 cinder-backup[101319]: { Jul 03 09:45:55.970965 np0000004400 cinder-backup[101319]: "volume_b1fc0d58-7747-4bcf-99a7-fb482aacb945/20260703094530/az_nova_backup_e353b2b2-ecff-4fe0-8148-bf9d1d84a8bf-00002": { Jul 03 09:45:55.970965 np0000004400 cinder-backup[101319]: "compression": "zlib", Jul 03 09:45:55.970965 np0000004400 cinder-backup[101319]: "length": 52428800, Jul 03 09:45:55.970965 np0000004400 cinder-backup[101319]: "md5": "25e317773f308e446cc84c503a6d1f85", Jul 03 09:45:55.970965 np0000004400 cinder-backup[101319]: "offset": 52428800 Jul 03 09:45:55.970965 np0000004400 cinder-backup[101319]: } Jul 03 09:45:55.970965 np0000004400 cinder-backup[101319]: }, Jul 03 09:45:55.970965 np0000004400 cinder-backup[101319]: { Jul 03 09:45:55.970965 np0000004400 cinder-backup[101319]: "volume_b1fc0d58-7747-4bcf-99a7-fb482aacb945/20260703094530/az_nova_backup_e353b2b2-ecff-4fe0-8148-bf9d1d84a8bf-00003": { Jul 03 09:45:55.970965 np0000004400 cinder-backup[101319]: "compression": "zlib", Jul 03 09:45:55.970965 np0000004400 cinder-backup[101319]: "length": 52428800, Jul 03 09:45:55.970965 np0000004400 cinder-backup[101319]: "md5": "25e317773f308e446cc84c503a6d1f85", Jul 03 09:45:55.970965 np0000004400 cinder-backup[101319]: "offset": 104857600 Jul 03 09:45:55.970965 np0000004400 cinder-backup[101319]: } Jul 03 09:45:55.970965 np0000004400 cinder-backup[101319]: }, Jul 03 09:45:55.970965 np0000004400 cinder-backup[101319]: { Jul 03 09:45:55.970965 np0000004400 cinder-backup[101319]: "volume_b1fc0d58-7747-4bcf-99a7-fb482aacb945/20260703094530/az_nova_backup_e353b2b2-ecff-4fe0-8148-bf9d1d84a8bf-00004": { Jul 03 09:45:55.970965 np0000004400 cinder-backup[101319]: "compression": "zlib", Jul 03 09:45:55.970965 np0000004400 cinder-backup[101319]: "length": 52428800, Jul 03 09:45:55.970965 np0000004400 cinder-backup[101319]: "md5": "25e317773f308e446cc84c503a6d1f85", Jul 03 09:45:55.970965 np0000004400 cinder-backup[101319]: "offset": 157286400 Jul 03 09:45:55.970965 np0000004400 cinder-backup[101319]: } Jul 03 09:45:55.970965 np0000004400 cinder-backup[101319]: }, Jul 03 09:45:55.970965 np0000004400 cinder-backup[101319]: { Jul 03 09:45:55.970965 np0000004400 cinder-backup[101319]: "volume_b1fc0d58-7747-4bcf-99a7-fb482aacb945/20260703094530/az_nova_backup_e353b2b2-ecff-4fe0-8148-bf9d1d84a8bf-00005": { Jul 03 09:45:55.970965 np0000004400 cinder-backup[101319]: "compression": "zlib", Jul 03 09:45:55.970965 np0000004400 cinder-backup[101319]: "length": 52428800, Jul 03 09:45:55.970965 np0000004400 cinder-backup[101319]: "md5": "25e317773f308e446cc84c503a6d1f85", Jul 03 09:45:55.970965 np0000004400 cinder-backup[101319]: "offset": 209715200 Jul 03 09:45:55.970965 np0000004400 cinder-backup[101319]: } Jul 03 09:45:55.970965 np0000004400 cinder-backup[101319]: }, Jul 03 09:45:55.970965 np0000004400 cinder-backup[101319]: { Jul 03 09:45:55.970965 np0000004400 cinder-backup[101319]: "volume_b1fc0d58-7747-4bcf-99a7-fb482aacb945/20260703094530/az_nova_backup_e353b2b2-ecff-4fe0-8148-bf9d1d84a8bf-00006": { Jul 03 09:45:55.970965 np0000004400 cinder-backup[101319]: "compression": "zlib", Jul 03 09:45:55.970965 np0000004400 cinder-backup[101319]: "length": 52428800, Jul 03 09:45:55.970965 np0000004400 cinder-backup[101319]: "md5": "25e317773f308e446cc84c503a6d1f85", Jul 03 09:45:55.970965 np0000004400 cinder-backup[101319]: "offset": 262144000 Jul 03 09:45:55.970965 np0000004400 cinder-backup[101319]: } Jul 03 09:45:55.970965 np0000004400 cinder-backup[101319]: }, Jul 03 09:45:55.970965 np0000004400 cinder-backup[101319]: { Jul 03 09:45:55.970965 np0000004400 cinder-backup[101319]: "volume_b1fc0d58-7747-4bcf-99a7-fb482aacb945/20260703094530/az_nova_backup_e353b2b2-ecff-4fe0-8148-bf9d1d84a8bf-00007": { Jul 03 09:45:55.970965 np0000004400 cinder-backup[101319]: "compression": "zlib", Jul 03 09:45:55.970965 np0000004400 cinder-backup[101319]: "length": 52428800, Jul 03 09:45:55.970965 np0000004400 cinder-backup[101319]: "md5": "25e317773f308e446cc84c503a6d1f85", Jul 03 09:45:55.970965 np0000004400 cinder-backup[101319]: "offset": 314572800 Jul 03 09:45:55.970965 np0000004400 cinder-backup[101319]: } Jul 03 09:45:55.970965 np0000004400 cinder-backup[101319]: }, Jul 03 09:45:55.970965 np0000004400 cinder-backup[101319]: { Jul 03 09:45:55.970965 np0000004400 cinder-backup[101319]: "volume_b1fc0d58-7747-4bcf-99a7-fb482aacb945/20260703094530/az_nova_backup_e353b2b2-ecff-4fe0-8148-bf9d1d84a8bf-00008": { Jul 03 09:45:55.970965 np0000004400 cinder-backup[101319]: "compression": "zlib", Jul 03 09:45:55.970965 np0000004400 cinder-backup[101319]: "length": 52428800, Jul 03 09:45:55.970965 np0000004400 cinder-backup[101319]: "md5": "25e317773f308e446cc84c503a6d1f85", Jul 03 09:45:55.970965 np0000004400 cinder-backup[101319]: "offset": 367001600 Jul 03 09:45:55.970965 np0000004400 cinder-backup[101319]: } Jul 03 09:45:55.970965 np0000004400 cinder-backup[101319]: }, Jul 03 09:45:55.970965 np0000004400 cinder-backup[101319]: { Jul 03 09:45:55.970965 np0000004400 cinder-backup[101319]: "volume_b1fc0d58-7747-4bcf-99a7-fb482aacb945/20260703094530/az_nova_backup_e353b2b2-ecff-4fe0-8148-bf9d1d84a8bf-00009": { Jul 03 09:45:55.970965 np0000004400 cinder-backup[101319]: "compression": "zlib", Jul 03 09:45:55.970965 np0000004400 cinder-backup[101319]: "length": 52428800, Jul 03 09:45:55.970965 np0000004400 cinder-backup[101319]: "md5": "25e317773f308e446cc84c503a6d1f85", Jul 03 09:45:55.970965 np0000004400 cinder-backup[101319]: "offset": 419430400 Jul 03 09:45:55.970965 np0000004400 cinder-backup[101319]: } Jul 03 09:45:55.970965 np0000004400 cinder-backup[101319]: }, Jul 03 09:45:55.970965 np0000004400 cinder-backup[101319]: { Jul 03 09:45:55.970965 np0000004400 cinder-backup[101319]: "volume_b1fc0d58-7747-4bcf-99a7-fb482aacb945/20260703094530/az_nova_backup_e353b2b2-ecff-4fe0-8148-bf9d1d84a8bf-00010": { Jul 03 09:45:55.970965 np0000004400 cinder-backup[101319]: "compression": "zlib", Jul 03 09:45:55.970965 np0000004400 cinder-backup[101319]: "length": 52428800, Jul 03 09:45:55.970965 np0000004400 cinder-backup[101319]: "md5": "25e317773f308e446cc84c503a6d1f85", Jul 03 09:45:55.970965 np0000004400 cinder-backup[101319]: "offset": 471859200 Jul 03 09:45:55.970965 np0000004400 cinder-backup[101319]: } Jul 03 09:45:55.970965 np0000004400 cinder-backup[101319]: }, Jul 03 09:45:55.970965 np0000004400 cinder-backup[101319]: { Jul 03 09:45:55.970965 np0000004400 cinder-backup[101319]: "volume_b1fc0d58-7747-4bcf-99a7-fb482aacb945/20260703094530/az_nova_backup_e353b2b2-ecff-4fe0-8148-bf9d1d84a8bf-00011": { Jul 03 09:45:55.970965 np0000004400 cinder-backup[101319]: "compression": "zlib", Jul 03 09:45:55.970965 np0000004400 cinder-backup[101319]: "length": 52428800, Jul 03 09:45:55.970965 np0000004400 cinder-backup[101319]: "md5": "25e317773f308e446cc84c503a6d1f85", Jul 03 09:45:55.970965 np0000004400 cinder-backup[101319]: "offset": 524288000 Jul 03 09:45:55.970965 np0000004400 cinder-backup[101319]: } Jul 03 09:45:55.970965 np0000004400 cinder-backup[101319]: }, Jul 03 09:45:55.970965 np0000004400 cinder-backup[101319]: { Jul 03 09:45:55.970965 np0000004400 cinder-backup[101319]: "volume_b1fc0d58-7747-4bcf-99a7-fb482aacb945/20260703094530/az_nova_backup_e353b2b2-ecff-4fe0-8148-bf9d1d84a8bf-00012": { Jul 03 09:45:55.970965 np0000004400 cinder-backup[101319]: "compression": "zlib", Jul 03 09:45:55.970965 np0000004400 cinder-backup[101319]: "length": 52428800, Jul 03 09:45:55.970965 np0000004400 cinder-backup[101319]: "md5": "25e317773f308e446cc84c503a6d1f85", Jul 03 09:45:55.970965 np0000004400 cinder-backup[101319]: "offset": 576716800 Jul 03 09:45:55.970965 np0000004400 cinder-backup[101319]: } Jul 03 09:45:55.970965 np0000004400 cinder-backup[101319]: }, Jul 03 09:45:55.970965 np0000004400 cinder-backup[101319]: { Jul 03 09:45:55.970965 np0000004400 cinder-backup[101319]: "volume_b1fc0d58-7747-4bcf-99a7-fb482aacb945/20260703094530/az_nova_backup_e353b2b2-ecff-4fe0-8148-bf9d1d84a8bf-00013": { Jul 03 09:45:55.970965 np0000004400 cinder-backup[101319]: "compression": "zlib", Jul 03 09:45:55.970965 np0000004400 cinder-backup[101319]: "length": 52428800, Jul 03 09:45:55.970965 np0000004400 cinder-backup[101319]: "md5": "25e317773f308e446cc84c503a6d1f85", Jul 03 09:45:55.970965 np0000004400 cinder-backup[101319]: "offset": 629145600 Jul 03 09:45:55.970965 np0000004400 cinder-backup[101319]: } Jul 03 09:45:55.970965 np0000004400 cinder-backup[101319]: }, Jul 03 09:45:55.970965 np0000004400 cinder-backup[101319]: { Jul 03 09:45:55.970965 np0000004400 cinder-backup[101319]: "volume_b1fc0d58-7747-4bcf-99a7-fb482aacb945/20260703094530/az_nova_backup_e353b2b2-ecff-4fe0-8148-bf9d1d84a8bf-00014": { Jul 03 09:45:55.970965 np0000004400 cinder-backup[101319]: "compression": "zlib", Jul 03 09:45:55.970965 np0000004400 cinder-backup[101319]: "length": 52428800, Jul 03 09:45:55.970965 np0000004400 cinder-backup[101319]: "md5": "25e317773f308e446cc84c503a6d1f85", Jul 03 09:45:55.970965 np0000004400 cinder-backup[101319]: "offset": 681574400 Jul 03 09:45:55.970965 np0000004400 cinder-backup[101319]: } Jul 03 09:45:55.970965 np0000004400 cinder-backup[101319]: }, Jul 03 09:45:55.970965 np0000004400 cinder-backup[101319]: { Jul 03 09:45:55.970965 np0000004400 cinder-backup[101319]: "volume_b1fc0d58-7747-4bcf-99a7-fb482aacb945/20260703094530/az_nova_backup_e353b2b2-ecff-4fe0-8148-bf9d1d84a8bf-00015": { Jul 03 09:45:55.970965 np0000004400 cinder-backup[101319]: "compression": "zlib", Jul 03 09:45:55.970965 np0000004400 cinder-backup[101319]: "length": 52428800, Jul 03 09:45:55.970965 np0000004400 cinder-backup[101319]: "md5": "25e317773f308e446cc84c503a6d1f85", Jul 03 09:45:55.970965 np0000004400 cinder-backup[101319]: "offset": 734003200 Jul 03 09:45:55.970965 np0000004400 cinder-backup[101319]: } Jul 03 09:45:55.970965 np0000004400 cinder-backup[101319]: }, Jul 03 09:45:55.970965 np0000004400 cinder-backup[101319]: { Jul 03 09:45:55.970965 np0000004400 cinder-backup[101319]: "volume_b1fc0d58-7747-4bcf-99a7-fb482aacb945/20260703094530/az_nova_backup_e353b2b2-ecff-4fe0-8148-bf9d1d84a8bf-00016": { Jul 03 09:45:55.970965 np0000004400 cinder-backup[101319]: "compression": "zlib", Jul 03 09:45:55.970965 np0000004400 cinder-backup[101319]: "length": 52428800, Jul 03 09:45:55.970965 np0000004400 cinder-backup[101319]: "md5": "25e317773f308e446cc84c503a6d1f85", Jul 03 09:45:55.970965 np0000004400 cinder-backup[101319]: "offset": 786432000 Jul 03 09:45:55.970965 np0000004400 cinder-backup[101319]: } Jul 03 09:45:55.970965 np0000004400 cinder-backup[101319]: }, Jul 03 09:45:55.970965 np0000004400 cinder-backup[101319]: { Jul 03 09:45:55.970965 np0000004400 cinder-backup[101319]: "volume_b1fc0d58-7747-4bcf-99a7-fb482aacb945/20260703094530/az_nova_backup_e353b2b2-ecff-4fe0-8148-bf9d1d84a8bf-00017": { Jul 03 09:45:55.970965 np0000004400 cinder-backup[101319]: "compression": "zlib", Jul 03 09:45:55.970965 np0000004400 cinder-backup[101319]: "length": 52428800, Jul 03 09:45:55.970965 np0000004400 cinder-backup[101319]: "md5": "25e317773f308e446cc84c503a6d1f85", Jul 03 09:45:55.970965 np0000004400 cinder-backup[101319]: "offset": 838860800 Jul 03 09:45:55.970965 np0000004400 cinder-backup[101319]: } Jul 03 09:45:55.970965 np0000004400 cinder-backup[101319]: }, Jul 03 09:45:55.970965 np0000004400 cinder-backup[101319]: { Jul 03 09:45:55.970965 np0000004400 cinder-backup[101319]: "volume_b1fc0d58-7747-4bcf-99a7-fb482aacb945/20260703094530/az_nova_backup_e353b2b2-ecff-4fe0-8148-bf9d1d84a8bf-00018": { Jul 03 09:45:55.970965 np0000004400 cinder-backup[101319]: "compression": "zlib", Jul 03 09:45:55.970965 np0000004400 cinder-backup[101319]: "length": 52428800, Jul 03 09:45:55.970965 np0000004400 cinder-backup[101319]: "md5": "25e317773f308e446cc84c503a6d1f85", Jul 03 09:45:55.970965 np0000004400 cinder-backup[101319]: "offset": 891289600 Jul 03 09:45:55.970965 np0000004400 cinder-backup[101319]: } Jul 03 09:45:55.970965 np0000004400 cinder-backup[101319]: }, Jul 03 09:45:55.970965 np0000004400 cinder-backup[101319]: { Jul 03 09:45:55.970965 np0000004400 cinder-backup[101319]: "volume_b1fc0d58-7747-4bcf-99a7-fb482aacb945/20260703094530/az_nova_backup_e353b2b2-ecff-4fe0-8148-bf9d1d84a8bf-00019": { Jul 03 09:45:55.970965 np0000004400 cinder-backup[101319]: "compression": "zlib", Jul 03 09:45:55.970965 np0000004400 cinder-backup[101319]: "length": 52428800, Jul 03 09:45:55.970965 np0000004400 cinder-backup[101319]: "md5": "25e317773f308e446cc84c503a6d1f85", Jul 03 09:45:55.970965 np0000004400 cinder-backup[101319]: "offset": 943718400 Jul 03 09:45:55.970965 np0000004400 cinder-backup[101319]: } Jul 03 09:45:55.970965 np0000004400 cinder-backup[101319]: }, Jul 03 09:45:55.970965 np0000004400 cinder-backup[101319]: { Jul 03 09:45:55.970965 np0000004400 cinder-backup[101319]: "volume_b1fc0d58-7747-4bcf-99a7-fb482aacb945/20260703094530/az_nova_backup_e353b2b2-ecff-4fe0-8148-bf9d1d84a8bf-00020": { Jul 03 09:45:55.970965 np0000004400 cinder-backup[101319]: "compression": "zlib", Jul 03 09:45:55.970965 np0000004400 cinder-backup[101319]: "length": 52428800, Jul 03 09:45:55.970965 np0000004400 cinder-backup[101319]: "md5": "25e317773f308e446cc84c503a6d1f85", Jul 03 09:45:55.970965 np0000004400 cinder-backup[101319]: "offset": 996147200 Jul 03 09:45:55.970965 np0000004400 cinder-backup[101319]: } Jul 03 09:45:55.970965 np0000004400 cinder-backup[101319]: }, Jul 03 09:45:55.970965 np0000004400 cinder-backup[101319]: { Jul 03 09:45:55.970965 np0000004400 cinder-backup[101319]: "volume_b1fc0d58-7747-4bcf-99a7-fb482aacb945/20260703094530/az_nova_backup_e353b2b2-ecff-4fe0-8148-bf9d1d84a8bf-00021": { Jul 03 09:45:55.970965 np0000004400 cinder-backup[101319]: "compression": "zlib", Jul 03 09:45:55.970965 np0000004400 cinder-backup[101319]: "length": 25165824, Jul 03 09:45:55.970965 np0000004400 cinder-backup[101319]: "md5": "77377273b0a4b61febdbf7bbf52b9db9", Jul 03 09:45:55.970965 np0000004400 cinder-backup[101319]: "offset": 1048576000 Jul 03 09:45:55.970965 np0000004400 cinder-backup[101319]: } Jul 03 09:45:55.970965 np0000004400 cinder-backup[101319]: } Jul 03 09:45:55.970965 np0000004400 cinder-backup[101319]: ], Jul 03 09:45:55.970965 np0000004400 cinder-backup[101319]: "parent_id": null, Jul 03 09:45:55.970965 np0000004400 cinder-backup[101319]: "version": "1.0.0", Jul 03 09:45:55.970965 np0000004400 cinder-backup[101319]: "volume_id": "b1fc0d58-7747-4bcf-99a7-fb482aacb945", Jul 03 09:45:55.970965 np0000004400 cinder-backup[101319]: "volume_meta": "{\"version\": 2, \"volume-base-metadata\": {\"id\": \"b1fc0d58-7747-4bcf-99a7-fb482aacb945\", \"_name_id\": null, \"use_quota\": true, \"ec2_id\": null, \"user_id\": \"91463b6c437c4711a49d3c31c513a101\", \"project_id\": \"59044e18a5b24b19a7b9b8a380f2e1a0\", \"snapshot_id\": null, \"cluster_name\": null, \"host\": \"np0000004400@storpool#default\", \"size\": 1, \"availability_zone\": \"nova\", \"status\": \"backing-up\", \"attach_status\": \"detached\", \"migration_status\": null, \"scheduled_at\": \"2026-07-03T09:45:23.000000\", \"launched_at\": \"2026-07-03T09:45:23.000000\", \"terminated_at\": null, \"display_name\": \"tempest-VolumesBackupsTest-Volume-334161830\", \"display_description\": null, \"provider_location\": null, \"provider_auth\": null, \"provider_geometry\": null, \"provider_id\": null, \"volume_type_id\": \"03e13fe6-0e30-4803-ace0-725d38e6dc24\", \"source_volid\": null, \"encryption_key_id\": null, \"consistencygroup_id\": null, \"group_id\": null, \"bootable\": false, \"multiattach\": false, \"replication_status\": null, \"replication_extended_status\": null, \"replication_driver_data\": null, \"previous_status\": \"available\", \"service_uuid\": \"6d4b0e79-fefe-4744-b25f-34be05095200\", \"shared_targets\": true, \"deleted_at\": null, \"deleted\": false, \"created_at\": \"2026-07-03T09:45:23.000000\", \"updated_at\": \"2026-07-03T09:45:24.000000\"}, \"volume-metadata\": {\"vol-meta1\": \"value1\", \"vol-meta2\": \"value2\", \"vol-meta3\": \"value3\"}}" Jul 03 09:45:55.970965 np0000004400 cinder-backup[101319]: }. {{(pid=101319) _read_metadata /opt/stack/cinder/cinder/backup/chunkeddriver.py:327}} Jul 03 09:45:55.976960 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-888e3f93-d9e9-47ce-a144-629fa57e40f8 tempest-VolumesBackupsTest-2142009639 None] v1 volume backup restore of e353b2b2-ecff-4fe0-8148-bf9d1d84a8bf started. {{(pid=101319) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:678}} Jul 03 09:45:55.976960 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-888e3f93-d9e9-47ce-a144-629fa57e40f8 tempest-VolumesBackupsTest-2142009639 None] metadata_object_names = ['volume_b1fc0d58-7747-4bcf-99a7-fb482aacb945/20260703094530/az_nova_backup_e353b2b2-ecff-4fe0-8148-bf9d1d84a8bf-00001', 'volume_b1fc0d58-7747-4bcf-99a7-fb482aacb945/20260703094530/az_nova_backup_e353b2b2-ecff-4fe0-8148-bf9d1d84a8bf-00002', 'volume_b1fc0d58-7747-4bcf-99a7-fb482aacb945/20260703094530/az_nova_backup_e353b2b2-ecff-4fe0-8148-bf9d1d84a8bf-00003', 'volume_b1fc0d58-7747-4bcf-99a7-fb482aacb945/20260703094530/az_nova_backup_e353b2b2-ecff-4fe0-8148-bf9d1d84a8bf-00004', 'volume_b1fc0d58-7747-4bcf-99a7-fb482aacb945/20260703094530/az_nova_backup_e353b2b2-ecff-4fe0-8148-bf9d1d84a8bf-00005', 'volume_b1fc0d58-7747-4bcf-99a7-fb482aacb945/20260703094530/az_nova_backup_e353b2b2-ecff-4fe0-8148-bf9d1d84a8bf-00006', 'volume_b1fc0d58-7747-4bcf-99a7-fb482aacb945/20260703094530/az_nova_backup_e353b2b2-ecff-4fe0-8148-bf9d1d84a8bf-00007', 'volume_b1fc0d58-7747-4bcf-99a7-fb482aacb945/20260703094530/az_nova_backup_e353b2b2-ecff-4fe0-8148-bf9d1d84a8bf-00008', 'volume_b1fc0d58-7747-4bcf-99a7-fb482aacb945/20260703094530/az_nova_backup_e353b2b2-ecff-4fe0-8148-bf9d1d84a8bf-00009', 'volume_b1fc0d58-7747-4bcf-99a7-fb482aacb945/20260703094530/az_nova_backup_e353b2b2-ecff-4fe0-8148-bf9d1d84a8bf-00010', 'volume_b1fc0d58-7747-4bcf-99a7-fb482aacb945/20260703094530/az_nova_backup_e353b2b2-ecff-4fe0-8148-bf9d1d84a8bf-00011', 'volume_b1fc0d58-7747-4bcf-99a7-fb482aacb945/20260703094530/az_nova_backup_e353b2b2-ecff-4fe0-8148-bf9d1d84a8bf-00012', 'volume_b1fc0d58-7747-4bcf-99a7-fb482aacb945/20260703094530/az_nova_backup_e353b2b2-ecff-4fe0-8148-bf9d1d84a8bf-00013', 'volume_b1fc0d58-7747-4bcf-99a7-fb482aacb945/20260703094530/az_nova_backup_e353b2b2-ecff-4fe0-8148-bf9d1d84a8bf-00014', 'volume_b1fc0d58-7747-4bcf-99a7-fb482aacb945/20260703094530/az_nova_backup_e353b2b2-ecff-4fe0-8148-bf9d1d84a8bf-00015', 'volume_b1fc0d58-7747-4bcf-99a7-fb482aacb945/20260703094530/az_nova_backup_e353b2b2-ecff-4fe0-8148-bf9d1d84a8bf-00016', 'volume_b1fc0d58-7747-4bcf-99a7-fb482aacb945/20260703094530/az_nova_backup_e353b2b2-ecff-4fe0-8148-bf9d1d84a8bf-00017', 'volume_b1fc0d58-7747-4bcf-99a7-fb482aacb945/20260703094530/az_nova_backup_e353b2b2-ecff-4fe0-8148-bf9d1d84a8bf-00018', 'volume_b1fc0d58-7747-4bcf-99a7-fb482aacb945/20260703094530/az_nova_backup_e353b2b2-ecff-4fe0-8148-bf9d1d84a8bf-00019', 'volume_b1fc0d58-7747-4bcf-99a7-fb482aacb945/20260703094530/az_nova_backup_e353b2b2-ecff-4fe0-8148-bf9d1d84a8bf-00020', 'volume_b1fc0d58-7747-4bcf-99a7-fb482aacb945/20260703094530/az_nova_backup_e353b2b2-ecff-4fe0-8148-bf9d1d84a8bf-00021']. {{(pid=101319) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:685}} Jul 03 09:45:55.976960 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-6ef928da-3670-4523-823a-3443e2d91692 tempest-VolumesBackupsTest-118275719 None] backup MD5 for volume_72e07e1e-1567-4071-8204-c29cb26d2660/20260703094546/az_nova_backup_8b377d15-3804-4a9c-ad2d-e8e1359c0ee5-00014: 25e317773f308e446cc84c503a6d1f85 {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 09:45:55.976960 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-6ef928da-3670-4523-823a-3443e2d91692 tempest-VolumesBackupsTest-118275719 None] Calling eventlet.sleep(0) {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 09:45:56.030589 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-888e3f93-d9e9-47ce-a144-629fa57e40f8 tempest-VolumesBackupsTest-2142009639 None] generated object list: ['volume_b1fc0d58-7747-4bcf-99a7-fb482aacb945/20260703094530/az_nova_backup_e353b2b2-ecff-4fe0-8148-bf9d1d84a8bf-00001', 'volume_b1fc0d58-7747-4bcf-99a7-fb482aacb945/20260703094530/az_nova_backup_e353b2b2-ecff-4fe0-8148-bf9d1d84a8bf-00002', 'volume_b1fc0d58-7747-4bcf-99a7-fb482aacb945/20260703094530/az_nova_backup_e353b2b2-ecff-4fe0-8148-bf9d1d84a8bf-00003', 'volume_b1fc0d58-7747-4bcf-99a7-fb482aacb945/20260703094530/az_nova_backup_e353b2b2-ecff-4fe0-8148-bf9d1d84a8bf-00004', 'volume_b1fc0d58-7747-4bcf-99a7-fb482aacb945/20260703094530/az_nova_backup_e353b2b2-ecff-4fe0-8148-bf9d1d84a8bf-00005', 'volume_b1fc0d58-7747-4bcf-99a7-fb482aacb945/20260703094530/az_nova_backup_e353b2b2-ecff-4fe0-8148-bf9d1d84a8bf-00006', 'volume_b1fc0d58-7747-4bcf-99a7-fb482aacb945/20260703094530/az_nova_backup_e353b2b2-ecff-4fe0-8148-bf9d1d84a8bf-00007', 'volume_b1fc0d58-7747-4bcf-99a7-fb482aacb945/20260703094530/az_nova_backup_e353b2b2-ecff-4fe0-8148-bf9d1d84a8bf-00008', 'volume_b1fc0d58-7747-4bcf-99a7-fb482aacb945/20260703094530/az_nova_backup_e353b2b2-ecff-4fe0-8148-bf9d1d84a8bf-00009', 'volume_b1fc0d58-7747-4bcf-99a7-fb482aacb945/20260703094530/az_nova_backup_e353b2b2-ecff-4fe0-8148-bf9d1d84a8bf-00010', 'volume_b1fc0d58-7747-4bcf-99a7-fb482aacb945/20260703094530/az_nova_backup_e353b2b2-ecff-4fe0-8148-bf9d1d84a8bf-00011', 'volume_b1fc0d58-7747-4bcf-99a7-fb482aacb945/20260703094530/az_nova_backup_e353b2b2-ecff-4fe0-8148-bf9d1d84a8bf-00012', 'volume_b1fc0d58-7747-4bcf-99a7-fb482aacb945/20260703094530/az_nova_backup_e353b2b2-ecff-4fe0-8148-bf9d1d84a8bf-00013', 'volume_b1fc0d58-7747-4bcf-99a7-fb482aacb945/20260703094530/az_nova_backup_e353b2b2-ecff-4fe0-8148-bf9d1d84a8bf-00014', 'volume_b1fc0d58-7747-4bcf-99a7-fb482aacb945/20260703094530/az_nova_backup_e353b2b2-ecff-4fe0-8148-bf9d1d84a8bf-00015', 'volume_b1fc0d58-7747-4bcf-99a7-fb482aacb945/20260703094530/az_nova_backup_e353b2b2-ecff-4fe0-8148-bf9d1d84a8bf-00016', 'volume_b1fc0d58-7747-4bcf-99a7-fb482aacb945/20260703094530/az_nova_backup_e353b2b2-ecff-4fe0-8148-bf9d1d84a8bf-00017', 'volume_b1fc0d58-7747-4bcf-99a7-fb482aacb945/20260703094530/az_nova_backup_e353b2b2-ecff-4fe0-8148-bf9d1d84a8bf-00018', 'volume_b1fc0d58-7747-4bcf-99a7-fb482aacb945/20260703094530/az_nova_backup_e353b2b2-ecff-4fe0-8148-bf9d1d84a8bf-00019', 'volume_b1fc0d58-7747-4bcf-99a7-fb482aacb945/20260703094530/az_nova_backup_e353b2b2-ecff-4fe0-8148-bf9d1d84a8bf-00020', 'volume_b1fc0d58-7747-4bcf-99a7-fb482aacb945/20260703094530/az_nova_backup_e353b2b2-ecff-4fe0-8148-bf9d1d84a8bf-00021', 'volume_b1fc0d58-7747-4bcf-99a7-fb482aacb945/20260703094530/az_nova_backup_e353b2b2-ecff-4fe0-8148-bf9d1d84a8bf_metadata', 'volume_b1fc0d58-7747-4bcf-99a7-fb482aacb945/20260703094530/az_nova_backup_e353b2b2-ecff-4fe0-8148-bf9d1d84a8bf_sha256file']. {{(pid=101319) _generate_object_names /opt/stack/cinder/cinder/backup/chunkeddriver.py:260}} Jul 03 09:45:56.037959 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-888e3f93-d9e9-47ce-a144-629fa57e40f8 tempest-VolumesBackupsTest-2142009639 None] restoring object. backup: e353b2b2-ecff-4fe0-8148-bf9d1d84a8bf, container: tempest-volumesbackupstest-backup-container-1320776190, object name: volume_b1fc0d58-7747-4bcf-99a7-fb482aacb945/20260703094530/az_nova_backup_e353b2b2-ecff-4fe0-8148-bf9d1d84a8bf-00001, volume: 2a67969a-282a-431e-9fb2-763d3c62eab0. {{(pid=101319) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:705}} Jul 03 09:45:56.058338 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-888e3f93-d9e9-47ce-a144-629fa57e40f8 tempest-VolumesBackupsTest-2142009639 None] decompressing data using zlib algorithm {{(pid=101319) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:722}} Jul 03 09:45:56.164769 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-9a399181-d884-4e46-a928-590766ad92c9 tempest-ProjectAdminTests33-1900627284 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101319) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 09:45:56.164769 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-9a399181-d884-4e46-a928-590766ad92c9 tempest-ProjectAdminTests33-1900627284 None] About to put_object {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 09:45:56.191434 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-6ef928da-3670-4523-823a-3443e2d91692 tempest-VolumesBackupsTest-118275719 None] Backing up chunk of data from volume. {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 09:45:56.318427 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-9a399181-d884-4e46-a928-590766ad92c9 tempest-ProjectAdminTests33-1900627284 None] backup MD5 for volume_52be2cf8-1f6a-47e1-910d-17cdde3abb60/20260703094549/az_nova_backup_ec711725-25f0-4982-afe6-3b48b0e50917-00012: 25e317773f308e446cc84c503a6d1f85 {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 09:45:56.318427 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-9a399181-d884-4e46-a928-590766ad92c9 tempest-ProjectAdminTests33-1900627284 None] Calling eventlet.sleep(0) {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 09:45:56.464257 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-6ef928da-3670-4523-823a-3443e2d91692 tempest-VolumesBackupsTest-118275719 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101319) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 09:45:56.464423 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-6ef928da-3670-4523-823a-3443e2d91692 tempest-VolumesBackupsTest-118275719 None] About to put_object {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 09:45:56.508537 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-888e3f93-d9e9-47ce-a144-629fa57e40f8 tempest-VolumesBackupsTest-2142009639 None] restoring object. backup: e353b2b2-ecff-4fe0-8148-bf9d1d84a8bf, container: tempest-volumesbackupstest-backup-container-1320776190, object name: volume_b1fc0d58-7747-4bcf-99a7-fb482aacb945/20260703094530/az_nova_backup_e353b2b2-ecff-4fe0-8148-bf9d1d84a8bf-00002, volume: 2a67969a-282a-431e-9fb2-763d3c62eab0. {{(pid=101319) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:705}} Jul 03 09:45:56.529341 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-888e3f93-d9e9-47ce-a144-629fa57e40f8 tempest-VolumesBackupsTest-2142009639 None] decompressing data using zlib algorithm {{(pid=101319) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:722}} Jul 03 09:45:56.588956 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-6ef928da-3670-4523-823a-3443e2d91692 tempest-VolumesBackupsTest-118275719 None] backup MD5 for volume_72e07e1e-1567-4071-8204-c29cb26d2660/20260703094546/az_nova_backup_8b377d15-3804-4a9c-ad2d-e8e1359c0ee5-00015: 25e317773f308e446cc84c503a6d1f85 {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 09:45:56.589144 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-6ef928da-3670-4523-823a-3443e2d91692 tempest-VolumesBackupsTest-118275719 None] Calling eventlet.sleep(0) {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 09:45:56.886966 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-888e3f93-d9e9-47ce-a144-629fa57e40f8 tempest-VolumesBackupsTest-2142009639 None] restoring object. backup: e353b2b2-ecff-4fe0-8148-bf9d1d84a8bf, container: tempest-volumesbackupstest-backup-container-1320776190, object name: volume_b1fc0d58-7747-4bcf-99a7-fb482aacb945/20260703094530/az_nova_backup_e353b2b2-ecff-4fe0-8148-bf9d1d84a8bf-00003, volume: 2a67969a-282a-431e-9fb2-763d3c62eab0. {{(pid=101319) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:705}} Jul 03 09:45:56.908890 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-888e3f93-d9e9-47ce-a144-629fa57e40f8 tempest-VolumesBackupsTest-2142009639 None] decompressing data using zlib algorithm {{(pid=101319) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:722}} Jul 03 09:45:56.936547 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-6ef928da-3670-4523-823a-3443e2d91692 tempest-VolumesBackupsTest-118275719 None] Backing up chunk of data from volume. {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 09:45:56.947848 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-9a399181-d884-4e46-a928-590766ad92c9 tempest-ProjectAdminTests33-1900627284 None] Backing up chunk of data from volume. {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 09:45:57.267097 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-6ef928da-3670-4523-823a-3443e2d91692 tempest-VolumesBackupsTest-118275719 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101319) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 09:45:57.267235 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-6ef928da-3670-4523-823a-3443e2d91692 tempest-VolumesBackupsTest-118275719 None] About to put_object {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 09:45:57.267418 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-9a399181-d884-4e46-a928-590766ad92c9 tempest-ProjectAdminTests33-1900627284 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101319) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 09:45:57.267595 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-9a399181-d884-4e46-a928-590766ad92c9 tempest-ProjectAdminTests33-1900627284 None] About to put_object {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 09:45:57.274269 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-888e3f93-d9e9-47ce-a144-629fa57e40f8 tempest-VolumesBackupsTest-2142009639 None] restoring object. backup: e353b2b2-ecff-4fe0-8148-bf9d1d84a8bf, container: tempest-volumesbackupstest-backup-container-1320776190, object name: volume_b1fc0d58-7747-4bcf-99a7-fb482aacb945/20260703094530/az_nova_backup_e353b2b2-ecff-4fe0-8148-bf9d1d84a8bf-00004, volume: 2a67969a-282a-431e-9fb2-763d3c62eab0. {{(pid=101319) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:705}} Jul 03 09:45:57.297269 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-888e3f93-d9e9-47ce-a144-629fa57e40f8 tempest-VolumesBackupsTest-2142009639 None] decompressing data using zlib algorithm {{(pid=101319) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:722}} Jul 03 09:45:57.402038 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-6ef928da-3670-4523-823a-3443e2d91692 tempest-VolumesBackupsTest-118275719 None] backup MD5 for volume_72e07e1e-1567-4071-8204-c29cb26d2660/20260703094546/az_nova_backup_8b377d15-3804-4a9c-ad2d-e8e1359c0ee5-00016: 25e317773f308e446cc84c503a6d1f85 {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 09:45:57.402514 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-6ef928da-3670-4523-823a-3443e2d91692 tempest-VolumesBackupsTest-118275719 None] Calling eventlet.sleep(0) {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 09:45:57.408666 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-9a399181-d884-4e46-a928-590766ad92c9 tempest-ProjectAdminTests33-1900627284 None] backup MD5 for volume_52be2cf8-1f6a-47e1-910d-17cdde3abb60/20260703094549/az_nova_backup_ec711725-25f0-4982-afe6-3b48b0e50917-00013: 25e317773f308e446cc84c503a6d1f85 {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 09:45:57.408856 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-9a399181-d884-4e46-a928-590766ad92c9 tempest-ProjectAdminTests33-1900627284 None] Calling eventlet.sleep(0) {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 09:45:57.685014 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-888e3f93-d9e9-47ce-a144-629fa57e40f8 tempest-VolumesBackupsTest-2142009639 None] restoring object. backup: e353b2b2-ecff-4fe0-8148-bf9d1d84a8bf, container: tempest-volumesbackupstest-backup-container-1320776190, object name: volume_b1fc0d58-7747-4bcf-99a7-fb482aacb945/20260703094530/az_nova_backup_e353b2b2-ecff-4fe0-8148-bf9d1d84a8bf-00005, volume: 2a67969a-282a-431e-9fb2-763d3c62eab0. {{(pid=101319) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:705}} Jul 03 09:45:57.700845 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-888e3f93-d9e9-47ce-a144-629fa57e40f8 tempest-VolumesBackupsTest-2142009639 None] decompressing data using zlib algorithm {{(pid=101319) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:722}} Jul 03 09:45:57.730383 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-9a399181-d884-4e46-a928-590766ad92c9 tempest-ProjectAdminTests33-1900627284 None] Backing up chunk of data from volume. {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 09:45:57.731058 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-6ef928da-3670-4523-823a-3443e2d91692 tempest-VolumesBackupsTest-118275719 None] Backing up chunk of data from volume. {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 09:45:58.027808 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-9a399181-d884-4e46-a928-590766ad92c9 tempest-ProjectAdminTests33-1900627284 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101319) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 09:45:58.028100 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-9a399181-d884-4e46-a928-590766ad92c9 tempest-ProjectAdminTests33-1900627284 None] About to put_object {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 09:45:58.028365 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-6ef928da-3670-4523-823a-3443e2d91692 tempest-VolumesBackupsTest-118275719 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101319) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 09:45:58.028529 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-6ef928da-3670-4523-823a-3443e2d91692 tempest-VolumesBackupsTest-118275719 None] About to put_object {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 09:45:58.049336 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-888e3f93-d9e9-47ce-a144-629fa57e40f8 tempest-VolumesBackupsTest-2142009639 None] restoring object. backup: e353b2b2-ecff-4fe0-8148-bf9d1d84a8bf, container: tempest-volumesbackupstest-backup-container-1320776190, object name: volume_b1fc0d58-7747-4bcf-99a7-fb482aacb945/20260703094530/az_nova_backup_e353b2b2-ecff-4fe0-8148-bf9d1d84a8bf-00006, volume: 2a67969a-282a-431e-9fb2-763d3c62eab0. {{(pid=101319) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:705}} Jul 03 09:45:58.071644 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-888e3f93-d9e9-47ce-a144-629fa57e40f8 tempest-VolumesBackupsTest-2142009639 None] decompressing data using zlib algorithm {{(pid=101319) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:722}} Jul 03 09:45:58.185853 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-6ef928da-3670-4523-823a-3443e2d91692 tempest-VolumesBackupsTest-118275719 None] backup MD5 for volume_72e07e1e-1567-4071-8204-c29cb26d2660/20260703094546/az_nova_backup_8b377d15-3804-4a9c-ad2d-e8e1359c0ee5-00017: 25e317773f308e446cc84c503a6d1f85 {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 09:45:58.186009 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-6ef928da-3670-4523-823a-3443e2d91692 tempest-VolumesBackupsTest-118275719 None] Calling eventlet.sleep(0) {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 09:45:58.209322 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-9a399181-d884-4e46-a928-590766ad92c9 tempest-ProjectAdminTests33-1900627284 None] backup MD5 for volume_52be2cf8-1f6a-47e1-910d-17cdde3abb60/20260703094549/az_nova_backup_ec711725-25f0-4982-afe6-3b48b0e50917-00014: 25e317773f308e446cc84c503a6d1f85 {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 09:45:58.209514 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-9a399181-d884-4e46-a928-590766ad92c9 tempest-ProjectAdminTests33-1900627284 None] Calling eventlet.sleep(0) {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 09:45:58.446575 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-888e3f93-d9e9-47ce-a144-629fa57e40f8 tempest-VolumesBackupsTest-2142009639 None] restoring object. backup: e353b2b2-ecff-4fe0-8148-bf9d1d84a8bf, container: tempest-volumesbackupstest-backup-container-1320776190, object name: volume_b1fc0d58-7747-4bcf-99a7-fb482aacb945/20260703094530/az_nova_backup_e353b2b2-ecff-4fe0-8148-bf9d1d84a8bf-00007, volume: 2a67969a-282a-431e-9fb2-763d3c62eab0. {{(pid=101319) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:705}} Jul 03 09:45:58.474266 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-888e3f93-d9e9-47ce-a144-629fa57e40f8 tempest-VolumesBackupsTest-2142009639 None] decompressing data using zlib algorithm {{(pid=101319) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:722}} Jul 03 09:45:58.500539 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-6ef928da-3670-4523-823a-3443e2d91692 tempest-VolumesBackupsTest-118275719 None] Backing up chunk of data from volume. {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 09:45:58.506417 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-9a399181-d884-4e46-a928-590766ad92c9 tempest-ProjectAdminTests33-1900627284 None] Backing up chunk of data from volume. {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 09:45:58.817977 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-9a399181-d884-4e46-a928-590766ad92c9 tempest-ProjectAdminTests33-1900627284 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101319) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 09:45:58.818147 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-9a399181-d884-4e46-a928-590766ad92c9 tempest-ProjectAdminTests33-1900627284 None] About to put_object {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 09:45:58.818377 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-6ef928da-3670-4523-823a-3443e2d91692 tempest-VolumesBackupsTest-118275719 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101319) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 09:45:58.818583 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-6ef928da-3670-4523-823a-3443e2d91692 tempest-VolumesBackupsTest-118275719 None] About to put_object {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 09:45:58.826972 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-888e3f93-d9e9-47ce-a144-629fa57e40f8 tempest-VolumesBackupsTest-2142009639 None] restoring object. backup: e353b2b2-ecff-4fe0-8148-bf9d1d84a8bf, container: tempest-volumesbackupstest-backup-container-1320776190, object name: volume_b1fc0d58-7747-4bcf-99a7-fb482aacb945/20260703094530/az_nova_backup_e353b2b2-ecff-4fe0-8148-bf9d1d84a8bf-00008, volume: 2a67969a-282a-431e-9fb2-763d3c62eab0. {{(pid=101319) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:705}} Jul 03 09:45:58.849926 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-888e3f93-d9e9-47ce-a144-629fa57e40f8 tempest-VolumesBackupsTest-2142009639 None] decompressing data using zlib algorithm {{(pid=101319) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:722}} Jul 03 09:45:58.943272 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-9a399181-d884-4e46-a928-590766ad92c9 tempest-ProjectAdminTests33-1900627284 None] backup MD5 for volume_52be2cf8-1f6a-47e1-910d-17cdde3abb60/20260703094549/az_nova_backup_ec711725-25f0-4982-afe6-3b48b0e50917-00015: 25e317773f308e446cc84c503a6d1f85 {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 09:45:58.943400 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-9a399181-d884-4e46-a928-590766ad92c9 tempest-ProjectAdminTests33-1900627284 None] Calling eventlet.sleep(0) {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 09:45:58.955668 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-6ef928da-3670-4523-823a-3443e2d91692 tempest-VolumesBackupsTest-118275719 None] backup MD5 for volume_72e07e1e-1567-4071-8204-c29cb26d2660/20260703094546/az_nova_backup_8b377d15-3804-4a9c-ad2d-e8e1359c0ee5-00018: 25e317773f308e446cc84c503a6d1f85 {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 09:45:58.955668 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-6ef928da-3670-4523-823a-3443e2d91692 tempest-VolumesBackupsTest-118275719 None] Calling eventlet.sleep(0) {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 09:45:59.210044 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-888e3f93-d9e9-47ce-a144-629fa57e40f8 tempest-VolumesBackupsTest-2142009639 None] restoring object. backup: e353b2b2-ecff-4fe0-8148-bf9d1d84a8bf, container: tempest-volumesbackupstest-backup-container-1320776190, object name: volume_b1fc0d58-7747-4bcf-99a7-fb482aacb945/20260703094530/az_nova_backup_e353b2b2-ecff-4fe0-8148-bf9d1d84a8bf-00009, volume: 2a67969a-282a-431e-9fb2-763d3c62eab0. {{(pid=101319) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:705}} Jul 03 09:45:59.241861 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-888e3f93-d9e9-47ce-a144-629fa57e40f8 tempest-VolumesBackupsTest-2142009639 None] decompressing data using zlib algorithm {{(pid=101319) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:722}} Jul 03 09:45:59.254605 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-9a399181-d884-4e46-a928-590766ad92c9 tempest-ProjectAdminTests33-1900627284 None] Backing up chunk of data from volume. {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 09:45:59.266279 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-6ef928da-3670-4523-823a-3443e2d91692 tempest-VolumesBackupsTest-118275719 None] Backing up chunk of data from volume. {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 09:45:59.580589 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-9a399181-d884-4e46-a928-590766ad92c9 tempest-ProjectAdminTests33-1900627284 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101319) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 09:45:59.581053 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-9a399181-d884-4e46-a928-590766ad92c9 tempest-ProjectAdminTests33-1900627284 None] About to put_object {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 09:45:59.581053 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-6ef928da-3670-4523-823a-3443e2d91692 tempest-VolumesBackupsTest-118275719 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101319) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 09:45:59.581133 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-6ef928da-3670-4523-823a-3443e2d91692 tempest-VolumesBackupsTest-118275719 None] About to put_object {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 09:45:59.588064 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-888e3f93-d9e9-47ce-a144-629fa57e40f8 tempest-VolumesBackupsTest-2142009639 None] restoring object. backup: e353b2b2-ecff-4fe0-8148-bf9d1d84a8bf, container: tempest-volumesbackupstest-backup-container-1320776190, object name: volume_b1fc0d58-7747-4bcf-99a7-fb482aacb945/20260703094530/az_nova_backup_e353b2b2-ecff-4fe0-8148-bf9d1d84a8bf-00010, volume: 2a67969a-282a-431e-9fb2-763d3c62eab0. {{(pid=101319) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:705}} Jul 03 09:45:59.607578 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-888e3f93-d9e9-47ce-a144-629fa57e40f8 tempest-VolumesBackupsTest-2142009639 None] decompressing data using zlib algorithm {{(pid=101319) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:722}} Jul 03 09:45:59.706598 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-9a399181-d884-4e46-a928-590766ad92c9 tempest-ProjectAdminTests33-1900627284 None] backup MD5 for volume_52be2cf8-1f6a-47e1-910d-17cdde3abb60/20260703094549/az_nova_backup_ec711725-25f0-4982-afe6-3b48b0e50917-00016: 25e317773f308e446cc84c503a6d1f85 {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 09:45:59.706832 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-9a399181-d884-4e46-a928-590766ad92c9 tempest-ProjectAdminTests33-1900627284 None] Calling eventlet.sleep(0) {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 09:45:59.711204 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-6ef928da-3670-4523-823a-3443e2d91692 tempest-VolumesBackupsTest-118275719 None] backup MD5 for volume_72e07e1e-1567-4071-8204-c29cb26d2660/20260703094546/az_nova_backup_8b377d15-3804-4a9c-ad2d-e8e1359c0ee5-00019: 25e317773f308e446cc84c503a6d1f85 {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 09:45:59.711390 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-6ef928da-3670-4523-823a-3443e2d91692 tempest-VolumesBackupsTest-118275719 None] Calling eventlet.sleep(0) {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 09:45:59.947305 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-888e3f93-d9e9-47ce-a144-629fa57e40f8 tempest-VolumesBackupsTest-2142009639 None] restoring object. backup: e353b2b2-ecff-4fe0-8148-bf9d1d84a8bf, container: tempest-volumesbackupstest-backup-container-1320776190, object name: volume_b1fc0d58-7747-4bcf-99a7-fb482aacb945/20260703094530/az_nova_backup_e353b2b2-ecff-4fe0-8148-bf9d1d84a8bf-00011, volume: 2a67969a-282a-431e-9fb2-763d3c62eab0. {{(pid=101319) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:705}} Jul 03 09:45:59.975718 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-888e3f93-d9e9-47ce-a144-629fa57e40f8 tempest-VolumesBackupsTest-2142009639 None] decompressing data using zlib algorithm {{(pid=101319) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:722}} Jul 03 09:46:00.003442 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-6ef928da-3670-4523-823a-3443e2d91692 tempest-VolumesBackupsTest-118275719 None] Backing up chunk of data from volume. {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 09:46:00.004438 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-9a399181-d884-4e46-a928-590766ad92c9 tempest-ProjectAdminTests33-1900627284 None] Backing up chunk of data from volume. {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 09:46:00.313328 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-9a399181-d884-4e46-a928-590766ad92c9 tempest-ProjectAdminTests33-1900627284 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101319) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 09:46:00.313493 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-9a399181-d884-4e46-a928-590766ad92c9 tempest-ProjectAdminTests33-1900627284 None] About to put_object {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 09:46:00.313801 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-6ef928da-3670-4523-823a-3443e2d91692 tempest-VolumesBackupsTest-118275719 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101319) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 09:46:00.313908 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-6ef928da-3670-4523-823a-3443e2d91692 tempest-VolumesBackupsTest-118275719 None] About to put_object {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 09:46:00.324062 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-888e3f93-d9e9-47ce-a144-629fa57e40f8 tempest-VolumesBackupsTest-2142009639 None] restoring object. backup: e353b2b2-ecff-4fe0-8148-bf9d1d84a8bf, container: tempest-volumesbackupstest-backup-container-1320776190, object name: volume_b1fc0d58-7747-4bcf-99a7-fb482aacb945/20260703094530/az_nova_backup_e353b2b2-ecff-4fe0-8148-bf9d1d84a8bf-00012, volume: 2a67969a-282a-431e-9fb2-763d3c62eab0. {{(pid=101319) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:705}} Jul 03 09:46:00.351793 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-888e3f93-d9e9-47ce-a144-629fa57e40f8 tempest-VolumesBackupsTest-2142009639 None] decompressing data using zlib algorithm {{(pid=101319) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:722}} Jul 03 09:46:00.434769 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-6ef928da-3670-4523-823a-3443e2d91692 tempest-VolumesBackupsTest-118275719 None] backup MD5 for volume_72e07e1e-1567-4071-8204-c29cb26d2660/20260703094546/az_nova_backup_8b377d15-3804-4a9c-ad2d-e8e1359c0ee5-00020: 25e317773f308e446cc84c503a6d1f85 {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 09:46:00.434769 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-6ef928da-3670-4523-823a-3443e2d91692 tempest-VolumesBackupsTest-118275719 None] Calling eventlet.sleep(0) {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 09:46:00.451611 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-9a399181-d884-4e46-a928-590766ad92c9 tempest-ProjectAdminTests33-1900627284 None] backup MD5 for volume_52be2cf8-1f6a-47e1-910d-17cdde3abb60/20260703094549/az_nova_backup_ec711725-25f0-4982-afe6-3b48b0e50917-00017: 25e317773f308e446cc84c503a6d1f85 {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 09:46:00.451804 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-9a399181-d884-4e46-a928-590766ad92c9 tempest-ProjectAdminTests33-1900627284 None] Calling eventlet.sleep(0) {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 09:46:00.732658 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-888e3f93-d9e9-47ce-a144-629fa57e40f8 tempest-VolumesBackupsTest-2142009639 None] restoring object. backup: e353b2b2-ecff-4fe0-8148-bf9d1d84a8bf, container: tempest-volumesbackupstest-backup-container-1320776190, object name: volume_b1fc0d58-7747-4bcf-99a7-fb482aacb945/20260703094530/az_nova_backup_e353b2b2-ecff-4fe0-8148-bf9d1d84a8bf-00013, volume: 2a67969a-282a-431e-9fb2-763d3c62eab0. {{(pid=101319) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:705}} Jul 03 09:46:00.749719 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-888e3f93-d9e9-47ce-a144-629fa57e40f8 tempest-VolumesBackupsTest-2142009639 None] decompressing data using zlib algorithm {{(pid=101319) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:722}} Jul 03 09:46:00.753696 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-6ef928da-3670-4523-823a-3443e2d91692 tempest-VolumesBackupsTest-118275719 None] Backing up chunk of data from volume. {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 09:46:00.773821 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-9a399181-d884-4e46-a928-590766ad92c9 tempest-ProjectAdminTests33-1900627284 None] Backing up chunk of data from volume. {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 09:46:00.870829 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-6ef928da-3670-4523-823a-3443e2d91692 tempest-VolumesBackupsTest-118275719 None] Compressed 25165824 bytes of data to 24470 bytes using zlib. {{(pid=101319) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 09:46:00.871063 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-6ef928da-3670-4523-823a-3443e2d91692 tempest-VolumesBackupsTest-118275719 None] About to put_object {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 09:46:00.943175 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-6ef928da-3670-4523-823a-3443e2d91692 tempest-VolumesBackupsTest-118275719 None] backup MD5 for volume_72e07e1e-1567-4071-8204-c29cb26d2660/20260703094546/az_nova_backup_8b377d15-3804-4a9c-ad2d-e8e1359c0ee5-00021: 77377273b0a4b61febdbf7bbf52b9db9 {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 09:46:00.943328 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-6ef928da-3670-4523-823a-3443e2d91692 tempest-VolumesBackupsTest-118275719 None] Calling eventlet.sleep(0) {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 09:46:01.070794 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-9a399181-d884-4e46-a928-590766ad92c9 tempest-ProjectAdminTests33-1900627284 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101319) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 09:46:01.071031 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-9a399181-d884-4e46-a928-590766ad92c9 tempest-ProjectAdminTests33-1900627284 None] About to put_object {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 09:46:01.078528 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-888e3f93-d9e9-47ce-a144-629fa57e40f8 tempest-VolumesBackupsTest-2142009639 None] restoring object. backup: e353b2b2-ecff-4fe0-8148-bf9d1d84a8bf, container: tempest-volumesbackupstest-backup-container-1320776190, object name: volume_b1fc0d58-7747-4bcf-99a7-fb482aacb945/20260703094530/az_nova_backup_e353b2b2-ecff-4fe0-8148-bf9d1d84a8bf-00014, volume: 2a67969a-282a-431e-9fb2-763d3c62eab0. {{(pid=101319) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:705}} Jul 03 09:46:01.083426 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.driver [None req-6ef928da-3670-4523-823a-3443e2d91692 tempest-VolumesBackupsTest-118275719 None] Getting metadata type 'volume-base-metadata' {{(pid=101319) _save_vol_base_meta /opt/stack/cinder/cinder/backup/driver.py:79}} Jul 03 09:46:01.095371 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.driver [None req-6ef928da-3670-4523-823a-3443e2d91692 tempest-VolumesBackupsTest-118275719 None] Completed fetching metadata type 'volume-base-metadata' {{(pid=101319) _save_vol_base_meta /opt/stack/cinder/cinder/backup/driver.py:98}} Jul 03 09:46:01.095602 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.driver [None req-6ef928da-3670-4523-823a-3443e2d91692 tempest-VolumesBackupsTest-118275719 None] Getting metadata type 'volume-metadata' {{(pid=101319) _save_vol_meta /opt/stack/cinder/cinder/backup/driver.py:109}} Jul 03 09:46:01.100912 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-888e3f93-d9e9-47ce-a144-629fa57e40f8 tempest-VolumesBackupsTest-2142009639 None] decompressing data using zlib algorithm {{(pid=101319) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:722}} Jul 03 09:46:01.101552 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.driver [None req-6ef928da-3670-4523-823a-3443e2d91692 tempest-VolumesBackupsTest-118275719 None] No metadata type 'volume-metadata' available {{(pid=101319) _save_vol_meta /opt/stack/cinder/cinder/backup/driver.py:123}} Jul 03 09:46:01.101769 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.driver [None req-6ef928da-3670-4523-823a-3443e2d91692 tempest-VolumesBackupsTest-118275719 None] Getting metadata type 'volume-glance-metadata' {{(pid=101319) _save_vol_glance_meta /opt/stack/cinder/cinder/backup/driver.py:132}} Jul 03 09:46:01.106054 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.driver [None req-6ef928da-3670-4523-823a-3443e2d91692 tempest-VolumesBackupsTest-118275719 None] Completed fetching metadata type 'volume-glance-metadata' {{(pid=101319) _save_vol_glance_meta /opt/stack/cinder/cinder/backup/driver.py:145}} Jul 03 09:46:01.106201 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-6ef928da-3670-4523-823a-3443e2d91692 tempest-VolumesBackupsTest-118275719 None] _write_sha256file started, container name: volumebackups, sha256file filename: volume_72e07e1e-1567-4071-8204-c29cb26d2660/20260703094546/az_nova_backup_8b377d15-3804-4a9c-ad2d-e8e1359c0ee5_sha256file. {{(pid=101319) _write_sha256file /opt/stack/cinder/cinder/backup/chunkeddriver.py:299}} Jul 03 09:46:01.181168 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-6ef928da-3670-4523-823a-3443e2d91692 tempest-VolumesBackupsTest-118275719 None] _write_sha256file finished. {{(pid=101319) _write_sha256file /opt/stack/cinder/cinder/backup/chunkeddriver.py:315}} Jul 03 09:46:01.182234 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-6ef928da-3670-4523-823a-3443e2d91692 tempest-VolumesBackupsTest-118275719 None] _write_metadata started, container name: volumebackups, metadata filename: volume_72e07e1e-1567-4071-8204-c29cb26d2660/20260703094546/az_nova_backup_8b377d15-3804-4a9c-ad2d-e8e1359c0ee5_metadata. {{(pid=101319) _write_metadata /opt/stack/cinder/cinder/backup/chunkeddriver.py:276}} Jul 03 09:46:01.217719 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-6ef928da-3670-4523-823a-3443e2d91692 tempest-VolumesBackupsTest-118275719 None] _write_metadata finished. Metadata: b'{\n "backup_description": null,\n "backup_id": "8b377d15-3804-4a9c-ad2d-e8e1359c0ee5",\n "backup_name": "tempest-VolumesBackupsTest-Backup-1747870483",\n "created_at": "2026-07-03 09:45:44+00:00",\n "objects": [\n {\n "volume_72e07e1e-1567-4071-8204-c29cb26d2660/20260703094546/az_nova_backup_8b377d15-3804-4a9c-ad2d-e8e1359c0ee5-00001": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "82571f7121cb9475563edde615e4e4df",\n "offset": 0\n }\n },\n {\n "volume_72e07e1e-1567-4071-8204-c29cb26d2660/20260703094546/az_nova_backup_8b377d15-3804-4a9c-ad2d-e8e1359c0ee5-00002": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 52428800\n }\n },\n {\n "volume_72e07e1e-1567-4071-8204-c29cb26d2660/20260703094546/az_nova_backup_8b377d15-3804-4a9c-ad2d-e8e1359c0ee5-00003": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "a35891500449df17e893f84bd88472fb",\n "offset": 104857600\n }\n },\n {\n "volume_72e07e1e-1567-4071-8204-c29cb26d2660/20260703094546/az_nova_backup_8b377d15-3804-4a9c-ad2d-e8e1359c0ee5-00004": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 157286400\n }\n },\n {\n "volume_72e07e1e-1567-4071-8204-c29cb26d2660/20260703094546/az_nova_backup_8b377d15-3804-4a9c-ad2d-e8e1359c0ee5-00005": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 209715200\n }\n },\n {\n "volume_72e07e1e-1567-4071-8204-c29cb26d2660/20260703094546/az_nova_backup_8b377d15-3804-4a9c-ad2d-e8e1359c0ee5-00006": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 262144000\n }\n },\n {\n "volume_72e07e1e-1567-4071-8204-c29cb26d2660/20260703094546/az_nova_backup_8b377d15-3804-4a9c-ad2d-e8e1359c0ee5-00007": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 314572800\n }\n },\n {\n "volume_72e07e1e-1567-4071-8204-c29cb26d2660/20260703094546/az_nova_backup_8b377d15-3804-4a9c-ad2d-e8e1359c0ee5-00008": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 367001600\n }\n },\n {\n "volume_72e07e1e-1567-4071-8204-c29cb26d2660/20260703094546/az_nova_backup_8b377d15-3804-4a9c-ad2d-e8e1359c0ee5-00009": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 419430400\n }\n },\n {\n "volume_72e07e1e-1567-4071-8204-c29cb26d2660/20260703094546/az_nova_backup_8b377d15-3804-4a9c-ad2d-e8e1359c0ee5-00010": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 471859200\n }\n },\n {\n "volume_72e07e1e-1567-4071-8204-c29cb26d2660/20260703094546/az_nova_backup_8b377d15-3804-4a9c-ad2d-e8e1359c0ee5-00011": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 524288000\n }\n },\n {\n "volume_72e07e1e-1567-4071-8204-c29cb26d2660/20260703094546/az_nova_backup_8b377d15-3804-4a9c-ad2d-e8e1359c0ee5-00012": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 576716800\n }\n },\n {\n "volume_72e07e1e-1567-4071-8204-c29cb26d2660/20260703094546/az_nova_backup_8b377d15-3804-4a9c-ad2d-e8e1359c0ee5-00013": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 629145600\n }\n },\n {\n "volume_72e07e1e-1567-4071-8204-c29cb26d2660/20260703094546/az_nova_backup_8b377d15-3804-4a9c-ad2d-e8e1359c0ee5-00014": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 681574400\n }\n },\n {\n "volume_72e07e1e-1567-4071-8204-c29cb26d2660/20260703094546/az_nova_backup_8b377d15-3804-4a9c-ad2d-e8e1359c0ee5-00015": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 734003200\n }\n },\n {\n "volume_72e07e1e-1567-4071-8204-c29cb26d2660/20260703094546/az_nova_backup_8b377d15-3804-4a9c-ad2d-e8e1359c0ee5-00016": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 786432000\n }\n },\n {\n "volume_72e07e1e-1567-4071-8204-c29cb26d2660/20260703094546/az_nova_backup_8b377d15-3804-4a9c-ad2d-e8e1359c0ee5-00017": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 838860800\n }\n },\n {\n "volume_72e07e1e-1567-4071-8204-c29cb26d2660/20260703094546/az_nova_backup_8b377d15-3804-4a9c-ad2d-e8e1359c0ee5-00018": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 891289600\n }\n },\n {\n "volume_72e07e1e-1567-4071-8204-c29cb26d2660/20260703094546/az_nova_backup_8b377d15-3804-4a9c-ad2d-e8e1359c0ee5-00019": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 943718400\n }\n },\n {\n "volume_72e07e1e-1567-4071-8204-c29cb26d2660/20260703094546/az_nova_backup_8b377d15-3804-4a9c-ad2d-e8e1359c0ee5-00020": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 996147200\n }\n },\n {\n "volume_72e07e1e-1567-4071-8204-c29cb26d2660/20260703094546/az_nova_backup_8b377d15-3804-4a9c-ad2d-e8e1359c0ee5-00021": {\n "compression": "zlib",\n "length": 25165824,\n "md5": "77377273b0a4b61febdbf7bbf52b9db9",\n "offset": 1048576000\n }\n }\n ],\n "parent_id": null,\n "version": "1.0.0",\n "volume_id": "72e07e1e-1567-4071-8204-c29cb26d2660",\n "volume_meta": "{\\"version\\": 2, \\"volume-base-metadata\\": {\\"id\\": \\"72e07e1e-1567-4071-8204-c29cb26d2660\\", \\"_name_id\\": null, \\"use_quota\\": true, \\"ec2_id\\": null, \\"user_id\\": \\"b861df2a13684334b293b1f348152e37\\", \\"project_id\\": \\"a484ec9218bf417bb9d7575ae6370646\\", \\"snapshot_id\\": null, \\"cluster_name\\": null, \\"host\\": \\"np0000004400@storpool#template_virtual\\", \\"size\\": 1, \\"availability_zone\\": \\"nova\\", \\"status\\": \\"backing-up\\", \\"attach_status\\": \\"detached\\", \\"migration_status\\": null, \\"scheduled_at\\": \\"2026-07-03T09:45:43.000000\\", \\"launched_at\\": \\"2026-07-03T09:45:43.000000\\", \\"terminated_at\\": null, \\"display_name\\": \\"tempest-VolumesBackupsTest-Volume-895469207\\", \\"display_description\\": null, \\"provider_location\\": null, \\"provider_auth\\": null, \\"provider_geometry\\": null, \\"provider_id\\": null, \\"volume_type_id\\": \\"03e13fe6-0e30-4803-ace0-725d38e6dc24\\", \\"source_volid\\": null, \\"encryption_key_id\\": null, \\"consistencygroup_id\\": null, \\"group_id\\": null, \\"bootable\\": true, \\"multiattach\\": false, \\"replication_status\\": null, \\"replication_extended_status\\": null, \\"replication_driver_data\\": null, \\"previous_status\\": \\"available\\", \\"service_uuid\\": \\"6d4b0e79-fefe-4744-b25f-34be05095200\\", \\"shared_targets\\": true, \\"deleted_at\\": null, \\"deleted\\": false, \\"created_at\\": \\"2026-07-03T09:45:42.000000\\", \\"updated_at\\": \\"2026-07-03T09:45:44.000000\\"}, \\"volume-glance-metadata\\": {\\"hw_rng_model\\": \\"virtio\\", \\"os_glance_failed_import\\": \\"\\", \\"os_glance_importing_to_stores\\": \\"\\", \\"owner_specified.openstack.md5\\": \\"\\", \\"owner_specified.openstack.object\\": \\"images/cirros-0.6.3-x86_64-disk\\", \\"owner_specified.openstack.sha256\\": \\"\\", \\"image_id\\": \\"c1946dda-7935-4a75-a25a-cf65d1d25617\\", \\"image_name\\": \\"cirros-0.6.3-x86_64-disk\\", \\"checksum\\": \\"87617e24a5e30cb3b87fda8c0764838f\\", \\"container_format\\": \\"bare\\", \\"disk_format\\": \\"qcow2\\", \\"min_disk\\": \\"0\\", \\"min_ram\\": \\"0\\", \\"size\\": \\"21692416\\"}}"\n}'. {{(pid=101319) _write_metadata /opt/stack/cinder/cinder/backup/chunkeddriver.py:295}} Jul 03 09:46:01.221933 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-9a399181-d884-4e46-a928-590766ad92c9 tempest-ProjectAdminTests33-1900627284 None] backup MD5 for volume_52be2cf8-1f6a-47e1-910d-17cdde3abb60/20260703094549/az_nova_backup_ec711725-25f0-4982-afe6-3b48b0e50917-00018: 25e317773f308e446cc84c503a6d1f85 {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 09:46:01.222067 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-9a399181-d884-4e46-a928-590766ad92c9 tempest-ProjectAdminTests33-1900627284 None] Calling eventlet.sleep(0) {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 09:46:01.225739 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-6ef928da-3670-4523-823a-3443e2d91692 tempest-VolumesBackupsTest-118275719 None] backup 8b377d15-3804-4a9c-ad2d-e8e1359c0ee5 finished. {{(pid=101319) _finalize_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:462}} Jul 03 09:46:01.366905 np0000004400 cinder-backup[101319]: DEBUG oslo_concurrency.processutils [None req-6ef928da-3670-4523-823a-3443e2d91692 tempest-VolumesBackupsTest-118275719 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chown 0 /dev/sdb {{(pid=101319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 09:46:01.390720 np0000004400 sudo[137968]: stack : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chown 0 /dev/sdb Jul 03 09:46:01.391306 np0000004400 sudo[137968]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1002) Jul 03 09:46:01.512440 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-888e3f93-d9e9-47ce-a144-629fa57e40f8 tempest-VolumesBackupsTest-2142009639 None] restoring object. backup: e353b2b2-ecff-4fe0-8148-bf9d1d84a8bf, container: tempest-volumesbackupstest-backup-container-1320776190, object name: volume_b1fc0d58-7747-4bcf-99a7-fb482aacb945/20260703094530/az_nova_backup_e353b2b2-ecff-4fe0-8148-bf9d1d84a8bf-00015, volume: 2a67969a-282a-431e-9fb2-763d3c62eab0. {{(pid=101319) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:705}} Jul 03 09:46:01.531523 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-888e3f93-d9e9-47ce-a144-629fa57e40f8 tempest-VolumesBackupsTest-2142009639 None] decompressing data using zlib algorithm {{(pid=101319) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:722}} Jul 03 09:46:01.558274 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-9a399181-d884-4e46-a928-590766ad92c9 tempest-ProjectAdminTests33-1900627284 None] Backing up chunk of data from volume. {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 09:46:01.693057 np0000004400 sudo[137968]: pam_unix(sudo:session): session closed for user root Jul 03 09:46:01.864788 np0000004400 cinder-backup[101319]: DEBUG oslo_concurrency.processutils [None req-6ef928da-3670-4523-823a-3443e2d91692 tempest-VolumesBackupsTest-118275719 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chown 0 /dev/sdb" returned: 0 in 0.498s {{(pid=101319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 09:46:01.865383 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-6ef928da-3670-4523-823a-3443e2d91692 tempest-VolumesBackupsTest-118275719 None] ==> disconnect_volume: call "{'args': (, {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-72e07e1e-1567-4071-8204-c29cb26d2660', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '72e07e1e-1567-4071-8204-c29cb26d2660', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': False}, {'type': 'block', 'scsi_wwn': 'SStorPool_iSCSI_DISK_1034578903445799033', 'path': '/dev/sdb'}), 'kwargs': {'force': True, 'ignore_errors': True}}" {{(pid=101319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}} Jul 03 09:46:01.865593 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.base [None req-6ef928da-3670-4523-823a-3443e2d91692 tempest-VolumesBackupsTest-118275719 None] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=101319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jul 03 09:46:01.866107 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-9a399181-d884-4e46-a928-590766ad92c9 tempest-ProjectAdminTests33-1900627284 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101319) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 09:46:01.866230 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-9a399181-d884-4e46-a928-590766ad92c9 tempest-ProjectAdminTests33-1900627284 None] About to put_object {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 09:46:01.871463 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-888e3f93-d9e9-47ce-a144-629fa57e40f8 tempest-VolumesBackupsTest-2142009639 None] restoring object. backup: e353b2b2-ecff-4fe0-8148-bf9d1d84a8bf, container: tempest-volumesbackupstest-backup-container-1320776190, object name: volume_b1fc0d58-7747-4bcf-99a7-fb482aacb945/20260703094530/az_nova_backup_e353b2b2-ecff-4fe0-8148-bf9d1d84a8bf-00016, volume: 2a67969a-282a-431e-9fb2-763d3c62eab0. {{(pid=101319) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:705}} Jul 03 09:46:01.886567 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-888e3f93-d9e9-47ce-a144-629fa57e40f8 tempest-VolumesBackupsTest-2142009639 None] decompressing data using zlib algorithm {{(pid=101319) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:722}} Jul 03 09:46:01.968835 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-9a399181-d884-4e46-a928-590766ad92c9 tempest-ProjectAdminTests33-1900627284 None] backup MD5 for volume_52be2cf8-1f6a-47e1-910d-17cdde3abb60/20260703094549/az_nova_backup_ec711725-25f0-4982-afe6-3b48b0e50917-00019: 25e317773f308e446cc84c503a6d1f85 {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 09:46:01.969028 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-9a399181-d884-4e46-a928-590766ad92c9 tempest-ProjectAdminTests33-1900627284 None] Calling eventlet.sleep(0) {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 09:46:02.234751 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-888e3f93-d9e9-47ce-a144-629fa57e40f8 tempest-VolumesBackupsTest-2142009639 None] restoring object. backup: e353b2b2-ecff-4fe0-8148-bf9d1d84a8bf, container: tempest-volumesbackupstest-backup-container-1320776190, object name: volume_b1fc0d58-7747-4bcf-99a7-fb482aacb945/20260703094530/az_nova_backup_e353b2b2-ecff-4fe0-8148-bf9d1d84a8bf-00017, volume: 2a67969a-282a-431e-9fb2-763d3c62eab0. {{(pid=101319) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:705}} Jul 03 09:46:02.247817 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-888e3f93-d9e9-47ce-a144-629fa57e40f8 tempest-VolumesBackupsTest-2142009639 None] decompressing data using zlib algorithm {{(pid=101319) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:722}} Jul 03 09:46:02.271554 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-9a399181-d884-4e46-a928-590766ad92c9 tempest-ProjectAdminTests33-1900627284 None] Backing up chunk of data from volume. {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 09:46:02.306774 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.base [None req-6ef928da-3670-4523-823a-3443e2d91692 tempest-VolumesBackupsTest-118275719 None] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.440s {{(pid=101319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jul 03 09:46:02.306774 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-6ef928da-3670-4523-823a-3443e2d91692 tempest-VolumesBackupsTest-118275719 None] _get_connection_devices called with parameters: connection_properties={'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-72e07e1e-1567-4071-8204-c29cb26d2660', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '72e07e1e-1567-4071-8204-c29cb26d2660', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': False}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=101319) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:847}} Jul 03 09:46:02.318443 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-6ef928da-3670-4523-823a-3443e2d91692 tempest-VolumesBackupsTest-118275719 None] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS: Jul 03 09:46:02.318443 np0000004400 cinder-backup[101319]: No targets found. Jul 03 09:46:02.318443 np0000004400 cinder-backup[101319]: iSNS: Jul 03 09:46:02.318443 np0000004400 cinder-backup[101319]: No targets found. Jul 03 09:46:02.318443 np0000004400 cinder-backup[101319]: STATIC: Jul 03 09:46:02.318443 np0000004400 cinder-backup[101319]: Target: iqn.2023-03.storpool.com:os--volume-2a67969a-282a-431e-9fb2-763d3c62eab0 Jul 03 09:46:02.318443 np0000004400 cinder-backup[101319]: Portal: 192.168.40.100:3260,-1 Jul 03 09:46:02.318443 np0000004400 cinder-backup[101319]: Iface Name: default Jul 03 09:46:02.318443 np0000004400 cinder-backup[101319]: Target: iqn.2023-03.storpool.com:os--volume-52be2cf8-1f6a-47e1-910d-17cdde3abb60 Jul 03 09:46:02.318443 np0000004400 cinder-backup[101319]: Portal: 192.168.40.100:3260,-1 Jul 03 09:46:02.318443 np0000004400 cinder-backup[101319]: Iface Name: default Jul 03 09:46:02.318443 np0000004400 cinder-backup[101319]: Target: iqn.2023-03.storpool.com:os--volume-76320525-737e-4f58-8523-63ec9abbdc64 Jul 03 09:46:02.318443 np0000004400 cinder-backup[101319]: Portal: 192.168.50.100:3260,-1 Jul 03 09:46:02.318443 np0000004400 cinder-backup[101319]: Iface Name: default Jul 03 09:46:02.318443 np0000004400 cinder-backup[101319]: Portal: 192.168.40.100:3260,-1 Jul 03 09:46:02.318443 np0000004400 cinder-backup[101319]: Iface Name: default Jul 03 09:46:02.318443 np0000004400 cinder-backup[101319]: Target: iqn.2023-03.storpool.com:os--volume-72e07e1e-1567-4071-8204-c29cb26d2660 Jul 03 09:46:02.318443 np0000004400 cinder-backup[101319]: Portal: 192.168.40.100:3260,-1 Jul 03 09:46:02.318443 np0000004400 cinder-backup[101319]: Iface Name: default Jul 03 09:46:02.318443 np0000004400 cinder-backup[101319]: Target: iqn.2023-03.storpool.com:os--volume-d47f5d2f-dce5-42f7-a693-a654fd702622 Jul 03 09:46:02.318443 np0000004400 cinder-backup[101319]: Portal: 192.168.50.100:3260,-1 Jul 03 09:46:02.318443 np0000004400 cinder-backup[101319]: Iface Name: default Jul 03 09:46:02.318443 np0000004400 cinder-backup[101319]: Portal: 192.168.40.100:3260,-1 Jul 03 09:46:02.318443 np0000004400 cinder-backup[101319]: Iface Name: default Jul 03 09:46:02.318443 np0000004400 cinder-backup[101319]: Target: iqn.2023-03.storpool.com:os--volume-6713aeef-c919-4102-a884-a71545173837 Jul 03 09:46:02.318443 np0000004400 cinder-backup[101319]: Portal: 192.168.50.100:3260,-1 Jul 03 09:46:02.318443 np0000004400 cinder-backup[101319]: Iface Name: default Jul 03 09:46:02.318443 np0000004400 cinder-backup[101319]: Portal: 192.168.40.100:3260,-1 Jul 03 09:46:02.318443 np0000004400 cinder-backup[101319]: Iface Name: default Jul 03 09:46:02.318443 np0000004400 cinder-backup[101319]: FIRMWARE: Jul 03 09:46:02.318443 np0000004400 cinder-backup[101319]: No targets found. Jul 03 09:46:02.318443 np0000004400 cinder-backup[101319]: stderr= {{(pid=101319) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jul 03 09:46:02.318443 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-6ef928da-3670-4523-823a-3443e2d91692 tempest-VolumesBackupsTest-118275719 None] Regex to get portals from discoverydb: ^SENDTARGETS: Jul 03 09:46:02.318443 np0000004400 cinder-backup[101319]: .*?^DiscoveryAddress: 192.168.40.100,3260.*? Jul 03 09:46:02.318443 np0000004400 cinder-backup[101319]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=101319) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:390}} Jul 03 09:46:02.318443 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-6ef928da-3670-4523-823a-3443e2d91692 tempest-VolumesBackupsTest-118275719 None] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-72e07e1e-1567-4071-8204-c29cb26d2660', 0)] {{(pid=101319) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:858}} Jul 03 09:46:02.346029 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-6ef928da-3670-4523-823a-3443e2d91692 tempest-VolumesBackupsTest-118275719 None] iscsiadm ('-m', 'session'): stdout=tcp: [107] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-72e07e1e-1567-4071-8204-c29cb26d2660 (non-flash) Jul 03 09:46:02.346029 np0000004400 cinder-backup[101319]: tcp: [108] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-52be2cf8-1f6a-47e1-910d-17cdde3abb60 (non-flash) Jul 03 09:46:02.346029 np0000004400 cinder-backup[101319]: tcp: [109] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2a67969a-282a-431e-9fb2-763d3c62eab0 (non-flash) Jul 03 09:46:02.346029 np0000004400 cinder-backup[101319]: tcp: [110] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6713aeef-c919-4102-a884-a71545173837 (non-flash) Jul 03 09:46:02.346029 np0000004400 cinder-backup[101319]: tcp: [111] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-6713aeef-c919-4102-a884-a71545173837 (non-flash) Jul 03 09:46:02.346029 np0000004400 cinder-backup[101319]: tcp: [82] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-76320525-737e-4f58-8523-63ec9abbdc64 (non-flash) Jul 03 09:46:02.346029 np0000004400 cinder-backup[101319]: tcp: [83] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-76320525-737e-4f58-8523-63ec9abbdc64 (non-flash) Jul 03 09:46:02.346029 np0000004400 cinder-backup[101319]: tcp: [97] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d47f5d2f-dce5-42f7-a693-a654fd702622 (non-flash) Jul 03 09:46:02.346029 np0000004400 cinder-backup[101319]: tcp: [98] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d47f5d2f-dce5-42f7-a693-a654fd702622 (non-flash) Jul 03 09:46:02.346029 np0000004400 cinder-backup[101319]: stderr= {{(pid=101319) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jul 03 09:46:02.346029 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-6ef928da-3670-4523-823a-3443e2d91692 tempest-VolumesBackupsTest-118275719 None] iscsi session list stdout=tcp: [107] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-72e07e1e-1567-4071-8204-c29cb26d2660 (non-flash) Jul 03 09:46:02.346029 np0000004400 cinder-backup[101319]: tcp: [108] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-52be2cf8-1f6a-47e1-910d-17cdde3abb60 (non-flash) Jul 03 09:46:02.346029 np0000004400 cinder-backup[101319]: tcp: [109] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2a67969a-282a-431e-9fb2-763d3c62eab0 (non-flash) Jul 03 09:46:02.346029 np0000004400 cinder-backup[101319]: tcp: [110] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6713aeef-c919-4102-a884-a71545173837 (non-flash) Jul 03 09:46:02.346029 np0000004400 cinder-backup[101319]: tcp: [111] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-6713aeef-c919-4102-a884-a71545173837 (non-flash) Jul 03 09:46:02.346029 np0000004400 cinder-backup[101319]: tcp: [82] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-76320525-737e-4f58-8523-63ec9abbdc64 (non-flash) Jul 03 09:46:02.346029 np0000004400 cinder-backup[101319]: tcp: [83] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-76320525-737e-4f58-8523-63ec9abbdc64 (non-flash) Jul 03 09:46:02.346029 np0000004400 cinder-backup[101319]: tcp: [97] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d47f5d2f-dce5-42f7-a693-a654fd702622 (non-flash) Jul 03 09:46:02.346029 np0000004400 cinder-backup[101319]: tcp: [98] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d47f5d2f-dce5-42f7-a693-a654fd702622 (non-flash) Jul 03 09:46:02.346029 np0000004400 cinder-backup[101319]: stderr= {{(pid=101319) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jul 03 09:46:02.346029 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-6ef928da-3670-4523-823a-3443e2d91692 tempest-VolumesBackupsTest-118275719 None] Sessions list: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-72e07e1e-1567-4071-8204-c29cb26d2660', '107'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-52be2cf8-1f6a-47e1-910d-17cdde3abb60', '108'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-2a67969a-282a-431e-9fb2-763d3c62eab0', '109'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-6713aeef-c919-4102-a884-a71545173837', '110'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-6713aeef-c919-4102-a884-a71545173837', '111'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-76320525-737e-4f58-8523-63ec9abbdc64', '82'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-76320525-737e-4f58-8523-63ec9abbdc64', '83'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-d47f5d2f-dce5-42f7-a693-a654fd702622', '97'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-d47f5d2f-dce5-42f7-a693-a654fd702622', '98')] {{(pid=101319) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:866}} Jul 03 09:46:02.346029 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-6ef928da-3670-4523-823a-3443e2d91692 tempest-VolumesBackupsTest-118275719 None] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-72e07e1e-1567-4071-8204-c29cb26d2660, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-72e07e1e-1567-4071-8204-c29cb26d2660', '107')] {{(pid=101319) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}} Jul 03 09:46:02.346029 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-6ef928da-3670-4523-823a-3443e2d91692 tempest-VolumesBackupsTest-118275719 None] Resulting device map defaultdict(. at 0x7e76e6da0220>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-72e07e1e-1567-4071-8204-c29cb26d2660'): ({'sdb'}, set())}) {{(pid=101319) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:912}} Jul 03 09:46:02.346029 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.linuxscsi [None req-6ef928da-3670-4523-823a-3443e2d91692 tempest-VolumesBackupsTest-118275719 None] Removing single pathed devices sdb {{(pid=101319) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}} Jul 03 09:46:02.356923 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.linuxscsi [None req-6ef928da-3670-4523-823a-3443e2d91692 tempest-VolumesBackupsTest-118275719 None] Flushing IO for device /dev/sdb {{(pid=101319) flush_device_io /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:461}} Jul 03 09:46:02.364867 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.linuxscsi [None req-6ef928da-3670-4523-823a-3443e2d91692 tempest-VolumesBackupsTest-118275719 None] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=101319) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}} Jul 03 09:46:02.439976 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.linuxscsi [None req-6ef928da-3670-4523-823a-3443e2d91692 tempest-VolumesBackupsTest-118275719 None] Checking to see if SCSI volumes sdb have been removed. {{(pid=101319) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}} Jul 03 09:46:02.442451 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.linuxscsi [None req-6ef928da-3670-4523-823a-3443e2d91692 tempest-VolumesBackupsTest-118275719 None] SCSI volumes sdb have been removed. {{(pid=101319) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}} Jul 03 09:46:02.442451 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.linuxscsi [None req-6ef928da-3670-4523-823a-3443e2d91692 tempest-VolumesBackupsTest-118275719 None] Checking to see if device paths {'sdb'} are still under multipathd monitoring {{(pid=101319) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}} Jul 03 09:46:02.584560 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-9a399181-d884-4e46-a928-590766ad92c9 tempest-ProjectAdminTests33-1900627284 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101319) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 09:46:02.584806 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-9a399181-d884-4e46-a928-590766ad92c9 tempest-ProjectAdminTests33-1900627284 None] About to put_object {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 09:46:02.585164 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.linuxscsi [None req-6ef928da-3670-4523-823a-3443e2d91692 tempest-VolumesBackupsTest-118275719 None] Device paths {'sdb'} have been removed from multipathd monitoring. {{(pid=101319) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}} Jul 03 09:46:02.585485 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-6ef928da-3670-4523-823a-3443e2d91692 tempest-VolumesBackupsTest-118275719 None] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-72e07e1e-1567-4071-8204-c29cb26d2660')] {{(pid=101319) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1225}} Jul 03 09:46:02.591395 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-888e3f93-d9e9-47ce-a144-629fa57e40f8 tempest-VolumesBackupsTest-2142009639 None] restoring object. backup: e353b2b2-ecff-4fe0-8148-bf9d1d84a8bf, container: tempest-volumesbackupstest-backup-container-1320776190, object name: volume_b1fc0d58-7747-4bcf-99a7-fb482aacb945/20260703094530/az_nova_backup_e353b2b2-ecff-4fe0-8148-bf9d1d84a8bf-00018, volume: 2a67969a-282a-431e-9fb2-763d3c62eab0. {{(pid=101319) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:705}} Jul 03 09:46:02.597441 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-6ef928da-3670-4523-823a-3443e2d91692 tempest-VolumesBackupsTest-118275719 None] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=101319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 03 09:46:02.610155 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-888e3f93-d9e9-47ce-a144-629fa57e40f8 tempest-VolumesBackupsTest-2142009639 None] decompressing data using zlib algorithm {{(pid=101319) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:722}} Jul 03 09:46:02.632814 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-6ef928da-3670-4523-823a-3443e2d91692 tempest-VolumesBackupsTest-118275719 None] iscsiadm ('--logout',): stdout=Logging out of session [sid: 107, target: iqn.2023-03.storpool.com:os--volume-72e07e1e-1567-4071-8204-c29cb26d2660, portal: 192.168.40.100,3260] Jul 03 09:46:02.632814 np0000004400 cinder-backup[101319]: Logout of [sid: 107, target: iqn.2023-03.storpool.com:os--volume-72e07e1e-1567-4071-8204-c29cb26d2660, portal: 192.168.40.100,3260] successful. Jul 03 09:46:02.632814 np0000004400 cinder-backup[101319]: stderr= {{(pid=101319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 03 09:46:02.648863 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-6ef928da-3670-4523-823a-3443e2d91692 tempest-VolumesBackupsTest-118275719 None] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=101319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 03 09:46:02.649093 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.base [None req-6ef928da-3670-4523-823a-3443e2d91692 tempest-VolumesBackupsTest-118275719 None] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.343s {{(pid=101319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jul 03 09:46:02.649218 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-6ef928da-3670-4523-823a-3443e2d91692 tempest-VolumesBackupsTest-118275719 None] <== disconnect_volume: return (783ms) None {{(pid=101319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}} Jul 03 09:46:02.708325 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-9a399181-d884-4e46-a928-590766ad92c9 tempest-ProjectAdminTests33-1900627284 None] backup MD5 for volume_52be2cf8-1f6a-47e1-910d-17cdde3abb60/20260703094549/az_nova_backup_ec711725-25f0-4982-afe6-3b48b0e50917-00020: 25e317773f308e446cc84c503a6d1f85 {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 09:46:02.708491 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-9a399181-d884-4e46-a928-590766ad92c9 tempest-ProjectAdminTests33-1900627284 None] Calling eventlet.sleep(0) {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 09:46:02.951734 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-888e3f93-d9e9-47ce-a144-629fa57e40f8 tempest-VolumesBackupsTest-2142009639 None] restoring object. backup: e353b2b2-ecff-4fe0-8148-bf9d1d84a8bf, container: tempest-volumesbackupstest-backup-container-1320776190, object name: volume_b1fc0d58-7747-4bcf-99a7-fb482aacb945/20260703094530/az_nova_backup_e353b2b2-ecff-4fe0-8148-bf9d1d84a8bf-00019, volume: 2a67969a-282a-431e-9fb2-763d3c62eab0. {{(pid=101319) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:705}} Jul 03 09:46:02.969151 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-888e3f93-d9e9-47ce-a144-629fa57e40f8 tempest-VolumesBackupsTest-2142009639 None] decompressing data using zlib algorithm {{(pid=101319) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:722}} Jul 03 09:46:02.971100 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-9a399181-d884-4e46-a928-590766ad92c9 tempest-ProjectAdminTests33-1900627284 None] Backing up chunk of data from volume. {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 09:46:03.110077 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-9a399181-d884-4e46-a928-590766ad92c9 tempest-ProjectAdminTests33-1900627284 None] Compressed 25165824 bytes of data to 24470 bytes using zlib. {{(pid=101319) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 09:46:03.110274 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-9a399181-d884-4e46-a928-590766ad92c9 tempest-ProjectAdminTests33-1900627284 None] About to put_object {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 09:46:03.314834 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-888e3f93-d9e9-47ce-a144-629fa57e40f8 tempest-VolumesBackupsTest-2142009639 None] restoring object. backup: e353b2b2-ecff-4fe0-8148-bf9d1d84a8bf, container: tempest-volumesbackupstest-backup-container-1320776190, object name: volume_b1fc0d58-7747-4bcf-99a7-fb482aacb945/20260703094530/az_nova_backup_e353b2b2-ecff-4fe0-8148-bf9d1d84a8bf-00020, volume: 2a67969a-282a-431e-9fb2-763d3c62eab0. {{(pid=101319) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:705}} Jul 03 09:46:03.335727 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-888e3f93-d9e9-47ce-a144-629fa57e40f8 tempest-VolumesBackupsTest-2142009639 None] decompressing data using zlib algorithm {{(pid=101319) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:722}} Jul 03 09:46:03.350916 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-9a399181-d884-4e46-a928-590766ad92c9 tempest-ProjectAdminTests33-1900627284 None] backup MD5 for volume_52be2cf8-1f6a-47e1-910d-17cdde3abb60/20260703094549/az_nova_backup_ec711725-25f0-4982-afe6-3b48b0e50917-00021: 77377273b0a4b61febdbf7bbf52b9db9 {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 09:46:03.351133 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-9a399181-d884-4e46-a928-590766ad92c9 tempest-ProjectAdminTests33-1900627284 None] Calling eventlet.sleep(0) {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 09:46:03.358141 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.driver [None req-9a399181-d884-4e46-a928-590766ad92c9 tempest-ProjectAdminTests33-1900627284 None] Getting metadata type 'volume-base-metadata' {{(pid=101319) _save_vol_base_meta /opt/stack/cinder/cinder/backup/driver.py:79}} Jul 03 09:46:03.364882 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.driver [None req-9a399181-d884-4e46-a928-590766ad92c9 tempest-ProjectAdminTests33-1900627284 None] Completed fetching metadata type 'volume-base-metadata' {{(pid=101319) _save_vol_base_meta /opt/stack/cinder/cinder/backup/driver.py:98}} Jul 03 09:46:03.365071 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.driver [None req-9a399181-d884-4e46-a928-590766ad92c9 tempest-ProjectAdminTests33-1900627284 None] Getting metadata type 'volume-metadata' {{(pid=101319) _save_vol_meta /opt/stack/cinder/cinder/backup/driver.py:109}} Jul 03 09:46:03.369676 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.driver [None req-9a399181-d884-4e46-a928-590766ad92c9 tempest-ProjectAdminTests33-1900627284 None] No metadata type 'volume-metadata' available {{(pid=101319) _save_vol_meta /opt/stack/cinder/cinder/backup/driver.py:123}} Jul 03 09:46:03.369892 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.driver [None req-9a399181-d884-4e46-a928-590766ad92c9 tempest-ProjectAdminTests33-1900627284 None] Getting metadata type 'volume-glance-metadata' {{(pid=101319) _save_vol_glance_meta /opt/stack/cinder/cinder/backup/driver.py:132}} Jul 03 09:46:03.373124 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.driver [None req-9a399181-d884-4e46-a928-590766ad92c9 tempest-ProjectAdminTests33-1900627284 None] No metadata type 'volume-glance-metadata' available {{(pid=101319) _save_vol_glance_meta /opt/stack/cinder/cinder/backup/driver.py:147}} Jul 03 09:46:03.373419 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-9a399181-d884-4e46-a928-590766ad92c9 tempest-ProjectAdminTests33-1900627284 None] _write_sha256file started, container name: volumebackups, sha256file filename: volume_52be2cf8-1f6a-47e1-910d-17cdde3abb60/20260703094549/az_nova_backup_ec711725-25f0-4982-afe6-3b48b0e50917_sha256file. {{(pid=101319) _write_sha256file /opt/stack/cinder/cinder/backup/chunkeddriver.py:299}} Jul 03 09:46:03.446678 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-9a399181-d884-4e46-a928-590766ad92c9 tempest-ProjectAdminTests33-1900627284 None] _write_sha256file finished. {{(pid=101319) _write_sha256file /opt/stack/cinder/cinder/backup/chunkeddriver.py:315}} Jul 03 09:46:03.447491 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-9a399181-d884-4e46-a928-590766ad92c9 tempest-ProjectAdminTests33-1900627284 None] _write_metadata started, container name: volumebackups, metadata filename: volume_52be2cf8-1f6a-47e1-910d-17cdde3abb60/20260703094549/az_nova_backup_ec711725-25f0-4982-afe6-3b48b0e50917_metadata. {{(pid=101319) _write_metadata /opt/stack/cinder/cinder/backup/chunkeddriver.py:276}} Jul 03 09:46:03.471059 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-9a399181-d884-4e46-a928-590766ad92c9 tempest-ProjectAdminTests33-1900627284 None] _write_metadata finished. Metadata: b'{\n "backup_description": null,\n "backup_id": "ec711725-25f0-4982-afe6-3b48b0e50917",\n "backup_name": "tempest-type-Backup-1661276233",\n "created_at": "2026-07-03 09:45:46+00:00",\n "objects": [\n {\n "volume_52be2cf8-1f6a-47e1-910d-17cdde3abb60/20260703094549/az_nova_backup_ec711725-25f0-4982-afe6-3b48b0e50917-00001": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 0\n }\n },\n {\n "volume_52be2cf8-1f6a-47e1-910d-17cdde3abb60/20260703094549/az_nova_backup_ec711725-25f0-4982-afe6-3b48b0e50917-00002": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 52428800\n }\n },\n {\n "volume_52be2cf8-1f6a-47e1-910d-17cdde3abb60/20260703094549/az_nova_backup_ec711725-25f0-4982-afe6-3b48b0e50917-00003": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 104857600\n }\n },\n {\n "volume_52be2cf8-1f6a-47e1-910d-17cdde3abb60/20260703094549/az_nova_backup_ec711725-25f0-4982-afe6-3b48b0e50917-00004": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 157286400\n }\n },\n {\n "volume_52be2cf8-1f6a-47e1-910d-17cdde3abb60/20260703094549/az_nova_backup_ec711725-25f0-4982-afe6-3b48b0e50917-00005": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 209715200\n }\n },\n {\n "volume_52be2cf8-1f6a-47e1-910d-17cdde3abb60/20260703094549/az_nova_backup_ec711725-25f0-4982-afe6-3b48b0e50917-00006": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 262144000\n }\n },\n {\n "volume_52be2cf8-1f6a-47e1-910d-17cdde3abb60/20260703094549/az_nova_backup_ec711725-25f0-4982-afe6-3b48b0e50917-00007": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 314572800\n }\n },\n {\n "volume_52be2cf8-1f6a-47e1-910d-17cdde3abb60/20260703094549/az_nova_backup_ec711725-25f0-4982-afe6-3b48b0e50917-00008": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 367001600\n }\n },\n {\n "volume_52be2cf8-1f6a-47e1-910d-17cdde3abb60/20260703094549/az_nova_backup_ec711725-25f0-4982-afe6-3b48b0e50917-00009": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 419430400\n }\n },\n {\n "volume_52be2cf8-1f6a-47e1-910d-17cdde3abb60/20260703094549/az_nova_backup_ec711725-25f0-4982-afe6-3b48b0e50917-00010": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 471859200\n }\n },\n {\n "volume_52be2cf8-1f6a-47e1-910d-17cdde3abb60/20260703094549/az_nova_backup_ec711725-25f0-4982-afe6-3b48b0e50917-00011": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 524288000\n }\n },\n {\n "volume_52be2cf8-1f6a-47e1-910d-17cdde3abb60/20260703094549/az_nova_backup_ec711725-25f0-4982-afe6-3b48b0e50917-00012": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 576716800\n }\n },\n {\n "volume_52be2cf8-1f6a-47e1-910d-17cdde3abb60/20260703094549/az_nova_backup_ec711725-25f0-4982-afe6-3b48b0e50917-00013": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 629145600\n }\n },\n {\n "volume_52be2cf8-1f6a-47e1-910d-17cdde3abb60/20260703094549/az_nova_backup_ec711725-25f0-4982-afe6-3b48b0e50917-00014": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 681574400\n }\n },\n {\n "volume_52be2cf8-1f6a-47e1-910d-17cdde3abb60/20260703094549/az_nova_backup_ec711725-25f0-4982-afe6-3b48b0e50917-00015": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 734003200\n }\n },\n {\n "volume_52be2cf8-1f6a-47e1-910d-17cdde3abb60/20260703094549/az_nova_backup_ec711725-25f0-4982-afe6-3b48b0e50917-00016": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 786432000\n }\n },\n {\n "volume_52be2cf8-1f6a-47e1-910d-17cdde3abb60/20260703094549/az_nova_backup_ec711725-25f0-4982-afe6-3b48b0e50917-00017": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 838860800\n }\n },\n {\n "volume_52be2cf8-1f6a-47e1-910d-17cdde3abb60/20260703094549/az_nova_backup_ec711725-25f0-4982-afe6-3b48b0e50917-00018": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 891289600\n }\n },\n {\n "volume_52be2cf8-1f6a-47e1-910d-17cdde3abb60/20260703094549/az_nova_backup_ec711725-25f0-4982-afe6-3b48b0e50917-00019": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 943718400\n }\n },\n {\n "volume_52be2cf8-1f6a-47e1-910d-17cdde3abb60/20260703094549/az_nova_backup_ec711725-25f0-4982-afe6-3b48b0e50917-00020": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 996147200\n }\n },\n {\n "volume_52be2cf8-1f6a-47e1-910d-17cdde3abb60/20260703094549/az_nova_backup_ec711725-25f0-4982-afe6-3b48b0e50917-00021": {\n "compression": "zlib",\n "length": 25165824,\n "md5": "77377273b0a4b61febdbf7bbf52b9db9",\n "offset": 1048576000\n }\n }\n ],\n "parent_id": null,\n "version": "1.0.0",\n "volume_id": "52be2cf8-1f6a-47e1-910d-17cdde3abb60",\n "volume_meta": "{\\"version\\": 2, \\"volume-base-metadata\\": {\\"id\\": \\"52be2cf8-1f6a-47e1-910d-17cdde3abb60\\", \\"_name_id\\": null, \\"use_quota\\": true, \\"ec2_id\\": null, \\"user_id\\": \\"23ba560f6eed465495956e82c26b6f69\\", \\"project_id\\": \\"a2309d0555a742279b4a5017d94ebf02\\", \\"snapshot_id\\": null, \\"cluster_name\\": null, \\"host\\": \\"np0000004400@storpool#template_virtual\\", \\"size\\": 1, \\"availability_zone\\": \\"nova\\", \\"status\\": \\"backing-up\\", \\"attach_status\\": \\"detached\\", \\"migration_status\\": null, \\"scheduled_at\\": \\"2026-07-03T09:45:45.000000\\", \\"launched_at\\": \\"2026-07-03T09:45:45.000000\\", \\"terminated_at\\": null, \\"display_name\\": \\"tempest-VolumeV3RbacBaseTests-Volume-471751000\\", \\"display_description\\": null, \\"provider_location\\": null, \\"provider_auth\\": null, \\"provider_geometry\\": null, \\"provider_id\\": null, \\"volume_type_id\\": \\"03e13fe6-0e30-4803-ace0-725d38e6dc24\\", \\"source_volid\\": null, \\"encryption_key_id\\": null, \\"consistencygroup_id\\": null, \\"group_id\\": null, \\"bootable\\": false, \\"multiattach\\": false, \\"replication_status\\": null, \\"replication_extended_status\\": null, \\"replication_driver_data\\": null, \\"previous_status\\": \\"available\\", \\"service_uuid\\": \\"6d4b0e79-fefe-4744-b25f-34be05095200\\", \\"shared_targets\\": true, \\"deleted_at\\": null, \\"deleted\\": false, \\"created_at\\": \\"2026-07-03T09:45:44.000000\\", \\"updated_at\\": \\"2026-07-03T09:45:46.000000\\"}}"\n}'. {{(pid=101319) _write_metadata /opt/stack/cinder/cinder/backup/chunkeddriver.py:295}} Jul 03 09:46:03.476551 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-9a399181-d884-4e46-a928-590766ad92c9 tempest-ProjectAdminTests33-1900627284 None] backup ec711725-25f0-4982-afe6-3b48b0e50917 finished. {{(pid=101319) _finalize_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:462}} Jul 03 09:46:03.608267 np0000004400 cinder-backup[101319]: DEBUG oslo_concurrency.processutils [None req-9a399181-d884-4e46-a928-590766ad92c9 tempest-ProjectAdminTests33-1900627284 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chown 0 /dev/sdc {{(pid=101319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 09:46:03.629221 np0000004400 sudo[138004]: stack : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chown 0 /dev/sdc Jul 03 09:46:03.629903 np0000004400 sudo[138004]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1002) Jul 03 09:46:03.748112 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-888e3f93-d9e9-47ce-a144-629fa57e40f8 tempest-VolumesBackupsTest-2142009639 None] restoring object. backup: e353b2b2-ecff-4fe0-8148-bf9d1d84a8bf, container: tempest-volumesbackupstest-backup-container-1320776190, object name: volume_b1fc0d58-7747-4bcf-99a7-fb482aacb945/20260703094530/az_nova_backup_e353b2b2-ecff-4fe0-8148-bf9d1d84a8bf-00021, volume: 2a67969a-282a-431e-9fb2-763d3c62eab0. {{(pid=101319) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:705}} Jul 03 09:46:03.764524 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-888e3f93-d9e9-47ce-a144-629fa57e40f8 tempest-VolumesBackupsTest-2142009639 None] decompressing data using zlib algorithm {{(pid=101319) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:722}} Jul 03 09:46:03.827024 np0000004400 cinder-backup[101319]: INFO cinder.backup.manager [None req-6ef928da-3670-4523-823a-3443e2d91692 tempest-VolumesBackupsTest-118275719 None] Create backup finished. backup: 8b377d15-3804-4a9c-ad2d-e8e1359c0ee5. Jul 03 09:46:03.923065 np0000004400 sudo[138004]: pam_unix(sudo:session): session closed for user root Jul 03 09:46:03.928656 np0000004400 cinder-backup[101319]: DEBUG oslo_concurrency.processutils [None req-9a399181-d884-4e46-a928-590766ad92c9 tempest-ProjectAdminTests33-1900627284 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chown 0 /dev/sdc" returned: 0 in 0.320s {{(pid=101319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 09:46:03.929134 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-9a399181-d884-4e46-a928-590766ad92c9 tempest-ProjectAdminTests33-1900627284 None] ==> disconnect_volume: call "{'args': (, {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-52be2cf8-1f6a-47e1-910d-17cdde3abb60', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '52be2cf8-1f6a-47e1-910d-17cdde3abb60', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': False}, {'type': 'block', 'scsi_wwn': '330000000eefb6614', 'path': '/dev/sdc'}), 'kwargs': {'force': True, 'ignore_errors': True}}" {{(pid=101319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}} Jul 03 09:46:03.929339 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.base [None req-9a399181-d884-4e46-a928-590766ad92c9 tempest-ProjectAdminTests33-1900627284 None] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=101319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jul 03 09:46:03.929992 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.base [None req-9a399181-d884-4e46-a928-590766ad92c9 tempest-ProjectAdminTests33-1900627284 None] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=101319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jul 03 09:46:03.930364 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-9a399181-d884-4e46-a928-590766ad92c9 tempest-ProjectAdminTests33-1900627284 None] _get_connection_devices called with parameters: connection_properties={'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-52be2cf8-1f6a-47e1-910d-17cdde3abb60', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '52be2cf8-1f6a-47e1-910d-17cdde3abb60', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': False}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=101319) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:847}} Jul 03 09:46:03.931568 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-888e3f93-d9e9-47ce-a144-629fa57e40f8 tempest-VolumesBackupsTest-2142009639 None] v1 volume backup restore of e353b2b2-ecff-4fe0-8148-bf9d1d84a8bf finished. {{(pid=101319) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:750}} Jul 03 09:46:03.931811 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.driver [None req-888e3f93-d9e9-47ce-a144-629fa57e40f8 tempest-VolumesBackupsTest-2142009639 None] Restoring volume base metadata {{(pid=101319) _restore_vol_base_meta /opt/stack/cinder/cinder/backup/driver.py:177}} Jul 03 09:46:03.943509 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-9a399181-d884-4e46-a928-590766ad92c9 tempest-ProjectAdminTests33-1900627284 None] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS: Jul 03 09:46:03.943509 np0000004400 cinder-backup[101319]: No targets found. Jul 03 09:46:03.943509 np0000004400 cinder-backup[101319]: iSNS: Jul 03 09:46:03.943509 np0000004400 cinder-backup[101319]: No targets found. Jul 03 09:46:03.943509 np0000004400 cinder-backup[101319]: STATIC: Jul 03 09:46:03.943509 np0000004400 cinder-backup[101319]: Target: iqn.2023-03.storpool.com:os--volume-2a67969a-282a-431e-9fb2-763d3c62eab0 Jul 03 09:46:03.943509 np0000004400 cinder-backup[101319]: Portal: 192.168.40.100:3260,-1 Jul 03 09:46:03.943509 np0000004400 cinder-backup[101319]: Iface Name: default Jul 03 09:46:03.943509 np0000004400 cinder-backup[101319]: Target: iqn.2023-03.storpool.com:os--volume-52be2cf8-1f6a-47e1-910d-17cdde3abb60 Jul 03 09:46:03.943509 np0000004400 cinder-backup[101319]: Portal: 192.168.40.100:3260,-1 Jul 03 09:46:03.943509 np0000004400 cinder-backup[101319]: Iface Name: default Jul 03 09:46:03.943509 np0000004400 cinder-backup[101319]: Target: iqn.2023-03.storpool.com:os--volume-76320525-737e-4f58-8523-63ec9abbdc64 Jul 03 09:46:03.943509 np0000004400 cinder-backup[101319]: Portal: 192.168.50.100:3260,-1 Jul 03 09:46:03.943509 np0000004400 cinder-backup[101319]: Iface Name: default Jul 03 09:46:03.943509 np0000004400 cinder-backup[101319]: Portal: 192.168.40.100:3260,-1 Jul 03 09:46:03.943509 np0000004400 cinder-backup[101319]: Iface Name: default Jul 03 09:46:03.943509 np0000004400 cinder-backup[101319]: Target: iqn.2023-03.storpool.com:os--volume-d47f5d2f-dce5-42f7-a693-a654fd702622 Jul 03 09:46:03.943509 np0000004400 cinder-backup[101319]: Portal: 192.168.50.100:3260,-1 Jul 03 09:46:03.943509 np0000004400 cinder-backup[101319]: Iface Name: default Jul 03 09:46:03.943509 np0000004400 cinder-backup[101319]: Portal: 192.168.40.100:3260,-1 Jul 03 09:46:03.943509 np0000004400 cinder-backup[101319]: Iface Name: default Jul 03 09:46:03.943509 np0000004400 cinder-backup[101319]: Target: iqn.2023-03.storpool.com:os--volume-6713aeef-c919-4102-a884-a71545173837 Jul 03 09:46:03.943509 np0000004400 cinder-backup[101319]: Portal: 192.168.50.100:3260,-1 Jul 03 09:46:03.943509 np0000004400 cinder-backup[101319]: Iface Name: default Jul 03 09:46:03.943509 np0000004400 cinder-backup[101319]: Portal: 192.168.40.100:3260,-1 Jul 03 09:46:03.943509 np0000004400 cinder-backup[101319]: Iface Name: default Jul 03 09:46:03.943509 np0000004400 cinder-backup[101319]: FIRMWARE: Jul 03 09:46:03.943509 np0000004400 cinder-backup[101319]: No targets found. Jul 03 09:46:03.943509 np0000004400 cinder-backup[101319]: stderr= {{(pid=101319) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jul 03 09:46:03.944345 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-9a399181-d884-4e46-a928-590766ad92c9 tempest-ProjectAdminTests33-1900627284 None] Regex to get portals from discoverydb: ^SENDTARGETS: Jul 03 09:46:03.944345 np0000004400 cinder-backup[101319]: .*?^DiscoveryAddress: 192.168.40.100,3260.*? Jul 03 09:46:03.944345 np0000004400 cinder-backup[101319]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=101319) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:390}} Jul 03 09:46:03.944345 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-9a399181-d884-4e46-a928-590766ad92c9 tempest-ProjectAdminTests33-1900627284 None] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-52be2cf8-1f6a-47e1-910d-17cdde3abb60', 0)] {{(pid=101319) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:858}} Jul 03 09:46:03.944823 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.driver [None req-888e3f93-d9e9-47ce-a144-629fa57e40f8 tempest-VolumesBackupsTest-2142009639 None] Restoring volume metadata {{(pid=101319) _restore_vol_meta /opt/stack/cinder/cinder/backup/driver.py:249}} Jul 03 09:46:03.955464 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.driver [None req-888e3f93-d9e9-47ce-a144-629fa57e40f8 tempest-VolumesBackupsTest-2142009639 None] No metadata of type 'volume-glance-metadata' to restore {{(pid=101319) put /opt/stack/cinder/cinder/backup/driver.py:345}} Jul 03 09:46:03.955884 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-888e3f93-d9e9-47ce-a144-629fa57e40f8 tempest-VolumesBackupsTest-2142009639 None] restore e353b2b2-ecff-4fe0-8148-bf9d1d84a8bf to 2a67969a-282a-431e-9fb2-763d3c62eab0 finished. {{(pid=101319) restore /opt/stack/cinder/cinder/backup/chunkeddriver.py:815}} Jul 03 09:46:03.955968 np0000004400 cinder-backup[101319]: DEBUG oslo_concurrency.processutils [None req-888e3f93-d9e9-47ce-a144-629fa57e40f8 tempest-VolumesBackupsTest-2142009639 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chown 0 /dev/sdd {{(pid=101319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 09:46:03.977024 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-9a399181-d884-4e46-a928-590766ad92c9 tempest-ProjectAdminTests33-1900627284 None] iscsiadm ('-m', 'session'): stdout=tcp: [108] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-52be2cf8-1f6a-47e1-910d-17cdde3abb60 (non-flash) Jul 03 09:46:03.977024 np0000004400 cinder-backup[101319]: tcp: [109] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2a67969a-282a-431e-9fb2-763d3c62eab0 (non-flash) Jul 03 09:46:03.977024 np0000004400 cinder-backup[101319]: tcp: [110] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6713aeef-c919-4102-a884-a71545173837 (non-flash) Jul 03 09:46:03.977024 np0000004400 cinder-backup[101319]: tcp: [111] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-6713aeef-c919-4102-a884-a71545173837 (non-flash) Jul 03 09:46:03.977024 np0000004400 cinder-backup[101319]: tcp: [82] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-76320525-737e-4f58-8523-63ec9abbdc64 (non-flash) Jul 03 09:46:03.977024 np0000004400 cinder-backup[101319]: tcp: [83] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-76320525-737e-4f58-8523-63ec9abbdc64 (non-flash) Jul 03 09:46:03.977024 np0000004400 cinder-backup[101319]: tcp: [97] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d47f5d2f-dce5-42f7-a693-a654fd702622 (non-flash) Jul 03 09:46:03.977024 np0000004400 cinder-backup[101319]: tcp: [98] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d47f5d2f-dce5-42f7-a693-a654fd702622 (non-flash) Jul 03 09:46:03.977024 np0000004400 cinder-backup[101319]: stderr= {{(pid=101319) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jul 03 09:46:03.977482 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-9a399181-d884-4e46-a928-590766ad92c9 tempest-ProjectAdminTests33-1900627284 None] iscsi session list stdout=tcp: [108] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-52be2cf8-1f6a-47e1-910d-17cdde3abb60 (non-flash) Jul 03 09:46:03.977482 np0000004400 cinder-backup[101319]: tcp: [109] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2a67969a-282a-431e-9fb2-763d3c62eab0 (non-flash) Jul 03 09:46:03.977482 np0000004400 cinder-backup[101319]: tcp: [110] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6713aeef-c919-4102-a884-a71545173837 (non-flash) Jul 03 09:46:03.977482 np0000004400 cinder-backup[101319]: tcp: [111] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-6713aeef-c919-4102-a884-a71545173837 (non-flash) Jul 03 09:46:03.977482 np0000004400 cinder-backup[101319]: tcp: [82] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-76320525-737e-4f58-8523-63ec9abbdc64 (non-flash) Jul 03 09:46:03.977482 np0000004400 cinder-backup[101319]: tcp: [83] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-76320525-737e-4f58-8523-63ec9abbdc64 (non-flash) Jul 03 09:46:03.977482 np0000004400 cinder-backup[101319]: tcp: [97] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d47f5d2f-dce5-42f7-a693-a654fd702622 (non-flash) Jul 03 09:46:03.977482 np0000004400 cinder-backup[101319]: tcp: [98] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d47f5d2f-dce5-42f7-a693-a654fd702622 (non-flash) Jul 03 09:46:03.977482 np0000004400 cinder-backup[101319]: stderr= {{(pid=101319) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jul 03 09:46:03.977108 np0000004400 sudo[138013]: stack : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chown 0 /dev/sdd Jul 03 09:46:03.978095 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-9a399181-d884-4e46-a928-590766ad92c9 tempest-ProjectAdminTests33-1900627284 None] Sessions list: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-52be2cf8-1f6a-47e1-910d-17cdde3abb60', '108'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-2a67969a-282a-431e-9fb2-763d3c62eab0', '109'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-6713aeef-c919-4102-a884-a71545173837', '110'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-6713aeef-c919-4102-a884-a71545173837', '111'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-76320525-737e-4f58-8523-63ec9abbdc64', '82'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-76320525-737e-4f58-8523-63ec9abbdc64', '83'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-d47f5d2f-dce5-42f7-a693-a654fd702622', '97'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-d47f5d2f-dce5-42f7-a693-a654fd702622', '98')] {{(pid=101319) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:866}} Jul 03 09:46:03.978095 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-9a399181-d884-4e46-a928-590766ad92c9 tempest-ProjectAdminTests33-1900627284 None] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-52be2cf8-1f6a-47e1-910d-17cdde3abb60, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-52be2cf8-1f6a-47e1-910d-17cdde3abb60', '108')] {{(pid=101319) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}} Jul 03 09:46:03.978692 np0000004400 sudo[138013]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1002) Jul 03 09:46:03.979212 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-9a399181-d884-4e46-a928-590766ad92c9 tempest-ProjectAdminTests33-1900627284 None] Resulting device map defaultdict(. at 0x7e76e71f3e20>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-52be2cf8-1f6a-47e1-910d-17cdde3abb60'): ({'sdc'}, set())}) {{(pid=101319) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:912}} Jul 03 09:46:03.979301 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.linuxscsi [None req-9a399181-d884-4e46-a928-590766ad92c9 tempest-ProjectAdminTests33-1900627284 None] Removing single pathed devices sdc {{(pid=101319) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}} Jul 03 09:46:03.990840 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.linuxscsi [None req-9a399181-d884-4e46-a928-590766ad92c9 tempest-ProjectAdminTests33-1900627284 None] Flushing IO for device /dev/sdc {{(pid=101319) flush_device_io /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:461}} Jul 03 09:46:03.999722 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.linuxscsi [None req-9a399181-d884-4e46-a928-590766ad92c9 tempest-ProjectAdminTests33-1900627284 None] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=101319) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}} Jul 03 09:46:04.053990 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.linuxscsi [None req-9a399181-d884-4e46-a928-590766ad92c9 tempest-ProjectAdminTests33-1900627284 None] Checking to see if SCSI volumes sdc have been removed. {{(pid=101319) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}} Jul 03 09:46:04.053990 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.linuxscsi [None req-9a399181-d884-4e46-a928-590766ad92c9 tempest-ProjectAdminTests33-1900627284 None] SCSI volumes sdc have been removed. {{(pid=101319) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}} Jul 03 09:46:04.055161 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.linuxscsi [None req-9a399181-d884-4e46-a928-590766ad92c9 tempest-ProjectAdminTests33-1900627284 None] Checking to see if device paths {'sdc'} are still under multipathd monitoring {{(pid=101319) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}} Jul 03 09:46:04.065300 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.linuxscsi [None req-9a399181-d884-4e46-a928-590766ad92c9 tempest-ProjectAdminTests33-1900627284 None] Device paths {'sdc'} have been removed from multipathd monitoring. {{(pid=101319) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}} Jul 03 09:46:04.065300 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-9a399181-d884-4e46-a928-590766ad92c9 tempest-ProjectAdminTests33-1900627284 None] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-52be2cf8-1f6a-47e1-910d-17cdde3abb60')] {{(pid=101319) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1225}} Jul 03 09:46:04.077053 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-9a399181-d884-4e46-a928-590766ad92c9 tempest-ProjectAdminTests33-1900627284 None] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=101319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 03 09:46:04.127798 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-9a399181-d884-4e46-a928-590766ad92c9 tempest-ProjectAdminTests33-1900627284 None] iscsiadm ('--logout',): stdout=Logging out of session [sid: 108, target: iqn.2023-03.storpool.com:os--volume-52be2cf8-1f6a-47e1-910d-17cdde3abb60, portal: 192.168.40.100,3260] Jul 03 09:46:04.127798 np0000004400 cinder-backup[101319]: Logout of [sid: 108, target: iqn.2023-03.storpool.com:os--volume-52be2cf8-1f6a-47e1-910d-17cdde3abb60, portal: 192.168.40.100,3260] successful. Jul 03 09:46:04.127798 np0000004400 cinder-backup[101319]: stderr= {{(pid=101319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 03 09:46:04.146776 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-9a399181-d884-4e46-a928-590766ad92c9 tempest-ProjectAdminTests33-1900627284 None] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=101319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 03 09:46:04.147150 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.base [None req-9a399181-d884-4e46-a928-590766ad92c9 tempest-ProjectAdminTests33-1900627284 None] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.217s {{(pid=101319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jul 03 09:46:04.147576 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-9a399181-d884-4e46-a928-590766ad92c9 tempest-ProjectAdminTests33-1900627284 None] <== disconnect_volume: return (217ms) None {{(pid=101319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}} Jul 03 09:46:04.324911 np0000004400 sudo[138013]: pam_unix(sudo:session): session closed for user root Jul 03 09:46:04.327765 np0000004400 cinder-backup[101319]: DEBUG oslo_concurrency.processutils [None req-888e3f93-d9e9-47ce-a144-629fa57e40f8 tempest-VolumesBackupsTest-2142009639 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chown 0 /dev/sdd" returned: 0 in 0.371s {{(pid=101319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 09:46:04.327765 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-888e3f93-d9e9-47ce-a144-629fa57e40f8 tempest-VolumesBackupsTest-2142009639 None] ==> disconnect_volume: call "{'args': (, {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-2a67969a-282a-431e-9fb2-763d3c62eab0', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '2a67969a-282a-431e-9fb2-763d3c62eab0', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': False}, {'type': 'block', 'scsi_wwn': '3300000000921b172', 'path': '/dev/sdd'}), 'kwargs': {'force': True, 'ignore_errors': False}}" {{(pid=101319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}} Jul 03 09:46:04.327765 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.base [None req-888e3f93-d9e9-47ce-a144-629fa57e40f8 tempest-VolumesBackupsTest-2142009639 None] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=101319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jul 03 09:46:04.327765 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.base [None req-888e3f93-d9e9-47ce-a144-629fa57e40f8 tempest-VolumesBackupsTest-2142009639 None] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.000s {{(pid=101319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jul 03 09:46:04.328437 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-888e3f93-d9e9-47ce-a144-629fa57e40f8 tempest-VolumesBackupsTest-2142009639 None] _get_connection_devices called with parameters: connection_properties={'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-2a67969a-282a-431e-9fb2-763d3c62eab0', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '2a67969a-282a-431e-9fb2-763d3c62eab0', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': False}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=101319) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:847}} Jul 03 09:46:04.340325 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-888e3f93-d9e9-47ce-a144-629fa57e40f8 tempest-VolumesBackupsTest-2142009639 None] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS: Jul 03 09:46:04.340325 np0000004400 cinder-backup[101319]: No targets found. Jul 03 09:46:04.340325 np0000004400 cinder-backup[101319]: iSNS: Jul 03 09:46:04.340325 np0000004400 cinder-backup[101319]: No targets found. Jul 03 09:46:04.340325 np0000004400 cinder-backup[101319]: STATIC: Jul 03 09:46:04.340325 np0000004400 cinder-backup[101319]: Target: iqn.2023-03.storpool.com:os--volume-2a67969a-282a-431e-9fb2-763d3c62eab0 Jul 03 09:46:04.340325 np0000004400 cinder-backup[101319]: Portal: 192.168.40.100:3260,-1 Jul 03 09:46:04.340325 np0000004400 cinder-backup[101319]: Iface Name: default Jul 03 09:46:04.340325 np0000004400 cinder-backup[101319]: Target: iqn.2023-03.storpool.com:os--volume-76320525-737e-4f58-8523-63ec9abbdc64 Jul 03 09:46:04.340325 np0000004400 cinder-backup[101319]: Portal: 192.168.50.100:3260,-1 Jul 03 09:46:04.340325 np0000004400 cinder-backup[101319]: Iface Name: default Jul 03 09:46:04.340325 np0000004400 cinder-backup[101319]: Portal: 192.168.40.100:3260,-1 Jul 03 09:46:04.340325 np0000004400 cinder-backup[101319]: Iface Name: default Jul 03 09:46:04.340325 np0000004400 cinder-backup[101319]: Target: iqn.2023-03.storpool.com:os--volume-d47f5d2f-dce5-42f7-a693-a654fd702622 Jul 03 09:46:04.340325 np0000004400 cinder-backup[101319]: Portal: 192.168.50.100:3260,-1 Jul 03 09:46:04.340325 np0000004400 cinder-backup[101319]: Iface Name: default Jul 03 09:46:04.340325 np0000004400 cinder-backup[101319]: Portal: 192.168.40.100:3260,-1 Jul 03 09:46:04.340325 np0000004400 cinder-backup[101319]: Iface Name: default Jul 03 09:46:04.340325 np0000004400 cinder-backup[101319]: Target: iqn.2023-03.storpool.com:os--volume-6713aeef-c919-4102-a884-a71545173837 Jul 03 09:46:04.340325 np0000004400 cinder-backup[101319]: Portal: 192.168.50.100:3260,-1 Jul 03 09:46:04.340325 np0000004400 cinder-backup[101319]: Iface Name: default Jul 03 09:46:04.340325 np0000004400 cinder-backup[101319]: Portal: 192.168.40.100:3260,-1 Jul 03 09:46:04.340325 np0000004400 cinder-backup[101319]: Iface Name: default Jul 03 09:46:04.340325 np0000004400 cinder-backup[101319]: FIRMWARE: Jul 03 09:46:04.340325 np0000004400 cinder-backup[101319]: No targets found. Jul 03 09:46:04.340325 np0000004400 cinder-backup[101319]: stderr= {{(pid=101319) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jul 03 09:46:04.341309 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-888e3f93-d9e9-47ce-a144-629fa57e40f8 tempest-VolumesBackupsTest-2142009639 None] Regex to get portals from discoverydb: ^SENDTARGETS: Jul 03 09:46:04.341309 np0000004400 cinder-backup[101319]: .*?^DiscoveryAddress: 192.168.40.100,3260.*? Jul 03 09:46:04.341309 np0000004400 cinder-backup[101319]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=101319) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:390}} Jul 03 09:46:04.341637 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-888e3f93-d9e9-47ce-a144-629fa57e40f8 tempest-VolumesBackupsTest-2142009639 None] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-2a67969a-282a-431e-9fb2-763d3c62eab0', 0)] {{(pid=101319) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:858}} Jul 03 09:46:04.369842 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-888e3f93-d9e9-47ce-a144-629fa57e40f8 tempest-VolumesBackupsTest-2142009639 None] iscsiadm ('-m', 'session'): stdout=tcp: [109] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2a67969a-282a-431e-9fb2-763d3c62eab0 (non-flash) Jul 03 09:46:04.369842 np0000004400 cinder-backup[101319]: tcp: [110] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6713aeef-c919-4102-a884-a71545173837 (non-flash) Jul 03 09:46:04.369842 np0000004400 cinder-backup[101319]: tcp: [111] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-6713aeef-c919-4102-a884-a71545173837 (non-flash) Jul 03 09:46:04.369842 np0000004400 cinder-backup[101319]: tcp: [82] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-76320525-737e-4f58-8523-63ec9abbdc64 (non-flash) Jul 03 09:46:04.369842 np0000004400 cinder-backup[101319]: tcp: [83] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-76320525-737e-4f58-8523-63ec9abbdc64 (non-flash) Jul 03 09:46:04.369842 np0000004400 cinder-backup[101319]: tcp: [97] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d47f5d2f-dce5-42f7-a693-a654fd702622 (non-flash) Jul 03 09:46:04.369842 np0000004400 cinder-backup[101319]: tcp: [98] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d47f5d2f-dce5-42f7-a693-a654fd702622 (non-flash) Jul 03 09:46:04.369842 np0000004400 cinder-backup[101319]: stderr= {{(pid=101319) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jul 03 09:46:04.370045 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-888e3f93-d9e9-47ce-a144-629fa57e40f8 tempest-VolumesBackupsTest-2142009639 None] iscsi session list stdout=tcp: [109] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2a67969a-282a-431e-9fb2-763d3c62eab0 (non-flash) Jul 03 09:46:04.370045 np0000004400 cinder-backup[101319]: tcp: [110] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6713aeef-c919-4102-a884-a71545173837 (non-flash) Jul 03 09:46:04.370045 np0000004400 cinder-backup[101319]: tcp: [111] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-6713aeef-c919-4102-a884-a71545173837 (non-flash) Jul 03 09:46:04.370045 np0000004400 cinder-backup[101319]: tcp: [82] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-76320525-737e-4f58-8523-63ec9abbdc64 (non-flash) Jul 03 09:46:04.370045 np0000004400 cinder-backup[101319]: tcp: [83] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-76320525-737e-4f58-8523-63ec9abbdc64 (non-flash) Jul 03 09:46:04.370045 np0000004400 cinder-backup[101319]: tcp: [97] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d47f5d2f-dce5-42f7-a693-a654fd702622 (non-flash) Jul 03 09:46:04.370045 np0000004400 cinder-backup[101319]: tcp: [98] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d47f5d2f-dce5-42f7-a693-a654fd702622 (non-flash) Jul 03 09:46:04.370045 np0000004400 cinder-backup[101319]: stderr= {{(pid=101319) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jul 03 09:46:04.370221 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-888e3f93-d9e9-47ce-a144-629fa57e40f8 tempest-VolumesBackupsTest-2142009639 None] Sessions list: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-2a67969a-282a-431e-9fb2-763d3c62eab0', '109'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-6713aeef-c919-4102-a884-a71545173837', '110'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-6713aeef-c919-4102-a884-a71545173837', '111'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-76320525-737e-4f58-8523-63ec9abbdc64', '82'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-76320525-737e-4f58-8523-63ec9abbdc64', '83'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-d47f5d2f-dce5-42f7-a693-a654fd702622', '97'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-d47f5d2f-dce5-42f7-a693-a654fd702622', '98')] {{(pid=101319) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:866}} Jul 03 09:46:04.370221 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-888e3f93-d9e9-47ce-a144-629fa57e40f8 tempest-VolumesBackupsTest-2142009639 None] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-2a67969a-282a-431e-9fb2-763d3c62eab0, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-2a67969a-282a-431e-9fb2-763d3c62eab0', '109')] {{(pid=101319) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}} Jul 03 09:46:04.371238 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-888e3f93-d9e9-47ce-a144-629fa57e40f8 tempest-VolumesBackupsTest-2142009639 None] Resulting device map defaultdict(. at 0x7e77059f59e0>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-2a67969a-282a-431e-9fb2-763d3c62eab0'): ({'sdd'}, set())}) {{(pid=101319) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:912}} Jul 03 09:46:04.371238 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.linuxscsi [None req-888e3f93-d9e9-47ce-a144-629fa57e40f8 tempest-VolumesBackupsTest-2142009639 None] Removing single pathed devices sdd {{(pid=101319) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}} Jul 03 09:46:04.381913 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.linuxscsi [None req-888e3f93-d9e9-47ce-a144-629fa57e40f8 tempest-VolumesBackupsTest-2142009639 None] Flushing IO for device /dev/sdd {{(pid=101319) flush_device_io /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:461}} Jul 03 09:46:04.390990 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.linuxscsi [None req-888e3f93-d9e9-47ce-a144-629fa57e40f8 tempest-VolumesBackupsTest-2142009639 None] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=101319) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}} Jul 03 09:46:04.442673 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.linuxscsi [None req-888e3f93-d9e9-47ce-a144-629fa57e40f8 tempest-VolumesBackupsTest-2142009639 None] Checking to see if SCSI volumes sdd have been removed. {{(pid=101319) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}} Jul 03 09:46:04.442819 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.linuxscsi [None req-888e3f93-d9e9-47ce-a144-629fa57e40f8 tempest-VolumesBackupsTest-2142009639 None] SCSI volumes sdd have been removed. {{(pid=101319) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}} Jul 03 09:46:04.443792 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.linuxscsi [None req-888e3f93-d9e9-47ce-a144-629fa57e40f8 tempest-VolumesBackupsTest-2142009639 None] Checking to see if device paths {'sdd'} are still under multipathd monitoring {{(pid=101319) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}} Jul 03 09:46:04.453497 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.linuxscsi [None req-888e3f93-d9e9-47ce-a144-629fa57e40f8 tempest-VolumesBackupsTest-2142009639 None] Device paths {'sdd'} have been removed from multipathd monitoring. {{(pid=101319) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}} Jul 03 09:46:04.453725 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-888e3f93-d9e9-47ce-a144-629fa57e40f8 tempest-VolumesBackupsTest-2142009639 None] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-2a67969a-282a-431e-9fb2-763d3c62eab0')] {{(pid=101319) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1225}} Jul 03 09:46:04.464296 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-888e3f93-d9e9-47ce-a144-629fa57e40f8 tempest-VolumesBackupsTest-2142009639 None] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=101319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 03 09:46:04.496881 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-888e3f93-d9e9-47ce-a144-629fa57e40f8 tempest-VolumesBackupsTest-2142009639 None] iscsiadm ('--logout',): stdout=Logging out of session [sid: 109, target: iqn.2023-03.storpool.com:os--volume-2a67969a-282a-431e-9fb2-763d3c62eab0, portal: 192.168.40.100,3260] Jul 03 09:46:04.496881 np0000004400 cinder-backup[101319]: Logout of [sid: 109, target: iqn.2023-03.storpool.com:os--volume-2a67969a-282a-431e-9fb2-763d3c62eab0, portal: 192.168.40.100,3260] successful. Jul 03 09:46:04.496881 np0000004400 cinder-backup[101319]: stderr= {{(pid=101319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 03 09:46:04.514694 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-888e3f93-d9e9-47ce-a144-629fa57e40f8 tempest-VolumesBackupsTest-2142009639 None] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=101319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 03 09:46:04.514694 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.base [None req-888e3f93-d9e9-47ce-a144-629fa57e40f8 tempest-VolumesBackupsTest-2142009639 None] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.186s {{(pid=101319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jul 03 09:46:04.514694 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-888e3f93-d9e9-47ce-a144-629fa57e40f8 tempest-VolumesBackupsTest-2142009639 None] <== disconnect_volume: return (186ms) None {{(pid=101319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}} Jul 03 09:46:05.172393 np0000004400 cinder-backup[101319]: INFO cinder.backup.manager [None req-9a399181-d884-4e46-a928-590766ad92c9 tempest-ProjectAdminTests33-1900627284 None] Create backup finished. backup: ec711725-25f0-4982-afe6-3b48b0e50917. Jul 03 09:46:05.422799 np0000004400 cinder-backup[101319]: INFO cinder.backup.manager [None req-8509588a-f09a-4654-8aea-668e17ae4ab9 tempest-ProjectAdminTests33-1900627284 None] Delete backup started, backup: ec711725-25f0-4982-afe6-3b48b0e50917. Jul 03 09:46:05.430725 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.drivers.swift [None req-8509588a-f09a-4654-8aea-668e17ae4ab9 tempest-ProjectAdminTests33-1900627284 None] Using swift URL https://10.4.3.95:8080/v1/AUTH_a2309d0555a742279b4a5017d94ebf02 {{(pid=101319) initialize /opt/stack/cinder/cinder/backup/drivers/swift.py:300}} Jul 03 09:46:05.431179 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.drivers.swift [None req-8509588a-f09a-4654-8aea-668e17ae4ab9 tempest-ProjectAdminTests33-1900627284 None] Connect to https://10.4.3.95:8080/v1/AUTH_ in "per_user" mode {{(pid=101319) initialize /opt/stack/cinder/cinder/backup/drivers/swift.py:301}} Jul 03 09:46:05.431449 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-8509588a-f09a-4654-8aea-668e17ae4ab9 tempest-ProjectAdminTests33-1900627284 None] delete started, backup: ec711725-25f0-4982-afe6-3b48b0e50917, container: volumebackups, prefix: volume_52be2cf8-1f6a-47e1-910d-17cdde3abb60/20260703094549/az_nova_backup_ec711725-25f0-4982-afe6-3b48b0e50917. {{(pid=101319) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:822}} Jul 03 09:46:05.552576 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-8509588a-f09a-4654-8aea-668e17ae4ab9 tempest-ProjectAdminTests33-1900627284 None] generated object list: ['volume_52be2cf8-1f6a-47e1-910d-17cdde3abb60/20260703094549/az_nova_backup_ec711725-25f0-4982-afe6-3b48b0e50917-00001', 'volume_52be2cf8-1f6a-47e1-910d-17cdde3abb60/20260703094549/az_nova_backup_ec711725-25f0-4982-afe6-3b48b0e50917-00002', 'volume_52be2cf8-1f6a-47e1-910d-17cdde3abb60/20260703094549/az_nova_backup_ec711725-25f0-4982-afe6-3b48b0e50917-00003', 'volume_52be2cf8-1f6a-47e1-910d-17cdde3abb60/20260703094549/az_nova_backup_ec711725-25f0-4982-afe6-3b48b0e50917-00004', 'volume_52be2cf8-1f6a-47e1-910d-17cdde3abb60/20260703094549/az_nova_backup_ec711725-25f0-4982-afe6-3b48b0e50917-00005', 'volume_52be2cf8-1f6a-47e1-910d-17cdde3abb60/20260703094549/az_nova_backup_ec711725-25f0-4982-afe6-3b48b0e50917-00006', 'volume_52be2cf8-1f6a-47e1-910d-17cdde3abb60/20260703094549/az_nova_backup_ec711725-25f0-4982-afe6-3b48b0e50917-00007', 'volume_52be2cf8-1f6a-47e1-910d-17cdde3abb60/20260703094549/az_nova_backup_ec711725-25f0-4982-afe6-3b48b0e50917-00008', 'volume_52be2cf8-1f6a-47e1-910d-17cdde3abb60/20260703094549/az_nova_backup_ec711725-25f0-4982-afe6-3b48b0e50917-00009', 'volume_52be2cf8-1f6a-47e1-910d-17cdde3abb60/20260703094549/az_nova_backup_ec711725-25f0-4982-afe6-3b48b0e50917-00010', 'volume_52be2cf8-1f6a-47e1-910d-17cdde3abb60/20260703094549/az_nova_backup_ec711725-25f0-4982-afe6-3b48b0e50917-00011', 'volume_52be2cf8-1f6a-47e1-910d-17cdde3abb60/20260703094549/az_nova_backup_ec711725-25f0-4982-afe6-3b48b0e50917-00012', 'volume_52be2cf8-1f6a-47e1-910d-17cdde3abb60/20260703094549/az_nova_backup_ec711725-25f0-4982-afe6-3b48b0e50917-00013', 'volume_52be2cf8-1f6a-47e1-910d-17cdde3abb60/20260703094549/az_nova_backup_ec711725-25f0-4982-afe6-3b48b0e50917-00014', 'volume_52be2cf8-1f6a-47e1-910d-17cdde3abb60/20260703094549/az_nova_backup_ec711725-25f0-4982-afe6-3b48b0e50917-00015', 'volume_52be2cf8-1f6a-47e1-910d-17cdde3abb60/20260703094549/az_nova_backup_ec711725-25f0-4982-afe6-3b48b0e50917-00016', 'volume_52be2cf8-1f6a-47e1-910d-17cdde3abb60/20260703094549/az_nova_backup_ec711725-25f0-4982-afe6-3b48b0e50917-00017', 'volume_52be2cf8-1f6a-47e1-910d-17cdde3abb60/20260703094549/az_nova_backup_ec711725-25f0-4982-afe6-3b48b0e50917-00018', 'volume_52be2cf8-1f6a-47e1-910d-17cdde3abb60/20260703094549/az_nova_backup_ec711725-25f0-4982-afe6-3b48b0e50917-00019', 'volume_52be2cf8-1f6a-47e1-910d-17cdde3abb60/20260703094549/az_nova_backup_ec711725-25f0-4982-afe6-3b48b0e50917-00020', 'volume_52be2cf8-1f6a-47e1-910d-17cdde3abb60/20260703094549/az_nova_backup_ec711725-25f0-4982-afe6-3b48b0e50917-00021', 'volume_52be2cf8-1f6a-47e1-910d-17cdde3abb60/20260703094549/az_nova_backup_ec711725-25f0-4982-afe6-3b48b0e50917_metadata', 'volume_52be2cf8-1f6a-47e1-910d-17cdde3abb60/20260703094549/az_nova_backup_ec711725-25f0-4982-afe6-3b48b0e50917_sha256file']. {{(pid=101319) _generate_object_names /opt/stack/cinder/cinder/backup/chunkeddriver.py:260}} Jul 03 09:46:05.567801 np0000004400 cinder-backup[101319]: DEBUG oslo_db.sqlalchemy.engines [None req-888e3f93-d9e9-47ce-a144-629fa57e40f8 tempest-VolumesBackupsTest-2142009639 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=101319) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 03 09:46:05.579308 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.manager [None req-888e3f93-d9e9-47ce-a144-629fa57e40f8 tempest-VolumesBackupsTest-2142009639 None] Encryption key ID for volume 2a67969a-282a-431e-9fb2-763d3c62eab0 already matches encryption key ID in backup e353b2b2-ecff-4fe0-8148-bf9d1d84a8bf. {{(pid=101319) _run_restore /opt/stack/cinder/cinder/backup/manager.py:873}} Jul 03 09:46:05.591907 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-8509588a-f09a-4654-8aea-668e17ae4ab9 tempest-ProjectAdminTests33-1900627284 None] deleted object: volume_52be2cf8-1f6a-47e1-910d-17cdde3abb60/20260703094549/az_nova_backup_ec711725-25f0-4982-afe6-3b48b0e50917-00001 in container: volumebackups. {{(pid=101319) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 09:46:05.629889 np0000004400 cinder-backup[101319]: INFO cinder.backup.manager [None req-888e3f93-d9e9-47ce-a144-629fa57e40f8 tempest-VolumesBackupsTest-2142009639 None] Finished restoring backup e353b2b2-ecff-4fe0-8148-bf9d1d84a8bf to volume 2a67969a-282a-431e-9fb2-763d3c62eab0. Jul 03 09:46:05.631582 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-8509588a-f09a-4654-8aea-668e17ae4ab9 tempest-ProjectAdminTests33-1900627284 None] deleted object: volume_52be2cf8-1f6a-47e1-910d-17cdde3abb60/20260703094549/az_nova_backup_ec711725-25f0-4982-afe6-3b48b0e50917-00002 in container: volumebackups. {{(pid=101319) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 09:46:05.660509 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-8509588a-f09a-4654-8aea-668e17ae4ab9 tempest-ProjectAdminTests33-1900627284 None] deleted object: volume_52be2cf8-1f6a-47e1-910d-17cdde3abb60/20260703094549/az_nova_backup_ec711725-25f0-4982-afe6-3b48b0e50917-00003 in container: volumebackups. {{(pid=101319) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 09:46:05.693423 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-8509588a-f09a-4654-8aea-668e17ae4ab9 tempest-ProjectAdminTests33-1900627284 None] deleted object: volume_52be2cf8-1f6a-47e1-910d-17cdde3abb60/20260703094549/az_nova_backup_ec711725-25f0-4982-afe6-3b48b0e50917-00004 in container: volumebackups. {{(pid=101319) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 09:46:05.719235 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-8509588a-f09a-4654-8aea-668e17ae4ab9 tempest-ProjectAdminTests33-1900627284 None] deleted object: volume_52be2cf8-1f6a-47e1-910d-17cdde3abb60/20260703094549/az_nova_backup_ec711725-25f0-4982-afe6-3b48b0e50917-00005 in container: volumebackups. {{(pid=101319) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 09:46:05.751191 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-8509588a-f09a-4654-8aea-668e17ae4ab9 tempest-ProjectAdminTests33-1900627284 None] deleted object: volume_52be2cf8-1f6a-47e1-910d-17cdde3abb60/20260703094549/az_nova_backup_ec711725-25f0-4982-afe6-3b48b0e50917-00006 in container: volumebackups. {{(pid=101319) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 09:46:05.775627 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-8509588a-f09a-4654-8aea-668e17ae4ab9 tempest-ProjectAdminTests33-1900627284 None] deleted object: volume_52be2cf8-1f6a-47e1-910d-17cdde3abb60/20260703094549/az_nova_backup_ec711725-25f0-4982-afe6-3b48b0e50917-00007 in container: volumebackups. {{(pid=101319) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 09:46:05.813560 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-8509588a-f09a-4654-8aea-668e17ae4ab9 tempest-ProjectAdminTests33-1900627284 None] deleted object: volume_52be2cf8-1f6a-47e1-910d-17cdde3abb60/20260703094549/az_nova_backup_ec711725-25f0-4982-afe6-3b48b0e50917-00008 in container: volumebackups. {{(pid=101319) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 09:46:05.847853 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-8509588a-f09a-4654-8aea-668e17ae4ab9 tempest-ProjectAdminTests33-1900627284 None] deleted object: volume_52be2cf8-1f6a-47e1-910d-17cdde3abb60/20260703094549/az_nova_backup_ec711725-25f0-4982-afe6-3b48b0e50917-00009 in container: volumebackups. {{(pid=101319) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 09:46:05.895709 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-8509588a-f09a-4654-8aea-668e17ae4ab9 tempest-ProjectAdminTests33-1900627284 None] deleted object: volume_52be2cf8-1f6a-47e1-910d-17cdde3abb60/20260703094549/az_nova_backup_ec711725-25f0-4982-afe6-3b48b0e50917-00010 in container: volumebackups. {{(pid=101319) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 09:46:05.928239 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-8509588a-f09a-4654-8aea-668e17ae4ab9 tempest-ProjectAdminTests33-1900627284 None] deleted object: volume_52be2cf8-1f6a-47e1-910d-17cdde3abb60/20260703094549/az_nova_backup_ec711725-25f0-4982-afe6-3b48b0e50917-00011 in container: volumebackups. {{(pid=101319) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 09:46:05.949352 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-8509588a-f09a-4654-8aea-668e17ae4ab9 tempest-ProjectAdminTests33-1900627284 None] deleted object: volume_52be2cf8-1f6a-47e1-910d-17cdde3abb60/20260703094549/az_nova_backup_ec711725-25f0-4982-afe6-3b48b0e50917-00012 in container: volumebackups. {{(pid=101319) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 09:46:05.986227 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-8509588a-f09a-4654-8aea-668e17ae4ab9 tempest-ProjectAdminTests33-1900627284 None] deleted object: volume_52be2cf8-1f6a-47e1-910d-17cdde3abb60/20260703094549/az_nova_backup_ec711725-25f0-4982-afe6-3b48b0e50917-00013 in container: volumebackups. {{(pid=101319) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 09:46:06.017565 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-8509588a-f09a-4654-8aea-668e17ae4ab9 tempest-ProjectAdminTests33-1900627284 None] deleted object: volume_52be2cf8-1f6a-47e1-910d-17cdde3abb60/20260703094549/az_nova_backup_ec711725-25f0-4982-afe6-3b48b0e50917-00014 in container: volumebackups. {{(pid=101319) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 09:46:06.042570 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-8509588a-f09a-4654-8aea-668e17ae4ab9 tempest-ProjectAdminTests33-1900627284 None] deleted object: volume_52be2cf8-1f6a-47e1-910d-17cdde3abb60/20260703094549/az_nova_backup_ec711725-25f0-4982-afe6-3b48b0e50917-00015 in container: volumebackups. {{(pid=101319) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 09:46:06.067583 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-8509588a-f09a-4654-8aea-668e17ae4ab9 tempest-ProjectAdminTests33-1900627284 None] deleted object: volume_52be2cf8-1f6a-47e1-910d-17cdde3abb60/20260703094549/az_nova_backup_ec711725-25f0-4982-afe6-3b48b0e50917-00016 in container: volumebackups. {{(pid=101319) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 09:46:06.089940 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-8509588a-f09a-4654-8aea-668e17ae4ab9 tempest-ProjectAdminTests33-1900627284 None] deleted object: volume_52be2cf8-1f6a-47e1-910d-17cdde3abb60/20260703094549/az_nova_backup_ec711725-25f0-4982-afe6-3b48b0e50917-00017 in container: volumebackups. {{(pid=101319) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 09:46:06.116095 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-8509588a-f09a-4654-8aea-668e17ae4ab9 tempest-ProjectAdminTests33-1900627284 None] deleted object: volume_52be2cf8-1f6a-47e1-910d-17cdde3abb60/20260703094549/az_nova_backup_ec711725-25f0-4982-afe6-3b48b0e50917-00018 in container: volumebackups. {{(pid=101319) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 09:46:06.144858 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-8509588a-f09a-4654-8aea-668e17ae4ab9 tempest-ProjectAdminTests33-1900627284 None] deleted object: volume_52be2cf8-1f6a-47e1-910d-17cdde3abb60/20260703094549/az_nova_backup_ec711725-25f0-4982-afe6-3b48b0e50917-00019 in container: volumebackups. {{(pid=101319) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 09:46:06.168029 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-8509588a-f09a-4654-8aea-668e17ae4ab9 tempest-ProjectAdminTests33-1900627284 None] deleted object: volume_52be2cf8-1f6a-47e1-910d-17cdde3abb60/20260703094549/az_nova_backup_ec711725-25f0-4982-afe6-3b48b0e50917-00020 in container: volumebackups. {{(pid=101319) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 09:46:06.196161 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-8509588a-f09a-4654-8aea-668e17ae4ab9 tempest-ProjectAdminTests33-1900627284 None] deleted object: volume_52be2cf8-1f6a-47e1-910d-17cdde3abb60/20260703094549/az_nova_backup_ec711725-25f0-4982-afe6-3b48b0e50917-00021 in container: volumebackups. {{(pid=101319) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 09:46:06.223022 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-8509588a-f09a-4654-8aea-668e17ae4ab9 tempest-ProjectAdminTests33-1900627284 None] deleted object: volume_52be2cf8-1f6a-47e1-910d-17cdde3abb60/20260703094549/az_nova_backup_ec711725-25f0-4982-afe6-3b48b0e50917_metadata in container: volumebackups. {{(pid=101319) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 09:46:06.252573 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-8509588a-f09a-4654-8aea-668e17ae4ab9 tempest-ProjectAdminTests33-1900627284 None] deleted object: volume_52be2cf8-1f6a-47e1-910d-17cdde3abb60/20260703094549/az_nova_backup_ec711725-25f0-4982-afe6-3b48b0e50917_sha256file in container: volumebackups. {{(pid=101319) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 09:46:06.252804 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-8509588a-f09a-4654-8aea-668e17ae4ab9 tempest-ProjectAdminTests33-1900627284 None] delete ec711725-25f0-4982-afe6-3b48b0e50917 finished. {{(pid=101319) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:848}} Jul 03 09:46:06.267265 np0000004400 cinder-backup[101319]: DEBUG cinder.quota [None req-8509588a-f09a-4654-8aea-668e17ae4ab9 tempest-ProjectAdminTests33-1900627284 None] Created reservations ['6745eb07-1157-40a7-b10c-3c85cbae40dc', '10a5de45-7810-4446-8612-dace7c9eea4f'] {{(pid=101319) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 09:46:06.288148 np0000004400 cinder-backup[101319]: INFO cinder.backup.manager [None req-8509588a-f09a-4654-8aea-668e17ae4ab9 tempest-ProjectAdminTests33-1900627284 None] Delete backup finished, backup ec711725-25f0-4982-afe6-3b48b0e50917 deleted. Jul 03 09:46:06.570148 np0000004400 cinder-backup[101319]: INFO cinder.backup.manager [None req-4608fcca-cd31-45cb-8887-835af473e74d tempest-ProjectAdminTests33-1900627284 None] Export record started, backup: cfdc4925-e984-4da2-aa3e-e1e8a7c37558. Jul 03 09:46:06.573418 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.drivers.swift [None req-4608fcca-cd31-45cb-8887-835af473e74d tempest-ProjectAdminTests33-1900627284 None] Using swift URL https://10.4.3.95:8080/v1/AUTH_a2309d0555a742279b4a5017d94ebf02 {{(pid=101319) initialize /opt/stack/cinder/cinder/backup/drivers/swift.py:300}} Jul 03 09:46:06.573764 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.drivers.swift [None req-4608fcca-cd31-45cb-8887-835af473e74d tempest-ProjectAdminTests33-1900627284 None] Connect to https://10.4.3.95:8080/v1/AUTH_ in "per_user" mode {{(pid=101319) initialize /opt/stack/cinder/cinder/backup/drivers/swift.py:301}} Jul 03 09:46:06.574165 np0000004400 cinder-backup[101319]: INFO cinder.backup.manager [None req-4608fcca-cd31-45cb-8887-835af473e74d tempest-ProjectAdminTests33-1900627284 None] Export record finished, backup cfdc4925-e984-4da2-aa3e-e1e8a7c37558 exported. Jul 03 09:46:07.793546 np0000004400 cinder-backup[101319]: INFO cinder.backup.manager [None req-f7681f40-9f24-47c3-b5fb-86cb1dfa75ff tempest-VolumesBackupsTest-2142009639 None] Delete backup started, backup: e353b2b2-ecff-4fe0-8148-bf9d1d84a8bf. Jul 03 09:46:07.793546 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.drivers.swift [None req-f7681f40-9f24-47c3-b5fb-86cb1dfa75ff tempest-VolumesBackupsTest-2142009639 None] Using swift URL https://10.4.3.95:8080/v1/AUTH_59044e18a5b24b19a7b9b8a380f2e1a0 {{(pid=101319) initialize /opt/stack/cinder/cinder/backup/drivers/swift.py:300}} Jul 03 09:46:07.793546 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.drivers.swift [None req-f7681f40-9f24-47c3-b5fb-86cb1dfa75ff tempest-VolumesBackupsTest-2142009639 None] Connect to https://10.4.3.95:8080/v1/AUTH_ in "per_user" mode {{(pid=101319) initialize /opt/stack/cinder/cinder/backup/drivers/swift.py:301}} Jul 03 09:46:07.793546 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-f7681f40-9f24-47c3-b5fb-86cb1dfa75ff tempest-VolumesBackupsTest-2142009639 None] delete started, backup: e353b2b2-ecff-4fe0-8148-bf9d1d84a8bf, container: tempest-volumesbackupstest-backup-container-1320776190, prefix: volume_b1fc0d58-7747-4bcf-99a7-fb482aacb945/20260703094530/az_nova_backup_e353b2b2-ecff-4fe0-8148-bf9d1d84a8bf. {{(pid=101319) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:822}} Jul 03 09:46:07.834448 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-f7681f40-9f24-47c3-b5fb-86cb1dfa75ff tempest-VolumesBackupsTest-2142009639 None] generated object list: ['volume_b1fc0d58-7747-4bcf-99a7-fb482aacb945/20260703094530/az_nova_backup_e353b2b2-ecff-4fe0-8148-bf9d1d84a8bf-00001', 'volume_b1fc0d58-7747-4bcf-99a7-fb482aacb945/20260703094530/az_nova_backup_e353b2b2-ecff-4fe0-8148-bf9d1d84a8bf-00002', 'volume_b1fc0d58-7747-4bcf-99a7-fb482aacb945/20260703094530/az_nova_backup_e353b2b2-ecff-4fe0-8148-bf9d1d84a8bf-00003', 'volume_b1fc0d58-7747-4bcf-99a7-fb482aacb945/20260703094530/az_nova_backup_e353b2b2-ecff-4fe0-8148-bf9d1d84a8bf-00004', 'volume_b1fc0d58-7747-4bcf-99a7-fb482aacb945/20260703094530/az_nova_backup_e353b2b2-ecff-4fe0-8148-bf9d1d84a8bf-00005', 'volume_b1fc0d58-7747-4bcf-99a7-fb482aacb945/20260703094530/az_nova_backup_e353b2b2-ecff-4fe0-8148-bf9d1d84a8bf-00006', 'volume_b1fc0d58-7747-4bcf-99a7-fb482aacb945/20260703094530/az_nova_backup_e353b2b2-ecff-4fe0-8148-bf9d1d84a8bf-00007', 'volume_b1fc0d58-7747-4bcf-99a7-fb482aacb945/20260703094530/az_nova_backup_e353b2b2-ecff-4fe0-8148-bf9d1d84a8bf-00008', 'volume_b1fc0d58-7747-4bcf-99a7-fb482aacb945/20260703094530/az_nova_backup_e353b2b2-ecff-4fe0-8148-bf9d1d84a8bf-00009', 'volume_b1fc0d58-7747-4bcf-99a7-fb482aacb945/20260703094530/az_nova_backup_e353b2b2-ecff-4fe0-8148-bf9d1d84a8bf-00010', 'volume_b1fc0d58-7747-4bcf-99a7-fb482aacb945/20260703094530/az_nova_backup_e353b2b2-ecff-4fe0-8148-bf9d1d84a8bf-00011', 'volume_b1fc0d58-7747-4bcf-99a7-fb482aacb945/20260703094530/az_nova_backup_e353b2b2-ecff-4fe0-8148-bf9d1d84a8bf-00012', 'volume_b1fc0d58-7747-4bcf-99a7-fb482aacb945/20260703094530/az_nova_backup_e353b2b2-ecff-4fe0-8148-bf9d1d84a8bf-00013', 'volume_b1fc0d58-7747-4bcf-99a7-fb482aacb945/20260703094530/az_nova_backup_e353b2b2-ecff-4fe0-8148-bf9d1d84a8bf-00014', 'volume_b1fc0d58-7747-4bcf-99a7-fb482aacb945/20260703094530/az_nova_backup_e353b2b2-ecff-4fe0-8148-bf9d1d84a8bf-00015', 'volume_b1fc0d58-7747-4bcf-99a7-fb482aacb945/20260703094530/az_nova_backup_e353b2b2-ecff-4fe0-8148-bf9d1d84a8bf-00016', 'volume_b1fc0d58-7747-4bcf-99a7-fb482aacb945/20260703094530/az_nova_backup_e353b2b2-ecff-4fe0-8148-bf9d1d84a8bf-00017', 'volume_b1fc0d58-7747-4bcf-99a7-fb482aacb945/20260703094530/az_nova_backup_e353b2b2-ecff-4fe0-8148-bf9d1d84a8bf-00018', 'volume_b1fc0d58-7747-4bcf-99a7-fb482aacb945/20260703094530/az_nova_backup_e353b2b2-ecff-4fe0-8148-bf9d1d84a8bf-00019', 'volume_b1fc0d58-7747-4bcf-99a7-fb482aacb945/20260703094530/az_nova_backup_e353b2b2-ecff-4fe0-8148-bf9d1d84a8bf-00020', 'volume_b1fc0d58-7747-4bcf-99a7-fb482aacb945/20260703094530/az_nova_backup_e353b2b2-ecff-4fe0-8148-bf9d1d84a8bf-00021', 'volume_b1fc0d58-7747-4bcf-99a7-fb482aacb945/20260703094530/az_nova_backup_e353b2b2-ecff-4fe0-8148-bf9d1d84a8bf_metadata', 'volume_b1fc0d58-7747-4bcf-99a7-fb482aacb945/20260703094530/az_nova_backup_e353b2b2-ecff-4fe0-8148-bf9d1d84a8bf_sha256file']. {{(pid=101319) _generate_object_names /opt/stack/cinder/cinder/backup/chunkeddriver.py:260}} Jul 03 09:46:07.856346 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-f7681f40-9f24-47c3-b5fb-86cb1dfa75ff tempest-VolumesBackupsTest-2142009639 None] deleted object: volume_b1fc0d58-7747-4bcf-99a7-fb482aacb945/20260703094530/az_nova_backup_e353b2b2-ecff-4fe0-8148-bf9d1d84a8bf-00001 in container: tempest-volumesbackupstest-backup-container-1320776190. {{(pid=101319) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 09:46:07.880005 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-f7681f40-9f24-47c3-b5fb-86cb1dfa75ff tempest-VolumesBackupsTest-2142009639 None] deleted object: volume_b1fc0d58-7747-4bcf-99a7-fb482aacb945/20260703094530/az_nova_backup_e353b2b2-ecff-4fe0-8148-bf9d1d84a8bf-00002 in container: tempest-volumesbackupstest-backup-container-1320776190. {{(pid=101319) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 09:46:07.902384 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-f7681f40-9f24-47c3-b5fb-86cb1dfa75ff tempest-VolumesBackupsTest-2142009639 None] deleted object: volume_b1fc0d58-7747-4bcf-99a7-fb482aacb945/20260703094530/az_nova_backup_e353b2b2-ecff-4fe0-8148-bf9d1d84a8bf-00003 in container: tempest-volumesbackupstest-backup-container-1320776190. {{(pid=101319) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 09:46:07.922657 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-f7681f40-9f24-47c3-b5fb-86cb1dfa75ff tempest-VolumesBackupsTest-2142009639 None] deleted object: volume_b1fc0d58-7747-4bcf-99a7-fb482aacb945/20260703094530/az_nova_backup_e353b2b2-ecff-4fe0-8148-bf9d1d84a8bf-00004 in container: tempest-volumesbackupstest-backup-container-1320776190. {{(pid=101319) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 09:46:07.941265 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-f7681f40-9f24-47c3-b5fb-86cb1dfa75ff tempest-VolumesBackupsTest-2142009639 None] deleted object: volume_b1fc0d58-7747-4bcf-99a7-fb482aacb945/20260703094530/az_nova_backup_e353b2b2-ecff-4fe0-8148-bf9d1d84a8bf-00005 in container: tempest-volumesbackupstest-backup-container-1320776190. {{(pid=101319) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 09:46:07.960542 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-f7681f40-9f24-47c3-b5fb-86cb1dfa75ff tempest-VolumesBackupsTest-2142009639 None] deleted object: volume_b1fc0d58-7747-4bcf-99a7-fb482aacb945/20260703094530/az_nova_backup_e353b2b2-ecff-4fe0-8148-bf9d1d84a8bf-00006 in container: tempest-volumesbackupstest-backup-container-1320776190. {{(pid=101319) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 09:46:07.978950 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-f7681f40-9f24-47c3-b5fb-86cb1dfa75ff tempest-VolumesBackupsTest-2142009639 None] deleted object: volume_b1fc0d58-7747-4bcf-99a7-fb482aacb945/20260703094530/az_nova_backup_e353b2b2-ecff-4fe0-8148-bf9d1d84a8bf-00007 in container: tempest-volumesbackupstest-backup-container-1320776190. {{(pid=101319) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 09:46:07.999263 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-f7681f40-9f24-47c3-b5fb-86cb1dfa75ff tempest-VolumesBackupsTest-2142009639 None] deleted object: volume_b1fc0d58-7747-4bcf-99a7-fb482aacb945/20260703094530/az_nova_backup_e353b2b2-ecff-4fe0-8148-bf9d1d84a8bf-00008 in container: tempest-volumesbackupstest-backup-container-1320776190. {{(pid=101319) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 09:46:08.017284 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-f7681f40-9f24-47c3-b5fb-86cb1dfa75ff tempest-VolumesBackupsTest-2142009639 None] deleted object: volume_b1fc0d58-7747-4bcf-99a7-fb482aacb945/20260703094530/az_nova_backup_e353b2b2-ecff-4fe0-8148-bf9d1d84a8bf-00009 in container: tempest-volumesbackupstest-backup-container-1320776190. {{(pid=101319) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 09:46:08.036781 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-f7681f40-9f24-47c3-b5fb-86cb1dfa75ff tempest-VolumesBackupsTest-2142009639 None] deleted object: volume_b1fc0d58-7747-4bcf-99a7-fb482aacb945/20260703094530/az_nova_backup_e353b2b2-ecff-4fe0-8148-bf9d1d84a8bf-00010 in container: tempest-volumesbackupstest-backup-container-1320776190. {{(pid=101319) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 09:46:08.057091 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-f7681f40-9f24-47c3-b5fb-86cb1dfa75ff tempest-VolumesBackupsTest-2142009639 None] deleted object: volume_b1fc0d58-7747-4bcf-99a7-fb482aacb945/20260703094530/az_nova_backup_e353b2b2-ecff-4fe0-8148-bf9d1d84a8bf-00011 in container: tempest-volumesbackupstest-backup-container-1320776190. {{(pid=101319) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 09:46:08.076419 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-f7681f40-9f24-47c3-b5fb-86cb1dfa75ff tempest-VolumesBackupsTest-2142009639 None] deleted object: volume_b1fc0d58-7747-4bcf-99a7-fb482aacb945/20260703094530/az_nova_backup_e353b2b2-ecff-4fe0-8148-bf9d1d84a8bf-00012 in container: tempest-volumesbackupstest-backup-container-1320776190. {{(pid=101319) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 09:46:08.093930 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-f7681f40-9f24-47c3-b5fb-86cb1dfa75ff tempest-VolumesBackupsTest-2142009639 None] deleted object: volume_b1fc0d58-7747-4bcf-99a7-fb482aacb945/20260703094530/az_nova_backup_e353b2b2-ecff-4fe0-8148-bf9d1d84a8bf-00013 in container: tempest-volumesbackupstest-backup-container-1320776190. {{(pid=101319) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 09:46:08.112241 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-f7681f40-9f24-47c3-b5fb-86cb1dfa75ff tempest-VolumesBackupsTest-2142009639 None] deleted object: volume_b1fc0d58-7747-4bcf-99a7-fb482aacb945/20260703094530/az_nova_backup_e353b2b2-ecff-4fe0-8148-bf9d1d84a8bf-00014 in container: tempest-volumesbackupstest-backup-container-1320776190. {{(pid=101319) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 09:46:08.131024 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-f7681f40-9f24-47c3-b5fb-86cb1dfa75ff tempest-VolumesBackupsTest-2142009639 None] deleted object: volume_b1fc0d58-7747-4bcf-99a7-fb482aacb945/20260703094530/az_nova_backup_e353b2b2-ecff-4fe0-8148-bf9d1d84a8bf-00015 in container: tempest-volumesbackupstest-backup-container-1320776190. {{(pid=101319) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 09:46:08.149700 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-f7681f40-9f24-47c3-b5fb-86cb1dfa75ff tempest-VolumesBackupsTest-2142009639 None] deleted object: volume_b1fc0d58-7747-4bcf-99a7-fb482aacb945/20260703094530/az_nova_backup_e353b2b2-ecff-4fe0-8148-bf9d1d84a8bf-00016 in container: tempest-volumesbackupstest-backup-container-1320776190. {{(pid=101319) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 09:46:08.174758 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-f7681f40-9f24-47c3-b5fb-86cb1dfa75ff tempest-VolumesBackupsTest-2142009639 None] deleted object: volume_b1fc0d58-7747-4bcf-99a7-fb482aacb945/20260703094530/az_nova_backup_e353b2b2-ecff-4fe0-8148-bf9d1d84a8bf-00017 in container: tempest-volumesbackupstest-backup-container-1320776190. {{(pid=101319) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 09:46:08.198250 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-f7681f40-9f24-47c3-b5fb-86cb1dfa75ff tempest-VolumesBackupsTest-2142009639 None] deleted object: volume_b1fc0d58-7747-4bcf-99a7-fb482aacb945/20260703094530/az_nova_backup_e353b2b2-ecff-4fe0-8148-bf9d1d84a8bf-00018 in container: tempest-volumesbackupstest-backup-container-1320776190. {{(pid=101319) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 09:46:08.240671 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-f7681f40-9f24-47c3-b5fb-86cb1dfa75ff tempest-VolumesBackupsTest-2142009639 None] deleted object: volume_b1fc0d58-7747-4bcf-99a7-fb482aacb945/20260703094530/az_nova_backup_e353b2b2-ecff-4fe0-8148-bf9d1d84a8bf-00019 in container: tempest-volumesbackupstest-backup-container-1320776190. {{(pid=101319) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 09:46:08.271419 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-f7681f40-9f24-47c3-b5fb-86cb1dfa75ff tempest-VolumesBackupsTest-2142009639 None] deleted object: volume_b1fc0d58-7747-4bcf-99a7-fb482aacb945/20260703094530/az_nova_backup_e353b2b2-ecff-4fe0-8148-bf9d1d84a8bf-00020 in container: tempest-volumesbackupstest-backup-container-1320776190. {{(pid=101319) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 09:46:08.306366 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-f7681f40-9f24-47c3-b5fb-86cb1dfa75ff tempest-VolumesBackupsTest-2142009639 None] deleted object: volume_b1fc0d58-7747-4bcf-99a7-fb482aacb945/20260703094530/az_nova_backup_e353b2b2-ecff-4fe0-8148-bf9d1d84a8bf-00021 in container: tempest-volumesbackupstest-backup-container-1320776190. {{(pid=101319) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 09:46:08.345991 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-f7681f40-9f24-47c3-b5fb-86cb1dfa75ff tempest-VolumesBackupsTest-2142009639 None] deleted object: volume_b1fc0d58-7747-4bcf-99a7-fb482aacb945/20260703094530/az_nova_backup_e353b2b2-ecff-4fe0-8148-bf9d1d84a8bf_metadata in container: tempest-volumesbackupstest-backup-container-1320776190. {{(pid=101319) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 09:46:08.376159 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-f7681f40-9f24-47c3-b5fb-86cb1dfa75ff tempest-VolumesBackupsTest-2142009639 None] deleted object: volume_b1fc0d58-7747-4bcf-99a7-fb482aacb945/20260703094530/az_nova_backup_e353b2b2-ecff-4fe0-8148-bf9d1d84a8bf_sha256file in container: tempest-volumesbackupstest-backup-container-1320776190. {{(pid=101319) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 09:46:08.376447 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-f7681f40-9f24-47c3-b5fb-86cb1dfa75ff tempest-VolumesBackupsTest-2142009639 None] delete e353b2b2-ecff-4fe0-8148-bf9d1d84a8bf finished. {{(pid=101319) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:848}} Jul 03 09:46:08.417255 np0000004400 cinder-backup[101319]: DEBUG oslo_db.sqlalchemy.engines [None req-f7681f40-9f24-47c3-b5fb-86cb1dfa75ff tempest-VolumesBackupsTest-2142009639 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=101319) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 03 09:46:08.430175 np0000004400 cinder-backup[101319]: DEBUG cinder.quota [None req-f7681f40-9f24-47c3-b5fb-86cb1dfa75ff tempest-VolumesBackupsTest-2142009639 None] Created reservations ['2d8ae5be-1be8-476c-9abc-fdeea236583a', '9cc07ef7-0078-4a5b-882c-cba5ad89d987'] {{(pid=101319) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 09:46:08.449994 np0000004400 cinder-backup[101319]: INFO cinder.backup.manager [None req-f7681f40-9f24-47c3-b5fb-86cb1dfa75ff tempest-VolumesBackupsTest-2142009639 None] Delete backup finished, backup e353b2b2-ecff-4fe0-8148-bf9d1d84a8bf deleted. Jul 03 09:46:08.537336 np0000004400 cinder-backup[101319]: INFO cinder.backup.manager [None req-9e4652d9-7b88-4965-aef2-2c42a95e107c tempest-ProjectAdminTests33-1900627284 None] Create backup started, backup: 3e013368-c720-4dd1-96fd-358ab8abaea3 volume: bcfdc9b0-68fe-4358-ac7c-7d6e27267fe9. Jul 03 09:46:08.542906 np0000004400 cinder-backup[101319]: INFO cinder.backup.manager [None req-9e4652d9-7b88-4965-aef2-2c42a95e107c tempest-ProjectAdminTests33-1900627284 None] Call Volume Manager to get_backup_device for Backup(availability_zone='nova',container=None,created_at=2026-07-03T09:46:08Z,data_timestamp=2026-07-03T09:46:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-type-Backup-1781984812',encryption_key_id=None,fail_reason=None,host='np0000004400',id=3e013368-c720-4dd1-96fd-358ab8abaea3,metadata={},num_dependent_backups=0,object_count=0,parent=None,parent_id=None,project_id='a2309d0555a742279b4a5017d94ebf02',restore_volume_id=None,service='cinder.backup.drivers.swift.SwiftBackupDriver',service_metadata=None,size=1,snapshot_id=None,status='creating',temp_snapshot_id=None,temp_volume_id=None,updated_at=None,user_id='23ba560f6eed465495956e82c26b6f69',volume_id=bcfdc9b0-68fe-4358-ac7c-7d6e27267fe9) Jul 03 09:46:08.565665 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.drivers.swift [None req-9e4652d9-7b88-4965-aef2-2c42a95e107c tempest-ProjectAdminTests33-1900627284 None] Using swift URL https://10.4.3.95:8080/v1/AUTH_a2309d0555a742279b4a5017d94ebf02 {{(pid=101319) initialize /opt/stack/cinder/cinder/backup/drivers/swift.py:300}} Jul 03 09:46:08.565888 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.drivers.swift [None req-9e4652d9-7b88-4965-aef2-2c42a95e107c tempest-ProjectAdminTests33-1900627284 None] Connect to https://10.4.3.95:8080/v1/AUTH_ in "per_user" mode {{(pid=101319) initialize /opt/stack/cinder/cinder/backup/drivers/swift.py:301}} Jul 03 09:46:08.566518 np0000004400 cinder-backup[101319]: DEBUG os_brick.utils [None req-9e4652d9-7b88-4965-aef2-2c42a95e107c tempest-ProjectAdminTests33-1900627284 None] ==> get_connector_properties: call "{'root_helper': 'sudo cinder-rootwrap /etc/cinder/rootwrap.conf', 'my_ip': '10.4.3.95', 'multipath': False, 'enforce_multipath': False, 'host': None, 'execute': None}" {{(pid=101319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}} Jul 03 09:46:08.577265 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.scaleio [None req-9e4652d9-7b88-4965-aef2-2c42a95e107c tempest-ProjectAdminTests33-1900627284 None] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=101319) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}} Jul 03 09:46:08.595710 np0000004400 cinder-backup[101319]: DEBUG oslo_concurrency.processutils [None req-9e4652d9-7b88-4965-aef2-2c42a95e107c tempest-ProjectAdminTests33-1900627284 None] Running cmd (subprocess): nvme version {{(pid=101319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 09:46:08.610751 np0000004400 cinder-backup[101319]: DEBUG oslo_concurrency.processutils [None req-9e4652d9-7b88-4965-aef2-2c42a95e107c tempest-ProjectAdminTests33-1900627284 None] 'nvme version' failed. Not Retrying. {{(pid=101319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 03 09:46:08.611130 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.nvmeof [None req-9e4652d9-7b88-4965-aef2-2c42a95e107c tempest-ProjectAdminTests33-1900627284 None] nvme not present on system {{(pid=101319) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}} Jul 03 09:46:08.623339 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.lightos [None req-9e4652d9-7b88-4965-aef2-2c42a95e107c tempest-ProjectAdminTests33-1900627284 None] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=101319) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}} Jul 03 09:46:08.624721 np0000004400 cinder-backup[101319]: INFO os_brick.initiator.connectors.lightos [None req-9e4652d9-7b88-4965-aef2-2c42a95e107c tempest-ProjectAdminTests33-1900627284 None] Current host hostNQN and IP(s) are ['10.4.3.95', 'fe80::f816:3eff:fe47:268c', '192.168.40.6', 'fe80::f816:3eff:febf:7be2', '192.168.50.6', 'fe80::f816:3eff:fe99:8914', '192.168.10.6', 'fe80::f816:3eff:fe2f:e696', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::bc9d:84ff:fec2:6b49', 'fe80::fc16:3eff:fea0:4147', 'fe80::b0cf:48ff:fe29:caf0', 'fe80::fc16:3eff:fe91:aa0', 'fe80::fc16:3eff:fe3b:46af', 'fe80::28c1:27ff:fe3c:5528', 'fe80::fc16:3eff:fe6b:be86', 'fe80::4007:baff:fe0f:8f44', 'fe80::fc16:3eff:fe93:a114'] Jul 03 09:46:08.624938 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.lightos [None req-9e4652d9-7b88-4965-aef2-2c42a95e107c tempest-ProjectAdminTests33-1900627284 None] LIGHTOS: did not find dsc, continuing anyway. {{(pid=101319) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}} Jul 03 09:46:08.625119 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.lightos [None req-9e4652d9-7b88-4965-aef2-2c42a95e107c tempest-ProjectAdminTests33-1900627284 None] LIGHTOS: no hostnqn found. {{(pid=101319) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}} Jul 03 09:46:08.625427 np0000004400 cinder-backup[101319]: DEBUG os_brick.utils [None req-9e4652d9-7b88-4965-aef2-2c42a95e107c tempest-ProjectAdminTests33-1900627284 None] <== get_connector_properties: return (58ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.95', 'host': 'np0000004400', 'multipath': False, 'enforce_multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:ae7e5bb0ebe6', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': '6b284368-d0ba-4d18-af6f-4998d3955c52', 'nvme_native_multipath': False} {{(pid=101319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}} Jul 03 09:46:09.129433 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connector [None req-9e4652d9-7b88-4965-aef2-2c42a95e107c tempest-ProjectAdminTests33-1900627284 None] Factory for iscsi on None {{(pid=101319) factory /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connector.py:243}} Jul 03 09:46:09.129881 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-9e4652d9-7b88-4965-aef2-2c42a95e107c tempest-ProjectAdminTests33-1900627284 None] ==> connect_volume: call "{'self': , 'connection_properties': {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-bcfdc9b0-68fe-4358-ac7c-7d6e27267fe9', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'bcfdc9b0-68fe-4358-ac7c-7d6e27267fe9', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': False}}" {{(pid=101319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}} Jul 03 09:46:09.130065 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.base [None req-9e4652d9-7b88-4965-aef2-2c42a95e107c tempest-ProjectAdminTests33-1900627284 None] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=101319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jul 03 09:46:09.130550 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.base [None req-9e4652d9-7b88-4965-aef2-2c42a95e107c tempest-ProjectAdminTests33-1900627284 None] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=101319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jul 03 09:46:09.130814 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.base [None req-9e4652d9-7b88-4965-aef2-2c42a95e107c tempest-ProjectAdminTests33-1900627284 None] Connection properties {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-bcfdc9b0-68fe-4358-ac7c-7d6e27267fe9', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'bcfdc9b0-68fe-4358-ac7c-7d6e27267fe9', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': False} {{(pid=101319) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}} Jul 03 09:46:09.140590 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.base [None req-9e4652d9-7b88-4965-aef2-2c42a95e107c tempest-ProjectAdminTests33-1900627284 None] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-bcfdc9b0-68fe-4358-ac7c-7d6e27267fe9" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=101319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jul 03 09:46:09.140958 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.base [None req-9e4652d9-7b88-4965-aef2-2c42a95e107c tempest-ProjectAdminTests33-1900627284 None] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-bcfdc9b0-68fe-4358-ac7c-7d6e27267fe9" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.000s {{(pid=101319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jul 03 09:46:09.141141 np0000004400 cinder-backup[101319]: INFO os_brick.initiator.connectors.iscsi [None req-9e4652d9-7b88-4965-aef2-2c42a95e107c tempest-ProjectAdminTests33-1900627284 None] Trying to connect to iSCSI portal 192.168.40.100:3260 Jul 03 09:46:09.149533 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-9e4652d9-7b88-4965-aef2-2c42a95e107c tempest-ProjectAdminTests33-1900627284 None] iscsiadm (): stdout= stderr=iscsiadm: No records found Jul 03 09:46:09.149533 np0000004400 cinder-backup[101319]: {{(pid=101319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 03 09:46:09.158846 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-9e4652d9-7b88-4965-aef2-2c42a95e107c tempest-ProjectAdminTests33-1900627284 None] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-bcfdc9b0-68fe-4358-ac7c-7d6e27267fe9] added Jul 03 09:46:09.158846 np0000004400 cinder-backup[101319]: stderr=iscsiadm: Config file line 363 does not have value Jul 03 09:46:09.158846 np0000004400 cinder-backup[101319]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs' Jul 03 09:46:09.158846 np0000004400 cinder-backup[101319]: iscsiadm: Config file line 363 does not have value Jul 03 09:46:09.158846 np0000004400 cinder-backup[101319]: iscsiadm: Config file line 363 does not have value Jul 03 09:46:09.158846 np0000004400 cinder-backup[101319]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs' Jul 03 09:46:09.158846 np0000004400 cinder-backup[101319]: {{(pid=101319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 03 09:46:09.159137 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-9e4652d9-7b88-4965-aef2-2c42a95e107c tempest-ProjectAdminTests33-1900627284 None] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=101319) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}} Jul 03 09:46:09.159578 np0000004400 cinder-backup[101319]: DEBUG os_brick.utils [None req-9e4652d9-7b88-4965-aef2-2c42a95e107c tempest-ProjectAdminTests33-1900627284 None] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0182(s), this was the 1st time calling it. {{(pid=101319) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}} Jul 03 09:46:09.159875 np0000004400 cinder-backup[101319]: DEBUG os_brick.utils [None req-9e4652d9-7b88-4965-aef2-2c42a95e107c tempest-ProjectAdminTests33-1900627284 None] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=101319) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}} Jul 03 09:46:10.161238 np0000004400 cinder-backup[101319]: INFO os_brick.initiator.connectors.iscsi [None req-9e4652d9-7b88-4965-aef2-2c42a95e107c tempest-ProjectAdminTests33-1900627284 None] Trying to connect to iSCSI portal 192.168.40.100:3260 Jul 03 09:46:10.172144 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-9e4652d9-7b88-4965-aef2-2c42a95e107c tempest-ProjectAdminTests33-1900627284 None] iscsiadm (): stdout=# BEGIN RECORD 2.1.9 Jul 03 09:46:10.172144 np0000004400 cinder-backup[101319]: node.name = iqn.2023-03.storpool.com:os--volume-bcfdc9b0-68fe-4358-ac7c-7d6e27267fe9 Jul 03 09:46:10.172144 np0000004400 cinder-backup[101319]: node.tpgt = -1 Jul 03 09:46:10.172144 np0000004400 cinder-backup[101319]: node.startup = manual Jul 03 09:46:10.172144 np0000004400 cinder-backup[101319]: node.leading_login = No Jul 03 09:46:10.172144 np0000004400 cinder-backup[101319]: iface.iscsi_ifacename = default Jul 03 09:46:10.172144 np0000004400 cinder-backup[101319]: iface.net_ifacename = Jul 03 09:46:10.172144 np0000004400 cinder-backup[101319]: iface.ipaddress = Jul 03 09:46:10.172144 np0000004400 cinder-backup[101319]: iface.prefix_len = 0 Jul 03 09:46:10.172144 np0000004400 cinder-backup[101319]: iface.hwaddress = Jul 03 09:46:10.172144 np0000004400 cinder-backup[101319]: iface.transport_name = tcp Jul 03 09:46:10.172144 np0000004400 cinder-backup[101319]: iface.initiatorname = Jul 03 09:46:10.172144 np0000004400 cinder-backup[101319]: iface.state = Jul 03 09:46:10.172144 np0000004400 cinder-backup[101319]: iface.vlan_id = 0 Jul 03 09:46:10.172144 np0000004400 cinder-backup[101319]: iface.vlan_priority = 0 Jul 03 09:46:10.172144 np0000004400 cinder-backup[101319]: iface.vlan_state = Jul 03 09:46:10.172144 np0000004400 cinder-backup[101319]: iface.iface_num = 0 Jul 03 09:46:10.172144 np0000004400 cinder-backup[101319]: iface.mtu = 0 Jul 03 09:46:10.172144 np0000004400 cinder-backup[101319]: iface.port = 0 Jul 03 09:46:10.172144 np0000004400 cinder-backup[101319]: iface.bootproto = Jul 03 09:46:10.172144 np0000004400 cinder-backup[101319]: iface.subnet_mask = Jul 03 09:46:10.172144 np0000004400 cinder-backup[101319]: iface.gateway = Jul 03 09:46:10.172144 np0000004400 cinder-backup[101319]: iface.dhcp_alt_client_id_state = Jul 03 09:46:10.172144 np0000004400 cinder-backup[101319]: iface.dhcp_alt_client_id = Jul 03 09:46:10.172144 np0000004400 cinder-backup[101319]: iface.dhcp_dns = Jul 03 09:46:10.172144 np0000004400 cinder-backup[101319]: iface.dhcp_learn_iqn = Jul 03 09:46:10.172144 np0000004400 cinder-backup[101319]: iface.dhcp_req_vendor_id_state = Jul 03 09:46:10.172144 np0000004400 cinder-backup[101319]: iface.dhcp_vendor_id_state = Jul 03 09:46:10.172144 np0000004400 cinder-backup[101319]: iface.dhcp_vendor_id = Jul 03 09:46:10.172144 np0000004400 cinder-backup[101319]: iface.dhcp_slp_da = Jul 03 09:46:10.172144 np0000004400 cinder-backup[101319]: iface.fragmentation = Jul 03 09:46:10.172144 np0000004400 cinder-backup[101319]: iface.gratuitous_arp = Jul 03 09:46:10.172144 np0000004400 cinder-backup[101319]: iface.incoming_forwarding = Jul 03 09:46:10.172144 np0000004400 cinder-backup[101319]: iface.tos_state = Jul 03 09:46:10.172144 np0000004400 cinder-backup[101319]: iface.tos = 0 Jul 03 09:46:10.172144 np0000004400 cinder-backup[101319]: iface.ttl = 0 Jul 03 09:46:10.172144 np0000004400 cinder-backup[101319]: iface.delayed_ack = Jul 03 09:46:10.172144 np0000004400 cinder-backup[101319]: iface.tcp_nagle = Jul 03 09:46:10.172144 np0000004400 cinder-backup[101319]: iface.tcp_wsf_state = Jul 03 09:46:10.172144 np0000004400 cinder-backup[101319]: iface.tcp_wsf = 0 Jul 03 09:46:10.172144 np0000004400 cinder-backup[101319]: iface.tcp_timer_scale = 0 Jul 03 09:46:10.172144 np0000004400 cinder-backup[101319]: iface.tcp_timestamp = Jul 03 09:46:10.172144 np0000004400 cinder-backup[101319]: iface.redirect = Jul 03 09:46:10.172144 np0000004400 cinder-backup[101319]: iface.def_task_mgmt_timeout = 0 Jul 03 09:46:10.172144 np0000004400 cinder-backup[101319]: iface.header_digest = Jul 03 09:46:10.172144 np0000004400 cinder-backup[101319]: iface.data_digest = Jul 03 09:46:10.172144 np0000004400 cinder-backup[101319]: iface.immediate_data = Jul 03 09:46:10.172144 np0000004400 cinder-backup[101319]: iface.initial_r2t = Jul 03 09:46:10.172144 np0000004400 cinder-backup[101319]: iface.data_seq_inorder = Jul 03 09:46:10.172144 np0000004400 cinder-backup[101319]: iface.data_pdu_inorder = Jul 03 09:46:10.172144 np0000004400 cinder-backup[101319]: iface.erl = 0 Jul 03 09:46:10.172144 np0000004400 cinder-backup[101319]: iface.max_receive_data_len = 0 Jul 03 09:46:10.172144 np0000004400 cinder-backup[101319]: iface.first_burst_len = 0 Jul 03 09:46:10.172144 np0000004400 cinder-backup[101319]: iface.max_outstanding_r2t = 0 Jul 03 09:46:10.172144 np0000004400 cinder-backup[101319]: iface.max_burst_len = 0 Jul 03 09:46:10.172144 np0000004400 cinder-backup[101319]: iface.chap_auth = Jul 03 09:46:10.172144 np0000004400 cinder-backup[101319]: iface.bidi_chap = Jul 03 09:46:10.172144 np0000004400 cinder-backup[101319]: iface.strict_login_compliance = Jul 03 09:46:10.172144 np0000004400 cinder-backup[101319]: iface.discovery_auth = Jul 03 09:46:10.172144 np0000004400 cinder-backup[101319]: iface.discovery_logout = Jul 03 09:46:10.172144 np0000004400 cinder-backup[101319]: node.discovery_address = Jul 03 09:46:10.172144 np0000004400 cinder-backup[101319]: node.discovery_port = 0 Jul 03 09:46:10.172144 np0000004400 cinder-backup[101319]: node.discovery_type = fw Jul 03 09:46:10.172144 np0000004400 cinder-backup[101319]: node.session.initial_cmdsn = 0 Jul 03 09:46:10.172144 np0000004400 cinder-backup[101319]: node.session.initial_login_retry_max = 8 Jul 03 09:46:10.172144 np0000004400 cinder-backup[101319]: node.session.xmit_thread_priority = 0 Jul 03 09:46:10.172144 np0000004400 cinder-backup[101319]: node.session.cmds_max = 128 Jul 03 09:46:10.172144 np0000004400 cinder-backup[101319]: node.session.queue_depth = 32 Jul 03 09:46:10.172144 np0000004400 cinder-backup[101319]: node.session.nr_sessions = 1 Jul 03 09:46:10.172144 np0000004400 cinder-backup[101319]: node.session.auth.authmethod = None Jul 03 09:46:10.172144 np0000004400 cinder-backup[101319]: node.session.auth.username = Jul 03 09:46:10.172144 np0000004400 cinder-backup[101319]: node.session.auth.password = *** Jul 03 09:46:10.172144 np0000004400 cinder-backup[101319]: node.session.auth.username_in = Jul 03 09:46:10.172144 np0000004400 cinder-backup[101319]: node.session.auth.password_in = Jul 03 09:46:10.172144 np0000004400 cinder-backup[101319]: node.session.auth.chap_algs = SHA256 Jul 03 09:46:10.172144 np0000004400 cinder-backup[101319]: node.session.timeo.replacement_timeout = 120 Jul 03 09:46:10.172144 np0000004400 cinder-backup[101319]: node.session.err_timeo.abort_timeout = 15 Jul 03 09:46:10.172144 np0000004400 cinder-backup[101319]: node.session.err_timeo.lu_reset_timeout = 30 Jul 03 09:46:10.172144 np0000004400 cinder-backup[101319]: node.session.err_timeo.tgt_reset_timeout = 30 Jul 03 09:46:10.172144 np0000004400 cinder-backup[101319]: node.session.err_timeo.host_reset_timeout = 60 Jul 03 09:46:10.172144 np0000004400 cinder-backup[101319]: node.session.iscsi.FastAbort = Yes Jul 03 09:46:10.172144 np0000004400 cinder-backup[101319]: node.session.iscsi.InitialR2T = No Jul 03 09:46:10.172144 np0000004400 cinder-backup[101319]: node.session.iscsi.ImmediateData = Yes Jul 03 09:46:10.172144 np0000004400 cinder-backup[101319]: node.session.iscsi.FirstBurstLength = 262144 Jul 03 09:46:10.172144 np0000004400 cinder-backup[101319]: node.session.iscsi.MaxBurstLength = 16776192 Jul 03 09:46:10.172144 np0000004400 cinder-backup[101319]: node.session.iscsi.DefaultTime2Retain = 0 Jul 03 09:46:10.172144 np0000004400 cinder-backup[101319]: node.session.iscsi.DefaultTime2Wait = 2 Jul 03 09:46:10.172144 np0000004400 cinder-backup[101319]: node.session.iscsi.MaxConnections = 1 Jul 03 09:46:10.172144 np0000004400 cinder-backup[101319]: node.session.iscsi.MaxOutstandingR2T = 1 Jul 03 09:46:10.172144 np0000004400 cinder-backup[101319]: node.session.iscsi.ERL = 0 Jul 03 09:46:10.172144 np0000004400 cinder-backup[101319]: node.session.scan = auto Jul 03 09:46:10.172144 np0000004400 cinder-backup[101319]: node.session.reopen_max = 0 Jul 03 09:46:10.172144 np0000004400 cinder-backup[101319]: node.conn[0].address = 192.168.40.100 Jul 03 09:46:10.172144 np0000004400 cinder-backup[101319]: node.conn[0].port = 3260 Jul 03 09:46:10.172144 np0000004400 cinder-backup[101319]: node.conn[0].startup = manual Jul 03 09:46:10.172144 np0000004400 cinder-backup[101319]: node.conn[0].tcp.window_size = 524288 Jul 03 09:46:10.172144 np0000004400 cinder-backup[101319]: node.conn[0].tcp.type_of_service = 0 Jul 03 09:46:10.172144 np0000004400 cinder-backup[101319]: node.conn[0].timeo.logout_timeout = 15 Jul 03 09:46:10.172144 np0000004400 cinder-backup[101319]: node.conn[0].timeo.login_timeout = 15 Jul 03 09:46:10.172144 np0000004400 cinder-backup[101319]: node.conn[0].timeo.auth_timeout = 45 Jul 03 09:46:10.172144 np0000004400 cinder-backup[101319]: node.conn[0].timeo.noop_out_interval = 5 Jul 03 09:46:10.172144 np0000004400 cinder-backup[101319]: node.conn[0].timeo.noop_out_timeout = 5 Jul 03 09:46:10.172144 np0000004400 cinder-backup[101319]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0 Jul 03 09:46:10.172144 np0000004400 cinder-backup[101319]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144 Jul 03 09:46:10.172144 np0000004400 cinder-backup[101319]: node.conn[0].iscsi.HeaderDigest = None Jul 03 09:46:10.172144 np0000004400 cinder-backup[101319]: node.conn[0].iscsi.DataDigest = None Jul 03 09:46:10.172144 np0000004400 cinder-backup[101319]: node.conn[0].iscsi.IFMarker = No Jul 03 09:46:10.172144 np0000004400 cinder-backup[101319]: node.conn[0].iscsi.OFMarker = No Jul 03 09:46:10.172144 np0000004400 cinder-backup[101319]: # END RECORD Jul 03 09:46:10.172144 np0000004400 cinder-backup[101319]: stderr= {{(pid=101319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 03 09:46:10.182626 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-9e4652d9-7b88-4965-aef2-2c42a95e107c tempest-ProjectAdminTests33-1900627284 None] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=101319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 03 09:46:10.196422 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-9e4652d9-7b88-4965-aef2-2c42a95e107c tempest-ProjectAdminTests33-1900627284 None] iscsiadm ('-m', 'session'): stdout=tcp: [110] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6713aeef-c919-4102-a884-a71545173837 (non-flash) Jul 03 09:46:10.196422 np0000004400 cinder-backup[101319]: tcp: [111] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-6713aeef-c919-4102-a884-a71545173837 (non-flash) Jul 03 09:46:10.196422 np0000004400 cinder-backup[101319]: tcp: [82] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-76320525-737e-4f58-8523-63ec9abbdc64 (non-flash) Jul 03 09:46:10.196422 np0000004400 cinder-backup[101319]: tcp: [83] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-76320525-737e-4f58-8523-63ec9abbdc64 (non-flash) Jul 03 09:46:10.196422 np0000004400 cinder-backup[101319]: tcp: [97] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d47f5d2f-dce5-42f7-a693-a654fd702622 (non-flash) Jul 03 09:46:10.196422 np0000004400 cinder-backup[101319]: tcp: [98] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d47f5d2f-dce5-42f7-a693-a654fd702622 (non-flash) Jul 03 09:46:10.196422 np0000004400 cinder-backup[101319]: stderr= {{(pid=101319) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jul 03 09:46:10.196731 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-9e4652d9-7b88-4965-aef2-2c42a95e107c tempest-ProjectAdminTests33-1900627284 None] iscsi session list stdout=tcp: [110] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6713aeef-c919-4102-a884-a71545173837 (non-flash) Jul 03 09:46:10.196731 np0000004400 cinder-backup[101319]: tcp: [111] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-6713aeef-c919-4102-a884-a71545173837 (non-flash) Jul 03 09:46:10.196731 np0000004400 cinder-backup[101319]: tcp: [82] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-76320525-737e-4f58-8523-63ec9abbdc64 (non-flash) Jul 03 09:46:10.196731 np0000004400 cinder-backup[101319]: tcp: [83] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-76320525-737e-4f58-8523-63ec9abbdc64 (non-flash) Jul 03 09:46:10.196731 np0000004400 cinder-backup[101319]: tcp: [97] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d47f5d2f-dce5-42f7-a693-a654fd702622 (non-flash) Jul 03 09:46:10.196731 np0000004400 cinder-backup[101319]: tcp: [98] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d47f5d2f-dce5-42f7-a693-a654fd702622 (non-flash) Jul 03 09:46:10.196731 np0000004400 cinder-backup[101319]: stderr= {{(pid=101319) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jul 03 09:46:10.240869 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-9e4652d9-7b88-4965-aef2-2c42a95e107c tempest-ProjectAdminTests33-1900627284 None] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-bcfdc9b0-68fe-4358-ac7c-7d6e27267fe9, portal: 192.168.40.100,3260] Jul 03 09:46:10.240869 np0000004400 cinder-backup[101319]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-bcfdc9b0-68fe-4358-ac7c-7d6e27267fe9, portal: 192.168.40.100,3260] successful. Jul 03 09:46:10.240869 np0000004400 cinder-backup[101319]: stderr= {{(pid=101319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 03 09:46:10.252245 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-9e4652d9-7b88-4965-aef2-2c42a95e107c tempest-ProjectAdminTests33-1900627284 None] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=101319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 03 09:46:10.265596 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-9e4652d9-7b88-4965-aef2-2c42a95e107c tempest-ProjectAdminTests33-1900627284 None] iscsiadm ('-m', 'session'): stdout=tcp: [110] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6713aeef-c919-4102-a884-a71545173837 (non-flash) Jul 03 09:46:10.265596 np0000004400 cinder-backup[101319]: tcp: [111] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-6713aeef-c919-4102-a884-a71545173837 (non-flash) Jul 03 09:46:10.265596 np0000004400 cinder-backup[101319]: tcp: [112] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-bcfdc9b0-68fe-4358-ac7c-7d6e27267fe9 (non-flash) Jul 03 09:46:10.265596 np0000004400 cinder-backup[101319]: tcp: [82] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-76320525-737e-4f58-8523-63ec9abbdc64 (non-flash) Jul 03 09:46:10.265596 np0000004400 cinder-backup[101319]: tcp: [83] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-76320525-737e-4f58-8523-63ec9abbdc64 (non-flash) Jul 03 09:46:10.265596 np0000004400 cinder-backup[101319]: tcp: [97] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d47f5d2f-dce5-42f7-a693-a654fd702622 (non-flash) Jul 03 09:46:10.265596 np0000004400 cinder-backup[101319]: tcp: [98] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d47f5d2f-dce5-42f7-a693-a654fd702622 (non-flash) Jul 03 09:46:10.265596 np0000004400 cinder-backup[101319]: stderr= {{(pid=101319) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jul 03 09:46:10.265882 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-9e4652d9-7b88-4965-aef2-2c42a95e107c tempest-ProjectAdminTests33-1900627284 None] iscsi session list stdout=tcp: [110] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6713aeef-c919-4102-a884-a71545173837 (non-flash) Jul 03 09:46:10.265882 np0000004400 cinder-backup[101319]: tcp: [111] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-6713aeef-c919-4102-a884-a71545173837 (non-flash) Jul 03 09:46:10.265882 np0000004400 cinder-backup[101319]: tcp: [112] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-bcfdc9b0-68fe-4358-ac7c-7d6e27267fe9 (non-flash) Jul 03 09:46:10.265882 np0000004400 cinder-backup[101319]: tcp: [82] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-76320525-737e-4f58-8523-63ec9abbdc64 (non-flash) Jul 03 09:46:10.265882 np0000004400 cinder-backup[101319]: tcp: [83] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-76320525-737e-4f58-8523-63ec9abbdc64 (non-flash) Jul 03 09:46:10.265882 np0000004400 cinder-backup[101319]: tcp: [97] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d47f5d2f-dce5-42f7-a693-a654fd702622 (non-flash) Jul 03 09:46:10.265882 np0000004400 cinder-backup[101319]: tcp: [98] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d47f5d2f-dce5-42f7-a693-a654fd702622 (non-flash) Jul 03 09:46:10.265882 np0000004400 cinder-backup[101319]: stderr= {{(pid=101319) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jul 03 09:46:10.266060 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.base [None req-9e4652d9-7b88-4965-aef2-2c42a95e107c tempest-ProjectAdminTests33-1900627284 None] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-bcfdc9b0-68fe-4358-ac7c-7d6e27267fe9" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.125s {{(pid=101319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jul 03 09:46:10.266186 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-9e4652d9-7b88-4965-aef2-2c42a95e107c tempest-ProjectAdminTests33-1900627284 None] Connected to 192.168.40.100:3260 {{(pid=101319) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}} Jul 03 09:46:10.266972 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.linuxscsi [None req-9e4652d9-7b88-4965-aef2-2c42a95e107c tempest-ProjectAdminTests33-1900627284 None] HCTL ('7', '-', '-', 0) found on session 112 with lun 0 {{(pid=101319) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}} Jul 03 09:46:10.267101 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.linuxscsi [None req-9e4652d9-7b88-4965-aef2-2c42a95e107c tempest-ProjectAdminTests33-1900627284 None] Scanning host 7 c: -, t: -, l: 0) {{(pid=101319) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}} Jul 03 09:46:10.280863 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.linuxscsi [None req-9e4652d9-7b88-4965-aef2-2c42a95e107c tempest-ProjectAdminTests33-1900627284 None] Searching for a device in session 112 and hctl ['7', '*', '*', 0] yield: sdb {{(pid=101319) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}} Jul 03 09:46:10.281053 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-9e4652d9-7b88-4965-aef2-2c42a95e107c tempest-ProjectAdminTests33-1900627284 None] Connected to sdb using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-bcfdc9b0-68fe-4358-ac7c-7d6e27267fe9', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'bcfdc9b0-68fe-4358-ac7c-7d6e27267fe9', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': False} {{(pid=101319) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}} Jul 03 09:46:11.183788 np0000004400 cinder-backup[101319]: DEBUG oslo_db.sqlalchemy.engines [None req-c3c8d3a9-3541-41d7-9916-9ce1f91f0d1c None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=101319) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 03 09:46:11.284997 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.base [None req-9e4652d9-7b88-4965-aef2-2c42a95e107c tempest-ProjectAdminTests33-1900627284 None] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 2.154s {{(pid=101319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jul 03 09:46:11.285170 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-9e4652d9-7b88-4965-aef2-2c42a95e107c tempest-ProjectAdminTests33-1900627284 None] <== connect_volume: return (2155ms) {'type': 'block', 'scsi_wwn': 'SStorPool_iSCSI_DISK_1034578903445799048', 'path': '/dev/sdb'} {{(pid=101319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}} Jul 03 09:46:11.285527 np0000004400 cinder-backup[101319]: DEBUG oslo_concurrency.processutils [None req-9e4652d9-7b88-4965-aef2-2c42a95e107c tempest-ProjectAdminTests33-1900627284 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chown 1002 /dev/sdb {{(pid=101319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 09:46:11.305010 np0000004400 sudo[138206]: stack : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chown 1002 /dev/sdb Jul 03 09:46:11.305659 np0000004400 sudo[138206]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1002) Jul 03 09:46:11.626810 np0000004400 sudo[138206]: pam_unix(sudo:session): session closed for user root Jul 03 09:46:11.628914 np0000004400 cinder-backup[101319]: DEBUG oslo_concurrency.processutils [None req-9e4652d9-7b88-4965-aef2-2c42a95e107c tempest-ProjectAdminTests33-1900627284 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chown 1002 /dev/sdb" returned: 0 in 0.343s {{(pid=101319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 09:46:11.638110 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-9e4652d9-7b88-4965-aef2-2c42a95e107c tempest-ProjectAdminTests33-1900627284 None] _create_container started, container: volumebackups,backup: 3e013368-c720-4dd1-96fd-358ab8abaea3. {{(pid=101319) _create_container /opt/stack/cinder/cinder/backup/chunkeddriver.py:249}} Jul 03 09:46:11.685576 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.drivers.swift [None req-9e4652d9-7b88-4965-aef2-2c42a95e107c tempest-ProjectAdminTests33-1900627284 None] generate_object_name_prefix: volume_bcfdc9b0-68fe-4358-ac7c-7d6e27267fe9/20260703094611/az_nova_backup_3e013368-c720-4dd1-96fd-358ab8abaea3 {{(pid=101319) _generate_object_name_prefix /opt/stack/cinder/cinder/backup/drivers/swift.py:452}} Jul 03 09:46:11.696042 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-9e4652d9-7b88-4965-aef2-2c42a95e107c tempest-ProjectAdminTests33-1900627284 None] starting backup of volume: bcfdc9b0-68fe-4358-ac7c-7d6e27267fe9, volume size: 1073741824, object names prefix volume_bcfdc9b0-68fe-4358-ac7c-7d6e27267fe9/20260703094611/az_nova_backup_3e013368-c720-4dd1-96fd-358ab8abaea3, availability zone: nova {{(pid=101319) _prepare_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:359}} Jul 03 09:46:11.914272 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-9e4652d9-7b88-4965-aef2-2c42a95e107c tempest-ProjectAdminTests33-1900627284 None] Backing up chunk of data from volume. {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 09:46:12.162867 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-9e4652d9-7b88-4965-aef2-2c42a95e107c tempest-ProjectAdminTests33-1900627284 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101319) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 09:46:12.163024 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-9e4652d9-7b88-4965-aef2-2c42a95e107c tempest-ProjectAdminTests33-1900627284 None] About to put_object {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 09:46:12.285192 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-9e4652d9-7b88-4965-aef2-2c42a95e107c tempest-ProjectAdminTests33-1900627284 None] backup MD5 for volume_bcfdc9b0-68fe-4358-ac7c-7d6e27267fe9/20260703094611/az_nova_backup_3e013368-c720-4dd1-96fd-358ab8abaea3-00001: 25e317773f308e446cc84c503a6d1f85 {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 09:46:12.285622 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-9e4652d9-7b88-4965-aef2-2c42a95e107c tempest-ProjectAdminTests33-1900627284 None] Calling eventlet.sleep(0) {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 09:46:12.502419 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-9e4652d9-7b88-4965-aef2-2c42a95e107c tempest-ProjectAdminTests33-1900627284 None] Backing up chunk of data from volume. {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 09:46:12.757137 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-9e4652d9-7b88-4965-aef2-2c42a95e107c tempest-ProjectAdminTests33-1900627284 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101319) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 09:46:12.757328 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-9e4652d9-7b88-4965-aef2-2c42a95e107c tempest-ProjectAdminTests33-1900627284 None] About to put_object {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 09:46:12.881285 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-9e4652d9-7b88-4965-aef2-2c42a95e107c tempest-ProjectAdminTests33-1900627284 None] backup MD5 for volume_bcfdc9b0-68fe-4358-ac7c-7d6e27267fe9/20260703094611/az_nova_backup_3e013368-c720-4dd1-96fd-358ab8abaea3-00002: 25e317773f308e446cc84c503a6d1f85 {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 09:46:12.881453 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-9e4652d9-7b88-4965-aef2-2c42a95e107c tempest-ProjectAdminTests33-1900627284 None] Calling eventlet.sleep(0) {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 09:46:13.102182 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-9e4652d9-7b88-4965-aef2-2c42a95e107c tempest-ProjectAdminTests33-1900627284 None] Backing up chunk of data from volume. {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 09:46:13.349815 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-9e4652d9-7b88-4965-aef2-2c42a95e107c tempest-ProjectAdminTests33-1900627284 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101319) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 09:46:13.349815 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-9e4652d9-7b88-4965-aef2-2c42a95e107c tempest-ProjectAdminTests33-1900627284 None] About to put_object {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 09:46:13.476536 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-9e4652d9-7b88-4965-aef2-2c42a95e107c tempest-ProjectAdminTests33-1900627284 None] backup MD5 for volume_bcfdc9b0-68fe-4358-ac7c-7d6e27267fe9/20260703094611/az_nova_backup_3e013368-c720-4dd1-96fd-358ab8abaea3-00003: 25e317773f308e446cc84c503a6d1f85 {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 09:46:13.476749 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-9e4652d9-7b88-4965-aef2-2c42a95e107c tempest-ProjectAdminTests33-1900627284 None] Calling eventlet.sleep(0) {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 09:46:13.676188 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-9e4652d9-7b88-4965-aef2-2c42a95e107c tempest-ProjectAdminTests33-1900627284 None] Backing up chunk of data from volume. {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 09:46:13.923388 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-9e4652d9-7b88-4965-aef2-2c42a95e107c tempest-ProjectAdminTests33-1900627284 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101319) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 09:46:13.923650 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-9e4652d9-7b88-4965-aef2-2c42a95e107c tempest-ProjectAdminTests33-1900627284 None] About to put_object {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 09:46:14.029893 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-9e4652d9-7b88-4965-aef2-2c42a95e107c tempest-ProjectAdminTests33-1900627284 None] backup MD5 for volume_bcfdc9b0-68fe-4358-ac7c-7d6e27267fe9/20260703094611/az_nova_backup_3e013368-c720-4dd1-96fd-358ab8abaea3-00004: 25e317773f308e446cc84c503a6d1f85 {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 09:46:14.030188 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-9e4652d9-7b88-4965-aef2-2c42a95e107c tempest-ProjectAdminTests33-1900627284 None] Calling eventlet.sleep(0) {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 09:46:14.219300 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-9e4652d9-7b88-4965-aef2-2c42a95e107c tempest-ProjectAdminTests33-1900627284 None] Backing up chunk of data from volume. {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 09:46:14.466035 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-9e4652d9-7b88-4965-aef2-2c42a95e107c tempest-ProjectAdminTests33-1900627284 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101319) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 09:46:14.468909 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-9e4652d9-7b88-4965-aef2-2c42a95e107c tempest-ProjectAdminTests33-1900627284 None] About to put_object {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 09:46:14.572680 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-9e4652d9-7b88-4965-aef2-2c42a95e107c tempest-ProjectAdminTests33-1900627284 None] backup MD5 for volume_bcfdc9b0-68fe-4358-ac7c-7d6e27267fe9/20260703094611/az_nova_backup_3e013368-c720-4dd1-96fd-358ab8abaea3-00005: 25e317773f308e446cc84c503a6d1f85 {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 09:46:14.572680 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-9e4652d9-7b88-4965-aef2-2c42a95e107c tempest-ProjectAdminTests33-1900627284 None] Calling eventlet.sleep(0) {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 09:46:14.759140 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-9e4652d9-7b88-4965-aef2-2c42a95e107c tempest-ProjectAdminTests33-1900627284 None] Backing up chunk of data from volume. {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 09:46:15.011940 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-9e4652d9-7b88-4965-aef2-2c42a95e107c tempest-ProjectAdminTests33-1900627284 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101319) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 09:46:15.012723 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-9e4652d9-7b88-4965-aef2-2c42a95e107c tempest-ProjectAdminTests33-1900627284 None] About to put_object {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 09:46:15.134539 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-9e4652d9-7b88-4965-aef2-2c42a95e107c tempest-ProjectAdminTests33-1900627284 None] backup MD5 for volume_bcfdc9b0-68fe-4358-ac7c-7d6e27267fe9/20260703094611/az_nova_backup_3e013368-c720-4dd1-96fd-358ab8abaea3-00006: 25e317773f308e446cc84c503a6d1f85 {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 09:46:15.134539 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-9e4652d9-7b88-4965-aef2-2c42a95e107c tempest-ProjectAdminTests33-1900627284 None] Calling eventlet.sleep(0) {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 09:46:15.329745 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-9e4652d9-7b88-4965-aef2-2c42a95e107c tempest-ProjectAdminTests33-1900627284 None] Backing up chunk of data from volume. {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 09:46:15.589852 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-9e4652d9-7b88-4965-aef2-2c42a95e107c tempest-ProjectAdminTests33-1900627284 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101319) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 09:46:15.590671 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-9e4652d9-7b88-4965-aef2-2c42a95e107c tempest-ProjectAdminTests33-1900627284 None] About to put_object {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 09:46:15.705635 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-9e4652d9-7b88-4965-aef2-2c42a95e107c tempest-ProjectAdminTests33-1900627284 None] backup MD5 for volume_bcfdc9b0-68fe-4358-ac7c-7d6e27267fe9/20260703094611/az_nova_backup_3e013368-c720-4dd1-96fd-358ab8abaea3-00007: 25e317773f308e446cc84c503a6d1f85 {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 09:46:15.706061 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-9e4652d9-7b88-4965-aef2-2c42a95e107c tempest-ProjectAdminTests33-1900627284 None] Calling eventlet.sleep(0) {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 09:46:15.903162 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-9e4652d9-7b88-4965-aef2-2c42a95e107c tempest-ProjectAdminTests33-1900627284 None] Backing up chunk of data from volume. {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 09:46:16.149865 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-9e4652d9-7b88-4965-aef2-2c42a95e107c tempest-ProjectAdminTests33-1900627284 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101319) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 09:46:16.149865 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-9e4652d9-7b88-4965-aef2-2c42a95e107c tempest-ProjectAdminTests33-1900627284 None] About to put_object {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 09:46:16.264527 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-9e4652d9-7b88-4965-aef2-2c42a95e107c tempest-ProjectAdminTests33-1900627284 None] backup MD5 for volume_bcfdc9b0-68fe-4358-ac7c-7d6e27267fe9/20260703094611/az_nova_backup_3e013368-c720-4dd1-96fd-358ab8abaea3-00008: 25e317773f308e446cc84c503a6d1f85 {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 09:46:16.264527 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-9e4652d9-7b88-4965-aef2-2c42a95e107c tempest-ProjectAdminTests33-1900627284 None] Calling eventlet.sleep(0) {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 09:46:16.456942 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-9e4652d9-7b88-4965-aef2-2c42a95e107c tempest-ProjectAdminTests33-1900627284 None] Backing up chunk of data from volume. {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 09:46:16.739146 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-9e4652d9-7b88-4965-aef2-2c42a95e107c tempest-ProjectAdminTests33-1900627284 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101319) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 09:46:16.739146 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-9e4652d9-7b88-4965-aef2-2c42a95e107c tempest-ProjectAdminTests33-1900627284 None] About to put_object {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 09:46:16.860990 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-9e4652d9-7b88-4965-aef2-2c42a95e107c tempest-ProjectAdminTests33-1900627284 None] backup MD5 for volume_bcfdc9b0-68fe-4358-ac7c-7d6e27267fe9/20260703094611/az_nova_backup_3e013368-c720-4dd1-96fd-358ab8abaea3-00009: 25e317773f308e446cc84c503a6d1f85 {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 09:46:16.861182 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-9e4652d9-7b88-4965-aef2-2c42a95e107c tempest-ProjectAdminTests33-1900627284 None] Calling eventlet.sleep(0) {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 09:46:17.043742 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-9e4652d9-7b88-4965-aef2-2c42a95e107c tempest-ProjectAdminTests33-1900627284 None] Backing up chunk of data from volume. {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 09:46:17.297906 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-9e4652d9-7b88-4965-aef2-2c42a95e107c tempest-ProjectAdminTests33-1900627284 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101319) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 09:46:17.298106 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-9e4652d9-7b88-4965-aef2-2c42a95e107c tempest-ProjectAdminTests33-1900627284 None] About to put_object {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 09:46:17.403054 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-9e4652d9-7b88-4965-aef2-2c42a95e107c tempest-ProjectAdminTests33-1900627284 None] backup MD5 for volume_bcfdc9b0-68fe-4358-ac7c-7d6e27267fe9/20260703094611/az_nova_backup_3e013368-c720-4dd1-96fd-358ab8abaea3-00010: 25e317773f308e446cc84c503a6d1f85 {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 09:46:17.403237 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-9e4652d9-7b88-4965-aef2-2c42a95e107c tempest-ProjectAdminTests33-1900627284 None] Calling eventlet.sleep(0) {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 09:46:17.584509 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-9e4652d9-7b88-4965-aef2-2c42a95e107c tempest-ProjectAdminTests33-1900627284 None] Backing up chunk of data from volume. {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 09:46:17.824395 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-9e4652d9-7b88-4965-aef2-2c42a95e107c tempest-ProjectAdminTests33-1900627284 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101319) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 09:46:17.824760 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-9e4652d9-7b88-4965-aef2-2c42a95e107c tempest-ProjectAdminTests33-1900627284 None] About to put_object {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 09:46:17.926203 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-9e4652d9-7b88-4965-aef2-2c42a95e107c tempest-ProjectAdminTests33-1900627284 None] backup MD5 for volume_bcfdc9b0-68fe-4358-ac7c-7d6e27267fe9/20260703094611/az_nova_backup_3e013368-c720-4dd1-96fd-358ab8abaea3-00011: 25e317773f308e446cc84c503a6d1f85 {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 09:46:17.926382 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-9e4652d9-7b88-4965-aef2-2c42a95e107c tempest-ProjectAdminTests33-1900627284 None] Calling eventlet.sleep(0) {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 09:46:18.127925 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-9e4652d9-7b88-4965-aef2-2c42a95e107c tempest-ProjectAdminTests33-1900627284 None] Backing up chunk of data from volume. {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 09:46:18.390259 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-9e4652d9-7b88-4965-aef2-2c42a95e107c tempest-ProjectAdminTests33-1900627284 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101319) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 09:46:18.390259 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-9e4652d9-7b88-4965-aef2-2c42a95e107c tempest-ProjectAdminTests33-1900627284 None] About to put_object {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 09:46:18.501474 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-9e4652d9-7b88-4965-aef2-2c42a95e107c tempest-ProjectAdminTests33-1900627284 None] backup MD5 for volume_bcfdc9b0-68fe-4358-ac7c-7d6e27267fe9/20260703094611/az_nova_backup_3e013368-c720-4dd1-96fd-358ab8abaea3-00012: 25e317773f308e446cc84c503a6d1f85 {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 09:46:18.501625 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-9e4652d9-7b88-4965-aef2-2c42a95e107c tempest-ProjectAdminTests33-1900627284 None] Calling eventlet.sleep(0) {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 09:46:18.690949 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-9e4652d9-7b88-4965-aef2-2c42a95e107c tempest-ProjectAdminTests33-1900627284 None] Backing up chunk of data from volume. {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 09:46:18.955906 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-9e4652d9-7b88-4965-aef2-2c42a95e107c tempest-ProjectAdminTests33-1900627284 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101319) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 09:46:18.956436 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-9e4652d9-7b88-4965-aef2-2c42a95e107c tempest-ProjectAdminTests33-1900627284 None] About to put_object {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 09:46:19.073152 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-9e4652d9-7b88-4965-aef2-2c42a95e107c tempest-ProjectAdminTests33-1900627284 None] backup MD5 for volume_bcfdc9b0-68fe-4358-ac7c-7d6e27267fe9/20260703094611/az_nova_backup_3e013368-c720-4dd1-96fd-358ab8abaea3-00013: 25e317773f308e446cc84c503a6d1f85 {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 09:46:19.073352 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-9e4652d9-7b88-4965-aef2-2c42a95e107c tempest-ProjectAdminTests33-1900627284 None] Calling eventlet.sleep(0) {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 09:46:19.263377 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-9e4652d9-7b88-4965-aef2-2c42a95e107c tempest-ProjectAdminTests33-1900627284 None] Backing up chunk of data from volume. {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 09:46:19.510264 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-9e4652d9-7b88-4965-aef2-2c42a95e107c tempest-ProjectAdminTests33-1900627284 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101319) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 09:46:19.510411 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-9e4652d9-7b88-4965-aef2-2c42a95e107c tempest-ProjectAdminTests33-1900627284 None] About to put_object {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 09:46:19.614488 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-9e4652d9-7b88-4965-aef2-2c42a95e107c tempest-ProjectAdminTests33-1900627284 None] backup MD5 for volume_bcfdc9b0-68fe-4358-ac7c-7d6e27267fe9/20260703094611/az_nova_backup_3e013368-c720-4dd1-96fd-358ab8abaea3-00014: 25e317773f308e446cc84c503a6d1f85 {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 09:46:19.614642 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-9e4652d9-7b88-4965-aef2-2c42a95e107c tempest-ProjectAdminTests33-1900627284 None] Calling eventlet.sleep(0) {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 09:46:19.822794 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-9e4652d9-7b88-4965-aef2-2c42a95e107c tempest-ProjectAdminTests33-1900627284 None] Backing up chunk of data from volume. {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 09:46:20.077578 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-9e4652d9-7b88-4965-aef2-2c42a95e107c tempest-ProjectAdminTests33-1900627284 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101319) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 09:46:20.077972 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-9e4652d9-7b88-4965-aef2-2c42a95e107c tempest-ProjectAdminTests33-1900627284 None] About to put_object {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 09:46:20.183555 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-9e4652d9-7b88-4965-aef2-2c42a95e107c tempest-ProjectAdminTests33-1900627284 None] backup MD5 for volume_bcfdc9b0-68fe-4358-ac7c-7d6e27267fe9/20260703094611/az_nova_backup_3e013368-c720-4dd1-96fd-358ab8abaea3-00015: 25e317773f308e446cc84c503a6d1f85 {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 09:46:20.183779 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-9e4652d9-7b88-4965-aef2-2c42a95e107c tempest-ProjectAdminTests33-1900627284 None] Calling eventlet.sleep(0) {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 09:46:20.379294 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-9e4652d9-7b88-4965-aef2-2c42a95e107c tempest-ProjectAdminTests33-1900627284 None] Backing up chunk of data from volume. {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 09:46:20.647709 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-9e4652d9-7b88-4965-aef2-2c42a95e107c tempest-ProjectAdminTests33-1900627284 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101319) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 09:46:20.647889 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-9e4652d9-7b88-4965-aef2-2c42a95e107c tempest-ProjectAdminTests33-1900627284 None] About to put_object {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 09:46:20.759250 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-9e4652d9-7b88-4965-aef2-2c42a95e107c tempest-ProjectAdminTests33-1900627284 None] backup MD5 for volume_bcfdc9b0-68fe-4358-ac7c-7d6e27267fe9/20260703094611/az_nova_backup_3e013368-c720-4dd1-96fd-358ab8abaea3-00016: 25e317773f308e446cc84c503a6d1f85 {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 09:46:20.759399 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-9e4652d9-7b88-4965-aef2-2c42a95e107c tempest-ProjectAdminTests33-1900627284 None] Calling eventlet.sleep(0) {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 09:46:20.942763 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-9e4652d9-7b88-4965-aef2-2c42a95e107c tempest-ProjectAdminTests33-1900627284 None] Backing up chunk of data from volume. {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 09:46:21.211199 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-9e4652d9-7b88-4965-aef2-2c42a95e107c tempest-ProjectAdminTests33-1900627284 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101319) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 09:46:21.211668 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-9e4652d9-7b88-4965-aef2-2c42a95e107c tempest-ProjectAdminTests33-1900627284 None] About to put_object {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 09:46:21.317552 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-9e4652d9-7b88-4965-aef2-2c42a95e107c tempest-ProjectAdminTests33-1900627284 None] backup MD5 for volume_bcfdc9b0-68fe-4358-ac7c-7d6e27267fe9/20260703094611/az_nova_backup_3e013368-c720-4dd1-96fd-358ab8abaea3-00017: 25e317773f308e446cc84c503a6d1f85 {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 09:46:21.317786 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-9e4652d9-7b88-4965-aef2-2c42a95e107c tempest-ProjectAdminTests33-1900627284 None] Calling eventlet.sleep(0) {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 09:46:21.503372 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-9e4652d9-7b88-4965-aef2-2c42a95e107c tempest-ProjectAdminTests33-1900627284 None] Backing up chunk of data from volume. {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 09:46:21.754157 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-9e4652d9-7b88-4965-aef2-2c42a95e107c tempest-ProjectAdminTests33-1900627284 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101319) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 09:46:21.754353 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-9e4652d9-7b88-4965-aef2-2c42a95e107c tempest-ProjectAdminTests33-1900627284 None] About to put_object {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 09:46:21.871811 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-9e4652d9-7b88-4965-aef2-2c42a95e107c tempest-ProjectAdminTests33-1900627284 None] backup MD5 for volume_bcfdc9b0-68fe-4358-ac7c-7d6e27267fe9/20260703094611/az_nova_backup_3e013368-c720-4dd1-96fd-358ab8abaea3-00018: 25e317773f308e446cc84c503a6d1f85 {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 09:46:21.871989 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-9e4652d9-7b88-4965-aef2-2c42a95e107c tempest-ProjectAdminTests33-1900627284 None] Calling eventlet.sleep(0) {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 09:46:22.064117 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-9e4652d9-7b88-4965-aef2-2c42a95e107c tempest-ProjectAdminTests33-1900627284 None] Backing up chunk of data from volume. {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 09:46:22.319159 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-9e4652d9-7b88-4965-aef2-2c42a95e107c tempest-ProjectAdminTests33-1900627284 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101319) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 09:46:22.319830 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-9e4652d9-7b88-4965-aef2-2c42a95e107c tempest-ProjectAdminTests33-1900627284 None] About to put_object {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 09:46:22.431919 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-9e4652d9-7b88-4965-aef2-2c42a95e107c tempest-ProjectAdminTests33-1900627284 None] backup MD5 for volume_bcfdc9b0-68fe-4358-ac7c-7d6e27267fe9/20260703094611/az_nova_backup_3e013368-c720-4dd1-96fd-358ab8abaea3-00019: 25e317773f308e446cc84c503a6d1f85 {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 09:46:22.432091 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-9e4652d9-7b88-4965-aef2-2c42a95e107c tempest-ProjectAdminTests33-1900627284 None] Calling eventlet.sleep(0) {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 09:46:22.630055 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-9e4652d9-7b88-4965-aef2-2c42a95e107c tempest-ProjectAdminTests33-1900627284 None] Backing up chunk of data from volume. {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 09:46:22.886087 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-9e4652d9-7b88-4965-aef2-2c42a95e107c tempest-ProjectAdminTests33-1900627284 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101319) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 09:46:22.886155 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-9e4652d9-7b88-4965-aef2-2c42a95e107c tempest-ProjectAdminTests33-1900627284 None] About to put_object {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 09:46:23.011689 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-9e4652d9-7b88-4965-aef2-2c42a95e107c tempest-ProjectAdminTests33-1900627284 None] backup MD5 for volume_bcfdc9b0-68fe-4358-ac7c-7d6e27267fe9/20260703094611/az_nova_backup_3e013368-c720-4dd1-96fd-358ab8abaea3-00020: 25e317773f308e446cc84c503a6d1f85 {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 09:46:23.011850 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-9e4652d9-7b88-4965-aef2-2c42a95e107c tempest-ProjectAdminTests33-1900627284 None] Calling eventlet.sleep(0) {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 09:46:23.134123 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-9e4652d9-7b88-4965-aef2-2c42a95e107c tempest-ProjectAdminTests33-1900627284 None] Backing up chunk of data from volume. {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 09:46:23.275694 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-9e4652d9-7b88-4965-aef2-2c42a95e107c tempest-ProjectAdminTests33-1900627284 None] Compressed 25165824 bytes of data to 24470 bytes using zlib. {{(pid=101319) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 09:46:23.275916 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-9e4652d9-7b88-4965-aef2-2c42a95e107c tempest-ProjectAdminTests33-1900627284 None] About to put_object {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 09:46:23.361310 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-9e4652d9-7b88-4965-aef2-2c42a95e107c tempest-ProjectAdminTests33-1900627284 None] backup MD5 for volume_bcfdc9b0-68fe-4358-ac7c-7d6e27267fe9/20260703094611/az_nova_backup_3e013368-c720-4dd1-96fd-358ab8abaea3-00021: 77377273b0a4b61febdbf7bbf52b9db9 {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 09:46:23.361716 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-9e4652d9-7b88-4965-aef2-2c42a95e107c tempest-ProjectAdminTests33-1900627284 None] Calling eventlet.sleep(0) {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 09:46:23.373534 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.driver [None req-9e4652d9-7b88-4965-aef2-2c42a95e107c tempest-ProjectAdminTests33-1900627284 None] Getting metadata type 'volume-base-metadata' {{(pid=101319) _save_vol_base_meta /opt/stack/cinder/cinder/backup/driver.py:79}} Jul 03 09:46:23.379710 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.driver [None req-9e4652d9-7b88-4965-aef2-2c42a95e107c tempest-ProjectAdminTests33-1900627284 None] Completed fetching metadata type 'volume-base-metadata' {{(pid=101319) _save_vol_base_meta /opt/stack/cinder/cinder/backup/driver.py:98}} Jul 03 09:46:23.379975 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.driver [None req-9e4652d9-7b88-4965-aef2-2c42a95e107c tempest-ProjectAdminTests33-1900627284 None] Getting metadata type 'volume-metadata' {{(pid=101319) _save_vol_meta /opt/stack/cinder/cinder/backup/driver.py:109}} Jul 03 09:46:23.385096 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.driver [None req-9e4652d9-7b88-4965-aef2-2c42a95e107c tempest-ProjectAdminTests33-1900627284 None] No metadata type 'volume-metadata' available {{(pid=101319) _save_vol_meta /opt/stack/cinder/cinder/backup/driver.py:123}} Jul 03 09:46:23.385317 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.driver [None req-9e4652d9-7b88-4965-aef2-2c42a95e107c tempest-ProjectAdminTests33-1900627284 None] Getting metadata type 'volume-glance-metadata' {{(pid=101319) _save_vol_glance_meta /opt/stack/cinder/cinder/backup/driver.py:132}} Jul 03 09:46:23.388424 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.driver [None req-9e4652d9-7b88-4965-aef2-2c42a95e107c tempest-ProjectAdminTests33-1900627284 None] No metadata type 'volume-glance-metadata' available {{(pid=101319) _save_vol_glance_meta /opt/stack/cinder/cinder/backup/driver.py:147}} Jul 03 09:46:23.390315 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-9e4652d9-7b88-4965-aef2-2c42a95e107c tempest-ProjectAdminTests33-1900627284 None] _write_sha256file started, container name: volumebackups, sha256file filename: volume_bcfdc9b0-68fe-4358-ac7c-7d6e27267fe9/20260703094611/az_nova_backup_3e013368-c720-4dd1-96fd-358ab8abaea3_sha256file. {{(pid=101319) _write_sha256file /opt/stack/cinder/cinder/backup/chunkeddriver.py:299}} Jul 03 09:46:23.458335 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-9e4652d9-7b88-4965-aef2-2c42a95e107c tempest-ProjectAdminTests33-1900627284 None] _write_sha256file finished. {{(pid=101319) _write_sha256file /opt/stack/cinder/cinder/backup/chunkeddriver.py:315}} Jul 03 09:46:23.459144 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-9e4652d9-7b88-4965-aef2-2c42a95e107c tempest-ProjectAdminTests33-1900627284 None] _write_metadata started, container name: volumebackups, metadata filename: volume_bcfdc9b0-68fe-4358-ac7c-7d6e27267fe9/20260703094611/az_nova_backup_3e013368-c720-4dd1-96fd-358ab8abaea3_metadata. {{(pid=101319) _write_metadata /opt/stack/cinder/cinder/backup/chunkeddriver.py:276}} Jul 03 09:46:23.490007 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-9e4652d9-7b88-4965-aef2-2c42a95e107c tempest-ProjectAdminTests33-1900627284 None] _write_metadata finished. Metadata: b'{\n "backup_description": null,\n "backup_id": "3e013368-c720-4dd1-96fd-358ab8abaea3",\n "backup_name": "tempest-type-Backup-1781984812",\n "created_at": "2026-07-03 09:46:08+00:00",\n "objects": [\n {\n "volume_bcfdc9b0-68fe-4358-ac7c-7d6e27267fe9/20260703094611/az_nova_backup_3e013368-c720-4dd1-96fd-358ab8abaea3-00001": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 0\n }\n },\n {\n "volume_bcfdc9b0-68fe-4358-ac7c-7d6e27267fe9/20260703094611/az_nova_backup_3e013368-c720-4dd1-96fd-358ab8abaea3-00002": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 52428800\n }\n },\n {\n "volume_bcfdc9b0-68fe-4358-ac7c-7d6e27267fe9/20260703094611/az_nova_backup_3e013368-c720-4dd1-96fd-358ab8abaea3-00003": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 104857600\n }\n },\n {\n "volume_bcfdc9b0-68fe-4358-ac7c-7d6e27267fe9/20260703094611/az_nova_backup_3e013368-c720-4dd1-96fd-358ab8abaea3-00004": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 157286400\n }\n },\n {\n "volume_bcfdc9b0-68fe-4358-ac7c-7d6e27267fe9/20260703094611/az_nova_backup_3e013368-c720-4dd1-96fd-358ab8abaea3-00005": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 209715200\n }\n },\n {\n "volume_bcfdc9b0-68fe-4358-ac7c-7d6e27267fe9/20260703094611/az_nova_backup_3e013368-c720-4dd1-96fd-358ab8abaea3-00006": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 262144000\n }\n },\n {\n "volume_bcfdc9b0-68fe-4358-ac7c-7d6e27267fe9/20260703094611/az_nova_backup_3e013368-c720-4dd1-96fd-358ab8abaea3-00007": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 314572800\n }\n },\n {\n "volume_bcfdc9b0-68fe-4358-ac7c-7d6e27267fe9/20260703094611/az_nova_backup_3e013368-c720-4dd1-96fd-358ab8abaea3-00008": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 367001600\n }\n },\n {\n "volume_bcfdc9b0-68fe-4358-ac7c-7d6e27267fe9/20260703094611/az_nova_backup_3e013368-c720-4dd1-96fd-358ab8abaea3-00009": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 419430400\n }\n },\n {\n "volume_bcfdc9b0-68fe-4358-ac7c-7d6e27267fe9/20260703094611/az_nova_backup_3e013368-c720-4dd1-96fd-358ab8abaea3-00010": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 471859200\n }\n },\n {\n "volume_bcfdc9b0-68fe-4358-ac7c-7d6e27267fe9/20260703094611/az_nova_backup_3e013368-c720-4dd1-96fd-358ab8abaea3-00011": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 524288000\n }\n },\n {\n "volume_bcfdc9b0-68fe-4358-ac7c-7d6e27267fe9/20260703094611/az_nova_backup_3e013368-c720-4dd1-96fd-358ab8abaea3-00012": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 576716800\n }\n },\n {\n "volume_bcfdc9b0-68fe-4358-ac7c-7d6e27267fe9/20260703094611/az_nova_backup_3e013368-c720-4dd1-96fd-358ab8abaea3-00013": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 629145600\n }\n },\n {\n "volume_bcfdc9b0-68fe-4358-ac7c-7d6e27267fe9/20260703094611/az_nova_backup_3e013368-c720-4dd1-96fd-358ab8abaea3-00014": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 681574400\n }\n },\n {\n "volume_bcfdc9b0-68fe-4358-ac7c-7d6e27267fe9/20260703094611/az_nova_backup_3e013368-c720-4dd1-96fd-358ab8abaea3-00015": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 734003200\n }\n },\n {\n "volume_bcfdc9b0-68fe-4358-ac7c-7d6e27267fe9/20260703094611/az_nova_backup_3e013368-c720-4dd1-96fd-358ab8abaea3-00016": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 786432000\n }\n },\n {\n "volume_bcfdc9b0-68fe-4358-ac7c-7d6e27267fe9/20260703094611/az_nova_backup_3e013368-c720-4dd1-96fd-358ab8abaea3-00017": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 838860800\n }\n },\n {\n "volume_bcfdc9b0-68fe-4358-ac7c-7d6e27267fe9/20260703094611/az_nova_backup_3e013368-c720-4dd1-96fd-358ab8abaea3-00018": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 891289600\n }\n },\n {\n "volume_bcfdc9b0-68fe-4358-ac7c-7d6e27267fe9/20260703094611/az_nova_backup_3e013368-c720-4dd1-96fd-358ab8abaea3-00019": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 943718400\n }\n },\n {\n "volume_bcfdc9b0-68fe-4358-ac7c-7d6e27267fe9/20260703094611/az_nova_backup_3e013368-c720-4dd1-96fd-358ab8abaea3-00020": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 996147200\n }\n },\n {\n "volume_bcfdc9b0-68fe-4358-ac7c-7d6e27267fe9/20260703094611/az_nova_backup_3e013368-c720-4dd1-96fd-358ab8abaea3-00021": {\n "compression": "zlib",\n "length": 25165824,\n "md5": "77377273b0a4b61febdbf7bbf52b9db9",\n "offset": 1048576000\n }\n }\n ],\n "parent_id": null,\n "version": "1.0.0",\n "volume_id": "bcfdc9b0-68fe-4358-ac7c-7d6e27267fe9",\n "volume_meta": "{\\"version\\": 2, \\"volume-base-metadata\\": {\\"id\\": \\"bcfdc9b0-68fe-4358-ac7c-7d6e27267fe9\\", \\"_name_id\\": null, \\"use_quota\\": true, \\"ec2_id\\": null, \\"user_id\\": \\"23ba560f6eed465495956e82c26b6f69\\", \\"project_id\\": \\"a2309d0555a742279b4a5017d94ebf02\\", \\"snapshot_id\\": null, \\"cluster_name\\": null, \\"host\\": \\"np0000004400@storpool#default\\", \\"size\\": 1, \\"availability_zone\\": \\"nova\\", \\"status\\": \\"backing-up\\", \\"attach_status\\": \\"detached\\", \\"migration_status\\": null, \\"scheduled_at\\": \\"2026-07-03T09:46:07.000000\\", \\"launched_at\\": \\"2026-07-03T09:46:08.000000\\", \\"terminated_at\\": null, \\"display_name\\": \\"tempest-VolumeV3RbacBaseTests-Volume-839412920\\", \\"display_description\\": null, \\"provider_location\\": null, \\"provider_auth\\": null, \\"provider_geometry\\": null, \\"provider_id\\": null, \\"volume_type_id\\": \\"03e13fe6-0e30-4803-ace0-725d38e6dc24\\", \\"source_volid\\": null, \\"encryption_key_id\\": null, \\"consistencygroup_id\\": null, \\"group_id\\": null, \\"bootable\\": false, \\"multiattach\\": false, \\"replication_status\\": null, \\"replication_extended_status\\": null, \\"replication_driver_data\\": null, \\"previous_status\\": \\"available\\", \\"service_uuid\\": \\"6d4b0e79-fefe-4744-b25f-34be05095200\\", \\"shared_targets\\": true, \\"deleted_at\\": null, \\"deleted\\": false, \\"created_at\\": \\"2026-07-03T09:46:07.000000\\", \\"updated_at\\": \\"2026-07-03T09:46:08.000000\\"}}"\n}'. {{(pid=101319) _write_metadata /opt/stack/cinder/cinder/backup/chunkeddriver.py:295}} Jul 03 09:46:23.495175 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-9e4652d9-7b88-4965-aef2-2c42a95e107c tempest-ProjectAdminTests33-1900627284 None] backup 3e013368-c720-4dd1-96fd-358ab8abaea3 finished. {{(pid=101319) _finalize_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:462}} Jul 03 09:46:23.643150 np0000004400 cinder-backup[101319]: DEBUG oslo_concurrency.processutils [None req-9e4652d9-7b88-4965-aef2-2c42a95e107c tempest-ProjectAdminTests33-1900627284 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chown 0 /dev/sdb {{(pid=101319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 09:46:23.661443 np0000004400 sudo[138647]: stack : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chown 0 /dev/sdb Jul 03 09:46:23.662053 np0000004400 sudo[138647]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1002) Jul 03 09:46:23.954070 np0000004400 sudo[138647]: pam_unix(sudo:session): session closed for user root Jul 03 09:46:23.957387 np0000004400 cinder-backup[101319]: DEBUG oslo_concurrency.processutils [None req-9e4652d9-7b88-4965-aef2-2c42a95e107c tempest-ProjectAdminTests33-1900627284 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chown 0 /dev/sdb" returned: 0 in 0.313s {{(pid=101319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 09:46:23.957387 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-9e4652d9-7b88-4965-aef2-2c42a95e107c tempest-ProjectAdminTests33-1900627284 None] ==> disconnect_volume: call "{'args': (, {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-bcfdc9b0-68fe-4358-ac7c-7d6e27267fe9', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'bcfdc9b0-68fe-4358-ac7c-7d6e27267fe9', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': False}, {'type': 'block', 'scsi_wwn': 'SStorPool_iSCSI_DISK_1034578903445799048', 'path': '/dev/sdb'}), 'kwargs': {'force': True, 'ignore_errors': True}}" {{(pid=101319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}} Jul 03 09:46:23.957387 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.base [None req-9e4652d9-7b88-4965-aef2-2c42a95e107c tempest-ProjectAdminTests33-1900627284 None] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=101319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jul 03 09:46:23.957580 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.base [None req-9e4652d9-7b88-4965-aef2-2c42a95e107c tempest-ProjectAdminTests33-1900627284 None] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.000s {{(pid=101319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jul 03 09:46:23.957865 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-9e4652d9-7b88-4965-aef2-2c42a95e107c tempest-ProjectAdminTests33-1900627284 None] _get_connection_devices called with parameters: connection_properties={'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-bcfdc9b0-68fe-4358-ac7c-7d6e27267fe9', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'bcfdc9b0-68fe-4358-ac7c-7d6e27267fe9', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': False}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=101319) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:847}} Jul 03 09:46:23.969579 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-9e4652d9-7b88-4965-aef2-2c42a95e107c tempest-ProjectAdminTests33-1900627284 None] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS: Jul 03 09:46:23.969579 np0000004400 cinder-backup[101319]: No targets found. Jul 03 09:46:23.969579 np0000004400 cinder-backup[101319]: iSNS: Jul 03 09:46:23.969579 np0000004400 cinder-backup[101319]: No targets found. Jul 03 09:46:23.969579 np0000004400 cinder-backup[101319]: STATIC: Jul 03 09:46:23.969579 np0000004400 cinder-backup[101319]: Target: iqn.2023-03.storpool.com:os--volume-76320525-737e-4f58-8523-63ec9abbdc64 Jul 03 09:46:23.969579 np0000004400 cinder-backup[101319]: Portal: 192.168.50.100:3260,-1 Jul 03 09:46:23.969579 np0000004400 cinder-backup[101319]: Iface Name: default Jul 03 09:46:23.969579 np0000004400 cinder-backup[101319]: Portal: 192.168.40.100:3260,-1 Jul 03 09:46:23.969579 np0000004400 cinder-backup[101319]: Iface Name: default Jul 03 09:46:23.969579 np0000004400 cinder-backup[101319]: Target: iqn.2023-03.storpool.com:os--volume-72e07e1e-1567-4071-8204-c29cb26d2660 Jul 03 09:46:23.969579 np0000004400 cinder-backup[101319]: Portal: 192.168.50.100:3260,-1 Jul 03 09:46:23.969579 np0000004400 cinder-backup[101319]: Iface Name: default Jul 03 09:46:23.969579 np0000004400 cinder-backup[101319]: Portal: 192.168.40.100:3260,-1 Jul 03 09:46:23.969579 np0000004400 cinder-backup[101319]: Iface Name: default Jul 03 09:46:23.969579 np0000004400 cinder-backup[101319]: Target: iqn.2023-03.storpool.com:os--volume-bcfdc9b0-68fe-4358-ac7c-7d6e27267fe9 Jul 03 09:46:23.969579 np0000004400 cinder-backup[101319]: Portal: 192.168.40.100:3260,-1 Jul 03 09:46:23.969579 np0000004400 cinder-backup[101319]: Iface Name: default Jul 03 09:46:23.969579 np0000004400 cinder-backup[101319]: Target: iqn.2023-03.storpool.com:os--volume-d47f5d2f-dce5-42f7-a693-a654fd702622 Jul 03 09:46:23.969579 np0000004400 cinder-backup[101319]: Portal: 192.168.50.100:3260,-1 Jul 03 09:46:23.969579 np0000004400 cinder-backup[101319]: Iface Name: default Jul 03 09:46:23.969579 np0000004400 cinder-backup[101319]: Portal: 192.168.40.100:3260,-1 Jul 03 09:46:23.969579 np0000004400 cinder-backup[101319]: Iface Name: default Jul 03 09:46:23.969579 np0000004400 cinder-backup[101319]: Target: iqn.2023-03.storpool.com:os--volume-6713aeef-c919-4102-a884-a71545173837 Jul 03 09:46:23.969579 np0000004400 cinder-backup[101319]: Portal: 192.168.50.100:3260,-1 Jul 03 09:46:23.969579 np0000004400 cinder-backup[101319]: Iface Name: default Jul 03 09:46:23.969579 np0000004400 cinder-backup[101319]: Portal: 192.168.40.100:3260,-1 Jul 03 09:46:23.969579 np0000004400 cinder-backup[101319]: Iface Name: default Jul 03 09:46:23.969579 np0000004400 cinder-backup[101319]: FIRMWARE: Jul 03 09:46:23.969579 np0000004400 cinder-backup[101319]: No targets found. Jul 03 09:46:23.969579 np0000004400 cinder-backup[101319]: stderr= {{(pid=101319) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jul 03 09:46:23.970632 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-9e4652d9-7b88-4965-aef2-2c42a95e107c tempest-ProjectAdminTests33-1900627284 None] Regex to get portals from discoverydb: ^SENDTARGETS: Jul 03 09:46:23.970632 np0000004400 cinder-backup[101319]: .*?^DiscoveryAddress: 192.168.40.100,3260.*? Jul 03 09:46:23.970632 np0000004400 cinder-backup[101319]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=101319) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:390}} Jul 03 09:46:23.970632 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-9e4652d9-7b88-4965-aef2-2c42a95e107c tempest-ProjectAdminTests33-1900627284 None] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-bcfdc9b0-68fe-4358-ac7c-7d6e27267fe9', 0)] {{(pid=101319) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:858}} Jul 03 09:46:23.996429 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-9e4652d9-7b88-4965-aef2-2c42a95e107c tempest-ProjectAdminTests33-1900627284 None] iscsiadm ('-m', 'session'): stdout=tcp: [110] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6713aeef-c919-4102-a884-a71545173837 (non-flash) Jul 03 09:46:23.996429 np0000004400 cinder-backup[101319]: tcp: [111] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-6713aeef-c919-4102-a884-a71545173837 (non-flash) Jul 03 09:46:23.996429 np0000004400 cinder-backup[101319]: tcp: [112] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-bcfdc9b0-68fe-4358-ac7c-7d6e27267fe9 (non-flash) Jul 03 09:46:23.996429 np0000004400 cinder-backup[101319]: tcp: [113] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-72e07e1e-1567-4071-8204-c29cb26d2660 (non-flash) Jul 03 09:46:23.996429 np0000004400 cinder-backup[101319]: tcp: [114] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-72e07e1e-1567-4071-8204-c29cb26d2660 (non-flash) Jul 03 09:46:23.996429 np0000004400 cinder-backup[101319]: tcp: [82] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-76320525-737e-4f58-8523-63ec9abbdc64 (non-flash) Jul 03 09:46:23.996429 np0000004400 cinder-backup[101319]: tcp: [83] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-76320525-737e-4f58-8523-63ec9abbdc64 (non-flash) Jul 03 09:46:23.996429 np0000004400 cinder-backup[101319]: tcp: [97] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d47f5d2f-dce5-42f7-a693-a654fd702622 (non-flash) Jul 03 09:46:23.996429 np0000004400 cinder-backup[101319]: tcp: [98] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d47f5d2f-dce5-42f7-a693-a654fd702622 (non-flash) Jul 03 09:46:23.996429 np0000004400 cinder-backup[101319]: stderr= {{(pid=101319) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jul 03 09:46:23.996700 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-9e4652d9-7b88-4965-aef2-2c42a95e107c tempest-ProjectAdminTests33-1900627284 None] iscsi session list stdout=tcp: [110] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6713aeef-c919-4102-a884-a71545173837 (non-flash) Jul 03 09:46:23.996700 np0000004400 cinder-backup[101319]: tcp: [111] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-6713aeef-c919-4102-a884-a71545173837 (non-flash) Jul 03 09:46:23.996700 np0000004400 cinder-backup[101319]: tcp: [112] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-bcfdc9b0-68fe-4358-ac7c-7d6e27267fe9 (non-flash) Jul 03 09:46:23.996700 np0000004400 cinder-backup[101319]: tcp: [113] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-72e07e1e-1567-4071-8204-c29cb26d2660 (non-flash) Jul 03 09:46:23.996700 np0000004400 cinder-backup[101319]: tcp: [114] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-72e07e1e-1567-4071-8204-c29cb26d2660 (non-flash) Jul 03 09:46:23.996700 np0000004400 cinder-backup[101319]: tcp: [82] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-76320525-737e-4f58-8523-63ec9abbdc64 (non-flash) Jul 03 09:46:23.996700 np0000004400 cinder-backup[101319]: tcp: [83] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-76320525-737e-4f58-8523-63ec9abbdc64 (non-flash) Jul 03 09:46:23.996700 np0000004400 cinder-backup[101319]: tcp: [97] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d47f5d2f-dce5-42f7-a693-a654fd702622 (non-flash) Jul 03 09:46:23.996700 np0000004400 cinder-backup[101319]: tcp: [98] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d47f5d2f-dce5-42f7-a693-a654fd702622 (non-flash) Jul 03 09:46:23.996700 np0000004400 cinder-backup[101319]: stderr= {{(pid=101319) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jul 03 09:46:23.996901 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-9e4652d9-7b88-4965-aef2-2c42a95e107c tempest-ProjectAdminTests33-1900627284 None] Sessions list: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-6713aeef-c919-4102-a884-a71545173837', '110'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-6713aeef-c919-4102-a884-a71545173837', '111'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-bcfdc9b0-68fe-4358-ac7c-7d6e27267fe9', '112'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-72e07e1e-1567-4071-8204-c29cb26d2660', '113'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-72e07e1e-1567-4071-8204-c29cb26d2660', '114'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-76320525-737e-4f58-8523-63ec9abbdc64', '82'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-76320525-737e-4f58-8523-63ec9abbdc64', '83'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-d47f5d2f-dce5-42f7-a693-a654fd702622', '97'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-d47f5d2f-dce5-42f7-a693-a654fd702622', '98')] {{(pid=101319) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:866}} Jul 03 09:46:23.997027 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-9e4652d9-7b88-4965-aef2-2c42a95e107c tempest-ProjectAdminTests33-1900627284 None] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-bcfdc9b0-68fe-4358-ac7c-7d6e27267fe9, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-bcfdc9b0-68fe-4358-ac7c-7d6e27267fe9', '112')] {{(pid=101319) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}} Jul 03 09:46:23.998311 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-9e4652d9-7b88-4965-aef2-2c42a95e107c tempest-ProjectAdminTests33-1900627284 None] Resulting device map defaultdict(. at 0x7e77058e1440>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-bcfdc9b0-68fe-4358-ac7c-7d6e27267fe9'): ({'sdb'}, set())}) {{(pid=101319) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:912}} Jul 03 09:46:23.998585 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.linuxscsi [None req-9e4652d9-7b88-4965-aef2-2c42a95e107c tempest-ProjectAdminTests33-1900627284 None] Removing single pathed devices sdb {{(pid=101319) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}} Jul 03 09:46:24.010622 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.linuxscsi [None req-9e4652d9-7b88-4965-aef2-2c42a95e107c tempest-ProjectAdminTests33-1900627284 None] Flushing IO for device /dev/sdb {{(pid=101319) flush_device_io /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:461}} Jul 03 09:46:24.017070 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.linuxscsi [None req-9e4652d9-7b88-4965-aef2-2c42a95e107c tempest-ProjectAdminTests33-1900627284 None] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=101319) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}} Jul 03 09:46:24.072674 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.linuxscsi [None req-9e4652d9-7b88-4965-aef2-2c42a95e107c tempest-ProjectAdminTests33-1900627284 None] Checking to see if SCSI volumes sdb have been removed. {{(pid=101319) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}} Jul 03 09:46:24.072904 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.linuxscsi [None req-9e4652d9-7b88-4965-aef2-2c42a95e107c tempest-ProjectAdminTests33-1900627284 None] SCSI volumes sdb have been removed. {{(pid=101319) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}} Jul 03 09:46:24.074764 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.linuxscsi [None req-9e4652d9-7b88-4965-aef2-2c42a95e107c tempest-ProjectAdminTests33-1900627284 None] Checking to see if device paths {'sdb'} are still under multipathd monitoring {{(pid=101319) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}} Jul 03 09:46:24.084430 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.linuxscsi [None req-9e4652d9-7b88-4965-aef2-2c42a95e107c tempest-ProjectAdminTests33-1900627284 None] Device paths {'sdb'} have been removed from multipathd monitoring. {{(pid=101319) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}} Jul 03 09:46:24.084747 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-9e4652d9-7b88-4965-aef2-2c42a95e107c tempest-ProjectAdminTests33-1900627284 None] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-bcfdc9b0-68fe-4358-ac7c-7d6e27267fe9')] {{(pid=101319) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1225}} Jul 03 09:46:24.096659 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-9e4652d9-7b88-4965-aef2-2c42a95e107c tempest-ProjectAdminTests33-1900627284 None] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=101319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 03 09:46:24.136619 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-9e4652d9-7b88-4965-aef2-2c42a95e107c tempest-ProjectAdminTests33-1900627284 None] iscsiadm ('--logout',): stdout=Logging out of session [sid: 112, target: iqn.2023-03.storpool.com:os--volume-bcfdc9b0-68fe-4358-ac7c-7d6e27267fe9, portal: 192.168.40.100,3260] Jul 03 09:46:24.136619 np0000004400 cinder-backup[101319]: Logout of [sid: 112, target: iqn.2023-03.storpool.com:os--volume-bcfdc9b0-68fe-4358-ac7c-7d6e27267fe9, portal: 192.168.40.100,3260] successful. Jul 03 09:46:24.136619 np0000004400 cinder-backup[101319]: stderr= {{(pid=101319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 03 09:46:24.153872 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-9e4652d9-7b88-4965-aef2-2c42a95e107c tempest-ProjectAdminTests33-1900627284 None] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=101319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 03 09:46:24.154079 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.base [None req-9e4652d9-7b88-4965-aef2-2c42a95e107c tempest-ProjectAdminTests33-1900627284 None] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.197s {{(pid=101319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jul 03 09:46:24.154207 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-9e4652d9-7b88-4965-aef2-2c42a95e107c tempest-ProjectAdminTests33-1900627284 None] <== disconnect_volume: return (197ms) None {{(pid=101319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}} Jul 03 09:46:25.242909 np0000004400 cinder-backup[101319]: INFO cinder.backup.manager [None req-9e4652d9-7b88-4965-aef2-2c42a95e107c tempest-ProjectAdminTests33-1900627284 None] Create backup finished. backup: 3e013368-c720-4dd1-96fd-358ab8abaea3. Jul 03 09:46:25.950752 np0000004400 cinder-backup[101319]: INFO cinder.backup.manager [None req-b76fba72-4e02-4a16-bb61-88bdf638f778 tempest-ProjectAdminTests33-1900627284 None] Export record started, backup: 3e013368-c720-4dd1-96fd-358ab8abaea3. Jul 03 09:46:25.958836 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.drivers.swift [None req-b76fba72-4e02-4a16-bb61-88bdf638f778 tempest-ProjectAdminTests33-1900627284 None] Using swift URL https://10.4.3.95:8080/v1/AUTH_a2309d0555a742279b4a5017d94ebf02 {{(pid=101319) initialize /opt/stack/cinder/cinder/backup/drivers/swift.py:300}} Jul 03 09:46:25.959367 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.drivers.swift [None req-b76fba72-4e02-4a16-bb61-88bdf638f778 tempest-ProjectAdminTests33-1900627284 None] Connect to https://10.4.3.95:8080/v1/AUTH_ in "per_user" mode {{(pid=101319) initialize /opt/stack/cinder/cinder/backup/drivers/swift.py:301}} Jul 03 09:46:25.959799 np0000004400 cinder-backup[101319]: INFO cinder.backup.manager [None req-b76fba72-4e02-4a16-bb61-88bdf638f778 tempest-ProjectAdminTests33-1900627284 None] Export record finished, backup 3e013368-c720-4dd1-96fd-358ab8abaea3 exported. Jul 03 09:46:26.580907 np0000004400 cinder-backup[101319]: INFO cinder.backup.manager [None req-86d719d3-2b1f-4326-8765-c849de9e1a92 tempest-ProjectAdminTests33-1900627284 None] Import record started, backup_url: eyJkcml2ZXJfaW5mbyI6IHt9LCAiaWQiOiAiMTY1Y2M1NjEtMmU4ZS00ODJkLTkxMjgtMWNhNzNmMzRmNWY1IiwgInVzZXJfaWQiOiAiMjNiYTU2MGY2ZWVkNDY1NDk1OTU2ZTgyYzI2YjZmNjkiLCAicHJvamVjdF9pZCI6ICJhMjMwOWQwNTU1YTc0MjI3OWI0YTUwMTdkOTRlYmYwMiIsICJ2b2x1bWVfaWQiOiAiYmNmZGM5YjAtNjhmZS00MzU4LWFjN2MtN2Q2ZTI3MjY3ZmU5IiwgImhvc3QiOiAibnAwMDAwMDA0NDAwIiwgImF2YWlsYWJpbGl0eV96b25lIjogIm5vdmEiLCAiY29udGFpbmVyIjogInZvbHVtZWJhY2t1cHMiLCAicGFyZW50X2lkIjogbnVsbCwgInN0YXR1cyI6ICJhdmFpbGFibGUiLCAiZmFpbF9yZWFzb24iOiBudWxsLCAic2l6ZSI6IDEsICJkaXNwbGF5X25hbWUiOiAidGVtcGVzdC10eXBlLUJhY2t1cC0xNzgxOTg0ODEyIiwgImRpc3BsYXlfZGVzY3JpcHRpb24iOiBudWxsLCAic2VydmljZV9tZXRhZGF0YSI6ICJ2b2x1bWVfYmNmZGM5YjAtNjhmZS00MzU4LWFjN2MtN2Q2ZTI3MjY3ZmU5LzIwMjYwNzAzMDk0NjExL2F6X25vdmFfYmFja3VwXzNlMDEzMzY4LWM3MjAtNGRkMS05NmZkLTM1OGFiOGFiYWVhMyIsICJzZXJ2aWNlIjogImNpbmRlci5iYWNrdXAuZHJpdmVycy5zd2lmdC5Td2lmdEJhY2t1cERyaXZlciIsICJvYmplY3RfY291bnQiOiAyMSwgInRlbXBfdm9sdW1lX2lkIjogbnVsbCwgInRlbXBfc25hcHNob3RfaWQiOiBudWxsLCAibnVtX2RlcGVuZGVudF9iYWNrdXBzIjogMCwgInNuYXBzaG90X2lkIjogbnVsbCwgImRhdGFfdGltZXN0YW1wIjogIjIwMjYtMDctMDNUMDk6NDY6MDhaIiwgInJlc3RvcmVfdm9sdW1lX2lkIjogbnVsbCwgIm1ldGFkYXRhIjoge30sICJlbmNyeXB0aW9uX2tleV9pZCI6IG51bGwsICJjcmVhdGVkX2F0IjogIjIwMjYtMDctMDNUMDk6NDY6MDhaIiwgInVwZGF0ZWRfYXQiOiAiMjAyNi0wNy0wM1QwOTo0NjoyNVoiLCAiZGVsZXRlZF9hdCI6IG51bGwsICJkZWxldGVkIjogZmFsc2V9. Jul 03 09:46:26.581570 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.drivers.swift [None req-86d719d3-2b1f-4326-8765-c849de9e1a92 tempest-ProjectAdminTests33-1900627284 None] Using swift URL https://10.4.3.95:8080/v1/AUTH_a2309d0555a742279b4a5017d94ebf02 {{(pid=101319) initialize /opt/stack/cinder/cinder/backup/drivers/swift.py:300}} Jul 03 09:46:26.581691 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.drivers.swift [None req-86d719d3-2b1f-4326-8765-c849de9e1a92 tempest-ProjectAdminTests33-1900627284 None] Connect to https://10.4.3.95:8080/v1/AUTH_ in "per_user" mode {{(pid=101319) initialize /opt/stack/cinder/cinder/backup/drivers/swift.py:301}} Jul 03 09:46:26.627025 np0000004400 cinder-backup[101319]: DEBUG oslo_db.sqlalchemy.engines [None req-86d719d3-2b1f-4326-8765-c849de9e1a92 tempest-ProjectAdminTests33-1900627284 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=101319) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 03 09:46:26.645583 np0000004400 cinder-backup[101319]: INFO cinder.backup.manager [None req-86d719d3-2b1f-4326-8765-c849de9e1a92 tempest-ProjectAdminTests33-1900627284 None] Import record id 165cc561-2e8e-482d-9128-1ca73f34f5f5 metadata from driver finished. Jul 03 09:46:27.679640 np0000004400 cinder-backup[101319]: INFO cinder.backup.manager [None req-e1b2da96-59f0-4c32-a216-4eb9c88ccff5 tempest-ProjectAdminTests33-1900627284 None] Delete backup started, backup: 165cc561-2e8e-482d-9128-1ca73f34f5f5. Jul 03 09:46:27.683319 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.drivers.swift [None req-e1b2da96-59f0-4c32-a216-4eb9c88ccff5 tempest-ProjectAdminTests33-1900627284 None] Using swift URL https://10.4.3.95:8080/v1/AUTH_a2309d0555a742279b4a5017d94ebf02 {{(pid=101319) initialize /opt/stack/cinder/cinder/backup/drivers/swift.py:300}} Jul 03 09:46:27.683803 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.drivers.swift [None req-e1b2da96-59f0-4c32-a216-4eb9c88ccff5 tempest-ProjectAdminTests33-1900627284 None] Connect to https://10.4.3.95:8080/v1/AUTH_ in "per_user" mode {{(pid=101319) initialize /opt/stack/cinder/cinder/backup/drivers/swift.py:301}} Jul 03 09:46:27.683991 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-e1b2da96-59f0-4c32-a216-4eb9c88ccff5 tempest-ProjectAdminTests33-1900627284 None] delete started, backup: 165cc561-2e8e-482d-9128-1ca73f34f5f5, container: volumebackups, prefix: volume_bcfdc9b0-68fe-4358-ac7c-7d6e27267fe9/20260703094611/az_nova_backup_3e013368-c720-4dd1-96fd-358ab8abaea3. {{(pid=101319) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:822}} Jul 03 09:46:27.772122 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-e1b2da96-59f0-4c32-a216-4eb9c88ccff5 tempest-ProjectAdminTests33-1900627284 None] generated object list: ['volume_bcfdc9b0-68fe-4358-ac7c-7d6e27267fe9/20260703094611/az_nova_backup_3e013368-c720-4dd1-96fd-358ab8abaea3-00001', 'volume_bcfdc9b0-68fe-4358-ac7c-7d6e27267fe9/20260703094611/az_nova_backup_3e013368-c720-4dd1-96fd-358ab8abaea3-00002', 'volume_bcfdc9b0-68fe-4358-ac7c-7d6e27267fe9/20260703094611/az_nova_backup_3e013368-c720-4dd1-96fd-358ab8abaea3-00003', 'volume_bcfdc9b0-68fe-4358-ac7c-7d6e27267fe9/20260703094611/az_nova_backup_3e013368-c720-4dd1-96fd-358ab8abaea3-00004', 'volume_bcfdc9b0-68fe-4358-ac7c-7d6e27267fe9/20260703094611/az_nova_backup_3e013368-c720-4dd1-96fd-358ab8abaea3-00005', 'volume_bcfdc9b0-68fe-4358-ac7c-7d6e27267fe9/20260703094611/az_nova_backup_3e013368-c720-4dd1-96fd-358ab8abaea3-00006', 'volume_bcfdc9b0-68fe-4358-ac7c-7d6e27267fe9/20260703094611/az_nova_backup_3e013368-c720-4dd1-96fd-358ab8abaea3-00007', 'volume_bcfdc9b0-68fe-4358-ac7c-7d6e27267fe9/20260703094611/az_nova_backup_3e013368-c720-4dd1-96fd-358ab8abaea3-00008', 'volume_bcfdc9b0-68fe-4358-ac7c-7d6e27267fe9/20260703094611/az_nova_backup_3e013368-c720-4dd1-96fd-358ab8abaea3-00009', 'volume_bcfdc9b0-68fe-4358-ac7c-7d6e27267fe9/20260703094611/az_nova_backup_3e013368-c720-4dd1-96fd-358ab8abaea3-00010', 'volume_bcfdc9b0-68fe-4358-ac7c-7d6e27267fe9/20260703094611/az_nova_backup_3e013368-c720-4dd1-96fd-358ab8abaea3-00011', 'volume_bcfdc9b0-68fe-4358-ac7c-7d6e27267fe9/20260703094611/az_nova_backup_3e013368-c720-4dd1-96fd-358ab8abaea3-00012', 'volume_bcfdc9b0-68fe-4358-ac7c-7d6e27267fe9/20260703094611/az_nova_backup_3e013368-c720-4dd1-96fd-358ab8abaea3-00013', 'volume_bcfdc9b0-68fe-4358-ac7c-7d6e27267fe9/20260703094611/az_nova_backup_3e013368-c720-4dd1-96fd-358ab8abaea3-00014', 'volume_bcfdc9b0-68fe-4358-ac7c-7d6e27267fe9/20260703094611/az_nova_backup_3e013368-c720-4dd1-96fd-358ab8abaea3-00015', 'volume_bcfdc9b0-68fe-4358-ac7c-7d6e27267fe9/20260703094611/az_nova_backup_3e013368-c720-4dd1-96fd-358ab8abaea3-00016', 'volume_bcfdc9b0-68fe-4358-ac7c-7d6e27267fe9/20260703094611/az_nova_backup_3e013368-c720-4dd1-96fd-358ab8abaea3-00017', 'volume_bcfdc9b0-68fe-4358-ac7c-7d6e27267fe9/20260703094611/az_nova_backup_3e013368-c720-4dd1-96fd-358ab8abaea3-00018', 'volume_bcfdc9b0-68fe-4358-ac7c-7d6e27267fe9/20260703094611/az_nova_backup_3e013368-c720-4dd1-96fd-358ab8abaea3-00019', 'volume_bcfdc9b0-68fe-4358-ac7c-7d6e27267fe9/20260703094611/az_nova_backup_3e013368-c720-4dd1-96fd-358ab8abaea3-00020', 'volume_bcfdc9b0-68fe-4358-ac7c-7d6e27267fe9/20260703094611/az_nova_backup_3e013368-c720-4dd1-96fd-358ab8abaea3-00021', 'volume_bcfdc9b0-68fe-4358-ac7c-7d6e27267fe9/20260703094611/az_nova_backup_3e013368-c720-4dd1-96fd-358ab8abaea3_metadata', 'volume_bcfdc9b0-68fe-4358-ac7c-7d6e27267fe9/20260703094611/az_nova_backup_3e013368-c720-4dd1-96fd-358ab8abaea3_sha256file']. {{(pid=101319) _generate_object_names /opt/stack/cinder/cinder/backup/chunkeddriver.py:260}} Jul 03 09:46:27.805612 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-e1b2da96-59f0-4c32-a216-4eb9c88ccff5 tempest-ProjectAdminTests33-1900627284 None] deleted object: volume_bcfdc9b0-68fe-4358-ac7c-7d6e27267fe9/20260703094611/az_nova_backup_3e013368-c720-4dd1-96fd-358ab8abaea3-00001 in container: volumebackups. {{(pid=101319) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 09:46:27.848908 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-e1b2da96-59f0-4c32-a216-4eb9c88ccff5 tempest-ProjectAdminTests33-1900627284 None] deleted object: volume_bcfdc9b0-68fe-4358-ac7c-7d6e27267fe9/20260703094611/az_nova_backup_3e013368-c720-4dd1-96fd-358ab8abaea3-00002 in container: volumebackups. {{(pid=101319) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 09:46:27.881461 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-e1b2da96-59f0-4c32-a216-4eb9c88ccff5 tempest-ProjectAdminTests33-1900627284 None] deleted object: volume_bcfdc9b0-68fe-4358-ac7c-7d6e27267fe9/20260703094611/az_nova_backup_3e013368-c720-4dd1-96fd-358ab8abaea3-00003 in container: volumebackups. {{(pid=101319) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 09:46:27.948076 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-e1b2da96-59f0-4c32-a216-4eb9c88ccff5 tempest-ProjectAdminTests33-1900627284 None] deleted object: volume_bcfdc9b0-68fe-4358-ac7c-7d6e27267fe9/20260703094611/az_nova_backup_3e013368-c720-4dd1-96fd-358ab8abaea3-00004 in container: volumebackups. {{(pid=101319) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 09:46:27.979867 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-e1b2da96-59f0-4c32-a216-4eb9c88ccff5 tempest-ProjectAdminTests33-1900627284 None] deleted object: volume_bcfdc9b0-68fe-4358-ac7c-7d6e27267fe9/20260703094611/az_nova_backup_3e013368-c720-4dd1-96fd-358ab8abaea3-00005 in container: volumebackups. {{(pid=101319) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 09:46:28.008046 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-e1b2da96-59f0-4c32-a216-4eb9c88ccff5 tempest-ProjectAdminTests33-1900627284 None] deleted object: volume_bcfdc9b0-68fe-4358-ac7c-7d6e27267fe9/20260703094611/az_nova_backup_3e013368-c720-4dd1-96fd-358ab8abaea3-00006 in container: volumebackups. {{(pid=101319) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 09:46:28.029888 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-e1b2da96-59f0-4c32-a216-4eb9c88ccff5 tempest-ProjectAdminTests33-1900627284 None] deleted object: volume_bcfdc9b0-68fe-4358-ac7c-7d6e27267fe9/20260703094611/az_nova_backup_3e013368-c720-4dd1-96fd-358ab8abaea3-00007 in container: volumebackups. {{(pid=101319) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 09:46:28.050113 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-e1b2da96-59f0-4c32-a216-4eb9c88ccff5 tempest-ProjectAdminTests33-1900627284 None] deleted object: volume_bcfdc9b0-68fe-4358-ac7c-7d6e27267fe9/20260703094611/az_nova_backup_3e013368-c720-4dd1-96fd-358ab8abaea3-00008 in container: volumebackups. {{(pid=101319) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 09:46:28.072454 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-e1b2da96-59f0-4c32-a216-4eb9c88ccff5 tempest-ProjectAdminTests33-1900627284 None] deleted object: volume_bcfdc9b0-68fe-4358-ac7c-7d6e27267fe9/20260703094611/az_nova_backup_3e013368-c720-4dd1-96fd-358ab8abaea3-00009 in container: volumebackups. {{(pid=101319) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 09:46:28.094135 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-e1b2da96-59f0-4c32-a216-4eb9c88ccff5 tempest-ProjectAdminTests33-1900627284 None] deleted object: volume_bcfdc9b0-68fe-4358-ac7c-7d6e27267fe9/20260703094611/az_nova_backup_3e013368-c720-4dd1-96fd-358ab8abaea3-00010 in container: volumebackups. {{(pid=101319) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 09:46:28.117281 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-e1b2da96-59f0-4c32-a216-4eb9c88ccff5 tempest-ProjectAdminTests33-1900627284 None] deleted object: volume_bcfdc9b0-68fe-4358-ac7c-7d6e27267fe9/20260703094611/az_nova_backup_3e013368-c720-4dd1-96fd-358ab8abaea3-00011 in container: volumebackups. {{(pid=101319) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 09:46:28.137933 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-e1b2da96-59f0-4c32-a216-4eb9c88ccff5 tempest-ProjectAdminTests33-1900627284 None] deleted object: volume_bcfdc9b0-68fe-4358-ac7c-7d6e27267fe9/20260703094611/az_nova_backup_3e013368-c720-4dd1-96fd-358ab8abaea3-00012 in container: volumebackups. {{(pid=101319) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 09:46:28.161914 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-e1b2da96-59f0-4c32-a216-4eb9c88ccff5 tempest-ProjectAdminTests33-1900627284 None] deleted object: volume_bcfdc9b0-68fe-4358-ac7c-7d6e27267fe9/20260703094611/az_nova_backup_3e013368-c720-4dd1-96fd-358ab8abaea3-00013 in container: volumebackups. {{(pid=101319) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 09:46:28.180463 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-e1b2da96-59f0-4c32-a216-4eb9c88ccff5 tempest-ProjectAdminTests33-1900627284 None] deleted object: volume_bcfdc9b0-68fe-4358-ac7c-7d6e27267fe9/20260703094611/az_nova_backup_3e013368-c720-4dd1-96fd-358ab8abaea3-00014 in container: volumebackups. {{(pid=101319) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 09:46:28.200492 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-e1b2da96-59f0-4c32-a216-4eb9c88ccff5 tempest-ProjectAdminTests33-1900627284 None] deleted object: volume_bcfdc9b0-68fe-4358-ac7c-7d6e27267fe9/20260703094611/az_nova_backup_3e013368-c720-4dd1-96fd-358ab8abaea3-00015 in container: volumebackups. {{(pid=101319) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 09:46:28.218960 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-e1b2da96-59f0-4c32-a216-4eb9c88ccff5 tempest-ProjectAdminTests33-1900627284 None] deleted object: volume_bcfdc9b0-68fe-4358-ac7c-7d6e27267fe9/20260703094611/az_nova_backup_3e013368-c720-4dd1-96fd-358ab8abaea3-00016 in container: volumebackups. {{(pid=101319) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 09:46:28.239685 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-e1b2da96-59f0-4c32-a216-4eb9c88ccff5 tempest-ProjectAdminTests33-1900627284 None] deleted object: volume_bcfdc9b0-68fe-4358-ac7c-7d6e27267fe9/20260703094611/az_nova_backup_3e013368-c720-4dd1-96fd-358ab8abaea3-00017 in container: volumebackups. {{(pid=101319) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 09:46:28.262134 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-e1b2da96-59f0-4c32-a216-4eb9c88ccff5 tempest-ProjectAdminTests33-1900627284 None] deleted object: volume_bcfdc9b0-68fe-4358-ac7c-7d6e27267fe9/20260703094611/az_nova_backup_3e013368-c720-4dd1-96fd-358ab8abaea3-00018 in container: volumebackups. {{(pid=101319) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 09:46:28.284865 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-e1b2da96-59f0-4c32-a216-4eb9c88ccff5 tempest-ProjectAdminTests33-1900627284 None] deleted object: volume_bcfdc9b0-68fe-4358-ac7c-7d6e27267fe9/20260703094611/az_nova_backup_3e013368-c720-4dd1-96fd-358ab8abaea3-00019 in container: volumebackups. {{(pid=101319) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 09:46:28.309492 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-e1b2da96-59f0-4c32-a216-4eb9c88ccff5 tempest-ProjectAdminTests33-1900627284 None] deleted object: volume_bcfdc9b0-68fe-4358-ac7c-7d6e27267fe9/20260703094611/az_nova_backup_3e013368-c720-4dd1-96fd-358ab8abaea3-00020 in container: volumebackups. {{(pid=101319) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 09:46:28.334574 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-e1b2da96-59f0-4c32-a216-4eb9c88ccff5 tempest-ProjectAdminTests33-1900627284 None] deleted object: volume_bcfdc9b0-68fe-4358-ac7c-7d6e27267fe9/20260703094611/az_nova_backup_3e013368-c720-4dd1-96fd-358ab8abaea3-00021 in container: volumebackups. {{(pid=101319) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 09:46:28.368419 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-e1b2da96-59f0-4c32-a216-4eb9c88ccff5 tempest-ProjectAdminTests33-1900627284 None] deleted object: volume_bcfdc9b0-68fe-4358-ac7c-7d6e27267fe9/20260703094611/az_nova_backup_3e013368-c720-4dd1-96fd-358ab8abaea3_metadata in container: volumebackups. {{(pid=101319) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 09:46:28.398789 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-e1b2da96-59f0-4c32-a216-4eb9c88ccff5 tempest-ProjectAdminTests33-1900627284 None] deleted object: volume_bcfdc9b0-68fe-4358-ac7c-7d6e27267fe9/20260703094611/az_nova_backup_3e013368-c720-4dd1-96fd-358ab8abaea3_sha256file in container: volumebackups. {{(pid=101319) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 09:46:28.398968 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-e1b2da96-59f0-4c32-a216-4eb9c88ccff5 tempest-ProjectAdminTests33-1900627284 None] delete 165cc561-2e8e-482d-9128-1ca73f34f5f5 finished. {{(pid=101319) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:848}} Jul 03 09:46:28.435934 np0000004400 cinder-backup[101319]: DEBUG oslo_db.sqlalchemy.engines [None req-e1b2da96-59f0-4c32-a216-4eb9c88ccff5 tempest-ProjectAdminTests33-1900627284 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=101319) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 03 09:46:28.483116 np0000004400 cinder-backup[101319]: DEBUG cinder.quota [None req-e1b2da96-59f0-4c32-a216-4eb9c88ccff5 tempest-ProjectAdminTests33-1900627284 None] Created reservations ['324e50c5-25c4-4efa-b9c4-19b85ae7ba16', '34051c93-a8e3-4990-8172-43334c381941'] {{(pid=101319) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 09:46:28.557469 np0000004400 cinder-backup[101319]: INFO cinder.backup.manager [None req-e1b2da96-59f0-4c32-a216-4eb9c88ccff5 tempest-ProjectAdminTests33-1900627284 None] Delete backup finished, backup 165cc561-2e8e-482d-9128-1ca73f34f5f5 deleted. Jul 03 09:46:31.268584 np0000004400 cinder-backup[101319]: INFO cinder.backup.manager [None req-ab6b0b80-b0fb-4af3-b356-0a2a830796d4 tempest-ProjectAdminTests33-1900627284 None] Create backup started, backup: 64e0c106-c41a-47bc-80c1-33370700f504 volume: 87113756-5260-460f-864c-3fb466e6be45. Jul 03 09:46:31.280261 np0000004400 cinder-backup[101319]: INFO cinder.backup.manager [None req-ab6b0b80-b0fb-4af3-b356-0a2a830796d4 tempest-ProjectAdminTests33-1900627284 None] Call Volume Manager to get_backup_device for Backup(availability_zone='nova',container=None,created_at=2026-07-03T09:46:31Z,data_timestamp=2026-07-03T09:46:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-type-Backup-1867960478',encryption_key_id=None,fail_reason=None,host='np0000004400',id=64e0c106-c41a-47bc-80c1-33370700f504,metadata={},num_dependent_backups=0,object_count=0,parent=None,parent_id=None,project_id='a2309d0555a742279b4a5017d94ebf02',restore_volume_id=None,service='cinder.backup.drivers.swift.SwiftBackupDriver',service_metadata=None,size=1,snapshot_id=None,status='creating',temp_snapshot_id=None,temp_volume_id=None,updated_at=None,user_id='23ba560f6eed465495956e82c26b6f69',volume_id=87113756-5260-460f-864c-3fb466e6be45) Jul 03 09:46:31.305913 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.drivers.swift [None req-ab6b0b80-b0fb-4af3-b356-0a2a830796d4 tempest-ProjectAdminTests33-1900627284 None] Using swift URL https://10.4.3.95:8080/v1/AUTH_a2309d0555a742279b4a5017d94ebf02 {{(pid=101319) initialize /opt/stack/cinder/cinder/backup/drivers/swift.py:300}} Jul 03 09:46:31.306190 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.drivers.swift [None req-ab6b0b80-b0fb-4af3-b356-0a2a830796d4 tempest-ProjectAdminTests33-1900627284 None] Connect to https://10.4.3.95:8080/v1/AUTH_ in "per_user" mode {{(pid=101319) initialize /opt/stack/cinder/cinder/backup/drivers/swift.py:301}} Jul 03 09:46:31.306492 np0000004400 cinder-backup[101319]: DEBUG os_brick.utils [None req-ab6b0b80-b0fb-4af3-b356-0a2a830796d4 tempest-ProjectAdminTests33-1900627284 None] ==> get_connector_properties: call "{'root_helper': 'sudo cinder-rootwrap /etc/cinder/rootwrap.conf', 'my_ip': '10.4.3.95', 'multipath': False, 'enforce_multipath': False, 'host': None, 'execute': None}" {{(pid=101319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}} Jul 03 09:46:31.318193 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.scaleio [None req-ab6b0b80-b0fb-4af3-b356-0a2a830796d4 tempest-ProjectAdminTests33-1900627284 None] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=101319) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}} Jul 03 09:46:31.338509 np0000004400 cinder-backup[101319]: DEBUG oslo_concurrency.processutils [None req-ab6b0b80-b0fb-4af3-b356-0a2a830796d4 tempest-ProjectAdminTests33-1900627284 None] Running cmd (subprocess): nvme version {{(pid=101319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 09:46:31.352681 np0000004400 cinder-backup[101319]: DEBUG oslo_concurrency.processutils [None req-ab6b0b80-b0fb-4af3-b356-0a2a830796d4 tempest-ProjectAdminTests33-1900627284 None] 'nvme version' failed. Not Retrying. {{(pid=101319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 03 09:46:31.352949 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.nvmeof [None req-ab6b0b80-b0fb-4af3-b356-0a2a830796d4 tempest-ProjectAdminTests33-1900627284 None] nvme not present on system {{(pid=101319) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}} Jul 03 09:46:31.361460 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.lightos [None req-ab6b0b80-b0fb-4af3-b356-0a2a830796d4 tempest-ProjectAdminTests33-1900627284 None] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=101319) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}} Jul 03 09:46:31.362639 np0000004400 cinder-backup[101319]: INFO os_brick.initiator.connectors.lightos [None req-ab6b0b80-b0fb-4af3-b356-0a2a830796d4 tempest-ProjectAdminTests33-1900627284 None] Current host hostNQN and IP(s) are ['10.4.3.95', 'fe80::f816:3eff:fe47:268c', '192.168.40.6', 'fe80::f816:3eff:febf:7be2', '192.168.50.6', 'fe80::f816:3eff:fe99:8914', '192.168.10.6', 'fe80::f816:3eff:fe2f:e696', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::bc9d:84ff:fec2:6b49', 'fe80::fc16:3eff:fea0:4147', 'fe80::b0cf:48ff:fe29:caf0', 'fe80::fc16:3eff:fe91:aa0', 'fe80::fc16:3eff:fe6b:be86', 'fe80::4007:baff:fe0f:8f44', 'fe80::fc16:3eff:fe93:a114', 'fe80::fc16:3eff:fe16:6cb1', 'fe80::4075:8aff:feff:e907', 'fe80::fc16:3eff:fe97:90a6', 'fe80::8435:18ff:feb9:798c'] Jul 03 09:46:31.362783 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.lightos [None req-ab6b0b80-b0fb-4af3-b356-0a2a830796d4 tempest-ProjectAdminTests33-1900627284 None] LIGHTOS: did not find dsc, continuing anyway. {{(pid=101319) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}} Jul 03 09:46:31.362905 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.lightos [None req-ab6b0b80-b0fb-4af3-b356-0a2a830796d4 tempest-ProjectAdminTests33-1900627284 None] LIGHTOS: no hostnqn found. {{(pid=101319) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}} Jul 03 09:46:31.363136 np0000004400 cinder-backup[101319]: DEBUG os_brick.utils [None req-ab6b0b80-b0fb-4af3-b356-0a2a830796d4 tempest-ProjectAdminTests33-1900627284 None] <== get_connector_properties: return (56ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.95', 'host': 'np0000004400', 'multipath': False, 'enforce_multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:ae7e5bb0ebe6', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': '6b284368-d0ba-4d18-af6f-4998d3955c52', 'nvme_native_multipath': False} {{(pid=101319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}} Jul 03 09:46:31.867245 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connector [None req-ab6b0b80-b0fb-4af3-b356-0a2a830796d4 tempest-ProjectAdminTests33-1900627284 None] Factory for iscsi on None {{(pid=101319) factory /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connector.py:243}} Jul 03 09:46:31.867665 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-ab6b0b80-b0fb-4af3-b356-0a2a830796d4 tempest-ProjectAdminTests33-1900627284 None] ==> connect_volume: call "{'self': , 'connection_properties': {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-87113756-5260-460f-864c-3fb466e6be45', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '87113756-5260-460f-864c-3fb466e6be45', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': False}}" {{(pid=101319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}} Jul 03 09:46:31.868232 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.base [None req-ab6b0b80-b0fb-4af3-b356-0a2a830796d4 tempest-ProjectAdminTests33-1900627284 None] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=101319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jul 03 09:46:31.868803 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.base [None req-ab6b0b80-b0fb-4af3-b356-0a2a830796d4 tempest-ProjectAdminTests33-1900627284 None] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=101319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jul 03 09:46:31.868803 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.base [None req-ab6b0b80-b0fb-4af3-b356-0a2a830796d4 tempest-ProjectAdminTests33-1900627284 None] Connection properties {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-87113756-5260-460f-864c-3fb466e6be45', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '87113756-5260-460f-864c-3fb466e6be45', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': False} {{(pid=101319) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}} Jul 03 09:46:31.882735 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.base [None req-ab6b0b80-b0fb-4af3-b356-0a2a830796d4 tempest-ProjectAdminTests33-1900627284 None] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-87113756-5260-460f-864c-3fb466e6be45" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=101319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jul 03 09:46:31.883223 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.base [None req-ab6b0b80-b0fb-4af3-b356-0a2a830796d4 tempest-ProjectAdminTests33-1900627284 None] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-87113756-5260-460f-864c-3fb466e6be45" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=101319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jul 03 09:46:31.883518 np0000004400 cinder-backup[101319]: INFO os_brick.initiator.connectors.iscsi [None req-ab6b0b80-b0fb-4af3-b356-0a2a830796d4 tempest-ProjectAdminTests33-1900627284 None] Trying to connect to iSCSI portal 192.168.40.100:3260 Jul 03 09:46:31.894334 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-ab6b0b80-b0fb-4af3-b356-0a2a830796d4 tempest-ProjectAdminTests33-1900627284 None] iscsiadm (): stdout= stderr=iscsiadm: No records found Jul 03 09:46:31.894334 np0000004400 cinder-backup[101319]: {{(pid=101319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 03 09:46:31.906922 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-ab6b0b80-b0fb-4af3-b356-0a2a830796d4 tempest-ProjectAdminTests33-1900627284 None] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-87113756-5260-460f-864c-3fb466e6be45] added Jul 03 09:46:31.906922 np0000004400 cinder-backup[101319]: stderr=iscsiadm: Config file line 363 does not have value Jul 03 09:46:31.906922 np0000004400 cinder-backup[101319]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs' Jul 03 09:46:31.906922 np0000004400 cinder-backup[101319]: iscsiadm: Config file line 363 does not have value Jul 03 09:46:31.906922 np0000004400 cinder-backup[101319]: iscsiadm: Config file line 363 does not have value Jul 03 09:46:31.906922 np0000004400 cinder-backup[101319]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs' Jul 03 09:46:31.906922 np0000004400 cinder-backup[101319]: {{(pid=101319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 03 09:46:31.907305 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-ab6b0b80-b0fb-4af3-b356-0a2a830796d4 tempest-ProjectAdminTests33-1900627284 None] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=101319) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}} Jul 03 09:46:31.908887 np0000004400 cinder-backup[101319]: DEBUG os_brick.utils [None req-ab6b0b80-b0fb-4af3-b356-0a2a830796d4 tempest-ProjectAdminTests33-1900627284 None] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0238(s), this was the 1st time calling it. {{(pid=101319) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}} Jul 03 09:46:31.908887 np0000004400 cinder-backup[101319]: DEBUG os_brick.utils [None req-ab6b0b80-b0fb-4af3-b356-0a2a830796d4 tempest-ProjectAdminTests33-1900627284 None] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=101319) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}} Jul 03 09:46:32.909048 np0000004400 cinder-backup[101319]: INFO os_brick.initiator.connectors.iscsi [None req-ab6b0b80-b0fb-4af3-b356-0a2a830796d4 tempest-ProjectAdminTests33-1900627284 None] Trying to connect to iSCSI portal 192.168.40.100:3260 Jul 03 09:46:32.921476 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-ab6b0b80-b0fb-4af3-b356-0a2a830796d4 tempest-ProjectAdminTests33-1900627284 None] iscsiadm (): stdout=# BEGIN RECORD 2.1.9 Jul 03 09:46:32.921476 np0000004400 cinder-backup[101319]: node.name = iqn.2023-03.storpool.com:os--volume-87113756-5260-460f-864c-3fb466e6be45 Jul 03 09:46:32.921476 np0000004400 cinder-backup[101319]: node.tpgt = -1 Jul 03 09:46:32.921476 np0000004400 cinder-backup[101319]: node.startup = manual Jul 03 09:46:32.921476 np0000004400 cinder-backup[101319]: node.leading_login = No Jul 03 09:46:32.921476 np0000004400 cinder-backup[101319]: iface.iscsi_ifacename = default Jul 03 09:46:32.921476 np0000004400 cinder-backup[101319]: iface.net_ifacename = Jul 03 09:46:32.921476 np0000004400 cinder-backup[101319]: iface.ipaddress = Jul 03 09:46:32.921476 np0000004400 cinder-backup[101319]: iface.prefix_len = 0 Jul 03 09:46:32.921476 np0000004400 cinder-backup[101319]: iface.hwaddress = Jul 03 09:46:32.921476 np0000004400 cinder-backup[101319]: iface.transport_name = tcp Jul 03 09:46:32.921476 np0000004400 cinder-backup[101319]: iface.initiatorname = Jul 03 09:46:32.921476 np0000004400 cinder-backup[101319]: iface.state = Jul 03 09:46:32.921476 np0000004400 cinder-backup[101319]: iface.vlan_id = 0 Jul 03 09:46:32.921476 np0000004400 cinder-backup[101319]: iface.vlan_priority = 0 Jul 03 09:46:32.921476 np0000004400 cinder-backup[101319]: iface.vlan_state = Jul 03 09:46:32.921476 np0000004400 cinder-backup[101319]: iface.iface_num = 0 Jul 03 09:46:32.921476 np0000004400 cinder-backup[101319]: iface.mtu = 0 Jul 03 09:46:32.921476 np0000004400 cinder-backup[101319]: iface.port = 0 Jul 03 09:46:32.921476 np0000004400 cinder-backup[101319]: iface.bootproto = Jul 03 09:46:32.921476 np0000004400 cinder-backup[101319]: iface.subnet_mask = Jul 03 09:46:32.921476 np0000004400 cinder-backup[101319]: iface.gateway = Jul 03 09:46:32.921476 np0000004400 cinder-backup[101319]: iface.dhcp_alt_client_id_state = Jul 03 09:46:32.921476 np0000004400 cinder-backup[101319]: iface.dhcp_alt_client_id = Jul 03 09:46:32.921476 np0000004400 cinder-backup[101319]: iface.dhcp_dns = Jul 03 09:46:32.921476 np0000004400 cinder-backup[101319]: iface.dhcp_learn_iqn = Jul 03 09:46:32.921476 np0000004400 cinder-backup[101319]: iface.dhcp_req_vendor_id_state = Jul 03 09:46:32.921476 np0000004400 cinder-backup[101319]: iface.dhcp_vendor_id_state = Jul 03 09:46:32.921476 np0000004400 cinder-backup[101319]: iface.dhcp_vendor_id = Jul 03 09:46:32.921476 np0000004400 cinder-backup[101319]: iface.dhcp_slp_da = Jul 03 09:46:32.921476 np0000004400 cinder-backup[101319]: iface.fragmentation = Jul 03 09:46:32.921476 np0000004400 cinder-backup[101319]: iface.gratuitous_arp = Jul 03 09:46:32.921476 np0000004400 cinder-backup[101319]: iface.incoming_forwarding = Jul 03 09:46:32.921476 np0000004400 cinder-backup[101319]: iface.tos_state = Jul 03 09:46:32.921476 np0000004400 cinder-backup[101319]: iface.tos = 0 Jul 03 09:46:32.921476 np0000004400 cinder-backup[101319]: iface.ttl = 0 Jul 03 09:46:32.921476 np0000004400 cinder-backup[101319]: iface.delayed_ack = Jul 03 09:46:32.921476 np0000004400 cinder-backup[101319]: iface.tcp_nagle = Jul 03 09:46:32.921476 np0000004400 cinder-backup[101319]: iface.tcp_wsf_state = Jul 03 09:46:32.921476 np0000004400 cinder-backup[101319]: iface.tcp_wsf = 0 Jul 03 09:46:32.921476 np0000004400 cinder-backup[101319]: iface.tcp_timer_scale = 0 Jul 03 09:46:32.921476 np0000004400 cinder-backup[101319]: iface.tcp_timestamp = Jul 03 09:46:32.921476 np0000004400 cinder-backup[101319]: iface.redirect = Jul 03 09:46:32.921476 np0000004400 cinder-backup[101319]: iface.def_task_mgmt_timeout = 0 Jul 03 09:46:32.921476 np0000004400 cinder-backup[101319]: iface.header_digest = Jul 03 09:46:32.921476 np0000004400 cinder-backup[101319]: iface.data_digest = Jul 03 09:46:32.921476 np0000004400 cinder-backup[101319]: iface.immediate_data = Jul 03 09:46:32.921476 np0000004400 cinder-backup[101319]: iface.initial_r2t = Jul 03 09:46:32.921476 np0000004400 cinder-backup[101319]: iface.data_seq_inorder = Jul 03 09:46:32.921476 np0000004400 cinder-backup[101319]: iface.data_pdu_inorder = Jul 03 09:46:32.921476 np0000004400 cinder-backup[101319]: iface.erl = 0 Jul 03 09:46:32.921476 np0000004400 cinder-backup[101319]: iface.max_receive_data_len = 0 Jul 03 09:46:32.921476 np0000004400 cinder-backup[101319]: iface.first_burst_len = 0 Jul 03 09:46:32.921476 np0000004400 cinder-backup[101319]: iface.max_outstanding_r2t = 0 Jul 03 09:46:32.921476 np0000004400 cinder-backup[101319]: iface.max_burst_len = 0 Jul 03 09:46:32.921476 np0000004400 cinder-backup[101319]: iface.chap_auth = Jul 03 09:46:32.921476 np0000004400 cinder-backup[101319]: iface.bidi_chap = Jul 03 09:46:32.921476 np0000004400 cinder-backup[101319]: iface.strict_login_compliance = Jul 03 09:46:32.921476 np0000004400 cinder-backup[101319]: iface.discovery_auth = Jul 03 09:46:32.921476 np0000004400 cinder-backup[101319]: iface.discovery_logout = Jul 03 09:46:32.921476 np0000004400 cinder-backup[101319]: node.discovery_address = Jul 03 09:46:32.921476 np0000004400 cinder-backup[101319]: node.discovery_port = 0 Jul 03 09:46:32.921476 np0000004400 cinder-backup[101319]: node.discovery_type = fw Jul 03 09:46:32.921476 np0000004400 cinder-backup[101319]: node.session.initial_cmdsn = 0 Jul 03 09:46:32.921476 np0000004400 cinder-backup[101319]: node.session.initial_login_retry_max = 8 Jul 03 09:46:32.921476 np0000004400 cinder-backup[101319]: node.session.xmit_thread_priority = 0 Jul 03 09:46:32.921476 np0000004400 cinder-backup[101319]: node.session.cmds_max = 128 Jul 03 09:46:32.921476 np0000004400 cinder-backup[101319]: node.session.queue_depth = 32 Jul 03 09:46:32.921476 np0000004400 cinder-backup[101319]: node.session.nr_sessions = 1 Jul 03 09:46:32.921476 np0000004400 cinder-backup[101319]: node.session.auth.authmethod = None Jul 03 09:46:32.921476 np0000004400 cinder-backup[101319]: node.session.auth.username = Jul 03 09:46:32.921476 np0000004400 cinder-backup[101319]: node.session.auth.password = *** Jul 03 09:46:32.921476 np0000004400 cinder-backup[101319]: node.session.auth.username_in = Jul 03 09:46:32.921476 np0000004400 cinder-backup[101319]: node.session.auth.password_in = Jul 03 09:46:32.921476 np0000004400 cinder-backup[101319]: node.session.auth.chap_algs = SHA256 Jul 03 09:46:32.921476 np0000004400 cinder-backup[101319]: node.session.timeo.replacement_timeout = 120 Jul 03 09:46:32.921476 np0000004400 cinder-backup[101319]: node.session.err_timeo.abort_timeout = 15 Jul 03 09:46:32.921476 np0000004400 cinder-backup[101319]: node.session.err_timeo.lu_reset_timeout = 30 Jul 03 09:46:32.921476 np0000004400 cinder-backup[101319]: node.session.err_timeo.tgt_reset_timeout = 30 Jul 03 09:46:32.921476 np0000004400 cinder-backup[101319]: node.session.err_timeo.host_reset_timeout = 60 Jul 03 09:46:32.921476 np0000004400 cinder-backup[101319]: node.session.iscsi.FastAbort = Yes Jul 03 09:46:32.921476 np0000004400 cinder-backup[101319]: node.session.iscsi.InitialR2T = No Jul 03 09:46:32.921476 np0000004400 cinder-backup[101319]: node.session.iscsi.ImmediateData = Yes Jul 03 09:46:32.921476 np0000004400 cinder-backup[101319]: node.session.iscsi.FirstBurstLength = 262144 Jul 03 09:46:32.921476 np0000004400 cinder-backup[101319]: node.session.iscsi.MaxBurstLength = 16776192 Jul 03 09:46:32.921476 np0000004400 cinder-backup[101319]: node.session.iscsi.DefaultTime2Retain = 0 Jul 03 09:46:32.921476 np0000004400 cinder-backup[101319]: node.session.iscsi.DefaultTime2Wait = 2 Jul 03 09:46:32.921476 np0000004400 cinder-backup[101319]: node.session.iscsi.MaxConnections = 1 Jul 03 09:46:32.921476 np0000004400 cinder-backup[101319]: node.session.iscsi.MaxOutstandingR2T = 1 Jul 03 09:46:32.921476 np0000004400 cinder-backup[101319]: node.session.iscsi.ERL = 0 Jul 03 09:46:32.921476 np0000004400 cinder-backup[101319]: node.session.scan = auto Jul 03 09:46:32.921476 np0000004400 cinder-backup[101319]: node.session.reopen_max = 0 Jul 03 09:46:32.921476 np0000004400 cinder-backup[101319]: node.conn[0].address = 192.168.40.100 Jul 03 09:46:32.921476 np0000004400 cinder-backup[101319]: node.conn[0].port = 3260 Jul 03 09:46:32.921476 np0000004400 cinder-backup[101319]: node.conn[0].startup = manual Jul 03 09:46:32.921476 np0000004400 cinder-backup[101319]: node.conn[0].tcp.window_size = 524288 Jul 03 09:46:32.921476 np0000004400 cinder-backup[101319]: node.conn[0].tcp.type_of_service = 0 Jul 03 09:46:32.921476 np0000004400 cinder-backup[101319]: node.conn[0].timeo.logout_timeout = 15 Jul 03 09:46:32.921476 np0000004400 cinder-backup[101319]: node.conn[0].timeo.login_timeout = 15 Jul 03 09:46:32.921476 np0000004400 cinder-backup[101319]: node.conn[0].timeo.auth_timeout = 45 Jul 03 09:46:32.921476 np0000004400 cinder-backup[101319]: node.conn[0].timeo.noop_out_interval = 5 Jul 03 09:46:32.921476 np0000004400 cinder-backup[101319]: node.conn[0].timeo.noop_out_timeout = 5 Jul 03 09:46:32.921476 np0000004400 cinder-backup[101319]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0 Jul 03 09:46:32.921476 np0000004400 cinder-backup[101319]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144 Jul 03 09:46:32.921476 np0000004400 cinder-backup[101319]: node.conn[0].iscsi.HeaderDigest = None Jul 03 09:46:32.921476 np0000004400 cinder-backup[101319]: node.conn[0].iscsi.DataDigest = None Jul 03 09:46:32.921476 np0000004400 cinder-backup[101319]: node.conn[0].iscsi.IFMarker = No Jul 03 09:46:32.921476 np0000004400 cinder-backup[101319]: node.conn[0].iscsi.OFMarker = No Jul 03 09:46:32.921476 np0000004400 cinder-backup[101319]: # END RECORD Jul 03 09:46:32.921476 np0000004400 cinder-backup[101319]: stderr= {{(pid=101319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 03 09:46:32.931808 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-ab6b0b80-b0fb-4af3-b356-0a2a830796d4 tempest-ProjectAdminTests33-1900627284 None] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=101319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 03 09:46:32.950927 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-ab6b0b80-b0fb-4af3-b356-0a2a830796d4 tempest-ProjectAdminTests33-1900627284 None] iscsiadm ('-m', 'session'): stdout=tcp: [110] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6713aeef-c919-4102-a884-a71545173837 (non-flash) Jul 03 09:46:32.950927 np0000004400 cinder-backup[101319]: tcp: [111] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-6713aeef-c919-4102-a884-a71545173837 (non-flash) Jul 03 09:46:32.950927 np0000004400 cinder-backup[101319]: tcp: [113] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-72e07e1e-1567-4071-8204-c29cb26d2660 (non-flash) Jul 03 09:46:32.950927 np0000004400 cinder-backup[101319]: tcp: [114] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-72e07e1e-1567-4071-8204-c29cb26d2660 (non-flash) Jul 03 09:46:32.950927 np0000004400 cinder-backup[101319]: tcp: [82] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-76320525-737e-4f58-8523-63ec9abbdc64 (non-flash) Jul 03 09:46:32.950927 np0000004400 cinder-backup[101319]: tcp: [83] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-76320525-737e-4f58-8523-63ec9abbdc64 (non-flash) Jul 03 09:46:32.950927 np0000004400 cinder-backup[101319]: tcp: [97] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d47f5d2f-dce5-42f7-a693-a654fd702622 (non-flash) Jul 03 09:46:32.950927 np0000004400 cinder-backup[101319]: tcp: [98] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d47f5d2f-dce5-42f7-a693-a654fd702622 (non-flash) Jul 03 09:46:32.950927 np0000004400 cinder-backup[101319]: stderr= {{(pid=101319) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jul 03 09:46:32.951344 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-ab6b0b80-b0fb-4af3-b356-0a2a830796d4 tempest-ProjectAdminTests33-1900627284 None] iscsi session list stdout=tcp: [110] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6713aeef-c919-4102-a884-a71545173837 (non-flash) Jul 03 09:46:32.951344 np0000004400 cinder-backup[101319]: tcp: [111] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-6713aeef-c919-4102-a884-a71545173837 (non-flash) Jul 03 09:46:32.951344 np0000004400 cinder-backup[101319]: tcp: [113] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-72e07e1e-1567-4071-8204-c29cb26d2660 (non-flash) Jul 03 09:46:32.951344 np0000004400 cinder-backup[101319]: tcp: [114] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-72e07e1e-1567-4071-8204-c29cb26d2660 (non-flash) Jul 03 09:46:32.951344 np0000004400 cinder-backup[101319]: tcp: [82] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-76320525-737e-4f58-8523-63ec9abbdc64 (non-flash) Jul 03 09:46:32.951344 np0000004400 cinder-backup[101319]: tcp: [83] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-76320525-737e-4f58-8523-63ec9abbdc64 (non-flash) Jul 03 09:46:32.951344 np0000004400 cinder-backup[101319]: tcp: [97] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d47f5d2f-dce5-42f7-a693-a654fd702622 (non-flash) Jul 03 09:46:32.951344 np0000004400 cinder-backup[101319]: tcp: [98] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d47f5d2f-dce5-42f7-a693-a654fd702622 (non-flash) Jul 03 09:46:32.951344 np0000004400 cinder-backup[101319]: stderr= {{(pid=101319) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jul 03 09:46:32.994916 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-ab6b0b80-b0fb-4af3-b356-0a2a830796d4 tempest-ProjectAdminTests33-1900627284 None] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-87113756-5260-460f-864c-3fb466e6be45, portal: 192.168.40.100,3260] Jul 03 09:46:32.994916 np0000004400 cinder-backup[101319]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-87113756-5260-460f-864c-3fb466e6be45, portal: 192.168.40.100,3260] successful. Jul 03 09:46:32.994916 np0000004400 cinder-backup[101319]: stderr= {{(pid=101319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 03 09:46:33.006186 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-ab6b0b80-b0fb-4af3-b356-0a2a830796d4 tempest-ProjectAdminTests33-1900627284 None] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=101319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 03 09:46:33.028104 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-ab6b0b80-b0fb-4af3-b356-0a2a830796d4 tempest-ProjectAdminTests33-1900627284 None] iscsiadm ('-m', 'session'): stdout=tcp: [110] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6713aeef-c919-4102-a884-a71545173837 (non-flash) Jul 03 09:46:33.028104 np0000004400 cinder-backup[101319]: tcp: [111] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-6713aeef-c919-4102-a884-a71545173837 (non-flash) Jul 03 09:46:33.028104 np0000004400 cinder-backup[101319]: tcp: [113] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-72e07e1e-1567-4071-8204-c29cb26d2660 (non-flash) Jul 03 09:46:33.028104 np0000004400 cinder-backup[101319]: tcp: [114] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-72e07e1e-1567-4071-8204-c29cb26d2660 (non-flash) Jul 03 09:46:33.028104 np0000004400 cinder-backup[101319]: tcp: [115] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-87113756-5260-460f-864c-3fb466e6be45 (non-flash) Jul 03 09:46:33.028104 np0000004400 cinder-backup[101319]: tcp: [82] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-76320525-737e-4f58-8523-63ec9abbdc64 (non-flash) Jul 03 09:46:33.028104 np0000004400 cinder-backup[101319]: tcp: [83] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-76320525-737e-4f58-8523-63ec9abbdc64 (non-flash) Jul 03 09:46:33.028104 np0000004400 cinder-backup[101319]: tcp: [97] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d47f5d2f-dce5-42f7-a693-a654fd702622 (non-flash) Jul 03 09:46:33.028104 np0000004400 cinder-backup[101319]: tcp: [98] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d47f5d2f-dce5-42f7-a693-a654fd702622 (non-flash) Jul 03 09:46:33.028104 np0000004400 cinder-backup[101319]: stderr= {{(pid=101319) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jul 03 09:46:33.028344 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-ab6b0b80-b0fb-4af3-b356-0a2a830796d4 tempest-ProjectAdminTests33-1900627284 None] iscsi session list stdout=tcp: [110] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6713aeef-c919-4102-a884-a71545173837 (non-flash) Jul 03 09:46:33.028344 np0000004400 cinder-backup[101319]: tcp: [111] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-6713aeef-c919-4102-a884-a71545173837 (non-flash) Jul 03 09:46:33.028344 np0000004400 cinder-backup[101319]: tcp: [113] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-72e07e1e-1567-4071-8204-c29cb26d2660 (non-flash) Jul 03 09:46:33.028344 np0000004400 cinder-backup[101319]: tcp: [114] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-72e07e1e-1567-4071-8204-c29cb26d2660 (non-flash) Jul 03 09:46:33.028344 np0000004400 cinder-backup[101319]: tcp: [115] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-87113756-5260-460f-864c-3fb466e6be45 (non-flash) Jul 03 09:46:33.028344 np0000004400 cinder-backup[101319]: tcp: [82] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-76320525-737e-4f58-8523-63ec9abbdc64 (non-flash) Jul 03 09:46:33.028344 np0000004400 cinder-backup[101319]: tcp: [83] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-76320525-737e-4f58-8523-63ec9abbdc64 (non-flash) Jul 03 09:46:33.028344 np0000004400 cinder-backup[101319]: tcp: [97] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d47f5d2f-dce5-42f7-a693-a654fd702622 (non-flash) Jul 03 09:46:33.028344 np0000004400 cinder-backup[101319]: tcp: [98] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d47f5d2f-dce5-42f7-a693-a654fd702622 (non-flash) Jul 03 09:46:33.028344 np0000004400 cinder-backup[101319]: stderr= {{(pid=101319) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jul 03 09:46:33.028527 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.base [None req-ab6b0b80-b0fb-4af3-b356-0a2a830796d4 tempest-ProjectAdminTests33-1900627284 None] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-87113756-5260-460f-864c-3fb466e6be45" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.145s {{(pid=101319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jul 03 09:46:33.028668 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-ab6b0b80-b0fb-4af3-b356-0a2a830796d4 tempest-ProjectAdminTests33-1900627284 None] Connected to 192.168.40.100:3260 {{(pid=101319) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}} Jul 03 09:46:33.029561 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.linuxscsi [None req-ab6b0b80-b0fb-4af3-b356-0a2a830796d4 tempest-ProjectAdminTests33-1900627284 None] HCTL ('7', '-', '-', 0) found on session 115 with lun 0 {{(pid=101319) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}} Jul 03 09:46:33.029697 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.linuxscsi [None req-ab6b0b80-b0fb-4af3-b356-0a2a830796d4 tempest-ProjectAdminTests33-1900627284 None] Scanning host 7 c: -, t: -, l: 0) {{(pid=101319) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}} Jul 03 09:46:33.042280 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.linuxscsi [None req-ab6b0b80-b0fb-4af3-b356-0a2a830796d4 tempest-ProjectAdminTests33-1900627284 None] Searching for a device in session 115 and hctl ['7', '*', '*', 0] yield: None {{(pid=101319) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}} Jul 03 09:46:34.043652 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.linuxscsi [None req-ab6b0b80-b0fb-4af3-b356-0a2a830796d4 tempest-ProjectAdminTests33-1900627284 None] Searching for a device in session 115 and hctl ['7', '*', '*', 0] yield: sdb {{(pid=101319) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}} Jul 03 09:46:34.043652 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-ab6b0b80-b0fb-4af3-b356-0a2a830796d4 tempest-ProjectAdminTests33-1900627284 None] Connected to sdb using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-87113756-5260-460f-864c-3fb466e6be45', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '87113756-5260-460f-864c-3fb466e6be45', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': False} {{(pid=101319) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}} Jul 03 09:46:34.044290 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.base [None req-ab6b0b80-b0fb-4af3-b356-0a2a830796d4 tempest-ProjectAdminTests33-1900627284 None] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 2.176s {{(pid=101319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jul 03 09:46:34.044393 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-ab6b0b80-b0fb-4af3-b356-0a2a830796d4 tempest-ProjectAdminTests33-1900627284 None] <== connect_volume: return (2176ms) {'type': 'block', 'scsi_wwn': '3300000006af70a75', 'path': '/dev/sdb'} {{(pid=101319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}} Jul 03 09:46:34.044839 np0000004400 cinder-backup[101319]: DEBUG oslo_concurrency.processutils [None req-ab6b0b80-b0fb-4af3-b356-0a2a830796d4 tempest-ProjectAdminTests33-1900627284 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chown 1002 /dev/sdb {{(pid=101319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 09:46:34.067561 np0000004400 sudo[138853]: stack : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chown 1002 /dev/sdb Jul 03 09:46:34.068177 np0000004400 sudo[138853]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1002) Jul 03 09:46:34.406509 np0000004400 sudo[138853]: pam_unix(sudo:session): session closed for user root Jul 03 09:46:34.408894 np0000004400 cinder-backup[101319]: DEBUG oslo_concurrency.processutils [None req-ab6b0b80-b0fb-4af3-b356-0a2a830796d4 tempest-ProjectAdminTests33-1900627284 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chown 1002 /dev/sdb" returned: 0 in 0.364s {{(pid=101319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 09:46:34.448210 np0000004400 cinder-backup[101319]: DEBUG oslo_db.sqlalchemy.engines [None req-ab6b0b80-b0fb-4af3-b356-0a2a830796d4 tempest-ProjectAdminTests33-1900627284 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=101319) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 03 09:46:34.458552 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-ab6b0b80-b0fb-4af3-b356-0a2a830796d4 tempest-ProjectAdminTests33-1900627284 None] _create_container started, container: volumebackups,backup: 64e0c106-c41a-47bc-80c1-33370700f504. {{(pid=101319) _create_container /opt/stack/cinder/cinder/backup/chunkeddriver.py:249}} Jul 03 09:46:34.521634 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.drivers.swift [None req-ab6b0b80-b0fb-4af3-b356-0a2a830796d4 tempest-ProjectAdminTests33-1900627284 None] generate_object_name_prefix: volume_87113756-5260-460f-864c-3fb466e6be45/20260703094634/az_nova_backup_64e0c106-c41a-47bc-80c1-33370700f504 {{(pid=101319) _generate_object_name_prefix /opt/stack/cinder/cinder/backup/drivers/swift.py:452}} Jul 03 09:46:34.531693 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-ab6b0b80-b0fb-4af3-b356-0a2a830796d4 tempest-ProjectAdminTests33-1900627284 None] starting backup of volume: 87113756-5260-460f-864c-3fb466e6be45, volume size: 1073741824, object names prefix volume_87113756-5260-460f-864c-3fb466e6be45/20260703094634/az_nova_backup_64e0c106-c41a-47bc-80c1-33370700f504, availability zone: nova {{(pid=101319) _prepare_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:359}} Jul 03 09:46:34.753242 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-ab6b0b80-b0fb-4af3-b356-0a2a830796d4 tempest-ProjectAdminTests33-1900627284 None] Backing up chunk of data from volume. {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 09:46:34.993898 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-ab6b0b80-b0fb-4af3-b356-0a2a830796d4 tempest-ProjectAdminTests33-1900627284 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101319) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 09:46:34.994013 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-ab6b0b80-b0fb-4af3-b356-0a2a830796d4 tempest-ProjectAdminTests33-1900627284 None] About to put_object {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 09:46:35.127973 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-ab6b0b80-b0fb-4af3-b356-0a2a830796d4 tempest-ProjectAdminTests33-1900627284 None] backup MD5 for volume_87113756-5260-460f-864c-3fb466e6be45/20260703094634/az_nova_backup_64e0c106-c41a-47bc-80c1-33370700f504-00001: 25e317773f308e446cc84c503a6d1f85 {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 09:46:35.128333 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-ab6b0b80-b0fb-4af3-b356-0a2a830796d4 tempest-ProjectAdminTests33-1900627284 None] Calling eventlet.sleep(0) {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 09:46:35.346837 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-ab6b0b80-b0fb-4af3-b356-0a2a830796d4 tempest-ProjectAdminTests33-1900627284 None] Backing up chunk of data from volume. {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 09:46:35.601559 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-ab6b0b80-b0fb-4af3-b356-0a2a830796d4 tempest-ProjectAdminTests33-1900627284 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101319) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 09:46:35.601747 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-ab6b0b80-b0fb-4af3-b356-0a2a830796d4 tempest-ProjectAdminTests33-1900627284 None] About to put_object {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 09:46:35.714193 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-ab6b0b80-b0fb-4af3-b356-0a2a830796d4 tempest-ProjectAdminTests33-1900627284 None] backup MD5 for volume_87113756-5260-460f-864c-3fb466e6be45/20260703094634/az_nova_backup_64e0c106-c41a-47bc-80c1-33370700f504-00002: 25e317773f308e446cc84c503a6d1f85 {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 09:46:35.714344 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-ab6b0b80-b0fb-4af3-b356-0a2a830796d4 tempest-ProjectAdminTests33-1900627284 None] Calling eventlet.sleep(0) {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 09:46:35.905678 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-ab6b0b80-b0fb-4af3-b356-0a2a830796d4 tempest-ProjectAdminTests33-1900627284 None] Backing up chunk of data from volume. {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 09:46:36.159301 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-ab6b0b80-b0fb-4af3-b356-0a2a830796d4 tempest-ProjectAdminTests33-1900627284 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101319) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 09:46:36.159301 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-ab6b0b80-b0fb-4af3-b356-0a2a830796d4 tempest-ProjectAdminTests33-1900627284 None] About to put_object {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 09:46:36.296203 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-ab6b0b80-b0fb-4af3-b356-0a2a830796d4 tempest-ProjectAdminTests33-1900627284 None] backup MD5 for volume_87113756-5260-460f-864c-3fb466e6be45/20260703094634/az_nova_backup_64e0c106-c41a-47bc-80c1-33370700f504-00003: 25e317773f308e446cc84c503a6d1f85 {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 09:46:36.296203 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-ab6b0b80-b0fb-4af3-b356-0a2a830796d4 tempest-ProjectAdminTests33-1900627284 None] Calling eventlet.sleep(0) {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 09:46:36.520689 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-ab6b0b80-b0fb-4af3-b356-0a2a830796d4 tempest-ProjectAdminTests33-1900627284 None] Backing up chunk of data from volume. {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 09:46:36.779870 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-ab6b0b80-b0fb-4af3-b356-0a2a830796d4 tempest-ProjectAdminTests33-1900627284 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101319) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 09:46:36.780015 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-ab6b0b80-b0fb-4af3-b356-0a2a830796d4 tempest-ProjectAdminTests33-1900627284 None] About to put_object {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 09:46:36.883555 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-ab6b0b80-b0fb-4af3-b356-0a2a830796d4 tempest-ProjectAdminTests33-1900627284 None] backup MD5 for volume_87113756-5260-460f-864c-3fb466e6be45/20260703094634/az_nova_backup_64e0c106-c41a-47bc-80c1-33370700f504-00004: 25e317773f308e446cc84c503a6d1f85 {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 09:46:36.883672 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-ab6b0b80-b0fb-4af3-b356-0a2a830796d4 tempest-ProjectAdminTests33-1900627284 None] Calling eventlet.sleep(0) {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 09:46:37.094041 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-ab6b0b80-b0fb-4af3-b356-0a2a830796d4 tempest-ProjectAdminTests33-1900627284 None] Backing up chunk of data from volume. {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 09:46:37.347279 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-ab6b0b80-b0fb-4af3-b356-0a2a830796d4 tempest-ProjectAdminTests33-1900627284 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101319) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 09:46:37.347768 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-ab6b0b80-b0fb-4af3-b356-0a2a830796d4 tempest-ProjectAdminTests33-1900627284 None] About to put_object {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 09:46:37.473775 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-ab6b0b80-b0fb-4af3-b356-0a2a830796d4 tempest-ProjectAdminTests33-1900627284 None] backup MD5 for volume_87113756-5260-460f-864c-3fb466e6be45/20260703094634/az_nova_backup_64e0c106-c41a-47bc-80c1-33370700f504-00005: 25e317773f308e446cc84c503a6d1f85 {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 09:46:37.473961 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-ab6b0b80-b0fb-4af3-b356-0a2a830796d4 tempest-ProjectAdminTests33-1900627284 None] Calling eventlet.sleep(0) {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 09:46:37.691823 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-ab6b0b80-b0fb-4af3-b356-0a2a830796d4 tempest-ProjectAdminTests33-1900627284 None] Backing up chunk of data from volume. {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 09:46:37.949966 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-ab6b0b80-b0fb-4af3-b356-0a2a830796d4 tempest-ProjectAdminTests33-1900627284 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101319) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 09:46:37.950170 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-ab6b0b80-b0fb-4af3-b356-0a2a830796d4 tempest-ProjectAdminTests33-1900627284 None] About to put_object {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 09:46:38.089865 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-ab6b0b80-b0fb-4af3-b356-0a2a830796d4 tempest-ProjectAdminTests33-1900627284 None] backup MD5 for volume_87113756-5260-460f-864c-3fb466e6be45/20260703094634/az_nova_backup_64e0c106-c41a-47bc-80c1-33370700f504-00006: 25e317773f308e446cc84c503a6d1f85 {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 09:46:38.089865 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-ab6b0b80-b0fb-4af3-b356-0a2a830796d4 tempest-ProjectAdminTests33-1900627284 None] Calling eventlet.sleep(0) {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 09:46:38.281658 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-ab6b0b80-b0fb-4af3-b356-0a2a830796d4 tempest-ProjectAdminTests33-1900627284 None] Backing up chunk of data from volume. {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 09:46:38.546152 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-ab6b0b80-b0fb-4af3-b356-0a2a830796d4 tempest-ProjectAdminTests33-1900627284 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101319) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 09:46:38.546488 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-ab6b0b80-b0fb-4af3-b356-0a2a830796d4 tempest-ProjectAdminTests33-1900627284 None] About to put_object {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 09:46:38.674167 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-ab6b0b80-b0fb-4af3-b356-0a2a830796d4 tempest-ProjectAdminTests33-1900627284 None] backup MD5 for volume_87113756-5260-460f-864c-3fb466e6be45/20260703094634/az_nova_backup_64e0c106-c41a-47bc-80c1-33370700f504-00007: 25e317773f308e446cc84c503a6d1f85 {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 09:46:38.674386 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-ab6b0b80-b0fb-4af3-b356-0a2a830796d4 tempest-ProjectAdminTests33-1900627284 None] Calling eventlet.sleep(0) {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 09:46:38.869423 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-ab6b0b80-b0fb-4af3-b356-0a2a830796d4 tempest-ProjectAdminTests33-1900627284 None] Backing up chunk of data from volume. {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 09:46:39.113440 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-ab6b0b80-b0fb-4af3-b356-0a2a830796d4 tempest-ProjectAdminTests33-1900627284 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101319) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 09:46:39.113816 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-ab6b0b80-b0fb-4af3-b356-0a2a830796d4 tempest-ProjectAdminTests33-1900627284 None] About to put_object {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 09:46:39.226873 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-ab6b0b80-b0fb-4af3-b356-0a2a830796d4 tempest-ProjectAdminTests33-1900627284 None] backup MD5 for volume_87113756-5260-460f-864c-3fb466e6be45/20260703094634/az_nova_backup_64e0c106-c41a-47bc-80c1-33370700f504-00008: 25e317773f308e446cc84c503a6d1f85 {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 09:46:39.227099 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-ab6b0b80-b0fb-4af3-b356-0a2a830796d4 tempest-ProjectAdminTests33-1900627284 None] Calling eventlet.sleep(0) {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 09:46:39.425843 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-ab6b0b80-b0fb-4af3-b356-0a2a830796d4 tempest-ProjectAdminTests33-1900627284 None] Backing up chunk of data from volume. {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 09:46:39.690016 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-ab6b0b80-b0fb-4af3-b356-0a2a830796d4 tempest-ProjectAdminTests33-1900627284 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101319) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 09:46:39.690526 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-ab6b0b80-b0fb-4af3-b356-0a2a830796d4 tempest-ProjectAdminTests33-1900627284 None] About to put_object {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 09:46:39.806672 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-ab6b0b80-b0fb-4af3-b356-0a2a830796d4 tempest-ProjectAdminTests33-1900627284 None] backup MD5 for volume_87113756-5260-460f-864c-3fb466e6be45/20260703094634/az_nova_backup_64e0c106-c41a-47bc-80c1-33370700f504-00009: 25e317773f308e446cc84c503a6d1f85 {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 09:46:39.806841 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-ab6b0b80-b0fb-4af3-b356-0a2a830796d4 tempest-ProjectAdminTests33-1900627284 None] Calling eventlet.sleep(0) {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 09:46:40.022136 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-ab6b0b80-b0fb-4af3-b356-0a2a830796d4 tempest-ProjectAdminTests33-1900627284 None] Backing up chunk of data from volume. {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 09:46:40.270121 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-ab6b0b80-b0fb-4af3-b356-0a2a830796d4 tempest-ProjectAdminTests33-1900627284 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101319) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 09:46:40.270313 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-ab6b0b80-b0fb-4af3-b356-0a2a830796d4 tempest-ProjectAdminTests33-1900627284 None] About to put_object {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 09:46:40.363619 np0000004400 cinder-backup[101319]: DEBUG oslo_service.periodic_task [None req-ffd932d2-122c-4e68-b5ba-628aff7ae7b8 None None] Running periodic task BackupManager.publish_service_capabilities {{(pid=101319) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 03 09:46:40.363831 np0000004400 cinder-backup[101319]: DEBUG cinder.manager [None req-ffd932d2-122c-4e68-b5ba-628aff7ae7b8 None None] Notifying Schedulers of capabilities ... {{(pid=101319) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 03 09:46:40.377790 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-ab6b0b80-b0fb-4af3-b356-0a2a830796d4 tempest-ProjectAdminTests33-1900627284 None] backup MD5 for volume_87113756-5260-460f-864c-3fb466e6be45/20260703094634/az_nova_backup_64e0c106-c41a-47bc-80c1-33370700f504-00010: 25e317773f308e446cc84c503a6d1f85 {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 09:46:40.377976 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-ab6b0b80-b0fb-4af3-b356-0a2a830796d4 tempest-ProjectAdminTests33-1900627284 None] Calling eventlet.sleep(0) {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 09:46:40.606637 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-ab6b0b80-b0fb-4af3-b356-0a2a830796d4 tempest-ProjectAdminTests33-1900627284 None] Backing up chunk of data from volume. {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 09:46:40.863958 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-ab6b0b80-b0fb-4af3-b356-0a2a830796d4 tempest-ProjectAdminTests33-1900627284 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101319) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 09:46:40.864533 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-ab6b0b80-b0fb-4af3-b356-0a2a830796d4 tempest-ProjectAdminTests33-1900627284 None] About to put_object {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 09:46:40.975218 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-ab6b0b80-b0fb-4af3-b356-0a2a830796d4 tempest-ProjectAdminTests33-1900627284 None] backup MD5 for volume_87113756-5260-460f-864c-3fb466e6be45/20260703094634/az_nova_backup_64e0c106-c41a-47bc-80c1-33370700f504-00011: 25e317773f308e446cc84c503a6d1f85 {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 09:46:40.975386 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-ab6b0b80-b0fb-4af3-b356-0a2a830796d4 tempest-ProjectAdminTests33-1900627284 None] Calling eventlet.sleep(0) {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 09:46:41.172184 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-ab6b0b80-b0fb-4af3-b356-0a2a830796d4 tempest-ProjectAdminTests33-1900627284 None] Backing up chunk of data from volume. {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 09:46:41.415699 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-ab6b0b80-b0fb-4af3-b356-0a2a830796d4 tempest-ProjectAdminTests33-1900627284 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101319) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 09:46:41.415881 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-ab6b0b80-b0fb-4af3-b356-0a2a830796d4 tempest-ProjectAdminTests33-1900627284 None] About to put_object {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 09:46:41.534427 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-ab6b0b80-b0fb-4af3-b356-0a2a830796d4 tempest-ProjectAdminTests33-1900627284 None] backup MD5 for volume_87113756-5260-460f-864c-3fb466e6be45/20260703094634/az_nova_backup_64e0c106-c41a-47bc-80c1-33370700f504-00012: 25e317773f308e446cc84c503a6d1f85 {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 09:46:41.534566 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-ab6b0b80-b0fb-4af3-b356-0a2a830796d4 tempest-ProjectAdminTests33-1900627284 None] Calling eventlet.sleep(0) {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 09:46:41.716558 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-ab6b0b80-b0fb-4af3-b356-0a2a830796d4 tempest-ProjectAdminTests33-1900627284 None] Backing up chunk of data from volume. {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 09:46:41.968128 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-ab6b0b80-b0fb-4af3-b356-0a2a830796d4 tempest-ProjectAdminTests33-1900627284 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101319) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 09:46:41.968547 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-ab6b0b80-b0fb-4af3-b356-0a2a830796d4 tempest-ProjectAdminTests33-1900627284 None] About to put_object {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 09:46:42.069647 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-ab6b0b80-b0fb-4af3-b356-0a2a830796d4 tempest-ProjectAdminTests33-1900627284 None] backup MD5 for volume_87113756-5260-460f-864c-3fb466e6be45/20260703094634/az_nova_backup_64e0c106-c41a-47bc-80c1-33370700f504-00013: 25e317773f308e446cc84c503a6d1f85 {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 09:46:42.069837 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-ab6b0b80-b0fb-4af3-b356-0a2a830796d4 tempest-ProjectAdminTests33-1900627284 None] Calling eventlet.sleep(0) {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 09:46:42.258284 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-ab6b0b80-b0fb-4af3-b356-0a2a830796d4 tempest-ProjectAdminTests33-1900627284 None] Backing up chunk of data from volume. {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 09:46:42.504658 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-ab6b0b80-b0fb-4af3-b356-0a2a830796d4 tempest-ProjectAdminTests33-1900627284 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101319) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 09:46:42.504871 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-ab6b0b80-b0fb-4af3-b356-0a2a830796d4 tempest-ProjectAdminTests33-1900627284 None] About to put_object {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 09:46:42.621971 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-ab6b0b80-b0fb-4af3-b356-0a2a830796d4 tempest-ProjectAdminTests33-1900627284 None] backup MD5 for volume_87113756-5260-460f-864c-3fb466e6be45/20260703094634/az_nova_backup_64e0c106-c41a-47bc-80c1-33370700f504-00014: 25e317773f308e446cc84c503a6d1f85 {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 09:46:42.622157 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-ab6b0b80-b0fb-4af3-b356-0a2a830796d4 tempest-ProjectAdminTests33-1900627284 None] Calling eventlet.sleep(0) {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 09:46:42.836246 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-ab6b0b80-b0fb-4af3-b356-0a2a830796d4 tempest-ProjectAdminTests33-1900627284 None] Backing up chunk of data from volume. {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 09:46:43.073540 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-ab6b0b80-b0fb-4af3-b356-0a2a830796d4 tempest-ProjectAdminTests33-1900627284 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101319) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 09:46:43.074077 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-ab6b0b80-b0fb-4af3-b356-0a2a830796d4 tempest-ProjectAdminTests33-1900627284 None] About to put_object {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 09:46:43.185822 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-ab6b0b80-b0fb-4af3-b356-0a2a830796d4 tempest-ProjectAdminTests33-1900627284 None] backup MD5 for volume_87113756-5260-460f-864c-3fb466e6be45/20260703094634/az_nova_backup_64e0c106-c41a-47bc-80c1-33370700f504-00015: 25e317773f308e446cc84c503a6d1f85 {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 09:46:43.185932 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-ab6b0b80-b0fb-4af3-b356-0a2a830796d4 tempest-ProjectAdminTests33-1900627284 None] Calling eventlet.sleep(0) {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 09:46:43.383912 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-ab6b0b80-b0fb-4af3-b356-0a2a830796d4 tempest-ProjectAdminTests33-1900627284 None] Backing up chunk of data from volume. {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 09:46:43.639080 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-ab6b0b80-b0fb-4af3-b356-0a2a830796d4 tempest-ProjectAdminTests33-1900627284 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101319) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 09:46:43.639229 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-ab6b0b80-b0fb-4af3-b356-0a2a830796d4 tempest-ProjectAdminTests33-1900627284 None] About to put_object {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 09:46:43.752171 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-ab6b0b80-b0fb-4af3-b356-0a2a830796d4 tempest-ProjectAdminTests33-1900627284 None] backup MD5 for volume_87113756-5260-460f-864c-3fb466e6be45/20260703094634/az_nova_backup_64e0c106-c41a-47bc-80c1-33370700f504-00016: 25e317773f308e446cc84c503a6d1f85 {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 09:46:43.752416 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-ab6b0b80-b0fb-4af3-b356-0a2a830796d4 tempest-ProjectAdminTests33-1900627284 None] Calling eventlet.sleep(0) {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 09:46:43.958284 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-ab6b0b80-b0fb-4af3-b356-0a2a830796d4 tempest-ProjectAdminTests33-1900627284 None] Backing up chunk of data from volume. {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 09:46:44.205663 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-ab6b0b80-b0fb-4af3-b356-0a2a830796d4 tempest-ProjectAdminTests33-1900627284 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101319) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 09:46:44.206002 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-ab6b0b80-b0fb-4af3-b356-0a2a830796d4 tempest-ProjectAdminTests33-1900627284 None] About to put_object {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 09:46:44.311287 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-ab6b0b80-b0fb-4af3-b356-0a2a830796d4 tempest-ProjectAdminTests33-1900627284 None] backup MD5 for volume_87113756-5260-460f-864c-3fb466e6be45/20260703094634/az_nova_backup_64e0c106-c41a-47bc-80c1-33370700f504-00017: 25e317773f308e446cc84c503a6d1f85 {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 09:46:44.311552 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-ab6b0b80-b0fb-4af3-b356-0a2a830796d4 tempest-ProjectAdminTests33-1900627284 None] Calling eventlet.sleep(0) {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 09:46:44.488438 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-ab6b0b80-b0fb-4af3-b356-0a2a830796d4 tempest-ProjectAdminTests33-1900627284 None] Backing up chunk of data from volume. {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 09:46:44.727083 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-ab6b0b80-b0fb-4af3-b356-0a2a830796d4 tempest-ProjectAdminTests33-1900627284 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101319) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 09:46:44.727268 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-ab6b0b80-b0fb-4af3-b356-0a2a830796d4 tempest-ProjectAdminTests33-1900627284 None] About to put_object {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 09:46:44.839018 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-ab6b0b80-b0fb-4af3-b356-0a2a830796d4 tempest-ProjectAdminTests33-1900627284 None] backup MD5 for volume_87113756-5260-460f-864c-3fb466e6be45/20260703094634/az_nova_backup_64e0c106-c41a-47bc-80c1-33370700f504-00018: 25e317773f308e446cc84c503a6d1f85 {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 09:46:44.839222 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-ab6b0b80-b0fb-4af3-b356-0a2a830796d4 tempest-ProjectAdminTests33-1900627284 None] Calling eventlet.sleep(0) {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 09:46:45.025373 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-ab6b0b80-b0fb-4af3-b356-0a2a830796d4 tempest-ProjectAdminTests33-1900627284 None] Backing up chunk of data from volume. {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 09:46:45.290865 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-ab6b0b80-b0fb-4af3-b356-0a2a830796d4 tempest-ProjectAdminTests33-1900627284 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101319) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 09:46:45.291231 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-ab6b0b80-b0fb-4af3-b356-0a2a830796d4 tempest-ProjectAdminTests33-1900627284 None] About to put_object {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 09:46:45.398236 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-ab6b0b80-b0fb-4af3-b356-0a2a830796d4 tempest-ProjectAdminTests33-1900627284 None] backup MD5 for volume_87113756-5260-460f-864c-3fb466e6be45/20260703094634/az_nova_backup_64e0c106-c41a-47bc-80c1-33370700f504-00019: 25e317773f308e446cc84c503a6d1f85 {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 09:46:45.398375 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-ab6b0b80-b0fb-4af3-b356-0a2a830796d4 tempest-ProjectAdminTests33-1900627284 None] Calling eventlet.sleep(0) {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 09:46:45.577166 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-ab6b0b80-b0fb-4af3-b356-0a2a830796d4 tempest-ProjectAdminTests33-1900627284 None] Backing up chunk of data from volume. {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 09:46:45.822797 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-ab6b0b80-b0fb-4af3-b356-0a2a830796d4 tempest-ProjectAdminTests33-1900627284 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101319) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 09:46:45.822917 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-ab6b0b80-b0fb-4af3-b356-0a2a830796d4 tempest-ProjectAdminTests33-1900627284 None] About to put_object {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 09:46:45.942369 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-ab6b0b80-b0fb-4af3-b356-0a2a830796d4 tempest-ProjectAdminTests33-1900627284 None] backup MD5 for volume_87113756-5260-460f-864c-3fb466e6be45/20260703094634/az_nova_backup_64e0c106-c41a-47bc-80c1-33370700f504-00020: 25e317773f308e446cc84c503a6d1f85 {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 09:46:45.942574 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-ab6b0b80-b0fb-4af3-b356-0a2a830796d4 tempest-ProjectAdminTests33-1900627284 None] Calling eventlet.sleep(0) {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 09:46:46.040157 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-ab6b0b80-b0fb-4af3-b356-0a2a830796d4 tempest-ProjectAdminTests33-1900627284 None] Backing up chunk of data from volume. {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 09:46:46.160998 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-ab6b0b80-b0fb-4af3-b356-0a2a830796d4 tempest-ProjectAdminTests33-1900627284 None] Compressed 25165824 bytes of data to 24470 bytes using zlib. {{(pid=101319) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 09:46:46.161191 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-ab6b0b80-b0fb-4af3-b356-0a2a830796d4 tempest-ProjectAdminTests33-1900627284 None] About to put_object {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 09:46:46.245799 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-ab6b0b80-b0fb-4af3-b356-0a2a830796d4 tempest-ProjectAdminTests33-1900627284 None] backup MD5 for volume_87113756-5260-460f-864c-3fb466e6be45/20260703094634/az_nova_backup_64e0c106-c41a-47bc-80c1-33370700f504-00021: 77377273b0a4b61febdbf7bbf52b9db9 {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 09:46:46.246037 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-ab6b0b80-b0fb-4af3-b356-0a2a830796d4 tempest-ProjectAdminTests33-1900627284 None] Calling eventlet.sleep(0) {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 09:46:46.253850 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.driver [None req-ab6b0b80-b0fb-4af3-b356-0a2a830796d4 tempest-ProjectAdminTests33-1900627284 None] Getting metadata type 'volume-base-metadata' {{(pid=101319) _save_vol_base_meta /opt/stack/cinder/cinder/backup/driver.py:79}} Jul 03 09:46:46.261477 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.driver [None req-ab6b0b80-b0fb-4af3-b356-0a2a830796d4 tempest-ProjectAdminTests33-1900627284 None] Completed fetching metadata type 'volume-base-metadata' {{(pid=101319) _save_vol_base_meta /opt/stack/cinder/cinder/backup/driver.py:98}} Jul 03 09:46:46.261668 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.driver [None req-ab6b0b80-b0fb-4af3-b356-0a2a830796d4 tempest-ProjectAdminTests33-1900627284 None] Getting metadata type 'volume-metadata' {{(pid=101319) _save_vol_meta /opt/stack/cinder/cinder/backup/driver.py:109}} Jul 03 09:46:46.266496 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.driver [None req-ab6b0b80-b0fb-4af3-b356-0a2a830796d4 tempest-ProjectAdminTests33-1900627284 None] No metadata type 'volume-metadata' available {{(pid=101319) _save_vol_meta /opt/stack/cinder/cinder/backup/driver.py:123}} Jul 03 09:46:46.266689 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.driver [None req-ab6b0b80-b0fb-4af3-b356-0a2a830796d4 tempest-ProjectAdminTests33-1900627284 None] Getting metadata type 'volume-glance-metadata' {{(pid=101319) _save_vol_glance_meta /opt/stack/cinder/cinder/backup/driver.py:132}} Jul 03 09:46:46.270041 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.driver [None req-ab6b0b80-b0fb-4af3-b356-0a2a830796d4 tempest-ProjectAdminTests33-1900627284 None] No metadata type 'volume-glance-metadata' available {{(pid=101319) _save_vol_glance_meta /opt/stack/cinder/cinder/backup/driver.py:147}} Jul 03 09:46:46.270347 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-ab6b0b80-b0fb-4af3-b356-0a2a830796d4 tempest-ProjectAdminTests33-1900627284 None] _write_sha256file started, container name: volumebackups, sha256file filename: volume_87113756-5260-460f-864c-3fb466e6be45/20260703094634/az_nova_backup_64e0c106-c41a-47bc-80c1-33370700f504_sha256file. {{(pid=101319) _write_sha256file /opt/stack/cinder/cinder/backup/chunkeddriver.py:299}} Jul 03 09:46:46.333411 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-ab6b0b80-b0fb-4af3-b356-0a2a830796d4 tempest-ProjectAdminTests33-1900627284 None] _write_sha256file finished. {{(pid=101319) _write_sha256file /opt/stack/cinder/cinder/backup/chunkeddriver.py:315}} Jul 03 09:46:46.334111 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-ab6b0b80-b0fb-4af3-b356-0a2a830796d4 tempest-ProjectAdminTests33-1900627284 None] _write_metadata started, container name: volumebackups, metadata filename: volume_87113756-5260-460f-864c-3fb466e6be45/20260703094634/az_nova_backup_64e0c106-c41a-47bc-80c1-33370700f504_metadata. {{(pid=101319) _write_metadata /opt/stack/cinder/cinder/backup/chunkeddriver.py:276}} Jul 03 09:46:46.358200 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-ab6b0b80-b0fb-4af3-b356-0a2a830796d4 tempest-ProjectAdminTests33-1900627284 None] _write_metadata finished. Metadata: b'{\n "backup_description": null,\n "backup_id": "64e0c106-c41a-47bc-80c1-33370700f504",\n "backup_name": "tempest-type-Backup-1867960478",\n "created_at": "2026-07-03 09:46:31+00:00",\n "objects": [\n {\n "volume_87113756-5260-460f-864c-3fb466e6be45/20260703094634/az_nova_backup_64e0c106-c41a-47bc-80c1-33370700f504-00001": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 0\n }\n },\n {\n "volume_87113756-5260-460f-864c-3fb466e6be45/20260703094634/az_nova_backup_64e0c106-c41a-47bc-80c1-33370700f504-00002": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 52428800\n }\n },\n {\n "volume_87113756-5260-460f-864c-3fb466e6be45/20260703094634/az_nova_backup_64e0c106-c41a-47bc-80c1-33370700f504-00003": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 104857600\n }\n },\n {\n "volume_87113756-5260-460f-864c-3fb466e6be45/20260703094634/az_nova_backup_64e0c106-c41a-47bc-80c1-33370700f504-00004": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 157286400\n }\n },\n {\n "volume_87113756-5260-460f-864c-3fb466e6be45/20260703094634/az_nova_backup_64e0c106-c41a-47bc-80c1-33370700f504-00005": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 209715200\n }\n },\n {\n "volume_87113756-5260-460f-864c-3fb466e6be45/20260703094634/az_nova_backup_64e0c106-c41a-47bc-80c1-33370700f504-00006": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 262144000\n }\n },\n {\n "volume_87113756-5260-460f-864c-3fb466e6be45/20260703094634/az_nova_backup_64e0c106-c41a-47bc-80c1-33370700f504-00007": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 314572800\n }\n },\n {\n "volume_87113756-5260-460f-864c-3fb466e6be45/20260703094634/az_nova_backup_64e0c106-c41a-47bc-80c1-33370700f504-00008": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 367001600\n }\n },\n {\n "volume_87113756-5260-460f-864c-3fb466e6be45/20260703094634/az_nova_backup_64e0c106-c41a-47bc-80c1-33370700f504-00009": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 419430400\n }\n },\n {\n "volume_87113756-5260-460f-864c-3fb466e6be45/20260703094634/az_nova_backup_64e0c106-c41a-47bc-80c1-33370700f504-00010": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 471859200\n }\n },\n {\n "volume_87113756-5260-460f-864c-3fb466e6be45/20260703094634/az_nova_backup_64e0c106-c41a-47bc-80c1-33370700f504-00011": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 524288000\n }\n },\n {\n "volume_87113756-5260-460f-864c-3fb466e6be45/20260703094634/az_nova_backup_64e0c106-c41a-47bc-80c1-33370700f504-00012": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 576716800\n }\n },\n {\n "volume_87113756-5260-460f-864c-3fb466e6be45/20260703094634/az_nova_backup_64e0c106-c41a-47bc-80c1-33370700f504-00013": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 629145600\n }\n },\n {\n "volume_87113756-5260-460f-864c-3fb466e6be45/20260703094634/az_nova_backup_64e0c106-c41a-47bc-80c1-33370700f504-00014": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 681574400\n }\n },\n {\n "volume_87113756-5260-460f-864c-3fb466e6be45/20260703094634/az_nova_backup_64e0c106-c41a-47bc-80c1-33370700f504-00015": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 734003200\n }\n },\n {\n "volume_87113756-5260-460f-864c-3fb466e6be45/20260703094634/az_nova_backup_64e0c106-c41a-47bc-80c1-33370700f504-00016": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 786432000\n }\n },\n {\n "volume_87113756-5260-460f-864c-3fb466e6be45/20260703094634/az_nova_backup_64e0c106-c41a-47bc-80c1-33370700f504-00017": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 838860800\n }\n },\n {\n "volume_87113756-5260-460f-864c-3fb466e6be45/20260703094634/az_nova_backup_64e0c106-c41a-47bc-80c1-33370700f504-00018": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 891289600\n }\n },\n {\n "volume_87113756-5260-460f-864c-3fb466e6be45/20260703094634/az_nova_backup_64e0c106-c41a-47bc-80c1-33370700f504-00019": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 943718400\n }\n },\n {\n "volume_87113756-5260-460f-864c-3fb466e6be45/20260703094634/az_nova_backup_64e0c106-c41a-47bc-80c1-33370700f504-00020": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 996147200\n }\n },\n {\n "volume_87113756-5260-460f-864c-3fb466e6be45/20260703094634/az_nova_backup_64e0c106-c41a-47bc-80c1-33370700f504-00021": {\n "compression": "zlib",\n "length": 25165824,\n "md5": "77377273b0a4b61febdbf7bbf52b9db9",\n "offset": 1048576000\n }\n }\n ],\n "parent_id": null,\n "version": "1.0.0",\n "volume_id": "87113756-5260-460f-864c-3fb466e6be45",\n "volume_meta": "{\\"version\\": 2, \\"volume-base-metadata\\": {\\"id\\": \\"87113756-5260-460f-864c-3fb466e6be45\\", \\"_name_id\\": null, \\"use_quota\\": true, \\"ec2_id\\": null, \\"user_id\\": \\"23ba560f6eed465495956e82c26b6f69\\", \\"project_id\\": \\"a2309d0555a742279b4a5017d94ebf02\\", \\"snapshot_id\\": null, \\"cluster_name\\": null, \\"host\\": \\"np0000004400@storpool#default\\", \\"size\\": 1, \\"availability_zone\\": \\"nova\\", \\"status\\": \\"backing-up\\", \\"attach_status\\": \\"detached\\", \\"migration_status\\": null, \\"scheduled_at\\": \\"2026-07-03T09:46:30.000000\\", \\"launched_at\\": \\"2026-07-03T09:46:30.000000\\", \\"terminated_at\\": null, \\"display_name\\": \\"tempest-VolumeV3RbacBaseTests-Volume-2049209242\\", \\"display_description\\": null, \\"provider_location\\": null, \\"provider_auth\\": null, \\"provider_geometry\\": null, \\"provider_id\\": null, \\"volume_type_id\\": \\"03e13fe6-0e30-4803-ace0-725d38e6dc24\\", \\"source_volid\\": null, \\"encryption_key_id\\": null, \\"consistencygroup_id\\": null, \\"group_id\\": null, \\"bootable\\": false, \\"multiattach\\": false, \\"replication_status\\": null, \\"replication_extended_status\\": null, \\"replication_driver_data\\": null, \\"previous_status\\": \\"available\\", \\"service_uuid\\": \\"6d4b0e79-fefe-4744-b25f-34be05095200\\", \\"shared_targets\\": true, \\"deleted_at\\": null, \\"deleted\\": false, \\"created_at\\": \\"2026-07-03T09:46:30.000000\\", \\"updated_at\\": \\"2026-07-03T09:46:31.000000\\"}}"\n}'. {{(pid=101319) _write_metadata /opt/stack/cinder/cinder/backup/chunkeddriver.py:295}} Jul 03 09:46:46.362588 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-ab6b0b80-b0fb-4af3-b356-0a2a830796d4 tempest-ProjectAdminTests33-1900627284 None] backup 64e0c106-c41a-47bc-80c1-33370700f504 finished. {{(pid=101319) _finalize_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:462}} Jul 03 09:46:46.491674 np0000004400 cinder-backup[101319]: DEBUG oslo_concurrency.processutils [None req-ab6b0b80-b0fb-4af3-b356-0a2a830796d4 tempest-ProjectAdminTests33-1900627284 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chown 0 /dev/sdb {{(pid=101319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 09:46:46.511378 np0000004400 sudo[139302]: stack : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chown 0 /dev/sdb Jul 03 09:46:46.512184 np0000004400 sudo[139302]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1002) Jul 03 09:46:46.838369 np0000004400 sudo[139302]: pam_unix(sudo:session): session closed for user root Jul 03 09:46:46.840557 np0000004400 cinder-backup[101319]: DEBUG oslo_concurrency.processutils [None req-ab6b0b80-b0fb-4af3-b356-0a2a830796d4 tempest-ProjectAdminTests33-1900627284 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chown 0 /dev/sdb" returned: 0 in 0.349s {{(pid=101319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 09:46:46.841276 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-ab6b0b80-b0fb-4af3-b356-0a2a830796d4 tempest-ProjectAdminTests33-1900627284 None] ==> disconnect_volume: call "{'args': (, {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-87113756-5260-460f-864c-3fb466e6be45', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '87113756-5260-460f-864c-3fb466e6be45', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': False}, {'type': 'block', 'scsi_wwn': '3300000006af70a75', 'path': '/dev/sdb'}), 'kwargs': {'force': True, 'ignore_errors': True}}" {{(pid=101319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}} Jul 03 09:46:46.841527 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.base [None req-ab6b0b80-b0fb-4af3-b356-0a2a830796d4 tempest-ProjectAdminTests33-1900627284 None] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=101319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jul 03 09:46:46.842035 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.base [None req-ab6b0b80-b0fb-4af3-b356-0a2a830796d4 tempest-ProjectAdminTests33-1900627284 None] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=101319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jul 03 09:46:46.842497 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-ab6b0b80-b0fb-4af3-b356-0a2a830796d4 tempest-ProjectAdminTests33-1900627284 None] _get_connection_devices called with parameters: connection_properties={'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-87113756-5260-460f-864c-3fb466e6be45', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '87113756-5260-460f-864c-3fb466e6be45', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': False}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=101319) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:847}} Jul 03 09:46:46.856835 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-ab6b0b80-b0fb-4af3-b356-0a2a830796d4 tempest-ProjectAdminTests33-1900627284 None] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS: Jul 03 09:46:46.856835 np0000004400 cinder-backup[101319]: No targets found. Jul 03 09:46:46.856835 np0000004400 cinder-backup[101319]: iSNS: Jul 03 09:46:46.856835 np0000004400 cinder-backup[101319]: No targets found. Jul 03 09:46:46.856835 np0000004400 cinder-backup[101319]: STATIC: Jul 03 09:46:46.856835 np0000004400 cinder-backup[101319]: Target: iqn.2023-03.storpool.com:os--volume-76320525-737e-4f58-8523-63ec9abbdc64 Jul 03 09:46:46.856835 np0000004400 cinder-backup[101319]: Portal: 192.168.50.100:3260,-1 Jul 03 09:46:46.856835 np0000004400 cinder-backup[101319]: Iface Name: default Jul 03 09:46:46.856835 np0000004400 cinder-backup[101319]: Portal: 192.168.40.100:3260,-1 Jul 03 09:46:46.856835 np0000004400 cinder-backup[101319]: Iface Name: default Jul 03 09:46:46.856835 np0000004400 cinder-backup[101319]: Target: iqn.2023-03.storpool.com:os--volume-72e07e1e-1567-4071-8204-c29cb26d2660 Jul 03 09:46:46.856835 np0000004400 cinder-backup[101319]: Portal: 192.168.50.100:3260,-1 Jul 03 09:46:46.856835 np0000004400 cinder-backup[101319]: Iface Name: default Jul 03 09:46:46.856835 np0000004400 cinder-backup[101319]: Portal: 192.168.40.100:3260,-1 Jul 03 09:46:46.856835 np0000004400 cinder-backup[101319]: Iface Name: default Jul 03 09:46:46.856835 np0000004400 cinder-backup[101319]: Target: iqn.2023-03.storpool.com:os--volume-87113756-5260-460f-864c-3fb466e6be45 Jul 03 09:46:46.856835 np0000004400 cinder-backup[101319]: Portal: 192.168.40.100:3260,-1 Jul 03 09:46:46.856835 np0000004400 cinder-backup[101319]: Iface Name: default Jul 03 09:46:46.856835 np0000004400 cinder-backup[101319]: Target: iqn.2023-03.storpool.com:os--volume-d47f5d2f-dce5-42f7-a693-a654fd702622 Jul 03 09:46:46.856835 np0000004400 cinder-backup[101319]: Portal: 192.168.50.100:3260,-1 Jul 03 09:46:46.856835 np0000004400 cinder-backup[101319]: Iface Name: default Jul 03 09:46:46.856835 np0000004400 cinder-backup[101319]: Portal: 192.168.40.100:3260,-1 Jul 03 09:46:46.856835 np0000004400 cinder-backup[101319]: Iface Name: default Jul 03 09:46:46.856835 np0000004400 cinder-backup[101319]: Target: iqn.2023-03.storpool.com:os--volume-6713aeef-c919-4102-a884-a71545173837 Jul 03 09:46:46.856835 np0000004400 cinder-backup[101319]: Portal: 192.168.50.100:3260,-1 Jul 03 09:46:46.856835 np0000004400 cinder-backup[101319]: Iface Name: default Jul 03 09:46:46.856835 np0000004400 cinder-backup[101319]: Portal: 192.168.40.100:3260,-1 Jul 03 09:46:46.856835 np0000004400 cinder-backup[101319]: Iface Name: default Jul 03 09:46:46.856835 np0000004400 cinder-backup[101319]: FIRMWARE: Jul 03 09:46:46.856835 np0000004400 cinder-backup[101319]: No targets found. Jul 03 09:46:46.856835 np0000004400 cinder-backup[101319]: stderr= {{(pid=101319) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jul 03 09:46:46.857483 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-ab6b0b80-b0fb-4af3-b356-0a2a830796d4 tempest-ProjectAdminTests33-1900627284 None] Regex to get portals from discoverydb: ^SENDTARGETS: Jul 03 09:46:46.857483 np0000004400 cinder-backup[101319]: .*?^DiscoveryAddress: 192.168.40.100,3260.*? Jul 03 09:46:46.857483 np0000004400 cinder-backup[101319]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=101319) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:390}} Jul 03 09:46:46.857483 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-ab6b0b80-b0fb-4af3-b356-0a2a830796d4 tempest-ProjectAdminTests33-1900627284 None] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-87113756-5260-460f-864c-3fb466e6be45', 0)] {{(pid=101319) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:858}} Jul 03 09:46:46.887811 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-ab6b0b80-b0fb-4af3-b356-0a2a830796d4 tempest-ProjectAdminTests33-1900627284 None] iscsiadm ('-m', 'session'): stdout=tcp: [110] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6713aeef-c919-4102-a884-a71545173837 (non-flash) Jul 03 09:46:46.887811 np0000004400 cinder-backup[101319]: tcp: [111] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-6713aeef-c919-4102-a884-a71545173837 (non-flash) Jul 03 09:46:46.887811 np0000004400 cinder-backup[101319]: tcp: [113] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-72e07e1e-1567-4071-8204-c29cb26d2660 (non-flash) Jul 03 09:46:46.887811 np0000004400 cinder-backup[101319]: tcp: [114] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-72e07e1e-1567-4071-8204-c29cb26d2660 (non-flash) Jul 03 09:46:46.887811 np0000004400 cinder-backup[101319]: tcp: [115] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-87113756-5260-460f-864c-3fb466e6be45 (non-flash) Jul 03 09:46:46.887811 np0000004400 cinder-backup[101319]: tcp: [82] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-76320525-737e-4f58-8523-63ec9abbdc64 (non-flash) Jul 03 09:46:46.887811 np0000004400 cinder-backup[101319]: tcp: [83] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-76320525-737e-4f58-8523-63ec9abbdc64 (non-flash) Jul 03 09:46:46.887811 np0000004400 cinder-backup[101319]: tcp: [97] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d47f5d2f-dce5-42f7-a693-a654fd702622 (non-flash) Jul 03 09:46:46.887811 np0000004400 cinder-backup[101319]: tcp: [98] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d47f5d2f-dce5-42f7-a693-a654fd702622 (non-flash) Jul 03 09:46:46.887811 np0000004400 cinder-backup[101319]: stderr= {{(pid=101319) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jul 03 09:46:46.888082 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-ab6b0b80-b0fb-4af3-b356-0a2a830796d4 tempest-ProjectAdminTests33-1900627284 None] iscsi session list stdout=tcp: [110] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6713aeef-c919-4102-a884-a71545173837 (non-flash) Jul 03 09:46:46.888082 np0000004400 cinder-backup[101319]: tcp: [111] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-6713aeef-c919-4102-a884-a71545173837 (non-flash) Jul 03 09:46:46.888082 np0000004400 cinder-backup[101319]: tcp: [113] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-72e07e1e-1567-4071-8204-c29cb26d2660 (non-flash) Jul 03 09:46:46.888082 np0000004400 cinder-backup[101319]: tcp: [114] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-72e07e1e-1567-4071-8204-c29cb26d2660 (non-flash) Jul 03 09:46:46.888082 np0000004400 cinder-backup[101319]: tcp: [115] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-87113756-5260-460f-864c-3fb466e6be45 (non-flash) Jul 03 09:46:46.888082 np0000004400 cinder-backup[101319]: tcp: [82] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-76320525-737e-4f58-8523-63ec9abbdc64 (non-flash) Jul 03 09:46:46.888082 np0000004400 cinder-backup[101319]: tcp: [83] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-76320525-737e-4f58-8523-63ec9abbdc64 (non-flash) Jul 03 09:46:46.888082 np0000004400 cinder-backup[101319]: tcp: [97] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d47f5d2f-dce5-42f7-a693-a654fd702622 (non-flash) Jul 03 09:46:46.888082 np0000004400 cinder-backup[101319]: tcp: [98] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d47f5d2f-dce5-42f7-a693-a654fd702622 (non-flash) Jul 03 09:46:46.888082 np0000004400 cinder-backup[101319]: stderr= {{(pid=101319) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jul 03 09:46:46.888309 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-ab6b0b80-b0fb-4af3-b356-0a2a830796d4 tempest-ProjectAdminTests33-1900627284 None] Sessions list: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-6713aeef-c919-4102-a884-a71545173837', '110'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-6713aeef-c919-4102-a884-a71545173837', '111'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-72e07e1e-1567-4071-8204-c29cb26d2660', '113'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-72e07e1e-1567-4071-8204-c29cb26d2660', '114'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-87113756-5260-460f-864c-3fb466e6be45', '115'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-76320525-737e-4f58-8523-63ec9abbdc64', '82'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-76320525-737e-4f58-8523-63ec9abbdc64', '83'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-d47f5d2f-dce5-42f7-a693-a654fd702622', '97'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-d47f5d2f-dce5-42f7-a693-a654fd702622', '98')] {{(pid=101319) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:866}} Jul 03 09:46:46.888416 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-ab6b0b80-b0fb-4af3-b356-0a2a830796d4 tempest-ProjectAdminTests33-1900627284 None] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-87113756-5260-460f-864c-3fb466e6be45, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-87113756-5260-460f-864c-3fb466e6be45', '115')] {{(pid=101319) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}} Jul 03 09:46:46.889524 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-ab6b0b80-b0fb-4af3-b356-0a2a830796d4 tempest-ProjectAdminTests33-1900627284 None] Resulting device map defaultdict(. at 0x7e7705876840>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-87113756-5260-460f-864c-3fb466e6be45'): ({'sdb'}, set())}) {{(pid=101319) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:912}} Jul 03 09:46:46.889791 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.linuxscsi [None req-ab6b0b80-b0fb-4af3-b356-0a2a830796d4 tempest-ProjectAdminTests33-1900627284 None] Removing single pathed devices sdb {{(pid=101319) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}} Jul 03 09:46:46.900367 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.linuxscsi [None req-ab6b0b80-b0fb-4af3-b356-0a2a830796d4 tempest-ProjectAdminTests33-1900627284 None] Flushing IO for device /dev/sdb {{(pid=101319) flush_device_io /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:461}} Jul 03 09:46:46.912007 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.linuxscsi [None req-ab6b0b80-b0fb-4af3-b356-0a2a830796d4 tempest-ProjectAdminTests33-1900627284 None] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=101319) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}} Jul 03 09:46:46.967625 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.linuxscsi [None req-ab6b0b80-b0fb-4af3-b356-0a2a830796d4 tempest-ProjectAdminTests33-1900627284 None] Checking to see if SCSI volumes sdb have been removed. {{(pid=101319) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}} Jul 03 09:46:46.967997 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.linuxscsi [None req-ab6b0b80-b0fb-4af3-b356-0a2a830796d4 tempest-ProjectAdminTests33-1900627284 None] SCSI volumes sdb have been removed. {{(pid=101319) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}} Jul 03 09:46:46.969386 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.linuxscsi [None req-ab6b0b80-b0fb-4af3-b356-0a2a830796d4 tempest-ProjectAdminTests33-1900627284 None] Checking to see if device paths {'sdb'} are still under multipathd monitoring {{(pid=101319) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}} Jul 03 09:46:46.988398 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.linuxscsi [None req-ab6b0b80-b0fb-4af3-b356-0a2a830796d4 tempest-ProjectAdminTests33-1900627284 None] Device paths {'sdb'} have been removed from multipathd monitoring. {{(pid=101319) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}} Jul 03 09:46:46.988611 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-ab6b0b80-b0fb-4af3-b356-0a2a830796d4 tempest-ProjectAdminTests33-1900627284 None] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-87113756-5260-460f-864c-3fb466e6be45')] {{(pid=101319) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1225}} Jul 03 09:46:47.002257 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-ab6b0b80-b0fb-4af3-b356-0a2a830796d4 tempest-ProjectAdminTests33-1900627284 None] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=101319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 03 09:46:47.035517 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-ab6b0b80-b0fb-4af3-b356-0a2a830796d4 tempest-ProjectAdminTests33-1900627284 None] iscsiadm ('--logout',): stdout=Logging out of session [sid: 115, target: iqn.2023-03.storpool.com:os--volume-87113756-5260-460f-864c-3fb466e6be45, portal: 192.168.40.100,3260] Jul 03 09:46:47.035517 np0000004400 cinder-backup[101319]: Logout of [sid: 115, target: iqn.2023-03.storpool.com:os--volume-87113756-5260-460f-864c-3fb466e6be45, portal: 192.168.40.100,3260] successful. Jul 03 09:46:47.035517 np0000004400 cinder-backup[101319]: stderr= {{(pid=101319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 03 09:46:47.052095 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-ab6b0b80-b0fb-4af3-b356-0a2a830796d4 tempest-ProjectAdminTests33-1900627284 None] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=101319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 03 09:46:47.052480 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.base [None req-ab6b0b80-b0fb-4af3-b356-0a2a830796d4 tempest-ProjectAdminTests33-1900627284 None] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.210s {{(pid=101319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jul 03 09:46:47.052726 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-ab6b0b80-b0fb-4af3-b356-0a2a830796d4 tempest-ProjectAdminTests33-1900627284 None] <== disconnect_volume: return (210ms) None {{(pid=101319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}} Jul 03 09:46:48.085381 np0000004400 cinder-backup[101319]: INFO cinder.backup.manager [None req-ab6b0b80-b0fb-4af3-b356-0a2a830796d4 tempest-ProjectAdminTests33-1900627284 None] Create backup finished. backup: 64e0c106-c41a-47bc-80c1-33370700f504. Jul 03 09:46:48.694925 np0000004400 cinder-backup[101319]: INFO cinder.backup.manager [None req-c8394971-084f-4594-a0a9-da948fab1098 tempest-ProjectAdminTests33-1900627284 None] Reset backup status started, backup_id: 64e0c106-c41a-47bc-80c1-33370700f504, status: error. Jul 03 09:46:48.695068 np0000004400 cinder-backup[101319]: INFO cinder.backup.manager [None req-c8394971-084f-4594-a0a9-da948fab1098 tempest-ProjectAdminTests33-1900627284 None] Backup service: cinder.backup.drivers.swift.SwiftBackupDriver. Jul 03 09:46:51.027186 np0000004400 cinder-backup[101319]: INFO cinder.backup.manager [None req-90f98a9f-c4f1-4c4e-a984-1f6f6f0a3431 tempest-ProjectAdminTests33-1900627284 None] Restore backup started, backup: cfdc4925-e984-4da2-aa3e-e1e8a7c37558 volume: 2f85e2c7-ae08-48ab-bf50-358f3320874d. Jul 03 09:46:51.051521 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.drivers.swift [None req-90f98a9f-c4f1-4c4e-a984-1f6f6f0a3431 tempest-ProjectAdminTests33-1900627284 None] Using swift URL https://10.4.3.95:8080/v1/AUTH_a2309d0555a742279b4a5017d94ebf02 {{(pid=101319) initialize /opt/stack/cinder/cinder/backup/drivers/swift.py:300}} Jul 03 09:46:51.051862 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.drivers.swift [None req-90f98a9f-c4f1-4c4e-a984-1f6f6f0a3431 tempest-ProjectAdminTests33-1900627284 None] Connect to https://10.4.3.95:8080/v1/AUTH_ in "per_user" mode {{(pid=101319) initialize /opt/stack/cinder/cinder/backup/drivers/swift.py:301}} Jul 03 09:46:51.052214 np0000004400 cinder-backup[101319]: DEBUG os_brick.utils [None req-90f98a9f-c4f1-4c4e-a984-1f6f6f0a3431 tempest-ProjectAdminTests33-1900627284 None] ==> get_connector_properties: call "{'root_helper': 'sudo cinder-rootwrap /etc/cinder/rootwrap.conf', 'my_ip': '10.4.3.95', 'multipath': False, 'enforce_multipath': False, 'host': None, 'execute': None}" {{(pid=101319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}} Jul 03 09:46:51.065072 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.scaleio [None req-90f98a9f-c4f1-4c4e-a984-1f6f6f0a3431 tempest-ProjectAdminTests33-1900627284 None] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=101319) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}} Jul 03 09:46:51.086098 np0000004400 cinder-backup[101319]: DEBUG oslo_concurrency.processutils [None req-90f98a9f-c4f1-4c4e-a984-1f6f6f0a3431 tempest-ProjectAdminTests33-1900627284 None] Running cmd (subprocess): nvme version {{(pid=101319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 09:46:51.097228 np0000004400 cinder-backup[101319]: DEBUG oslo_concurrency.processutils [None req-90f98a9f-c4f1-4c4e-a984-1f6f6f0a3431 tempest-ProjectAdminTests33-1900627284 None] 'nvme version' failed. Not Retrying. {{(pid=101319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 03 09:46:51.097488 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.nvmeof [None req-90f98a9f-c4f1-4c4e-a984-1f6f6f0a3431 tempest-ProjectAdminTests33-1900627284 None] nvme not present on system {{(pid=101319) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}} Jul 03 09:46:51.105612 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.lightos [None req-90f98a9f-c4f1-4c4e-a984-1f6f6f0a3431 tempest-ProjectAdminTests33-1900627284 None] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=101319) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}} Jul 03 09:46:51.106796 np0000004400 cinder-backup[101319]: INFO os_brick.initiator.connectors.lightos [None req-90f98a9f-c4f1-4c4e-a984-1f6f6f0a3431 tempest-ProjectAdminTests33-1900627284 None] Current host hostNQN and IP(s) are ['10.4.3.95', 'fe80::f816:3eff:fe47:268c', '192.168.40.6', 'fe80::f816:3eff:febf:7be2', '192.168.50.6', 'fe80::f816:3eff:fe99:8914', '192.168.10.6', 'fe80::f816:3eff:fe2f:e696', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::bc9d:84ff:fec2:6b49', 'fe80::fc16:3eff:fea0:4147', 'fe80::b0cf:48ff:fe29:caf0', 'fe80::fc16:3eff:fe91:aa0', 'fe80::fc16:3eff:fe16:6cb1', 'fe80::4075:8aff:feff:e907', 'fe80::fc16:3eff:fe97:90a6', 'fe80::8435:18ff:feb9:798c', 'fe80::fc16:3eff:feda:9a9f', 'fe80::28c1:27ff:fe3c:5528', 'fe80::fc16:3eff:fe6d:bd46', 'fe80::58b4:29ff:fe5b:9557'] Jul 03 09:46:51.106924 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.lightos [None req-90f98a9f-c4f1-4c4e-a984-1f6f6f0a3431 tempest-ProjectAdminTests33-1900627284 None] LIGHTOS: did not find dsc, continuing anyway. {{(pid=101319) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}} Jul 03 09:46:51.107031 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.lightos [None req-90f98a9f-c4f1-4c4e-a984-1f6f6f0a3431 tempest-ProjectAdminTests33-1900627284 None] LIGHTOS: no hostnqn found. {{(pid=101319) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}} Jul 03 09:46:51.107292 np0000004400 cinder-backup[101319]: DEBUG os_brick.utils [None req-90f98a9f-c4f1-4c4e-a984-1f6f6f0a3431 tempest-ProjectAdminTests33-1900627284 None] <== get_connector_properties: return (54ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.95', 'host': 'np0000004400', 'multipath': False, 'enforce_multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:ae7e5bb0ebe6', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': '6b284368-d0ba-4d18-af6f-4998d3955c52', 'nvme_native_multipath': False} {{(pid=101319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}} Jul 03 09:46:52.114984 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connector [None req-90f98a9f-c4f1-4c4e-a984-1f6f6f0a3431 tempest-ProjectAdminTests33-1900627284 None] Factory for iscsi on None {{(pid=101319) factory /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connector.py:243}} Jul 03 09:46:52.115726 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-90f98a9f-c4f1-4c4e-a984-1f6f6f0a3431 tempest-ProjectAdminTests33-1900627284 None] ==> connect_volume: call "{'self': , 'connection_properties': {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-2f85e2c7-ae08-48ab-bf50-358f3320874d', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '2f85e2c7-ae08-48ab-bf50-358f3320874d', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': False}}" {{(pid=101319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}} Jul 03 09:46:52.115966 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.base [None req-90f98a9f-c4f1-4c4e-a984-1f6f6f0a3431 tempest-ProjectAdminTests33-1900627284 None] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=101319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jul 03 09:46:52.116483 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.base [None req-90f98a9f-c4f1-4c4e-a984-1f6f6f0a3431 tempest-ProjectAdminTests33-1900627284 None] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=101319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jul 03 09:46:52.116761 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.base [None req-90f98a9f-c4f1-4c4e-a984-1f6f6f0a3431 tempest-ProjectAdminTests33-1900627284 None] Connection properties {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-2f85e2c7-ae08-48ab-bf50-358f3320874d', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '2f85e2c7-ae08-48ab-bf50-358f3320874d', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': False} {{(pid=101319) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}} Jul 03 09:46:52.126950 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.base [None req-90f98a9f-c4f1-4c4e-a984-1f6f6f0a3431 tempest-ProjectAdminTests33-1900627284 None] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-2f85e2c7-ae08-48ab-bf50-358f3320874d" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=101319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jul 03 09:46:52.127393 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.base [None req-90f98a9f-c4f1-4c4e-a984-1f6f6f0a3431 tempest-ProjectAdminTests33-1900627284 None] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-2f85e2c7-ae08-48ab-bf50-358f3320874d" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=101319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jul 03 09:46:52.127682 np0000004400 cinder-backup[101319]: INFO os_brick.initiator.connectors.iscsi [None req-90f98a9f-c4f1-4c4e-a984-1f6f6f0a3431 tempest-ProjectAdminTests33-1900627284 None] Trying to connect to iSCSI portal 192.168.40.100:3260 Jul 03 09:46:52.138451 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-90f98a9f-c4f1-4c4e-a984-1f6f6f0a3431 tempest-ProjectAdminTests33-1900627284 None] iscsiadm (): stdout= stderr=iscsiadm: No records found Jul 03 09:46:52.138451 np0000004400 cinder-backup[101319]: {{(pid=101319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 03 09:46:52.149048 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-90f98a9f-c4f1-4c4e-a984-1f6f6f0a3431 tempest-ProjectAdminTests33-1900627284 None] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-2f85e2c7-ae08-48ab-bf50-358f3320874d] added Jul 03 09:46:52.149048 np0000004400 cinder-backup[101319]: stderr=iscsiadm: Config file line 363 does not have value Jul 03 09:46:52.149048 np0000004400 cinder-backup[101319]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs' Jul 03 09:46:52.149048 np0000004400 cinder-backup[101319]: iscsiadm: Config file line 363 does not have value Jul 03 09:46:52.149048 np0000004400 cinder-backup[101319]: iscsiadm: Config file line 363 does not have value Jul 03 09:46:52.149048 np0000004400 cinder-backup[101319]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs' Jul 03 09:46:52.149048 np0000004400 cinder-backup[101319]: {{(pid=101319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 03 09:46:52.149360 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-90f98a9f-c4f1-4c4e-a984-1f6f6f0a3431 tempest-ProjectAdminTests33-1900627284 None] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=101319) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}} Jul 03 09:46:52.149644 np0000004400 cinder-backup[101319]: DEBUG os_brick.utils [None req-90f98a9f-c4f1-4c4e-a984-1f6f6f0a3431 tempest-ProjectAdminTests33-1900627284 None] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0219(s), this was the 1st time calling it. {{(pid=101319) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}} Jul 03 09:46:52.149918 np0000004400 cinder-backup[101319]: DEBUG os_brick.utils [None req-90f98a9f-c4f1-4c4e-a984-1f6f6f0a3431 tempest-ProjectAdminTests33-1900627284 None] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=101319) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}} Jul 03 09:46:53.152007 np0000004400 cinder-backup[101319]: INFO os_brick.initiator.connectors.iscsi [None req-90f98a9f-c4f1-4c4e-a984-1f6f6f0a3431 tempest-ProjectAdminTests33-1900627284 None] Trying to connect to iSCSI portal 192.168.40.100:3260 Jul 03 09:46:53.176711 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-90f98a9f-c4f1-4c4e-a984-1f6f6f0a3431 tempest-ProjectAdminTests33-1900627284 None] iscsiadm (): stdout=# BEGIN RECORD 2.1.9 Jul 03 09:46:53.176711 np0000004400 cinder-backup[101319]: node.name = iqn.2023-03.storpool.com:os--volume-2f85e2c7-ae08-48ab-bf50-358f3320874d Jul 03 09:46:53.176711 np0000004400 cinder-backup[101319]: node.tpgt = -1 Jul 03 09:46:53.176711 np0000004400 cinder-backup[101319]: node.startup = manual Jul 03 09:46:53.176711 np0000004400 cinder-backup[101319]: node.leading_login = No Jul 03 09:46:53.176711 np0000004400 cinder-backup[101319]: iface.iscsi_ifacename = default Jul 03 09:46:53.176711 np0000004400 cinder-backup[101319]: iface.net_ifacename = Jul 03 09:46:53.176711 np0000004400 cinder-backup[101319]: iface.ipaddress = Jul 03 09:46:53.176711 np0000004400 cinder-backup[101319]: iface.prefix_len = 0 Jul 03 09:46:53.176711 np0000004400 cinder-backup[101319]: iface.hwaddress = Jul 03 09:46:53.176711 np0000004400 cinder-backup[101319]: iface.transport_name = tcp Jul 03 09:46:53.176711 np0000004400 cinder-backup[101319]: iface.initiatorname = Jul 03 09:46:53.176711 np0000004400 cinder-backup[101319]: iface.state = Jul 03 09:46:53.176711 np0000004400 cinder-backup[101319]: iface.vlan_id = 0 Jul 03 09:46:53.176711 np0000004400 cinder-backup[101319]: iface.vlan_priority = 0 Jul 03 09:46:53.176711 np0000004400 cinder-backup[101319]: iface.vlan_state = Jul 03 09:46:53.176711 np0000004400 cinder-backup[101319]: iface.iface_num = 0 Jul 03 09:46:53.176711 np0000004400 cinder-backup[101319]: iface.mtu = 0 Jul 03 09:46:53.176711 np0000004400 cinder-backup[101319]: iface.port = 0 Jul 03 09:46:53.176711 np0000004400 cinder-backup[101319]: iface.bootproto = Jul 03 09:46:53.176711 np0000004400 cinder-backup[101319]: iface.subnet_mask = Jul 03 09:46:53.176711 np0000004400 cinder-backup[101319]: iface.gateway = Jul 03 09:46:53.176711 np0000004400 cinder-backup[101319]: iface.dhcp_alt_client_id_state = Jul 03 09:46:53.176711 np0000004400 cinder-backup[101319]: iface.dhcp_alt_client_id = Jul 03 09:46:53.176711 np0000004400 cinder-backup[101319]: iface.dhcp_dns = Jul 03 09:46:53.176711 np0000004400 cinder-backup[101319]: iface.dhcp_learn_iqn = Jul 03 09:46:53.176711 np0000004400 cinder-backup[101319]: iface.dhcp_req_vendor_id_state = Jul 03 09:46:53.176711 np0000004400 cinder-backup[101319]: iface.dhcp_vendor_id_state = Jul 03 09:46:53.176711 np0000004400 cinder-backup[101319]: iface.dhcp_vendor_id = Jul 03 09:46:53.176711 np0000004400 cinder-backup[101319]: iface.dhcp_slp_da = Jul 03 09:46:53.176711 np0000004400 cinder-backup[101319]: iface.fragmentation = Jul 03 09:46:53.176711 np0000004400 cinder-backup[101319]: iface.gratuitous_arp = Jul 03 09:46:53.176711 np0000004400 cinder-backup[101319]: iface.incoming_forwarding = Jul 03 09:46:53.176711 np0000004400 cinder-backup[101319]: iface.tos_state = Jul 03 09:46:53.176711 np0000004400 cinder-backup[101319]: iface.tos = 0 Jul 03 09:46:53.176711 np0000004400 cinder-backup[101319]: iface.ttl = 0 Jul 03 09:46:53.176711 np0000004400 cinder-backup[101319]: iface.delayed_ack = Jul 03 09:46:53.176711 np0000004400 cinder-backup[101319]: iface.tcp_nagle = Jul 03 09:46:53.176711 np0000004400 cinder-backup[101319]: iface.tcp_wsf_state = Jul 03 09:46:53.176711 np0000004400 cinder-backup[101319]: iface.tcp_wsf = 0 Jul 03 09:46:53.176711 np0000004400 cinder-backup[101319]: iface.tcp_timer_scale = 0 Jul 03 09:46:53.176711 np0000004400 cinder-backup[101319]: iface.tcp_timestamp = Jul 03 09:46:53.176711 np0000004400 cinder-backup[101319]: iface.redirect = Jul 03 09:46:53.176711 np0000004400 cinder-backup[101319]: iface.def_task_mgmt_timeout = 0 Jul 03 09:46:53.176711 np0000004400 cinder-backup[101319]: iface.header_digest = Jul 03 09:46:53.176711 np0000004400 cinder-backup[101319]: iface.data_digest = Jul 03 09:46:53.176711 np0000004400 cinder-backup[101319]: iface.immediate_data = Jul 03 09:46:53.176711 np0000004400 cinder-backup[101319]: iface.initial_r2t = Jul 03 09:46:53.176711 np0000004400 cinder-backup[101319]: iface.data_seq_inorder = Jul 03 09:46:53.176711 np0000004400 cinder-backup[101319]: iface.data_pdu_inorder = Jul 03 09:46:53.176711 np0000004400 cinder-backup[101319]: iface.erl = 0 Jul 03 09:46:53.176711 np0000004400 cinder-backup[101319]: iface.max_receive_data_len = 0 Jul 03 09:46:53.176711 np0000004400 cinder-backup[101319]: iface.first_burst_len = 0 Jul 03 09:46:53.176711 np0000004400 cinder-backup[101319]: iface.max_outstanding_r2t = 0 Jul 03 09:46:53.176711 np0000004400 cinder-backup[101319]: iface.max_burst_len = 0 Jul 03 09:46:53.176711 np0000004400 cinder-backup[101319]: iface.chap_auth = Jul 03 09:46:53.176711 np0000004400 cinder-backup[101319]: iface.bidi_chap = Jul 03 09:46:53.176711 np0000004400 cinder-backup[101319]: iface.strict_login_compliance = Jul 03 09:46:53.176711 np0000004400 cinder-backup[101319]: iface.discovery_auth = Jul 03 09:46:53.176711 np0000004400 cinder-backup[101319]: iface.discovery_logout = Jul 03 09:46:53.176711 np0000004400 cinder-backup[101319]: node.discovery_address = Jul 03 09:46:53.176711 np0000004400 cinder-backup[101319]: node.discovery_port = 0 Jul 03 09:46:53.176711 np0000004400 cinder-backup[101319]: node.discovery_type = fw Jul 03 09:46:53.176711 np0000004400 cinder-backup[101319]: node.session.initial_cmdsn = 0 Jul 03 09:46:53.176711 np0000004400 cinder-backup[101319]: node.session.initial_login_retry_max = 8 Jul 03 09:46:53.176711 np0000004400 cinder-backup[101319]: node.session.xmit_thread_priority = 0 Jul 03 09:46:53.176711 np0000004400 cinder-backup[101319]: node.session.cmds_max = 128 Jul 03 09:46:53.176711 np0000004400 cinder-backup[101319]: node.session.queue_depth = 32 Jul 03 09:46:53.176711 np0000004400 cinder-backup[101319]: node.session.nr_sessions = 1 Jul 03 09:46:53.176711 np0000004400 cinder-backup[101319]: node.session.auth.authmethod = None Jul 03 09:46:53.176711 np0000004400 cinder-backup[101319]: node.session.auth.username = Jul 03 09:46:53.176711 np0000004400 cinder-backup[101319]: node.session.auth.password = *** Jul 03 09:46:53.176711 np0000004400 cinder-backup[101319]: node.session.auth.username_in = Jul 03 09:46:53.176711 np0000004400 cinder-backup[101319]: node.session.auth.password_in = Jul 03 09:46:53.176711 np0000004400 cinder-backup[101319]: node.session.auth.chap_algs = SHA256 Jul 03 09:46:53.176711 np0000004400 cinder-backup[101319]: node.session.timeo.replacement_timeout = 120 Jul 03 09:46:53.176711 np0000004400 cinder-backup[101319]: node.session.err_timeo.abort_timeout = 15 Jul 03 09:46:53.176711 np0000004400 cinder-backup[101319]: node.session.err_timeo.lu_reset_timeout = 30 Jul 03 09:46:53.176711 np0000004400 cinder-backup[101319]: node.session.err_timeo.tgt_reset_timeout = 30 Jul 03 09:46:53.176711 np0000004400 cinder-backup[101319]: node.session.err_timeo.host_reset_timeout = 60 Jul 03 09:46:53.176711 np0000004400 cinder-backup[101319]: node.session.iscsi.FastAbort = Yes Jul 03 09:46:53.176711 np0000004400 cinder-backup[101319]: node.session.iscsi.InitialR2T = No Jul 03 09:46:53.176711 np0000004400 cinder-backup[101319]: node.session.iscsi.ImmediateData = Yes Jul 03 09:46:53.176711 np0000004400 cinder-backup[101319]: node.session.iscsi.FirstBurstLength = 262144 Jul 03 09:46:53.176711 np0000004400 cinder-backup[101319]: node.session.iscsi.MaxBurstLength = 16776192 Jul 03 09:46:53.176711 np0000004400 cinder-backup[101319]: node.session.iscsi.DefaultTime2Retain = 0 Jul 03 09:46:53.176711 np0000004400 cinder-backup[101319]: node.session.iscsi.DefaultTime2Wait = 2 Jul 03 09:46:53.176711 np0000004400 cinder-backup[101319]: node.session.iscsi.MaxConnections = 1 Jul 03 09:46:53.176711 np0000004400 cinder-backup[101319]: node.session.iscsi.MaxOutstandingR2T = 1 Jul 03 09:46:53.176711 np0000004400 cinder-backup[101319]: node.session.iscsi.ERL = 0 Jul 03 09:46:53.176711 np0000004400 cinder-backup[101319]: node.session.scan = auto Jul 03 09:46:53.176711 np0000004400 cinder-backup[101319]: node.session.reopen_max = 0 Jul 03 09:46:53.176711 np0000004400 cinder-backup[101319]: node.conn[0].address = 192.168.40.100 Jul 03 09:46:53.176711 np0000004400 cinder-backup[101319]: node.conn[0].port = 3260 Jul 03 09:46:53.176711 np0000004400 cinder-backup[101319]: node.conn[0].startup = manual Jul 03 09:46:53.176711 np0000004400 cinder-backup[101319]: node.conn[0].tcp.window_size = 524288 Jul 03 09:46:53.176711 np0000004400 cinder-backup[101319]: node.conn[0].tcp.type_of_service = 0 Jul 03 09:46:53.176711 np0000004400 cinder-backup[101319]: node.conn[0].timeo.logout_timeout = 15 Jul 03 09:46:53.176711 np0000004400 cinder-backup[101319]: node.conn[0].timeo.login_timeout = 15 Jul 03 09:46:53.176711 np0000004400 cinder-backup[101319]: node.conn[0].timeo.auth_timeout = 45 Jul 03 09:46:53.176711 np0000004400 cinder-backup[101319]: node.conn[0].timeo.noop_out_interval = 5 Jul 03 09:46:53.176711 np0000004400 cinder-backup[101319]: node.conn[0].timeo.noop_out_timeout = 5 Jul 03 09:46:53.176711 np0000004400 cinder-backup[101319]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0 Jul 03 09:46:53.176711 np0000004400 cinder-backup[101319]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144 Jul 03 09:46:53.176711 np0000004400 cinder-backup[101319]: node.conn[0].iscsi.HeaderDigest = None Jul 03 09:46:53.176711 np0000004400 cinder-backup[101319]: node.conn[0].iscsi.DataDigest = None Jul 03 09:46:53.176711 np0000004400 cinder-backup[101319]: node.conn[0].iscsi.IFMarker = No Jul 03 09:46:53.176711 np0000004400 cinder-backup[101319]: node.conn[0].iscsi.OFMarker = No Jul 03 09:46:53.176711 np0000004400 cinder-backup[101319]: # END RECORD Jul 03 09:46:53.176711 np0000004400 cinder-backup[101319]: stderr= {{(pid=101319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 03 09:46:53.189983 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-90f98a9f-c4f1-4c4e-a984-1f6f6f0a3431 tempest-ProjectAdminTests33-1900627284 None] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=101319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 03 09:46:53.203762 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-90f98a9f-c4f1-4c4e-a984-1f6f6f0a3431 tempest-ProjectAdminTests33-1900627284 None] iscsiadm ('-m', 'session'): stdout=tcp: [113] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-72e07e1e-1567-4071-8204-c29cb26d2660 (non-flash) Jul 03 09:46:53.203762 np0000004400 cinder-backup[101319]: tcp: [114] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-72e07e1e-1567-4071-8204-c29cb26d2660 (non-flash) Jul 03 09:46:53.203762 np0000004400 cinder-backup[101319]: tcp: [82] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-76320525-737e-4f58-8523-63ec9abbdc64 (non-flash) Jul 03 09:46:53.203762 np0000004400 cinder-backup[101319]: tcp: [83] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-76320525-737e-4f58-8523-63ec9abbdc64 (non-flash) Jul 03 09:46:53.203762 np0000004400 cinder-backup[101319]: tcp: [97] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d47f5d2f-dce5-42f7-a693-a654fd702622 (non-flash) Jul 03 09:46:53.203762 np0000004400 cinder-backup[101319]: tcp: [98] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d47f5d2f-dce5-42f7-a693-a654fd702622 (non-flash) Jul 03 09:46:53.203762 np0000004400 cinder-backup[101319]: stderr= {{(pid=101319) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jul 03 09:46:53.203762 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-90f98a9f-c4f1-4c4e-a984-1f6f6f0a3431 tempest-ProjectAdminTests33-1900627284 None] iscsi session list stdout=tcp: [113] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-72e07e1e-1567-4071-8204-c29cb26d2660 (non-flash) Jul 03 09:46:53.203762 np0000004400 cinder-backup[101319]: tcp: [114] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-72e07e1e-1567-4071-8204-c29cb26d2660 (non-flash) Jul 03 09:46:53.203762 np0000004400 cinder-backup[101319]: tcp: [82] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-76320525-737e-4f58-8523-63ec9abbdc64 (non-flash) Jul 03 09:46:53.203762 np0000004400 cinder-backup[101319]: tcp: [83] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-76320525-737e-4f58-8523-63ec9abbdc64 (non-flash) Jul 03 09:46:53.203762 np0000004400 cinder-backup[101319]: tcp: [97] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d47f5d2f-dce5-42f7-a693-a654fd702622 (non-flash) Jul 03 09:46:53.203762 np0000004400 cinder-backup[101319]: tcp: [98] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d47f5d2f-dce5-42f7-a693-a654fd702622 (non-flash) Jul 03 09:46:53.203762 np0000004400 cinder-backup[101319]: stderr= {{(pid=101319) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jul 03 09:46:53.243997 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-90f98a9f-c4f1-4c4e-a984-1f6f6f0a3431 tempest-ProjectAdminTests33-1900627284 None] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-2f85e2c7-ae08-48ab-bf50-358f3320874d, portal: 192.168.40.100,3260] Jul 03 09:46:53.243997 np0000004400 cinder-backup[101319]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-2f85e2c7-ae08-48ab-bf50-358f3320874d, portal: 192.168.40.100,3260] successful. Jul 03 09:46:53.243997 np0000004400 cinder-backup[101319]: stderr= {{(pid=101319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 03 09:46:53.257374 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-90f98a9f-c4f1-4c4e-a984-1f6f6f0a3431 tempest-ProjectAdminTests33-1900627284 None] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=101319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 03 09:46:53.272765 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-90f98a9f-c4f1-4c4e-a984-1f6f6f0a3431 tempest-ProjectAdminTests33-1900627284 None] iscsiadm ('-m', 'session'): stdout=tcp: [113] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-72e07e1e-1567-4071-8204-c29cb26d2660 (non-flash) Jul 03 09:46:53.272765 np0000004400 cinder-backup[101319]: tcp: [114] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-72e07e1e-1567-4071-8204-c29cb26d2660 (non-flash) Jul 03 09:46:53.272765 np0000004400 cinder-backup[101319]: tcp: [118] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2f85e2c7-ae08-48ab-bf50-358f3320874d (non-flash) Jul 03 09:46:53.272765 np0000004400 cinder-backup[101319]: tcp: [82] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-76320525-737e-4f58-8523-63ec9abbdc64 (non-flash) Jul 03 09:46:53.272765 np0000004400 cinder-backup[101319]: tcp: [83] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-76320525-737e-4f58-8523-63ec9abbdc64 (non-flash) Jul 03 09:46:53.272765 np0000004400 cinder-backup[101319]: tcp: [97] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d47f5d2f-dce5-42f7-a693-a654fd702622 (non-flash) Jul 03 09:46:53.272765 np0000004400 cinder-backup[101319]: tcp: [98] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d47f5d2f-dce5-42f7-a693-a654fd702622 (non-flash) Jul 03 09:46:53.272765 np0000004400 cinder-backup[101319]: stderr= {{(pid=101319) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jul 03 09:46:53.273111 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-90f98a9f-c4f1-4c4e-a984-1f6f6f0a3431 tempest-ProjectAdminTests33-1900627284 None] iscsi session list stdout=tcp: [113] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-72e07e1e-1567-4071-8204-c29cb26d2660 (non-flash) Jul 03 09:46:53.273111 np0000004400 cinder-backup[101319]: tcp: [114] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-72e07e1e-1567-4071-8204-c29cb26d2660 (non-flash) Jul 03 09:46:53.273111 np0000004400 cinder-backup[101319]: tcp: [118] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2f85e2c7-ae08-48ab-bf50-358f3320874d (non-flash) Jul 03 09:46:53.273111 np0000004400 cinder-backup[101319]: tcp: [82] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-76320525-737e-4f58-8523-63ec9abbdc64 (non-flash) Jul 03 09:46:53.273111 np0000004400 cinder-backup[101319]: tcp: [83] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-76320525-737e-4f58-8523-63ec9abbdc64 (non-flash) Jul 03 09:46:53.273111 np0000004400 cinder-backup[101319]: tcp: [97] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d47f5d2f-dce5-42f7-a693-a654fd702622 (non-flash) Jul 03 09:46:53.273111 np0000004400 cinder-backup[101319]: tcp: [98] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d47f5d2f-dce5-42f7-a693-a654fd702622 (non-flash) Jul 03 09:46:53.273111 np0000004400 cinder-backup[101319]: stderr= {{(pid=101319) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jul 03 09:46:53.273340 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.base [None req-90f98a9f-c4f1-4c4e-a984-1f6f6f0a3431 tempest-ProjectAdminTests33-1900627284 None] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-2f85e2c7-ae08-48ab-bf50-358f3320874d" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.146s {{(pid=101319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jul 03 09:46:53.273432 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-90f98a9f-c4f1-4c4e-a984-1f6f6f0a3431 tempest-ProjectAdminTests33-1900627284 None] Connected to 192.168.40.100:3260 {{(pid=101319) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}} Jul 03 09:46:53.274346 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.linuxscsi [None req-90f98a9f-c4f1-4c4e-a984-1f6f6f0a3431 tempest-ProjectAdminTests33-1900627284 None] HCTL ('7', '-', '-', 0) found on session 118 with lun 0 {{(pid=101319) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}} Jul 03 09:46:53.274492 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.linuxscsi [None req-90f98a9f-c4f1-4c4e-a984-1f6f6f0a3431 tempest-ProjectAdminTests33-1900627284 None] Scanning host 7 c: -, t: -, l: 0) {{(pid=101319) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}} Jul 03 09:46:53.288839 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.linuxscsi [None req-90f98a9f-c4f1-4c4e-a984-1f6f6f0a3431 tempest-ProjectAdminTests33-1900627284 None] Searching for a device in session 118 and hctl ['7', '*', '*', 0] yield: None {{(pid=101319) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}} Jul 03 09:46:54.290007 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.linuxscsi [None req-90f98a9f-c4f1-4c4e-a984-1f6f6f0a3431 tempest-ProjectAdminTests33-1900627284 None] Searching for a device in session 118 and hctl ['7', '*', '*', 0] yield: sdb {{(pid=101319) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}} Jul 03 09:46:54.290450 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-90f98a9f-c4f1-4c4e-a984-1f6f6f0a3431 tempest-ProjectAdminTests33-1900627284 None] Connected to sdb using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-2f85e2c7-ae08-48ab-bf50-358f3320874d', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '2f85e2c7-ae08-48ab-bf50-358f3320874d', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': False} {{(pid=101319) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}} Jul 03 09:46:54.290783 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.base [None req-90f98a9f-c4f1-4c4e-a984-1f6f6f0a3431 tempest-ProjectAdminTests33-1900627284 None] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 2.174s {{(pid=101319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jul 03 09:46:54.290937 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-90f98a9f-c4f1-4c4e-a984-1f6f6f0a3431 tempest-ProjectAdminTests33-1900627284 None] <== connect_volume: return (2175ms) {'type': 'block', 'scsi_wwn': '330000000f4c3d716', 'path': '/dev/sdb'} {{(pid=101319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}} Jul 03 09:46:54.291239 np0000004400 cinder-backup[101319]: DEBUG oslo_concurrency.processutils [None req-90f98a9f-c4f1-4c4e-a984-1f6f6f0a3431 tempest-ProjectAdminTests33-1900627284 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chown 1002 /dev/sdb {{(pid=101319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 09:46:54.313372 np0000004400 sudo[139793]: stack : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chown 1002 /dev/sdb Jul 03 09:46:54.314156 np0000004400 sudo[139793]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1002) Jul 03 09:46:54.599334 np0000004400 sudo[139793]: pam_unix(sudo:session): session closed for user root Jul 03 09:46:54.601417 np0000004400 cinder-backup[101319]: DEBUG oslo_concurrency.processutils [None req-90f98a9f-c4f1-4c4e-a984-1f6f6f0a3431 tempest-ProjectAdminTests33-1900627284 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chown 1002 /dev/sdb" returned: 0 in 0.310s {{(pid=101319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 09:46:54.601908 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-90f98a9f-c4f1-4c4e-a984-1f6f6f0a3431 tempest-ProjectAdminTests33-1900627284 None] starting restore of backup volume_4b68dad5-e9a3-4bd1-84e2-ba745cb7bb83/20260703094505/az_nova_backup_cfdc4925-e984-4da2-aa3e-e1e8a7c37558 container: volumebackups, to new volume 2f85e2c7-ae08-48ab-bf50-358f3320874d, backup: cfdc4925-e984-4da2-aa3e-e1e8a7c37558. {{(pid=101319) restore /opt/stack/cinder/cinder/backup/chunkeddriver.py:761}} Jul 03 09:46:54.602071 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-90f98a9f-c4f1-4c4e-a984-1f6f6f0a3431 tempest-ProjectAdminTests33-1900627284 None] _read_metadata started, container name: volumebackups, metadata filename: volume_4b68dad5-e9a3-4bd1-84e2-ba745cb7bb83/20260703094505/az_nova_backup_cfdc4925-e984-4da2-aa3e-e1e8a7c37558_metadata. {{(pid=101319) _read_metadata /opt/stack/cinder/cinder/backup/chunkeddriver.py:320}} Jul 03 09:46:54.620498 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-90f98a9f-c4f1-4c4e-a984-1f6f6f0a3431 tempest-ProjectAdminTests33-1900627284 None] _read_metadata finished. Metadata: { Jul 03 09:46:54.620498 np0000004400 cinder-backup[101319]: "backup_description": null, Jul 03 09:46:54.620498 np0000004400 cinder-backup[101319]: "backup_id": "cfdc4925-e984-4da2-aa3e-e1e8a7c37558", Jul 03 09:46:54.620498 np0000004400 cinder-backup[101319]: "backup_name": "tempest-type-Backup-880845111", Jul 03 09:46:54.620498 np0000004400 cinder-backup[101319]: "created_at": "2026-07-03 09:45:01+00:00", Jul 03 09:46:54.620498 np0000004400 cinder-backup[101319]: "objects": [ Jul 03 09:46:54.620498 np0000004400 cinder-backup[101319]: { Jul 03 09:46:54.620498 np0000004400 cinder-backup[101319]: "volume_4b68dad5-e9a3-4bd1-84e2-ba745cb7bb83/20260703094505/az_nova_backup_cfdc4925-e984-4da2-aa3e-e1e8a7c37558-00001": { Jul 03 09:46:54.620498 np0000004400 cinder-backup[101319]: "compression": "zlib", Jul 03 09:46:54.620498 np0000004400 cinder-backup[101319]: "length": 52428800, Jul 03 09:46:54.620498 np0000004400 cinder-backup[101319]: "md5": "25e317773f308e446cc84c503a6d1f85", Jul 03 09:46:54.620498 np0000004400 cinder-backup[101319]: "offset": 0 Jul 03 09:46:54.620498 np0000004400 cinder-backup[101319]: } Jul 03 09:46:54.620498 np0000004400 cinder-backup[101319]: }, Jul 03 09:46:54.620498 np0000004400 cinder-backup[101319]: { Jul 03 09:46:54.620498 np0000004400 cinder-backup[101319]: "volume_4b68dad5-e9a3-4bd1-84e2-ba745cb7bb83/20260703094505/az_nova_backup_cfdc4925-e984-4da2-aa3e-e1e8a7c37558-00002": { Jul 03 09:46:54.620498 np0000004400 cinder-backup[101319]: "compression": "zlib", Jul 03 09:46:54.620498 np0000004400 cinder-backup[101319]: "length": 52428800, Jul 03 09:46:54.620498 np0000004400 cinder-backup[101319]: "md5": "25e317773f308e446cc84c503a6d1f85", Jul 03 09:46:54.620498 np0000004400 cinder-backup[101319]: "offset": 52428800 Jul 03 09:46:54.620498 np0000004400 cinder-backup[101319]: } Jul 03 09:46:54.620498 np0000004400 cinder-backup[101319]: }, Jul 03 09:46:54.620498 np0000004400 cinder-backup[101319]: { Jul 03 09:46:54.620498 np0000004400 cinder-backup[101319]: "volume_4b68dad5-e9a3-4bd1-84e2-ba745cb7bb83/20260703094505/az_nova_backup_cfdc4925-e984-4da2-aa3e-e1e8a7c37558-00003": { Jul 03 09:46:54.620498 np0000004400 cinder-backup[101319]: "compression": "zlib", Jul 03 09:46:54.620498 np0000004400 cinder-backup[101319]: "length": 52428800, Jul 03 09:46:54.620498 np0000004400 cinder-backup[101319]: "md5": "25e317773f308e446cc84c503a6d1f85", Jul 03 09:46:54.620498 np0000004400 cinder-backup[101319]: "offset": 104857600 Jul 03 09:46:54.620498 np0000004400 cinder-backup[101319]: } Jul 03 09:46:54.620498 np0000004400 cinder-backup[101319]: }, Jul 03 09:46:54.620498 np0000004400 cinder-backup[101319]: { Jul 03 09:46:54.620498 np0000004400 cinder-backup[101319]: "volume_4b68dad5-e9a3-4bd1-84e2-ba745cb7bb83/20260703094505/az_nova_backup_cfdc4925-e984-4da2-aa3e-e1e8a7c37558-00004": { Jul 03 09:46:54.620498 np0000004400 cinder-backup[101319]: "compression": "zlib", Jul 03 09:46:54.620498 np0000004400 cinder-backup[101319]: "length": 52428800, Jul 03 09:46:54.620498 np0000004400 cinder-backup[101319]: "md5": "25e317773f308e446cc84c503a6d1f85", Jul 03 09:46:54.620498 np0000004400 cinder-backup[101319]: "offset": 157286400 Jul 03 09:46:54.620498 np0000004400 cinder-backup[101319]: } Jul 03 09:46:54.620498 np0000004400 cinder-backup[101319]: }, Jul 03 09:46:54.620498 np0000004400 cinder-backup[101319]: { Jul 03 09:46:54.620498 np0000004400 cinder-backup[101319]: "volume_4b68dad5-e9a3-4bd1-84e2-ba745cb7bb83/20260703094505/az_nova_backup_cfdc4925-e984-4da2-aa3e-e1e8a7c37558-00005": { Jul 03 09:46:54.620498 np0000004400 cinder-backup[101319]: "compression": "zlib", Jul 03 09:46:54.620498 np0000004400 cinder-backup[101319]: "length": 52428800, Jul 03 09:46:54.620498 np0000004400 cinder-backup[101319]: "md5": "25e317773f308e446cc84c503a6d1f85", Jul 03 09:46:54.620498 np0000004400 cinder-backup[101319]: "offset": 209715200 Jul 03 09:46:54.620498 np0000004400 cinder-backup[101319]: } Jul 03 09:46:54.620498 np0000004400 cinder-backup[101319]: }, Jul 03 09:46:54.620498 np0000004400 cinder-backup[101319]: { Jul 03 09:46:54.620498 np0000004400 cinder-backup[101319]: "volume_4b68dad5-e9a3-4bd1-84e2-ba745cb7bb83/20260703094505/az_nova_backup_cfdc4925-e984-4da2-aa3e-e1e8a7c37558-00006": { Jul 03 09:46:54.620498 np0000004400 cinder-backup[101319]: "compression": "zlib", Jul 03 09:46:54.620498 np0000004400 cinder-backup[101319]: "length": 52428800, Jul 03 09:46:54.620498 np0000004400 cinder-backup[101319]: "md5": "25e317773f308e446cc84c503a6d1f85", Jul 03 09:46:54.620498 np0000004400 cinder-backup[101319]: "offset": 262144000 Jul 03 09:46:54.620498 np0000004400 cinder-backup[101319]: } Jul 03 09:46:54.620498 np0000004400 cinder-backup[101319]: }, Jul 03 09:46:54.620498 np0000004400 cinder-backup[101319]: { Jul 03 09:46:54.620498 np0000004400 cinder-backup[101319]: "volume_4b68dad5-e9a3-4bd1-84e2-ba745cb7bb83/20260703094505/az_nova_backup_cfdc4925-e984-4da2-aa3e-e1e8a7c37558-00007": { Jul 03 09:46:54.620498 np0000004400 cinder-backup[101319]: "compression": "zlib", Jul 03 09:46:54.620498 np0000004400 cinder-backup[101319]: "length": 52428800, Jul 03 09:46:54.620498 np0000004400 cinder-backup[101319]: "md5": "25e317773f308e446cc84c503a6d1f85", Jul 03 09:46:54.620498 np0000004400 cinder-backup[101319]: "offset": 314572800 Jul 03 09:46:54.620498 np0000004400 cinder-backup[101319]: } Jul 03 09:46:54.620498 np0000004400 cinder-backup[101319]: }, Jul 03 09:46:54.620498 np0000004400 cinder-backup[101319]: { Jul 03 09:46:54.620498 np0000004400 cinder-backup[101319]: "volume_4b68dad5-e9a3-4bd1-84e2-ba745cb7bb83/20260703094505/az_nova_backup_cfdc4925-e984-4da2-aa3e-e1e8a7c37558-00008": { Jul 03 09:46:54.620498 np0000004400 cinder-backup[101319]: "compression": "zlib", Jul 03 09:46:54.620498 np0000004400 cinder-backup[101319]: "length": 52428800, Jul 03 09:46:54.620498 np0000004400 cinder-backup[101319]: "md5": "25e317773f308e446cc84c503a6d1f85", Jul 03 09:46:54.620498 np0000004400 cinder-backup[101319]: "offset": 367001600 Jul 03 09:46:54.620498 np0000004400 cinder-backup[101319]: } Jul 03 09:46:54.620498 np0000004400 cinder-backup[101319]: }, Jul 03 09:46:54.620498 np0000004400 cinder-backup[101319]: { Jul 03 09:46:54.620498 np0000004400 cinder-backup[101319]: "volume_4b68dad5-e9a3-4bd1-84e2-ba745cb7bb83/20260703094505/az_nova_backup_cfdc4925-e984-4da2-aa3e-e1e8a7c37558-00009": { Jul 03 09:46:54.620498 np0000004400 cinder-backup[101319]: "compression": "zlib", Jul 03 09:46:54.620498 np0000004400 cinder-backup[101319]: "length": 52428800, Jul 03 09:46:54.620498 np0000004400 cinder-backup[101319]: "md5": "25e317773f308e446cc84c503a6d1f85", Jul 03 09:46:54.620498 np0000004400 cinder-backup[101319]: "offset": 419430400 Jul 03 09:46:54.620498 np0000004400 cinder-backup[101319]: } Jul 03 09:46:54.620498 np0000004400 cinder-backup[101319]: }, Jul 03 09:46:54.620498 np0000004400 cinder-backup[101319]: { Jul 03 09:46:54.620498 np0000004400 cinder-backup[101319]: "volume_4b68dad5-e9a3-4bd1-84e2-ba745cb7bb83/20260703094505/az_nova_backup_cfdc4925-e984-4da2-aa3e-e1e8a7c37558-00010": { Jul 03 09:46:54.620498 np0000004400 cinder-backup[101319]: "compression": "zlib", Jul 03 09:46:54.620498 np0000004400 cinder-backup[101319]: "length": 52428800, Jul 03 09:46:54.620498 np0000004400 cinder-backup[101319]: "md5": "25e317773f308e446cc84c503a6d1f85", Jul 03 09:46:54.620498 np0000004400 cinder-backup[101319]: "offset": 471859200 Jul 03 09:46:54.620498 np0000004400 cinder-backup[101319]: } Jul 03 09:46:54.620498 np0000004400 cinder-backup[101319]: }, Jul 03 09:46:54.620498 np0000004400 cinder-backup[101319]: { Jul 03 09:46:54.620498 np0000004400 cinder-backup[101319]: "volume_4b68dad5-e9a3-4bd1-84e2-ba745cb7bb83/20260703094505/az_nova_backup_cfdc4925-e984-4da2-aa3e-e1e8a7c37558-00011": { Jul 03 09:46:54.620498 np0000004400 cinder-backup[101319]: "compression": "zlib", Jul 03 09:46:54.620498 np0000004400 cinder-backup[101319]: "length": 52428800, Jul 03 09:46:54.620498 np0000004400 cinder-backup[101319]: "md5": "25e317773f308e446cc84c503a6d1f85", Jul 03 09:46:54.620498 np0000004400 cinder-backup[101319]: "offset": 524288000 Jul 03 09:46:54.620498 np0000004400 cinder-backup[101319]: } Jul 03 09:46:54.620498 np0000004400 cinder-backup[101319]: }, Jul 03 09:46:54.620498 np0000004400 cinder-backup[101319]: { Jul 03 09:46:54.620498 np0000004400 cinder-backup[101319]: "volume_4b68dad5-e9a3-4bd1-84e2-ba745cb7bb83/20260703094505/az_nova_backup_cfdc4925-e984-4da2-aa3e-e1e8a7c37558-00012": { Jul 03 09:46:54.620498 np0000004400 cinder-backup[101319]: "compression": "zlib", Jul 03 09:46:54.620498 np0000004400 cinder-backup[101319]: "length": 52428800, Jul 03 09:46:54.620498 np0000004400 cinder-backup[101319]: "md5": "25e317773f308e446cc84c503a6d1f85", Jul 03 09:46:54.620498 np0000004400 cinder-backup[101319]: "offset": 576716800 Jul 03 09:46:54.620498 np0000004400 cinder-backup[101319]: } Jul 03 09:46:54.620498 np0000004400 cinder-backup[101319]: }, Jul 03 09:46:54.620498 np0000004400 cinder-backup[101319]: { Jul 03 09:46:54.620498 np0000004400 cinder-backup[101319]: "volume_4b68dad5-e9a3-4bd1-84e2-ba745cb7bb83/20260703094505/az_nova_backup_cfdc4925-e984-4da2-aa3e-e1e8a7c37558-00013": { Jul 03 09:46:54.620498 np0000004400 cinder-backup[101319]: "compression": "zlib", Jul 03 09:46:54.620498 np0000004400 cinder-backup[101319]: "length": 52428800, Jul 03 09:46:54.620498 np0000004400 cinder-backup[101319]: "md5": "25e317773f308e446cc84c503a6d1f85", Jul 03 09:46:54.620498 np0000004400 cinder-backup[101319]: "offset": 629145600 Jul 03 09:46:54.620498 np0000004400 cinder-backup[101319]: } Jul 03 09:46:54.620498 np0000004400 cinder-backup[101319]: }, Jul 03 09:46:54.620498 np0000004400 cinder-backup[101319]: { Jul 03 09:46:54.620498 np0000004400 cinder-backup[101319]: "volume_4b68dad5-e9a3-4bd1-84e2-ba745cb7bb83/20260703094505/az_nova_backup_cfdc4925-e984-4da2-aa3e-e1e8a7c37558-00014": { Jul 03 09:46:54.620498 np0000004400 cinder-backup[101319]: "compression": "zlib", Jul 03 09:46:54.620498 np0000004400 cinder-backup[101319]: "length": 52428800, Jul 03 09:46:54.620498 np0000004400 cinder-backup[101319]: "md5": "25e317773f308e446cc84c503a6d1f85", Jul 03 09:46:54.620498 np0000004400 cinder-backup[101319]: "offset": 681574400 Jul 03 09:46:54.620498 np0000004400 cinder-backup[101319]: } Jul 03 09:46:54.620498 np0000004400 cinder-backup[101319]: }, Jul 03 09:46:54.620498 np0000004400 cinder-backup[101319]: { Jul 03 09:46:54.620498 np0000004400 cinder-backup[101319]: "volume_4b68dad5-e9a3-4bd1-84e2-ba745cb7bb83/20260703094505/az_nova_backup_cfdc4925-e984-4da2-aa3e-e1e8a7c37558-00015": { Jul 03 09:46:54.620498 np0000004400 cinder-backup[101319]: "compression": "zlib", Jul 03 09:46:54.620498 np0000004400 cinder-backup[101319]: "length": 52428800, Jul 03 09:46:54.620498 np0000004400 cinder-backup[101319]: "md5": "25e317773f308e446cc84c503a6d1f85", Jul 03 09:46:54.620498 np0000004400 cinder-backup[101319]: "offset": 734003200 Jul 03 09:46:54.620498 np0000004400 cinder-backup[101319]: } Jul 03 09:46:54.620498 np0000004400 cinder-backup[101319]: }, Jul 03 09:46:54.620498 np0000004400 cinder-backup[101319]: { Jul 03 09:46:54.620498 np0000004400 cinder-backup[101319]: "volume_4b68dad5-e9a3-4bd1-84e2-ba745cb7bb83/20260703094505/az_nova_backup_cfdc4925-e984-4da2-aa3e-e1e8a7c37558-00016": { Jul 03 09:46:54.620498 np0000004400 cinder-backup[101319]: "compression": "zlib", Jul 03 09:46:54.620498 np0000004400 cinder-backup[101319]: "length": 52428800, Jul 03 09:46:54.620498 np0000004400 cinder-backup[101319]: "md5": "25e317773f308e446cc84c503a6d1f85", Jul 03 09:46:54.620498 np0000004400 cinder-backup[101319]: "offset": 786432000 Jul 03 09:46:54.620498 np0000004400 cinder-backup[101319]: } Jul 03 09:46:54.620498 np0000004400 cinder-backup[101319]: }, Jul 03 09:46:54.620498 np0000004400 cinder-backup[101319]: { Jul 03 09:46:54.620498 np0000004400 cinder-backup[101319]: "volume_4b68dad5-e9a3-4bd1-84e2-ba745cb7bb83/20260703094505/az_nova_backup_cfdc4925-e984-4da2-aa3e-e1e8a7c37558-00017": { Jul 03 09:46:54.620498 np0000004400 cinder-backup[101319]: "compression": "zlib", Jul 03 09:46:54.620498 np0000004400 cinder-backup[101319]: "length": 52428800, Jul 03 09:46:54.620498 np0000004400 cinder-backup[101319]: "md5": "25e317773f308e446cc84c503a6d1f85", Jul 03 09:46:54.620498 np0000004400 cinder-backup[101319]: "offset": 838860800 Jul 03 09:46:54.620498 np0000004400 cinder-backup[101319]: } Jul 03 09:46:54.620498 np0000004400 cinder-backup[101319]: }, Jul 03 09:46:54.620498 np0000004400 cinder-backup[101319]: { Jul 03 09:46:54.620498 np0000004400 cinder-backup[101319]: "volume_4b68dad5-e9a3-4bd1-84e2-ba745cb7bb83/20260703094505/az_nova_backup_cfdc4925-e984-4da2-aa3e-e1e8a7c37558-00018": { Jul 03 09:46:54.620498 np0000004400 cinder-backup[101319]: "compression": "zlib", Jul 03 09:46:54.620498 np0000004400 cinder-backup[101319]: "length": 52428800, Jul 03 09:46:54.620498 np0000004400 cinder-backup[101319]: "md5": "25e317773f308e446cc84c503a6d1f85", Jul 03 09:46:54.620498 np0000004400 cinder-backup[101319]: "offset": 891289600 Jul 03 09:46:54.620498 np0000004400 cinder-backup[101319]: } Jul 03 09:46:54.620498 np0000004400 cinder-backup[101319]: }, Jul 03 09:46:54.620498 np0000004400 cinder-backup[101319]: { Jul 03 09:46:54.620498 np0000004400 cinder-backup[101319]: "volume_4b68dad5-e9a3-4bd1-84e2-ba745cb7bb83/20260703094505/az_nova_backup_cfdc4925-e984-4da2-aa3e-e1e8a7c37558-00019": { Jul 03 09:46:54.620498 np0000004400 cinder-backup[101319]: "compression": "zlib", Jul 03 09:46:54.620498 np0000004400 cinder-backup[101319]: "length": 52428800, Jul 03 09:46:54.620498 np0000004400 cinder-backup[101319]: "md5": "25e317773f308e446cc84c503a6d1f85", Jul 03 09:46:54.620498 np0000004400 cinder-backup[101319]: "offset": 943718400 Jul 03 09:46:54.620498 np0000004400 cinder-backup[101319]: } Jul 03 09:46:54.620498 np0000004400 cinder-backup[101319]: }, Jul 03 09:46:54.620498 np0000004400 cinder-backup[101319]: { Jul 03 09:46:54.620498 np0000004400 cinder-backup[101319]: "volume_4b68dad5-e9a3-4bd1-84e2-ba745cb7bb83/20260703094505/az_nova_backup_cfdc4925-e984-4da2-aa3e-e1e8a7c37558-00020": { Jul 03 09:46:54.620498 np0000004400 cinder-backup[101319]: "compression": "zlib", Jul 03 09:46:54.620498 np0000004400 cinder-backup[101319]: "length": 52428800, Jul 03 09:46:54.620498 np0000004400 cinder-backup[101319]: "md5": "25e317773f308e446cc84c503a6d1f85", Jul 03 09:46:54.620498 np0000004400 cinder-backup[101319]: "offset": 996147200 Jul 03 09:46:54.620498 np0000004400 cinder-backup[101319]: } Jul 03 09:46:54.620498 np0000004400 cinder-backup[101319]: }, Jul 03 09:46:54.620498 np0000004400 cinder-backup[101319]: { Jul 03 09:46:54.620498 np0000004400 cinder-backup[101319]: "volume_4b68dad5-e9a3-4bd1-84e2-ba745cb7bb83/20260703094505/az_nova_backup_cfdc4925-e984-4da2-aa3e-e1e8a7c37558-00021": { Jul 03 09:46:54.620498 np0000004400 cinder-backup[101319]: "compression": "zlib", Jul 03 09:46:54.620498 np0000004400 cinder-backup[101319]: "length": 25165824, Jul 03 09:46:54.620498 np0000004400 cinder-backup[101319]: "md5": "77377273b0a4b61febdbf7bbf52b9db9", Jul 03 09:46:54.620498 np0000004400 cinder-backup[101319]: "offset": 1048576000 Jul 03 09:46:54.620498 np0000004400 cinder-backup[101319]: } Jul 03 09:46:54.620498 np0000004400 cinder-backup[101319]: } Jul 03 09:46:54.620498 np0000004400 cinder-backup[101319]: ], Jul 03 09:46:54.620498 np0000004400 cinder-backup[101319]: "parent_id": null, Jul 03 09:46:54.620498 np0000004400 cinder-backup[101319]: "version": "1.0.0", Jul 03 09:46:54.620498 np0000004400 cinder-backup[101319]: "volume_id": "4b68dad5-e9a3-4bd1-84e2-ba745cb7bb83", Jul 03 09:46:54.620498 np0000004400 cinder-backup[101319]: "volume_meta": "{\"version\": 2, \"volume-base-metadata\": {\"id\": \"4b68dad5-e9a3-4bd1-84e2-ba745cb7bb83\", \"_name_id\": null, \"use_quota\": true, \"ec2_id\": null, \"user_id\": \"23ba560f6eed465495956e82c26b6f69\", \"project_id\": \"a2309d0555a742279b4a5017d94ebf02\", \"snapshot_id\": null, \"cluster_name\": null, \"host\": \"np0000004400@storpool#template_virtual\", \"size\": 1, \"availability_zone\": \"nova\", \"status\": \"backing-up\", \"attach_status\": \"detached\", \"migration_status\": null, \"scheduled_at\": \"2026-07-03T09:45:00.000000\", \"launched_at\": \"2026-07-03T09:45:00.000000\", \"terminated_at\": null, \"display_name\": \"tempest-VolumeV3RbacBaseTests-Volume-1547982480\", \"display_description\": null, \"provider_location\": null, \"provider_auth\": null, \"provider_geometry\": null, \"provider_id\": null, \"volume_type_id\": \"03e13fe6-0e30-4803-ace0-725d38e6dc24\", \"source_volid\": null, \"encryption_key_id\": null, \"consistencygroup_id\": null, \"group_id\": null, \"bootable\": false, \"multiattach\": false, \"replication_status\": null, \"replication_extended_status\": null, \"replication_driver_data\": null, \"previous_status\": \"available\", \"service_uuid\": \"6d4b0e79-fefe-4744-b25f-34be05095200\", \"shared_targets\": true, \"deleted_at\": null, \"deleted\": false, \"created_at\": \"2026-07-03T09:45:00.000000\", \"updated_at\": \"2026-07-03T09:45:01.000000\"}}" Jul 03 09:46:54.620498 np0000004400 cinder-backup[101319]: }. {{(pid=101319) _read_metadata /opt/stack/cinder/cinder/backup/chunkeddriver.py:327}} Jul 03 09:46:54.626240 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-90f98a9f-c4f1-4c4e-a984-1f6f6f0a3431 tempest-ProjectAdminTests33-1900627284 None] Restoring backup version 1.0.0 {{(pid=101319) restore /opt/stack/cinder/cinder/backup/chunkeddriver.py:774}} Jul 03 09:46:54.626240 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-90f98a9f-c4f1-4c4e-a984-1f6f6f0a3431 tempest-ProjectAdminTests33-1900627284 None] _read_metadata started, container name: volumebackups, metadata filename: volume_4b68dad5-e9a3-4bd1-84e2-ba745cb7bb83/20260703094505/az_nova_backup_cfdc4925-e984-4da2-aa3e-e1e8a7c37558_metadata. {{(pid=101319) _read_metadata /opt/stack/cinder/cinder/backup/chunkeddriver.py:320}} Jul 03 09:46:54.652663 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-90f98a9f-c4f1-4c4e-a984-1f6f6f0a3431 tempest-ProjectAdminTests33-1900627284 None] _read_metadata finished. Metadata: { Jul 03 09:46:54.652663 np0000004400 cinder-backup[101319]: "backup_description": null, Jul 03 09:46:54.652663 np0000004400 cinder-backup[101319]: "backup_id": "cfdc4925-e984-4da2-aa3e-e1e8a7c37558", Jul 03 09:46:54.652663 np0000004400 cinder-backup[101319]: "backup_name": "tempest-type-Backup-880845111", Jul 03 09:46:54.652663 np0000004400 cinder-backup[101319]: "created_at": "2026-07-03 09:45:01+00:00", Jul 03 09:46:54.652663 np0000004400 cinder-backup[101319]: "objects": [ Jul 03 09:46:54.652663 np0000004400 cinder-backup[101319]: { Jul 03 09:46:54.652663 np0000004400 cinder-backup[101319]: "volume_4b68dad5-e9a3-4bd1-84e2-ba745cb7bb83/20260703094505/az_nova_backup_cfdc4925-e984-4da2-aa3e-e1e8a7c37558-00001": { Jul 03 09:46:54.652663 np0000004400 cinder-backup[101319]: "compression": "zlib", Jul 03 09:46:54.652663 np0000004400 cinder-backup[101319]: "length": 52428800, Jul 03 09:46:54.652663 np0000004400 cinder-backup[101319]: "md5": "25e317773f308e446cc84c503a6d1f85", Jul 03 09:46:54.652663 np0000004400 cinder-backup[101319]: "offset": 0 Jul 03 09:46:54.652663 np0000004400 cinder-backup[101319]: } Jul 03 09:46:54.652663 np0000004400 cinder-backup[101319]: }, Jul 03 09:46:54.652663 np0000004400 cinder-backup[101319]: { Jul 03 09:46:54.652663 np0000004400 cinder-backup[101319]: "volume_4b68dad5-e9a3-4bd1-84e2-ba745cb7bb83/20260703094505/az_nova_backup_cfdc4925-e984-4da2-aa3e-e1e8a7c37558-00002": { Jul 03 09:46:54.652663 np0000004400 cinder-backup[101319]: "compression": "zlib", Jul 03 09:46:54.652663 np0000004400 cinder-backup[101319]: "length": 52428800, Jul 03 09:46:54.652663 np0000004400 cinder-backup[101319]: "md5": "25e317773f308e446cc84c503a6d1f85", Jul 03 09:46:54.652663 np0000004400 cinder-backup[101319]: "offset": 52428800 Jul 03 09:46:54.652663 np0000004400 cinder-backup[101319]: } Jul 03 09:46:54.652663 np0000004400 cinder-backup[101319]: }, Jul 03 09:46:54.652663 np0000004400 cinder-backup[101319]: { Jul 03 09:46:54.652663 np0000004400 cinder-backup[101319]: "volume_4b68dad5-e9a3-4bd1-84e2-ba745cb7bb83/20260703094505/az_nova_backup_cfdc4925-e984-4da2-aa3e-e1e8a7c37558-00003": { Jul 03 09:46:54.652663 np0000004400 cinder-backup[101319]: "compression": "zlib", Jul 03 09:46:54.652663 np0000004400 cinder-backup[101319]: "length": 52428800, Jul 03 09:46:54.652663 np0000004400 cinder-backup[101319]: "md5": "25e317773f308e446cc84c503a6d1f85", Jul 03 09:46:54.652663 np0000004400 cinder-backup[101319]: "offset": 104857600 Jul 03 09:46:54.652663 np0000004400 cinder-backup[101319]: } Jul 03 09:46:54.652663 np0000004400 cinder-backup[101319]: }, Jul 03 09:46:54.652663 np0000004400 cinder-backup[101319]: { Jul 03 09:46:54.652663 np0000004400 cinder-backup[101319]: "volume_4b68dad5-e9a3-4bd1-84e2-ba745cb7bb83/20260703094505/az_nova_backup_cfdc4925-e984-4da2-aa3e-e1e8a7c37558-00004": { Jul 03 09:46:54.652663 np0000004400 cinder-backup[101319]: "compression": "zlib", Jul 03 09:46:54.652663 np0000004400 cinder-backup[101319]: "length": 52428800, Jul 03 09:46:54.652663 np0000004400 cinder-backup[101319]: "md5": "25e317773f308e446cc84c503a6d1f85", Jul 03 09:46:54.652663 np0000004400 cinder-backup[101319]: "offset": 157286400 Jul 03 09:46:54.652663 np0000004400 cinder-backup[101319]: } Jul 03 09:46:54.652663 np0000004400 cinder-backup[101319]: }, Jul 03 09:46:54.652663 np0000004400 cinder-backup[101319]: { Jul 03 09:46:54.652663 np0000004400 cinder-backup[101319]: "volume_4b68dad5-e9a3-4bd1-84e2-ba745cb7bb83/20260703094505/az_nova_backup_cfdc4925-e984-4da2-aa3e-e1e8a7c37558-00005": { Jul 03 09:46:54.652663 np0000004400 cinder-backup[101319]: "compression": "zlib", Jul 03 09:46:54.652663 np0000004400 cinder-backup[101319]: "length": 52428800, Jul 03 09:46:54.652663 np0000004400 cinder-backup[101319]: "md5": "25e317773f308e446cc84c503a6d1f85", Jul 03 09:46:54.652663 np0000004400 cinder-backup[101319]: "offset": 209715200 Jul 03 09:46:54.652663 np0000004400 cinder-backup[101319]: } Jul 03 09:46:54.652663 np0000004400 cinder-backup[101319]: }, Jul 03 09:46:54.652663 np0000004400 cinder-backup[101319]: { Jul 03 09:46:54.652663 np0000004400 cinder-backup[101319]: "volume_4b68dad5-e9a3-4bd1-84e2-ba745cb7bb83/20260703094505/az_nova_backup_cfdc4925-e984-4da2-aa3e-e1e8a7c37558-00006": { Jul 03 09:46:54.652663 np0000004400 cinder-backup[101319]: "compression": "zlib", Jul 03 09:46:54.652663 np0000004400 cinder-backup[101319]: "length": 52428800, Jul 03 09:46:54.652663 np0000004400 cinder-backup[101319]: "md5": "25e317773f308e446cc84c503a6d1f85", Jul 03 09:46:54.652663 np0000004400 cinder-backup[101319]: "offset": 262144000 Jul 03 09:46:54.652663 np0000004400 cinder-backup[101319]: } Jul 03 09:46:54.652663 np0000004400 cinder-backup[101319]: }, Jul 03 09:46:54.652663 np0000004400 cinder-backup[101319]: { Jul 03 09:46:54.652663 np0000004400 cinder-backup[101319]: "volume_4b68dad5-e9a3-4bd1-84e2-ba745cb7bb83/20260703094505/az_nova_backup_cfdc4925-e984-4da2-aa3e-e1e8a7c37558-00007": { Jul 03 09:46:54.652663 np0000004400 cinder-backup[101319]: "compression": "zlib", Jul 03 09:46:54.652663 np0000004400 cinder-backup[101319]: "length": 52428800, Jul 03 09:46:54.652663 np0000004400 cinder-backup[101319]: "md5": "25e317773f308e446cc84c503a6d1f85", Jul 03 09:46:54.652663 np0000004400 cinder-backup[101319]: "offset": 314572800 Jul 03 09:46:54.652663 np0000004400 cinder-backup[101319]: } Jul 03 09:46:54.652663 np0000004400 cinder-backup[101319]: }, Jul 03 09:46:54.652663 np0000004400 cinder-backup[101319]: { Jul 03 09:46:54.652663 np0000004400 cinder-backup[101319]: "volume_4b68dad5-e9a3-4bd1-84e2-ba745cb7bb83/20260703094505/az_nova_backup_cfdc4925-e984-4da2-aa3e-e1e8a7c37558-00008": { Jul 03 09:46:54.652663 np0000004400 cinder-backup[101319]: "compression": "zlib", Jul 03 09:46:54.652663 np0000004400 cinder-backup[101319]: "length": 52428800, Jul 03 09:46:54.652663 np0000004400 cinder-backup[101319]: "md5": "25e317773f308e446cc84c503a6d1f85", Jul 03 09:46:54.652663 np0000004400 cinder-backup[101319]: "offset": 367001600 Jul 03 09:46:54.652663 np0000004400 cinder-backup[101319]: } Jul 03 09:46:54.652663 np0000004400 cinder-backup[101319]: }, Jul 03 09:46:54.652663 np0000004400 cinder-backup[101319]: { Jul 03 09:46:54.652663 np0000004400 cinder-backup[101319]: "volume_4b68dad5-e9a3-4bd1-84e2-ba745cb7bb83/20260703094505/az_nova_backup_cfdc4925-e984-4da2-aa3e-e1e8a7c37558-00009": { Jul 03 09:46:54.652663 np0000004400 cinder-backup[101319]: "compression": "zlib", Jul 03 09:46:54.652663 np0000004400 cinder-backup[101319]: "length": 52428800, Jul 03 09:46:54.652663 np0000004400 cinder-backup[101319]: "md5": "25e317773f308e446cc84c503a6d1f85", Jul 03 09:46:54.652663 np0000004400 cinder-backup[101319]: "offset": 419430400 Jul 03 09:46:54.652663 np0000004400 cinder-backup[101319]: } Jul 03 09:46:54.652663 np0000004400 cinder-backup[101319]: }, Jul 03 09:46:54.652663 np0000004400 cinder-backup[101319]: { Jul 03 09:46:54.652663 np0000004400 cinder-backup[101319]: "volume_4b68dad5-e9a3-4bd1-84e2-ba745cb7bb83/20260703094505/az_nova_backup_cfdc4925-e984-4da2-aa3e-e1e8a7c37558-00010": { Jul 03 09:46:54.652663 np0000004400 cinder-backup[101319]: "compression": "zlib", Jul 03 09:46:54.652663 np0000004400 cinder-backup[101319]: "length": 52428800, Jul 03 09:46:54.652663 np0000004400 cinder-backup[101319]: "md5": "25e317773f308e446cc84c503a6d1f85", Jul 03 09:46:54.652663 np0000004400 cinder-backup[101319]: "offset": 471859200 Jul 03 09:46:54.652663 np0000004400 cinder-backup[101319]: } Jul 03 09:46:54.652663 np0000004400 cinder-backup[101319]: }, Jul 03 09:46:54.652663 np0000004400 cinder-backup[101319]: { Jul 03 09:46:54.652663 np0000004400 cinder-backup[101319]: "volume_4b68dad5-e9a3-4bd1-84e2-ba745cb7bb83/20260703094505/az_nova_backup_cfdc4925-e984-4da2-aa3e-e1e8a7c37558-00011": { Jul 03 09:46:54.652663 np0000004400 cinder-backup[101319]: "compression": "zlib", Jul 03 09:46:54.652663 np0000004400 cinder-backup[101319]: "length": 52428800, Jul 03 09:46:54.652663 np0000004400 cinder-backup[101319]: "md5": "25e317773f308e446cc84c503a6d1f85", Jul 03 09:46:54.652663 np0000004400 cinder-backup[101319]: "offset": 524288000 Jul 03 09:46:54.652663 np0000004400 cinder-backup[101319]: } Jul 03 09:46:54.652663 np0000004400 cinder-backup[101319]: }, Jul 03 09:46:54.652663 np0000004400 cinder-backup[101319]: { Jul 03 09:46:54.652663 np0000004400 cinder-backup[101319]: "volume_4b68dad5-e9a3-4bd1-84e2-ba745cb7bb83/20260703094505/az_nova_backup_cfdc4925-e984-4da2-aa3e-e1e8a7c37558-00012": { Jul 03 09:46:54.652663 np0000004400 cinder-backup[101319]: "compression": "zlib", Jul 03 09:46:54.652663 np0000004400 cinder-backup[101319]: "length": 52428800, Jul 03 09:46:54.652663 np0000004400 cinder-backup[101319]: "md5": "25e317773f308e446cc84c503a6d1f85", Jul 03 09:46:54.652663 np0000004400 cinder-backup[101319]: "offset": 576716800 Jul 03 09:46:54.652663 np0000004400 cinder-backup[101319]: } Jul 03 09:46:54.652663 np0000004400 cinder-backup[101319]: }, Jul 03 09:46:54.652663 np0000004400 cinder-backup[101319]: { Jul 03 09:46:54.652663 np0000004400 cinder-backup[101319]: "volume_4b68dad5-e9a3-4bd1-84e2-ba745cb7bb83/20260703094505/az_nova_backup_cfdc4925-e984-4da2-aa3e-e1e8a7c37558-00013": { Jul 03 09:46:54.652663 np0000004400 cinder-backup[101319]: "compression": "zlib", Jul 03 09:46:54.652663 np0000004400 cinder-backup[101319]: "length": 52428800, Jul 03 09:46:54.652663 np0000004400 cinder-backup[101319]: "md5": "25e317773f308e446cc84c503a6d1f85", Jul 03 09:46:54.652663 np0000004400 cinder-backup[101319]: "offset": 629145600 Jul 03 09:46:54.652663 np0000004400 cinder-backup[101319]: } Jul 03 09:46:54.652663 np0000004400 cinder-backup[101319]: }, Jul 03 09:46:54.652663 np0000004400 cinder-backup[101319]: { Jul 03 09:46:54.652663 np0000004400 cinder-backup[101319]: "volume_4b68dad5-e9a3-4bd1-84e2-ba745cb7bb83/20260703094505/az_nova_backup_cfdc4925-e984-4da2-aa3e-e1e8a7c37558-00014": { Jul 03 09:46:54.652663 np0000004400 cinder-backup[101319]: "compression": "zlib", Jul 03 09:46:54.652663 np0000004400 cinder-backup[101319]: "length": 52428800, Jul 03 09:46:54.652663 np0000004400 cinder-backup[101319]: "md5": "25e317773f308e446cc84c503a6d1f85", Jul 03 09:46:54.652663 np0000004400 cinder-backup[101319]: "offset": 681574400 Jul 03 09:46:54.652663 np0000004400 cinder-backup[101319]: } Jul 03 09:46:54.652663 np0000004400 cinder-backup[101319]: }, Jul 03 09:46:54.652663 np0000004400 cinder-backup[101319]: { Jul 03 09:46:54.652663 np0000004400 cinder-backup[101319]: "volume_4b68dad5-e9a3-4bd1-84e2-ba745cb7bb83/20260703094505/az_nova_backup_cfdc4925-e984-4da2-aa3e-e1e8a7c37558-00015": { Jul 03 09:46:54.652663 np0000004400 cinder-backup[101319]: "compression": "zlib", Jul 03 09:46:54.652663 np0000004400 cinder-backup[101319]: "length": 52428800, Jul 03 09:46:54.652663 np0000004400 cinder-backup[101319]: "md5": "25e317773f308e446cc84c503a6d1f85", Jul 03 09:46:54.652663 np0000004400 cinder-backup[101319]: "offset": 734003200 Jul 03 09:46:54.652663 np0000004400 cinder-backup[101319]: } Jul 03 09:46:54.652663 np0000004400 cinder-backup[101319]: }, Jul 03 09:46:54.652663 np0000004400 cinder-backup[101319]: { Jul 03 09:46:54.652663 np0000004400 cinder-backup[101319]: "volume_4b68dad5-e9a3-4bd1-84e2-ba745cb7bb83/20260703094505/az_nova_backup_cfdc4925-e984-4da2-aa3e-e1e8a7c37558-00016": { Jul 03 09:46:54.652663 np0000004400 cinder-backup[101319]: "compression": "zlib", Jul 03 09:46:54.652663 np0000004400 cinder-backup[101319]: "length": 52428800, Jul 03 09:46:54.652663 np0000004400 cinder-backup[101319]: "md5": "25e317773f308e446cc84c503a6d1f85", Jul 03 09:46:54.652663 np0000004400 cinder-backup[101319]: "offset": 786432000 Jul 03 09:46:54.652663 np0000004400 cinder-backup[101319]: } Jul 03 09:46:54.652663 np0000004400 cinder-backup[101319]: }, Jul 03 09:46:54.652663 np0000004400 cinder-backup[101319]: { Jul 03 09:46:54.652663 np0000004400 cinder-backup[101319]: "volume_4b68dad5-e9a3-4bd1-84e2-ba745cb7bb83/20260703094505/az_nova_backup_cfdc4925-e984-4da2-aa3e-e1e8a7c37558-00017": { Jul 03 09:46:54.652663 np0000004400 cinder-backup[101319]: "compression": "zlib", Jul 03 09:46:54.652663 np0000004400 cinder-backup[101319]: "length": 52428800, Jul 03 09:46:54.652663 np0000004400 cinder-backup[101319]: "md5": "25e317773f308e446cc84c503a6d1f85", Jul 03 09:46:54.652663 np0000004400 cinder-backup[101319]: "offset": 838860800 Jul 03 09:46:54.652663 np0000004400 cinder-backup[101319]: } Jul 03 09:46:54.652663 np0000004400 cinder-backup[101319]: }, Jul 03 09:46:54.652663 np0000004400 cinder-backup[101319]: { Jul 03 09:46:54.652663 np0000004400 cinder-backup[101319]: "volume_4b68dad5-e9a3-4bd1-84e2-ba745cb7bb83/20260703094505/az_nova_backup_cfdc4925-e984-4da2-aa3e-e1e8a7c37558-00018": { Jul 03 09:46:54.652663 np0000004400 cinder-backup[101319]: "compression": "zlib", Jul 03 09:46:54.652663 np0000004400 cinder-backup[101319]: "length": 52428800, Jul 03 09:46:54.652663 np0000004400 cinder-backup[101319]: "md5": "25e317773f308e446cc84c503a6d1f85", Jul 03 09:46:54.652663 np0000004400 cinder-backup[101319]: "offset": 891289600 Jul 03 09:46:54.652663 np0000004400 cinder-backup[101319]: } Jul 03 09:46:54.652663 np0000004400 cinder-backup[101319]: }, Jul 03 09:46:54.652663 np0000004400 cinder-backup[101319]: { Jul 03 09:46:54.652663 np0000004400 cinder-backup[101319]: "volume_4b68dad5-e9a3-4bd1-84e2-ba745cb7bb83/20260703094505/az_nova_backup_cfdc4925-e984-4da2-aa3e-e1e8a7c37558-00019": { Jul 03 09:46:54.652663 np0000004400 cinder-backup[101319]: "compression": "zlib", Jul 03 09:46:54.652663 np0000004400 cinder-backup[101319]: "length": 52428800, Jul 03 09:46:54.652663 np0000004400 cinder-backup[101319]: "md5": "25e317773f308e446cc84c503a6d1f85", Jul 03 09:46:54.652663 np0000004400 cinder-backup[101319]: "offset": 943718400 Jul 03 09:46:54.652663 np0000004400 cinder-backup[101319]: } Jul 03 09:46:54.652663 np0000004400 cinder-backup[101319]: }, Jul 03 09:46:54.652663 np0000004400 cinder-backup[101319]: { Jul 03 09:46:54.652663 np0000004400 cinder-backup[101319]: "volume_4b68dad5-e9a3-4bd1-84e2-ba745cb7bb83/20260703094505/az_nova_backup_cfdc4925-e984-4da2-aa3e-e1e8a7c37558-00020": { Jul 03 09:46:54.652663 np0000004400 cinder-backup[101319]: "compression": "zlib", Jul 03 09:46:54.652663 np0000004400 cinder-backup[101319]: "length": 52428800, Jul 03 09:46:54.652663 np0000004400 cinder-backup[101319]: "md5": "25e317773f308e446cc84c503a6d1f85", Jul 03 09:46:54.652663 np0000004400 cinder-backup[101319]: "offset": 996147200 Jul 03 09:46:54.652663 np0000004400 cinder-backup[101319]: } Jul 03 09:46:54.652663 np0000004400 cinder-backup[101319]: }, Jul 03 09:46:54.652663 np0000004400 cinder-backup[101319]: { Jul 03 09:46:54.652663 np0000004400 cinder-backup[101319]: "volume_4b68dad5-e9a3-4bd1-84e2-ba745cb7bb83/20260703094505/az_nova_backup_cfdc4925-e984-4da2-aa3e-e1e8a7c37558-00021": { Jul 03 09:46:54.652663 np0000004400 cinder-backup[101319]: "compression": "zlib", Jul 03 09:46:54.652663 np0000004400 cinder-backup[101319]: "length": 25165824, Jul 03 09:46:54.652663 np0000004400 cinder-backup[101319]: "md5": "77377273b0a4b61febdbf7bbf52b9db9", Jul 03 09:46:54.652663 np0000004400 cinder-backup[101319]: "offset": 1048576000 Jul 03 09:46:54.652663 np0000004400 cinder-backup[101319]: } Jul 03 09:46:54.652663 np0000004400 cinder-backup[101319]: } Jul 03 09:46:54.652663 np0000004400 cinder-backup[101319]: ], Jul 03 09:46:54.652663 np0000004400 cinder-backup[101319]: "parent_id": null, Jul 03 09:46:54.652663 np0000004400 cinder-backup[101319]: "version": "1.0.0", Jul 03 09:46:54.652663 np0000004400 cinder-backup[101319]: "volume_id": "4b68dad5-e9a3-4bd1-84e2-ba745cb7bb83", Jul 03 09:46:54.652663 np0000004400 cinder-backup[101319]: "volume_meta": "{\"version\": 2, \"volume-base-metadata\": {\"id\": \"4b68dad5-e9a3-4bd1-84e2-ba745cb7bb83\", \"_name_id\": null, \"use_quota\": true, \"ec2_id\": null, \"user_id\": \"23ba560f6eed465495956e82c26b6f69\", \"project_id\": \"a2309d0555a742279b4a5017d94ebf02\", \"snapshot_id\": null, \"cluster_name\": null, \"host\": \"np0000004400@storpool#template_virtual\", \"size\": 1, \"availability_zone\": \"nova\", \"status\": \"backing-up\", \"attach_status\": \"detached\", \"migration_status\": null, \"scheduled_at\": \"2026-07-03T09:45:00.000000\", \"launched_at\": \"2026-07-03T09:45:00.000000\", \"terminated_at\": null, \"display_name\": \"tempest-VolumeV3RbacBaseTests-Volume-1547982480\", \"display_description\": null, \"provider_location\": null, \"provider_auth\": null, \"provider_geometry\": null, \"provider_id\": null, \"volume_type_id\": \"03e13fe6-0e30-4803-ace0-725d38e6dc24\", \"source_volid\": null, \"encryption_key_id\": null, \"consistencygroup_id\": null, \"group_id\": null, \"bootable\": false, \"multiattach\": false, \"replication_status\": null, \"replication_extended_status\": null, \"replication_driver_data\": null, \"previous_status\": \"available\", \"service_uuid\": \"6d4b0e79-fefe-4744-b25f-34be05095200\", \"shared_targets\": true, \"deleted_at\": null, \"deleted\": false, \"created_at\": \"2026-07-03T09:45:00.000000\", \"updated_at\": \"2026-07-03T09:45:01.000000\"}}" Jul 03 09:46:54.652663 np0000004400 cinder-backup[101319]: }. {{(pid=101319) _read_metadata /opt/stack/cinder/cinder/backup/chunkeddriver.py:327}} Jul 03 09:46:54.652663 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-90f98a9f-c4f1-4c4e-a984-1f6f6f0a3431 tempest-ProjectAdminTests33-1900627284 None] v1 volume backup restore of cfdc4925-e984-4da2-aa3e-e1e8a7c37558 started. {{(pid=101319) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:678}} Jul 03 09:46:54.659730 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-90f98a9f-c4f1-4c4e-a984-1f6f6f0a3431 tempest-ProjectAdminTests33-1900627284 None] metadata_object_names = ['volume_4b68dad5-e9a3-4bd1-84e2-ba745cb7bb83/20260703094505/az_nova_backup_cfdc4925-e984-4da2-aa3e-e1e8a7c37558-00001', 'volume_4b68dad5-e9a3-4bd1-84e2-ba745cb7bb83/20260703094505/az_nova_backup_cfdc4925-e984-4da2-aa3e-e1e8a7c37558-00002', 'volume_4b68dad5-e9a3-4bd1-84e2-ba745cb7bb83/20260703094505/az_nova_backup_cfdc4925-e984-4da2-aa3e-e1e8a7c37558-00003', 'volume_4b68dad5-e9a3-4bd1-84e2-ba745cb7bb83/20260703094505/az_nova_backup_cfdc4925-e984-4da2-aa3e-e1e8a7c37558-00004', 'volume_4b68dad5-e9a3-4bd1-84e2-ba745cb7bb83/20260703094505/az_nova_backup_cfdc4925-e984-4da2-aa3e-e1e8a7c37558-00005', 'volume_4b68dad5-e9a3-4bd1-84e2-ba745cb7bb83/20260703094505/az_nova_backup_cfdc4925-e984-4da2-aa3e-e1e8a7c37558-00006', 'volume_4b68dad5-e9a3-4bd1-84e2-ba745cb7bb83/20260703094505/az_nova_backup_cfdc4925-e984-4da2-aa3e-e1e8a7c37558-00007', 'volume_4b68dad5-e9a3-4bd1-84e2-ba745cb7bb83/20260703094505/az_nova_backup_cfdc4925-e984-4da2-aa3e-e1e8a7c37558-00008', 'volume_4b68dad5-e9a3-4bd1-84e2-ba745cb7bb83/20260703094505/az_nova_backup_cfdc4925-e984-4da2-aa3e-e1e8a7c37558-00009', 'volume_4b68dad5-e9a3-4bd1-84e2-ba745cb7bb83/20260703094505/az_nova_backup_cfdc4925-e984-4da2-aa3e-e1e8a7c37558-00010', 'volume_4b68dad5-e9a3-4bd1-84e2-ba745cb7bb83/20260703094505/az_nova_backup_cfdc4925-e984-4da2-aa3e-e1e8a7c37558-00011', 'volume_4b68dad5-e9a3-4bd1-84e2-ba745cb7bb83/20260703094505/az_nova_backup_cfdc4925-e984-4da2-aa3e-e1e8a7c37558-00012', 'volume_4b68dad5-e9a3-4bd1-84e2-ba745cb7bb83/20260703094505/az_nova_backup_cfdc4925-e984-4da2-aa3e-e1e8a7c37558-00013', 'volume_4b68dad5-e9a3-4bd1-84e2-ba745cb7bb83/20260703094505/az_nova_backup_cfdc4925-e984-4da2-aa3e-e1e8a7c37558-00014', 'volume_4b68dad5-e9a3-4bd1-84e2-ba745cb7bb83/20260703094505/az_nova_backup_cfdc4925-e984-4da2-aa3e-e1e8a7c37558-00015', 'volume_4b68dad5-e9a3-4bd1-84e2-ba745cb7bb83/20260703094505/az_nova_backup_cfdc4925-e984-4da2-aa3e-e1e8a7c37558-00016', 'volume_4b68dad5-e9a3-4bd1-84e2-ba745cb7bb83/20260703094505/az_nova_backup_cfdc4925-e984-4da2-aa3e-e1e8a7c37558-00017', 'volume_4b68dad5-e9a3-4bd1-84e2-ba745cb7bb83/20260703094505/az_nova_backup_cfdc4925-e984-4da2-aa3e-e1e8a7c37558-00018', 'volume_4b68dad5-e9a3-4bd1-84e2-ba745cb7bb83/20260703094505/az_nova_backup_cfdc4925-e984-4da2-aa3e-e1e8a7c37558-00019', 'volume_4b68dad5-e9a3-4bd1-84e2-ba745cb7bb83/20260703094505/az_nova_backup_cfdc4925-e984-4da2-aa3e-e1e8a7c37558-00020', 'volume_4b68dad5-e9a3-4bd1-84e2-ba745cb7bb83/20260703094505/az_nova_backup_cfdc4925-e984-4da2-aa3e-e1e8a7c37558-00021']. {{(pid=101319) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:685}} Jul 03 09:46:54.783503 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-90f98a9f-c4f1-4c4e-a984-1f6f6f0a3431 tempest-ProjectAdminTests33-1900627284 None] generated object list: ['volume_4b68dad5-e9a3-4bd1-84e2-ba745cb7bb83/20260703094505/az_nova_backup_cfdc4925-e984-4da2-aa3e-e1e8a7c37558-00001', 'volume_4b68dad5-e9a3-4bd1-84e2-ba745cb7bb83/20260703094505/az_nova_backup_cfdc4925-e984-4da2-aa3e-e1e8a7c37558-00002', 'volume_4b68dad5-e9a3-4bd1-84e2-ba745cb7bb83/20260703094505/az_nova_backup_cfdc4925-e984-4da2-aa3e-e1e8a7c37558-00003', 'volume_4b68dad5-e9a3-4bd1-84e2-ba745cb7bb83/20260703094505/az_nova_backup_cfdc4925-e984-4da2-aa3e-e1e8a7c37558-00004', 'volume_4b68dad5-e9a3-4bd1-84e2-ba745cb7bb83/20260703094505/az_nova_backup_cfdc4925-e984-4da2-aa3e-e1e8a7c37558-00005', 'volume_4b68dad5-e9a3-4bd1-84e2-ba745cb7bb83/20260703094505/az_nova_backup_cfdc4925-e984-4da2-aa3e-e1e8a7c37558-00006', 'volume_4b68dad5-e9a3-4bd1-84e2-ba745cb7bb83/20260703094505/az_nova_backup_cfdc4925-e984-4da2-aa3e-e1e8a7c37558-00007', 'volume_4b68dad5-e9a3-4bd1-84e2-ba745cb7bb83/20260703094505/az_nova_backup_cfdc4925-e984-4da2-aa3e-e1e8a7c37558-00008', 'volume_4b68dad5-e9a3-4bd1-84e2-ba745cb7bb83/20260703094505/az_nova_backup_cfdc4925-e984-4da2-aa3e-e1e8a7c37558-00009', 'volume_4b68dad5-e9a3-4bd1-84e2-ba745cb7bb83/20260703094505/az_nova_backup_cfdc4925-e984-4da2-aa3e-e1e8a7c37558-00010', 'volume_4b68dad5-e9a3-4bd1-84e2-ba745cb7bb83/20260703094505/az_nova_backup_cfdc4925-e984-4da2-aa3e-e1e8a7c37558-00011', 'volume_4b68dad5-e9a3-4bd1-84e2-ba745cb7bb83/20260703094505/az_nova_backup_cfdc4925-e984-4da2-aa3e-e1e8a7c37558-00012', 'volume_4b68dad5-e9a3-4bd1-84e2-ba745cb7bb83/20260703094505/az_nova_backup_cfdc4925-e984-4da2-aa3e-e1e8a7c37558-00013', 'volume_4b68dad5-e9a3-4bd1-84e2-ba745cb7bb83/20260703094505/az_nova_backup_cfdc4925-e984-4da2-aa3e-e1e8a7c37558-00014', 'volume_4b68dad5-e9a3-4bd1-84e2-ba745cb7bb83/20260703094505/az_nova_backup_cfdc4925-e984-4da2-aa3e-e1e8a7c37558-00015', 'volume_4b68dad5-e9a3-4bd1-84e2-ba745cb7bb83/20260703094505/az_nova_backup_cfdc4925-e984-4da2-aa3e-e1e8a7c37558-00016', 'volume_4b68dad5-e9a3-4bd1-84e2-ba745cb7bb83/20260703094505/az_nova_backup_cfdc4925-e984-4da2-aa3e-e1e8a7c37558-00017', 'volume_4b68dad5-e9a3-4bd1-84e2-ba745cb7bb83/20260703094505/az_nova_backup_cfdc4925-e984-4da2-aa3e-e1e8a7c37558-00018', 'volume_4b68dad5-e9a3-4bd1-84e2-ba745cb7bb83/20260703094505/az_nova_backup_cfdc4925-e984-4da2-aa3e-e1e8a7c37558-00019', 'volume_4b68dad5-e9a3-4bd1-84e2-ba745cb7bb83/20260703094505/az_nova_backup_cfdc4925-e984-4da2-aa3e-e1e8a7c37558-00020', 'volume_4b68dad5-e9a3-4bd1-84e2-ba745cb7bb83/20260703094505/az_nova_backup_cfdc4925-e984-4da2-aa3e-e1e8a7c37558-00021', 'volume_4b68dad5-e9a3-4bd1-84e2-ba745cb7bb83/20260703094505/az_nova_backup_cfdc4925-e984-4da2-aa3e-e1e8a7c37558_metadata', 'volume_4b68dad5-e9a3-4bd1-84e2-ba745cb7bb83/20260703094505/az_nova_backup_cfdc4925-e984-4da2-aa3e-e1e8a7c37558_sha256file']. {{(pid=101319) _generate_object_names /opt/stack/cinder/cinder/backup/chunkeddriver.py:260}} Jul 03 09:46:54.826988 np0000004400 cinder-backup[101319]: DEBUG oslo_db.sqlalchemy.engines [None req-90f98a9f-c4f1-4c4e-a984-1f6f6f0a3431 tempest-ProjectAdminTests33-1900627284 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=101319) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 03 09:46:54.845105 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-90f98a9f-c4f1-4c4e-a984-1f6f6f0a3431 tempest-ProjectAdminTests33-1900627284 None] restoring object. backup: cfdc4925-e984-4da2-aa3e-e1e8a7c37558, container: volumebackups, object name: volume_4b68dad5-e9a3-4bd1-84e2-ba745cb7bb83/20260703094505/az_nova_backup_cfdc4925-e984-4da2-aa3e-e1e8a7c37558-00001, volume: 2f85e2c7-ae08-48ab-bf50-358f3320874d. {{(pid=101319) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:705}} Jul 03 09:46:54.866698 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-90f98a9f-c4f1-4c4e-a984-1f6f6f0a3431 tempest-ProjectAdminTests33-1900627284 None] decompressing data using zlib algorithm {{(pid=101319) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:722}} Jul 03 09:46:55.249216 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-90f98a9f-c4f1-4c4e-a984-1f6f6f0a3431 tempest-ProjectAdminTests33-1900627284 None] restoring object. backup: cfdc4925-e984-4da2-aa3e-e1e8a7c37558, container: volumebackups, object name: volume_4b68dad5-e9a3-4bd1-84e2-ba745cb7bb83/20260703094505/az_nova_backup_cfdc4925-e984-4da2-aa3e-e1e8a7c37558-00002, volume: 2f85e2c7-ae08-48ab-bf50-358f3320874d. {{(pid=101319) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:705}} Jul 03 09:46:55.266834 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-90f98a9f-c4f1-4c4e-a984-1f6f6f0a3431 tempest-ProjectAdminTests33-1900627284 None] decompressing data using zlib algorithm {{(pid=101319) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:722}} Jul 03 09:46:55.628325 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-90f98a9f-c4f1-4c4e-a984-1f6f6f0a3431 tempest-ProjectAdminTests33-1900627284 None] restoring object. backup: cfdc4925-e984-4da2-aa3e-e1e8a7c37558, container: volumebackups, object name: volume_4b68dad5-e9a3-4bd1-84e2-ba745cb7bb83/20260703094505/az_nova_backup_cfdc4925-e984-4da2-aa3e-e1e8a7c37558-00003, volume: 2f85e2c7-ae08-48ab-bf50-358f3320874d. {{(pid=101319) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:705}} Jul 03 09:46:55.646363 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-90f98a9f-c4f1-4c4e-a984-1f6f6f0a3431 tempest-ProjectAdminTests33-1900627284 None] decompressing data using zlib algorithm {{(pid=101319) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:722}} Jul 03 09:46:55.999840 np0000004400 cinder-backup[101319]: DEBUG dbcounter [-] [101319] Writing DB stats cinder:SELECT=152,cinder:UPDATE=44,cinder:INSERT=8 {{(pid=101319) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 03 09:46:56.002654 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-90f98a9f-c4f1-4c4e-a984-1f6f6f0a3431 tempest-ProjectAdminTests33-1900627284 None] restoring object. backup: cfdc4925-e984-4da2-aa3e-e1e8a7c37558, container: volumebackups, object name: volume_4b68dad5-e9a3-4bd1-84e2-ba745cb7bb83/20260703094505/az_nova_backup_cfdc4925-e984-4da2-aa3e-e1e8a7c37558-00004, volume: 2f85e2c7-ae08-48ab-bf50-358f3320874d. {{(pid=101319) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:705}} Jul 03 09:46:56.016901 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-90f98a9f-c4f1-4c4e-a984-1f6f6f0a3431 tempest-ProjectAdminTests33-1900627284 None] decompressing data using zlib algorithm {{(pid=101319) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:722}} Jul 03 09:46:56.352068 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-90f98a9f-c4f1-4c4e-a984-1f6f6f0a3431 tempest-ProjectAdminTests33-1900627284 None] restoring object. backup: cfdc4925-e984-4da2-aa3e-e1e8a7c37558, container: volumebackups, object name: volume_4b68dad5-e9a3-4bd1-84e2-ba745cb7bb83/20260703094505/az_nova_backup_cfdc4925-e984-4da2-aa3e-e1e8a7c37558-00005, volume: 2f85e2c7-ae08-48ab-bf50-358f3320874d. {{(pid=101319) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:705}} Jul 03 09:46:56.366016 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-90f98a9f-c4f1-4c4e-a984-1f6f6f0a3431 tempest-ProjectAdminTests33-1900627284 None] decompressing data using zlib algorithm {{(pid=101319) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:722}} Jul 03 09:46:56.748151 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-90f98a9f-c4f1-4c4e-a984-1f6f6f0a3431 tempest-ProjectAdminTests33-1900627284 None] restoring object. backup: cfdc4925-e984-4da2-aa3e-e1e8a7c37558, container: volumebackups, object name: volume_4b68dad5-e9a3-4bd1-84e2-ba745cb7bb83/20260703094505/az_nova_backup_cfdc4925-e984-4da2-aa3e-e1e8a7c37558-00006, volume: 2f85e2c7-ae08-48ab-bf50-358f3320874d. {{(pid=101319) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:705}} Jul 03 09:46:56.769479 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-90f98a9f-c4f1-4c4e-a984-1f6f6f0a3431 tempest-ProjectAdminTests33-1900627284 None] decompressing data using zlib algorithm {{(pid=101319) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:722}} Jul 03 09:46:57.120287 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-90f98a9f-c4f1-4c4e-a984-1f6f6f0a3431 tempest-ProjectAdminTests33-1900627284 None] restoring object. backup: cfdc4925-e984-4da2-aa3e-e1e8a7c37558, container: volumebackups, object name: volume_4b68dad5-e9a3-4bd1-84e2-ba745cb7bb83/20260703094505/az_nova_backup_cfdc4925-e984-4da2-aa3e-e1e8a7c37558-00007, volume: 2f85e2c7-ae08-48ab-bf50-358f3320874d. {{(pid=101319) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:705}} Jul 03 09:46:57.134677 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-90f98a9f-c4f1-4c4e-a984-1f6f6f0a3431 tempest-ProjectAdminTests33-1900627284 None] decompressing data using zlib algorithm {{(pid=101319) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:722}} Jul 03 09:46:57.490386 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-90f98a9f-c4f1-4c4e-a984-1f6f6f0a3431 tempest-ProjectAdminTests33-1900627284 None] restoring object. backup: cfdc4925-e984-4da2-aa3e-e1e8a7c37558, container: volumebackups, object name: volume_4b68dad5-e9a3-4bd1-84e2-ba745cb7bb83/20260703094505/az_nova_backup_cfdc4925-e984-4da2-aa3e-e1e8a7c37558-00008, volume: 2f85e2c7-ae08-48ab-bf50-358f3320874d. {{(pid=101319) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:705}} Jul 03 09:46:57.514029 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-90f98a9f-c4f1-4c4e-a984-1f6f6f0a3431 tempest-ProjectAdminTests33-1900627284 None] decompressing data using zlib algorithm {{(pid=101319) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:722}} Jul 03 09:46:57.846601 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-90f98a9f-c4f1-4c4e-a984-1f6f6f0a3431 tempest-ProjectAdminTests33-1900627284 None] restoring object. backup: cfdc4925-e984-4da2-aa3e-e1e8a7c37558, container: volumebackups, object name: volume_4b68dad5-e9a3-4bd1-84e2-ba745cb7bb83/20260703094505/az_nova_backup_cfdc4925-e984-4da2-aa3e-e1e8a7c37558-00009, volume: 2f85e2c7-ae08-48ab-bf50-358f3320874d. {{(pid=101319) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:705}} Jul 03 09:46:57.864828 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-90f98a9f-c4f1-4c4e-a984-1f6f6f0a3431 tempest-ProjectAdminTests33-1900627284 None] decompressing data using zlib algorithm {{(pid=101319) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:722}} Jul 03 09:46:58.207397 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-90f98a9f-c4f1-4c4e-a984-1f6f6f0a3431 tempest-ProjectAdminTests33-1900627284 None] restoring object. backup: cfdc4925-e984-4da2-aa3e-e1e8a7c37558, container: volumebackups, object name: volume_4b68dad5-e9a3-4bd1-84e2-ba745cb7bb83/20260703094505/az_nova_backup_cfdc4925-e984-4da2-aa3e-e1e8a7c37558-00010, volume: 2f85e2c7-ae08-48ab-bf50-358f3320874d. {{(pid=101319) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:705}} Jul 03 09:46:58.224862 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-90f98a9f-c4f1-4c4e-a984-1f6f6f0a3431 tempest-ProjectAdminTests33-1900627284 None] decompressing data using zlib algorithm {{(pid=101319) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:722}} Jul 03 09:46:58.556991 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-90f98a9f-c4f1-4c4e-a984-1f6f6f0a3431 tempest-ProjectAdminTests33-1900627284 None] restoring object. backup: cfdc4925-e984-4da2-aa3e-e1e8a7c37558, container: volumebackups, object name: volume_4b68dad5-e9a3-4bd1-84e2-ba745cb7bb83/20260703094505/az_nova_backup_cfdc4925-e984-4da2-aa3e-e1e8a7c37558-00011, volume: 2f85e2c7-ae08-48ab-bf50-358f3320874d. {{(pid=101319) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:705}} Jul 03 09:46:58.574733 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-90f98a9f-c4f1-4c4e-a984-1f6f6f0a3431 tempest-ProjectAdminTests33-1900627284 None] decompressing data using zlib algorithm {{(pid=101319) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:722}} Jul 03 09:46:58.913397 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-90f98a9f-c4f1-4c4e-a984-1f6f6f0a3431 tempest-ProjectAdminTests33-1900627284 None] restoring object. backup: cfdc4925-e984-4da2-aa3e-e1e8a7c37558, container: volumebackups, object name: volume_4b68dad5-e9a3-4bd1-84e2-ba745cb7bb83/20260703094505/az_nova_backup_cfdc4925-e984-4da2-aa3e-e1e8a7c37558-00012, volume: 2f85e2c7-ae08-48ab-bf50-358f3320874d. {{(pid=101319) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:705}} Jul 03 09:46:58.926400 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-90f98a9f-c4f1-4c4e-a984-1f6f6f0a3431 tempest-ProjectAdminTests33-1900627284 None] decompressing data using zlib algorithm {{(pid=101319) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:722}} Jul 03 09:46:59.275015 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-90f98a9f-c4f1-4c4e-a984-1f6f6f0a3431 tempest-ProjectAdminTests33-1900627284 None] restoring object. backup: cfdc4925-e984-4da2-aa3e-e1e8a7c37558, container: volumebackups, object name: volume_4b68dad5-e9a3-4bd1-84e2-ba745cb7bb83/20260703094505/az_nova_backup_cfdc4925-e984-4da2-aa3e-e1e8a7c37558-00013, volume: 2f85e2c7-ae08-48ab-bf50-358f3320874d. {{(pid=101319) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:705}} Jul 03 09:46:59.288419 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-90f98a9f-c4f1-4c4e-a984-1f6f6f0a3431 tempest-ProjectAdminTests33-1900627284 None] decompressing data using zlib algorithm {{(pid=101319) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:722}} Jul 03 09:46:59.631475 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-90f98a9f-c4f1-4c4e-a984-1f6f6f0a3431 tempest-ProjectAdminTests33-1900627284 None] restoring object. backup: cfdc4925-e984-4da2-aa3e-e1e8a7c37558, container: volumebackups, object name: volume_4b68dad5-e9a3-4bd1-84e2-ba745cb7bb83/20260703094505/az_nova_backup_cfdc4925-e984-4da2-aa3e-e1e8a7c37558-00014, volume: 2f85e2c7-ae08-48ab-bf50-358f3320874d. {{(pid=101319) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:705}} Jul 03 09:46:59.645394 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-90f98a9f-c4f1-4c4e-a984-1f6f6f0a3431 tempest-ProjectAdminTests33-1900627284 None] decompressing data using zlib algorithm {{(pid=101319) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:722}} Jul 03 09:46:59.970864 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-90f98a9f-c4f1-4c4e-a984-1f6f6f0a3431 tempest-ProjectAdminTests33-1900627284 None] restoring object. backup: cfdc4925-e984-4da2-aa3e-e1e8a7c37558, container: volumebackups, object name: volume_4b68dad5-e9a3-4bd1-84e2-ba745cb7bb83/20260703094505/az_nova_backup_cfdc4925-e984-4da2-aa3e-e1e8a7c37558-00015, volume: 2f85e2c7-ae08-48ab-bf50-358f3320874d. {{(pid=101319) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:705}} Jul 03 09:46:59.986024 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-90f98a9f-c4f1-4c4e-a984-1f6f6f0a3431 tempest-ProjectAdminTests33-1900627284 None] decompressing data using zlib algorithm {{(pid=101319) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:722}} Jul 03 09:47:00.349768 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-90f98a9f-c4f1-4c4e-a984-1f6f6f0a3431 tempest-ProjectAdminTests33-1900627284 None] restoring object. backup: cfdc4925-e984-4da2-aa3e-e1e8a7c37558, container: volumebackups, object name: volume_4b68dad5-e9a3-4bd1-84e2-ba745cb7bb83/20260703094505/az_nova_backup_cfdc4925-e984-4da2-aa3e-e1e8a7c37558-00016, volume: 2f85e2c7-ae08-48ab-bf50-358f3320874d. {{(pid=101319) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:705}} Jul 03 09:47:00.364158 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-90f98a9f-c4f1-4c4e-a984-1f6f6f0a3431 tempest-ProjectAdminTests33-1900627284 None] decompressing data using zlib algorithm {{(pid=101319) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:722}} Jul 03 09:47:00.699767 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-90f98a9f-c4f1-4c4e-a984-1f6f6f0a3431 tempest-ProjectAdminTests33-1900627284 None] restoring object. backup: cfdc4925-e984-4da2-aa3e-e1e8a7c37558, container: volumebackups, object name: volume_4b68dad5-e9a3-4bd1-84e2-ba745cb7bb83/20260703094505/az_nova_backup_cfdc4925-e984-4da2-aa3e-e1e8a7c37558-00017, volume: 2f85e2c7-ae08-48ab-bf50-358f3320874d. {{(pid=101319) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:705}} Jul 03 09:47:00.716829 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-90f98a9f-c4f1-4c4e-a984-1f6f6f0a3431 tempest-ProjectAdminTests33-1900627284 None] decompressing data using zlib algorithm {{(pid=101319) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:722}} Jul 03 09:47:01.048695 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-90f98a9f-c4f1-4c4e-a984-1f6f6f0a3431 tempest-ProjectAdminTests33-1900627284 None] restoring object. backup: cfdc4925-e984-4da2-aa3e-e1e8a7c37558, container: volumebackups, object name: volume_4b68dad5-e9a3-4bd1-84e2-ba745cb7bb83/20260703094505/az_nova_backup_cfdc4925-e984-4da2-aa3e-e1e8a7c37558-00018, volume: 2f85e2c7-ae08-48ab-bf50-358f3320874d. {{(pid=101319) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:705}} Jul 03 09:47:01.069838 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-90f98a9f-c4f1-4c4e-a984-1f6f6f0a3431 tempest-ProjectAdminTests33-1900627284 None] decompressing data using zlib algorithm {{(pid=101319) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:722}} Jul 03 09:47:01.407342 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-90f98a9f-c4f1-4c4e-a984-1f6f6f0a3431 tempest-ProjectAdminTests33-1900627284 None] restoring object. backup: cfdc4925-e984-4da2-aa3e-e1e8a7c37558, container: volumebackups, object name: volume_4b68dad5-e9a3-4bd1-84e2-ba745cb7bb83/20260703094505/az_nova_backup_cfdc4925-e984-4da2-aa3e-e1e8a7c37558-00019, volume: 2f85e2c7-ae08-48ab-bf50-358f3320874d. {{(pid=101319) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:705}} Jul 03 09:47:01.426275 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-90f98a9f-c4f1-4c4e-a984-1f6f6f0a3431 tempest-ProjectAdminTests33-1900627284 None] decompressing data using zlib algorithm {{(pid=101319) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:722}} Jul 03 09:47:01.764973 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-90f98a9f-c4f1-4c4e-a984-1f6f6f0a3431 tempest-ProjectAdminTests33-1900627284 None] restoring object. backup: cfdc4925-e984-4da2-aa3e-e1e8a7c37558, container: volumebackups, object name: volume_4b68dad5-e9a3-4bd1-84e2-ba745cb7bb83/20260703094505/az_nova_backup_cfdc4925-e984-4da2-aa3e-e1e8a7c37558-00020, volume: 2f85e2c7-ae08-48ab-bf50-358f3320874d. {{(pid=101319) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:705}} Jul 03 09:47:01.778383 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-90f98a9f-c4f1-4c4e-a984-1f6f6f0a3431 tempest-ProjectAdminTests33-1900627284 None] decompressing data using zlib algorithm {{(pid=101319) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:722}} Jul 03 09:47:02.114209 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-90f98a9f-c4f1-4c4e-a984-1f6f6f0a3431 tempest-ProjectAdminTests33-1900627284 None] restoring object. backup: cfdc4925-e984-4da2-aa3e-e1e8a7c37558, container: volumebackups, object name: volume_4b68dad5-e9a3-4bd1-84e2-ba745cb7bb83/20260703094505/az_nova_backup_cfdc4925-e984-4da2-aa3e-e1e8a7c37558-00021, volume: 2f85e2c7-ae08-48ab-bf50-358f3320874d. {{(pid=101319) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:705}} Jul 03 09:47:02.127615 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-90f98a9f-c4f1-4c4e-a984-1f6f6f0a3431 tempest-ProjectAdminTests33-1900627284 None] decompressing data using zlib algorithm {{(pid=101319) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:722}} Jul 03 09:47:02.280953 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-90f98a9f-c4f1-4c4e-a984-1f6f6f0a3431 tempest-ProjectAdminTests33-1900627284 None] v1 volume backup restore of cfdc4925-e984-4da2-aa3e-e1e8a7c37558 finished. {{(pid=101319) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:750}} Jul 03 09:47:02.281149 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.driver [None req-90f98a9f-c4f1-4c4e-a984-1f6f6f0a3431 tempest-ProjectAdminTests33-1900627284 None] Restoring volume base metadata {{(pid=101319) _restore_vol_base_meta /opt/stack/cinder/cinder/backup/driver.py:177}} Jul 03 09:47:02.286290 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.driver [None req-90f98a9f-c4f1-4c4e-a984-1f6f6f0a3431 tempest-ProjectAdminTests33-1900627284 None] Excluding field 'display_name' {{(pid=101319) _filter /opt/stack/cinder/cinder/backup/driver.py:171}} Jul 03 09:47:02.286416 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.driver [None req-90f98a9f-c4f1-4c4e-a984-1f6f6f0a3431 tempest-ProjectAdminTests33-1900627284 None] Excluding field 'display_description' {{(pid=101319) _filter /opt/stack/cinder/cinder/backup/driver.py:171}} Jul 03 09:47:02.297778 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.driver [None req-90f98a9f-c4f1-4c4e-a984-1f6f6f0a3431 tempest-ProjectAdminTests33-1900627284 None] No metadata of type 'volume-metadata' to restore {{(pid=101319) put /opt/stack/cinder/cinder/backup/driver.py:345}} Jul 03 09:47:02.297939 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.driver [None req-90f98a9f-c4f1-4c4e-a984-1f6f6f0a3431 tempest-ProjectAdminTests33-1900627284 None] No metadata of type 'volume-glance-metadata' to restore {{(pid=101319) put /opt/stack/cinder/cinder/backup/driver.py:345}} Jul 03 09:47:02.298086 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-90f98a9f-c4f1-4c4e-a984-1f6f6f0a3431 tempest-ProjectAdminTests33-1900627284 None] restore cfdc4925-e984-4da2-aa3e-e1e8a7c37558 to 2f85e2c7-ae08-48ab-bf50-358f3320874d finished. {{(pid=101319) restore /opt/stack/cinder/cinder/backup/chunkeddriver.py:815}} Jul 03 09:47:02.298537 np0000004400 cinder-backup[101319]: DEBUG oslo_concurrency.processutils [None req-90f98a9f-c4f1-4c4e-a984-1f6f6f0a3431 tempest-ProjectAdminTests33-1900627284 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chown 0 /dev/sdb {{(pid=101319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 09:47:02.316766 np0000004400 sudo[139930]: stack : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chown 0 /dev/sdb Jul 03 09:47:02.317597 np0000004400 sudo[139930]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1002) Jul 03 09:47:02.653838 np0000004400 sudo[139930]: pam_unix(sudo:session): session closed for user root Jul 03 09:47:02.655955 np0000004400 cinder-backup[101319]: DEBUG oslo_concurrency.processutils [None req-90f98a9f-c4f1-4c4e-a984-1f6f6f0a3431 tempest-ProjectAdminTests33-1900627284 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chown 0 /dev/sdb" returned: 0 in 0.357s {{(pid=101319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 09:47:02.656557 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-90f98a9f-c4f1-4c4e-a984-1f6f6f0a3431 tempest-ProjectAdminTests33-1900627284 None] ==> disconnect_volume: call "{'args': (, {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-2f85e2c7-ae08-48ab-bf50-358f3320874d', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '2f85e2c7-ae08-48ab-bf50-358f3320874d', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': False}, {'type': 'block', 'scsi_wwn': '330000000f4c3d716', 'path': '/dev/sdb'}), 'kwargs': {'force': True, 'ignore_errors': False}}" {{(pid=101319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}} Jul 03 09:47:02.656779 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.base [None req-90f98a9f-c4f1-4c4e-a984-1f6f6f0a3431 tempest-ProjectAdminTests33-1900627284 None] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=101319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jul 03 09:47:02.657190 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.base [None req-90f98a9f-c4f1-4c4e-a984-1f6f6f0a3431 tempest-ProjectAdminTests33-1900627284 None] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.000s {{(pid=101319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jul 03 09:47:02.658306 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-90f98a9f-c4f1-4c4e-a984-1f6f6f0a3431 tempest-ProjectAdminTests33-1900627284 None] _get_connection_devices called with parameters: connection_properties={'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-2f85e2c7-ae08-48ab-bf50-358f3320874d', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '2f85e2c7-ae08-48ab-bf50-358f3320874d', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': False}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=101319) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:847}} Jul 03 09:47:02.668629 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-90f98a9f-c4f1-4c4e-a984-1f6f6f0a3431 tempest-ProjectAdminTests33-1900627284 None] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS: Jul 03 09:47:02.668629 np0000004400 cinder-backup[101319]: No targets found. Jul 03 09:47:02.668629 np0000004400 cinder-backup[101319]: iSNS: Jul 03 09:47:02.668629 np0000004400 cinder-backup[101319]: No targets found. Jul 03 09:47:02.668629 np0000004400 cinder-backup[101319]: STATIC: Jul 03 09:47:02.668629 np0000004400 cinder-backup[101319]: Target: iqn.2023-03.storpool.com:os--volume-76320525-737e-4f58-8523-63ec9abbdc64 Jul 03 09:47:02.668629 np0000004400 cinder-backup[101319]: Portal: 192.168.50.100:3260,-1 Jul 03 09:47:02.668629 np0000004400 cinder-backup[101319]: Iface Name: default Jul 03 09:47:02.668629 np0000004400 cinder-backup[101319]: Portal: 192.168.40.100:3260,-1 Jul 03 09:47:02.668629 np0000004400 cinder-backup[101319]: Iface Name: default Jul 03 09:47:02.668629 np0000004400 cinder-backup[101319]: Target: iqn.2023-03.storpool.com:os--volume-72e07e1e-1567-4071-8204-c29cb26d2660 Jul 03 09:47:02.668629 np0000004400 cinder-backup[101319]: Portal: 192.168.50.100:3260,-1 Jul 03 09:47:02.668629 np0000004400 cinder-backup[101319]: Iface Name: default Jul 03 09:47:02.668629 np0000004400 cinder-backup[101319]: Portal: 192.168.40.100:3260,-1 Jul 03 09:47:02.668629 np0000004400 cinder-backup[101319]: Iface Name: default Jul 03 09:47:02.668629 np0000004400 cinder-backup[101319]: Target: iqn.2023-03.storpool.com:os--volume-2f85e2c7-ae08-48ab-bf50-358f3320874d Jul 03 09:47:02.668629 np0000004400 cinder-backup[101319]: Portal: 192.168.40.100:3260,-1 Jul 03 09:47:02.668629 np0000004400 cinder-backup[101319]: Iface Name: default Jul 03 09:47:02.668629 np0000004400 cinder-backup[101319]: FIRMWARE: Jul 03 09:47:02.668629 np0000004400 cinder-backup[101319]: No targets found. Jul 03 09:47:02.668629 np0000004400 cinder-backup[101319]: stderr= {{(pid=101319) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jul 03 09:47:02.669180 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-90f98a9f-c4f1-4c4e-a984-1f6f6f0a3431 tempest-ProjectAdminTests33-1900627284 None] Regex to get portals from discoverydb: ^SENDTARGETS: Jul 03 09:47:02.669180 np0000004400 cinder-backup[101319]: .*?^DiscoveryAddress: 192.168.40.100,3260.*? Jul 03 09:47:02.669180 np0000004400 cinder-backup[101319]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=101319) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:390}} Jul 03 09:47:02.669180 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-90f98a9f-c4f1-4c4e-a984-1f6f6f0a3431 tempest-ProjectAdminTests33-1900627284 None] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-2f85e2c7-ae08-48ab-bf50-358f3320874d', 0)] {{(pid=101319) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:858}} Jul 03 09:47:02.691236 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-90f98a9f-c4f1-4c4e-a984-1f6f6f0a3431 tempest-ProjectAdminTests33-1900627284 None] iscsiadm ('-m', 'session'): stdout=tcp: [113] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-72e07e1e-1567-4071-8204-c29cb26d2660 (non-flash) Jul 03 09:47:02.691236 np0000004400 cinder-backup[101319]: tcp: [114] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-72e07e1e-1567-4071-8204-c29cb26d2660 (non-flash) Jul 03 09:47:02.691236 np0000004400 cinder-backup[101319]: tcp: [118] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2f85e2c7-ae08-48ab-bf50-358f3320874d (non-flash) Jul 03 09:47:02.691236 np0000004400 cinder-backup[101319]: tcp: [82] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-76320525-737e-4f58-8523-63ec9abbdc64 (non-flash) Jul 03 09:47:02.691236 np0000004400 cinder-backup[101319]: tcp: [83] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-76320525-737e-4f58-8523-63ec9abbdc64 (non-flash) Jul 03 09:47:02.691236 np0000004400 cinder-backup[101319]: stderr= {{(pid=101319) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jul 03 09:47:02.691461 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-90f98a9f-c4f1-4c4e-a984-1f6f6f0a3431 tempest-ProjectAdminTests33-1900627284 None] iscsi session list stdout=tcp: [113] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-72e07e1e-1567-4071-8204-c29cb26d2660 (non-flash) Jul 03 09:47:02.691461 np0000004400 cinder-backup[101319]: tcp: [114] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-72e07e1e-1567-4071-8204-c29cb26d2660 (non-flash) Jul 03 09:47:02.691461 np0000004400 cinder-backup[101319]: tcp: [118] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2f85e2c7-ae08-48ab-bf50-358f3320874d (non-flash) Jul 03 09:47:02.691461 np0000004400 cinder-backup[101319]: tcp: [82] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-76320525-737e-4f58-8523-63ec9abbdc64 (non-flash) Jul 03 09:47:02.691461 np0000004400 cinder-backup[101319]: tcp: [83] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-76320525-737e-4f58-8523-63ec9abbdc64 (non-flash) Jul 03 09:47:02.691461 np0000004400 cinder-backup[101319]: stderr= {{(pid=101319) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jul 03 09:47:02.691657 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-90f98a9f-c4f1-4c4e-a984-1f6f6f0a3431 tempest-ProjectAdminTests33-1900627284 None] Sessions list: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-72e07e1e-1567-4071-8204-c29cb26d2660', '113'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-72e07e1e-1567-4071-8204-c29cb26d2660', '114'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-2f85e2c7-ae08-48ab-bf50-358f3320874d', '118'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-76320525-737e-4f58-8523-63ec9abbdc64', '82'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-76320525-737e-4f58-8523-63ec9abbdc64', '83')] {{(pid=101319) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:866}} Jul 03 09:47:02.691747 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-90f98a9f-c4f1-4c4e-a984-1f6f6f0a3431 tempest-ProjectAdminTests33-1900627284 None] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-2f85e2c7-ae08-48ab-bf50-358f3320874d, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-2f85e2c7-ae08-48ab-bf50-358f3320874d', '118')] {{(pid=101319) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}} Jul 03 09:47:02.692591 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-90f98a9f-c4f1-4c4e-a984-1f6f6f0a3431 tempest-ProjectAdminTests33-1900627284 None] Resulting device map defaultdict(. at 0x7e77058e3f60>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-2f85e2c7-ae08-48ab-bf50-358f3320874d'): ({'sdb'}, set())}) {{(pid=101319) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:912}} Jul 03 09:47:02.692773 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.linuxscsi [None req-90f98a9f-c4f1-4c4e-a984-1f6f6f0a3431 tempest-ProjectAdminTests33-1900627284 None] Removing single pathed devices sdb {{(pid=101319) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}} Jul 03 09:47:02.704095 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.linuxscsi [None req-90f98a9f-c4f1-4c4e-a984-1f6f6f0a3431 tempest-ProjectAdminTests33-1900627284 None] Flushing IO for device /dev/sdb {{(pid=101319) flush_device_io /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:461}} Jul 03 09:47:02.712365 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.linuxscsi [None req-90f98a9f-c4f1-4c4e-a984-1f6f6f0a3431 tempest-ProjectAdminTests33-1900627284 None] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=101319) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}} Jul 03 09:47:02.778808 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.linuxscsi [None req-90f98a9f-c4f1-4c4e-a984-1f6f6f0a3431 tempest-ProjectAdminTests33-1900627284 None] Checking to see if SCSI volumes sdb have been removed. {{(pid=101319) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}} Jul 03 09:47:02.778808 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.linuxscsi [None req-90f98a9f-c4f1-4c4e-a984-1f6f6f0a3431 tempest-ProjectAdminTests33-1900627284 None] SCSI volumes sdb have been removed. {{(pid=101319) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}} Jul 03 09:47:02.778808 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.linuxscsi [None req-90f98a9f-c4f1-4c4e-a984-1f6f6f0a3431 tempest-ProjectAdminTests33-1900627284 None] Checking to see if device paths {'sdb'} are still under multipathd monitoring {{(pid=101319) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}} Jul 03 09:47:02.778808 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.linuxscsi [None req-90f98a9f-c4f1-4c4e-a984-1f6f6f0a3431 tempest-ProjectAdminTests33-1900627284 None] Device paths {'sdb'} have been removed from multipathd monitoring. {{(pid=101319) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}} Jul 03 09:47:02.778808 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-90f98a9f-c4f1-4c4e-a984-1f6f6f0a3431 tempest-ProjectAdminTests33-1900627284 None] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-2f85e2c7-ae08-48ab-bf50-358f3320874d')] {{(pid=101319) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1225}} Jul 03 09:47:02.780455 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-90f98a9f-c4f1-4c4e-a984-1f6f6f0a3431 tempest-ProjectAdminTests33-1900627284 None] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=101319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 03 09:47:02.841831 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-90f98a9f-c4f1-4c4e-a984-1f6f6f0a3431 tempest-ProjectAdminTests33-1900627284 None] iscsiadm ('--logout',): stdout=Logging out of session [sid: 118, target: iqn.2023-03.storpool.com:os--volume-2f85e2c7-ae08-48ab-bf50-358f3320874d, portal: 192.168.40.100,3260] Jul 03 09:47:02.841831 np0000004400 cinder-backup[101319]: Logout of [sid: 118, target: iqn.2023-03.storpool.com:os--volume-2f85e2c7-ae08-48ab-bf50-358f3320874d, portal: 192.168.40.100,3260] successful. Jul 03 09:47:02.841831 np0000004400 cinder-backup[101319]: stderr= {{(pid=101319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 03 09:47:02.869303 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-90f98a9f-c4f1-4c4e-a984-1f6f6f0a3431 tempest-ProjectAdminTests33-1900627284 None] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=101319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 03 09:47:02.869641 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.base [None req-90f98a9f-c4f1-4c4e-a984-1f6f6f0a3431 tempest-ProjectAdminTests33-1900627284 None] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.212s {{(pid=101319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jul 03 09:47:02.869793 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-90f98a9f-c4f1-4c4e-a984-1f6f6f0a3431 tempest-ProjectAdminTests33-1900627284 None] <== disconnect_volume: return (213ms) None {{(pid=101319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}} Jul 03 09:47:03.885891 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.manager [None req-90f98a9f-c4f1-4c4e-a984-1f6f6f0a3431 tempest-ProjectAdminTests33-1900627284 None] Encryption key ID for volume 2f85e2c7-ae08-48ab-bf50-358f3320874d already matches encryption key ID in backup cfdc4925-e984-4da2-aa3e-e1e8a7c37558. {{(pid=101319) _run_restore /opt/stack/cinder/cinder/backup/manager.py:873}} Jul 03 09:47:03.900507 np0000004400 cinder-backup[101319]: INFO cinder.backup.manager [None req-90f98a9f-c4f1-4c4e-a984-1f6f6f0a3431 tempest-ProjectAdminTests33-1900627284 None] Finished restoring backup cfdc4925-e984-4da2-aa3e-e1e8a7c37558 to volume 2f85e2c7-ae08-48ab-bf50-358f3320874d. Jul 03 09:47:05.488756 np0000004400 cinder-backup[101319]: INFO cinder.backup.manager [None req-f972a33b-2d21-44f1-a6cb-9a451bff23ef tempest-ProjectAdminTests33-1900627284 None] Delete backup started, backup: 64e0c106-c41a-47bc-80c1-33370700f504. Jul 03 09:47:05.494461 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.drivers.swift [None req-f972a33b-2d21-44f1-a6cb-9a451bff23ef tempest-ProjectAdminTests33-1900627284 None] Using swift URL https://10.4.3.95:8080/v1/AUTH_a2309d0555a742279b4a5017d94ebf02 {{(pid=101319) initialize /opt/stack/cinder/cinder/backup/drivers/swift.py:300}} Jul 03 09:47:05.494762 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.drivers.swift [None req-f972a33b-2d21-44f1-a6cb-9a451bff23ef tempest-ProjectAdminTests33-1900627284 None] Connect to https://10.4.3.95:8080/v1/AUTH_ in "per_user" mode {{(pid=101319) initialize /opt/stack/cinder/cinder/backup/drivers/swift.py:301}} Jul 03 09:47:05.494951 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-f972a33b-2d21-44f1-a6cb-9a451bff23ef tempest-ProjectAdminTests33-1900627284 None] delete started, backup: 64e0c106-c41a-47bc-80c1-33370700f504, container: volumebackups, prefix: volume_87113756-5260-460f-864c-3fb466e6be45/20260703094634/az_nova_backup_64e0c106-c41a-47bc-80c1-33370700f504. {{(pid=101319) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:822}} Jul 03 09:47:05.534801 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-f972a33b-2d21-44f1-a6cb-9a451bff23ef tempest-ProjectAdminTests33-1900627284 None] generated object list: ['volume_87113756-5260-460f-864c-3fb466e6be45/20260703094634/az_nova_backup_64e0c106-c41a-47bc-80c1-33370700f504-00001', 'volume_87113756-5260-460f-864c-3fb466e6be45/20260703094634/az_nova_backup_64e0c106-c41a-47bc-80c1-33370700f504-00002', 'volume_87113756-5260-460f-864c-3fb466e6be45/20260703094634/az_nova_backup_64e0c106-c41a-47bc-80c1-33370700f504-00003', 'volume_87113756-5260-460f-864c-3fb466e6be45/20260703094634/az_nova_backup_64e0c106-c41a-47bc-80c1-33370700f504-00004', 'volume_87113756-5260-460f-864c-3fb466e6be45/20260703094634/az_nova_backup_64e0c106-c41a-47bc-80c1-33370700f504-00005', 'volume_87113756-5260-460f-864c-3fb466e6be45/20260703094634/az_nova_backup_64e0c106-c41a-47bc-80c1-33370700f504-00006', 'volume_87113756-5260-460f-864c-3fb466e6be45/20260703094634/az_nova_backup_64e0c106-c41a-47bc-80c1-33370700f504-00007', 'volume_87113756-5260-460f-864c-3fb466e6be45/20260703094634/az_nova_backup_64e0c106-c41a-47bc-80c1-33370700f504-00008', 'volume_87113756-5260-460f-864c-3fb466e6be45/20260703094634/az_nova_backup_64e0c106-c41a-47bc-80c1-33370700f504-00009', 'volume_87113756-5260-460f-864c-3fb466e6be45/20260703094634/az_nova_backup_64e0c106-c41a-47bc-80c1-33370700f504-00010', 'volume_87113756-5260-460f-864c-3fb466e6be45/20260703094634/az_nova_backup_64e0c106-c41a-47bc-80c1-33370700f504-00011', 'volume_87113756-5260-460f-864c-3fb466e6be45/20260703094634/az_nova_backup_64e0c106-c41a-47bc-80c1-33370700f504-00012', 'volume_87113756-5260-460f-864c-3fb466e6be45/20260703094634/az_nova_backup_64e0c106-c41a-47bc-80c1-33370700f504-00013', 'volume_87113756-5260-460f-864c-3fb466e6be45/20260703094634/az_nova_backup_64e0c106-c41a-47bc-80c1-33370700f504-00014', 'volume_87113756-5260-460f-864c-3fb466e6be45/20260703094634/az_nova_backup_64e0c106-c41a-47bc-80c1-33370700f504-00015', 'volume_87113756-5260-460f-864c-3fb466e6be45/20260703094634/az_nova_backup_64e0c106-c41a-47bc-80c1-33370700f504-00016', 'volume_87113756-5260-460f-864c-3fb466e6be45/20260703094634/az_nova_backup_64e0c106-c41a-47bc-80c1-33370700f504-00017', 'volume_87113756-5260-460f-864c-3fb466e6be45/20260703094634/az_nova_backup_64e0c106-c41a-47bc-80c1-33370700f504-00018', 'volume_87113756-5260-460f-864c-3fb466e6be45/20260703094634/az_nova_backup_64e0c106-c41a-47bc-80c1-33370700f504-00019', 'volume_87113756-5260-460f-864c-3fb466e6be45/20260703094634/az_nova_backup_64e0c106-c41a-47bc-80c1-33370700f504-00020', 'volume_87113756-5260-460f-864c-3fb466e6be45/20260703094634/az_nova_backup_64e0c106-c41a-47bc-80c1-33370700f504-00021', 'volume_87113756-5260-460f-864c-3fb466e6be45/20260703094634/az_nova_backup_64e0c106-c41a-47bc-80c1-33370700f504_metadata', 'volume_87113756-5260-460f-864c-3fb466e6be45/20260703094634/az_nova_backup_64e0c106-c41a-47bc-80c1-33370700f504_sha256file']. {{(pid=101319) _generate_object_names /opt/stack/cinder/cinder/backup/chunkeddriver.py:260}} Jul 03 09:47:05.557200 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-f972a33b-2d21-44f1-a6cb-9a451bff23ef tempest-ProjectAdminTests33-1900627284 None] deleted object: volume_87113756-5260-460f-864c-3fb466e6be45/20260703094634/az_nova_backup_64e0c106-c41a-47bc-80c1-33370700f504-00001 in container: volumebackups. {{(pid=101319) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 09:47:05.579807 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-f972a33b-2d21-44f1-a6cb-9a451bff23ef tempest-ProjectAdminTests33-1900627284 None] deleted object: volume_87113756-5260-460f-864c-3fb466e6be45/20260703094634/az_nova_backup_64e0c106-c41a-47bc-80c1-33370700f504-00002 in container: volumebackups. {{(pid=101319) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 09:47:05.600736 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-f972a33b-2d21-44f1-a6cb-9a451bff23ef tempest-ProjectAdminTests33-1900627284 None] deleted object: volume_87113756-5260-460f-864c-3fb466e6be45/20260703094634/az_nova_backup_64e0c106-c41a-47bc-80c1-33370700f504-00003 in container: volumebackups. {{(pid=101319) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 09:47:05.630104 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-f972a33b-2d21-44f1-a6cb-9a451bff23ef tempest-ProjectAdminTests33-1900627284 None] deleted object: volume_87113756-5260-460f-864c-3fb466e6be45/20260703094634/az_nova_backup_64e0c106-c41a-47bc-80c1-33370700f504-00004 in container: volumebackups. {{(pid=101319) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 09:47:05.647320 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-f972a33b-2d21-44f1-a6cb-9a451bff23ef tempest-ProjectAdminTests33-1900627284 None] deleted object: volume_87113756-5260-460f-864c-3fb466e6be45/20260703094634/az_nova_backup_64e0c106-c41a-47bc-80c1-33370700f504-00005 in container: volumebackups. {{(pid=101319) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 09:47:05.670781 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-f972a33b-2d21-44f1-a6cb-9a451bff23ef tempest-ProjectAdminTests33-1900627284 None] deleted object: volume_87113756-5260-460f-864c-3fb466e6be45/20260703094634/az_nova_backup_64e0c106-c41a-47bc-80c1-33370700f504-00006 in container: volumebackups. {{(pid=101319) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 09:47:05.692002 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-f972a33b-2d21-44f1-a6cb-9a451bff23ef tempest-ProjectAdminTests33-1900627284 None] deleted object: volume_87113756-5260-460f-864c-3fb466e6be45/20260703094634/az_nova_backup_64e0c106-c41a-47bc-80c1-33370700f504-00007 in container: volumebackups. {{(pid=101319) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 09:47:05.711793 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-f972a33b-2d21-44f1-a6cb-9a451bff23ef tempest-ProjectAdminTests33-1900627284 None] deleted object: volume_87113756-5260-460f-864c-3fb466e6be45/20260703094634/az_nova_backup_64e0c106-c41a-47bc-80c1-33370700f504-00008 in container: volumebackups. {{(pid=101319) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 09:47:05.730497 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-f972a33b-2d21-44f1-a6cb-9a451bff23ef tempest-ProjectAdminTests33-1900627284 None] deleted object: volume_87113756-5260-460f-864c-3fb466e6be45/20260703094634/az_nova_backup_64e0c106-c41a-47bc-80c1-33370700f504-00009 in container: volumebackups. {{(pid=101319) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 09:47:05.745640 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-f972a33b-2d21-44f1-a6cb-9a451bff23ef tempest-ProjectAdminTests33-1900627284 None] deleted object: volume_87113756-5260-460f-864c-3fb466e6be45/20260703094634/az_nova_backup_64e0c106-c41a-47bc-80c1-33370700f504-00010 in container: volumebackups. {{(pid=101319) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 09:47:05.764966 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-f972a33b-2d21-44f1-a6cb-9a451bff23ef tempest-ProjectAdminTests33-1900627284 None] deleted object: volume_87113756-5260-460f-864c-3fb466e6be45/20260703094634/az_nova_backup_64e0c106-c41a-47bc-80c1-33370700f504-00011 in container: volumebackups. {{(pid=101319) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 09:47:05.780585 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-f972a33b-2d21-44f1-a6cb-9a451bff23ef tempest-ProjectAdminTests33-1900627284 None] deleted object: volume_87113756-5260-460f-864c-3fb466e6be45/20260703094634/az_nova_backup_64e0c106-c41a-47bc-80c1-33370700f504-00012 in container: volumebackups. {{(pid=101319) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 09:47:05.797340 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-f972a33b-2d21-44f1-a6cb-9a451bff23ef tempest-ProjectAdminTests33-1900627284 None] deleted object: volume_87113756-5260-460f-864c-3fb466e6be45/20260703094634/az_nova_backup_64e0c106-c41a-47bc-80c1-33370700f504-00013 in container: volumebackups. {{(pid=101319) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 09:47:05.812501 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-f972a33b-2d21-44f1-a6cb-9a451bff23ef tempest-ProjectAdminTests33-1900627284 None] deleted object: volume_87113756-5260-460f-864c-3fb466e6be45/20260703094634/az_nova_backup_64e0c106-c41a-47bc-80c1-33370700f504-00014 in container: volumebackups. {{(pid=101319) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 09:47:05.830210 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-f972a33b-2d21-44f1-a6cb-9a451bff23ef tempest-ProjectAdminTests33-1900627284 None] deleted object: volume_87113756-5260-460f-864c-3fb466e6be45/20260703094634/az_nova_backup_64e0c106-c41a-47bc-80c1-33370700f504-00015 in container: volumebackups. {{(pid=101319) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 09:47:05.849688 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-f972a33b-2d21-44f1-a6cb-9a451bff23ef tempest-ProjectAdminTests33-1900627284 None] deleted object: volume_87113756-5260-460f-864c-3fb466e6be45/20260703094634/az_nova_backup_64e0c106-c41a-47bc-80c1-33370700f504-00016 in container: volumebackups. {{(pid=101319) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 09:47:05.866732 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-f972a33b-2d21-44f1-a6cb-9a451bff23ef tempest-ProjectAdminTests33-1900627284 None] deleted object: volume_87113756-5260-460f-864c-3fb466e6be45/20260703094634/az_nova_backup_64e0c106-c41a-47bc-80c1-33370700f504-00017 in container: volumebackups. {{(pid=101319) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 09:47:05.883956 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-f972a33b-2d21-44f1-a6cb-9a451bff23ef tempest-ProjectAdminTests33-1900627284 None] deleted object: volume_87113756-5260-460f-864c-3fb466e6be45/20260703094634/az_nova_backup_64e0c106-c41a-47bc-80c1-33370700f504-00018 in container: volumebackups. {{(pid=101319) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 09:47:05.911754 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-f972a33b-2d21-44f1-a6cb-9a451bff23ef tempest-ProjectAdminTests33-1900627284 None] deleted object: volume_87113756-5260-460f-864c-3fb466e6be45/20260703094634/az_nova_backup_64e0c106-c41a-47bc-80c1-33370700f504-00019 in container: volumebackups. {{(pid=101319) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 09:47:05.940218 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-f972a33b-2d21-44f1-a6cb-9a451bff23ef tempest-ProjectAdminTests33-1900627284 None] deleted object: volume_87113756-5260-460f-864c-3fb466e6be45/20260703094634/az_nova_backup_64e0c106-c41a-47bc-80c1-33370700f504-00020 in container: volumebackups. {{(pid=101319) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 09:47:05.969648 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-f972a33b-2d21-44f1-a6cb-9a451bff23ef tempest-ProjectAdminTests33-1900627284 None] deleted object: volume_87113756-5260-460f-864c-3fb466e6be45/20260703094634/az_nova_backup_64e0c106-c41a-47bc-80c1-33370700f504-00021 in container: volumebackups. {{(pid=101319) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 09:47:06.021016 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-f972a33b-2d21-44f1-a6cb-9a451bff23ef tempest-ProjectAdminTests33-1900627284 None] deleted object: volume_87113756-5260-460f-864c-3fb466e6be45/20260703094634/az_nova_backup_64e0c106-c41a-47bc-80c1-33370700f504_metadata in container: volumebackups. {{(pid=101319) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 09:47:06.053441 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-f972a33b-2d21-44f1-a6cb-9a451bff23ef tempest-ProjectAdminTests33-1900627284 None] deleted object: volume_87113756-5260-460f-864c-3fb466e6be45/20260703094634/az_nova_backup_64e0c106-c41a-47bc-80c1-33370700f504_sha256file in container: volumebackups. {{(pid=101319) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 09:47:06.053634 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-f972a33b-2d21-44f1-a6cb-9a451bff23ef tempest-ProjectAdminTests33-1900627284 None] delete 64e0c106-c41a-47bc-80c1-33370700f504 finished. {{(pid=101319) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:848}} Jul 03 09:47:06.083898 np0000004400 cinder-backup[101319]: DEBUG oslo_db.sqlalchemy.engines [None req-f972a33b-2d21-44f1-a6cb-9a451bff23ef tempest-ProjectAdminTests33-1900627284 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=101319) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 03 09:47:06.175087 np0000004400 cinder-backup[101319]: DEBUG cinder.quota [None req-f972a33b-2d21-44f1-a6cb-9a451bff23ef tempest-ProjectAdminTests33-1900627284 None] Created reservations ['ed9ff251-eb43-4157-9dfa-3ee58ad3f0a6', '909fe870-a4f7-4ec6-8e2b-54d9539a2ceb'] {{(pid=101319) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 09:47:06.237793 np0000004400 cinder-backup[101319]: INFO cinder.backup.manager [None req-f972a33b-2d21-44f1-a6cb-9a451bff23ef tempest-ProjectAdminTests33-1900627284 None] Delete backup finished, backup 64e0c106-c41a-47bc-80c1-33370700f504 deleted. Jul 03 09:47:06.542031 np0000004400 cinder-backup[101319]: INFO cinder.backup.manager [None req-95012dff-9b88-4709-be26-0c56af3e79b7 tempest-ProjectAdminTests33-1900627284 None] Delete backup started, backup: 3e013368-c720-4dd1-96fd-358ab8abaea3. Jul 03 09:47:06.544932 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.drivers.swift [None req-95012dff-9b88-4709-be26-0c56af3e79b7 tempest-ProjectAdminTests33-1900627284 None] Using swift URL https://10.4.3.95:8080/v1/AUTH_a2309d0555a742279b4a5017d94ebf02 {{(pid=101319) initialize /opt/stack/cinder/cinder/backup/drivers/swift.py:300}} Jul 03 09:47:06.545067 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.drivers.swift [None req-95012dff-9b88-4709-be26-0c56af3e79b7 tempest-ProjectAdminTests33-1900627284 None] Connect to https://10.4.3.95:8080/v1/AUTH_ in "per_user" mode {{(pid=101319) initialize /opt/stack/cinder/cinder/backup/drivers/swift.py:301}} Jul 03 09:47:06.545201 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-95012dff-9b88-4709-be26-0c56af3e79b7 tempest-ProjectAdminTests33-1900627284 None] delete started, backup: 3e013368-c720-4dd1-96fd-358ab8abaea3, container: volumebackups, prefix: volume_bcfdc9b0-68fe-4358-ac7c-7d6e27267fe9/20260703094611/az_nova_backup_3e013368-c720-4dd1-96fd-358ab8abaea3. {{(pid=101319) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:822}} Jul 03 09:47:06.576988 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-95012dff-9b88-4709-be26-0c56af3e79b7 tempest-ProjectAdminTests33-1900627284 None] generated object list: []. {{(pid=101319) _generate_object_names /opt/stack/cinder/cinder/backup/chunkeddriver.py:260}} Jul 03 09:47:06.577121 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-95012dff-9b88-4709-be26-0c56af3e79b7 tempest-ProjectAdminTests33-1900627284 None] delete 3e013368-c720-4dd1-96fd-358ab8abaea3 finished. {{(pid=101319) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:848}} Jul 03 09:47:06.610891 np0000004400 cinder-backup[101319]: DEBUG oslo_db.sqlalchemy.engines [None req-95012dff-9b88-4709-be26-0c56af3e79b7 tempest-ProjectAdminTests33-1900627284 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=101319) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 03 09:47:06.626762 np0000004400 cinder-backup[101319]: DEBUG cinder.quota [None req-95012dff-9b88-4709-be26-0c56af3e79b7 tempest-ProjectAdminTests33-1900627284 None] Created reservations ['1087dfd3-278d-4a87-a600-fb2739477489', 'c50ae389-b5db-43cd-a8ba-2d92d9e562d0'] {{(pid=101319) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 09:47:06.656253 np0000004400 cinder-backup[101319]: INFO cinder.backup.manager [None req-95012dff-9b88-4709-be26-0c56af3e79b7 tempest-ProjectAdminTests33-1900627284 None] Delete backup finished, backup 3e013368-c720-4dd1-96fd-358ab8abaea3 deleted. Jul 03 09:47:06.915593 np0000004400 cinder-backup[101319]: INFO cinder.backup.manager [None req-c0b6bb1f-d91f-43e7-be98-b7740c01c433 tempest-VolumesBackupsTest-118275719 None] Create backup started, backup: eba702ee-9959-40fe-9093-1eecff8dbaa6 volume: 72e07e1e-1567-4071-8204-c29cb26d2660. Jul 03 09:47:06.931042 np0000004400 cinder-backup[101319]: INFO cinder.backup.manager [None req-c0b6bb1f-d91f-43e7-be98-b7740c01c433 tempest-VolumesBackupsTest-118275719 None] Call Volume Manager to get_backup_device for Backup(availability_zone='nova',container=None,created_at=2026-07-03T09:47:06Z,data_timestamp=2026-07-03T09:47:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesBackupsTest-Backup-984442641',encryption_key_id=None,fail_reason=None,host='np0000004400',id=eba702ee-9959-40fe-9093-1eecff8dbaa6,metadata={},num_dependent_backups=0,object_count=0,parent=Backup(8b377d15-3804-4a9c-ad2d-e8e1359c0ee5),parent_id='8b377d15-3804-4a9c-ad2d-e8e1359c0ee5',project_id='a484ec9218bf417bb9d7575ae6370646',restore_volume_id=None,service='cinder.backup.drivers.swift.SwiftBackupDriver',service_metadata=None,size=1,snapshot_id=None,status='creating',temp_snapshot_id=None,temp_volume_id=None,updated_at=None,user_id='b861df2a13684334b293b1f348152e37',volume_id=72e07e1e-1567-4071-8204-c29cb26d2660) Jul 03 09:47:06.957999 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.drivers.swift [None req-c0b6bb1f-d91f-43e7-be98-b7740c01c433 tempest-VolumesBackupsTest-118275719 None] Using swift URL https://10.4.3.95:8080/v1/AUTH_a484ec9218bf417bb9d7575ae6370646 {{(pid=101319) initialize /opt/stack/cinder/cinder/backup/drivers/swift.py:300}} Jul 03 09:47:06.958590 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.drivers.swift [None req-c0b6bb1f-d91f-43e7-be98-b7740c01c433 tempest-VolumesBackupsTest-118275719 None] Connect to https://10.4.3.95:8080/v1/AUTH_ in "per_user" mode {{(pid=101319) initialize /opt/stack/cinder/cinder/backup/drivers/swift.py:301}} Jul 03 09:47:06.958782 np0000004400 cinder-backup[101319]: DEBUG os_brick.utils [None req-c0b6bb1f-d91f-43e7-be98-b7740c01c433 tempest-VolumesBackupsTest-118275719 None] ==> get_connector_properties: call "{'root_helper': 'sudo cinder-rootwrap /etc/cinder/rootwrap.conf', 'my_ip': '10.4.3.95', 'multipath': False, 'enforce_multipath': False, 'host': None, 'execute': None}" {{(pid=101319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}} Jul 03 09:47:06.968888 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.scaleio [None req-c0b6bb1f-d91f-43e7-be98-b7740c01c433 tempest-VolumesBackupsTest-118275719 None] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=101319) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}} Jul 03 09:47:06.988772 np0000004400 cinder-backup[101319]: DEBUG oslo_concurrency.processutils [None req-c0b6bb1f-d91f-43e7-be98-b7740c01c433 tempest-VolumesBackupsTest-118275719 None] Running cmd (subprocess): nvme version {{(pid=101319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 09:47:07.000772 np0000004400 cinder-backup[101319]: DEBUG oslo_concurrency.processutils [None req-c0b6bb1f-d91f-43e7-be98-b7740c01c433 tempest-VolumesBackupsTest-118275719 None] 'nvme version' failed. Not Retrying. {{(pid=101319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 03 09:47:07.001074 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.nvmeof [None req-c0b6bb1f-d91f-43e7-be98-b7740c01c433 tempest-VolumesBackupsTest-118275719 None] nvme not present on system {{(pid=101319) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}} Jul 03 09:47:07.009620 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.lightos [None req-c0b6bb1f-d91f-43e7-be98-b7740c01c433 tempest-VolumesBackupsTest-118275719 None] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=101319) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}} Jul 03 09:47:07.010618 np0000004400 cinder-backup[101319]: INFO os_brick.initiator.connectors.lightos [None req-c0b6bb1f-d91f-43e7-be98-b7740c01c433 tempest-VolumesBackupsTest-118275719 None] Current host hostNQN and IP(s) are ['10.4.3.95', 'fe80::f816:3eff:fe47:268c', '192.168.40.6', 'fe80::f816:3eff:febf:7be2', '192.168.50.6', 'fe80::f816:3eff:fe99:8914', '192.168.10.6', 'fe80::f816:3eff:fe2f:e696', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::bc9d:84ff:fec2:6b49', 'fe80::fc16:3eff:fea0:4147', 'fe80::b0cf:48ff:fe29:caf0', 'fe80::fc16:3eff:fe97:90a6', 'fe80::8435:18ff:feb9:798c', 'fe80::fc16:3eff:feda:9a9f', 'fe80::28c1:27ff:fe3c:5528'] Jul 03 09:47:07.010767 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.lightos [None req-c0b6bb1f-d91f-43e7-be98-b7740c01c433 tempest-VolumesBackupsTest-118275719 None] LIGHTOS: did not find dsc, continuing anyway. {{(pid=101319) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}} Jul 03 09:47:07.010889 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.lightos [None req-c0b6bb1f-d91f-43e7-be98-b7740c01c433 tempest-VolumesBackupsTest-118275719 None] LIGHTOS: no hostnqn found. {{(pid=101319) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}} Jul 03 09:47:07.011126 np0000004400 cinder-backup[101319]: DEBUG os_brick.utils [None req-c0b6bb1f-d91f-43e7-be98-b7740c01c433 tempest-VolumesBackupsTest-118275719 None] <== get_connector_properties: return (52ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.95', 'host': 'np0000004400', 'multipath': False, 'enforce_multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:ae7e5bb0ebe6', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': '6b284368-d0ba-4d18-af6f-4998d3955c52', 'nvme_native_multipath': False} {{(pid=101319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}} Jul 03 09:47:07.515434 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connector [None req-c0b6bb1f-d91f-43e7-be98-b7740c01c433 tempest-VolumesBackupsTest-118275719 None] Factory for iscsi on None {{(pid=101319) factory /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connector.py:243}} Jul 03 09:47:07.515740 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-c0b6bb1f-d91f-43e7-be98-b7740c01c433 tempest-VolumesBackupsTest-118275719 None] ==> connect_volume: call "{'self': , 'connection_properties': {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-72e07e1e-1567-4071-8204-c29cb26d2660', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '72e07e1e-1567-4071-8204-c29cb26d2660', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': False}}" {{(pid=101319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}} Jul 03 09:47:07.515912 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.base [None req-c0b6bb1f-d91f-43e7-be98-b7740c01c433 tempest-VolumesBackupsTest-118275719 None] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=101319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jul 03 09:47:07.516366 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.base [None req-c0b6bb1f-d91f-43e7-be98-b7740c01c433 tempest-VolumesBackupsTest-118275719 None] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.000s {{(pid=101319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jul 03 09:47:07.516627 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.base [None req-c0b6bb1f-d91f-43e7-be98-b7740c01c433 tempest-VolumesBackupsTest-118275719 None] Connection properties {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-72e07e1e-1567-4071-8204-c29cb26d2660', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '72e07e1e-1567-4071-8204-c29cb26d2660', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': False} {{(pid=101319) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}} Jul 03 09:47:07.527189 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.base [None req-c0b6bb1f-d91f-43e7-be98-b7740c01c433 tempest-VolumesBackupsTest-118275719 None] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-72e07e1e-1567-4071-8204-c29cb26d2660" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=101319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jul 03 09:47:07.527525 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.base [None req-c0b6bb1f-d91f-43e7-be98-b7740c01c433 tempest-VolumesBackupsTest-118275719 None] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-72e07e1e-1567-4071-8204-c29cb26d2660" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.000s {{(pid=101319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jul 03 09:47:07.527723 np0000004400 cinder-backup[101319]: INFO os_brick.initiator.connectors.iscsi [None req-c0b6bb1f-d91f-43e7-be98-b7740c01c433 tempest-VolumesBackupsTest-118275719 None] Trying to connect to iSCSI portal 192.168.40.100:3260 Jul 03 09:47:07.537633 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-c0b6bb1f-d91f-43e7-be98-b7740c01c433 tempest-VolumesBackupsTest-118275719 None] iscsiadm (): stdout= stderr=iscsiadm: No records found Jul 03 09:47:07.537633 np0000004400 cinder-backup[101319]: {{(pid=101319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 03 09:47:07.547679 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-c0b6bb1f-d91f-43e7-be98-b7740c01c433 tempest-VolumesBackupsTest-118275719 None] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-72e07e1e-1567-4071-8204-c29cb26d2660] added Jul 03 09:47:07.547679 np0000004400 cinder-backup[101319]: stderr=iscsiadm: Config file line 363 does not have value Jul 03 09:47:07.547679 np0000004400 cinder-backup[101319]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs' Jul 03 09:47:07.547679 np0000004400 cinder-backup[101319]: iscsiadm: Config file line 363 does not have value Jul 03 09:47:07.547679 np0000004400 cinder-backup[101319]: iscsiadm: Config file line 363 does not have value Jul 03 09:47:07.547679 np0000004400 cinder-backup[101319]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs' Jul 03 09:47:07.547679 np0000004400 cinder-backup[101319]: {{(pid=101319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 03 09:47:07.548156 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-c0b6bb1f-d91f-43e7-be98-b7740c01c433 tempest-VolumesBackupsTest-118275719 None] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=101319) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}} Jul 03 09:47:07.548219 np0000004400 cinder-backup[101319]: DEBUG os_brick.utils [None req-c0b6bb1f-d91f-43e7-be98-b7740c01c433 tempest-VolumesBackupsTest-118275719 None] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0204(s), this was the 1st time calling it. {{(pid=101319) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}} Jul 03 09:47:07.548447 np0000004400 cinder-backup[101319]: DEBUG os_brick.utils [None req-c0b6bb1f-d91f-43e7-be98-b7740c01c433 tempest-VolumesBackupsTest-118275719 None] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=101319) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}} Jul 03 09:47:07.597974 np0000004400 cinder-backup[101319]: INFO cinder.backup.manager [None req-05659a23-952d-4d34-9761-3e7e884b05f2 tempest-ProjectAdminTests33-1900627284 None] Delete backup started, backup: cfdc4925-e984-4da2-aa3e-e1e8a7c37558. Jul 03 09:47:07.598984 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.drivers.swift [None req-05659a23-952d-4d34-9761-3e7e884b05f2 tempest-ProjectAdminTests33-1900627284 None] Using swift URL https://10.4.3.95:8080/v1/AUTH_a2309d0555a742279b4a5017d94ebf02 {{(pid=101319) initialize /opt/stack/cinder/cinder/backup/drivers/swift.py:300}} Jul 03 09:47:07.599122 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.drivers.swift [None req-05659a23-952d-4d34-9761-3e7e884b05f2 tempest-ProjectAdminTests33-1900627284 None] Connect to https://10.4.3.95:8080/v1/AUTH_ in "per_user" mode {{(pid=101319) initialize /opt/stack/cinder/cinder/backup/drivers/swift.py:301}} Jul 03 09:47:07.599279 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-05659a23-952d-4d34-9761-3e7e884b05f2 tempest-ProjectAdminTests33-1900627284 None] delete started, backup: cfdc4925-e984-4da2-aa3e-e1e8a7c37558, container: volumebackups, prefix: volume_4b68dad5-e9a3-4bd1-84e2-ba745cb7bb83/20260703094505/az_nova_backup_cfdc4925-e984-4da2-aa3e-e1e8a7c37558. {{(pid=101319) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:822}} Jul 03 09:47:07.630741 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-05659a23-952d-4d34-9761-3e7e884b05f2 tempest-ProjectAdminTests33-1900627284 None] generated object list: ['volume_4b68dad5-e9a3-4bd1-84e2-ba745cb7bb83/20260703094505/az_nova_backup_cfdc4925-e984-4da2-aa3e-e1e8a7c37558-00001', 'volume_4b68dad5-e9a3-4bd1-84e2-ba745cb7bb83/20260703094505/az_nova_backup_cfdc4925-e984-4da2-aa3e-e1e8a7c37558-00002', 'volume_4b68dad5-e9a3-4bd1-84e2-ba745cb7bb83/20260703094505/az_nova_backup_cfdc4925-e984-4da2-aa3e-e1e8a7c37558-00003', 'volume_4b68dad5-e9a3-4bd1-84e2-ba745cb7bb83/20260703094505/az_nova_backup_cfdc4925-e984-4da2-aa3e-e1e8a7c37558-00004', 'volume_4b68dad5-e9a3-4bd1-84e2-ba745cb7bb83/20260703094505/az_nova_backup_cfdc4925-e984-4da2-aa3e-e1e8a7c37558-00005', 'volume_4b68dad5-e9a3-4bd1-84e2-ba745cb7bb83/20260703094505/az_nova_backup_cfdc4925-e984-4da2-aa3e-e1e8a7c37558-00006', 'volume_4b68dad5-e9a3-4bd1-84e2-ba745cb7bb83/20260703094505/az_nova_backup_cfdc4925-e984-4da2-aa3e-e1e8a7c37558-00007', 'volume_4b68dad5-e9a3-4bd1-84e2-ba745cb7bb83/20260703094505/az_nova_backup_cfdc4925-e984-4da2-aa3e-e1e8a7c37558-00008', 'volume_4b68dad5-e9a3-4bd1-84e2-ba745cb7bb83/20260703094505/az_nova_backup_cfdc4925-e984-4da2-aa3e-e1e8a7c37558-00009', 'volume_4b68dad5-e9a3-4bd1-84e2-ba745cb7bb83/20260703094505/az_nova_backup_cfdc4925-e984-4da2-aa3e-e1e8a7c37558-00010', 'volume_4b68dad5-e9a3-4bd1-84e2-ba745cb7bb83/20260703094505/az_nova_backup_cfdc4925-e984-4da2-aa3e-e1e8a7c37558-00011', 'volume_4b68dad5-e9a3-4bd1-84e2-ba745cb7bb83/20260703094505/az_nova_backup_cfdc4925-e984-4da2-aa3e-e1e8a7c37558-00012', 'volume_4b68dad5-e9a3-4bd1-84e2-ba745cb7bb83/20260703094505/az_nova_backup_cfdc4925-e984-4da2-aa3e-e1e8a7c37558-00013', 'volume_4b68dad5-e9a3-4bd1-84e2-ba745cb7bb83/20260703094505/az_nova_backup_cfdc4925-e984-4da2-aa3e-e1e8a7c37558-00014', 'volume_4b68dad5-e9a3-4bd1-84e2-ba745cb7bb83/20260703094505/az_nova_backup_cfdc4925-e984-4da2-aa3e-e1e8a7c37558-00015', 'volume_4b68dad5-e9a3-4bd1-84e2-ba745cb7bb83/20260703094505/az_nova_backup_cfdc4925-e984-4da2-aa3e-e1e8a7c37558-00016', 'volume_4b68dad5-e9a3-4bd1-84e2-ba745cb7bb83/20260703094505/az_nova_backup_cfdc4925-e984-4da2-aa3e-e1e8a7c37558-00017', 'volume_4b68dad5-e9a3-4bd1-84e2-ba745cb7bb83/20260703094505/az_nova_backup_cfdc4925-e984-4da2-aa3e-e1e8a7c37558-00018', 'volume_4b68dad5-e9a3-4bd1-84e2-ba745cb7bb83/20260703094505/az_nova_backup_cfdc4925-e984-4da2-aa3e-e1e8a7c37558-00019', 'volume_4b68dad5-e9a3-4bd1-84e2-ba745cb7bb83/20260703094505/az_nova_backup_cfdc4925-e984-4da2-aa3e-e1e8a7c37558-00020', 'volume_4b68dad5-e9a3-4bd1-84e2-ba745cb7bb83/20260703094505/az_nova_backup_cfdc4925-e984-4da2-aa3e-e1e8a7c37558-00021', 'volume_4b68dad5-e9a3-4bd1-84e2-ba745cb7bb83/20260703094505/az_nova_backup_cfdc4925-e984-4da2-aa3e-e1e8a7c37558_metadata', 'volume_4b68dad5-e9a3-4bd1-84e2-ba745cb7bb83/20260703094505/az_nova_backup_cfdc4925-e984-4da2-aa3e-e1e8a7c37558_sha256file']. {{(pid=101319) _generate_object_names /opt/stack/cinder/cinder/backup/chunkeddriver.py:260}} Jul 03 09:47:07.647819 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-05659a23-952d-4d34-9761-3e7e884b05f2 tempest-ProjectAdminTests33-1900627284 None] deleted object: volume_4b68dad5-e9a3-4bd1-84e2-ba745cb7bb83/20260703094505/az_nova_backup_cfdc4925-e984-4da2-aa3e-e1e8a7c37558-00001 in container: volumebackups. {{(pid=101319) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 09:47:07.664509 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-05659a23-952d-4d34-9761-3e7e884b05f2 tempest-ProjectAdminTests33-1900627284 None] deleted object: volume_4b68dad5-e9a3-4bd1-84e2-ba745cb7bb83/20260703094505/az_nova_backup_cfdc4925-e984-4da2-aa3e-e1e8a7c37558-00002 in container: volumebackups. {{(pid=101319) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 09:47:07.680771 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-05659a23-952d-4d34-9761-3e7e884b05f2 tempest-ProjectAdminTests33-1900627284 None] deleted object: volume_4b68dad5-e9a3-4bd1-84e2-ba745cb7bb83/20260703094505/az_nova_backup_cfdc4925-e984-4da2-aa3e-e1e8a7c37558-00003 in container: volumebackups. {{(pid=101319) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 09:47:07.699235 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-05659a23-952d-4d34-9761-3e7e884b05f2 tempest-ProjectAdminTests33-1900627284 None] deleted object: volume_4b68dad5-e9a3-4bd1-84e2-ba745cb7bb83/20260703094505/az_nova_backup_cfdc4925-e984-4da2-aa3e-e1e8a7c37558-00004 in container: volumebackups. {{(pid=101319) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 09:47:07.716826 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-05659a23-952d-4d34-9761-3e7e884b05f2 tempest-ProjectAdminTests33-1900627284 None] deleted object: volume_4b68dad5-e9a3-4bd1-84e2-ba745cb7bb83/20260703094505/az_nova_backup_cfdc4925-e984-4da2-aa3e-e1e8a7c37558-00005 in container: volumebackups. {{(pid=101319) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 09:47:07.738681 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-05659a23-952d-4d34-9761-3e7e884b05f2 tempest-ProjectAdminTests33-1900627284 None] deleted object: volume_4b68dad5-e9a3-4bd1-84e2-ba745cb7bb83/20260703094505/az_nova_backup_cfdc4925-e984-4da2-aa3e-e1e8a7c37558-00006 in container: volumebackups. {{(pid=101319) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 09:47:07.762195 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-05659a23-952d-4d34-9761-3e7e884b05f2 tempest-ProjectAdminTests33-1900627284 None] deleted object: volume_4b68dad5-e9a3-4bd1-84e2-ba745cb7bb83/20260703094505/az_nova_backup_cfdc4925-e984-4da2-aa3e-e1e8a7c37558-00007 in container: volumebackups. {{(pid=101319) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 09:47:07.782091 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-05659a23-952d-4d34-9761-3e7e884b05f2 tempest-ProjectAdminTests33-1900627284 None] deleted object: volume_4b68dad5-e9a3-4bd1-84e2-ba745cb7bb83/20260703094505/az_nova_backup_cfdc4925-e984-4da2-aa3e-e1e8a7c37558-00008 in container: volumebackups. {{(pid=101319) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 09:47:07.802968 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-05659a23-952d-4d34-9761-3e7e884b05f2 tempest-ProjectAdminTests33-1900627284 None] deleted object: volume_4b68dad5-e9a3-4bd1-84e2-ba745cb7bb83/20260703094505/az_nova_backup_cfdc4925-e984-4da2-aa3e-e1e8a7c37558-00009 in container: volumebackups. {{(pid=101319) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 09:47:07.825648 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-05659a23-952d-4d34-9761-3e7e884b05f2 tempest-ProjectAdminTests33-1900627284 None] deleted object: volume_4b68dad5-e9a3-4bd1-84e2-ba745cb7bb83/20260703094505/az_nova_backup_cfdc4925-e984-4da2-aa3e-e1e8a7c37558-00010 in container: volumebackups. {{(pid=101319) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 09:47:07.852555 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-05659a23-952d-4d34-9761-3e7e884b05f2 tempest-ProjectAdminTests33-1900627284 None] deleted object: volume_4b68dad5-e9a3-4bd1-84e2-ba745cb7bb83/20260703094505/az_nova_backup_cfdc4925-e984-4da2-aa3e-e1e8a7c37558-00011 in container: volumebackups. {{(pid=101319) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 09:47:07.876701 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-05659a23-952d-4d34-9761-3e7e884b05f2 tempest-ProjectAdminTests33-1900627284 None] deleted object: volume_4b68dad5-e9a3-4bd1-84e2-ba745cb7bb83/20260703094505/az_nova_backup_cfdc4925-e984-4da2-aa3e-e1e8a7c37558-00012 in container: volumebackups. {{(pid=101319) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 09:47:07.901599 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-05659a23-952d-4d34-9761-3e7e884b05f2 tempest-ProjectAdminTests33-1900627284 None] deleted object: volume_4b68dad5-e9a3-4bd1-84e2-ba745cb7bb83/20260703094505/az_nova_backup_cfdc4925-e984-4da2-aa3e-e1e8a7c37558-00013 in container: volumebackups. {{(pid=101319) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 09:47:07.930566 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-05659a23-952d-4d34-9761-3e7e884b05f2 tempest-ProjectAdminTests33-1900627284 None] deleted object: volume_4b68dad5-e9a3-4bd1-84e2-ba745cb7bb83/20260703094505/az_nova_backup_cfdc4925-e984-4da2-aa3e-e1e8a7c37558-00014 in container: volumebackups. {{(pid=101319) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 09:47:07.957881 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-05659a23-952d-4d34-9761-3e7e884b05f2 tempest-ProjectAdminTests33-1900627284 None] deleted object: volume_4b68dad5-e9a3-4bd1-84e2-ba745cb7bb83/20260703094505/az_nova_backup_cfdc4925-e984-4da2-aa3e-e1e8a7c37558-00015 in container: volumebackups. {{(pid=101319) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 09:47:07.976054 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-05659a23-952d-4d34-9761-3e7e884b05f2 tempest-ProjectAdminTests33-1900627284 None] deleted object: volume_4b68dad5-e9a3-4bd1-84e2-ba745cb7bb83/20260703094505/az_nova_backup_cfdc4925-e984-4da2-aa3e-e1e8a7c37558-00016 in container: volumebackups. {{(pid=101319) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 09:47:07.997714 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-05659a23-952d-4d34-9761-3e7e884b05f2 tempest-ProjectAdminTests33-1900627284 None] deleted object: volume_4b68dad5-e9a3-4bd1-84e2-ba745cb7bb83/20260703094505/az_nova_backup_cfdc4925-e984-4da2-aa3e-e1e8a7c37558-00017 in container: volumebackups. {{(pid=101319) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 09:47:08.025085 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-05659a23-952d-4d34-9761-3e7e884b05f2 tempest-ProjectAdminTests33-1900627284 None] deleted object: volume_4b68dad5-e9a3-4bd1-84e2-ba745cb7bb83/20260703094505/az_nova_backup_cfdc4925-e984-4da2-aa3e-e1e8a7c37558-00018 in container: volumebackups. {{(pid=101319) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 09:47:08.045258 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-05659a23-952d-4d34-9761-3e7e884b05f2 tempest-ProjectAdminTests33-1900627284 None] deleted object: volume_4b68dad5-e9a3-4bd1-84e2-ba745cb7bb83/20260703094505/az_nova_backup_cfdc4925-e984-4da2-aa3e-e1e8a7c37558-00019 in container: volumebackups. {{(pid=101319) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 09:47:08.070172 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-05659a23-952d-4d34-9761-3e7e884b05f2 tempest-ProjectAdminTests33-1900627284 None] deleted object: volume_4b68dad5-e9a3-4bd1-84e2-ba745cb7bb83/20260703094505/az_nova_backup_cfdc4925-e984-4da2-aa3e-e1e8a7c37558-00020 in container: volumebackups. {{(pid=101319) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 09:47:08.094697 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-05659a23-952d-4d34-9761-3e7e884b05f2 tempest-ProjectAdminTests33-1900627284 None] deleted object: volume_4b68dad5-e9a3-4bd1-84e2-ba745cb7bb83/20260703094505/az_nova_backup_cfdc4925-e984-4da2-aa3e-e1e8a7c37558-00021 in container: volumebackups. {{(pid=101319) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 09:47:08.114824 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-05659a23-952d-4d34-9761-3e7e884b05f2 tempest-ProjectAdminTests33-1900627284 None] deleted object: volume_4b68dad5-e9a3-4bd1-84e2-ba745cb7bb83/20260703094505/az_nova_backup_cfdc4925-e984-4da2-aa3e-e1e8a7c37558_metadata in container: volumebackups. {{(pid=101319) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 09:47:08.132970 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-05659a23-952d-4d34-9761-3e7e884b05f2 tempest-ProjectAdminTests33-1900627284 None] deleted object: volume_4b68dad5-e9a3-4bd1-84e2-ba745cb7bb83/20260703094505/az_nova_backup_cfdc4925-e984-4da2-aa3e-e1e8a7c37558_sha256file in container: volumebackups. {{(pid=101319) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 09:47:08.133167 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-05659a23-952d-4d34-9761-3e7e884b05f2 tempest-ProjectAdminTests33-1900627284 None] delete cfdc4925-e984-4da2-aa3e-e1e8a7c37558 finished. {{(pid=101319) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:848}} Jul 03 09:47:08.168352 np0000004400 cinder-backup[101319]: DEBUG oslo_db.sqlalchemy.engines [None req-05659a23-952d-4d34-9761-3e7e884b05f2 tempest-ProjectAdminTests33-1900627284 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=101319) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 03 09:47:08.184733 np0000004400 cinder-backup[101319]: DEBUG cinder.quota [None req-05659a23-952d-4d34-9761-3e7e884b05f2 tempest-ProjectAdminTests33-1900627284 None] Created reservations ['dad1a3b0-83d8-478b-a76b-7f7ad54f0954', 'dd54afd0-d9b0-46d9-b1de-b71352d7515d'] {{(pid=101319) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 09:47:08.201913 np0000004400 cinder-backup[101319]: INFO cinder.backup.manager [None req-05659a23-952d-4d34-9761-3e7e884b05f2 tempest-ProjectAdminTests33-1900627284 None] Delete backup finished, backup cfdc4925-e984-4da2-aa3e-e1e8a7c37558 deleted. Jul 03 09:47:08.549099 np0000004400 cinder-backup[101319]: INFO os_brick.initiator.connectors.iscsi [None req-c0b6bb1f-d91f-43e7-be98-b7740c01c433 tempest-VolumesBackupsTest-118275719 None] Trying to connect to iSCSI portal 192.168.40.100:3260 Jul 03 09:47:08.559383 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-c0b6bb1f-d91f-43e7-be98-b7740c01c433 tempest-VolumesBackupsTest-118275719 None] iscsiadm (): stdout=# BEGIN RECORD 2.1.9 Jul 03 09:47:08.559383 np0000004400 cinder-backup[101319]: node.name = iqn.2023-03.storpool.com:os--volume-72e07e1e-1567-4071-8204-c29cb26d2660 Jul 03 09:47:08.559383 np0000004400 cinder-backup[101319]: node.tpgt = -1 Jul 03 09:47:08.559383 np0000004400 cinder-backup[101319]: node.startup = manual Jul 03 09:47:08.559383 np0000004400 cinder-backup[101319]: node.leading_login = No Jul 03 09:47:08.559383 np0000004400 cinder-backup[101319]: iface.iscsi_ifacename = default Jul 03 09:47:08.559383 np0000004400 cinder-backup[101319]: iface.net_ifacename = Jul 03 09:47:08.559383 np0000004400 cinder-backup[101319]: iface.ipaddress = Jul 03 09:47:08.559383 np0000004400 cinder-backup[101319]: iface.prefix_len = 0 Jul 03 09:47:08.559383 np0000004400 cinder-backup[101319]: iface.hwaddress = Jul 03 09:47:08.559383 np0000004400 cinder-backup[101319]: iface.transport_name = tcp Jul 03 09:47:08.559383 np0000004400 cinder-backup[101319]: iface.initiatorname = Jul 03 09:47:08.559383 np0000004400 cinder-backup[101319]: iface.state = Jul 03 09:47:08.559383 np0000004400 cinder-backup[101319]: iface.vlan_id = 0 Jul 03 09:47:08.559383 np0000004400 cinder-backup[101319]: iface.vlan_priority = 0 Jul 03 09:47:08.559383 np0000004400 cinder-backup[101319]: iface.vlan_state = Jul 03 09:47:08.559383 np0000004400 cinder-backup[101319]: iface.iface_num = 0 Jul 03 09:47:08.559383 np0000004400 cinder-backup[101319]: iface.mtu = 0 Jul 03 09:47:08.559383 np0000004400 cinder-backup[101319]: iface.port = 0 Jul 03 09:47:08.559383 np0000004400 cinder-backup[101319]: iface.bootproto = Jul 03 09:47:08.559383 np0000004400 cinder-backup[101319]: iface.subnet_mask = Jul 03 09:47:08.559383 np0000004400 cinder-backup[101319]: iface.gateway = Jul 03 09:47:08.559383 np0000004400 cinder-backup[101319]: iface.dhcp_alt_client_id_state = Jul 03 09:47:08.559383 np0000004400 cinder-backup[101319]: iface.dhcp_alt_client_id = Jul 03 09:47:08.559383 np0000004400 cinder-backup[101319]: iface.dhcp_dns = Jul 03 09:47:08.559383 np0000004400 cinder-backup[101319]: iface.dhcp_learn_iqn = Jul 03 09:47:08.559383 np0000004400 cinder-backup[101319]: iface.dhcp_req_vendor_id_state = Jul 03 09:47:08.559383 np0000004400 cinder-backup[101319]: iface.dhcp_vendor_id_state = Jul 03 09:47:08.559383 np0000004400 cinder-backup[101319]: iface.dhcp_vendor_id = Jul 03 09:47:08.559383 np0000004400 cinder-backup[101319]: iface.dhcp_slp_da = Jul 03 09:47:08.559383 np0000004400 cinder-backup[101319]: iface.fragmentation = Jul 03 09:47:08.559383 np0000004400 cinder-backup[101319]: iface.gratuitous_arp = Jul 03 09:47:08.559383 np0000004400 cinder-backup[101319]: iface.incoming_forwarding = Jul 03 09:47:08.559383 np0000004400 cinder-backup[101319]: iface.tos_state = Jul 03 09:47:08.559383 np0000004400 cinder-backup[101319]: iface.tos = 0 Jul 03 09:47:08.559383 np0000004400 cinder-backup[101319]: iface.ttl = 0 Jul 03 09:47:08.559383 np0000004400 cinder-backup[101319]: iface.delayed_ack = Jul 03 09:47:08.559383 np0000004400 cinder-backup[101319]: iface.tcp_nagle = Jul 03 09:47:08.559383 np0000004400 cinder-backup[101319]: iface.tcp_wsf_state = Jul 03 09:47:08.559383 np0000004400 cinder-backup[101319]: iface.tcp_wsf = 0 Jul 03 09:47:08.559383 np0000004400 cinder-backup[101319]: iface.tcp_timer_scale = 0 Jul 03 09:47:08.559383 np0000004400 cinder-backup[101319]: iface.tcp_timestamp = Jul 03 09:47:08.559383 np0000004400 cinder-backup[101319]: iface.redirect = Jul 03 09:47:08.559383 np0000004400 cinder-backup[101319]: iface.def_task_mgmt_timeout = 0 Jul 03 09:47:08.559383 np0000004400 cinder-backup[101319]: iface.header_digest = Jul 03 09:47:08.559383 np0000004400 cinder-backup[101319]: iface.data_digest = Jul 03 09:47:08.559383 np0000004400 cinder-backup[101319]: iface.immediate_data = Jul 03 09:47:08.559383 np0000004400 cinder-backup[101319]: iface.initial_r2t = Jul 03 09:47:08.559383 np0000004400 cinder-backup[101319]: iface.data_seq_inorder = Jul 03 09:47:08.559383 np0000004400 cinder-backup[101319]: iface.data_pdu_inorder = Jul 03 09:47:08.559383 np0000004400 cinder-backup[101319]: iface.erl = 0 Jul 03 09:47:08.559383 np0000004400 cinder-backup[101319]: iface.max_receive_data_len = 0 Jul 03 09:47:08.559383 np0000004400 cinder-backup[101319]: iface.first_burst_len = 0 Jul 03 09:47:08.559383 np0000004400 cinder-backup[101319]: iface.max_outstanding_r2t = 0 Jul 03 09:47:08.559383 np0000004400 cinder-backup[101319]: iface.max_burst_len = 0 Jul 03 09:47:08.559383 np0000004400 cinder-backup[101319]: iface.chap_auth = Jul 03 09:47:08.559383 np0000004400 cinder-backup[101319]: iface.bidi_chap = Jul 03 09:47:08.559383 np0000004400 cinder-backup[101319]: iface.strict_login_compliance = Jul 03 09:47:08.559383 np0000004400 cinder-backup[101319]: iface.discovery_auth = Jul 03 09:47:08.559383 np0000004400 cinder-backup[101319]: iface.discovery_logout = Jul 03 09:47:08.559383 np0000004400 cinder-backup[101319]: node.discovery_address = Jul 03 09:47:08.559383 np0000004400 cinder-backup[101319]: node.discovery_port = 0 Jul 03 09:47:08.559383 np0000004400 cinder-backup[101319]: node.discovery_type = fw Jul 03 09:47:08.559383 np0000004400 cinder-backup[101319]: node.session.initial_cmdsn = 0 Jul 03 09:47:08.559383 np0000004400 cinder-backup[101319]: node.session.initial_login_retry_max = 8 Jul 03 09:47:08.559383 np0000004400 cinder-backup[101319]: node.session.xmit_thread_priority = 0 Jul 03 09:47:08.559383 np0000004400 cinder-backup[101319]: node.session.cmds_max = 128 Jul 03 09:47:08.559383 np0000004400 cinder-backup[101319]: node.session.queue_depth = 32 Jul 03 09:47:08.559383 np0000004400 cinder-backup[101319]: node.session.nr_sessions = 1 Jul 03 09:47:08.559383 np0000004400 cinder-backup[101319]: node.session.auth.authmethod = None Jul 03 09:47:08.559383 np0000004400 cinder-backup[101319]: node.session.auth.username = Jul 03 09:47:08.559383 np0000004400 cinder-backup[101319]: node.session.auth.password = *** Jul 03 09:47:08.559383 np0000004400 cinder-backup[101319]: node.session.auth.username_in = Jul 03 09:47:08.559383 np0000004400 cinder-backup[101319]: node.session.auth.password_in = Jul 03 09:47:08.559383 np0000004400 cinder-backup[101319]: node.session.auth.chap_algs = SHA256 Jul 03 09:47:08.559383 np0000004400 cinder-backup[101319]: node.session.timeo.replacement_timeout = 120 Jul 03 09:47:08.559383 np0000004400 cinder-backup[101319]: node.session.err_timeo.abort_timeout = 15 Jul 03 09:47:08.559383 np0000004400 cinder-backup[101319]: node.session.err_timeo.lu_reset_timeout = 30 Jul 03 09:47:08.559383 np0000004400 cinder-backup[101319]: node.session.err_timeo.tgt_reset_timeout = 30 Jul 03 09:47:08.559383 np0000004400 cinder-backup[101319]: node.session.err_timeo.host_reset_timeout = 60 Jul 03 09:47:08.559383 np0000004400 cinder-backup[101319]: node.session.iscsi.FastAbort = Yes Jul 03 09:47:08.559383 np0000004400 cinder-backup[101319]: node.session.iscsi.InitialR2T = No Jul 03 09:47:08.559383 np0000004400 cinder-backup[101319]: node.session.iscsi.ImmediateData = Yes Jul 03 09:47:08.559383 np0000004400 cinder-backup[101319]: node.session.iscsi.FirstBurstLength = 262144 Jul 03 09:47:08.559383 np0000004400 cinder-backup[101319]: node.session.iscsi.MaxBurstLength = 16776192 Jul 03 09:47:08.559383 np0000004400 cinder-backup[101319]: node.session.iscsi.DefaultTime2Retain = 0 Jul 03 09:47:08.559383 np0000004400 cinder-backup[101319]: node.session.iscsi.DefaultTime2Wait = 2 Jul 03 09:47:08.559383 np0000004400 cinder-backup[101319]: node.session.iscsi.MaxConnections = 1 Jul 03 09:47:08.559383 np0000004400 cinder-backup[101319]: node.session.iscsi.MaxOutstandingR2T = 1 Jul 03 09:47:08.559383 np0000004400 cinder-backup[101319]: node.session.iscsi.ERL = 0 Jul 03 09:47:08.559383 np0000004400 cinder-backup[101319]: node.session.scan = auto Jul 03 09:47:08.559383 np0000004400 cinder-backup[101319]: node.session.reopen_max = 0 Jul 03 09:47:08.559383 np0000004400 cinder-backup[101319]: node.conn[0].address = 192.168.40.100 Jul 03 09:47:08.559383 np0000004400 cinder-backup[101319]: node.conn[0].port = 3260 Jul 03 09:47:08.559383 np0000004400 cinder-backup[101319]: node.conn[0].startup = manual Jul 03 09:47:08.559383 np0000004400 cinder-backup[101319]: node.conn[0].tcp.window_size = 524288 Jul 03 09:47:08.559383 np0000004400 cinder-backup[101319]: node.conn[0].tcp.type_of_service = 0 Jul 03 09:47:08.559383 np0000004400 cinder-backup[101319]: node.conn[0].timeo.logout_timeout = 15 Jul 03 09:47:08.559383 np0000004400 cinder-backup[101319]: node.conn[0].timeo.login_timeout = 15 Jul 03 09:47:08.559383 np0000004400 cinder-backup[101319]: node.conn[0].timeo.auth_timeout = 45 Jul 03 09:47:08.559383 np0000004400 cinder-backup[101319]: node.conn[0].timeo.noop_out_interval = 5 Jul 03 09:47:08.559383 np0000004400 cinder-backup[101319]: node.conn[0].timeo.noop_out_timeout = 5 Jul 03 09:47:08.559383 np0000004400 cinder-backup[101319]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0 Jul 03 09:47:08.559383 np0000004400 cinder-backup[101319]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144 Jul 03 09:47:08.559383 np0000004400 cinder-backup[101319]: node.conn[0].iscsi.HeaderDigest = None Jul 03 09:47:08.559383 np0000004400 cinder-backup[101319]: node.conn[0].iscsi.DataDigest = None Jul 03 09:47:08.559383 np0000004400 cinder-backup[101319]: node.conn[0].iscsi.IFMarker = No Jul 03 09:47:08.559383 np0000004400 cinder-backup[101319]: node.conn[0].iscsi.OFMarker = No Jul 03 09:47:08.559383 np0000004400 cinder-backup[101319]: # END RECORD Jul 03 09:47:08.559383 np0000004400 cinder-backup[101319]: stderr= {{(pid=101319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 03 09:47:08.571855 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-c0b6bb1f-d91f-43e7-be98-b7740c01c433 tempest-VolumesBackupsTest-118275719 None] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=101319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 03 09:47:08.582505 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-c0b6bb1f-d91f-43e7-be98-b7740c01c433 tempest-VolumesBackupsTest-118275719 None] iscsiadm ('-m', 'session'): stdout=tcp: [82] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-76320525-737e-4f58-8523-63ec9abbdc64 (non-flash) Jul 03 09:47:08.582505 np0000004400 cinder-backup[101319]: tcp: [83] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-76320525-737e-4f58-8523-63ec9abbdc64 (non-flash) Jul 03 09:47:08.582505 np0000004400 cinder-backup[101319]: stderr= {{(pid=101319) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jul 03 09:47:08.582772 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-c0b6bb1f-d91f-43e7-be98-b7740c01c433 tempest-VolumesBackupsTest-118275719 None] iscsi session list stdout=tcp: [82] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-76320525-737e-4f58-8523-63ec9abbdc64 (non-flash) Jul 03 09:47:08.582772 np0000004400 cinder-backup[101319]: tcp: [83] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-76320525-737e-4f58-8523-63ec9abbdc64 (non-flash) Jul 03 09:47:08.582772 np0000004400 cinder-backup[101319]: stderr= {{(pid=101319) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jul 03 09:47:08.611575 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-c0b6bb1f-d91f-43e7-be98-b7740c01c433 tempest-VolumesBackupsTest-118275719 None] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-72e07e1e-1567-4071-8204-c29cb26d2660, portal: 192.168.40.100,3260] Jul 03 09:47:08.611575 np0000004400 cinder-backup[101319]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-72e07e1e-1567-4071-8204-c29cb26d2660, portal: 192.168.40.100,3260] successful. Jul 03 09:47:08.611575 np0000004400 cinder-backup[101319]: stderr= {{(pid=101319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 03 09:47:08.618823 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-c0b6bb1f-d91f-43e7-be98-b7740c01c433 tempest-VolumesBackupsTest-118275719 None] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=101319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 03 09:47:08.632191 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-c0b6bb1f-d91f-43e7-be98-b7740c01c433 tempest-VolumesBackupsTest-118275719 None] iscsiadm ('-m', 'session'): stdout=tcp: [119] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-72e07e1e-1567-4071-8204-c29cb26d2660 (non-flash) Jul 03 09:47:08.632191 np0000004400 cinder-backup[101319]: tcp: [82] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-76320525-737e-4f58-8523-63ec9abbdc64 (non-flash) Jul 03 09:47:08.632191 np0000004400 cinder-backup[101319]: tcp: [83] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-76320525-737e-4f58-8523-63ec9abbdc64 (non-flash) Jul 03 09:47:08.632191 np0000004400 cinder-backup[101319]: stderr= {{(pid=101319) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jul 03 09:47:08.632388 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-c0b6bb1f-d91f-43e7-be98-b7740c01c433 tempest-VolumesBackupsTest-118275719 None] iscsi session list stdout=tcp: [119] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-72e07e1e-1567-4071-8204-c29cb26d2660 (non-flash) Jul 03 09:47:08.632388 np0000004400 cinder-backup[101319]: tcp: [82] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-76320525-737e-4f58-8523-63ec9abbdc64 (non-flash) Jul 03 09:47:08.632388 np0000004400 cinder-backup[101319]: tcp: [83] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-76320525-737e-4f58-8523-63ec9abbdc64 (non-flash) Jul 03 09:47:08.632388 np0000004400 cinder-backup[101319]: stderr= {{(pid=101319) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jul 03 09:47:08.632668 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.base [None req-c0b6bb1f-d91f-43e7-be98-b7740c01c433 tempest-VolumesBackupsTest-118275719 None] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-72e07e1e-1567-4071-8204-c29cb26d2660" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.105s {{(pid=101319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jul 03 09:47:08.632798 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-c0b6bb1f-d91f-43e7-be98-b7740c01c433 tempest-VolumesBackupsTest-118275719 None] Connected to 192.168.40.100:3260 {{(pid=101319) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}} Jul 03 09:47:08.633348 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.linuxscsi [None req-c0b6bb1f-d91f-43e7-be98-b7740c01c433 tempest-VolumesBackupsTest-118275719 None] HCTL ('7', '-', '-', 0) found on session 119 with lun 0 {{(pid=101319) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}} Jul 03 09:47:08.633517 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.linuxscsi [None req-c0b6bb1f-d91f-43e7-be98-b7740c01c433 tempest-VolumesBackupsTest-118275719 None] Scanning host 7 c: -, t: -, l: 0) {{(pid=101319) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}} Jul 03 09:47:08.644767 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.linuxscsi [None req-c0b6bb1f-d91f-43e7-be98-b7740c01c433 tempest-VolumesBackupsTest-118275719 None] Searching for a device in session 119 and hctl ['7', '*', '*', 0] yield: None {{(pid=101319) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}} Jul 03 09:47:09.646350 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.linuxscsi [None req-c0b6bb1f-d91f-43e7-be98-b7740c01c433 tempest-VolumesBackupsTest-118275719 None] Searching for a device in session 119 and hctl ['7', '*', '*', 0] yield: sdb {{(pid=101319) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}} Jul 03 09:47:09.646736 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-c0b6bb1f-d91f-43e7-be98-b7740c01c433 tempest-VolumesBackupsTest-118275719 None] Connected to sdb using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-72e07e1e-1567-4071-8204-c29cb26d2660', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '72e07e1e-1567-4071-8204-c29cb26d2660', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': False} {{(pid=101319) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}} Jul 03 09:47:09.648075 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.base [None req-c0b6bb1f-d91f-43e7-be98-b7740c01c433 tempest-VolumesBackupsTest-118275719 None] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 2.131s {{(pid=101319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jul 03 09:47:09.648075 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-c0b6bb1f-d91f-43e7-be98-b7740c01c433 tempest-VolumesBackupsTest-118275719 None] <== connect_volume: return (2131ms) {'type': 'block', 'scsi_wwn': '33000000091843b59', 'path': '/dev/sdb'} {{(pid=101319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}} Jul 03 09:47:09.648075 np0000004400 cinder-backup[101319]: DEBUG oslo_concurrency.processutils [None req-c0b6bb1f-d91f-43e7-be98-b7740c01c433 tempest-VolumesBackupsTest-118275719 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chown 1002 /dev/sdb {{(pid=101319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 09:47:09.673669 np0000004400 sudo[140347]: stack : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chown 1002 /dev/sdb Jul 03 09:47:09.674318 np0000004400 sudo[140347]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1002) Jul 03 09:47:09.973492 np0000004400 sudo[140347]: pam_unix(sudo:session): session closed for user root Jul 03 09:47:09.975548 np0000004400 cinder-backup[101319]: DEBUG oslo_concurrency.processutils [None req-c0b6bb1f-d91f-43e7-be98-b7740c01c433 tempest-VolumesBackupsTest-118275719 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chown 1002 /dev/sdb" returned: 0 in 0.327s {{(pid=101319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 09:47:10.003460 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-c0b6bb1f-d91f-43e7-be98-b7740c01c433 tempest-VolumesBackupsTest-118275719 None] _read_sha256file started, container name: volumebackups, sha256 filename: volume_72e07e1e-1567-4071-8204-c29cb26d2660/20260703094546/az_nova_backup_8b377d15-3804-4a9c-ad2d-e8e1359c0ee5_sha256file. {{(pid=101319) _read_sha256file /opt/stack/cinder/cinder/backup/chunkeddriver.py:333}} Jul 03 09:47:10.075524 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-c0b6bb1f-d91f-43e7-be98-b7740c01c433 tempest-VolumesBackupsTest-118275719 None] _read_sha256file finished. {{(pid=101319) _read_sha256file /opt/stack/cinder/cinder/backup/chunkeddriver.py:340}} Jul 03 09:47:10.102895 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-c0b6bb1f-d91f-43e7-be98-b7740c01c433 tempest-VolumesBackupsTest-118275719 None] _create_container started, container: volumebackups,backup: eba702ee-9959-40fe-9093-1eecff8dbaa6. {{(pid=101319) _create_container /opt/stack/cinder/cinder/backup/chunkeddriver.py:249}} Jul 03 09:47:10.169091 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.drivers.swift [None req-c0b6bb1f-d91f-43e7-be98-b7740c01c433 tempest-VolumesBackupsTest-118275719 None] generate_object_name_prefix: volume_72e07e1e-1567-4071-8204-c29cb26d2660/20260703094710/az_nova_backup_eba702ee-9959-40fe-9093-1eecff8dbaa6 {{(pid=101319) _generate_object_name_prefix /opt/stack/cinder/cinder/backup/drivers/swift.py:452}} Jul 03 09:47:10.252858 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-c0b6bb1f-d91f-43e7-be98-b7740c01c433 tempest-VolumesBackupsTest-118275719 None] starting backup of volume: 72e07e1e-1567-4071-8204-c29cb26d2660, volume size: 1073741824, object names prefix volume_72e07e1e-1567-4071-8204-c29cb26d2660/20260703094710/az_nova_backup_eba702ee-9959-40fe-9093-1eecff8dbaa6, availability zone: nova {{(pid=101319) _prepare_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:359}} Jul 03 09:47:10.598093 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-c0b6bb1f-d91f-43e7-be98-b7740c01c433 tempest-VolumesBackupsTest-118275719 None] Backing up chunk of data from volume. {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 09:47:10.598870 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-c0b6bb1f-d91f-43e7-be98-b7740c01c433 tempest-VolumesBackupsTest-118275719 None] Compressed 32768 bytes of data to 639 bytes using zlib. {{(pid=101319) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 09:47:10.601743 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-c0b6bb1f-d91f-43e7-be98-b7740c01c433 tempest-VolumesBackupsTest-118275719 None] About to put_object {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 09:47:10.661066 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-c0b6bb1f-d91f-43e7-be98-b7740c01c433 tempest-VolumesBackupsTest-118275719 None] backup MD5 for volume_72e07e1e-1567-4071-8204-c29cb26d2660/20260703094710/az_nova_backup_eba702ee-9959-40fe-9093-1eecff8dbaa6-00001: 7455b0146d203e0450dd14035351df50 {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 09:47:10.661066 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-c0b6bb1f-d91f-43e7-be98-b7740c01c433 tempest-VolumesBackupsTest-118275719 None] Calling eventlet.sleep(0) {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 09:47:10.661066 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-c0b6bb1f-d91f-43e7-be98-b7740c01c433 tempest-VolumesBackupsTest-118275719 None] Backing up chunk of data from volume. {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 09:47:10.665892 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-c0b6bb1f-d91f-43e7-be98-b7740c01c433 tempest-VolumesBackupsTest-118275719 None] Compressed 294912 bytes of data to 26577 bytes using zlib. {{(pid=101319) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 09:47:10.666208 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-c0b6bb1f-d91f-43e7-be98-b7740c01c433 tempest-VolumesBackupsTest-118275719 None] About to put_object {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 09:47:10.708800 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-c0b6bb1f-d91f-43e7-be98-b7740c01c433 tempest-VolumesBackupsTest-118275719 None] backup MD5 for volume_72e07e1e-1567-4071-8204-c29cb26d2660/20260703094710/az_nova_backup_eba702ee-9959-40fe-9093-1eecff8dbaa6-00002: f894e3de84554e2c3d9abe14489ed190 {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 09:47:10.709027 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-c0b6bb1f-d91f-43e7-be98-b7740c01c433 tempest-VolumesBackupsTest-118275719 None] Calling eventlet.sleep(0) {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 09:47:10.710937 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-c0b6bb1f-d91f-43e7-be98-b7740c01c433 tempest-VolumesBackupsTest-118275719 None] Backing up chunk of data from volume. {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 09:47:10.739167 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-c0b6bb1f-d91f-43e7-be98-b7740c01c433 tempest-VolumesBackupsTest-118275719 None] Compressed 2195456 bytes of data to 113552 bytes using zlib. {{(pid=101319) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 09:47:10.739362 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-c0b6bb1f-d91f-43e7-be98-b7740c01c433 tempest-VolumesBackupsTest-118275719 None] About to put_object {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 09:47:10.803544 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-c0b6bb1f-d91f-43e7-be98-b7740c01c433 tempest-VolumesBackupsTest-118275719 None] backup MD5 for volume_72e07e1e-1567-4071-8204-c29cb26d2660/20260703094710/az_nova_backup_eba702ee-9959-40fe-9093-1eecff8dbaa6-00003: 89ec4da3acc51ee3a662b9b401b603ec {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 09:47:10.803734 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-c0b6bb1f-d91f-43e7-be98-b7740c01c433 tempest-VolumesBackupsTest-118275719 None] Calling eventlet.sleep(0) {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 09:47:10.803734 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-c0b6bb1f-d91f-43e7-be98-b7740c01c433 tempest-VolumesBackupsTest-118275719 None] Backing up chunk of data from volume. {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 09:47:10.808213 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-c0b6bb1f-d91f-43e7-be98-b7740c01c433 tempest-VolumesBackupsTest-118275719 None] Compressed 98304 bytes of data to 3974 bytes using zlib. {{(pid=101319) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 09:47:10.808355 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-c0b6bb1f-d91f-43e7-be98-b7740c01c433 tempest-VolumesBackupsTest-118275719 None] About to put_object {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 09:47:10.869564 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-c0b6bb1f-d91f-43e7-be98-b7740c01c433 tempest-VolumesBackupsTest-118275719 None] backup MD5 for volume_72e07e1e-1567-4071-8204-c29cb26d2660/20260703094710/az_nova_backup_eba702ee-9959-40fe-9093-1eecff8dbaa6-00004: e1554f9208060479cb8c0e2b20ce3092 {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 09:47:10.869564 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-c0b6bb1f-d91f-43e7-be98-b7740c01c433 tempest-VolumesBackupsTest-118275719 None] Calling eventlet.sleep(0) {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 09:47:10.869564 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-c0b6bb1f-d91f-43e7-be98-b7740c01c433 tempest-VolumesBackupsTest-118275719 None] Backing up chunk of data from volume. {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 09:47:10.875631 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-c0b6bb1f-d91f-43e7-be98-b7740c01c433 tempest-VolumesBackupsTest-118275719 None] Compressed 360448 bytes of data to 34483 bytes using zlib. {{(pid=101319) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 09:47:10.875924 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-c0b6bb1f-d91f-43e7-be98-b7740c01c433 tempest-VolumesBackupsTest-118275719 None] About to put_object {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 09:47:10.917951 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-c0b6bb1f-d91f-43e7-be98-b7740c01c433 tempest-VolumesBackupsTest-118275719 None] backup MD5 for volume_72e07e1e-1567-4071-8204-c29cb26d2660/20260703094710/az_nova_backup_eba702ee-9959-40fe-9093-1eecff8dbaa6-00005: 260e04b2b4be4a8fb9af5bcaeef77f5e {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 09:47:10.918135 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-c0b6bb1f-d91f-43e7-be98-b7740c01c433 tempest-VolumesBackupsTest-118275719 None] Calling eventlet.sleep(0) {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 09:47:10.918634 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-c0b6bb1f-d91f-43e7-be98-b7740c01c433 tempest-VolumesBackupsTest-118275719 None] Backing up chunk of data from volume. {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 09:47:10.925328 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-c0b6bb1f-d91f-43e7-be98-b7740c01c433 tempest-VolumesBackupsTest-118275719 None] Compressed 262144 bytes of data to 36108 bytes using zlib. {{(pid=101319) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 09:47:10.925328 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-c0b6bb1f-d91f-43e7-be98-b7740c01c433 tempest-VolumesBackupsTest-118275719 None] About to put_object {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 09:47:10.981326 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-c0b6bb1f-d91f-43e7-be98-b7740c01c433 tempest-VolumesBackupsTest-118275719 None] backup MD5 for volume_72e07e1e-1567-4071-8204-c29cb26d2660/20260703094710/az_nova_backup_eba702ee-9959-40fe-9093-1eecff8dbaa6-00006: 7e4882497657c646c554c5ad835c0cf5 {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 09:47:10.981501 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-c0b6bb1f-d91f-43e7-be98-b7740c01c433 tempest-VolumesBackupsTest-118275719 None] Calling eventlet.sleep(0) {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 09:47:10.981816 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-c0b6bb1f-d91f-43e7-be98-b7740c01c433 tempest-VolumesBackupsTest-118275719 None] Backing up chunk of data from volume. {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 09:47:10.989889 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-c0b6bb1f-d91f-43e7-be98-b7740c01c433 tempest-VolumesBackupsTest-118275719 None] Compressed 32768 bytes of data to 338 bytes using zlib. {{(pid=101319) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 09:47:10.989988 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-c0b6bb1f-d91f-43e7-be98-b7740c01c433 tempest-VolumesBackupsTest-118275719 None] About to put_object {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 09:47:11.034499 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-c0b6bb1f-d91f-43e7-be98-b7740c01c433 tempest-VolumesBackupsTest-118275719 None] backup MD5 for volume_72e07e1e-1567-4071-8204-c29cb26d2660/20260703094710/az_nova_backup_eba702ee-9959-40fe-9093-1eecff8dbaa6-00007: d9cd9a4fb7c178bffad872b9fd1c6616 {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 09:47:11.034499 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-c0b6bb1f-d91f-43e7-be98-b7740c01c433 tempest-VolumesBackupsTest-118275719 None] Calling eventlet.sleep(0) {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 09:47:11.035076 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-c0b6bb1f-d91f-43e7-be98-b7740c01c433 tempest-VolumesBackupsTest-118275719 None] Backing up chunk of data from volume. {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 09:47:11.070375 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-c0b6bb1f-d91f-43e7-be98-b7740c01c433 tempest-VolumesBackupsTest-118275719 None] Compressed 524288 bytes of data to 272574 bytes using zlib. {{(pid=101319) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 09:47:11.070659 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-c0b6bb1f-d91f-43e7-be98-b7740c01c433 tempest-VolumesBackupsTest-118275719 None] About to put_object {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 09:47:11.154341 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-c0b6bb1f-d91f-43e7-be98-b7740c01c433 tempest-VolumesBackupsTest-118275719 None] backup MD5 for volume_72e07e1e-1567-4071-8204-c29cb26d2660/20260703094710/az_nova_backup_eba702ee-9959-40fe-9093-1eecff8dbaa6-00008: 89771b482f431367ab05882b853a01a6 {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 09:47:11.154521 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-c0b6bb1f-d91f-43e7-be98-b7740c01c433 tempest-VolumesBackupsTest-118275719 None] Calling eventlet.sleep(0) {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 09:47:11.154866 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-c0b6bb1f-d91f-43e7-be98-b7740c01c433 tempest-VolumesBackupsTest-118275719 None] Backing up chunk of data from volume. {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 09:47:11.157263 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-c0b6bb1f-d91f-43e7-be98-b7740c01c433 tempest-VolumesBackupsTest-118275719 None] Compressed 98304 bytes of data to 18814 bytes using zlib. {{(pid=101319) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 09:47:11.157441 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-c0b6bb1f-d91f-43e7-be98-b7740c01c433 tempest-VolumesBackupsTest-118275719 None] About to put_object {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 09:47:11.197872 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-c0b6bb1f-d91f-43e7-be98-b7740c01c433 tempest-VolumesBackupsTest-118275719 None] backup MD5 for volume_72e07e1e-1567-4071-8204-c29cb26d2660/20260703094710/az_nova_backup_eba702ee-9959-40fe-9093-1eecff8dbaa6-00009: 807f8f1c74646a8f9592027f16d2643d {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 09:47:11.198193 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-c0b6bb1f-d91f-43e7-be98-b7740c01c433 tempest-VolumesBackupsTest-118275719 None] Calling eventlet.sleep(0) {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 09:47:11.198565 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-c0b6bb1f-d91f-43e7-be98-b7740c01c433 tempest-VolumesBackupsTest-118275719 None] Backing up chunk of data from volume. {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 09:47:11.199931 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-c0b6bb1f-d91f-43e7-be98-b7740c01c433 tempest-VolumesBackupsTest-118275719 None] Compressed 65536 bytes of data to 21396 bytes using zlib. {{(pid=101319) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 09:47:11.200107 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-c0b6bb1f-d91f-43e7-be98-b7740c01c433 tempest-VolumesBackupsTest-118275719 None] About to put_object {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 09:47:11.234466 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-c0b6bb1f-d91f-43e7-be98-b7740c01c433 tempest-VolumesBackupsTest-118275719 None] backup MD5 for volume_72e07e1e-1567-4071-8204-c29cb26d2660/20260703094710/az_nova_backup_eba702ee-9959-40fe-9093-1eecff8dbaa6-00010: 035de9616151b09d26063aaf3786be98 {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 09:47:11.234466 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-c0b6bb1f-d91f-43e7-be98-b7740c01c433 tempest-VolumesBackupsTest-118275719 None] Calling eventlet.sleep(0) {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 09:47:11.234466 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-c0b6bb1f-d91f-43e7-be98-b7740c01c433 tempest-VolumesBackupsTest-118275719 None] Backing up chunk of data from volume. {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 09:47:11.257046 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-c0b6bb1f-d91f-43e7-be98-b7740c01c433 tempest-VolumesBackupsTest-118275719 None] Compressed 327680 bytes of data to 158643 bytes using zlib. {{(pid=101319) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 09:47:11.257320 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-c0b6bb1f-d91f-43e7-be98-b7740c01c433 tempest-VolumesBackupsTest-118275719 None] About to put_object {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 09:47:11.326305 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-c0b6bb1f-d91f-43e7-be98-b7740c01c433 tempest-VolumesBackupsTest-118275719 None] backup MD5 for volume_72e07e1e-1567-4071-8204-c29cb26d2660/20260703094710/az_nova_backup_eba702ee-9959-40fe-9093-1eecff8dbaa6-00011: f941eba3270410ec15b7aff819b8b0c0 {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 09:47:11.326521 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-c0b6bb1f-d91f-43e7-be98-b7740c01c433 tempest-VolumesBackupsTest-118275719 None] Calling eventlet.sleep(0) {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 09:47:11.327090 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-c0b6bb1f-d91f-43e7-be98-b7740c01c433 tempest-VolumesBackupsTest-118275719 None] Backing up chunk of data from volume. {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 09:47:11.336618 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-c0b6bb1f-d91f-43e7-be98-b7740c01c433 tempest-VolumesBackupsTest-118275719 None] Compressed 327680 bytes of data to 62614 bytes using zlib. {{(pid=101319) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 09:47:11.336805 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-c0b6bb1f-d91f-43e7-be98-b7740c01c433 tempest-VolumesBackupsTest-118275719 None] About to put_object {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 09:47:11.393466 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-c0b6bb1f-d91f-43e7-be98-b7740c01c433 tempest-VolumesBackupsTest-118275719 None] backup MD5 for volume_72e07e1e-1567-4071-8204-c29cb26d2660/20260703094710/az_nova_backup_eba702ee-9959-40fe-9093-1eecff8dbaa6-00012: ba683c210943a225502816568e3b8d00 {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 09:47:11.393797 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-c0b6bb1f-d91f-43e7-be98-b7740c01c433 tempest-VolumesBackupsTest-118275719 None] Calling eventlet.sleep(0) {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 09:47:11.394047 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-c0b6bb1f-d91f-43e7-be98-b7740c01c433 tempest-VolumesBackupsTest-118275719 None] Backing up chunk of data from volume. {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 09:47:11.396425 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-c0b6bb1f-d91f-43e7-be98-b7740c01c433 tempest-VolumesBackupsTest-118275719 None] Compressed 65536 bytes of data to 14711 bytes using zlib. {{(pid=101319) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 09:47:11.396612 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-c0b6bb1f-d91f-43e7-be98-b7740c01c433 tempest-VolumesBackupsTest-118275719 None] About to put_object {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 09:47:11.445032 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-c0b6bb1f-d91f-43e7-be98-b7740c01c433 tempest-VolumesBackupsTest-118275719 None] backup MD5 for volume_72e07e1e-1567-4071-8204-c29cb26d2660/20260703094710/az_nova_backup_eba702ee-9959-40fe-9093-1eecff8dbaa6-00013: e88548713f69de90eef0cd6c4e9796dd {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 09:47:11.445244 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-c0b6bb1f-d91f-43e7-be98-b7740c01c433 tempest-VolumesBackupsTest-118275719 None] Calling eventlet.sleep(0) {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 09:47:11.445851 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-c0b6bb1f-d91f-43e7-be98-b7740c01c433 tempest-VolumesBackupsTest-118275719 None] Backing up chunk of data from volume. {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 09:47:11.462277 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-c0b6bb1f-d91f-43e7-be98-b7740c01c433 tempest-VolumesBackupsTest-118275719 None] Compressed 393216 bytes of data to 90143 bytes using zlib. {{(pid=101319) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 09:47:11.462467 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-c0b6bb1f-d91f-43e7-be98-b7740c01c433 tempest-VolumesBackupsTest-118275719 None] About to put_object {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 09:47:11.524905 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-c0b6bb1f-d91f-43e7-be98-b7740c01c433 tempest-VolumesBackupsTest-118275719 None] backup MD5 for volume_72e07e1e-1567-4071-8204-c29cb26d2660/20260703094710/az_nova_backup_eba702ee-9959-40fe-9093-1eecff8dbaa6-00014: 01e3e2d3510c4223690a6849e71496ab {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 09:47:11.525121 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-c0b6bb1f-d91f-43e7-be98-b7740c01c433 tempest-VolumesBackupsTest-118275719 None] Calling eventlet.sleep(0) {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 09:47:11.525459 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-c0b6bb1f-d91f-43e7-be98-b7740c01c433 tempest-VolumesBackupsTest-118275719 None] Backing up chunk of data from volume. {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 09:47:11.529702 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-c0b6bb1f-d91f-43e7-be98-b7740c01c433 tempest-VolumesBackupsTest-118275719 None] Compressed 131072 bytes of data to 34865 bytes using zlib. {{(pid=101319) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 09:47:11.529823 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-c0b6bb1f-d91f-43e7-be98-b7740c01c433 tempest-VolumesBackupsTest-118275719 None] About to put_object {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 09:47:11.569949 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-c0b6bb1f-d91f-43e7-be98-b7740c01c433 tempest-VolumesBackupsTest-118275719 None] backup MD5 for volume_72e07e1e-1567-4071-8204-c29cb26d2660/20260703094710/az_nova_backup_eba702ee-9959-40fe-9093-1eecff8dbaa6-00015: 599805a91aa71f961c3787a61e7c5729 {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 09:47:11.570136 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-c0b6bb1f-d91f-43e7-be98-b7740c01c433 tempest-VolumesBackupsTest-118275719 None] Calling eventlet.sleep(0) {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 09:47:11.570441 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-c0b6bb1f-d91f-43e7-be98-b7740c01c433 tempest-VolumesBackupsTest-118275719 None] Backing up chunk of data from volume. {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 09:47:11.572962 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-c0b6bb1f-d91f-43e7-be98-b7740c01c433 tempest-VolumesBackupsTest-118275719 None] Compressed 65536 bytes of data to 7444 bytes using zlib. {{(pid=101319) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 09:47:11.573112 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-c0b6bb1f-d91f-43e7-be98-b7740c01c433 tempest-VolumesBackupsTest-118275719 None] About to put_object {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 09:47:11.621894 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-c0b6bb1f-d91f-43e7-be98-b7740c01c433 tempest-VolumesBackupsTest-118275719 None] backup MD5 for volume_72e07e1e-1567-4071-8204-c29cb26d2660/20260703094710/az_nova_backup_eba702ee-9959-40fe-9093-1eecff8dbaa6-00016: 179b961161bdaa477c7c01ad80585eee {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 09:47:11.622022 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-c0b6bb1f-d91f-43e7-be98-b7740c01c433 tempest-VolumesBackupsTest-118275719 None] Calling eventlet.sleep(0) {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 09:47:11.622198 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-c0b6bb1f-d91f-43e7-be98-b7740c01c433 tempest-VolumesBackupsTest-118275719 None] Backing up chunk of data from volume. {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 09:47:11.631567 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-c0b6bb1f-d91f-43e7-be98-b7740c01c433 tempest-VolumesBackupsTest-118275719 None] Compressed 131072 bytes of data to 83926 bytes using zlib. {{(pid=101319) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 09:47:11.631688 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-c0b6bb1f-d91f-43e7-be98-b7740c01c433 tempest-VolumesBackupsTest-118275719 None] About to put_object {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 09:47:11.703781 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-c0b6bb1f-d91f-43e7-be98-b7740c01c433 tempest-VolumesBackupsTest-118275719 None] backup MD5 for volume_72e07e1e-1567-4071-8204-c29cb26d2660/20260703094710/az_nova_backup_eba702ee-9959-40fe-9093-1eecff8dbaa6-00017: d27aa048e7ec9b4cbc6afc435ead70f6 {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 09:47:11.703781 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-c0b6bb1f-d91f-43e7-be98-b7740c01c433 tempest-VolumesBackupsTest-118275719 None] Calling eventlet.sleep(0) {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 09:47:11.703781 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-c0b6bb1f-d91f-43e7-be98-b7740c01c433 tempest-VolumesBackupsTest-118275719 None] Backing up chunk of data from volume. {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 09:47:11.737191 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-c0b6bb1f-d91f-43e7-be98-b7740c01c433 tempest-VolumesBackupsTest-118275719 None] Compressed 786432 bytes of data to 349723 bytes using zlib. {{(pid=101319) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 09:47:11.737359 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-c0b6bb1f-d91f-43e7-be98-b7740c01c433 tempest-VolumesBackupsTest-118275719 None] About to put_object {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 09:47:11.828148 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-c0b6bb1f-d91f-43e7-be98-b7740c01c433 tempest-VolumesBackupsTest-118275719 None] backup MD5 for volume_72e07e1e-1567-4071-8204-c29cb26d2660/20260703094710/az_nova_backup_eba702ee-9959-40fe-9093-1eecff8dbaa6-00018: 93a49a74b3f385db27466765f9e213d9 {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 09:47:11.828448 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-c0b6bb1f-d91f-43e7-be98-b7740c01c433 tempest-VolumesBackupsTest-118275719 None] Calling eventlet.sleep(0) {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 09:47:11.828954 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-c0b6bb1f-d91f-43e7-be98-b7740c01c433 tempest-VolumesBackupsTest-118275719 None] Backing up chunk of data from volume. {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 09:47:11.832643 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-c0b6bb1f-d91f-43e7-be98-b7740c01c433 tempest-VolumesBackupsTest-118275719 None] Compressed 65536 bytes of data to 30511 bytes using zlib. {{(pid=101319) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 09:47:11.832815 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-c0b6bb1f-d91f-43e7-be98-b7740c01c433 tempest-VolumesBackupsTest-118275719 None] About to put_object {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 09:47:11.994111 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-c0b6bb1f-d91f-43e7-be98-b7740c01c433 tempest-VolumesBackupsTest-118275719 None] backup MD5 for volume_72e07e1e-1567-4071-8204-c29cb26d2660/20260703094710/az_nova_backup_eba702ee-9959-40fe-9093-1eecff8dbaa6-00019: fb0b4c9f443eae7a19740e071a10002c {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 09:47:11.994111 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-c0b6bb1f-d91f-43e7-be98-b7740c01c433 tempest-VolumesBackupsTest-118275719 None] Calling eventlet.sleep(0) {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 09:47:12.000303 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-c0b6bb1f-d91f-43e7-be98-b7740c01c433 tempest-VolumesBackupsTest-118275719 None] Backing up chunk of data from volume. {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 09:47:12.097046 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-c0b6bb1f-d91f-43e7-be98-b7740c01c433 tempest-VolumesBackupsTest-118275719 None] Compressed 2293760 bytes of data to 749876 bytes using zlib. {{(pid=101319) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 09:47:12.097332 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-c0b6bb1f-d91f-43e7-be98-b7740c01c433 tempest-VolumesBackupsTest-118275719 None] About to put_object {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 09:47:12.147950 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-c0b6bb1f-d91f-43e7-be98-b7740c01c433 tempest-VolumesBackupsTest-118275719 None] backup MD5 for volume_72e07e1e-1567-4071-8204-c29cb26d2660/20260703094710/az_nova_backup_eba702ee-9959-40fe-9093-1eecff8dbaa6-00020: 00920597fdfc0422ef27d3428f71089e {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 09:47:12.148141 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-c0b6bb1f-d91f-43e7-be98-b7740c01c433 tempest-VolumesBackupsTest-118275719 None] Calling eventlet.sleep(0) {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 09:47:12.149054 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-c0b6bb1f-d91f-43e7-be98-b7740c01c433 tempest-VolumesBackupsTest-118275719 None] Backing up chunk of data from volume. {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 09:47:12.164224 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-c0b6bb1f-d91f-43e7-be98-b7740c01c433 tempest-VolumesBackupsTest-118275719 None] Compressed 262144 bytes of data to 60945 bytes using zlib. {{(pid=101319) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 09:47:12.164468 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-c0b6bb1f-d91f-43e7-be98-b7740c01c433 tempest-VolumesBackupsTest-118275719 None] About to put_object {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 09:47:12.207136 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-c0b6bb1f-d91f-43e7-be98-b7740c01c433 tempest-VolumesBackupsTest-118275719 None] backup MD5 for volume_72e07e1e-1567-4071-8204-c29cb26d2660/20260703094710/az_nova_backup_eba702ee-9959-40fe-9093-1eecff8dbaa6-00021: 600a0ec270d9626014f041f394a91dec {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 09:47:12.207288 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-c0b6bb1f-d91f-43e7-be98-b7740c01c433 tempest-VolumesBackupsTest-118275719 None] Calling eventlet.sleep(0) {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 09:47:12.207555 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-c0b6bb1f-d91f-43e7-be98-b7740c01c433 tempest-VolumesBackupsTest-118275719 None] Backing up chunk of data from volume. {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 09:47:12.211396 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-c0b6bb1f-d91f-43e7-be98-b7740c01c433 tempest-VolumesBackupsTest-118275719 None] Compressed 65536 bytes of data to 21497 bytes using zlib. {{(pid=101319) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 09:47:12.211727 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-c0b6bb1f-d91f-43e7-be98-b7740c01c433 tempest-VolumesBackupsTest-118275719 None] About to put_object {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 09:47:12.260013 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-c0b6bb1f-d91f-43e7-be98-b7740c01c433 tempest-VolumesBackupsTest-118275719 None] backup MD5 for volume_72e07e1e-1567-4071-8204-c29cb26d2660/20260703094710/az_nova_backup_eba702ee-9959-40fe-9093-1eecff8dbaa6-00022: d74672ad69032d6511c7f86b7b0cdb23 {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 09:47:12.260171 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-c0b6bb1f-d91f-43e7-be98-b7740c01c433 tempest-VolumesBackupsTest-118275719 None] Calling eventlet.sleep(0) {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 09:47:12.260351 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-c0b6bb1f-d91f-43e7-be98-b7740c01c433 tempest-VolumesBackupsTest-118275719 None] Backing up chunk of data from volume. {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 09:47:12.264205 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-c0b6bb1f-d91f-43e7-be98-b7740c01c433 tempest-VolumesBackupsTest-118275719 None] Compressed 98304 bytes of data to 16500 bytes using zlib. {{(pid=101319) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 09:47:12.264205 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-c0b6bb1f-d91f-43e7-be98-b7740c01c433 tempest-VolumesBackupsTest-118275719 None] About to put_object {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 09:47:12.299813 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-c0b6bb1f-d91f-43e7-be98-b7740c01c433 tempest-VolumesBackupsTest-118275719 None] backup MD5 for volume_72e07e1e-1567-4071-8204-c29cb26d2660/20260703094710/az_nova_backup_eba702ee-9959-40fe-9093-1eecff8dbaa6-00023: b26d859ed07de20dd16d0c165a4e6a3a {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 09:47:12.300025 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-c0b6bb1f-d91f-43e7-be98-b7740c01c433 tempest-VolumesBackupsTest-118275719 None] Calling eventlet.sleep(0) {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 09:47:12.300554 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-c0b6bb1f-d91f-43e7-be98-b7740c01c433 tempest-VolumesBackupsTest-118275719 None] Backing up chunk of data from volume. {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 09:47:12.311922 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-c0b6bb1f-d91f-43e7-be98-b7740c01c433 tempest-VolumesBackupsTest-118275719 None] Compressed 294912 bytes of data to 60530 bytes using zlib. {{(pid=101319) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 09:47:12.312089 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-c0b6bb1f-d91f-43e7-be98-b7740c01c433 tempest-VolumesBackupsTest-118275719 None] About to put_object {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 09:47:12.360227 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-c0b6bb1f-d91f-43e7-be98-b7740c01c433 tempest-VolumesBackupsTest-118275719 None] backup MD5 for volume_72e07e1e-1567-4071-8204-c29cb26d2660/20260703094710/az_nova_backup_eba702ee-9959-40fe-9093-1eecff8dbaa6-00024: 17812a659c805b2d08ad0ffbac17f523 {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 09:47:12.360227 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-c0b6bb1f-d91f-43e7-be98-b7740c01c433 tempest-VolumesBackupsTest-118275719 None] Calling eventlet.sleep(0) {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 09:47:12.360400 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-c0b6bb1f-d91f-43e7-be98-b7740c01c433 tempest-VolumesBackupsTest-118275719 None] Backing up chunk of data from volume. {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 09:47:12.362736 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-c0b6bb1f-d91f-43e7-be98-b7740c01c433 tempest-VolumesBackupsTest-118275719 None] Compressed 65536 bytes of data to 18150 bytes using zlib. {{(pid=101319) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 09:47:12.362861 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-c0b6bb1f-d91f-43e7-be98-b7740c01c433 tempest-VolumesBackupsTest-118275719 None] About to put_object {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 09:47:12.393541 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-c0b6bb1f-d91f-43e7-be98-b7740c01c433 tempest-VolumesBackupsTest-118275719 None] backup MD5 for volume_72e07e1e-1567-4071-8204-c29cb26d2660/20260703094710/az_nova_backup_eba702ee-9959-40fe-9093-1eecff8dbaa6-00025: 900ba3be5febaa4a7e8d4fe06a9e5bbe {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 09:47:12.394425 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-c0b6bb1f-d91f-43e7-be98-b7740c01c433 tempest-VolumesBackupsTest-118275719 None] Calling eventlet.sleep(0) {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 09:47:12.394425 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-c0b6bb1f-d91f-43e7-be98-b7740c01c433 tempest-VolumesBackupsTest-118275719 None] Backing up chunk of data from volume. {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 09:47:12.395893 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-c0b6bb1f-d91f-43e7-be98-b7740c01c433 tempest-VolumesBackupsTest-118275719 None] Compressed 32768 bytes of data to 5224 bytes using zlib. {{(pid=101319) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 09:47:12.396015 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-c0b6bb1f-d91f-43e7-be98-b7740c01c433 tempest-VolumesBackupsTest-118275719 None] About to put_object {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 09:47:12.443638 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-c0b6bb1f-d91f-43e7-be98-b7740c01c433 tempest-VolumesBackupsTest-118275719 None] backup MD5 for volume_72e07e1e-1567-4071-8204-c29cb26d2660/20260703094710/az_nova_backup_eba702ee-9959-40fe-9093-1eecff8dbaa6-00026: 7b83ad270600f54dc0ce5f973398f4a1 {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 09:47:12.443801 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-c0b6bb1f-d91f-43e7-be98-b7740c01c433 tempest-VolumesBackupsTest-118275719 None] Calling eventlet.sleep(0) {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 09:47:12.444003 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-c0b6bb1f-d91f-43e7-be98-b7740c01c433 tempest-VolumesBackupsTest-118275719 None] Backing up chunk of data from volume. {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 09:47:12.445450 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-c0b6bb1f-d91f-43e7-be98-b7740c01c433 tempest-VolumesBackupsTest-118275719 None] Compressed 32768 bytes of data to 7895 bytes using zlib. {{(pid=101319) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 09:47:12.445626 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-c0b6bb1f-d91f-43e7-be98-b7740c01c433 tempest-VolumesBackupsTest-118275719 None] About to put_object {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 09:47:12.506936 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-c0b6bb1f-d91f-43e7-be98-b7740c01c433 tempest-VolumesBackupsTest-118275719 None] backup MD5 for volume_72e07e1e-1567-4071-8204-c29cb26d2660/20260703094710/az_nova_backup_eba702ee-9959-40fe-9093-1eecff8dbaa6-00027: a31179c9f17d2086e474bbff2d8b9fa5 {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 09:47:12.507139 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-c0b6bb1f-d91f-43e7-be98-b7740c01c433 tempest-VolumesBackupsTest-118275719 None] Calling eventlet.sleep(0) {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 09:47:12.507320 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-c0b6bb1f-d91f-43e7-be98-b7740c01c433 tempest-VolumesBackupsTest-118275719 None] Backing up chunk of data from volume. {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 09:47:12.510702 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-c0b6bb1f-d91f-43e7-be98-b7740c01c433 tempest-VolumesBackupsTest-118275719 None] Compressed 98304 bytes of data to 16089 bytes using zlib. {{(pid=101319) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 09:47:12.510869 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-c0b6bb1f-d91f-43e7-be98-b7740c01c433 tempest-VolumesBackupsTest-118275719 None] About to put_object {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 09:47:12.545081 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-c0b6bb1f-d91f-43e7-be98-b7740c01c433 tempest-VolumesBackupsTest-118275719 None] backup MD5 for volume_72e07e1e-1567-4071-8204-c29cb26d2660/20260703094710/az_nova_backup_eba702ee-9959-40fe-9093-1eecff8dbaa6-00028: 86d6719d73ca0214c25634aedc7fe9d9 {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 09:47:12.545856 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-c0b6bb1f-d91f-43e7-be98-b7740c01c433 tempest-VolumesBackupsTest-118275719 None] Calling eventlet.sleep(0) {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 09:47:12.545856 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-c0b6bb1f-d91f-43e7-be98-b7740c01c433 tempest-VolumesBackupsTest-118275719 None] Backing up chunk of data from volume. {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 09:47:12.549569 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-c0b6bb1f-d91f-43e7-be98-b7740c01c433 tempest-VolumesBackupsTest-118275719 None] Compressed 98304 bytes of data to 19002 bytes using zlib. {{(pid=101319) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 09:47:12.549569 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-c0b6bb1f-d91f-43e7-be98-b7740c01c433 tempest-VolumesBackupsTest-118275719 None] About to put_object {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 09:47:12.600350 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-c0b6bb1f-d91f-43e7-be98-b7740c01c433 tempest-VolumesBackupsTest-118275719 None] backup MD5 for volume_72e07e1e-1567-4071-8204-c29cb26d2660/20260703094710/az_nova_backup_eba702ee-9959-40fe-9093-1eecff8dbaa6-00029: fdf44fcafc023cb46fe41182b8e073b8 {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 09:47:12.600350 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-c0b6bb1f-d91f-43e7-be98-b7740c01c433 tempest-VolumesBackupsTest-118275719 None] Calling eventlet.sleep(0) {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 09:47:12.600350 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-c0b6bb1f-d91f-43e7-be98-b7740c01c433 tempest-VolumesBackupsTest-118275719 None] Backing up chunk of data from volume. {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 09:47:12.628743 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-c0b6bb1f-d91f-43e7-be98-b7740c01c433 tempest-VolumesBackupsTest-118275719 None] Compressed 524288 bytes of data to 110895 bytes using zlib. {{(pid=101319) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 09:47:12.628743 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-c0b6bb1f-d91f-43e7-be98-b7740c01c433 tempest-VolumesBackupsTest-118275719 None] About to put_object {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 09:47:12.686183 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-c0b6bb1f-d91f-43e7-be98-b7740c01c433 tempest-VolumesBackupsTest-118275719 None] backup MD5 for volume_72e07e1e-1567-4071-8204-c29cb26d2660/20260703094710/az_nova_backup_eba702ee-9959-40fe-9093-1eecff8dbaa6-00030: 5815c96da9bc9be47f2dde7f69ddd130 {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 09:47:12.686311 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-c0b6bb1f-d91f-43e7-be98-b7740c01c433 tempest-VolumesBackupsTest-118275719 None] Calling eventlet.sleep(0) {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 09:47:12.686608 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-c0b6bb1f-d91f-43e7-be98-b7740c01c433 tempest-VolumesBackupsTest-118275719 None] Backing up chunk of data from volume. {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 09:47:12.693461 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-c0b6bb1f-d91f-43e7-be98-b7740c01c433 tempest-VolumesBackupsTest-118275719 None] Compressed 131072 bytes of data to 37108 bytes using zlib. {{(pid=101319) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 09:47:12.693751 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-c0b6bb1f-d91f-43e7-be98-b7740c01c433 tempest-VolumesBackupsTest-118275719 None] About to put_object {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 09:47:12.761207 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-c0b6bb1f-d91f-43e7-be98-b7740c01c433 tempest-VolumesBackupsTest-118275719 None] backup MD5 for volume_72e07e1e-1567-4071-8204-c29cb26d2660/20260703094710/az_nova_backup_eba702ee-9959-40fe-9093-1eecff8dbaa6-00031: 7ecd5b62ea9a77dd27d5058cc0b2af3a {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 09:47:12.761787 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-c0b6bb1f-d91f-43e7-be98-b7740c01c433 tempest-VolumesBackupsTest-118275719 None] Calling eventlet.sleep(0) {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 09:47:12.762004 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-c0b6bb1f-d91f-43e7-be98-b7740c01c433 tempest-VolumesBackupsTest-118275719 None] Backing up chunk of data from volume. {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 09:47:12.773798 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-c0b6bb1f-d91f-43e7-be98-b7740c01c433 tempest-VolumesBackupsTest-118275719 None] Compressed 294912 bytes of data to 57886 bytes using zlib. {{(pid=101319) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 09:47:12.773798 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-c0b6bb1f-d91f-43e7-be98-b7740c01c433 tempest-VolumesBackupsTest-118275719 None] About to put_object {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 09:47:12.815550 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-c0b6bb1f-d91f-43e7-be98-b7740c01c433 tempest-VolumesBackupsTest-118275719 None] backup MD5 for volume_72e07e1e-1567-4071-8204-c29cb26d2660/20260703094710/az_nova_backup_eba702ee-9959-40fe-9093-1eecff8dbaa6-00032: 185eea5b60ee84638ea2ef67b051e400 {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 09:47:12.815767 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-c0b6bb1f-d91f-43e7-be98-b7740c01c433 tempest-VolumesBackupsTest-118275719 None] Calling eventlet.sleep(0) {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 09:47:12.816058 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-c0b6bb1f-d91f-43e7-be98-b7740c01c433 tempest-VolumesBackupsTest-118275719 None] Backing up chunk of data from volume. {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 09:47:12.818230 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-c0b6bb1f-d91f-43e7-be98-b7740c01c433 tempest-VolumesBackupsTest-118275719 None] Compressed 32768 bytes of data to 6526 bytes using zlib. {{(pid=101319) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 09:47:12.818429 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-c0b6bb1f-d91f-43e7-be98-b7740c01c433 tempest-VolumesBackupsTest-118275719 None] About to put_object {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 09:47:12.866326 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-c0b6bb1f-d91f-43e7-be98-b7740c01c433 tempest-VolumesBackupsTest-118275719 None] backup MD5 for volume_72e07e1e-1567-4071-8204-c29cb26d2660/20260703094710/az_nova_backup_eba702ee-9959-40fe-9093-1eecff8dbaa6-00033: e41a77e44d240ad8104d5fb9712151e4 {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 09:47:12.866326 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-c0b6bb1f-d91f-43e7-be98-b7740c01c433 tempest-VolumesBackupsTest-118275719 None] Calling eventlet.sleep(0) {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 09:47:12.873615 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-c0b6bb1f-d91f-43e7-be98-b7740c01c433 tempest-VolumesBackupsTest-118275719 None] Backing up chunk of data from volume. {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 09:47:12.873615 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-c0b6bb1f-d91f-43e7-be98-b7740c01c433 tempest-VolumesBackupsTest-118275719 None] Compressed 65536 bytes of data to 14907 bytes using zlib. {{(pid=101319) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 09:47:12.873615 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-c0b6bb1f-d91f-43e7-be98-b7740c01c433 tempest-VolumesBackupsTest-118275719 None] About to put_object {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 09:47:12.962327 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-c0b6bb1f-d91f-43e7-be98-b7740c01c433 tempest-VolumesBackupsTest-118275719 None] backup MD5 for volume_72e07e1e-1567-4071-8204-c29cb26d2660/20260703094710/az_nova_backup_eba702ee-9959-40fe-9093-1eecff8dbaa6-00034: a7a0eee90ff873fe50f294cf33e7de2d {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 09:47:12.962327 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-c0b6bb1f-d91f-43e7-be98-b7740c01c433 tempest-VolumesBackupsTest-118275719 None] Calling eventlet.sleep(0) {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 09:47:12.962327 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-c0b6bb1f-d91f-43e7-be98-b7740c01c433 tempest-VolumesBackupsTest-118275719 None] Backing up chunk of data from volume. {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 09:47:12.968469 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-c0b6bb1f-d91f-43e7-be98-b7740c01c433 tempest-VolumesBackupsTest-118275719 None] Compressed 65536 bytes of data to 32515 bytes using zlib. {{(pid=101319) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 09:47:12.968469 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-c0b6bb1f-d91f-43e7-be98-b7740c01c433 tempest-VolumesBackupsTest-118275719 None] About to put_object {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 09:47:13.015869 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-c0b6bb1f-d91f-43e7-be98-b7740c01c433 tempest-VolumesBackupsTest-118275719 None] backup MD5 for volume_72e07e1e-1567-4071-8204-c29cb26d2660/20260703094710/az_nova_backup_eba702ee-9959-40fe-9093-1eecff8dbaa6-00035: 5a96fd0be63a553958c90d4a4316c4de {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 09:47:13.015869 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-c0b6bb1f-d91f-43e7-be98-b7740c01c433 tempest-VolumesBackupsTest-118275719 None] Calling eventlet.sleep(0) {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 09:47:13.015869 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-c0b6bb1f-d91f-43e7-be98-b7740c01c433 tempest-VolumesBackupsTest-118275719 None] Backing up chunk of data from volume. {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 09:47:13.019006 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-c0b6bb1f-d91f-43e7-be98-b7740c01c433 tempest-VolumesBackupsTest-118275719 None] Compressed 98304 bytes of data to 13305 bytes using zlib. {{(pid=101319) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 09:47:13.019006 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-c0b6bb1f-d91f-43e7-be98-b7740c01c433 tempest-VolumesBackupsTest-118275719 None] About to put_object {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 09:47:13.065766 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-c0b6bb1f-d91f-43e7-be98-b7740c01c433 tempest-VolumesBackupsTest-118275719 None] backup MD5 for volume_72e07e1e-1567-4071-8204-c29cb26d2660/20260703094710/az_nova_backup_eba702ee-9959-40fe-9093-1eecff8dbaa6-00036: b02b4173598f30151430937bc55a6faf {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 09:47:13.065766 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-c0b6bb1f-d91f-43e7-be98-b7740c01c433 tempest-VolumesBackupsTest-118275719 None] Calling eventlet.sleep(0) {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 09:47:13.065766 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-c0b6bb1f-d91f-43e7-be98-b7740c01c433 tempest-VolumesBackupsTest-118275719 None] Backing up chunk of data from volume. {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 09:47:13.080050 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-c0b6bb1f-d91f-43e7-be98-b7740c01c433 tempest-VolumesBackupsTest-118275719 None] Compressed 262144 bytes of data to 90046 bytes using zlib. {{(pid=101319) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 09:47:13.080596 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-c0b6bb1f-d91f-43e7-be98-b7740c01c433 tempest-VolumesBackupsTest-118275719 None] About to put_object {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 09:47:13.121204 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-c0b6bb1f-d91f-43e7-be98-b7740c01c433 tempest-VolumesBackupsTest-118275719 None] backup MD5 for volume_72e07e1e-1567-4071-8204-c29cb26d2660/20260703094710/az_nova_backup_eba702ee-9959-40fe-9093-1eecff8dbaa6-00037: b7e2d07e021e740544325541d67b7329 {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 09:47:13.121466 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-c0b6bb1f-d91f-43e7-be98-b7740c01c433 tempest-VolumesBackupsTest-118275719 None] Calling eventlet.sleep(0) {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 09:47:13.121816 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-c0b6bb1f-d91f-43e7-be98-b7740c01c433 tempest-VolumesBackupsTest-118275719 None] Backing up chunk of data from volume. {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 09:47:13.123595 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-c0b6bb1f-d91f-43e7-be98-b7740c01c433 tempest-VolumesBackupsTest-118275719 None] Compressed 32768 bytes of data to 2818 bytes using zlib. {{(pid=101319) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 09:47:13.123746 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-c0b6bb1f-d91f-43e7-be98-b7740c01c433 tempest-VolumesBackupsTest-118275719 None] About to put_object {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 09:47:13.147231 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-c0b6bb1f-d91f-43e7-be98-b7740c01c433 tempest-VolumesBackupsTest-118275719 None] backup MD5 for volume_72e07e1e-1567-4071-8204-c29cb26d2660/20260703094710/az_nova_backup_eba702ee-9959-40fe-9093-1eecff8dbaa6-00038: 00fb2cc13328ca425a2eca1e6c7c4e6d {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 09:47:13.147393 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-c0b6bb1f-d91f-43e7-be98-b7740c01c433 tempest-VolumesBackupsTest-118275719 None] Calling eventlet.sleep(0) {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 09:47:13.147621 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-c0b6bb1f-d91f-43e7-be98-b7740c01c433 tempest-VolumesBackupsTest-118275719 None] Backing up chunk of data from volume. {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 09:47:13.148905 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-c0b6bb1f-d91f-43e7-be98-b7740c01c433 tempest-VolumesBackupsTest-118275719 None] Compressed 32768 bytes of data to 5756 bytes using zlib. {{(pid=101319) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 09:47:13.149020 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-c0b6bb1f-d91f-43e7-be98-b7740c01c433 tempest-VolumesBackupsTest-118275719 None] About to put_object {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 09:47:13.179383 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-c0b6bb1f-d91f-43e7-be98-b7740c01c433 tempest-VolumesBackupsTest-118275719 None] backup MD5 for volume_72e07e1e-1567-4071-8204-c29cb26d2660/20260703094710/az_nova_backup_eba702ee-9959-40fe-9093-1eecff8dbaa6-00039: d11036511ad7f5dbe776a742c58f87ea {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 09:47:13.179632 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-c0b6bb1f-d91f-43e7-be98-b7740c01c433 tempest-VolumesBackupsTest-118275719 None] Calling eventlet.sleep(0) {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 09:47:13.179868 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-c0b6bb1f-d91f-43e7-be98-b7740c01c433 tempest-VolumesBackupsTest-118275719 None] Backing up chunk of data from volume. {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 09:47:13.180786 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-c0b6bb1f-d91f-43e7-be98-b7740c01c433 tempest-VolumesBackupsTest-118275719 None] Compressed 32768 bytes of data to 1906 bytes using zlib. {{(pid=101319) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 09:47:13.180966 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-c0b6bb1f-d91f-43e7-be98-b7740c01c433 tempest-VolumesBackupsTest-118275719 None] About to put_object {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 09:47:13.206298 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-c0b6bb1f-d91f-43e7-be98-b7740c01c433 tempest-VolumesBackupsTest-118275719 None] backup MD5 for volume_72e07e1e-1567-4071-8204-c29cb26d2660/20260703094710/az_nova_backup_eba702ee-9959-40fe-9093-1eecff8dbaa6-00040: c4ed5bf65e3847ac3a3103aeb9f043f9 {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 09:47:13.206463 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-c0b6bb1f-d91f-43e7-be98-b7740c01c433 tempest-VolumesBackupsTest-118275719 None] Calling eventlet.sleep(0) {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 09:47:13.206664 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-c0b6bb1f-d91f-43e7-be98-b7740c01c433 tempest-VolumesBackupsTest-118275719 None] Backing up chunk of data from volume. {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 09:47:13.208307 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-c0b6bb1f-d91f-43e7-be98-b7740c01c433 tempest-VolumesBackupsTest-118275719 None] Compressed 32768 bytes of data to 6858 bytes using zlib. {{(pid=101319) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 09:47:13.208493 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-c0b6bb1f-d91f-43e7-be98-b7740c01c433 tempest-VolumesBackupsTest-118275719 None] About to put_object {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 09:47:13.232436 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-c0b6bb1f-d91f-43e7-be98-b7740c01c433 tempest-VolumesBackupsTest-118275719 None] backup MD5 for volume_72e07e1e-1567-4071-8204-c29cb26d2660/20260703094710/az_nova_backup_eba702ee-9959-40fe-9093-1eecff8dbaa6-00041: 2abba25a77ee36c58131400ef11e9b33 {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 09:47:13.232634 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-c0b6bb1f-d91f-43e7-be98-b7740c01c433 tempest-VolumesBackupsTest-118275719 None] Calling eventlet.sleep(0) {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 09:47:13.232832 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-c0b6bb1f-d91f-43e7-be98-b7740c01c433 tempest-VolumesBackupsTest-118275719 None] Backing up chunk of data from volume. {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 09:47:13.235861 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-c0b6bb1f-d91f-43e7-be98-b7740c01c433 tempest-VolumesBackupsTest-118275719 None] Compressed 65536 bytes of data to 15768 bytes using zlib. {{(pid=101319) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 09:47:13.235983 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-c0b6bb1f-d91f-43e7-be98-b7740c01c433 tempest-VolumesBackupsTest-118275719 None] About to put_object {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 09:47:13.274136 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-c0b6bb1f-d91f-43e7-be98-b7740c01c433 tempest-VolumesBackupsTest-118275719 None] backup MD5 for volume_72e07e1e-1567-4071-8204-c29cb26d2660/20260703094710/az_nova_backup_eba702ee-9959-40fe-9093-1eecff8dbaa6-00042: 58c33934aea3dc04d999003f5971d3e1 {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 09:47:13.274413 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-c0b6bb1f-d91f-43e7-be98-b7740c01c433 tempest-VolumesBackupsTest-118275719 None] Calling eventlet.sleep(0) {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 09:47:13.274729 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-c0b6bb1f-d91f-43e7-be98-b7740c01c433 tempest-VolumesBackupsTest-118275719 None] Backing up chunk of data from volume. {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 09:47:13.277597 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-c0b6bb1f-d91f-43e7-be98-b7740c01c433 tempest-VolumesBackupsTest-118275719 None] Compressed 65536 bytes of data to 10944 bytes using zlib. {{(pid=101319) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 09:47:13.277780 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-c0b6bb1f-d91f-43e7-be98-b7740c01c433 tempest-VolumesBackupsTest-118275719 None] About to put_object {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 09:47:13.318430 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-c0b6bb1f-d91f-43e7-be98-b7740c01c433 tempest-VolumesBackupsTest-118275719 None] backup MD5 for volume_72e07e1e-1567-4071-8204-c29cb26d2660/20260703094710/az_nova_backup_eba702ee-9959-40fe-9093-1eecff8dbaa6-00043: 90971d6560092661366d4a8e0d690316 {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 09:47:13.318677 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-c0b6bb1f-d91f-43e7-be98-b7740c01c433 tempest-VolumesBackupsTest-118275719 None] Calling eventlet.sleep(0) {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 09:47:13.318902 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-c0b6bb1f-d91f-43e7-be98-b7740c01c433 tempest-VolumesBackupsTest-118275719 None] Backing up chunk of data from volume. {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 09:47:13.320360 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-c0b6bb1f-d91f-43e7-be98-b7740c01c433 tempest-VolumesBackupsTest-118275719 None] Compressed 32768 bytes of data to 5153 bytes using zlib. {{(pid=101319) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 09:47:13.320513 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-c0b6bb1f-d91f-43e7-be98-b7740c01c433 tempest-VolumesBackupsTest-118275719 None] About to put_object {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 09:47:13.358466 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-c0b6bb1f-d91f-43e7-be98-b7740c01c433 tempest-VolumesBackupsTest-118275719 None] backup MD5 for volume_72e07e1e-1567-4071-8204-c29cb26d2660/20260703094710/az_nova_backup_eba702ee-9959-40fe-9093-1eecff8dbaa6-00044: 6d63cabe5cbd45d0e7748b702fb3237f {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 09:47:13.358677 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-c0b6bb1f-d91f-43e7-be98-b7740c01c433 tempest-VolumesBackupsTest-118275719 None] Calling eventlet.sleep(0) {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 09:47:13.359099 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-c0b6bb1f-d91f-43e7-be98-b7740c01c433 tempest-VolumesBackupsTest-118275719 None] Backing up chunk of data from volume. {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 09:47:13.367324 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-c0b6bb1f-d91f-43e7-be98-b7740c01c433 tempest-VolumesBackupsTest-118275719 None] Compressed 229376 bytes of data to 56731 bytes using zlib. {{(pid=101319) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 09:47:13.367468 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-c0b6bb1f-d91f-43e7-be98-b7740c01c433 tempest-VolumesBackupsTest-118275719 None] About to put_object {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 09:47:13.451431 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-c0b6bb1f-d91f-43e7-be98-b7740c01c433 tempest-VolumesBackupsTest-118275719 None] backup MD5 for volume_72e07e1e-1567-4071-8204-c29cb26d2660/20260703094710/az_nova_backup_eba702ee-9959-40fe-9093-1eecff8dbaa6-00045: b63363b73e33269b13a4b9007772caea {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 09:47:13.451431 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-c0b6bb1f-d91f-43e7-be98-b7740c01c433 tempest-VolumesBackupsTest-118275719 None] Calling eventlet.sleep(0) {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 09:47:13.721917 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-c0b6bb1f-d91f-43e7-be98-b7740c01c433 tempest-VolumesBackupsTest-118275719 None] Backing up chunk of data from volume. {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 09:47:13.723153 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-c0b6bb1f-d91f-43e7-be98-b7740c01c433 tempest-VolumesBackupsTest-118275719 None] Compressed 32768 bytes of data to 6383 bytes using zlib. {{(pid=101319) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 09:47:13.723346 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-c0b6bb1f-d91f-43e7-be98-b7740c01c433 tempest-VolumesBackupsTest-118275719 None] About to put_object {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 09:47:13.842824 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-c0b6bb1f-d91f-43e7-be98-b7740c01c433 tempest-VolumesBackupsTest-118275719 None] backup MD5 for volume_72e07e1e-1567-4071-8204-c29cb26d2660/20260703094710/az_nova_backup_eba702ee-9959-40fe-9093-1eecff8dbaa6-00046: 7ad27b3399ebe8e17313a1edd45d2a4c {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 09:47:13.843135 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-c0b6bb1f-d91f-43e7-be98-b7740c01c433 tempest-VolumesBackupsTest-118275719 None] Calling eventlet.sleep(0) {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 09:47:13.843135 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-c0b6bb1f-d91f-43e7-be98-b7740c01c433 tempest-VolumesBackupsTest-118275719 None] Backing up chunk of data from volume. {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 09:47:13.846493 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-c0b6bb1f-d91f-43e7-be98-b7740c01c433 tempest-VolumesBackupsTest-118275719 None] Compressed 65536 bytes of data to 29648 bytes using zlib. {{(pid=101319) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 09:47:13.846662 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-c0b6bb1f-d91f-43e7-be98-b7740c01c433 tempest-VolumesBackupsTest-118275719 None] About to put_object {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 09:47:13.959575 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-c0b6bb1f-d91f-43e7-be98-b7740c01c433 tempest-VolumesBackupsTest-118275719 None] backup MD5 for volume_72e07e1e-1567-4071-8204-c29cb26d2660/20260703094710/az_nova_backup_eba702ee-9959-40fe-9093-1eecff8dbaa6-00047: b2f4bed0ea8034625ddd32034addd197 {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 09:47:13.959575 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-c0b6bb1f-d91f-43e7-be98-b7740c01c433 tempest-VolumesBackupsTest-118275719 None] Calling eventlet.sleep(0) {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 09:47:13.959575 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-c0b6bb1f-d91f-43e7-be98-b7740c01c433 tempest-VolumesBackupsTest-118275719 None] Backing up chunk of data from volume. {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 09:47:13.959575 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-c0b6bb1f-d91f-43e7-be98-b7740c01c433 tempest-VolumesBackupsTest-118275719 None] Compressed 65536 bytes of data to 11536 bytes using zlib. {{(pid=101319) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 09:47:13.959575 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-c0b6bb1f-d91f-43e7-be98-b7740c01c433 tempest-VolumesBackupsTest-118275719 None] About to put_object {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 09:47:14.073865 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-c0b6bb1f-d91f-43e7-be98-b7740c01c433 tempest-VolumesBackupsTest-118275719 None] backup MD5 for volume_72e07e1e-1567-4071-8204-c29cb26d2660/20260703094710/az_nova_backup_eba702ee-9959-40fe-9093-1eecff8dbaa6-00048: e2ae44a38272f3786b389fe25de025f7 {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 09:47:14.073865 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-c0b6bb1f-d91f-43e7-be98-b7740c01c433 tempest-VolumesBackupsTest-118275719 None] Calling eventlet.sleep(0) {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 09:47:14.073865 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-c0b6bb1f-d91f-43e7-be98-b7740c01c433 tempest-VolumesBackupsTest-118275719 None] Backing up chunk of data from volume. {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 09:47:14.079584 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-c0b6bb1f-d91f-43e7-be98-b7740c01c433 tempest-VolumesBackupsTest-118275719 None] Compressed 131072 bytes of data to 60908 bytes using zlib. {{(pid=101319) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 09:47:14.079788 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-c0b6bb1f-d91f-43e7-be98-b7740c01c433 tempest-VolumesBackupsTest-118275719 None] About to put_object {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 09:47:14.163895 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-c0b6bb1f-d91f-43e7-be98-b7740c01c433 tempest-VolumesBackupsTest-118275719 None] backup MD5 for volume_72e07e1e-1567-4071-8204-c29cb26d2660/20260703094710/az_nova_backup_eba702ee-9959-40fe-9093-1eecff8dbaa6-00049: 459edd959d71fc76632140b2c1c2afd7 {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 09:47:14.163895 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-c0b6bb1f-d91f-43e7-be98-b7740c01c433 tempest-VolumesBackupsTest-118275719 None] Calling eventlet.sleep(0) {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 09:47:14.164658 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-c0b6bb1f-d91f-43e7-be98-b7740c01c433 tempest-VolumesBackupsTest-118275719 None] Backing up chunk of data from volume. {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 09:47:14.176834 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-c0b6bb1f-d91f-43e7-be98-b7740c01c433 tempest-VolumesBackupsTest-118275719 None] Compressed 262144 bytes of data to 49816 bytes using zlib. {{(pid=101319) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 09:47:14.176904 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-c0b6bb1f-d91f-43e7-be98-b7740c01c433 tempest-VolumesBackupsTest-118275719 None] About to put_object {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 09:47:14.221351 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-c0b6bb1f-d91f-43e7-be98-b7740c01c433 tempest-VolumesBackupsTest-118275719 None] backup MD5 for volume_72e07e1e-1567-4071-8204-c29cb26d2660/20260703094710/az_nova_backup_eba702ee-9959-40fe-9093-1eecff8dbaa6-00050: 9f03bd9a5f1f3681ce923853068a5391 {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 09:47:14.221610 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-c0b6bb1f-d91f-43e7-be98-b7740c01c433 tempest-VolumesBackupsTest-118275719 None] Calling eventlet.sleep(0) {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 09:47:14.222029 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-c0b6bb1f-d91f-43e7-be98-b7740c01c433 tempest-VolumesBackupsTest-118275719 None] Backing up chunk of data from volume. {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 09:47:14.222992 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-c0b6bb1f-d91f-43e7-be98-b7740c01c433 tempest-VolumesBackupsTest-118275719 None] Compressed 32768 bytes of data to 3271 bytes using zlib. {{(pid=101319) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 09:47:14.223236 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-c0b6bb1f-d91f-43e7-be98-b7740c01c433 tempest-VolumesBackupsTest-118275719 None] About to put_object {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 09:47:14.264491 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-c0b6bb1f-d91f-43e7-be98-b7740c01c433 tempest-VolumesBackupsTest-118275719 None] backup MD5 for volume_72e07e1e-1567-4071-8204-c29cb26d2660/20260703094710/az_nova_backup_eba702ee-9959-40fe-9093-1eecff8dbaa6-00051: 808b8e5ae0ebfa3ebee1f25e56d7380e {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 09:47:14.264722 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-c0b6bb1f-d91f-43e7-be98-b7740c01c433 tempest-VolumesBackupsTest-118275719 None] Calling eventlet.sleep(0) {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 09:47:14.267044 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-c0b6bb1f-d91f-43e7-be98-b7740c01c433 tempest-VolumesBackupsTest-118275719 None] Backing up chunk of data from volume. {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 09:47:14.359743 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-c0b6bb1f-d91f-43e7-be98-b7740c01c433 tempest-VolumesBackupsTest-118275719 None] Compressed 2162688 bytes of data to 713033 bytes using zlib. {{(pid=101319) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 09:47:14.360047 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-c0b6bb1f-d91f-43e7-be98-b7740c01c433 tempest-VolumesBackupsTest-118275719 None] About to put_object {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 09:47:14.419642 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-c0b6bb1f-d91f-43e7-be98-b7740c01c433 tempest-VolumesBackupsTest-118275719 None] backup MD5 for volume_72e07e1e-1567-4071-8204-c29cb26d2660/20260703094710/az_nova_backup_eba702ee-9959-40fe-9093-1eecff8dbaa6-00052: be8d468a957514fe7be30768655b7463 {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 09:47:14.419838 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-c0b6bb1f-d91f-43e7-be98-b7740c01c433 tempest-VolumesBackupsTest-118275719 None] Calling eventlet.sleep(0) {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 09:47:14.420803 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-c0b6bb1f-d91f-43e7-be98-b7740c01c433 tempest-VolumesBackupsTest-118275719 None] Backing up chunk of data from volume. {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 09:47:14.431223 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-c0b6bb1f-d91f-43e7-be98-b7740c01c433 tempest-VolumesBackupsTest-118275719 None] Compressed 131072 bytes of data to 49711 bytes using zlib. {{(pid=101319) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 09:47:14.431419 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-c0b6bb1f-d91f-43e7-be98-b7740c01c433 tempest-VolumesBackupsTest-118275719 None] About to put_object {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 09:47:14.462791 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-c0b6bb1f-d91f-43e7-be98-b7740c01c433 tempest-VolumesBackupsTest-118275719 None] backup MD5 for volume_72e07e1e-1567-4071-8204-c29cb26d2660/20260703094710/az_nova_backup_eba702ee-9959-40fe-9093-1eecff8dbaa6-00053: ac2c3b7f365746cfcedfa3644641f133 {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 09:47:14.462951 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-c0b6bb1f-d91f-43e7-be98-b7740c01c433 tempest-VolumesBackupsTest-118275719 None] Calling eventlet.sleep(0) {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 09:47:14.463460 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-c0b6bb1f-d91f-43e7-be98-b7740c01c433 tempest-VolumesBackupsTest-118275719 None] Backing up chunk of data from volume. {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 09:47:14.480198 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-c0b6bb1f-d91f-43e7-be98-b7740c01c433 tempest-VolumesBackupsTest-118275719 None] Compressed 262144 bytes of data to 109962 bytes using zlib. {{(pid=101319) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 09:47:14.480384 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-c0b6bb1f-d91f-43e7-be98-b7740c01c433 tempest-VolumesBackupsTest-118275719 None] About to put_object {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 09:47:14.521460 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-c0b6bb1f-d91f-43e7-be98-b7740c01c433 tempest-VolumesBackupsTest-118275719 None] backup MD5 for volume_72e07e1e-1567-4071-8204-c29cb26d2660/20260703094710/az_nova_backup_eba702ee-9959-40fe-9093-1eecff8dbaa6-00054: d4e16afa8ee08db846e947df5b4ec08b {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 09:47:14.521639 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-c0b6bb1f-d91f-43e7-be98-b7740c01c433 tempest-VolumesBackupsTest-118275719 None] Calling eventlet.sleep(0) {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 09:47:14.521949 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-c0b6bb1f-d91f-43e7-be98-b7740c01c433 tempest-VolumesBackupsTest-118275719 None] Backing up chunk of data from volume. {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 09:47:14.536036 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-c0b6bb1f-d91f-43e7-be98-b7740c01c433 tempest-VolumesBackupsTest-118275719 None] Compressed 196608 bytes of data to 106450 bytes using zlib. {{(pid=101319) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 09:47:14.536204 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-c0b6bb1f-d91f-43e7-be98-b7740c01c433 tempest-VolumesBackupsTest-118275719 None] About to put_object {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 09:47:14.575522 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-c0b6bb1f-d91f-43e7-be98-b7740c01c433 tempest-VolumesBackupsTest-118275719 None] backup MD5 for volume_72e07e1e-1567-4071-8204-c29cb26d2660/20260703094710/az_nova_backup_eba702ee-9959-40fe-9093-1eecff8dbaa6-00055: 86d6f3eb5f3f66b3bd977ec8c039a49c {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 09:47:14.575716 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-c0b6bb1f-d91f-43e7-be98-b7740c01c433 tempest-VolumesBackupsTest-118275719 None] Calling eventlet.sleep(0) {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 09:47:14.575987 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-c0b6bb1f-d91f-43e7-be98-b7740c01c433 tempest-VolumesBackupsTest-118275719 None] Backing up chunk of data from volume. {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 09:47:14.583753 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-c0b6bb1f-d91f-43e7-be98-b7740c01c433 tempest-VolumesBackupsTest-118275719 None] Compressed 196608 bytes of data to 59932 bytes using zlib. {{(pid=101319) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 09:47:14.583881 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-c0b6bb1f-d91f-43e7-be98-b7740c01c433 tempest-VolumesBackupsTest-118275719 None] About to put_object {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 09:47:14.625628 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-c0b6bb1f-d91f-43e7-be98-b7740c01c433 tempest-VolumesBackupsTest-118275719 None] backup MD5 for volume_72e07e1e-1567-4071-8204-c29cb26d2660/20260703094710/az_nova_backup_eba702ee-9959-40fe-9093-1eecff8dbaa6-00056: 933534e51561c890b382aa9eb4c5764c {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 09:47:14.627093 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-c0b6bb1f-d91f-43e7-be98-b7740c01c433 tempest-VolumesBackupsTest-118275719 None] Calling eventlet.sleep(0) {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 09:47:14.627093 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-c0b6bb1f-d91f-43e7-be98-b7740c01c433 tempest-VolumesBackupsTest-118275719 None] Backing up chunk of data from volume. {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 09:47:14.627635 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-c0b6bb1f-d91f-43e7-be98-b7740c01c433 tempest-VolumesBackupsTest-118275719 None] Compressed 32768 bytes of data to 9062 bytes using zlib. {{(pid=101319) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 09:47:14.627819 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-c0b6bb1f-d91f-43e7-be98-b7740c01c433 tempest-VolumesBackupsTest-118275719 None] About to put_object {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 09:47:14.683496 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-c0b6bb1f-d91f-43e7-be98-b7740c01c433 tempest-VolumesBackupsTest-118275719 None] backup MD5 for volume_72e07e1e-1567-4071-8204-c29cb26d2660/20260703094710/az_nova_backup_eba702ee-9959-40fe-9093-1eecff8dbaa6-00057: 0f7cdc5b89fbb7316ab86f111715879e {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 09:47:14.683496 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-c0b6bb1f-d91f-43e7-be98-b7740c01c433 tempest-VolumesBackupsTest-118275719 None] Calling eventlet.sleep(0) {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 09:47:14.683496 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-c0b6bb1f-d91f-43e7-be98-b7740c01c433 tempest-VolumesBackupsTest-118275719 None] Backing up chunk of data from volume. {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 09:47:14.685962 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-c0b6bb1f-d91f-43e7-be98-b7740c01c433 tempest-VolumesBackupsTest-118275719 None] Compressed 65536 bytes of data to 23335 bytes using zlib. {{(pid=101319) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 09:47:14.686121 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-c0b6bb1f-d91f-43e7-be98-b7740c01c433 tempest-VolumesBackupsTest-118275719 None] About to put_object {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 09:47:14.719019 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-c0b6bb1f-d91f-43e7-be98-b7740c01c433 tempest-VolumesBackupsTest-118275719 None] backup MD5 for volume_72e07e1e-1567-4071-8204-c29cb26d2660/20260703094710/az_nova_backup_eba702ee-9959-40fe-9093-1eecff8dbaa6-00058: b3534e7bd21436d93d6e15ceae51ecbb {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 09:47:14.719019 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-c0b6bb1f-d91f-43e7-be98-b7740c01c433 tempest-VolumesBackupsTest-118275719 None] Calling eventlet.sleep(0) {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 09:47:14.719562 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-c0b6bb1f-d91f-43e7-be98-b7740c01c433 tempest-VolumesBackupsTest-118275719 None] Backing up chunk of data from volume. {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 09:47:14.724916 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-c0b6bb1f-d91f-43e7-be98-b7740c01c433 tempest-VolumesBackupsTest-118275719 None] Compressed 65536 bytes of data to 36991 bytes using zlib. {{(pid=101319) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 09:47:14.725383 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-c0b6bb1f-d91f-43e7-be98-b7740c01c433 tempest-VolumesBackupsTest-118275719 None] About to put_object {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 09:47:14.765313 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-c0b6bb1f-d91f-43e7-be98-b7740c01c433 tempest-VolumesBackupsTest-118275719 None] backup MD5 for volume_72e07e1e-1567-4071-8204-c29cb26d2660/20260703094710/az_nova_backup_eba702ee-9959-40fe-9093-1eecff8dbaa6-00059: 308e5172c7191c405029e68eb339b63e {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 09:47:14.765481 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-c0b6bb1f-d91f-43e7-be98-b7740c01c433 tempest-VolumesBackupsTest-118275719 None] Calling eventlet.sleep(0) {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 09:47:14.765699 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-c0b6bb1f-d91f-43e7-be98-b7740c01c433 tempest-VolumesBackupsTest-118275719 None] Backing up chunk of data from volume. {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 09:47:14.769086 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-c0b6bb1f-d91f-43e7-be98-b7740c01c433 tempest-VolumesBackupsTest-118275719 None] Compressed 98304 bytes of data to 27296 bytes using zlib. {{(pid=101319) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 09:47:14.769231 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-c0b6bb1f-d91f-43e7-be98-b7740c01c433 tempest-VolumesBackupsTest-118275719 None] About to put_object {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 09:47:14.818522 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-c0b6bb1f-d91f-43e7-be98-b7740c01c433 tempest-VolumesBackupsTest-118275719 None] backup MD5 for volume_72e07e1e-1567-4071-8204-c29cb26d2660/20260703094710/az_nova_backup_eba702ee-9959-40fe-9093-1eecff8dbaa6-00060: 87fed698449bb429c84cea142b47074f {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 09:47:14.818678 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-c0b6bb1f-d91f-43e7-be98-b7740c01c433 tempest-VolumesBackupsTest-118275719 None] Calling eventlet.sleep(0) {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 09:47:14.818870 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-c0b6bb1f-d91f-43e7-be98-b7740c01c433 tempest-VolumesBackupsTest-118275719 None] Backing up chunk of data from volume. {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 09:47:14.819857 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-c0b6bb1f-d91f-43e7-be98-b7740c01c433 tempest-VolumesBackupsTest-118275719 None] Compressed 32768 bytes of data to 6577 bytes using zlib. {{(pid=101319) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 09:47:14.819994 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-c0b6bb1f-d91f-43e7-be98-b7740c01c433 tempest-VolumesBackupsTest-118275719 None] About to put_object {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 09:47:14.880118 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-c0b6bb1f-d91f-43e7-be98-b7740c01c433 tempest-VolumesBackupsTest-118275719 None] backup MD5 for volume_72e07e1e-1567-4071-8204-c29cb26d2660/20260703094710/az_nova_backup_eba702ee-9959-40fe-9093-1eecff8dbaa6-00061: 8577057e39906809834d6bbe62984d84 {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 09:47:14.880522 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-c0b6bb1f-d91f-43e7-be98-b7740c01c433 tempest-VolumesBackupsTest-118275719 None] Calling eventlet.sleep(0) {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 09:47:14.882586 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-c0b6bb1f-d91f-43e7-be98-b7740c01c433 tempest-VolumesBackupsTest-118275719 None] Backing up chunk of data from volume. {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 09:47:14.983263 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-c0b6bb1f-d91f-43e7-be98-b7740c01c433 tempest-VolumesBackupsTest-118275719 None] Compressed 2162688 bytes of data to 835720 bytes using zlib. {{(pid=101319) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 09:47:14.983391 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-c0b6bb1f-d91f-43e7-be98-b7740c01c433 tempest-VolumesBackupsTest-118275719 None] About to put_object {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 09:47:15.053604 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-c0b6bb1f-d91f-43e7-be98-b7740c01c433 tempest-VolumesBackupsTest-118275719 None] backup MD5 for volume_72e07e1e-1567-4071-8204-c29cb26d2660/20260703094710/az_nova_backup_eba702ee-9959-40fe-9093-1eecff8dbaa6-00062: 286f32389d41ccb3a7454011b7fe833b {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 09:47:15.054005 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-c0b6bb1f-d91f-43e7-be98-b7740c01c433 tempest-VolumesBackupsTest-118275719 None] Calling eventlet.sleep(0) {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 09:47:15.055630 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-c0b6bb1f-d91f-43e7-be98-b7740c01c433 tempest-VolumesBackupsTest-118275719 None] Backing up chunk of data from volume. {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 09:47:15.060550 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-c0b6bb1f-d91f-43e7-be98-b7740c01c433 tempest-VolumesBackupsTest-118275719 None] Compressed 131072 bytes of data to 32835 bytes using zlib. {{(pid=101319) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 09:47:15.060812 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-c0b6bb1f-d91f-43e7-be98-b7740c01c433 tempest-VolumesBackupsTest-118275719 None] About to put_object {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 09:47:15.111207 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-c0b6bb1f-d91f-43e7-be98-b7740c01c433 tempest-VolumesBackupsTest-118275719 None] backup MD5 for volume_72e07e1e-1567-4071-8204-c29cb26d2660/20260703094710/az_nova_backup_eba702ee-9959-40fe-9093-1eecff8dbaa6-00063: 07f83a91f2a65593c97ccde75e2cdb1a {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 09:47:15.111355 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-c0b6bb1f-d91f-43e7-be98-b7740c01c433 tempest-VolumesBackupsTest-118275719 None] Calling eventlet.sleep(0) {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 09:47:15.111645 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-c0b6bb1f-d91f-43e7-be98-b7740c01c433 tempest-VolumesBackupsTest-118275719 None] Backing up chunk of data from volume. {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 09:47:15.112118 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-c0b6bb1f-d91f-43e7-be98-b7740c01c433 tempest-VolumesBackupsTest-118275719 None] Compressed 32768 bytes of data to 258 bytes using zlib. {{(pid=101319) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 09:47:15.112234 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-c0b6bb1f-d91f-43e7-be98-b7740c01c433 tempest-VolumesBackupsTest-118275719 None] About to put_object {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 09:47:15.143471 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-c0b6bb1f-d91f-43e7-be98-b7740c01c433 tempest-VolumesBackupsTest-118275719 None] backup MD5 for volume_72e07e1e-1567-4071-8204-c29cb26d2660/20260703094710/az_nova_backup_eba702ee-9959-40fe-9093-1eecff8dbaa6-00064: 472694eb9fd935b65a675e05db84ae55 {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 09:47:15.143622 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-c0b6bb1f-d91f-43e7-be98-b7740c01c433 tempest-VolumesBackupsTest-118275719 None] Calling eventlet.sleep(0) {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 09:47:15.143936 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-c0b6bb1f-d91f-43e7-be98-b7740c01c433 tempest-VolumesBackupsTest-118275719 None] Backing up chunk of data from volume. {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 09:47:15.153304 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-c0b6bb1f-d91f-43e7-be98-b7740c01c433 tempest-VolumesBackupsTest-118275719 None] Compressed 163840 bytes of data to 60928 bytes using zlib. {{(pid=101319) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 09:47:15.155082 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-c0b6bb1f-d91f-43e7-be98-b7740c01c433 tempest-VolumesBackupsTest-118275719 None] About to put_object {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 09:47:15.190018 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-c0b6bb1f-d91f-43e7-be98-b7740c01c433 tempest-VolumesBackupsTest-118275719 None] backup MD5 for volume_72e07e1e-1567-4071-8204-c29cb26d2660/20260703094710/az_nova_backup_eba702ee-9959-40fe-9093-1eecff8dbaa6-00065: 7bbd91225a7ad728f1ee251495d662a3 {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 09:47:15.190141 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-c0b6bb1f-d91f-43e7-be98-b7740c01c433 tempest-VolumesBackupsTest-118275719 None] Calling eventlet.sleep(0) {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 09:47:15.190511 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-c0b6bb1f-d91f-43e7-be98-b7740c01c433 tempest-VolumesBackupsTest-118275719 None] Backing up chunk of data from volume. {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 09:47:15.200358 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-c0b6bb1f-d91f-43e7-be98-b7740c01c433 tempest-VolumesBackupsTest-118275719 None] Compressed 196608 bytes of data to 89811 bytes using zlib. {{(pid=101319) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 09:47:15.201652 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-c0b6bb1f-d91f-43e7-be98-b7740c01c433 tempest-VolumesBackupsTest-118275719 None] About to put_object {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 09:47:15.234207 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-c0b6bb1f-d91f-43e7-be98-b7740c01c433 tempest-VolumesBackupsTest-118275719 None] backup MD5 for volume_72e07e1e-1567-4071-8204-c29cb26d2660/20260703094710/az_nova_backup_eba702ee-9959-40fe-9093-1eecff8dbaa6-00066: 9c2c443a510acae20e828ca784ea0ef0 {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 09:47:15.234479 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-c0b6bb1f-d91f-43e7-be98-b7740c01c433 tempest-VolumesBackupsTest-118275719 None] Calling eventlet.sleep(0) {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 09:47:15.234772 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-c0b6bb1f-d91f-43e7-be98-b7740c01c433 tempest-VolumesBackupsTest-118275719 None] Backing up chunk of data from volume. {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 09:47:15.236255 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-c0b6bb1f-d91f-43e7-be98-b7740c01c433 tempest-VolumesBackupsTest-118275719 None] Compressed 32768 bytes of data to 10326 bytes using zlib. {{(pid=101319) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 09:47:15.236449 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-c0b6bb1f-d91f-43e7-be98-b7740c01c433 tempest-VolumesBackupsTest-118275719 None] About to put_object {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 09:47:15.269060 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-c0b6bb1f-d91f-43e7-be98-b7740c01c433 tempest-VolumesBackupsTest-118275719 None] backup MD5 for volume_72e07e1e-1567-4071-8204-c29cb26d2660/20260703094710/az_nova_backup_eba702ee-9959-40fe-9093-1eecff8dbaa6-00067: f15596026d78fb5a6c33e31e645c1bc0 {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 09:47:15.269434 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-c0b6bb1f-d91f-43e7-be98-b7740c01c433 tempest-VolumesBackupsTest-118275719 None] Calling eventlet.sleep(0) {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 09:47:15.269475 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-c0b6bb1f-d91f-43e7-be98-b7740c01c433 tempest-VolumesBackupsTest-118275719 None] Backing up chunk of data from volume. {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 09:47:15.274217 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-c0b6bb1f-d91f-43e7-be98-b7740c01c433 tempest-VolumesBackupsTest-118275719 None] Compressed 131072 bytes of data to 31811 bytes using zlib. {{(pid=101319) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 09:47:15.274390 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-c0b6bb1f-d91f-43e7-be98-b7740c01c433 tempest-VolumesBackupsTest-118275719 None] About to put_object {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 09:47:15.333198 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-c0b6bb1f-d91f-43e7-be98-b7740c01c433 tempest-VolumesBackupsTest-118275719 None] backup MD5 for volume_72e07e1e-1567-4071-8204-c29cb26d2660/20260703094710/az_nova_backup_eba702ee-9959-40fe-9093-1eecff8dbaa6-00068: 01e07b6ff49d49600cff2b5f037b5585 {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 09:47:15.333375 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-c0b6bb1f-d91f-43e7-be98-b7740c01c433 tempest-VolumesBackupsTest-118275719 None] Calling eventlet.sleep(0) {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 09:47:15.333726 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-c0b6bb1f-d91f-43e7-be98-b7740c01c433 tempest-VolumesBackupsTest-118275719 None] Backing up chunk of data from volume. {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 09:47:15.351768 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-c0b6bb1f-d91f-43e7-be98-b7740c01c433 tempest-VolumesBackupsTest-118275719 None] Compressed 196608 bytes of data to 99152 bytes using zlib. {{(pid=101319) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 09:47:15.351956 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-c0b6bb1f-d91f-43e7-be98-b7740c01c433 tempest-VolumesBackupsTest-118275719 None] About to put_object {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 09:47:15.387558 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-c0b6bb1f-d91f-43e7-be98-b7740c01c433 tempest-VolumesBackupsTest-118275719 None] backup MD5 for volume_72e07e1e-1567-4071-8204-c29cb26d2660/20260703094710/az_nova_backup_eba702ee-9959-40fe-9093-1eecff8dbaa6-00069: 2cc1e5bb8b0f7f6b8f396071b242c82d {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 09:47:15.387726 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-c0b6bb1f-d91f-43e7-be98-b7740c01c433 tempest-VolumesBackupsTest-118275719 None] Calling eventlet.sleep(0) {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 09:47:15.389531 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-c0b6bb1f-d91f-43e7-be98-b7740c01c433 tempest-VolumesBackupsTest-118275719 None] Backing up chunk of data from volume. {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 09:47:15.506828 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-c0b6bb1f-d91f-43e7-be98-b7740c01c433 tempest-VolumesBackupsTest-118275719 None] Compressed 2555904 bytes of data to 1042244 bytes using zlib. {{(pid=101319) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 09:47:15.506828 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-c0b6bb1f-d91f-43e7-be98-b7740c01c433 tempest-VolumesBackupsTest-118275719 None] About to put_object {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 09:47:15.609620 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-c0b6bb1f-d91f-43e7-be98-b7740c01c433 tempest-VolumesBackupsTest-118275719 None] backup MD5 for volume_72e07e1e-1567-4071-8204-c29cb26d2660/20260703094710/az_nova_backup_eba702ee-9959-40fe-9093-1eecff8dbaa6-00070: 77a339075c2c22a3b220b8be3eafd00a {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 09:47:15.609620 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-c0b6bb1f-d91f-43e7-be98-b7740c01c433 tempest-VolumesBackupsTest-118275719 None] Calling eventlet.sleep(0) {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 09:47:15.609620 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-c0b6bb1f-d91f-43e7-be98-b7740c01c433 tempest-VolumesBackupsTest-118275719 None] Backing up chunk of data from volume. {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 09:47:15.613617 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-c0b6bb1f-d91f-43e7-be98-b7740c01c433 tempest-VolumesBackupsTest-118275719 None] Compressed 196608 bytes of data to 64453 bytes using zlib. {{(pid=101319) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 09:47:15.614004 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-c0b6bb1f-d91f-43e7-be98-b7740c01c433 tempest-VolumesBackupsTest-118275719 None] About to put_object {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 09:47:15.658730 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-c0b6bb1f-d91f-43e7-be98-b7740c01c433 tempest-VolumesBackupsTest-118275719 None] backup MD5 for volume_72e07e1e-1567-4071-8204-c29cb26d2660/20260703094710/az_nova_backup_eba702ee-9959-40fe-9093-1eecff8dbaa6-00071: 4976e1dea54e67ed34a48147acf51f95 {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 09:47:15.658929 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-c0b6bb1f-d91f-43e7-be98-b7740c01c433 tempest-VolumesBackupsTest-118275719 None] Calling eventlet.sleep(0) {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 09:47:15.659208 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-c0b6bb1f-d91f-43e7-be98-b7740c01c433 tempest-VolumesBackupsTest-118275719 None] Backing up chunk of data from volume. {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 09:47:15.660765 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-c0b6bb1f-d91f-43e7-be98-b7740c01c433 tempest-VolumesBackupsTest-118275719 None] Compressed 32768 bytes of data to 7823 bytes using zlib. {{(pid=101319) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 09:47:15.660944 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-c0b6bb1f-d91f-43e7-be98-b7740c01c433 tempest-VolumesBackupsTest-118275719 None] About to put_object {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 09:47:15.734637 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-c0b6bb1f-d91f-43e7-be98-b7740c01c433 tempest-VolumesBackupsTest-118275719 None] backup MD5 for volume_72e07e1e-1567-4071-8204-c29cb26d2660/20260703094710/az_nova_backup_eba702ee-9959-40fe-9093-1eecff8dbaa6-00072: c5102cf8b89d0646b4a8454aa2eb455b {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 09:47:15.734873 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-c0b6bb1f-d91f-43e7-be98-b7740c01c433 tempest-VolumesBackupsTest-118275719 None] Calling eventlet.sleep(0) {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 09:47:15.735445 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-c0b6bb1f-d91f-43e7-be98-b7740c01c433 tempest-VolumesBackupsTest-118275719 None] Backing up chunk of data from volume. {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 09:47:15.753307 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-c0b6bb1f-d91f-43e7-be98-b7740c01c433 tempest-VolumesBackupsTest-118275719 None] Compressed 262144 bytes of data to 50703 bytes using zlib. {{(pid=101319) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 09:47:15.753494 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-c0b6bb1f-d91f-43e7-be98-b7740c01c433 tempest-VolumesBackupsTest-118275719 None] About to put_object {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 09:47:15.792211 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-c0b6bb1f-d91f-43e7-be98-b7740c01c433 tempest-VolumesBackupsTest-118275719 None] backup MD5 for volume_72e07e1e-1567-4071-8204-c29cb26d2660/20260703094710/az_nova_backup_eba702ee-9959-40fe-9093-1eecff8dbaa6-00073: a90b39452df564cdaee1875cdf14648d {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 09:47:15.792341 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-c0b6bb1f-d91f-43e7-be98-b7740c01c433 tempest-VolumesBackupsTest-118275719 None] Calling eventlet.sleep(0) {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 09:47:15.792788 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-c0b6bb1f-d91f-43e7-be98-b7740c01c433 tempest-VolumesBackupsTest-118275719 None] Backing up chunk of data from volume. {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 09:47:15.803916 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-c0b6bb1f-d91f-43e7-be98-b7740c01c433 tempest-VolumesBackupsTest-118275719 None] Compressed 196608 bytes of data to 94089 bytes using zlib. {{(pid=101319) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 09:47:15.804037 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-c0b6bb1f-d91f-43e7-be98-b7740c01c433 tempest-VolumesBackupsTest-118275719 None] About to put_object {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 09:47:15.842027 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-c0b6bb1f-d91f-43e7-be98-b7740c01c433 tempest-VolumesBackupsTest-118275719 None] backup MD5 for volume_72e07e1e-1567-4071-8204-c29cb26d2660/20260703094710/az_nova_backup_eba702ee-9959-40fe-9093-1eecff8dbaa6-00074: 93190166bf0c7415bc69f707aeecba3d {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 09:47:15.842146 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-c0b6bb1f-d91f-43e7-be98-b7740c01c433 tempest-VolumesBackupsTest-118275719 None] Calling eventlet.sleep(0) {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 09:47:15.842864 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-c0b6bb1f-d91f-43e7-be98-b7740c01c433 tempest-VolumesBackupsTest-118275719 None] Backing up chunk of data from volume. {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 09:47:15.882040 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-c0b6bb1f-d91f-43e7-be98-b7740c01c433 tempest-VolumesBackupsTest-118275719 None] Compressed 753664 bytes of data to 382335 bytes using zlib. {{(pid=101319) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 09:47:15.882429 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-c0b6bb1f-d91f-43e7-be98-b7740c01c433 tempest-VolumesBackupsTest-118275719 None] About to put_object {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 09:47:15.912296 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-c0b6bb1f-d91f-43e7-be98-b7740c01c433 tempest-VolumesBackupsTest-118275719 None] backup MD5 for volume_72e07e1e-1567-4071-8204-c29cb26d2660/20260703094710/az_nova_backup_eba702ee-9959-40fe-9093-1eecff8dbaa6-00075: f20b7ef7942c255d34567ef7a8c931d5 {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 09:47:15.912477 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-c0b6bb1f-d91f-43e7-be98-b7740c01c433 tempest-VolumesBackupsTest-118275719 None] Calling eventlet.sleep(0) {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 09:47:15.914237 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-c0b6bb1f-d91f-43e7-be98-b7740c01c433 tempest-VolumesBackupsTest-118275719 None] Backing up chunk of data from volume. {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 09:47:15.985152 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-c0b6bb1f-d91f-43e7-be98-b7740c01c433 tempest-VolumesBackupsTest-118275719 None] Compressed 1245184 bytes of data to 692194 bytes using zlib. {{(pid=101319) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 09:47:15.985296 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-c0b6bb1f-d91f-43e7-be98-b7740c01c433 tempest-VolumesBackupsTest-118275719 None] About to put_object {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 09:47:16.027726 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-c0b6bb1f-d91f-43e7-be98-b7740c01c433 tempest-VolumesBackupsTest-118275719 None] backup MD5 for volume_72e07e1e-1567-4071-8204-c29cb26d2660/20260703094710/az_nova_backup_eba702ee-9959-40fe-9093-1eecff8dbaa6-00076: 2fec27600c3cba1475524f3a83a147d9 {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 09:47:16.027952 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-c0b6bb1f-d91f-43e7-be98-b7740c01c433 tempest-VolumesBackupsTest-118275719 None] Calling eventlet.sleep(0) {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 09:47:16.028501 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-c0b6bb1f-d91f-43e7-be98-b7740c01c433 tempest-VolumesBackupsTest-118275719 None] Backing up chunk of data from volume. {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 09:47:16.038735 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-c0b6bb1f-d91f-43e7-be98-b7740c01c433 tempest-VolumesBackupsTest-118275719 None] Compressed 229376 bytes of data to 86155 bytes using zlib. {{(pid=101319) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 09:47:16.038859 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-c0b6bb1f-d91f-43e7-be98-b7740c01c433 tempest-VolumesBackupsTest-118275719 None] About to put_object {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 09:47:16.070450 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-c0b6bb1f-d91f-43e7-be98-b7740c01c433 tempest-VolumesBackupsTest-118275719 None] backup MD5 for volume_72e07e1e-1567-4071-8204-c29cb26d2660/20260703094710/az_nova_backup_eba702ee-9959-40fe-9093-1eecff8dbaa6-00077: bd18e2aa13a8966c7ccaeb4a8d2ad111 {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 09:47:16.074571 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-c0b6bb1f-d91f-43e7-be98-b7740c01c433 tempest-VolumesBackupsTest-118275719 None] Calling eventlet.sleep(0) {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 09:47:16.074571 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-c0b6bb1f-d91f-43e7-be98-b7740c01c433 tempest-VolumesBackupsTest-118275719 None] Backing up chunk of data from volume. {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 09:47:16.090076 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-c0b6bb1f-d91f-43e7-be98-b7740c01c433 tempest-VolumesBackupsTest-118275719 None] Compressed 196608 bytes of data to 89989 bytes using zlib. {{(pid=101319) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 09:47:16.091132 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-c0b6bb1f-d91f-43e7-be98-b7740c01c433 tempest-VolumesBackupsTest-118275719 None] About to put_object {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 09:47:16.125994 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-c0b6bb1f-d91f-43e7-be98-b7740c01c433 tempest-VolumesBackupsTest-118275719 None] backup MD5 for volume_72e07e1e-1567-4071-8204-c29cb26d2660/20260703094710/az_nova_backup_eba702ee-9959-40fe-9093-1eecff8dbaa6-00078: 2742a11d6ef6f40794ba3a77fdd91fc1 {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 09:47:16.128174 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-c0b6bb1f-d91f-43e7-be98-b7740c01c433 tempest-VolumesBackupsTest-118275719 None] Calling eventlet.sleep(0) {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 09:47:16.128174 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-c0b6bb1f-d91f-43e7-be98-b7740c01c433 tempest-VolumesBackupsTest-118275719 None] Backing up chunk of data from volume. {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 09:47:16.171611 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-c0b6bb1f-d91f-43e7-be98-b7740c01c433 tempest-VolumesBackupsTest-118275719 None] Compressed 753664 bytes of data to 244005 bytes using zlib. {{(pid=101319) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 09:47:16.171611 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-c0b6bb1f-d91f-43e7-be98-b7740c01c433 tempest-VolumesBackupsTest-118275719 None] About to put_object {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 09:47:16.209336 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-c0b6bb1f-d91f-43e7-be98-b7740c01c433 tempest-VolumesBackupsTest-118275719 None] backup MD5 for volume_72e07e1e-1567-4071-8204-c29cb26d2660/20260703094710/az_nova_backup_eba702ee-9959-40fe-9093-1eecff8dbaa6-00079: 937919e06f1ac884e907b3b44f7aa3f7 {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 09:47:16.214243 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-c0b6bb1f-d91f-43e7-be98-b7740c01c433 tempest-VolumesBackupsTest-118275719 None] Calling eventlet.sleep(0) {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 09:47:16.214865 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-c0b6bb1f-d91f-43e7-be98-b7740c01c433 tempest-VolumesBackupsTest-118275719 None] Backing up chunk of data from volume. {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 09:47:16.221194 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-c0b6bb1f-d91f-43e7-be98-b7740c01c433 tempest-VolumesBackupsTest-118275719 None] Compressed 32768 bytes of data to 8385 bytes using zlib. {{(pid=101319) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 09:47:16.221390 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-c0b6bb1f-d91f-43e7-be98-b7740c01c433 tempest-VolumesBackupsTest-118275719 None] About to put_object {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 09:47:16.275283 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-c0b6bb1f-d91f-43e7-be98-b7740c01c433 tempest-VolumesBackupsTest-118275719 None] backup MD5 for volume_72e07e1e-1567-4071-8204-c29cb26d2660/20260703094710/az_nova_backup_eba702ee-9959-40fe-9093-1eecff8dbaa6-00080: 80bf1a781b69ed6d28f051a8c1bace93 {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 09:47:16.275494 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-c0b6bb1f-d91f-43e7-be98-b7740c01c433 tempest-VolumesBackupsTest-118275719 None] Calling eventlet.sleep(0) {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 09:47:16.275740 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-c0b6bb1f-d91f-43e7-be98-b7740c01c433 tempest-VolumesBackupsTest-118275719 None] Backing up chunk of data from volume. {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 09:47:16.280264 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-c0b6bb1f-d91f-43e7-be98-b7740c01c433 tempest-VolumesBackupsTest-118275719 None] Compressed 98304 bytes of data to 35069 bytes using zlib. {{(pid=101319) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 09:47:16.280399 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-c0b6bb1f-d91f-43e7-be98-b7740c01c433 tempest-VolumesBackupsTest-118275719 None] About to put_object {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 09:47:16.321960 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-c0b6bb1f-d91f-43e7-be98-b7740c01c433 tempest-VolumesBackupsTest-118275719 None] backup MD5 for volume_72e07e1e-1567-4071-8204-c29cb26d2660/20260703094710/az_nova_backup_eba702ee-9959-40fe-9093-1eecff8dbaa6-00081: 839ea305330c068b1e25e10bbe0072eb {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 09:47:16.322080 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-c0b6bb1f-d91f-43e7-be98-b7740c01c433 tempest-VolumesBackupsTest-118275719 None] Calling eventlet.sleep(0) {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 09:47:16.322394 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-c0b6bb1f-d91f-43e7-be98-b7740c01c433 tempest-VolumesBackupsTest-118275719 None] Backing up chunk of data from volume. {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 09:47:16.336426 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-c0b6bb1f-d91f-43e7-be98-b7740c01c433 tempest-VolumesBackupsTest-118275719 None] Compressed 196608 bytes of data to 101460 bytes using zlib. {{(pid=101319) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 09:47:16.336570 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-c0b6bb1f-d91f-43e7-be98-b7740c01c433 tempest-VolumesBackupsTest-118275719 None] About to put_object {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 09:47:16.369050 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-c0b6bb1f-d91f-43e7-be98-b7740c01c433 tempest-VolumesBackupsTest-118275719 None] backup MD5 for volume_72e07e1e-1567-4071-8204-c29cb26d2660/20260703094710/az_nova_backup_eba702ee-9959-40fe-9093-1eecff8dbaa6-00082: e35f12e70225bea64f1d64820a8c34af {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 09:47:16.369203 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-c0b6bb1f-d91f-43e7-be98-b7740c01c433 tempest-VolumesBackupsTest-118275719 None] Calling eventlet.sleep(0) {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 09:47:16.369510 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-c0b6bb1f-d91f-43e7-be98-b7740c01c433 tempest-VolumesBackupsTest-118275719 None] Backing up chunk of data from volume. {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 09:47:16.370812 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-c0b6bb1f-d91f-43e7-be98-b7740c01c433 tempest-VolumesBackupsTest-118275719 None] Compressed 32768 bytes of data to 27789 bytes using zlib. {{(pid=101319) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 09:47:16.370961 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-c0b6bb1f-d91f-43e7-be98-b7740c01c433 tempest-VolumesBackupsTest-118275719 None] About to put_object {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 09:47:16.393621 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-c0b6bb1f-d91f-43e7-be98-b7740c01c433 tempest-VolumesBackupsTest-118275719 None] backup MD5 for volume_72e07e1e-1567-4071-8204-c29cb26d2660/20260703094710/az_nova_backup_eba702ee-9959-40fe-9093-1eecff8dbaa6-00083: b64ba69a7c7b92cbb6e034a227c535e1 {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 09:47:16.393924 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-c0b6bb1f-d91f-43e7-be98-b7740c01c433 tempest-VolumesBackupsTest-118275719 None] Calling eventlet.sleep(0) {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 09:47:16.394415 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-c0b6bb1f-d91f-43e7-be98-b7740c01c433 tempest-VolumesBackupsTest-118275719 None] Backing up chunk of data from volume. {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 09:47:16.405998 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-c0b6bb1f-d91f-43e7-be98-b7740c01c433 tempest-VolumesBackupsTest-118275719 None] Compressed 163840 bytes of data to 57870 bytes using zlib. {{(pid=101319) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 09:47:16.405998 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-c0b6bb1f-d91f-43e7-be98-b7740c01c433 tempest-VolumesBackupsTest-118275719 None] About to put_object {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 09:47:16.436069 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-c0b6bb1f-d91f-43e7-be98-b7740c01c433 tempest-VolumesBackupsTest-118275719 None] backup MD5 for volume_72e07e1e-1567-4071-8204-c29cb26d2660/20260703094710/az_nova_backup_eba702ee-9959-40fe-9093-1eecff8dbaa6-00084: 7271b184b3a0862c0307275252dd4c26 {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 09:47:16.436193 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-c0b6bb1f-d91f-43e7-be98-b7740c01c433 tempest-VolumesBackupsTest-118275719 None] Calling eventlet.sleep(0) {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 09:47:16.436610 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-c0b6bb1f-d91f-43e7-be98-b7740c01c433 tempest-VolumesBackupsTest-118275719 None] Backing up chunk of data from volume. {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 09:47:16.450941 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-c0b6bb1f-d91f-43e7-be98-b7740c01c433 tempest-VolumesBackupsTest-118275719 None] Compressed 196608 bytes of data to 111151 bytes using zlib. {{(pid=101319) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 09:47:16.451059 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-c0b6bb1f-d91f-43e7-be98-b7740c01c433 tempest-VolumesBackupsTest-118275719 None] About to put_object {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 09:47:16.481969 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-c0b6bb1f-d91f-43e7-be98-b7740c01c433 tempest-VolumesBackupsTest-118275719 None] backup MD5 for volume_72e07e1e-1567-4071-8204-c29cb26d2660/20260703094710/az_nova_backup_eba702ee-9959-40fe-9093-1eecff8dbaa6-00085: 534ab1b26cf91adf3fcf3f10f1b565b6 {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 09:47:16.482123 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-c0b6bb1f-d91f-43e7-be98-b7740c01c433 tempest-VolumesBackupsTest-118275719 None] Calling eventlet.sleep(0) {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 09:47:16.482864 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-c0b6bb1f-d91f-43e7-be98-b7740c01c433 tempest-VolumesBackupsTest-118275719 None] Backing up chunk of data from volume. {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 09:47:16.502252 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-c0b6bb1f-d91f-43e7-be98-b7740c01c433 tempest-VolumesBackupsTest-118275719 None] Compressed 524288 bytes of data to 186707 bytes using zlib. {{(pid=101319) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 09:47:16.502390 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-c0b6bb1f-d91f-43e7-be98-b7740c01c433 tempest-VolumesBackupsTest-118275719 None] About to put_object {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 09:47:16.542492 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-c0b6bb1f-d91f-43e7-be98-b7740c01c433 tempest-VolumesBackupsTest-118275719 None] backup MD5 for volume_72e07e1e-1567-4071-8204-c29cb26d2660/20260703094710/az_nova_backup_eba702ee-9959-40fe-9093-1eecff8dbaa6-00086: e6b1cf18f1737dfbfbfad2578b0d6523 {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 09:47:16.542696 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-c0b6bb1f-d91f-43e7-be98-b7740c01c433 tempest-VolumesBackupsTest-118275719 None] Calling eventlet.sleep(0) {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 09:47:16.543101 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-c0b6bb1f-d91f-43e7-be98-b7740c01c433 tempest-VolumesBackupsTest-118275719 None] Backing up chunk of data from volume. {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 09:47:16.544277 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-c0b6bb1f-d91f-43e7-be98-b7740c01c433 tempest-VolumesBackupsTest-118275719 None] Compressed 98304 bytes of data to 3528 bytes using zlib. {{(pid=101319) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 09:47:16.544419 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-c0b6bb1f-d91f-43e7-be98-b7740c01c433 tempest-VolumesBackupsTest-118275719 None] About to put_object {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 09:47:16.569468 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-c0b6bb1f-d91f-43e7-be98-b7740c01c433 tempest-VolumesBackupsTest-118275719 None] backup MD5 for volume_72e07e1e-1567-4071-8204-c29cb26d2660/20260703094710/az_nova_backup_eba702ee-9959-40fe-9093-1eecff8dbaa6-00087: 161bce212c60776f3f1aebeef8ab713e {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 09:47:16.569628 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-c0b6bb1f-d91f-43e7-be98-b7740c01c433 tempest-VolumesBackupsTest-118275719 None] Calling eventlet.sleep(0) {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 09:47:16.569876 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-c0b6bb1f-d91f-43e7-be98-b7740c01c433 tempest-VolumesBackupsTest-118275719 None] Backing up chunk of data from volume. {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 09:47:16.570453 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-c0b6bb1f-d91f-43e7-be98-b7740c01c433 tempest-VolumesBackupsTest-118275719 None] Compressed 32768 bytes of data to 760 bytes using zlib. {{(pid=101319) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 09:47:16.570637 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-c0b6bb1f-d91f-43e7-be98-b7740c01c433 tempest-VolumesBackupsTest-118275719 None] About to put_object {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 09:47:16.603001 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-c0b6bb1f-d91f-43e7-be98-b7740c01c433 tempest-VolumesBackupsTest-118275719 None] backup MD5 for volume_72e07e1e-1567-4071-8204-c29cb26d2660/20260703094710/az_nova_backup_eba702ee-9959-40fe-9093-1eecff8dbaa6-00088: 897e251c76b9c58b8c8c3f5df8f956e5 {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 09:47:16.603183 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-c0b6bb1f-d91f-43e7-be98-b7740c01c433 tempest-VolumesBackupsTest-118275719 None] Calling eventlet.sleep(0) {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 09:47:16.603618 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-c0b6bb1f-d91f-43e7-be98-b7740c01c433 tempest-VolumesBackupsTest-118275719 None] Backing up chunk of data from volume. {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 09:47:16.617233 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-c0b6bb1f-d91f-43e7-be98-b7740c01c433 tempest-VolumesBackupsTest-118275719 None] Compressed 262144 bytes of data to 93620 bytes using zlib. {{(pid=101319) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 09:47:16.617458 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-c0b6bb1f-d91f-43e7-be98-b7740c01c433 tempest-VolumesBackupsTest-118275719 None] About to put_object {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 09:47:16.649970 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-c0b6bb1f-d91f-43e7-be98-b7740c01c433 tempest-VolumesBackupsTest-118275719 None] backup MD5 for volume_72e07e1e-1567-4071-8204-c29cb26d2660/20260703094710/az_nova_backup_eba702ee-9959-40fe-9093-1eecff8dbaa6-00089: a77c3df81950fe3ec6756b32c47d5889 {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 09:47:16.651769 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-c0b6bb1f-d91f-43e7-be98-b7740c01c433 tempest-VolumesBackupsTest-118275719 None] Calling eventlet.sleep(0) {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 09:47:16.897731 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-c0b6bb1f-d91f-43e7-be98-b7740c01c433 tempest-VolumesBackupsTest-118275719 None] Backing up chunk of data from volume. {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 09:47:16.899841 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-c0b6bb1f-d91f-43e7-be98-b7740c01c433 tempest-VolumesBackupsTest-118275719 None] Compressed 65536 bytes of data to 14202 bytes using zlib. {{(pid=101319) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 09:47:16.900020 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-c0b6bb1f-d91f-43e7-be98-b7740c01c433 tempest-VolumesBackupsTest-118275719 None] About to put_object {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 09:47:16.933298 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-c0b6bb1f-d91f-43e7-be98-b7740c01c433 tempest-VolumesBackupsTest-118275719 None] backup MD5 for volume_72e07e1e-1567-4071-8204-c29cb26d2660/20260703094710/az_nova_backup_eba702ee-9959-40fe-9093-1eecff8dbaa6-00090: c15a2e2eb7fb41df1e140bbf87c78a9c {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 09:47:16.933522 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-c0b6bb1f-d91f-43e7-be98-b7740c01c433 tempest-VolumesBackupsTest-118275719 None] Calling eventlet.sleep(0) {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 09:47:16.933785 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-c0b6bb1f-d91f-43e7-be98-b7740c01c433 tempest-VolumesBackupsTest-118275719 None] Backing up chunk of data from volume. {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 09:47:16.944836 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-c0b6bb1f-d91f-43e7-be98-b7740c01c433 tempest-VolumesBackupsTest-118275719 None] Compressed 196608 bytes of data to 99711 bytes using zlib. {{(pid=101319) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 09:47:16.945044 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-c0b6bb1f-d91f-43e7-be98-b7740c01c433 tempest-VolumesBackupsTest-118275719 None] About to put_object {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 09:47:16.995910 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-c0b6bb1f-d91f-43e7-be98-b7740c01c433 tempest-VolumesBackupsTest-118275719 None] backup MD5 for volume_72e07e1e-1567-4071-8204-c29cb26d2660/20260703094710/az_nova_backup_eba702ee-9959-40fe-9093-1eecff8dbaa6-00091: d2f8fd157e57c49a2e7fbb7db668bdfa {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 09:47:16.996088 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-c0b6bb1f-d91f-43e7-be98-b7740c01c433 tempest-VolumesBackupsTest-118275719 None] Calling eventlet.sleep(0) {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 09:47:16.996752 np0000004400 cinder-backup[101319]: INFO cinder.backup.manager [None req-75ba68df-8a8d-48ad-9be6-295988b8d81d tempest-VolumesBackupsTest-2142009639 None] Create backup started, backup: 86118233-3d57-47ad-8781-cab6c54e4d53 volume: 8a0b1cfb-8ea1-46a0-aac3-b254107b98ef. Jul 03 09:47:16.999176 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-c0b6bb1f-d91f-43e7-be98-b7740c01c433 tempest-VolumesBackupsTest-118275719 None] Backing up chunk of data from volume. {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 09:47:17.002839 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-c0b6bb1f-d91f-43e7-be98-b7740c01c433 tempest-VolumesBackupsTest-118275719 None] Compressed 65536 bytes of data to 24816 bytes using zlib. {{(pid=101319) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 09:47:17.003035 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-c0b6bb1f-d91f-43e7-be98-b7740c01c433 tempest-VolumesBackupsTest-118275719 None] About to put_object {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 09:47:17.005384 np0000004400 cinder-backup[101319]: INFO cinder.backup.manager [None req-75ba68df-8a8d-48ad-9be6-295988b8d81d tempest-VolumesBackupsTest-2142009639 None] Call Volume Manager to get_backup_device for Backup(availability_zone='nova',container='tempest-volumesbackupstest-backup-container-106419071',created_at=2026-07-03T09:47:16Z,data_timestamp=2026-07-03T09:47:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesBackupsTest-Backup-693599398',encryption_key_id=None,fail_reason=None,host='np0000004400',id=86118233-3d57-47ad-8781-cab6c54e4d53,metadata={},num_dependent_backups=0,object_count=0,parent=None,parent_id=None,project_id='59044e18a5b24b19a7b9b8a380f2e1a0',restore_volume_id=None,service='cinder.backup.drivers.swift.SwiftBackupDriver',service_metadata=None,size=1,snapshot_id=None,status='creating',temp_snapshot_id=None,temp_volume_id=None,updated_at=None,user_id='91463b6c437c4711a49d3c31c513a101',volume_id=8a0b1cfb-8ea1-46a0-aac3-b254107b98ef) Jul 03 09:47:17.042908 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-c0b6bb1f-d91f-43e7-be98-b7740c01c433 tempest-VolumesBackupsTest-118275719 None] backup MD5 for volume_72e07e1e-1567-4071-8204-c29cb26d2660/20260703094710/az_nova_backup_eba702ee-9959-40fe-9093-1eecff8dbaa6-00092: ab4c3c6565d120e31d0ec092b1f40fc0 {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 09:47:17.043101 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-c0b6bb1f-d91f-43e7-be98-b7740c01c433 tempest-VolumesBackupsTest-118275719 None] Calling eventlet.sleep(0) {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 09:47:17.043314 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-c0b6bb1f-d91f-43e7-be98-b7740c01c433 tempest-VolumesBackupsTest-118275719 None] Backing up chunk of data from volume. {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 09:47:17.045506 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-c0b6bb1f-d91f-43e7-be98-b7740c01c433 tempest-VolumesBackupsTest-118275719 None] Compressed 32768 bytes of data to 9379 bytes using zlib. {{(pid=101319) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 09:47:17.045691 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-c0b6bb1f-d91f-43e7-be98-b7740c01c433 tempest-VolumesBackupsTest-118275719 None] About to put_object {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 09:47:17.077953 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-c0b6bb1f-d91f-43e7-be98-b7740c01c433 tempest-VolumesBackupsTest-118275719 None] backup MD5 for volume_72e07e1e-1567-4071-8204-c29cb26d2660/20260703094710/az_nova_backup_eba702ee-9959-40fe-9093-1eecff8dbaa6-00093: 6df3fb11329fda670b6a648b803a75c3 {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 09:47:17.078142 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-c0b6bb1f-d91f-43e7-be98-b7740c01c433 tempest-VolumesBackupsTest-118275719 None] Calling eventlet.sleep(0) {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 09:47:17.078356 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-c0b6bb1f-d91f-43e7-be98-b7740c01c433 tempest-VolumesBackupsTest-118275719 None] Backing up chunk of data from volume. {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 09:47:17.081985 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-c0b6bb1f-d91f-43e7-be98-b7740c01c433 tempest-VolumesBackupsTest-118275719 None] Compressed 32768 bytes of data to 11742 bytes using zlib. {{(pid=101319) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 09:47:17.083532 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-c0b6bb1f-d91f-43e7-be98-b7740c01c433 tempest-VolumesBackupsTest-118275719 None] About to put_object {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 09:47:17.113313 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-c0b6bb1f-d91f-43e7-be98-b7740c01c433 tempest-VolumesBackupsTest-118275719 None] backup MD5 for volume_72e07e1e-1567-4071-8204-c29cb26d2660/20260703094710/az_nova_backup_eba702ee-9959-40fe-9093-1eecff8dbaa6-00094: d3338725ce0b00d0d0a20c3dc76363b5 {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 09:47:17.113313 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-c0b6bb1f-d91f-43e7-be98-b7740c01c433 tempest-VolumesBackupsTest-118275719 None] Calling eventlet.sleep(0) {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 09:47:17.113604 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-c0b6bb1f-d91f-43e7-be98-b7740c01c433 tempest-VolumesBackupsTest-118275719 None] Backing up chunk of data from volume. {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 09:47:17.128440 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.drivers.swift [None req-75ba68df-8a8d-48ad-9be6-295988b8d81d tempest-VolumesBackupsTest-2142009639 None] Using swift URL https://10.4.3.95:8080/v1/AUTH_59044e18a5b24b19a7b9b8a380f2e1a0 {{(pid=101319) initialize /opt/stack/cinder/cinder/backup/drivers/swift.py:300}} Jul 03 09:47:17.128581 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.drivers.swift [None req-75ba68df-8a8d-48ad-9be6-295988b8d81d tempest-VolumesBackupsTest-2142009639 None] Connect to https://10.4.3.95:8080/v1/AUTH_ in "per_user" mode {{(pid=101319) initialize /opt/stack/cinder/cinder/backup/drivers/swift.py:301}} Jul 03 09:47:17.129162 np0000004400 cinder-backup[101319]: DEBUG os_brick.utils [None req-75ba68df-8a8d-48ad-9be6-295988b8d81d tempest-VolumesBackupsTest-2142009639 None] ==> get_connector_properties: call "{'root_helper': 'sudo cinder-rootwrap /etc/cinder/rootwrap.conf', 'my_ip': '10.4.3.95', 'multipath': False, 'enforce_multipath': False, 'host': None, 'execute': None}" {{(pid=101319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}} Jul 03 09:47:17.142962 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.scaleio [None req-75ba68df-8a8d-48ad-9be6-295988b8d81d tempest-VolumesBackupsTest-2142009639 None] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=101319) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}} Jul 03 09:47:17.147429 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-c0b6bb1f-d91f-43e7-be98-b7740c01c433 tempest-VolumesBackupsTest-118275719 None] Compressed 557056 bytes of data to 231400 bytes using zlib. {{(pid=101319) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 09:47:17.147429 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-c0b6bb1f-d91f-43e7-be98-b7740c01c433 tempest-VolumesBackupsTest-118275719 None] About to put_object {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 09:47:17.167742 np0000004400 cinder-backup[101319]: DEBUG oslo_concurrency.processutils [None req-75ba68df-8a8d-48ad-9be6-295988b8d81d tempest-VolumesBackupsTest-2142009639 None] Running cmd (subprocess): nvme version {{(pid=101319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 09:47:17.185091 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-c0b6bb1f-d91f-43e7-be98-b7740c01c433 tempest-VolumesBackupsTest-118275719 None] backup MD5 for volume_72e07e1e-1567-4071-8204-c29cb26d2660/20260703094710/az_nova_backup_eba702ee-9959-40fe-9093-1eecff8dbaa6-00095: 736df86bae8f6a9fbe7631cf877d988c {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 09:47:17.185249 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-c0b6bb1f-d91f-43e7-be98-b7740c01c433 tempest-VolumesBackupsTest-118275719 None] Calling eventlet.sleep(0) {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 09:47:17.185723 np0000004400 cinder-backup[101319]: DEBUG oslo_concurrency.processutils [None req-75ba68df-8a8d-48ad-9be6-295988b8d81d tempest-VolumesBackupsTest-2142009639 None] 'nvme version' failed. Not Retrying. {{(pid=101319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 03 09:47:17.186160 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-c0b6bb1f-d91f-43e7-be98-b7740c01c433 tempest-VolumesBackupsTest-118275719 None] Backing up chunk of data from volume. {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 09:47:17.186422 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.nvmeof [None req-75ba68df-8a8d-48ad-9be6-295988b8d81d tempest-VolumesBackupsTest-2142009639 None] nvme not present on system {{(pid=101319) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}} Jul 03 09:47:17.194133 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.lightos [None req-75ba68df-8a8d-48ad-9be6-295988b8d81d tempest-VolumesBackupsTest-2142009639 None] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=101319) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}} Jul 03 09:47:17.195590 np0000004400 cinder-backup[101319]: INFO os_brick.initiator.connectors.lightos [None req-75ba68df-8a8d-48ad-9be6-295988b8d81d tempest-VolumesBackupsTest-2142009639 None] Current host hostNQN and IP(s) are ['10.4.3.95', 'fe80::f816:3eff:fe47:268c', '192.168.40.6', 'fe80::f816:3eff:febf:7be2', '192.168.50.6', 'fe80::f816:3eff:fe99:8914', '192.168.10.6', 'fe80::f816:3eff:fe2f:e696', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::bc9d:84ff:fec2:6b49', 'fe80::fc16:3eff:fe97:90a6', 'fe80::8435:18ff:feb9:798c', 'fe80::fc16:3eff:feda:9a9f', 'fe80::28c1:27ff:fe3c:5528', 'fe80::fc16:3eff:fec1:41ad', 'fe80::4007:baff:fe0f:8f44', 'fe80::fc16:3eff:fe0d:feb3', 'fe80::d024:91ff:fe82:6987'] Jul 03 09:47:17.196253 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.lightos [None req-75ba68df-8a8d-48ad-9be6-295988b8d81d tempest-VolumesBackupsTest-2142009639 None] LIGHTOS: did not find dsc, continuing anyway. {{(pid=101319) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}} Jul 03 09:47:17.196585 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.lightos [None req-75ba68df-8a8d-48ad-9be6-295988b8d81d tempest-VolumesBackupsTest-2142009639 None] LIGHTOS: no hostnqn found. {{(pid=101319) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}} Jul 03 09:47:17.197204 np0000004400 cinder-backup[101319]: DEBUG os_brick.utils [None req-75ba68df-8a8d-48ad-9be6-295988b8d81d tempest-VolumesBackupsTest-2142009639 None] <== get_connector_properties: return (68ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.95', 'host': 'np0000004400', 'multipath': False, 'enforce_multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:ae7e5bb0ebe6', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': '6b284368-d0ba-4d18-af6f-4998d3955c52', 'nvme_native_multipath': False} {{(pid=101319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}} Jul 03 09:47:17.200103 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-c0b6bb1f-d91f-43e7-be98-b7740c01c433 tempest-VolumesBackupsTest-118275719 None] Compressed 131072 bytes of data to 45214 bytes using zlib. {{(pid=101319) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 09:47:17.200247 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-c0b6bb1f-d91f-43e7-be98-b7740c01c433 tempest-VolumesBackupsTest-118275719 None] About to put_object {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 09:47:17.244676 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-c0b6bb1f-d91f-43e7-be98-b7740c01c433 tempest-VolumesBackupsTest-118275719 None] backup MD5 for volume_72e07e1e-1567-4071-8204-c29cb26d2660/20260703094710/az_nova_backup_eba702ee-9959-40fe-9093-1eecff8dbaa6-00096: 5465c211d4134a5c770e5e96d9420f8b {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 09:47:17.244793 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-c0b6bb1f-d91f-43e7-be98-b7740c01c433 tempest-VolumesBackupsTest-118275719 None] Calling eventlet.sleep(0) {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 09:47:17.245019 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-c0b6bb1f-d91f-43e7-be98-b7740c01c433 tempest-VolumesBackupsTest-118275719 None] Backing up chunk of data from volume. {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 09:47:17.248537 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-c0b6bb1f-d91f-43e7-be98-b7740c01c433 tempest-VolumesBackupsTest-118275719 None] Compressed 32768 bytes of data to 3791 bytes using zlib. {{(pid=101319) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 09:47:17.248676 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-c0b6bb1f-d91f-43e7-be98-b7740c01c433 tempest-VolumesBackupsTest-118275719 None] About to put_object {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 09:47:17.274573 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-c0b6bb1f-d91f-43e7-be98-b7740c01c433 tempest-VolumesBackupsTest-118275719 None] backup MD5 for volume_72e07e1e-1567-4071-8204-c29cb26d2660/20260703094710/az_nova_backup_eba702ee-9959-40fe-9093-1eecff8dbaa6-00097: 125fb29df3a88ed91bb536861e7d1ff9 {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 09:47:17.274721 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-c0b6bb1f-d91f-43e7-be98-b7740c01c433 tempest-VolumesBackupsTest-118275719 None] Calling eventlet.sleep(0) {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 09:47:17.274911 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-c0b6bb1f-d91f-43e7-be98-b7740c01c433 tempest-VolumesBackupsTest-118275719 None] Backing up chunk of data from volume. {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 09:47:17.277829 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-c0b6bb1f-d91f-43e7-be98-b7740c01c433 tempest-VolumesBackupsTest-118275719 None] Compressed 98304 bytes of data to 26004 bytes using zlib. {{(pid=101319) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 09:47:17.277976 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-c0b6bb1f-d91f-43e7-be98-b7740c01c433 tempest-VolumesBackupsTest-118275719 None] About to put_object {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 09:47:17.315308 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-c0b6bb1f-d91f-43e7-be98-b7740c01c433 tempest-VolumesBackupsTest-118275719 None] backup MD5 for volume_72e07e1e-1567-4071-8204-c29cb26d2660/20260703094710/az_nova_backup_eba702ee-9959-40fe-9093-1eecff8dbaa6-00098: 38a20f8b3afb8be4ea4deab5f9b3d080 {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 09:47:17.315466 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-c0b6bb1f-d91f-43e7-be98-b7740c01c433 tempest-VolumesBackupsTest-118275719 None] Calling eventlet.sleep(0) {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 09:47:17.315695 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-c0b6bb1f-d91f-43e7-be98-b7740c01c433 tempest-VolumesBackupsTest-118275719 None] Backing up chunk of data from volume. {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 09:47:17.321832 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-c0b6bb1f-d91f-43e7-be98-b7740c01c433 tempest-VolumesBackupsTest-118275719 None] Compressed 131072 bytes of data to 34863 bytes using zlib. {{(pid=101319) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 09:47:17.321991 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-c0b6bb1f-d91f-43e7-be98-b7740c01c433 tempest-VolumesBackupsTest-118275719 None] About to put_object {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 09:47:17.353172 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-c0b6bb1f-d91f-43e7-be98-b7740c01c433 tempest-VolumesBackupsTest-118275719 None] backup MD5 for volume_72e07e1e-1567-4071-8204-c29cb26d2660/20260703094710/az_nova_backup_eba702ee-9959-40fe-9093-1eecff8dbaa6-00099: f87eeae8e3222a88fc335a905cc595f5 {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 09:47:17.353315 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-c0b6bb1f-d91f-43e7-be98-b7740c01c433 tempest-VolumesBackupsTest-118275719 None] Calling eventlet.sleep(0) {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 09:47:17.353543 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-c0b6bb1f-d91f-43e7-be98-b7740c01c433 tempest-VolumesBackupsTest-118275719 None] Backing up chunk of data from volume. {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 09:47:17.359048 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-c0b6bb1f-d91f-43e7-be98-b7740c01c433 tempest-VolumesBackupsTest-118275719 None] Compressed 131072 bytes of data to 28914 bytes using zlib. {{(pid=101319) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 09:47:17.359165 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-c0b6bb1f-d91f-43e7-be98-b7740c01c433 tempest-VolumesBackupsTest-118275719 None] About to put_object {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 09:47:17.399382 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-c0b6bb1f-d91f-43e7-be98-b7740c01c433 tempest-VolumesBackupsTest-118275719 None] backup MD5 for volume_72e07e1e-1567-4071-8204-c29cb26d2660/20260703094710/az_nova_backup_eba702ee-9959-40fe-9093-1eecff8dbaa6-00100: a34ec244a0a06a62255379762d3da663 {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 09:47:17.399382 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-c0b6bb1f-d91f-43e7-be98-b7740c01c433 tempest-VolumesBackupsTest-118275719 None] Calling eventlet.sleep(0) {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 09:47:17.399382 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-c0b6bb1f-d91f-43e7-be98-b7740c01c433 tempest-VolumesBackupsTest-118275719 None] Backing up chunk of data from volume. {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 09:47:17.422006 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-c0b6bb1f-d91f-43e7-be98-b7740c01c433 tempest-VolumesBackupsTest-118275719 None] Compressed 393216 bytes of data to 206685 bytes using zlib. {{(pid=101319) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 09:47:17.422006 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-c0b6bb1f-d91f-43e7-be98-b7740c01c433 tempest-VolumesBackupsTest-118275719 None] About to put_object {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 09:47:17.456555 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-c0b6bb1f-d91f-43e7-be98-b7740c01c433 tempest-VolumesBackupsTest-118275719 None] backup MD5 for volume_72e07e1e-1567-4071-8204-c29cb26d2660/20260703094710/az_nova_backup_eba702ee-9959-40fe-9093-1eecff8dbaa6-00101: ce40a8df09b1374e7997af78065811c8 {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 09:47:17.456555 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-c0b6bb1f-d91f-43e7-be98-b7740c01c433 tempest-VolumesBackupsTest-118275719 None] Calling eventlet.sleep(0) {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 09:47:17.456555 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-c0b6bb1f-d91f-43e7-be98-b7740c01c433 tempest-VolumesBackupsTest-118275719 None] Backing up chunk of data from volume. {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 09:47:17.457844 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-c0b6bb1f-d91f-43e7-be98-b7740c01c433 tempest-VolumesBackupsTest-118275719 None] Compressed 32768 bytes of data to 9850 bytes using zlib. {{(pid=101319) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 09:47:17.458081 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-c0b6bb1f-d91f-43e7-be98-b7740c01c433 tempest-VolumesBackupsTest-118275719 None] About to put_object {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 09:47:17.486255 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-c0b6bb1f-d91f-43e7-be98-b7740c01c433 tempest-VolumesBackupsTest-118275719 None] backup MD5 for volume_72e07e1e-1567-4071-8204-c29cb26d2660/20260703094710/az_nova_backup_eba702ee-9959-40fe-9093-1eecff8dbaa6-00102: 5649b75a126d07b66d0cec64e48b81cf {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 09:47:17.486255 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-c0b6bb1f-d91f-43e7-be98-b7740c01c433 tempest-VolumesBackupsTest-118275719 None] Calling eventlet.sleep(0) {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 09:47:17.486255 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-c0b6bb1f-d91f-43e7-be98-b7740c01c433 tempest-VolumesBackupsTest-118275719 None] Backing up chunk of data from volume. {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 09:47:17.487357 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-c0b6bb1f-d91f-43e7-be98-b7740c01c433 tempest-VolumesBackupsTest-118275719 None] Compressed 65536 bytes of data to 428 bytes using zlib. {{(pid=101319) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 09:47:17.487357 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-c0b6bb1f-d91f-43e7-be98-b7740c01c433 tempest-VolumesBackupsTest-118275719 None] About to put_object {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 09:47:17.520427 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-c0b6bb1f-d91f-43e7-be98-b7740c01c433 tempest-VolumesBackupsTest-118275719 None] backup MD5 for volume_72e07e1e-1567-4071-8204-c29cb26d2660/20260703094710/az_nova_backup_eba702ee-9959-40fe-9093-1eecff8dbaa6-00103: ae208eb3f83a46fb3c8423271518f7f4 {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 09:47:17.520427 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-c0b6bb1f-d91f-43e7-be98-b7740c01c433 tempest-VolumesBackupsTest-118275719 None] Calling eventlet.sleep(0) {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 09:47:17.565574 np0000004400 cinder-backup[101319]: DEBUG oslo_db.sqlalchemy.engines [None req-c0b6bb1f-d91f-43e7-be98-b7740c01c433 tempest-VolumesBackupsTest-118275719 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=101319) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 03 09:47:17.702194 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connector [None req-75ba68df-8a8d-48ad-9be6-295988b8d81d tempest-VolumesBackupsTest-2142009639 None] Factory for iscsi on None {{(pid=101319) factory /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connector.py:243}} Jul 03 09:47:17.702643 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-75ba68df-8a8d-48ad-9be6-295988b8d81d tempest-VolumesBackupsTest-2142009639 None] ==> connect_volume: call "{'self': , 'connection_properties': {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-298b8723-c4d1-455f-aef8-665b62a8001f', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '298b8723-c4d1-455f-aef8-665b62a8001f', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': False}}" {{(pid=101319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}} Jul 03 09:47:17.702835 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.base [None req-75ba68df-8a8d-48ad-9be6-295988b8d81d tempest-VolumesBackupsTest-2142009639 None] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=101319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jul 03 09:47:17.703263 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.base [None req-75ba68df-8a8d-48ad-9be6-295988b8d81d tempest-VolumesBackupsTest-2142009639 None] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.000s {{(pid=101319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jul 03 09:47:17.703477 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.base [None req-75ba68df-8a8d-48ad-9be6-295988b8d81d tempest-VolumesBackupsTest-2142009639 None] Connection properties {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-298b8723-c4d1-455f-aef8-665b62a8001f', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '298b8723-c4d1-455f-aef8-665b62a8001f', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': False} {{(pid=101319) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}} Jul 03 09:47:17.714737 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.base [None req-75ba68df-8a8d-48ad-9be6-295988b8d81d tempest-VolumesBackupsTest-2142009639 None] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-298b8723-c4d1-455f-aef8-665b62a8001f" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=101319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jul 03 09:47:17.715170 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.base [None req-75ba68df-8a8d-48ad-9be6-295988b8d81d tempest-VolumesBackupsTest-2142009639 None] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-298b8723-c4d1-455f-aef8-665b62a8001f" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=101319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jul 03 09:47:17.715370 np0000004400 cinder-backup[101319]: INFO os_brick.initiator.connectors.iscsi [None req-75ba68df-8a8d-48ad-9be6-295988b8d81d tempest-VolumesBackupsTest-2142009639 None] Trying to connect to iSCSI portal 192.168.40.100:3260 Jul 03 09:47:17.727667 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-75ba68df-8a8d-48ad-9be6-295988b8d81d tempest-VolumesBackupsTest-2142009639 None] iscsiadm (): stdout= stderr=iscsiadm: No records found Jul 03 09:47:17.727667 np0000004400 cinder-backup[101319]: {{(pid=101319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 03 09:47:17.740552 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-75ba68df-8a8d-48ad-9be6-295988b8d81d tempest-VolumesBackupsTest-2142009639 None] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-298b8723-c4d1-455f-aef8-665b62a8001f] added Jul 03 09:47:17.740552 np0000004400 cinder-backup[101319]: stderr=iscsiadm: Config file line 363 does not have value Jul 03 09:47:17.740552 np0000004400 cinder-backup[101319]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs' Jul 03 09:47:17.740552 np0000004400 cinder-backup[101319]: iscsiadm: Config file line 363 does not have value Jul 03 09:47:17.740552 np0000004400 cinder-backup[101319]: iscsiadm: Config file line 363 does not have value Jul 03 09:47:17.740552 np0000004400 cinder-backup[101319]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs' Jul 03 09:47:17.740552 np0000004400 cinder-backup[101319]: {{(pid=101319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 03 09:47:17.740822 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-75ba68df-8a8d-48ad-9be6-295988b8d81d tempest-VolumesBackupsTest-2142009639 None] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=101319) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}} Jul 03 09:47:17.741039 np0000004400 cinder-backup[101319]: DEBUG os_brick.utils [None req-75ba68df-8a8d-48ad-9be6-295988b8d81d tempest-VolumesBackupsTest-2142009639 None] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0256(s), this was the 1st time calling it. {{(pid=101319) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}} Jul 03 09:47:17.741204 np0000004400 cinder-backup[101319]: DEBUG os_brick.utils [None req-75ba68df-8a8d-48ad-9be6-295988b8d81d tempest-VolumesBackupsTest-2142009639 None] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=101319) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}} Jul 03 09:47:18.220562 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-c0b6bb1f-d91f-43e7-be98-b7740c01c433 tempest-VolumesBackupsTest-118275719 None] Backing up chunk of data from volume. {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 09:47:18.221420 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-c0b6bb1f-d91f-43e7-be98-b7740c01c433 tempest-VolumesBackupsTest-118275719 None] Compressed 32768 bytes of data to 68 bytes using zlib. {{(pid=101319) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 09:47:18.222349 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-c0b6bb1f-d91f-43e7-be98-b7740c01c433 tempest-VolumesBackupsTest-118275719 None] About to put_object {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 09:47:18.258924 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-c0b6bb1f-d91f-43e7-be98-b7740c01c433 tempest-VolumesBackupsTest-118275719 None] backup MD5 for volume_72e07e1e-1567-4071-8204-c29cb26d2660/20260703094710/az_nova_backup_eba702ee-9959-40fe-9093-1eecff8dbaa6-00104: 0ac8838eee7696114147d95e0878e3b2 {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 09:47:18.259075 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-c0b6bb1f-d91f-43e7-be98-b7740c01c433 tempest-VolumesBackupsTest-118275719 None] Calling eventlet.sleep(0) {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 09:47:18.645101 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-c0b6bb1f-d91f-43e7-be98-b7740c01c433 tempest-VolumesBackupsTest-118275719 None] Backing up chunk of data from volume. {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 09:47:18.646016 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-c0b6bb1f-d91f-43e7-be98-b7740c01c433 tempest-VolumesBackupsTest-118275719 None] Compressed 65536 bytes of data to 428 bytes using zlib. {{(pid=101319) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 09:47:18.646155 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-c0b6bb1f-d91f-43e7-be98-b7740c01c433 tempest-VolumesBackupsTest-118275719 None] About to put_object {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 09:47:18.675684 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-c0b6bb1f-d91f-43e7-be98-b7740c01c433 tempest-VolumesBackupsTest-118275719 None] backup MD5 for volume_72e07e1e-1567-4071-8204-c29cb26d2660/20260703094710/az_nova_backup_eba702ee-9959-40fe-9093-1eecff8dbaa6-00105: b2292ab86959f8d7dae80c7bc94b877f {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 09:47:18.675844 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-c0b6bb1f-d91f-43e7-be98-b7740c01c433 tempest-VolumesBackupsTest-118275719 None] Calling eventlet.sleep(0) {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 09:47:18.741963 np0000004400 cinder-backup[101319]: INFO os_brick.initiator.connectors.iscsi [None req-75ba68df-8a8d-48ad-9be6-295988b8d81d tempest-VolumesBackupsTest-2142009639 None] Trying to connect to iSCSI portal 192.168.40.100:3260 Jul 03 09:47:18.753069 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-75ba68df-8a8d-48ad-9be6-295988b8d81d tempest-VolumesBackupsTest-2142009639 None] iscsiadm (): stdout=# BEGIN RECORD 2.1.9 Jul 03 09:47:18.753069 np0000004400 cinder-backup[101319]: node.name = iqn.2023-03.storpool.com:os--volume-298b8723-c4d1-455f-aef8-665b62a8001f Jul 03 09:47:18.753069 np0000004400 cinder-backup[101319]: node.tpgt = -1 Jul 03 09:47:18.753069 np0000004400 cinder-backup[101319]: node.startup = manual Jul 03 09:47:18.753069 np0000004400 cinder-backup[101319]: node.leading_login = No Jul 03 09:47:18.753069 np0000004400 cinder-backup[101319]: iface.iscsi_ifacename = default Jul 03 09:47:18.753069 np0000004400 cinder-backup[101319]: iface.net_ifacename = Jul 03 09:47:18.753069 np0000004400 cinder-backup[101319]: iface.ipaddress = Jul 03 09:47:18.753069 np0000004400 cinder-backup[101319]: iface.prefix_len = 0 Jul 03 09:47:18.753069 np0000004400 cinder-backup[101319]: iface.hwaddress = Jul 03 09:47:18.753069 np0000004400 cinder-backup[101319]: iface.transport_name = tcp Jul 03 09:47:18.753069 np0000004400 cinder-backup[101319]: iface.initiatorname = Jul 03 09:47:18.753069 np0000004400 cinder-backup[101319]: iface.state = Jul 03 09:47:18.753069 np0000004400 cinder-backup[101319]: iface.vlan_id = 0 Jul 03 09:47:18.753069 np0000004400 cinder-backup[101319]: iface.vlan_priority = 0 Jul 03 09:47:18.753069 np0000004400 cinder-backup[101319]: iface.vlan_state = Jul 03 09:47:18.753069 np0000004400 cinder-backup[101319]: iface.iface_num = 0 Jul 03 09:47:18.753069 np0000004400 cinder-backup[101319]: iface.mtu = 0 Jul 03 09:47:18.753069 np0000004400 cinder-backup[101319]: iface.port = 0 Jul 03 09:47:18.753069 np0000004400 cinder-backup[101319]: iface.bootproto = Jul 03 09:47:18.753069 np0000004400 cinder-backup[101319]: iface.subnet_mask = Jul 03 09:47:18.753069 np0000004400 cinder-backup[101319]: iface.gateway = Jul 03 09:47:18.753069 np0000004400 cinder-backup[101319]: iface.dhcp_alt_client_id_state = Jul 03 09:47:18.753069 np0000004400 cinder-backup[101319]: iface.dhcp_alt_client_id = Jul 03 09:47:18.753069 np0000004400 cinder-backup[101319]: iface.dhcp_dns = Jul 03 09:47:18.753069 np0000004400 cinder-backup[101319]: iface.dhcp_learn_iqn = Jul 03 09:47:18.753069 np0000004400 cinder-backup[101319]: iface.dhcp_req_vendor_id_state = Jul 03 09:47:18.753069 np0000004400 cinder-backup[101319]: iface.dhcp_vendor_id_state = Jul 03 09:47:18.753069 np0000004400 cinder-backup[101319]: iface.dhcp_vendor_id = Jul 03 09:47:18.753069 np0000004400 cinder-backup[101319]: iface.dhcp_slp_da = Jul 03 09:47:18.753069 np0000004400 cinder-backup[101319]: iface.fragmentation = Jul 03 09:47:18.753069 np0000004400 cinder-backup[101319]: iface.gratuitous_arp = Jul 03 09:47:18.753069 np0000004400 cinder-backup[101319]: iface.incoming_forwarding = Jul 03 09:47:18.753069 np0000004400 cinder-backup[101319]: iface.tos_state = Jul 03 09:47:18.753069 np0000004400 cinder-backup[101319]: iface.tos = 0 Jul 03 09:47:18.753069 np0000004400 cinder-backup[101319]: iface.ttl = 0 Jul 03 09:47:18.753069 np0000004400 cinder-backup[101319]: iface.delayed_ack = Jul 03 09:47:18.753069 np0000004400 cinder-backup[101319]: iface.tcp_nagle = Jul 03 09:47:18.753069 np0000004400 cinder-backup[101319]: iface.tcp_wsf_state = Jul 03 09:47:18.753069 np0000004400 cinder-backup[101319]: iface.tcp_wsf = 0 Jul 03 09:47:18.753069 np0000004400 cinder-backup[101319]: iface.tcp_timer_scale = 0 Jul 03 09:47:18.753069 np0000004400 cinder-backup[101319]: iface.tcp_timestamp = Jul 03 09:47:18.753069 np0000004400 cinder-backup[101319]: iface.redirect = Jul 03 09:47:18.753069 np0000004400 cinder-backup[101319]: iface.def_task_mgmt_timeout = 0 Jul 03 09:47:18.753069 np0000004400 cinder-backup[101319]: iface.header_digest = Jul 03 09:47:18.753069 np0000004400 cinder-backup[101319]: iface.data_digest = Jul 03 09:47:18.753069 np0000004400 cinder-backup[101319]: iface.immediate_data = Jul 03 09:47:18.753069 np0000004400 cinder-backup[101319]: iface.initial_r2t = Jul 03 09:47:18.753069 np0000004400 cinder-backup[101319]: iface.data_seq_inorder = Jul 03 09:47:18.753069 np0000004400 cinder-backup[101319]: iface.data_pdu_inorder = Jul 03 09:47:18.753069 np0000004400 cinder-backup[101319]: iface.erl = 0 Jul 03 09:47:18.753069 np0000004400 cinder-backup[101319]: iface.max_receive_data_len = 0 Jul 03 09:47:18.753069 np0000004400 cinder-backup[101319]: iface.first_burst_len = 0 Jul 03 09:47:18.753069 np0000004400 cinder-backup[101319]: iface.max_outstanding_r2t = 0 Jul 03 09:47:18.753069 np0000004400 cinder-backup[101319]: iface.max_burst_len = 0 Jul 03 09:47:18.753069 np0000004400 cinder-backup[101319]: iface.chap_auth = Jul 03 09:47:18.753069 np0000004400 cinder-backup[101319]: iface.bidi_chap = Jul 03 09:47:18.753069 np0000004400 cinder-backup[101319]: iface.strict_login_compliance = Jul 03 09:47:18.753069 np0000004400 cinder-backup[101319]: iface.discovery_auth = Jul 03 09:47:18.753069 np0000004400 cinder-backup[101319]: iface.discovery_logout = Jul 03 09:47:18.753069 np0000004400 cinder-backup[101319]: node.discovery_address = Jul 03 09:47:18.753069 np0000004400 cinder-backup[101319]: node.discovery_port = 0 Jul 03 09:47:18.753069 np0000004400 cinder-backup[101319]: node.discovery_type = fw Jul 03 09:47:18.753069 np0000004400 cinder-backup[101319]: node.session.initial_cmdsn = 0 Jul 03 09:47:18.753069 np0000004400 cinder-backup[101319]: node.session.initial_login_retry_max = 8 Jul 03 09:47:18.753069 np0000004400 cinder-backup[101319]: node.session.xmit_thread_priority = 0 Jul 03 09:47:18.753069 np0000004400 cinder-backup[101319]: node.session.cmds_max = 128 Jul 03 09:47:18.753069 np0000004400 cinder-backup[101319]: node.session.queue_depth = 32 Jul 03 09:47:18.753069 np0000004400 cinder-backup[101319]: node.session.nr_sessions = 1 Jul 03 09:47:18.753069 np0000004400 cinder-backup[101319]: node.session.auth.authmethod = None Jul 03 09:47:18.753069 np0000004400 cinder-backup[101319]: node.session.auth.username = Jul 03 09:47:18.753069 np0000004400 cinder-backup[101319]: node.session.auth.password = *** Jul 03 09:47:18.753069 np0000004400 cinder-backup[101319]: node.session.auth.username_in = Jul 03 09:47:18.753069 np0000004400 cinder-backup[101319]: node.session.auth.password_in = Jul 03 09:47:18.753069 np0000004400 cinder-backup[101319]: node.session.auth.chap_algs = SHA256 Jul 03 09:47:18.753069 np0000004400 cinder-backup[101319]: node.session.timeo.replacement_timeout = 120 Jul 03 09:47:18.753069 np0000004400 cinder-backup[101319]: node.session.err_timeo.abort_timeout = 15 Jul 03 09:47:18.753069 np0000004400 cinder-backup[101319]: node.session.err_timeo.lu_reset_timeout = 30 Jul 03 09:47:18.753069 np0000004400 cinder-backup[101319]: node.session.err_timeo.tgt_reset_timeout = 30 Jul 03 09:47:18.753069 np0000004400 cinder-backup[101319]: node.session.err_timeo.host_reset_timeout = 60 Jul 03 09:47:18.753069 np0000004400 cinder-backup[101319]: node.session.iscsi.FastAbort = Yes Jul 03 09:47:18.753069 np0000004400 cinder-backup[101319]: node.session.iscsi.InitialR2T = No Jul 03 09:47:18.753069 np0000004400 cinder-backup[101319]: node.session.iscsi.ImmediateData = Yes Jul 03 09:47:18.753069 np0000004400 cinder-backup[101319]: node.session.iscsi.FirstBurstLength = 262144 Jul 03 09:47:18.753069 np0000004400 cinder-backup[101319]: node.session.iscsi.MaxBurstLength = 16776192 Jul 03 09:47:18.753069 np0000004400 cinder-backup[101319]: node.session.iscsi.DefaultTime2Retain = 0 Jul 03 09:47:18.753069 np0000004400 cinder-backup[101319]: node.session.iscsi.DefaultTime2Wait = 2 Jul 03 09:47:18.753069 np0000004400 cinder-backup[101319]: node.session.iscsi.MaxConnections = 1 Jul 03 09:47:18.753069 np0000004400 cinder-backup[101319]: node.session.iscsi.MaxOutstandingR2T = 1 Jul 03 09:47:18.753069 np0000004400 cinder-backup[101319]: node.session.iscsi.ERL = 0 Jul 03 09:47:18.753069 np0000004400 cinder-backup[101319]: node.session.scan = auto Jul 03 09:47:18.753069 np0000004400 cinder-backup[101319]: node.session.reopen_max = 0 Jul 03 09:47:18.753069 np0000004400 cinder-backup[101319]: node.conn[0].address = 192.168.40.100 Jul 03 09:47:18.753069 np0000004400 cinder-backup[101319]: node.conn[0].port = 3260 Jul 03 09:47:18.753069 np0000004400 cinder-backup[101319]: node.conn[0].startup = manual Jul 03 09:47:18.753069 np0000004400 cinder-backup[101319]: node.conn[0].tcp.window_size = 524288 Jul 03 09:47:18.753069 np0000004400 cinder-backup[101319]: node.conn[0].tcp.type_of_service = 0 Jul 03 09:47:18.753069 np0000004400 cinder-backup[101319]: node.conn[0].timeo.logout_timeout = 15 Jul 03 09:47:18.753069 np0000004400 cinder-backup[101319]: node.conn[0].timeo.login_timeout = 15 Jul 03 09:47:18.753069 np0000004400 cinder-backup[101319]: node.conn[0].timeo.auth_timeout = 45 Jul 03 09:47:18.753069 np0000004400 cinder-backup[101319]: node.conn[0].timeo.noop_out_interval = 5 Jul 03 09:47:18.753069 np0000004400 cinder-backup[101319]: node.conn[0].timeo.noop_out_timeout = 5 Jul 03 09:47:18.753069 np0000004400 cinder-backup[101319]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0 Jul 03 09:47:18.753069 np0000004400 cinder-backup[101319]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144 Jul 03 09:47:18.753069 np0000004400 cinder-backup[101319]: node.conn[0].iscsi.HeaderDigest = None Jul 03 09:47:18.753069 np0000004400 cinder-backup[101319]: node.conn[0].iscsi.DataDigest = None Jul 03 09:47:18.753069 np0000004400 cinder-backup[101319]: node.conn[0].iscsi.IFMarker = No Jul 03 09:47:18.753069 np0000004400 cinder-backup[101319]: node.conn[0].iscsi.OFMarker = No Jul 03 09:47:18.753069 np0000004400 cinder-backup[101319]: # END RECORD Jul 03 09:47:18.753069 np0000004400 cinder-backup[101319]: stderr= {{(pid=101319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 03 09:47:18.764194 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-75ba68df-8a8d-48ad-9be6-295988b8d81d tempest-VolumesBackupsTest-2142009639 None] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=101319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 03 09:47:18.775893 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-75ba68df-8a8d-48ad-9be6-295988b8d81d tempest-VolumesBackupsTest-2142009639 None] iscsiadm ('-m', 'session'): stdout=tcp: [119] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-72e07e1e-1567-4071-8204-c29cb26d2660 (non-flash) Jul 03 09:47:18.775893 np0000004400 cinder-backup[101319]: tcp: [120] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8a0b1cfb-8ea1-46a0-aac3-b254107b98ef (non-flash) Jul 03 09:47:18.775893 np0000004400 cinder-backup[101319]: tcp: [121] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8a0b1cfb-8ea1-46a0-aac3-b254107b98ef (non-flash) Jul 03 09:47:18.775893 np0000004400 cinder-backup[101319]: stderr= {{(pid=101319) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jul 03 09:47:18.776164 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-75ba68df-8a8d-48ad-9be6-295988b8d81d tempest-VolumesBackupsTest-2142009639 None] iscsi session list stdout=tcp: [119] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-72e07e1e-1567-4071-8204-c29cb26d2660 (non-flash) Jul 03 09:47:18.776164 np0000004400 cinder-backup[101319]: tcp: [120] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8a0b1cfb-8ea1-46a0-aac3-b254107b98ef (non-flash) Jul 03 09:47:18.776164 np0000004400 cinder-backup[101319]: tcp: [121] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8a0b1cfb-8ea1-46a0-aac3-b254107b98ef (non-flash) Jul 03 09:47:18.776164 np0000004400 cinder-backup[101319]: stderr= {{(pid=101319) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jul 03 09:47:18.826878 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-75ba68df-8a8d-48ad-9be6-295988b8d81d tempest-VolumesBackupsTest-2142009639 None] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-298b8723-c4d1-455f-aef8-665b62a8001f, portal: 192.168.40.100,3260] Jul 03 09:47:18.826878 np0000004400 cinder-backup[101319]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-298b8723-c4d1-455f-aef8-665b62a8001f, portal: 192.168.40.100,3260] successful. Jul 03 09:47:18.826878 np0000004400 cinder-backup[101319]: stderr= {{(pid=101319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 03 09:47:18.841964 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-75ba68df-8a8d-48ad-9be6-295988b8d81d tempest-VolumesBackupsTest-2142009639 None] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=101319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 03 09:47:18.854198 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-75ba68df-8a8d-48ad-9be6-295988b8d81d tempest-VolumesBackupsTest-2142009639 None] iscsiadm ('-m', 'session'): stdout=tcp: [119] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-72e07e1e-1567-4071-8204-c29cb26d2660 (non-flash) Jul 03 09:47:18.854198 np0000004400 cinder-backup[101319]: tcp: [120] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8a0b1cfb-8ea1-46a0-aac3-b254107b98ef (non-flash) Jul 03 09:47:18.854198 np0000004400 cinder-backup[101319]: tcp: [121] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8a0b1cfb-8ea1-46a0-aac3-b254107b98ef (non-flash) Jul 03 09:47:18.854198 np0000004400 cinder-backup[101319]: tcp: [122] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-298b8723-c4d1-455f-aef8-665b62a8001f (non-flash) Jul 03 09:47:18.854198 np0000004400 cinder-backup[101319]: stderr= {{(pid=101319) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jul 03 09:47:18.854450 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-75ba68df-8a8d-48ad-9be6-295988b8d81d tempest-VolumesBackupsTest-2142009639 None] iscsi session list stdout=tcp: [119] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-72e07e1e-1567-4071-8204-c29cb26d2660 (non-flash) Jul 03 09:47:18.854450 np0000004400 cinder-backup[101319]: tcp: [120] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8a0b1cfb-8ea1-46a0-aac3-b254107b98ef (non-flash) Jul 03 09:47:18.854450 np0000004400 cinder-backup[101319]: tcp: [121] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8a0b1cfb-8ea1-46a0-aac3-b254107b98ef (non-flash) Jul 03 09:47:18.854450 np0000004400 cinder-backup[101319]: tcp: [122] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-298b8723-c4d1-455f-aef8-665b62a8001f (non-flash) Jul 03 09:47:18.854450 np0000004400 cinder-backup[101319]: stderr= {{(pid=101319) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jul 03 09:47:18.854720 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.base [None req-75ba68df-8a8d-48ad-9be6-295988b8d81d tempest-VolumesBackupsTest-2142009639 None] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-298b8723-c4d1-455f-aef8-665b62a8001f" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.140s {{(pid=101319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jul 03 09:47:18.854878 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-75ba68df-8a8d-48ad-9be6-295988b8d81d tempest-VolumesBackupsTest-2142009639 None] Connected to 192.168.40.100:3260 {{(pid=101319) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}} Jul 03 09:47:18.855722 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.linuxscsi [None req-75ba68df-8a8d-48ad-9be6-295988b8d81d tempest-VolumesBackupsTest-2142009639 None] HCTL ('10', '-', '-', 0) found on session 122 with lun 0 {{(pid=101319) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}} Jul 03 09:47:18.855869 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.linuxscsi [None req-75ba68df-8a8d-48ad-9be6-295988b8d81d tempest-VolumesBackupsTest-2142009639 None] Scanning host 10 c: -, t: -, l: 0) {{(pid=101319) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}} Jul 03 09:47:18.867228 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.linuxscsi [None req-75ba68df-8a8d-48ad-9be6-295988b8d81d tempest-VolumesBackupsTest-2142009639 None] Searching for a device in session 122 and hctl ['10', '*', '*', 0] yield: None {{(pid=101319) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}} Jul 03 09:47:19.307817 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-c0b6bb1f-d91f-43e7-be98-b7740c01c433 tempest-VolumesBackupsTest-118275719 None] Backing up chunk of data from volume. {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 09:47:19.308484 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-c0b6bb1f-d91f-43e7-be98-b7740c01c433 tempest-VolumesBackupsTest-118275719 None] Compressed 32768 bytes of data to 68 bytes using zlib. {{(pid=101319) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 09:47:19.308661 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-c0b6bb1f-d91f-43e7-be98-b7740c01c433 tempest-VolumesBackupsTest-118275719 None] About to put_object {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 09:47:19.340200 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-c0b6bb1f-d91f-43e7-be98-b7740c01c433 tempest-VolumesBackupsTest-118275719 None] backup MD5 for volume_72e07e1e-1567-4071-8204-c29cb26d2660/20260703094710/az_nova_backup_eba702ee-9959-40fe-9093-1eecff8dbaa6-00106: 0ac8838eee7696114147d95e0878e3b2 {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 09:47:19.340339 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-c0b6bb1f-d91f-43e7-be98-b7740c01c433 tempest-VolumesBackupsTest-118275719 None] Calling eventlet.sleep(0) {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 09:47:19.772321 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-c0b6bb1f-d91f-43e7-be98-b7740c01c433 tempest-VolumesBackupsTest-118275719 None] Backing up chunk of data from volume. {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 09:47:19.773247 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-c0b6bb1f-d91f-43e7-be98-b7740c01c433 tempest-VolumesBackupsTest-118275719 None] Compressed 65536 bytes of data to 428 bytes using zlib. {{(pid=101319) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 09:47:19.773397 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-c0b6bb1f-d91f-43e7-be98-b7740c01c433 tempest-VolumesBackupsTest-118275719 None] About to put_object {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 09:47:19.795379 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-c0b6bb1f-d91f-43e7-be98-b7740c01c433 tempest-VolumesBackupsTest-118275719 None] backup MD5 for volume_72e07e1e-1567-4071-8204-c29cb26d2660/20260703094710/az_nova_backup_eba702ee-9959-40fe-9093-1eecff8dbaa6-00107: a6fa469c52e2f95b4fdf7f6887a8d1e2 {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 09:47:19.795616 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-c0b6bb1f-d91f-43e7-be98-b7740c01c433 tempest-VolumesBackupsTest-118275719 None] Calling eventlet.sleep(0) {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 09:47:19.868869 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.linuxscsi [None req-75ba68df-8a8d-48ad-9be6-295988b8d81d tempest-VolumesBackupsTest-2142009639 None] Searching for a device in session 122 and hctl ['10', '*', '*', 0] yield: sde {{(pid=101319) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}} Jul 03 09:47:19.869118 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-75ba68df-8a8d-48ad-9be6-295988b8d81d tempest-VolumesBackupsTest-2142009639 None] Connected to sde using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-298b8723-c4d1-455f-aef8-665b62a8001f', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '298b8723-c4d1-455f-aef8-665b62a8001f', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': False} {{(pid=101319) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}} Jul 03 09:47:19.869892 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.base [None req-75ba68df-8a8d-48ad-9be6-295988b8d81d tempest-VolumesBackupsTest-2142009639 None] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 2.167s {{(pid=101319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jul 03 09:47:19.870146 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-75ba68df-8a8d-48ad-9be6-295988b8d81d tempest-VolumesBackupsTest-2142009639 None] <== connect_volume: return (2167ms) {'type': 'block', 'scsi_wwn': '33000000090d3e696', 'path': '/dev/sde'} {{(pid=101319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}} Jul 03 09:47:19.870588 np0000004400 cinder-backup[101319]: DEBUG oslo_concurrency.processutils [None req-75ba68df-8a8d-48ad-9be6-295988b8d81d tempest-VolumesBackupsTest-2142009639 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chown 1002 /dev/sde {{(pid=101319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 09:47:19.895792 np0000004400 sudo[140817]: stack : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chown 1002 /dev/sde Jul 03 09:47:19.896492 np0000004400 sudo[140817]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1002) Jul 03 09:47:20.366203 np0000004400 sudo[140817]: pam_unix(sudo:session): session closed for user root Jul 03 09:47:20.369245 np0000004400 cinder-backup[101319]: DEBUG oslo_concurrency.processutils [None req-75ba68df-8a8d-48ad-9be6-295988b8d81d tempest-VolumesBackupsTest-2142009639 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chown 1002 /dev/sde" returned: 0 in 0.497s {{(pid=101319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 09:47:20.374568 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-75ba68df-8a8d-48ad-9be6-295988b8d81d tempest-VolumesBackupsTest-2142009639 None] _create_container started, container: tempest-volumesbackupstest-backup-container-106419071,backup: 86118233-3d57-47ad-8781-cab6c54e4d53. {{(pid=101319) _create_container /opt/stack/cinder/cinder/backup/chunkeddriver.py:249}} Jul 03 09:47:20.435754 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.drivers.swift [None req-75ba68df-8a8d-48ad-9be6-295988b8d81d tempest-VolumesBackupsTest-2142009639 None] generate_object_name_prefix: volume_8a0b1cfb-8ea1-46a0-aac3-b254107b98ef/20260703094720/az_nova_backup_86118233-3d57-47ad-8781-cab6c54e4d53 {{(pid=101319) _generate_object_name_prefix /opt/stack/cinder/cinder/backup/drivers/swift.py:452}} Jul 03 09:47:20.441759 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-75ba68df-8a8d-48ad-9be6-295988b8d81d tempest-VolumesBackupsTest-2142009639 None] starting backup of volume: 8a0b1cfb-8ea1-46a0-aac3-b254107b98ef, volume size: 1073741824, object names prefix volume_8a0b1cfb-8ea1-46a0-aac3-b254107b98ef/20260703094720/az_nova_backup_86118233-3d57-47ad-8781-cab6c54e4d53, availability zone: nova {{(pid=101319) _prepare_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:359}} Jul 03 09:47:20.472431 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-c0b6bb1f-d91f-43e7-be98-b7740c01c433 tempest-VolumesBackupsTest-118275719 None] Backing up chunk of data from volume. {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 09:47:20.473386 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-c0b6bb1f-d91f-43e7-be98-b7740c01c433 tempest-VolumesBackupsTest-118275719 None] Compressed 32768 bytes of data to 68 bytes using zlib. {{(pid=101319) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 09:47:20.473700 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-c0b6bb1f-d91f-43e7-be98-b7740c01c433 tempest-VolumesBackupsTest-118275719 None] About to put_object {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 09:47:20.507077 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-c0b6bb1f-d91f-43e7-be98-b7740c01c433 tempest-VolumesBackupsTest-118275719 None] backup MD5 for volume_72e07e1e-1567-4071-8204-c29cb26d2660/20260703094710/az_nova_backup_eba702ee-9959-40fe-9093-1eecff8dbaa6-00108: 0ac8838eee7696114147d95e0878e3b2 {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 09:47:20.507286 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-c0b6bb1f-d91f-43e7-be98-b7740c01c433 tempest-VolumesBackupsTest-118275719 None] Calling eventlet.sleep(0) {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 09:47:20.756928 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-75ba68df-8a8d-48ad-9be6-295988b8d81d tempest-VolumesBackupsTest-2142009639 None] Backing up chunk of data from volume. {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 09:47:21.036596 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-75ba68df-8a8d-48ad-9be6-295988b8d81d tempest-VolumesBackupsTest-2142009639 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101319) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 09:47:21.036596 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-75ba68df-8a8d-48ad-9be6-295988b8d81d tempest-VolumesBackupsTest-2142009639 None] About to put_object {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 09:47:21.778895 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-75ba68df-8a8d-48ad-9be6-295988b8d81d tempest-VolumesBackupsTest-2142009639 None] backup MD5 for volume_8a0b1cfb-8ea1-46a0-aac3-b254107b98ef/20260703094720/az_nova_backup_86118233-3d57-47ad-8781-cab6c54e4d53-00001: 25e317773f308e446cc84c503a6d1f85 {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 09:47:21.778895 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-75ba68df-8a8d-48ad-9be6-295988b8d81d tempest-VolumesBackupsTest-2142009639 None] Calling eventlet.sleep(0) {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 09:47:21.778895 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-c0b6bb1f-d91f-43e7-be98-b7740c01c433 tempest-VolumesBackupsTest-118275719 None] Backing up chunk of data from volume. {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 09:47:21.778895 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-c0b6bb1f-d91f-43e7-be98-b7740c01c433 tempest-VolumesBackupsTest-118275719 None] Compressed 65536 bytes of data to 439 bytes using zlib. {{(pid=101319) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 09:47:21.778895 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-c0b6bb1f-d91f-43e7-be98-b7740c01c433 tempest-VolumesBackupsTest-118275719 None] About to put_object {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 09:47:21.778895 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-c0b6bb1f-d91f-43e7-be98-b7740c01c433 tempest-VolumesBackupsTest-118275719 None] backup MD5 for volume_72e07e1e-1567-4071-8204-c29cb26d2660/20260703094710/az_nova_backup_eba702ee-9959-40fe-9093-1eecff8dbaa6-00109: 3f1e4849348e19cc3e4f2affb2c2a15a {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 09:47:21.778895 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-c0b6bb1f-d91f-43e7-be98-b7740c01c433 tempest-VolumesBackupsTest-118275719 None] Calling eventlet.sleep(0) {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 09:47:21.778895 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-75ba68df-8a8d-48ad-9be6-295988b8d81d tempest-VolumesBackupsTest-2142009639 None] Backing up chunk of data from volume. {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 09:47:21.778895 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-c0b6bb1f-d91f-43e7-be98-b7740c01c433 tempest-VolumesBackupsTest-118275719 None] Backing up chunk of data from volume. {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 09:47:21.778895 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-c0b6bb1f-d91f-43e7-be98-b7740c01c433 tempest-VolumesBackupsTest-118275719 None] Compressed 32768 bytes of data to 258 bytes using zlib. {{(pid=101319) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 09:47:21.778895 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-c0b6bb1f-d91f-43e7-be98-b7740c01c433 tempest-VolumesBackupsTest-118275719 None] About to put_object {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 09:47:21.778895 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-c0b6bb1f-d91f-43e7-be98-b7740c01c433 tempest-VolumesBackupsTest-118275719 None] backup MD5 for volume_72e07e1e-1567-4071-8204-c29cb26d2660/20260703094710/az_nova_backup_eba702ee-9959-40fe-9093-1eecff8dbaa6-00110: ccd615116dcb4026c3f50f53f219fe04 {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 09:47:21.778895 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-c0b6bb1f-d91f-43e7-be98-b7740c01c433 tempest-VolumesBackupsTest-118275719 None] Calling eventlet.sleep(0) {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 09:47:21.778895 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.driver [None req-c0b6bb1f-d91f-43e7-be98-b7740c01c433 tempest-VolumesBackupsTest-118275719 None] Getting metadata type 'volume-base-metadata' {{(pid=101319) _save_vol_base_meta /opt/stack/cinder/cinder/backup/driver.py:79}} Jul 03 09:47:21.778895 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.driver [None req-c0b6bb1f-d91f-43e7-be98-b7740c01c433 tempest-VolumesBackupsTest-118275719 None] Completed fetching metadata type 'volume-base-metadata' {{(pid=101319) _save_vol_base_meta /opt/stack/cinder/cinder/backup/driver.py:98}} Jul 03 09:47:21.778895 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.driver [None req-c0b6bb1f-d91f-43e7-be98-b7740c01c433 tempest-VolumesBackupsTest-118275719 None] Getting metadata type 'volume-metadata' {{(pid=101319) _save_vol_meta /opt/stack/cinder/cinder/backup/driver.py:109}} Jul 03 09:47:21.778895 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.driver [None req-c0b6bb1f-d91f-43e7-be98-b7740c01c433 tempest-VolumesBackupsTest-118275719 None] No metadata type 'volume-metadata' available {{(pid=101319) _save_vol_meta /opt/stack/cinder/cinder/backup/driver.py:123}} Jul 03 09:47:21.778895 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.driver [None req-c0b6bb1f-d91f-43e7-be98-b7740c01c433 tempest-VolumesBackupsTest-118275719 None] Getting metadata type 'volume-glance-metadata' {{(pid=101319) _save_vol_glance_meta /opt/stack/cinder/cinder/backup/driver.py:132}} Jul 03 09:47:21.778895 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.driver [None req-c0b6bb1f-d91f-43e7-be98-b7740c01c433 tempest-VolumesBackupsTest-118275719 None] Completed fetching metadata type 'volume-glance-metadata' {{(pid=101319) _save_vol_glance_meta /opt/stack/cinder/cinder/backup/driver.py:145}} Jul 03 09:47:21.778895 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-c0b6bb1f-d91f-43e7-be98-b7740c01c433 tempest-VolumesBackupsTest-118275719 None] _write_sha256file started, container name: volumebackups, sha256file filename: volume_72e07e1e-1567-4071-8204-c29cb26d2660/20260703094710/az_nova_backup_eba702ee-9959-40fe-9093-1eecff8dbaa6_sha256file. {{(pid=101319) _write_sha256file /opt/stack/cinder/cinder/backup/chunkeddriver.py:299}} Jul 03 09:47:21.778895 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-75ba68df-8a8d-48ad-9be6-295988b8d81d tempest-VolumesBackupsTest-2142009639 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101319) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 09:47:21.778895 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-75ba68df-8a8d-48ad-9be6-295988b8d81d tempest-VolumesBackupsTest-2142009639 None] About to put_object {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 09:47:21.778895 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-c0b6bb1f-d91f-43e7-be98-b7740c01c433 tempest-VolumesBackupsTest-118275719 None] _write_sha256file finished. {{(pid=101319) _write_sha256file /opt/stack/cinder/cinder/backup/chunkeddriver.py:315}} Jul 03 09:47:21.778895 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-c0b6bb1f-d91f-43e7-be98-b7740c01c433 tempest-VolumesBackupsTest-118275719 None] _write_metadata started, container name: volumebackups, metadata filename: volume_72e07e1e-1567-4071-8204-c29cb26d2660/20260703094710/az_nova_backup_eba702ee-9959-40fe-9093-1eecff8dbaa6_metadata. {{(pid=101319) _write_metadata /opt/stack/cinder/cinder/backup/chunkeddriver.py:276}} Jul 03 09:47:21.789182 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-c0b6bb1f-d91f-43e7-be98-b7740c01c433 tempest-VolumesBackupsTest-118275719 None] _write_metadata finished. Metadata: b'{\n "backup_description": null,\n "backup_id": "eba702ee-9959-40fe-9093-1eecff8dbaa6",\n "backup_name": "tempest-VolumesBackupsTest-Backup-984442641",\n "created_at": "2026-07-03 09:47:07+00:00",\n "objects": [\n {\n "volume_72e07e1e-1567-4071-8204-c29cb26d2660/20260703094710/az_nova_backup_eba702ee-9959-40fe-9093-1eecff8dbaa6-00001": {\n "compression": "zlib",\n "length": 32768,\n "md5": "7455b0146d203e0450dd14035351df50",\n "offset": 0\n }\n },\n {\n "volume_72e07e1e-1567-4071-8204-c29cb26d2660/20260703094710/az_nova_backup_eba702ee-9959-40fe-9093-1eecff8dbaa6-00002": {\n "compression": "zlib",\n "length": 294912,\n "md5": "f894e3de84554e2c3d9abe14489ed190",\n "offset": 9437184\n }\n },\n {\n "volume_72e07e1e-1567-4071-8204-c29cb26d2660/20260703094710/az_nova_backup_eba702ee-9959-40fe-9093-1eecff8dbaa6-00003": {\n "compression": "zlib",\n "length": 2195456,\n "md5": "89ec4da3acc51ee3a662b9b401b603ec",\n "offset": 16023552\n }\n },\n {\n "volume_72e07e1e-1567-4071-8204-c29cb26d2660/20260703094710/az_nova_backup_eba702ee-9959-40fe-9093-1eecff8dbaa6-00004": {\n "compression": "zlib",\n "length": 98304,\n "md5": "e1554f9208060479cb8c0e2b20ce3092",\n "offset": 20283392\n }\n },\n {\n "volume_72e07e1e-1567-4071-8204-c29cb26d2660/20260703094710/az_nova_backup_eba702ee-9959-40fe-9093-1eecff8dbaa6-00005": {\n "compression": "zlib",\n "length": 360448,\n "md5": "260e04b2b4be4a8fb9af5bcaeef77f5e",\n "offset": 20414464\n }\n },\n {\n "volume_72e07e1e-1567-4071-8204-c29cb26d2660/20260703094710/az_nova_backup_eba702ee-9959-40fe-9093-1eecff8dbaa6-00006": {\n "compression": "zlib",\n "length": 262144,\n "md5": "7e4882497657c646c554c5ad835c0cf5",\n "offset": 20840448\n }\n },\n {\n "volume_72e07e1e-1567-4071-8204-c29cb26d2660/20260703094710/az_nova_backup_eba702ee-9959-40fe-9093-1eecff8dbaa6-00007": {\n "compression": "zlib",\n "length": 32768,\n "md5": "d9cd9a4fb7c178bffad872b9fd1c6616",\n "offset": 21364736\n }\n },\n {\n "volume_72e07e1e-1567-4071-8204-c29cb26d2660/20260703094710/az_nova_backup_eba702ee-9959-40fe-9093-1eecff8dbaa6-00008": {\n "compression": "zlib",\n "length": 524288,\n "md5": "89771b482f431367ab05882b853a01a6",\n "offset": 21528576\n }\n },\n {\n "volume_72e07e1e-1567-4071-8204-c29cb26d2660/20260703094710/az_nova_backup_eba702ee-9959-40fe-9093-1eecff8dbaa6-00009": {\n "compression": "zlib",\n "length": 98304,\n "md5": "807f8f1c74646a8f9592027f16d2643d",\n "offset": 22085632\n }\n },\n {\n "volume_72e07e1e-1567-4071-8204-c29cb26d2660/20260703094710/az_nova_backup_eba702ee-9959-40fe-9093-1eecff8dbaa6-00010": {\n "compression": "zlib",\n "length": 65536,\n "md5": "035de9616151b09d26063aaf3786be98",\n "offset": 22282240\n }\n },\n {\n "volume_72e07e1e-1567-4071-8204-c29cb26d2660/20260703094710/az_nova_backup_eba702ee-9959-40fe-9093-1eecff8dbaa6-00011": {\n "compression": "zlib",\n "length": 327680,\n "md5": "f941eba3270410ec15b7aff819b8b0c0",\n "offset": 22478848\n }\n },\n {\n "volume_72e07e1e-1567-4071-8204-c29cb26d2660/20260703094710/az_nova_backup_eba702ee-9959-40fe-9093-1eecff8dbaa6-00012": {\n "compression": "zlib",\n "length": 327680,\n "md5": "ba683c210943a225502816568e3b8d00",\n "offset": 22872064\n }\n },\n {\n "volume_72e07e1e-1567-4071-8204-c29cb26d2660/20260703094710/az_nova_backup_eba702ee-9959-40fe-9093-1eecff8dbaa6-00013": {\n "compression": "zlib",\n "length": 65536,\n "md5": "e88548713f69de90eef0cd6c4e9796dd",\n "offset": 23265280\n }\n },\n {\n "volume_72e07e1e-1567-4071-8204-c29cb26d2660/20260703094710/az_nova_backup_eba702ee-9959-40fe-9093-1eecff8dbaa6-00014": {\n "compression": "zlib",\n "length": 393216,\n "md5": "01e3e2d3510c4223690a6849e71496ab",\n "offset": 23396352\n }\n },\n {\n "volume_72e07e1e-1567-4071-8204-c29cb26d2660/20260703094710/az_nova_backup_eba702ee-9959-40fe-9093-1eecff8dbaa6-00015": {\n "compression": "zlib",\n "length": 131072,\n "md5": "599805a91aa71f961c3787a61e7c5729",\n "offset": 23855104\n }\n },\n {\n "volume_72e07e1e-1567-4071-8204-c29cb26d2660/20260703094710/az_nova_backup_eba702ee-9959-40fe-9093-1eecff8dbaa6-00016": {\n "compression": "zlib",\n "length": 65536,\n "md5": "179b961161bdaa477c7c01ad80585eee",\n "offset": 24051712\n }\n },\n {\n "volume_72e07e1e-1567-4071-8204-c29cb26d2660/20260703094710/az_nova_backup_eba702ee-9959-40fe-9093-1eecff8dbaa6-00017": {\n "compression": "zlib",\n "length": 131072,\n "md5": "d27aa048e7ec9b4cbc6afc435ead70f6",\n "offset": 24510464\n }\n },\n {\n "volume_72e07e1e-1567-4071-8204-c29cb26d2660/20260703094710/az_nova_backup_eba702ee-9959-40fe-9093-1eecff8dbaa6-00018": {\n "compression": "zlib",\n "length": 786432,\n "md5": "93a49a74b3f385db27466765f9e213d9",\n "offset": 24707072\n }\n },\n {\n "volume_72e07e1e-1567-4071-8204-c29cb26d2660/20260703094710/az_nova_backup_eba702ee-9959-40fe-9093-1eecff8dbaa6-00019": {\n "compression": "zlib",\n "length": 65536,\n "md5": "fb0b4c9f443eae7a19740e071a10002c",\n "offset": 25624576\n }\n },\n {\n "volume_72e07e1e-1567-4071-8204-c29cb26d2660/20260703094710/az_nova_backup_eba702ee-9959-40fe-9093-1eecff8dbaa6-00020": {\n "compression": "zlib",\n "length": 2293760,\n "md5": "00920597fdfc0422ef27d3428f71089e",\n "offset": 26214400\n }\n },\n {\n "volume_72e07e1e-1567-4071-8204-c29cb26d2660/20260703094710/az_nova_backup_eba702ee-9959-40fe-9093-1eecff8dbaa6-00021": {\n "compression": "zlib",\n "length": 262144,\n "md5": "600a0ec270d9626014f041f394a91dec",\n "offset": 28606464\n }\n },\n {\n "volume_72e07e1e-1567-4071-8204-c29cb26d2660/20260703094710/az_nova_backup_eba702ee-9959-40fe-9093-1eecff8dbaa6-00022": {\n "compression": "zlib",\n "length": 65536,\n "md5": "d74672ad69032d6511c7f86b7b0cdb23",\n "offset": 29032448\n }\n },\n {\n "volume_72e07e1e-1567-4071-8204-c29cb26d2660/20260703094710/az_nova_backup_eba702ee-9959-40fe-9093-1eecff8dbaa6-00023": {\n "compression": "zlib",\n "length": 98304,\n "md5": "b26d859ed07de20dd16d0c165a4e6a3a",\n "offset": 29425664\n }\n },\n {\n "volume_72e07e1e-1567-4071-8204-c29cb26d2660/20260703094710/az_nova_backup_eba702ee-9959-40fe-9093-1eecff8dbaa6-00024": {\n "compression": "zlib",\n "length": 294912,\n "md5": "17812a659c805b2d08ad0ffbac17f523",\n "offset": 29622272\n }\n },\n {\n "volume_72e07e1e-1567-4071-8204-c29cb26d2660/20260703094710/az_nova_backup_eba702ee-9959-40fe-9093-1eecff8dbaa6-00025": {\n "compression": "zlib",\n "length": 65536,\n "md5": "900ba3be5febaa4a7e8d4fe06a9e5bbe",\n "offset": 30081024\n }\n },\n {\n "volume_72e07e1e-1567-4071-8204-c29cb26d2660/20260703094710/az_nova_backup_eba702ee-9959-40fe-9093-1eecff8dbaa6-00026": {\n "compression": "zlib",\n "length": 32768,\n "md5": "7b83ad270600f54dc0ce5f973398f4a1",\n "offset": 30212096\n }\n },\n {\n "volume_72e07e1e-1567-4071-8204-c29cb26d2660/20260703094710/az_nova_backup_eba702ee-9959-40fe-9093-1eecff8dbaa6-00027": {\n "compression": "zlib",\n "length": 32768,\n "md5": "a31179c9f17d2086e474bbff2d8b9fa5",\n "offset": 30343168\n }\n },\n {\n "volume_72e07e1e-1567-4071-8204-c29cb26d2660/20260703094710/az_nova_backup_eba702ee-9959-40fe-9093-1eecff8dbaa6-00028": {\n "compression": "zlib",\n "length": 98304,\n "md5": "86d6719d73ca0214c25634aedc7fe9d9",\n "offset": 32636928\n }\n },\n {\n "volume_72e07e1e-1567-4071-8204-c29cb26d2660/20260703094710/az_nova_backup_eba702ee-9959-40fe-9093-1eecff8dbaa6-00029": {\n "compression": "zlib",\n "length": 98304,\n "md5": "fdf44fcafc023cb46fe41182b8e073b8",\n "offset": 32833536\n }\n },\n {\n "volume_72e07e1e-1567-4071-8204-c29cb26d2660/20260703094710/az_nova_backup_eba702ee-9959-40fe-9093-1eecff8dbaa6-00030": {\n "compression": "zlib",\n "length": 524288,\n "md5": "5815c96da9bc9be47f2dde7f69ddd130",\n "offset": 33030144\n }\n },\n {\n "volume_72e07e1e-1567-4071-8204-c29cb26d2660/20260703094710/az_nova_backup_eba702ee-9959-40fe-9093-1eecff8dbaa6-00031": {\n "compression": "zlib",\n "length": 131072,\n "md5": "7ecd5b62ea9a77dd27d5058cc0b2af3a",\n "offset": 33619968\n }\n },\n {\n "volume_72e07e1e-1567-4071-8204-c29cb26d2660/20260703094710/az_nova_backup_eba702ee-9959-40fe-9093-1eecff8dbaa6-00032": {\n "compression": "zlib",\n "length": 294912,\n "md5": "185eea5b60ee84638ea2ef67b051e400",\n "offset": 33849344\n }\n },\n {\n "volume_72e07e1e-1567-4071-8204-c29cb26d2660/20260703094710/az_nova_backup_eba702ee-9959-40fe-9093-1eecff8dbaa6-00033": {\n "compression": "zlib",\n "length": 32768,\n "md5": "e41a77e44d240ad8104d5fb9712151e4",\n "offset": 34275328\n }\n },\n {\n "volume_72e07e1e-1567-4071-8204-c29cb26d2660/20260703094710/az_nova_backup_eba702ee-9959-40fe-9093-1eecff8dbaa6-00034": {\n "compression": "zlib",\n "length": 65536,\n "md5": "a7a0eee90ff873fe50f294cf33e7de2d",\n "offset": 34406400\n }\n },\n {\n "volume_72e07e1e-1567-4071-8204-c29cb26d2660/20260703094710/az_nova_backup_eba702ee-9959-40fe-9093-1eecff8dbaa6-00035": {\n "compression": "zlib",\n "length": 65536,\n "md5": "5a96fd0be63a553958c90d4a4316c4de",\n "offset": 34537472\n }\n },\n {\n "volume_72e07e1e-1567-4071-8204-c29cb26d2660/20260703094710/az_nova_backup_eba702ee-9959-40fe-9093-1eecff8dbaa6-00036": {\n "compression": "zlib",\n "length": 98304,\n "md5": "b02b4173598f30151430937bc55a6faf",\n "offset": 38797312\n }\n },\n {\n "volume_72e07e1e-1567-4071-8204-c29cb26d2660/20260703094710/az_nova_backup_eba702ee-9959-40fe-9093-1eecff8dbaa6-00037": {\n "compression": "zlib",\n "length": 262144,\n "md5": "b7e2d07e021e740544325541d67b7329",\n "offset": 38928384\n }\n },\n {\n "volume_72e07e1e-1567-4071-8204-c29cb26d2660/20260703094710/az_nova_backup_eba702ee-9959-40fe-9093-1eecff8dbaa6-00038": {\n "compression": "zlib",\n "length": 32768,\n "md5": "00fb2cc13328ca425a2eca1e6c7c4e6d",\n "offset": 39256064\n }\n },\n {\n "volume_72e07e1e-1567-4071-8204-c29cb26d2660/20260703094710/az_nova_backup_eba702ee-9959-40fe-9093-1eecff8dbaa6-00039": {\n "compression": "zlib",\n "length": 32768,\n "md5": "d11036511ad7f5dbe776a742c58f87ea",\n "offset": 40370176\n }\n },\n {\n "volume_72e07e1e-1567-4071-8204-c29cb26d2660/20260703094710/az_nova_backup_eba702ee-9959-40fe-9093-1eecff8dbaa6-00040": {\n "compression": "zlib",\n "length": 32768,\n "md5": "c4ed5bf65e3847ac3a3103aeb9f043f9",\n "offset": 40566784\n }\n },\n {\n "volume_72e07e1e-1567-4071-8204-c29cb26d2660/20260703094710/az_nova_backup_eba702ee-9959-40fe-9093-1eecff8dbaa6-00041": {\n "compression": "zlib",\n "length": 32768,\n "md5": "2abba25a77ee36c58131400ef11e9b33",\n "offset": 40697856\n }\n },\n {\n "volume_72e07e1e-1567-4071-8204-c29cb26d2660/20260703094710/az_nova_backup_eba702ee-9959-40fe-9093-1eecff8dbaa6-00042": {\n "compression": "zlib",\n "length": 65536,\n "md5": "58c33934aea3dc04d999003f5971d3e1",\n "offset": 40828928\n }\n },\n {\n "volume_72e07e1e-1567-4071-8204-c29cb26d2660/20260703094710/az_nova_backup_eba702ee-9959-40fe-9093-1eecff8dbaa6-00043": {\n "compression": "zlib",\n "length": 65536,\n "md5": "90971d6560092661366d4a8e0d690316",\n "offset": 46399488\n }\n },\n {\n "volume_72e07e1e-1567-4071-8204-c29cb26d2660/20260703094710/az_nova_backup_eba702ee-9959-40fe-9093-1eecff8dbaa6-00044": {\n "compression": "zlib",\n "length": 32768,\n "md5": "6d63cabe5cbd45d0e7748b702fb3237f",\n "offset": 46596096\n }\n },\n {\n "volume_72e07e1e-1567-4071-8204-c29cb26d2660/20260703094710/az_nova_backup_eba702ee-9959-40fe-9093-1eecff8dbaa6-00045": {\n "compression": "zlib",\n "length": 229376,\n "md5": "b63363b73e33269b13a4b9007772caea",\n "offset": 52199424\n }\n },\n {\n "volume_72e07e1e-1567-4071-8204-c29cb26d2660/20260703094710/az_nova_backup_eba702ee-9959-40fe-9093-1eecff8dbaa6-00046": {\n "compression": "zlib",\n "length": 32768,\n "md5": "7ad27b3399ebe8e17313a1edd45d2a4c",\n "offset": 52428800\n }\n },\n {\n "volume_72e07e1e-1567-4071-8204-c29cb26d2660/20260703094710/az_nova_backup_eba702ee-9959-40fe-9093-1eecff8dbaa6-00047": {\n "compression": "zlib",\n "length": 65536,\n "md5": "b2f4bed0ea8034625ddd32034addd197",\n "offset": 52494336\n }\n },\n {\n "volume_72e07e1e-1567-4071-8204-c29cb26d2660/20260703094710/az_nova_backup_eba702ee-9959-40fe-9093-1eecff8dbaa6-00048": {\n "compression": "zlib",\n "length": 65536,\n "md5": "e2ae44a38272f3786b389fe25de025f7",\n "offset": 52592640\n }\n },\n {\n "volume_72e07e1e-1567-4071-8204-c29cb26d2660/20260703094710/az_nova_backup_eba702ee-9959-40fe-9093-1eecff8dbaa6-00049": {\n "compression": "zlib",\n "length": 131072,\n "md5": "459edd959d71fc76632140b2c1c2afd7",\n "offset": 52756480\n }\n },\n {\n "volume_72e07e1e-1567-4071-8204-c29cb26d2660/20260703094710/az_nova_backup_eba702ee-9959-40fe-9093-1eecff8dbaa6-00050": {\n "compression": "zlib",\n "length": 262144,\n "md5": "9f03bd9a5f1f3681ce923853068a5391",\n "offset": 52953088\n }\n },\n {\n "volume_72e07e1e-1567-4071-8204-c29cb26d2660/20260703094710/az_nova_backup_eba702ee-9959-40fe-9093-1eecff8dbaa6-00051": {\n "compression": "zlib",\n "length": 32768,\n "md5": "808b8e5ae0ebfa3ebee1f25e56d7380e",\n "offset": 53280768\n }\n },\n {\n "volume_72e07e1e-1567-4071-8204-c29cb26d2660/20260703094710/az_nova_backup_eba702ee-9959-40fe-9093-1eecff8dbaa6-00052": {\n "compression": "zlib",\n "length": 2162688,\n "md5": "be8d468a957514fe7be30768655b7463",\n "offset": 53411840\n }\n },\n {\n "volume_72e07e1e-1567-4071-8204-c29cb26d2660/20260703094710/az_nova_backup_eba702ee-9959-40fe-9093-1eecff8dbaa6-00053": {\n "compression": "zlib",\n "length": 131072,\n "md5": "ac2c3b7f365746cfcedfa3644641f133",\n "offset": 55640064\n }\n },\n {\n "volume_72e07e1e-1567-4071-8204-c29cb26d2660/20260703094710/az_nova_backup_eba702ee-9959-40fe-9093-1eecff8dbaa6-00054": {\n "compression": "zlib",\n "length": 262144,\n "md5": "d4e16afa8ee08db846e947df5b4ec08b",\n "offset": 55869440\n }\n },\n {\n "volume_72e07e1e-1567-4071-8204-c29cb26d2660/20260703094710/az_nova_backup_eba702ee-9959-40fe-9093-1eecff8dbaa6-00055": {\n "compression": "zlib",\n "length": 196608,\n "md5": "86d6f3eb5f3f66b3bd977ec8c039a49c",\n "offset": 56295424\n }\n },\n {\n "volume_72e07e1e-1567-4071-8204-c29cb26d2660/20260703094710/az_nova_backup_eba702ee-9959-40fe-9093-1eecff8dbaa6-00056": {\n "compression": "zlib",\n "length": 196608,\n "md5": "933534e51561c890b382aa9eb4c5764c",\n "offset": 56557568\n }\n },\n {\n "volume_72e07e1e-1567-4071-8204-c29cb26d2660/20260703094710/az_nova_backup_eba702ee-9959-40fe-9093-1eecff8dbaa6-00057": {\n "compression": "zlib",\n "length": 32768,\n "md5": "0f7cdc5b89fbb7316ab86f111715879e",\n "offset": 56819712\n }\n },\n {\n "volume_72e07e1e-1567-4071-8204-c29cb26d2660/20260703094710/az_nova_backup_eba702ee-9959-40fe-9093-1eecff8dbaa6-00058": {\n "compression": "zlib",\n "length": 65536,\n "md5": "b3534e7bd21436d93d6e15ceae51ecbb",\n "offset": 56950784\n }\n },\n {\n "volume_72e07e1e-1567-4071-8204-c29cb26d2660/20260703094710/az_nova_backup_eba702ee-9959-40fe-9093-1eecff8dbaa6-00059": {\n "compression": "zlib",\n "length": 65536,\n "md5": "308e5172c7191c405029e68eb339b63e",\n "offset": 57081856\n }\n },\n {\n "volume_72e07e1e-1567-4071-8204-c29cb26d2660/20260703094710/az_nova_backup_eba702ee-9959-40fe-9093-1eecff8dbaa6-00060": {\n "compression": "zlib",\n "length": 98304,\n "md5": "87fed698449bb429c84cea142b47074f",\n "offset": 57212928\n }\n },\n {\n "volume_72e07e1e-1567-4071-8204-c29cb26d2660/20260703094710/az_nova_backup_eba702ee-9959-40fe-9093-1eecff8dbaa6-00061": {\n "compression": "zlib",\n "length": 32768,\n "md5": "8577057e39906809834d6bbe62984d84",\n "offset": 57475072\n }\n },\n {\n "volume_72e07e1e-1567-4071-8204-c29cb26d2660/20260703094710/az_nova_backup_eba702ee-9959-40fe-9093-1eecff8dbaa6-00062": {\n "compression": "zlib",\n "length": 2162688,\n "md5": "286f32389d41ccb3a7454011b7fe833b",\n "offset": 57606144\n }\n },\n {\n "volume_72e07e1e-1567-4071-8204-c29cb26d2660/20260703094710/az_nova_backup_eba702ee-9959-40fe-9093-1eecff8dbaa6-00063": {\n "compression": "zlib",\n "length": 131072,\n "md5": "07f83a91f2a65593c97ccde75e2cdb1a",\n "offset": 59834368\n }\n },\n {\n "volume_72e07e1e-1567-4071-8204-c29cb26d2660/20260703094710/az_nova_backup_eba702ee-9959-40fe-9093-1eecff8dbaa6-00064": {\n "compression": "zlib",\n "length": 32768,\n "md5": "472694eb9fd935b65a675e05db84ae55",\n "offset": 60030976\n }\n },\n {\n "volume_72e07e1e-1567-4071-8204-c29cb26d2660/20260703094710/az_nova_backup_eba702ee-9959-40fe-9093-1eecff8dbaa6-00065": {\n "compression": "zlib",\n "length": 163840,\n "md5": "7bbd91225a7ad728f1ee251495d662a3",\n "offset": 60227584\n }\n },\n {\n "volume_72e07e1e-1567-4071-8204-c29cb26d2660/20260703094710/az_nova_backup_eba702ee-9959-40fe-9093-1eecff8dbaa6-00066": {\n "compression": "zlib",\n "length": 196608,\n "md5": "9c2c443a510acae20e828ca784ea0ef0",\n "offset": 60489728\n }\n },\n {\n "volume_72e07e1e-1567-4071-8204-c29cb26d2660/20260703094710/az_nova_backup_eba702ee-9959-40fe-9093-1eecff8dbaa6-00067": {\n "compression": "zlib",\n "length": 32768,\n "md5": "f15596026d78fb5a6c33e31e645c1bc0",\n "offset": 60751872\n }\n },\n {\n "volume_72e07e1e-1567-4071-8204-c29cb26d2660/20260703094710/az_nova_backup_eba702ee-9959-40fe-9093-1eecff8dbaa6-00068": {\n "compression": "zlib",\n "length": 131072,\n "md5": "01e07b6ff49d49600cff2b5f037b5585",\n "offset": 60882944\n }\n },\n {\n "volume_72e07e1e-1567-4071-8204-c29cb26d2660/20260703094710/az_nova_backup_eba702ee-9959-40fe-9093-1eecff8dbaa6-00069": {\n "compression": "zlib",\n "length": 196608,\n "md5": "2cc1e5bb8b0f7f6b8f396071b242c82d",\n "offset": 61145088\n }\n },\n {\n "volume_72e07e1e-1567-4071-8204-c29cb26d2660/20260703094710/az_nova_backup_eba702ee-9959-40fe-9093-1eecff8dbaa6-00070": {\n "compression": "zlib",\n "length": 2555904,\n "md5": "77a339075c2c22a3b220b8be3eafd00a",\n "offset": 61407232\n }\n },\n {\n "volume_72e07e1e-1567-4071-8204-c29cb26d2660/20260703094710/az_nova_backup_eba702ee-9959-40fe-9093-1eecff8dbaa6-00071": {\n "compression": "zlib",\n "length": 196608,\n "md5": "4976e1dea54e67ed34a48147acf51f95",\n "offset": 64028672\n }\n },\n {\n "volume_72e07e1e-1567-4071-8204-c29cb26d2660/20260703094710/az_nova_backup_eba702ee-9959-40fe-9093-1eecff8dbaa6-00072": {\n "compression": "zlib",\n "length": 32768,\n "md5": "c5102cf8b89d0646b4a8454aa2eb455b",\n "offset": 64290816\n }\n },\n {\n "volume_72e07e1e-1567-4071-8204-c29cb26d2660/20260703094710/az_nova_backup_eba702ee-9959-40fe-9093-1eecff8dbaa6-00073": {\n "compression": "zlib",\n "length": 262144,\n "md5": "a90b39452df564cdaee1875cdf14648d",\n "offset": 64356352\n }\n },\n {\n "volume_72e07e1e-1567-4071-8204-c29cb26d2660/20260703094710/az_nova_backup_eba702ee-9959-40fe-9093-1eecff8dbaa6-00074": {\n "compression": "zlib",\n "length": 196608,\n "md5": "93190166bf0c7415bc69f707aeecba3d",\n "offset": 64684032\n }\n },\n {\n "volume_72e07e1e-1567-4071-8204-c29cb26d2660/20260703094710/az_nova_backup_eba702ee-9959-40fe-9093-1eecff8dbaa6-00075": {\n "compression": "zlib",\n "length": 753664,\n "md5": "f20b7ef7942c255d34567ef7a8c931d5",\n "offset": 64946176\n }\n },\n {\n "volume_72e07e1e-1567-4071-8204-c29cb26d2660/20260703094710/az_nova_backup_eba702ee-9959-40fe-9093-1eecff8dbaa6-00076": {\n "compression": "zlib",\n "length": 1245184,\n "md5": "2fec27600c3cba1475524f3a83a147d9",\n "offset": 65863680\n }\n },\n {\n "volume_72e07e1e-1567-4071-8204-c29cb26d2660/20260703094710/az_nova_backup_eba702ee-9959-40fe-9093-1eecff8dbaa6-00077": {\n "compression": "zlib",\n "length": 229376,\n "md5": "bd18e2aa13a8966c7ccaeb4a8d2ad111",\n "offset": 67174400\n }\n },\n {\n "volume_72e07e1e-1567-4071-8204-c29cb26d2660/20260703094710/az_nova_backup_eba702ee-9959-40fe-9093-1eecff8dbaa6-00078": {\n "compression": "zlib",\n "length": 196608,\n "md5": "2742a11d6ef6f40794ba3a77fdd91fc1",\n "offset": 67567616\n }\n },\n {\n "volume_72e07e1e-1567-4071-8204-c29cb26d2660/20260703094710/az_nova_backup_eba702ee-9959-40fe-9093-1eecff8dbaa6-00079": {\n "compression": "zlib",\n "length": 753664,\n "md5": "937919e06f1ac884e907b3b44f7aa3f7",\n "offset": 67829760\n }\n },\n {\n "volume_72e07e1e-1567-4071-8204-c29cb26d2660/20260703094710/az_nova_backup_eba702ee-9959-40fe-9093-1eecff8dbaa6-00080": {\n "compression": "zlib",\n "length": 32768,\n "md5": "80bf1a781b69ed6d28f051a8c1bace93",\n "offset": 68681728\n }\n },\n {\n "volume_72e07e1e-1567-4071-8204-c29cb26d2660/20260703094710/az_nova_backup_eba702ee-9959-40fe-9093-1eecff8dbaa6-00081": {\n "compression": "zlib",\n "length": 98304,\n "md5": "839ea305330c068b1e25e10bbe0072eb",\n "offset": 68878336\n }\n },\n {\n "volume_72e07e1e-1567-4071-8204-c29cb26d2660/20260703094710/az_nova_backup_eba702ee-9959-40fe-9093-1eecff8dbaa6-00082": {\n "compression": "zlib",\n "length": 196608,\n "md5": "e35f12e70225bea64f1d64820a8c34af",\n "offset": 69140480\n }\n },\n {\n "volume_72e07e1e-1567-4071-8204-c29cb26d2660/20260703094710/az_nova_backup_eba702ee-9959-40fe-9093-1eecff8dbaa6-00083": {\n "compression": "zlib",\n "length": 32768,\n "md5": "b64ba69a7c7b92cbb6e034a227c535e1",\n "offset": 69402624\n }\n },\n {\n "volume_72e07e1e-1567-4071-8204-c29cb26d2660/20260703094710/az_nova_backup_eba702ee-9959-40fe-9093-1eecff8dbaa6-00084": {\n "compression": "zlib",\n "length": 163840,\n "md5": "7271b184b3a0862c0307275252dd4c26",\n "offset": 69468160\n }\n },\n {\n "volume_72e07e1e-1567-4071-8204-c29cb26d2660/20260703094710/az_nova_backup_eba702ee-9959-40fe-9093-1eecff8dbaa6-00085": {\n "compression": "zlib",\n "length": 196608,\n "md5": "534ab1b26cf91adf3fcf3f10f1b565b6",\n "offset": 69795840\n }\n },\n {\n "volume_72e07e1e-1567-4071-8204-c29cb26d2660/20260703094710/az_nova_backup_eba702ee-9959-40fe-9093-1eecff8dbaa6-00086": {\n "compression": "zlib",\n "length": 524288,\n "md5": "e6b1cf18f1737dfbfbfad2578b0d6523",\n "offset": 70254592\n }\n },\n {\n "volume_72e07e1e-1567-4071-8204-c29cb26d2660/20260703094710/az_nova_backup_eba702ee-9959-40fe-9093-1eecff8dbaa6-00087": {\n "compression": "zlib",\n "length": 98304,\n "md5": "161bce212c60776f3f1aebeef8ab713e",\n "offset": 71041024\n }\n },\n {\n "volume_72e07e1e-1567-4071-8204-c29cb26d2660/20260703094710/az_nova_backup_eba702ee-9959-40fe-9093-1eecff8dbaa6-00088": {\n "compression": "zlib",\n "length": 32768,\n "md5": "897e251c76b9c58b8c8c3f5df8f956e5",\n "offset": 71172096\n }\n },\n {\n "volume_72e07e1e-1567-4071-8204-c29cb26d2660/20260703094710/az_nova_backup_eba702ee-9959-40fe-9093-1eecff8dbaa6-00089": {\n "compression": "zlib",\n "length": 262144,\n "md5": "a77c3df81950fe3ec6756b32c47d5889",\n "offset": 72417280\n }\n },\n {\n "volume_72e07e1e-1567-4071-8204-c29cb26d2660/20260703094710/az_nova_backup_eba702ee-9959-40fe-9093-1eecff8dbaa6-00090": {\n "compression": "zlib",\n "length": 65536,\n "md5": "c15a2e2eb7fb41df1e140bbf87c78a9c",\n "offset": 110100480\n }\n },\n {\n "volume_72e07e1e-1567-4071-8204-c29cb26d2660/20260703094710/az_nova_backup_eba702ee-9959-40fe-9093-1eecff8dbaa6-00091": {\n "compression": "zlib",\n "length": 196608,\n "md5": "d2f8fd157e57c49a2e7fbb7db668bdfa",\n "offset": 110297088\n }\n },\n {\n "volume_72e07e1e-1567-4071-8204-c29cb26d2660/20260703094710/az_nova_backup_eba702ee-9959-40fe-9093-1eecff8dbaa6-00092": {\n "compression": "zlib",\n "length": 65536,\n "md5": "ab4c3c6565d120e31d0ec092b1f40fc0",\n "offset": 110559232\n }\n },\n {\n "volume_72e07e1e-1567-4071-8204-c29cb26d2660/20260703094710/az_nova_backup_eba702ee-9959-40fe-9093-1eecff8dbaa6-00093": {\n "compression": "zlib",\n "length": 32768,\n "md5": "6df3fb11329fda670b6a648b803a75c3",\n "offset": 110690304\n }\n },\n {\n "volume_72e07e1e-1567-4071-8204-c29cb26d2660/20260703094710/az_nova_backup_eba702ee-9959-40fe-9093-1eecff8dbaa6-00094": {\n "compression": "zlib",\n "length": 32768,\n "md5": "d3338725ce0b00d0d0a20c3dc76363b5",\n "offset": 110821376\n }\n },\n {\n "volume_72e07e1e-1567-4071-8204-c29cb26d2660/20260703094710/az_nova_backup_eba702ee-9959-40fe-9093-1eecff8dbaa6-00095": {\n "compression": "zlib",\n "length": 557056,\n "md5": "736df86bae8f6a9fbe7631cf877d988c",\n "offset": 110952448\n }\n },\n {\n "volume_72e07e1e-1567-4071-8204-c29cb26d2660/20260703094710/az_nova_backup_eba702ee-9959-40fe-9093-1eecff8dbaa6-00096": {\n "compression": "zlib",\n "length": 131072,\n "md5": "5465c211d4134a5c770e5e96d9420f8b",\n "offset": 111607808\n }\n },\n {\n "volume_72e07e1e-1567-4071-8204-c29cb26d2660/20260703094710/az_nova_backup_eba702ee-9959-40fe-9093-1eecff8dbaa6-00097": {\n "compression": "zlib",\n "length": 32768,\n "md5": "125fb29df3a88ed91bb536861e7d1ff9",\n "offset": 111869952\n }\n },\n {\n "volume_72e07e1e-1567-4071-8204-c29cb26d2660/20260703094710/az_nova_backup_eba702ee-9959-40fe-9093-1eecff8dbaa6-00098": {\n "compression": "zlib",\n "length": 98304,\n "md5": "38a20f8b3afb8be4ea4deab5f9b3d080",\n "offset": 112001024\n }\n },\n {\n "volume_72e07e1e-1567-4071-8204-c29cb26d2660/20260703094710/az_nova_backup_eba702ee-9959-40fe-9093-1eecff8dbaa6-00099": {\n "compression": "zlib",\n "length": 131072,\n "md5": "f87eeae8e3222a88fc335a905cc595f5",\n "offset": 112197632\n }\n },\n {\n "volume_72e07e1e-1567-4071-8204-c29cb26d2660/20260703094710/az_nova_backup_eba702ee-9959-40fe-9093-1eecff8dbaa6-00100": {\n "compression": "zlib",\n "length": 131072,\n "md5": "a34ec244a0a06a62255379762d3da663",\n "offset": 112590848\n }\n },\n {\n "volume_72e07e1e-1567-4071-8204-c29cb26d2660/20260703094710/az_nova_backup_eba702ee-9959-40fe-9093-1eecff8dbaa6-00101": {\n "compression": "zlib",\n "length": 393216,\n "md5": "ce40a8df09b1374e7997af78065811c8",\n "offset": 113770496\n }\n },\n {\n "volume_72e07e1e-1567-4071-8204-c29cb26d2660/20260703094710/az_nova_backup_eba702ee-9959-40fe-9093-1eecff8dbaa6-00102": {\n "compression": "zlib",\n "length": 32768,\n "md5": "5649b75a126d07b66d0cec64e48b81cf",\n "offset": 114229248\n }\n },\n {\n "volume_72e07e1e-1567-4071-8204-c29cb26d2660/20260703094710/az_nova_backup_eba702ee-9959-40fe-9093-1eecff8dbaa6-00103": {\n "compression": "zlib",\n "length": 65536,\n "md5": "ae208eb3f83a46fb3c8423271518f7f4",\n "offset": 143654912\n }\n },\n {\n "volume_72e07e1e-1567-4071-8204-c29cb26d2660/20260703094710/az_nova_backup_eba702ee-9959-40fe-9093-1eecff8dbaa6-00104": {\n "compression": "zlib",\n "length": 32768,\n "md5": "0ac8838eee7696114147d95e0878e3b2",\n "offset": 277872640\n }\n },\n {\n "volume_72e07e1e-1567-4071-8204-c29cb26d2660/20260703094710/az_nova_backup_eba702ee-9959-40fe-9093-1eecff8dbaa6-00105": {\n "compression": "zlib",\n "length": 65536,\n "md5": "b2292ab86959f8d7dae80c7bc94b877f",\n "offset": 412090368\n }\n },\n {\n "volume_72e07e1e-1567-4071-8204-c29cb26d2660/20260703094710/az_nova_backup_eba702ee-9959-40fe-9093-1eecff8dbaa6-00106": {\n "compression": "zlib",\n "length": 32768,\n "md5": "0ac8838eee7696114147d95e0878e3b2",\n "offset": 546308096\n }\n },\n {\n "volume_72e07e1e-1567-4071-8204-c29cb26d2660/20260703094710/az_nova_backup_eba702ee-9959-40fe-9093-1eecff8dbaa6-00107": {\n "compression": "zlib",\n "length": 65536,\n "md5": "a6fa469c52e2f95b4fdf7f6887a8d1e2",\n "offset": 680525824\n }\n },\n {\n "volume_72e07e1e-1567-4071-8204-c29cb26d2660/20260703094710/az_nova_backup_eba702ee-9959-40fe-9093-1eecff8dbaa6-00108": {\n "compression": "zlib",\n "length": 32768,\n "md5": "0ac8838eee7696114147d95e0878e3b2",\n "offset": 814743552\n }\n },\n {\n "volume_72e07e1e-1567-4071-8204-c29cb26d2660/20260703094710/az_nova_backup_eba702ee-9959-40fe-9093-1eecff8dbaa6-00109": {\n "compression": "zlib",\n "length": 65536,\n "md5": "3f1e4849348e19cc3e4f2affb2c2a15a",\n "offset": 948961280\n }\n },\n {\n "volume_72e07e1e-1567-4071-8204-c29cb26d2660/20260703094710/az_nova_backup_eba702ee-9959-40fe-9093-1eecff8dbaa6-00110": {\n "compression": "zlib",\n "length": 32768,\n "md5": "ccd615116dcb4026c3f50f53f219fe04",\n "offset": 1073709056\n }\n }\n ],\n "parent_id": "8b377d15-3804-4a9c-ad2d-e8e1359c0ee5",\n "version": "1.0.0",\n "volume_id": "72e07e1e-1567-4071-8204-c29cb26d2660",\n "volume_meta": "{\\"version\\": 2, \\"volume-base-metadata\\": {\\"id\\": \\"72e07e1e-1567-4071-8204-c29cb26d2660\\", \\"_name_id\\": null, \\"use_quota\\": true, \\"ec2_id\\": null, \\"user_id\\": \\"b861df2a13684334b293b1f348152e37\\", \\"project_id\\": \\"a484ec9218bf417bb9d7575ae6370646\\", \\"snapshot_id\\": null, \\"cluster_name\\": null, \\"host\\": \\"np0000004400@storpool#template_virtual\\", \\"size\\": 1, \\"availability_zone\\": \\"nova\\", \\"status\\": \\"backing-up\\", \\"attach_status\\": \\"detached\\", \\"migration_status\\": null, \\"scheduled_at\\": \\"2026-07-03T09:45:43.000000\\", \\"launched_at\\": \\"2026-07-03T09:45:43.000000\\", \\"terminated_at\\": null, \\"display_name\\": \\"tempest-VolumesBackupsTest-Volume-895469207\\", \\"display_description\\": null, \\"provider_location\\": null, \\"provider_auth\\": null, \\"provider_geometry\\": null, \\"provider_id\\": null, \\"volume_type_id\\": \\"03e13fe6-0e30-4803-ace0-725d38e6dc24\\", \\"source_volid\\": null, \\"encryption_key_id\\": null, \\"consistencygroup_id\\": null, \\"group_id\\": null, \\"bootable\\": true, \\"multiattach\\": false, \\"replication_status\\": null, \\"replication_extended_status\\": null, \\"replication_driver_data\\": null, \\"previous_status\\": \\"available\\", \\"service_uuid\\": \\"6d4b0e79-fefe-4744-b25f-34be05095200\\", \\"shared_targets\\": true, \\"deleted_at\\": null, \\"deleted\\": false, \\"created_at\\": \\"2026-07-03T09:45:42.000000\\", \\"updated_at\\": \\"2026-07-03T09:47:07.000000\\"}, \\"volume-glance-metadata\\": {\\"hw_rng_model\\": \\"virtio\\", \\"os_glance_failed_import\\": \\"\\", \\"os_glance_importing_to_stores\\": \\"\\", \\"owner_specified.openstack.md5\\": \\"\\", \\"owner_specified.openstack.object\\": \\"images/cirros-0.6.3-x86_64-disk\\", \\"owner_specified.openstack.sha256\\": \\"\\", \\"image_id\\": \\"c1946dda-7935-4a75-a25a-cf65d1d25617\\", \\"image_name\\": \\"cirros-0.6.3-x86_64-disk\\", \\"checksum\\": \\"87617e24a5e30cb3b87fda8c0764838f\\", \\"container_format\\": \\"bare\\", \\"disk_format\\": \\"qcow2\\", \\"min_disk\\": \\"0\\", \\"min_ram\\": \\"0\\", \\"size\\": \\"21692416\\"}}"\n}'. {{(pid=101319) _write_metadata /opt/stack/cinder/cinder/backup/chunkeddriver.py:295}} Jul 03 09:47:21.789182 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-c0b6bb1f-d91f-43e7-be98-b7740c01c433 tempest-VolumesBackupsTest-118275719 None] backup eba702ee-9959-40fe-9093-1eecff8dbaa6 finished. {{(pid=101319) _finalize_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:462}} Jul 03 09:47:21.789182 np0000004400 cinder-backup[101319]: DEBUG oslo_concurrency.processutils [None req-c0b6bb1f-d91f-43e7-be98-b7740c01c433 tempest-VolumesBackupsTest-118275719 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chown 0 /dev/sdb {{(pid=101319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 09:47:21.801381 np0000004400 sudo[140844]: stack : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chown 0 /dev/sdb Jul 03 09:47:21.802188 np0000004400 sudo[140844]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1002) Jul 03 09:47:21.855310 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-75ba68df-8a8d-48ad-9be6-295988b8d81d tempest-VolumesBackupsTest-2142009639 None] backup MD5 for volume_8a0b1cfb-8ea1-46a0-aac3-b254107b98ef/20260703094720/az_nova_backup_86118233-3d57-47ad-8781-cab6c54e4d53-00002: 25e317773f308e446cc84c503a6d1f85 {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 09:47:21.855388 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-75ba68df-8a8d-48ad-9be6-295988b8d81d tempest-VolumesBackupsTest-2142009639 None] Calling eventlet.sleep(0) {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 09:47:22.071818 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-75ba68df-8a8d-48ad-9be6-295988b8d81d tempest-VolumesBackupsTest-2142009639 None] Backing up chunk of data from volume. {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 09:47:22.143385 np0000004400 sudo[140844]: pam_unix(sudo:session): session closed for user root Jul 03 09:47:22.145532 np0000004400 cinder-backup[101319]: DEBUG oslo_concurrency.processutils [None req-c0b6bb1f-d91f-43e7-be98-b7740c01c433 tempest-VolumesBackupsTest-118275719 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chown 0 /dev/sdb" returned: 0 in 0.367s {{(pid=101319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 09:47:22.146307 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-c0b6bb1f-d91f-43e7-be98-b7740c01c433 tempest-VolumesBackupsTest-118275719 None] ==> disconnect_volume: call "{'args': (, {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-72e07e1e-1567-4071-8204-c29cb26d2660', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '72e07e1e-1567-4071-8204-c29cb26d2660', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': False}, {'type': 'block', 'scsi_wwn': '33000000091843b59', 'path': '/dev/sdb'}), 'kwargs': {'force': True, 'ignore_errors': True}}" {{(pid=101319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}} Jul 03 09:47:22.146600 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.base [None req-c0b6bb1f-d91f-43e7-be98-b7740c01c433 tempest-VolumesBackupsTest-118275719 None] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=101319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jul 03 09:47:22.147116 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.base [None req-c0b6bb1f-d91f-43e7-be98-b7740c01c433 tempest-VolumesBackupsTest-118275719 None] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=101319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jul 03 09:47:22.147609 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-c0b6bb1f-d91f-43e7-be98-b7740c01c433 tempest-VolumesBackupsTest-118275719 None] _get_connection_devices called with parameters: connection_properties={'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-72e07e1e-1567-4071-8204-c29cb26d2660', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '72e07e1e-1567-4071-8204-c29cb26d2660', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': False}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=101319) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:847}} Jul 03 09:47:22.162615 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-c0b6bb1f-d91f-43e7-be98-b7740c01c433 tempest-VolumesBackupsTest-118275719 None] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS: Jul 03 09:47:22.162615 np0000004400 cinder-backup[101319]: No targets found. Jul 03 09:47:22.162615 np0000004400 cinder-backup[101319]: iSNS: Jul 03 09:47:22.162615 np0000004400 cinder-backup[101319]: No targets found. Jul 03 09:47:22.162615 np0000004400 cinder-backup[101319]: STATIC: Jul 03 09:47:22.162615 np0000004400 cinder-backup[101319]: Target: iqn.2023-03.storpool.com:os--volume-8a0b1cfb-8ea1-46a0-aac3-b254107b98ef Jul 03 09:47:22.162615 np0000004400 cinder-backup[101319]: Portal: 192.168.50.100:3260,-1 Jul 03 09:47:22.162615 np0000004400 cinder-backup[101319]: Iface Name: default Jul 03 09:47:22.162615 np0000004400 cinder-backup[101319]: Portal: 192.168.40.100:3260,-1 Jul 03 09:47:22.162615 np0000004400 cinder-backup[101319]: Iface Name: default Jul 03 09:47:22.162615 np0000004400 cinder-backup[101319]: Target: iqn.2023-03.storpool.com:os--volume-72e07e1e-1567-4071-8204-c29cb26d2660 Jul 03 09:47:22.162615 np0000004400 cinder-backup[101319]: Portal: 192.168.40.100:3260,-1 Jul 03 09:47:22.162615 np0000004400 cinder-backup[101319]: Iface Name: default Jul 03 09:47:22.162615 np0000004400 cinder-backup[101319]: Target: iqn.2023-03.storpool.com:os--volume-298b8723-c4d1-455f-aef8-665b62a8001f Jul 03 09:47:22.162615 np0000004400 cinder-backup[101319]: Portal: 192.168.40.100:3260,-1 Jul 03 09:47:22.162615 np0000004400 cinder-backup[101319]: Iface Name: default Jul 03 09:47:22.162615 np0000004400 cinder-backup[101319]: FIRMWARE: Jul 03 09:47:22.162615 np0000004400 cinder-backup[101319]: No targets found. Jul 03 09:47:22.162615 np0000004400 cinder-backup[101319]: stderr= {{(pid=101319) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jul 03 09:47:22.162941 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-c0b6bb1f-d91f-43e7-be98-b7740c01c433 tempest-VolumesBackupsTest-118275719 None] Regex to get portals from discoverydb: ^SENDTARGETS: Jul 03 09:47:22.162941 np0000004400 cinder-backup[101319]: .*?^DiscoveryAddress: 192.168.40.100,3260.*? Jul 03 09:47:22.162941 np0000004400 cinder-backup[101319]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=101319) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:390}} Jul 03 09:47:22.163158 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-c0b6bb1f-d91f-43e7-be98-b7740c01c433 tempest-VolumesBackupsTest-118275719 None] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-72e07e1e-1567-4071-8204-c29cb26d2660', 0)] {{(pid=101319) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:858}} Jul 03 09:47:22.188245 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-c0b6bb1f-d91f-43e7-be98-b7740c01c433 tempest-VolumesBackupsTest-118275719 None] iscsiadm ('-m', 'session'): stdout=tcp: [119] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-72e07e1e-1567-4071-8204-c29cb26d2660 (non-flash) Jul 03 09:47:22.188245 np0000004400 cinder-backup[101319]: tcp: [120] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8a0b1cfb-8ea1-46a0-aac3-b254107b98ef (non-flash) Jul 03 09:47:22.188245 np0000004400 cinder-backup[101319]: tcp: [121] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8a0b1cfb-8ea1-46a0-aac3-b254107b98ef (non-flash) Jul 03 09:47:22.188245 np0000004400 cinder-backup[101319]: tcp: [122] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-298b8723-c4d1-455f-aef8-665b62a8001f (non-flash) Jul 03 09:47:22.188245 np0000004400 cinder-backup[101319]: stderr= {{(pid=101319) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jul 03 09:47:22.188464 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-c0b6bb1f-d91f-43e7-be98-b7740c01c433 tempest-VolumesBackupsTest-118275719 None] iscsi session list stdout=tcp: [119] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-72e07e1e-1567-4071-8204-c29cb26d2660 (non-flash) Jul 03 09:47:22.188464 np0000004400 cinder-backup[101319]: tcp: [120] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8a0b1cfb-8ea1-46a0-aac3-b254107b98ef (non-flash) Jul 03 09:47:22.188464 np0000004400 cinder-backup[101319]: tcp: [121] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8a0b1cfb-8ea1-46a0-aac3-b254107b98ef (non-flash) Jul 03 09:47:22.188464 np0000004400 cinder-backup[101319]: tcp: [122] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-298b8723-c4d1-455f-aef8-665b62a8001f (non-flash) Jul 03 09:47:22.188464 np0000004400 cinder-backup[101319]: stderr= {{(pid=101319) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jul 03 09:47:22.188667 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-c0b6bb1f-d91f-43e7-be98-b7740c01c433 tempest-VolumesBackupsTest-118275719 None] Sessions list: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-72e07e1e-1567-4071-8204-c29cb26d2660', '119'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-8a0b1cfb-8ea1-46a0-aac3-b254107b98ef', '120'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-8a0b1cfb-8ea1-46a0-aac3-b254107b98ef', '121'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-298b8723-c4d1-455f-aef8-665b62a8001f', '122')] {{(pid=101319) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:866}} Jul 03 09:47:22.188777 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-c0b6bb1f-d91f-43e7-be98-b7740c01c433 tempest-VolumesBackupsTest-118275719 None] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-72e07e1e-1567-4071-8204-c29cb26d2660, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-72e07e1e-1567-4071-8204-c29cb26d2660', '119')] {{(pid=101319) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}} Jul 03 09:47:22.189750 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-c0b6bb1f-d91f-43e7-be98-b7740c01c433 tempest-VolumesBackupsTest-118275719 None] Resulting device map defaultdict(. at 0x7e7705857880>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-72e07e1e-1567-4071-8204-c29cb26d2660'): ({'sdb'}, set())}) {{(pid=101319) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:912}} Jul 03 09:47:22.189923 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.linuxscsi [None req-c0b6bb1f-d91f-43e7-be98-b7740c01c433 tempest-VolumesBackupsTest-118275719 None] Removing multipathed devices sdb {{(pid=101319) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}} Jul 03 09:47:22.190312 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.linuxscsi [None req-c0b6bb1f-d91f-43e7-be98-b7740c01c433 tempest-VolumesBackupsTest-118275719 None] Flush multipath device 33000000091843b59 {{(pid=101319) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}} Jul 03 09:47:22.322480 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-75ba68df-8a8d-48ad-9be6-295988b8d81d tempest-VolumesBackupsTest-2142009639 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101319) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 09:47:22.322686 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-75ba68df-8a8d-48ad-9be6-295988b8d81d tempest-VolumesBackupsTest-2142009639 None] About to put_object {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 09:47:22.399271 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.linuxscsi [None req-c0b6bb1f-d91f-43e7-be98-b7740c01c433 tempest-VolumesBackupsTest-118275719 None] Flushing IO for device /dev/sdb {{(pid=101319) flush_device_io /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:461}} Jul 03 09:47:22.407247 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.linuxscsi [None req-c0b6bb1f-d91f-43e7-be98-b7740c01c433 tempest-VolumesBackupsTest-118275719 None] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=101319) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}} Jul 03 09:47:22.442843 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-75ba68df-8a8d-48ad-9be6-295988b8d81d tempest-VolumesBackupsTest-2142009639 None] backup MD5 for volume_8a0b1cfb-8ea1-46a0-aac3-b254107b98ef/20260703094720/az_nova_backup_86118233-3d57-47ad-8781-cab6c54e4d53-00003: 25e317773f308e446cc84c503a6d1f85 {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 09:47:22.443023 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-75ba68df-8a8d-48ad-9be6-295988b8d81d tempest-VolumesBackupsTest-2142009639 None] Calling eventlet.sleep(0) {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 09:47:22.470489 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.linuxscsi [None req-c0b6bb1f-d91f-43e7-be98-b7740c01c433 tempest-VolumesBackupsTest-118275719 None] Checking to see if SCSI volumes sdb have been removed. {{(pid=101319) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}} Jul 03 09:47:22.470489 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.linuxscsi [None req-c0b6bb1f-d91f-43e7-be98-b7740c01c433 tempest-VolumesBackupsTest-118275719 None] SCSI volumes sdb have been removed. {{(pid=101319) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}} Jul 03 09:47:22.471394 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.linuxscsi [None req-c0b6bb1f-d91f-43e7-be98-b7740c01c433 tempest-VolumesBackupsTest-118275719 None] Checking to see if device paths {'sdb'} are still under multipathd monitoring {{(pid=101319) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}} Jul 03 09:47:22.482368 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.linuxscsi [None req-c0b6bb1f-d91f-43e7-be98-b7740c01c433 tempest-VolumesBackupsTest-118275719 None] Device paths {'sdb'} have been removed from multipathd monitoring. {{(pid=101319) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}} Jul 03 09:47:22.482725 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-c0b6bb1f-d91f-43e7-be98-b7740c01c433 tempest-VolumesBackupsTest-118275719 None] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-72e07e1e-1567-4071-8204-c29cb26d2660')] {{(pid=101319) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1225}} Jul 03 09:47:22.495055 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-c0b6bb1f-d91f-43e7-be98-b7740c01c433 tempest-VolumesBackupsTest-118275719 None] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=101319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 03 09:47:22.532592 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-c0b6bb1f-d91f-43e7-be98-b7740c01c433 tempest-VolumesBackupsTest-118275719 None] iscsiadm ('--logout',): stdout=Logging out of session [sid: 119, target: iqn.2023-03.storpool.com:os--volume-72e07e1e-1567-4071-8204-c29cb26d2660, portal: 192.168.40.100,3260] Jul 03 09:47:22.532592 np0000004400 cinder-backup[101319]: Logout of [sid: 119, target: iqn.2023-03.storpool.com:os--volume-72e07e1e-1567-4071-8204-c29cb26d2660, portal: 192.168.40.100,3260] successful. Jul 03 09:47:22.532592 np0000004400 cinder-backup[101319]: stderr= {{(pid=101319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 03 09:47:22.551217 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-c0b6bb1f-d91f-43e7-be98-b7740c01c433 tempest-VolumesBackupsTest-118275719 None] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=101319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 03 09:47:22.551559 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.base [None req-c0b6bb1f-d91f-43e7-be98-b7740c01c433 tempest-VolumesBackupsTest-118275719 None] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.404s {{(pid=101319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jul 03 09:47:22.551766 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-c0b6bb1f-d91f-43e7-be98-b7740c01c433 tempest-VolumesBackupsTest-118275719 None] <== disconnect_volume: return (405ms) None {{(pid=101319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}} Jul 03 09:47:22.630175 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-75ba68df-8a8d-48ad-9be6-295988b8d81d tempest-VolumesBackupsTest-2142009639 None] Backing up chunk of data from volume. {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 09:47:22.886710 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-75ba68df-8a8d-48ad-9be6-295988b8d81d tempest-VolumesBackupsTest-2142009639 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101319) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 09:47:22.887056 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-75ba68df-8a8d-48ad-9be6-295988b8d81d tempest-VolumesBackupsTest-2142009639 None] About to put_object {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 09:47:22.997026 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-75ba68df-8a8d-48ad-9be6-295988b8d81d tempest-VolumesBackupsTest-2142009639 None] backup MD5 for volume_8a0b1cfb-8ea1-46a0-aac3-b254107b98ef/20260703094720/az_nova_backup_86118233-3d57-47ad-8781-cab6c54e4d53-00004: 25e317773f308e446cc84c503a6d1f85 {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 09:47:22.997193 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-75ba68df-8a8d-48ad-9be6-295988b8d81d tempest-VolumesBackupsTest-2142009639 None] Calling eventlet.sleep(0) {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 09:47:23.210489 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-75ba68df-8a8d-48ad-9be6-295988b8d81d tempest-VolumesBackupsTest-2142009639 None] Backing up chunk of data from volume. {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 09:47:23.474802 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-75ba68df-8a8d-48ad-9be6-295988b8d81d tempest-VolumesBackupsTest-2142009639 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101319) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 09:47:23.474989 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-75ba68df-8a8d-48ad-9be6-295988b8d81d tempest-VolumesBackupsTest-2142009639 None] About to put_object {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 09:47:23.595991 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-75ba68df-8a8d-48ad-9be6-295988b8d81d tempest-VolumesBackupsTest-2142009639 None] backup MD5 for volume_8a0b1cfb-8ea1-46a0-aac3-b254107b98ef/20260703094720/az_nova_backup_86118233-3d57-47ad-8781-cab6c54e4d53-00005: 25e317773f308e446cc84c503a6d1f85 {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 09:47:23.596138 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-75ba68df-8a8d-48ad-9be6-295988b8d81d tempest-VolumesBackupsTest-2142009639 None] Calling eventlet.sleep(0) {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 09:47:23.644734 np0000004400 cinder-backup[101319]: INFO cinder.backup.manager [None req-c0b6bb1f-d91f-43e7-be98-b7740c01c433 tempest-VolumesBackupsTest-118275719 None] Create backup finished. backup: eba702ee-9959-40fe-9093-1eecff8dbaa6. Jul 03 09:47:23.850555 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-75ba68df-8a8d-48ad-9be6-295988b8d81d tempest-VolumesBackupsTest-2142009639 None] Backing up chunk of data from volume. {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 09:47:24.112213 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-75ba68df-8a8d-48ad-9be6-295988b8d81d tempest-VolumesBackupsTest-2142009639 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101319) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 09:47:24.112623 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-75ba68df-8a8d-48ad-9be6-295988b8d81d tempest-VolumesBackupsTest-2142009639 None] About to put_object {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 09:47:24.225628 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-75ba68df-8a8d-48ad-9be6-295988b8d81d tempest-VolumesBackupsTest-2142009639 None] backup MD5 for volume_8a0b1cfb-8ea1-46a0-aac3-b254107b98ef/20260703094720/az_nova_backup_86118233-3d57-47ad-8781-cab6c54e4d53-00006: 25e317773f308e446cc84c503a6d1f85 {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 09:47:24.225826 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-75ba68df-8a8d-48ad-9be6-295988b8d81d tempest-VolumesBackupsTest-2142009639 None] Calling eventlet.sleep(0) {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 09:47:24.453224 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-75ba68df-8a8d-48ad-9be6-295988b8d81d tempest-VolumesBackupsTest-2142009639 None] Backing up chunk of data from volume. {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 09:47:24.536325 np0000004400 cinder-backup[101319]: INFO cinder.backup.manager [None req-f2328ac8-0306-44eb-b2b5-223cab8b003f tempest-VolumesBackupsTest-118275719 None] Delete backup started, backup: eba702ee-9959-40fe-9093-1eecff8dbaa6. Jul 03 09:47:24.545731 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.drivers.swift [None req-f2328ac8-0306-44eb-b2b5-223cab8b003f tempest-VolumesBackupsTest-118275719 None] Using swift URL https://10.4.3.95:8080/v1/AUTH_a484ec9218bf417bb9d7575ae6370646 {{(pid=101319) initialize /opt/stack/cinder/cinder/backup/drivers/swift.py:300}} Jul 03 09:47:24.545731 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.drivers.swift [None req-f2328ac8-0306-44eb-b2b5-223cab8b003f tempest-VolumesBackupsTest-118275719 None] Connect to https://10.4.3.95:8080/v1/AUTH_ in "per_user" mode {{(pid=101319) initialize /opt/stack/cinder/cinder/backup/drivers/swift.py:301}} Jul 03 09:47:24.545942 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-f2328ac8-0306-44eb-b2b5-223cab8b003f tempest-VolumesBackupsTest-118275719 None] delete started, backup: eba702ee-9959-40fe-9093-1eecff8dbaa6, container: volumebackups, prefix: volume_72e07e1e-1567-4071-8204-c29cb26d2660/20260703094710/az_nova_backup_eba702ee-9959-40fe-9093-1eecff8dbaa6. {{(pid=101319) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:822}} Jul 03 09:47:24.647342 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-f2328ac8-0306-44eb-b2b5-223cab8b003f tempest-VolumesBackupsTest-118275719 None] generated object list: ['volume_72e07e1e-1567-4071-8204-c29cb26d2660/20260703094710/az_nova_backup_eba702ee-9959-40fe-9093-1eecff8dbaa6-00001', 'volume_72e07e1e-1567-4071-8204-c29cb26d2660/20260703094710/az_nova_backup_eba702ee-9959-40fe-9093-1eecff8dbaa6-00002', 'volume_72e07e1e-1567-4071-8204-c29cb26d2660/20260703094710/az_nova_backup_eba702ee-9959-40fe-9093-1eecff8dbaa6-00003', 'volume_72e07e1e-1567-4071-8204-c29cb26d2660/20260703094710/az_nova_backup_eba702ee-9959-40fe-9093-1eecff8dbaa6-00004', 'volume_72e07e1e-1567-4071-8204-c29cb26d2660/20260703094710/az_nova_backup_eba702ee-9959-40fe-9093-1eecff8dbaa6-00005', 'volume_72e07e1e-1567-4071-8204-c29cb26d2660/20260703094710/az_nova_backup_eba702ee-9959-40fe-9093-1eecff8dbaa6-00006', 'volume_72e07e1e-1567-4071-8204-c29cb26d2660/20260703094710/az_nova_backup_eba702ee-9959-40fe-9093-1eecff8dbaa6-00007', 'volume_72e07e1e-1567-4071-8204-c29cb26d2660/20260703094710/az_nova_backup_eba702ee-9959-40fe-9093-1eecff8dbaa6-00008', 'volume_72e07e1e-1567-4071-8204-c29cb26d2660/20260703094710/az_nova_backup_eba702ee-9959-40fe-9093-1eecff8dbaa6-00009', 'volume_72e07e1e-1567-4071-8204-c29cb26d2660/20260703094710/az_nova_backup_eba702ee-9959-40fe-9093-1eecff8dbaa6-00010', 'volume_72e07e1e-1567-4071-8204-c29cb26d2660/20260703094710/az_nova_backup_eba702ee-9959-40fe-9093-1eecff8dbaa6-00011', 'volume_72e07e1e-1567-4071-8204-c29cb26d2660/20260703094710/az_nova_backup_eba702ee-9959-40fe-9093-1eecff8dbaa6-00012', 'volume_72e07e1e-1567-4071-8204-c29cb26d2660/20260703094710/az_nova_backup_eba702ee-9959-40fe-9093-1eecff8dbaa6-00013', 'volume_72e07e1e-1567-4071-8204-c29cb26d2660/20260703094710/az_nova_backup_eba702ee-9959-40fe-9093-1eecff8dbaa6-00014', 'volume_72e07e1e-1567-4071-8204-c29cb26d2660/20260703094710/az_nova_backup_eba702ee-9959-40fe-9093-1eecff8dbaa6-00015', 'volume_72e07e1e-1567-4071-8204-c29cb26d2660/20260703094710/az_nova_backup_eba702ee-9959-40fe-9093-1eecff8dbaa6-00016', 'volume_72e07e1e-1567-4071-8204-c29cb26d2660/20260703094710/az_nova_backup_eba702ee-9959-40fe-9093-1eecff8dbaa6-00017', 'volume_72e07e1e-1567-4071-8204-c29cb26d2660/20260703094710/az_nova_backup_eba702ee-9959-40fe-9093-1eecff8dbaa6-00018', 'volume_72e07e1e-1567-4071-8204-c29cb26d2660/20260703094710/az_nova_backup_eba702ee-9959-40fe-9093-1eecff8dbaa6-00019', 'volume_72e07e1e-1567-4071-8204-c29cb26d2660/20260703094710/az_nova_backup_eba702ee-9959-40fe-9093-1eecff8dbaa6-00020', 'volume_72e07e1e-1567-4071-8204-c29cb26d2660/20260703094710/az_nova_backup_eba702ee-9959-40fe-9093-1eecff8dbaa6-00021', 'volume_72e07e1e-1567-4071-8204-c29cb26d2660/20260703094710/az_nova_backup_eba702ee-9959-40fe-9093-1eecff8dbaa6-00022', 'volume_72e07e1e-1567-4071-8204-c29cb26d2660/20260703094710/az_nova_backup_eba702ee-9959-40fe-9093-1eecff8dbaa6-00023', 'volume_72e07e1e-1567-4071-8204-c29cb26d2660/20260703094710/az_nova_backup_eba702ee-9959-40fe-9093-1eecff8dbaa6-00024', 'volume_72e07e1e-1567-4071-8204-c29cb26d2660/20260703094710/az_nova_backup_eba702ee-9959-40fe-9093-1eecff8dbaa6-00025', 'volume_72e07e1e-1567-4071-8204-c29cb26d2660/20260703094710/az_nova_backup_eba702ee-9959-40fe-9093-1eecff8dbaa6-00026', 'volume_72e07e1e-1567-4071-8204-c29cb26d2660/20260703094710/az_nova_backup_eba702ee-9959-40fe-9093-1eecff8dbaa6-00027', 'volume_72e07e1e-1567-4071-8204-c29cb26d2660/20260703094710/az_nova_backup_eba702ee-9959-40fe-9093-1eecff8dbaa6-00028', 'volume_72e07e1e-1567-4071-8204-c29cb26d2660/20260703094710/az_nova_backup_eba702ee-9959-40fe-9093-1eecff8dbaa6-00029', 'volume_72e07e1e-1567-4071-8204-c29cb26d2660/20260703094710/az_nova_backup_eba702ee-9959-40fe-9093-1eecff8dbaa6-00030', 'volume_72e07e1e-1567-4071-8204-c29cb26d2660/20260703094710/az_nova_backup_eba702ee-9959-40fe-9093-1eecff8dbaa6-00031', 'volume_72e07e1e-1567-4071-8204-c29cb26d2660/20260703094710/az_nova_backup_eba702ee-9959-40fe-9093-1eecff8dbaa6-00032', 'volume_72e07e1e-1567-4071-8204-c29cb26d2660/20260703094710/az_nova_backup_eba702ee-9959-40fe-9093-1eecff8dbaa6-00033', 'volume_72e07e1e-1567-4071-8204-c29cb26d2660/20260703094710/az_nova_backup_eba702ee-9959-40fe-9093-1eecff8dbaa6-00034', 'volume_72e07e1e-1567-4071-8204-c29cb26d2660/20260703094710/az_nova_backup_eba702ee-9959-40fe-9093-1eecff8dbaa6-00035', 'volume_72e07e1e-1567-4071-8204-c29cb26d2660/20260703094710/az_nova_backup_eba702ee-9959-40fe-9093-1eecff8dbaa6-00036', 'volume_72e07e1e-1567-4071-8204-c29cb26d2660/20260703094710/az_nova_backup_eba702ee-9959-40fe-9093-1eecff8dbaa6-00037', 'volume_72e07e1e-1567-4071-8204-c29cb26d2660/20260703094710/az_nova_backup_eba702ee-9959-40fe-9093-1eecff8dbaa6-00038', 'volume_72e07e1e-1567-4071-8204-c29cb26d2660/20260703094710/az_nova_backup_eba702ee-9959-40fe-9093-1eecff8dbaa6-00039', 'volume_72e07e1e-1567-4071-8204-c29cb26d2660/20260703094710/az_nova_backup_eba702ee-9959-40fe-9093-1eecff8dbaa6-00040', 'volume_72e07e1e-1567-4071-8204-c29cb26d2660/20260703094710/az_nova_backup_eba702ee-9959-40fe-9093-1eecff8dbaa6-00041', 'volume_72e07e1e-1567-4071-8204-c29cb26d2660/20260703094710/az_nova_backup_eba702ee-9959-40fe-9093-1eecff8dbaa6-00042', 'volume_72e07e1e-1567-4071-8204-c29cb26d2660/20260703094710/az_nova_backup_eba702ee-9959-40fe-9093-1eecff8dbaa6-00043', 'volume_72e07e1e-1567-4071-8204-c29cb26d2660/20260703094710/az_nova_backup_eba702ee-9959-40fe-9093-1eecff8dbaa6-00044', 'volume_72e07e1e-1567-4071-8204-c29cb26d2660/20260703094710/az_nova_backup_eba702ee-9959-40fe-9093-1eecff8dbaa6-00045', 'volume_72e07e1e-1567-4071-8204-c29cb26d2660/20260703094710/az_nova_backup_eba702ee-9959-40fe-9093-1eecff8dbaa6-00046', 'volume_72e07e1e-1567-4071-8204-c29cb26d2660/20260703094710/az_nova_backup_eba702ee-9959-40fe-9093-1eecff8dbaa6-00047', 'volume_72e07e1e-1567-4071-8204-c29cb26d2660/20260703094710/az_nova_backup_eba702ee-9959-40fe-9093-1eecff8dbaa6-00048', 'volume_72e07e1e-1567-4071-8204-c29cb26d2660/20260703094710/az_nova_backup_eba702ee-9959-40fe-9093-1eecff8dbaa6-00049', 'volume_72e07e1e-1567-4071-8204-c29cb26d2660/20260703094710/az_nova_backup_eba702ee-9959-40fe-9093-1eecff8dbaa6-00050', 'volume_72e07e1e-1567-4071-8204-c29cb26d2660/20260703094710/az_nova_backup_eba702ee-9959-40fe-9093-1eecff8dbaa6-00051', 'volume_72e07e1e-1567-4071-8204-c29cb26d2660/20260703094710/az_nova_backup_eba702ee-9959-40fe-9093-1eecff8dbaa6-00052', 'volume_72e07e1e-1567-4071-8204-c29cb26d2660/20260703094710/az_nova_backup_eba702ee-9959-40fe-9093-1eecff8dbaa6-00053', 'volume_72e07e1e-1567-4071-8204-c29cb26d2660/20260703094710/az_nova_backup_eba702ee-9959-40fe-9093-1eecff8dbaa6-00054', 'volume_72e07e1e-1567-4071-8204-c29cb26d2660/20260703094710/az_nova_backup_eba702ee-9959-40fe-9093-1eecff8dbaa6-00055', 'volume_72e07e1e-1567-4071-8204-c29cb26d2660/20260703094710/az_nova_backup_eba702ee-9959-40fe-9093-1eecff8dbaa6-00056', 'volume_72e07e1e-1567-4071-8204-c29cb26d2660/20260703094710/az_nova_backup_eba702ee-9959-40fe-9093-1eecff8dbaa6-00057', 'volume_72e07e1e-1567-4071-8204-c29cb26d2660/20260703094710/az_nova_backup_eba702ee-9959-40fe-9093-1eecff8dbaa6-00058', 'volume_72e07e1e-1567-4071-8204-c29cb26d2660/20260703094710/az_nova_backup_eba702ee-9959-40fe-9093-1eecff8dbaa6-00059', 'volume_72e07e1e-1567-4071-8204-c29cb26d2660/20260703094710/az_nova_backup_eba702ee-9959-40fe-9093-1eecff8dbaa6-00060', 'volume_72e07e1e-1567-4071-8204-c29cb26d2660/20260703094710/az_nova_backup_eba702ee-9959-40fe-9093-1eecff8dbaa6-00061', 'volume_72e07e1e-1567-4071-8204-c29cb26d2660/20260703094710/az_nova_backup_eba702ee-9959-40fe-9093-1eecff8dbaa6-00062', 'volume_72e07e1e-1567-4071-8204-c29cb26d2660/20260703094710/az_nova_backup_eba702ee-9959-40fe-9093-1eecff8dbaa6-00063', 'volume_72e07e1e-1567-4071-8204-c29cb26d2660/20260703094710/az_nova_backup_eba702ee-9959-40fe-9093-1eecff8dbaa6-00064', 'volume_72e07e1e-1567-4071-8204-c29cb26d2660/20260703094710/az_nova_backup_eba702ee-9959-40fe-9093-1eecff8dbaa6-00065', 'volume_72e07e1e-1567-4071-8204-c29cb26d2660/20260703094710/az_nova_backup_eba702ee-9959-40fe-9093-1eecff8dbaa6-00066', 'volume_72e07e1e-1567-4071-8204-c29cb26d2660/20260703094710/az_nova_backup_eba702ee-9959-40fe-9093-1eecff8dbaa6-00067', 'volume_72e07e1e-1567-4071-8204-c29cb26d2660/20260703094710/az_nova_backup_eba702ee-9959-40fe-9093-1eecff8dbaa6-00068', 'volume_72e07e1e-1567-4071-8204-c29cb26d2660/20260703094710/az_nova_backup_eba702ee-9959-40fe-9093-1eecff8dbaa6-00069', 'volume_72e07e1e-1567-4071-8204-c29cb26d2660/20260703094710/az_nova_backup_eba702ee-9959-40fe-9093-1eecff8dbaa6-00070', 'volume_72e07e1e-1567-4071-8204-c29cb26d2660/20260703094710/az_nova_backup_eba702ee-9959-40fe-9093-1eecff8dbaa6-00071', 'volume_72e07e1e-1567-4071-8204-c29cb26d2660/20260703094710/az_nova_backup_eba702ee-9959-40fe-9093-1eecff8dbaa6-00072', 'volume_72e07e1e-1567-4071-8204-c29cb26d2660/20260703094710/az_nova_backup_eba702ee-9959-40fe-9093-1eecff8dbaa6-00073', 'volume_72e07e1e-1567-4071-8204-c29cb26d2660/20260703094710/az_nova_backup_eba702ee-9959-40fe-9093-1eecff8dbaa6-00074', 'volume_72e07e1e-1567-4071-8204-c29cb26d2660/20260703094710/az_nova_backup_eba702ee-9959-40fe-9093-1eecff8dbaa6-00075', 'volume_72e07e1e-1567-4071-8204-c29cb26d2660/20260703094710/az_nova_backup_eba702ee-9959-40fe-9093-1eecff8dbaa6-00076', 'volume_72e07e1e-1567-4071-8204-c29cb26d2660/20260703094710/az_nova_backup_eba702ee-9959-40fe-9093-1eecff8dbaa6-00077', 'volume_72e07e1e-1567-4071-8204-c29cb26d2660/20260703094710/az_nova_backup_eba702ee-9959-40fe-9093-1eecff8dbaa6-00078', 'volume_72e07e1e-1567-4071-8204-c29cb26d2660/20260703094710/az_nova_backup_eba702ee-9959-40fe-9093-1eecff8dbaa6-00079', 'volume_72e07e1e-1567-4071-8204-c29cb26d2660/20260703094710/az_nova_backup_eba702ee-9959-40fe-9093-1eecff8dbaa6-00080', 'volume_72e07e1e-1567-4071-8204-c29cb26d2660/20260703094710/az_nova_backup_eba702ee-9959-40fe-9093-1eecff8dbaa6-00081', 'volume_72e07e1e-1567-4071-8204-c29cb26d2660/20260703094710/az_nova_backup_eba702ee-9959-40fe-9093-1eecff8dbaa6-00082', 'volume_72e07e1e-1567-4071-8204-c29cb26d2660/20260703094710/az_nova_backup_eba702ee-9959-40fe-9093-1eecff8dbaa6-00083', 'volume_72e07e1e-1567-4071-8204-c29cb26d2660/20260703094710/az_nova_backup_eba702ee-9959-40fe-9093-1eecff8dbaa6-00084', 'volume_72e07e1e-1567-4071-8204-c29cb26d2660/20260703094710/az_nova_backup_eba702ee-9959-40fe-9093-1eecff8dbaa6-00085', 'volume_72e07e1e-1567-4071-8204-c29cb26d2660/20260703094710/az_nova_backup_eba702ee-9959-40fe-9093-1eecff8dbaa6-00086', 'volume_72e07e1e-1567-4071-8204-c29cb26d2660/20260703094710/az_nova_backup_eba702ee-9959-40fe-9093-1eecff8dbaa6-00087', 'volume_72e07e1e-1567-4071-8204-c29cb26d2660/20260703094710/az_nova_backup_eba702ee-9959-40fe-9093-1eecff8dbaa6-00088', 'volume_72e07e1e-1567-4071-8204-c29cb26d2660/20260703094710/az_nova_backup_eba702ee-9959-40fe-9093-1eecff8dbaa6-00089', 'volume_72e07e1e-1567-4071-8204-c29cb26d2660/20260703094710/az_nova_backup_eba702ee-9959-40fe-9093-1eecff8dbaa6-00090', 'volume_72e07e1e-1567-4071-8204-c29cb26d2660/20260703094710/az_nova_backup_eba702ee-9959-40fe-9093-1eecff8dbaa6-00091', 'volume_72e07e1e-1567-4071-8204-c29cb26d2660/20260703094710/az_nova_backup_eba702ee-9959-40fe-9093-1eecff8dbaa6-00092', 'volume_72e07e1e-1567-4071-8204-c29cb26d2660/20260703094710/az_nova_backup_eba702ee-9959-40fe-9093-1eecff8dbaa6-00093', 'volume_72e07e1e-1567-4071-8204-c29cb26d2660/20260703094710/az_nova_backup_eba702ee-9959-40fe-9093-1eecff8dbaa6-00094', 'volume_72e07e1e-1567-4071-8204-c29cb26d2660/20260703094710/az_nova_backup_eba702ee-9959-40fe-9093-1eecff8dbaa6-00095', 'volume_72e07e1e-1567-4071-8204-c29cb26d2660/20260703094710/az_nova_backup_eba702ee-9959-40fe-9093-1eecff8dbaa6-00096', 'volume_72e07e1e-1567-4071-8204-c29cb26d2660/20260703094710/az_nova_backup_eba702ee-9959-40fe-9093-1eecff8dbaa6-00097', 'volume_72e07e1e-1567-4071-8204-c29cb26d2660/20260703094710/az_nova_backup_eba702ee-9959-40fe-9093-1eecff8dbaa6-00098', 'volume_72e07e1e-1567-4071-8204-c29cb26d2660/20260703094710/az_nova_backup_eba702ee-9959-40fe-9093-1eecff8dbaa6-00099', 'volume_72e07e1e-1567-4071-8204-c29cb26d2660/20260703094710/az_nova_backup_eba702ee-9959-40fe-9093-1eecff8dbaa6-00100', 'volume_72e07e1e-1567-4071-8204-c29cb26d2660/20260703094710/az_nova_backup_eba702ee-9959-40fe-9093-1eecff8dbaa6-00101', 'volume_72e07e1e-1567-4071-8204-c29cb26d2660/20260703094710/az_nova_backup_eba702ee-9959-40fe-9093-1eecff8dbaa6-00102', 'volume_72e07e1e-1567-4071-8204-c29cb26d2660/20260703094710/az_nova_backup_eba702ee-9959-40fe-9093-1eecff8dbaa6-00103', 'volume_72e07e1e-1567-4071-8204-c29cb26d2660/20260703094710/az_nova_backup_eba702ee-9959-40fe-9093-1eecff8dbaa6-00104', 'volume_72e07e1e-1567-4071-8204-c29cb26d2660/20260703094710/az_nova_backup_eba702ee-9959-40fe-9093-1eecff8dbaa6-00105', 'volume_72e07e1e-1567-4071-8204-c29cb26d2660/20260703094710/az_nova_backup_eba702ee-9959-40fe-9093-1eecff8dbaa6-00106', 'volume_72e07e1e-1567-4071-8204-c29cb26d2660/20260703094710/az_nova_backup_eba702ee-9959-40fe-9093-1eecff8dbaa6-00107', 'volume_72e07e1e-1567-4071-8204-c29cb26d2660/20260703094710/az_nova_backup_eba702ee-9959-40fe-9093-1eecff8dbaa6-00108', 'volume_72e07e1e-1567-4071-8204-c29cb26d2660/20260703094710/az_nova_backup_eba702ee-9959-40fe-9093-1eecff8dbaa6-00109', 'volume_72e07e1e-1567-4071-8204-c29cb26d2660/20260703094710/az_nova_backup_eba702ee-9959-40fe-9093-1eecff8dbaa6-00110', 'volume_72e07e1e-1567-4071-8204-c29cb26d2660/20260703094710/az_nova_backup_eba702ee-9959-40fe-9093-1eecff8dbaa6_metadata', 'volume_72e07e1e-1567-4071-8204-c29cb26d2660/20260703094710/az_nova_backup_eba702ee-9959-40fe-9093-1eecff8dbaa6_sha256file']. {{(pid=101319) _generate_object_names /opt/stack/cinder/cinder/backup/chunkeddriver.py:260}} Jul 03 09:47:24.667820 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-f2328ac8-0306-44eb-b2b5-223cab8b003f tempest-VolumesBackupsTest-118275719 None] deleted object: volume_72e07e1e-1567-4071-8204-c29cb26d2660/20260703094710/az_nova_backup_eba702ee-9959-40fe-9093-1eecff8dbaa6-00001 in container: volumebackups. {{(pid=101319) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 09:47:24.692192 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-f2328ac8-0306-44eb-b2b5-223cab8b003f tempest-VolumesBackupsTest-118275719 None] deleted object: volume_72e07e1e-1567-4071-8204-c29cb26d2660/20260703094710/az_nova_backup_eba702ee-9959-40fe-9093-1eecff8dbaa6-00002 in container: volumebackups. {{(pid=101319) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 09:47:24.698899 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-75ba68df-8a8d-48ad-9be6-295988b8d81d tempest-VolumesBackupsTest-2142009639 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101319) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 09:47:24.699021 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-75ba68df-8a8d-48ad-9be6-295988b8d81d tempest-VolumesBackupsTest-2142009639 None] About to put_object {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 09:47:24.768941 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-f2328ac8-0306-44eb-b2b5-223cab8b003f tempest-VolumesBackupsTest-118275719 None] deleted object: volume_72e07e1e-1567-4071-8204-c29cb26d2660/20260703094710/az_nova_backup_eba702ee-9959-40fe-9093-1eecff8dbaa6-00003 in container: volumebackups. {{(pid=101319) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 09:47:24.818457 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-f2328ac8-0306-44eb-b2b5-223cab8b003f tempest-VolumesBackupsTest-118275719 None] deleted object: volume_72e07e1e-1567-4071-8204-c29cb26d2660/20260703094710/az_nova_backup_eba702ee-9959-40fe-9093-1eecff8dbaa6-00004 in container: volumebackups. {{(pid=101319) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 09:47:24.844491 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-f2328ac8-0306-44eb-b2b5-223cab8b003f tempest-VolumesBackupsTest-118275719 None] deleted object: volume_72e07e1e-1567-4071-8204-c29cb26d2660/20260703094710/az_nova_backup_eba702ee-9959-40fe-9093-1eecff8dbaa6-00005 in container: volumebackups. {{(pid=101319) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 09:47:24.876604 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-75ba68df-8a8d-48ad-9be6-295988b8d81d tempest-VolumesBackupsTest-2142009639 None] backup MD5 for volume_8a0b1cfb-8ea1-46a0-aac3-b254107b98ef/20260703094720/az_nova_backup_86118233-3d57-47ad-8781-cab6c54e4d53-00007: 25e317773f308e446cc84c503a6d1f85 {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 09:47:24.876804 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-75ba68df-8a8d-48ad-9be6-295988b8d81d tempest-VolumesBackupsTest-2142009639 None] Calling eventlet.sleep(0) {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 09:47:24.877928 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-f2328ac8-0306-44eb-b2b5-223cab8b003f tempest-VolumesBackupsTest-118275719 None] deleted object: volume_72e07e1e-1567-4071-8204-c29cb26d2660/20260703094710/az_nova_backup_eba702ee-9959-40fe-9093-1eecff8dbaa6-00006 in container: volumebackups. {{(pid=101319) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 09:47:24.929457 np0000004400 cinder-backup[101319]: DEBUG oslo_db.sqlalchemy.engines [None req-75ba68df-8a8d-48ad-9be6-295988b8d81d tempest-VolumesBackupsTest-2142009639 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=101319) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 03 09:47:24.975432 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-f2328ac8-0306-44eb-b2b5-223cab8b003f tempest-VolumesBackupsTest-118275719 None] deleted object: volume_72e07e1e-1567-4071-8204-c29cb26d2660/20260703094710/az_nova_backup_eba702ee-9959-40fe-9093-1eecff8dbaa6-00007 in container: volumebackups. {{(pid=101319) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 09:47:25.012381 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-f2328ac8-0306-44eb-b2b5-223cab8b003f tempest-VolumesBackupsTest-118275719 None] deleted object: volume_72e07e1e-1567-4071-8204-c29cb26d2660/20260703094710/az_nova_backup_eba702ee-9959-40fe-9093-1eecff8dbaa6-00008 in container: volumebackups. {{(pid=101319) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 09:47:25.056560 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-f2328ac8-0306-44eb-b2b5-223cab8b003f tempest-VolumesBackupsTest-118275719 None] deleted object: volume_72e07e1e-1567-4071-8204-c29cb26d2660/20260703094710/az_nova_backup_eba702ee-9959-40fe-9093-1eecff8dbaa6-00009 in container: volumebackups. {{(pid=101319) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 09:47:25.093840 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-f2328ac8-0306-44eb-b2b5-223cab8b003f tempest-VolumesBackupsTest-118275719 None] deleted object: volume_72e07e1e-1567-4071-8204-c29cb26d2660/20260703094710/az_nova_backup_eba702ee-9959-40fe-9093-1eecff8dbaa6-00010 in container: volumebackups. {{(pid=101319) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 09:47:25.126240 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-f2328ac8-0306-44eb-b2b5-223cab8b003f tempest-VolumesBackupsTest-118275719 None] deleted object: volume_72e07e1e-1567-4071-8204-c29cb26d2660/20260703094710/az_nova_backup_eba702ee-9959-40fe-9093-1eecff8dbaa6-00011 in container: volumebackups. {{(pid=101319) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 09:47:25.134929 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-75ba68df-8a8d-48ad-9be6-295988b8d81d tempest-VolumesBackupsTest-2142009639 None] Backing up chunk of data from volume. {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 09:47:25.170153 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-f2328ac8-0306-44eb-b2b5-223cab8b003f tempest-VolumesBackupsTest-118275719 None] deleted object: volume_72e07e1e-1567-4071-8204-c29cb26d2660/20260703094710/az_nova_backup_eba702ee-9959-40fe-9093-1eecff8dbaa6-00012 in container: volumebackups. {{(pid=101319) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 09:47:25.204897 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-f2328ac8-0306-44eb-b2b5-223cab8b003f tempest-VolumesBackupsTest-118275719 None] deleted object: volume_72e07e1e-1567-4071-8204-c29cb26d2660/20260703094710/az_nova_backup_eba702ee-9959-40fe-9093-1eecff8dbaa6-00013 in container: volumebackups. {{(pid=101319) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 09:47:25.226650 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-f2328ac8-0306-44eb-b2b5-223cab8b003f tempest-VolumesBackupsTest-118275719 None] deleted object: volume_72e07e1e-1567-4071-8204-c29cb26d2660/20260703094710/az_nova_backup_eba702ee-9959-40fe-9093-1eecff8dbaa6-00014 in container: volumebackups. {{(pid=101319) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 09:47:25.250355 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-f2328ac8-0306-44eb-b2b5-223cab8b003f tempest-VolumesBackupsTest-118275719 None] deleted object: volume_72e07e1e-1567-4071-8204-c29cb26d2660/20260703094710/az_nova_backup_eba702ee-9959-40fe-9093-1eecff8dbaa6-00015 in container: volumebackups. {{(pid=101319) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 09:47:25.271748 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-f2328ac8-0306-44eb-b2b5-223cab8b003f tempest-VolumesBackupsTest-118275719 None] deleted object: volume_72e07e1e-1567-4071-8204-c29cb26d2660/20260703094710/az_nova_backup_eba702ee-9959-40fe-9093-1eecff8dbaa6-00016 in container: volumebackups. {{(pid=101319) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 09:47:25.293604 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-f2328ac8-0306-44eb-b2b5-223cab8b003f tempest-VolumesBackupsTest-118275719 None] deleted object: volume_72e07e1e-1567-4071-8204-c29cb26d2660/20260703094710/az_nova_backup_eba702ee-9959-40fe-9093-1eecff8dbaa6-00017 in container: volumebackups. {{(pid=101319) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 09:47:25.320464 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-f2328ac8-0306-44eb-b2b5-223cab8b003f tempest-VolumesBackupsTest-118275719 None] deleted object: volume_72e07e1e-1567-4071-8204-c29cb26d2660/20260703094710/az_nova_backup_eba702ee-9959-40fe-9093-1eecff8dbaa6-00018 in container: volumebackups. {{(pid=101319) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 09:47:25.344780 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-f2328ac8-0306-44eb-b2b5-223cab8b003f tempest-VolumesBackupsTest-118275719 None] deleted object: volume_72e07e1e-1567-4071-8204-c29cb26d2660/20260703094710/az_nova_backup_eba702ee-9959-40fe-9093-1eecff8dbaa6-00019 in container: volumebackups. {{(pid=101319) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 09:47:25.370428 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-f2328ac8-0306-44eb-b2b5-223cab8b003f tempest-VolumesBackupsTest-118275719 None] deleted object: volume_72e07e1e-1567-4071-8204-c29cb26d2660/20260703094710/az_nova_backup_eba702ee-9959-40fe-9093-1eecff8dbaa6-00020 in container: volumebackups. {{(pid=101319) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 09:47:25.387730 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-75ba68df-8a8d-48ad-9be6-295988b8d81d tempest-VolumesBackupsTest-2142009639 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101319) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 09:47:25.387912 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-75ba68df-8a8d-48ad-9be6-295988b8d81d tempest-VolumesBackupsTest-2142009639 None] About to put_object {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 09:47:25.397546 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-f2328ac8-0306-44eb-b2b5-223cab8b003f tempest-VolumesBackupsTest-118275719 None] deleted object: volume_72e07e1e-1567-4071-8204-c29cb26d2660/20260703094710/az_nova_backup_eba702ee-9959-40fe-9093-1eecff8dbaa6-00021 in container: volumebackups. {{(pid=101319) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 09:47:25.430161 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-f2328ac8-0306-44eb-b2b5-223cab8b003f tempest-VolumesBackupsTest-118275719 None] deleted object: volume_72e07e1e-1567-4071-8204-c29cb26d2660/20260703094710/az_nova_backup_eba702ee-9959-40fe-9093-1eecff8dbaa6-00022 in container: volumebackups. {{(pid=101319) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 09:47:25.475646 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-f2328ac8-0306-44eb-b2b5-223cab8b003f tempest-VolumesBackupsTest-118275719 None] deleted object: volume_72e07e1e-1567-4071-8204-c29cb26d2660/20260703094710/az_nova_backup_eba702ee-9959-40fe-9093-1eecff8dbaa6-00023 in container: volumebackups. {{(pid=101319) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 09:47:25.501235 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-f2328ac8-0306-44eb-b2b5-223cab8b003f tempest-VolumesBackupsTest-118275719 None] deleted object: volume_72e07e1e-1567-4071-8204-c29cb26d2660/20260703094710/az_nova_backup_eba702ee-9959-40fe-9093-1eecff8dbaa6-00024 in container: volumebackups. {{(pid=101319) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 09:47:25.504425 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-75ba68df-8a8d-48ad-9be6-295988b8d81d tempest-VolumesBackupsTest-2142009639 None] backup MD5 for volume_8a0b1cfb-8ea1-46a0-aac3-b254107b98ef/20260703094720/az_nova_backup_86118233-3d57-47ad-8781-cab6c54e4d53-00008: 25e317773f308e446cc84c503a6d1f85 {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 09:47:25.504623 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-75ba68df-8a8d-48ad-9be6-295988b8d81d tempest-VolumesBackupsTest-2142009639 None] Calling eventlet.sleep(0) {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 09:47:25.528743 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-f2328ac8-0306-44eb-b2b5-223cab8b003f tempest-VolumesBackupsTest-118275719 None] deleted object: volume_72e07e1e-1567-4071-8204-c29cb26d2660/20260703094710/az_nova_backup_eba702ee-9959-40fe-9093-1eecff8dbaa6-00025 in container: volumebackups. {{(pid=101319) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 09:47:25.552088 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-f2328ac8-0306-44eb-b2b5-223cab8b003f tempest-VolumesBackupsTest-118275719 None] deleted object: volume_72e07e1e-1567-4071-8204-c29cb26d2660/20260703094710/az_nova_backup_eba702ee-9959-40fe-9093-1eecff8dbaa6-00026 in container: volumebackups. {{(pid=101319) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 09:47:25.573354 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-f2328ac8-0306-44eb-b2b5-223cab8b003f tempest-VolumesBackupsTest-118275719 None] deleted object: volume_72e07e1e-1567-4071-8204-c29cb26d2660/20260703094710/az_nova_backup_eba702ee-9959-40fe-9093-1eecff8dbaa6-00027 in container: volumebackups. {{(pid=101319) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 09:47:25.594571 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-f2328ac8-0306-44eb-b2b5-223cab8b003f tempest-VolumesBackupsTest-118275719 None] deleted object: volume_72e07e1e-1567-4071-8204-c29cb26d2660/20260703094710/az_nova_backup_eba702ee-9959-40fe-9093-1eecff8dbaa6-00028 in container: volumebackups. {{(pid=101319) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 09:47:25.620439 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-f2328ac8-0306-44eb-b2b5-223cab8b003f tempest-VolumesBackupsTest-118275719 None] deleted object: volume_72e07e1e-1567-4071-8204-c29cb26d2660/20260703094710/az_nova_backup_eba702ee-9959-40fe-9093-1eecff8dbaa6-00029 in container: volumebackups. {{(pid=101319) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 09:47:25.717268 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-75ba68df-8a8d-48ad-9be6-295988b8d81d tempest-VolumesBackupsTest-2142009639 None] Backing up chunk of data from volume. {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 09:47:25.741188 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-f2328ac8-0306-44eb-b2b5-223cab8b003f tempest-VolumesBackupsTest-118275719 None] deleted object: volume_72e07e1e-1567-4071-8204-c29cb26d2660/20260703094710/az_nova_backup_eba702ee-9959-40fe-9093-1eecff8dbaa6-00030 in container: volumebackups. {{(pid=101319) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 09:47:25.808186 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-f2328ac8-0306-44eb-b2b5-223cab8b003f tempest-VolumesBackupsTest-118275719 None] deleted object: volume_72e07e1e-1567-4071-8204-c29cb26d2660/20260703094710/az_nova_backup_eba702ee-9959-40fe-9093-1eecff8dbaa6-00031 in container: volumebackups. {{(pid=101319) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 09:47:25.877675 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-f2328ac8-0306-44eb-b2b5-223cab8b003f tempest-VolumesBackupsTest-118275719 None] deleted object: volume_72e07e1e-1567-4071-8204-c29cb26d2660/20260703094710/az_nova_backup_eba702ee-9959-40fe-9093-1eecff8dbaa6-00032 in container: volumebackups. {{(pid=101319) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 09:47:25.926305 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-f2328ac8-0306-44eb-b2b5-223cab8b003f tempest-VolumesBackupsTest-118275719 None] deleted object: volume_72e07e1e-1567-4071-8204-c29cb26d2660/20260703094710/az_nova_backup_eba702ee-9959-40fe-9093-1eecff8dbaa6-00033 in container: volumebackups. {{(pid=101319) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 09:47:25.980081 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-75ba68df-8a8d-48ad-9be6-295988b8d81d tempest-VolumesBackupsTest-2142009639 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101319) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 09:47:25.980081 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-75ba68df-8a8d-48ad-9be6-295988b8d81d tempest-VolumesBackupsTest-2142009639 None] About to put_object {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 09:47:26.017188 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-f2328ac8-0306-44eb-b2b5-223cab8b003f tempest-VolumesBackupsTest-118275719 None] deleted object: volume_72e07e1e-1567-4071-8204-c29cb26d2660/20260703094710/az_nova_backup_eba702ee-9959-40fe-9093-1eecff8dbaa6-00034 in container: volumebackups. {{(pid=101319) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 09:47:26.052483 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-f2328ac8-0306-44eb-b2b5-223cab8b003f tempest-VolumesBackupsTest-118275719 None] deleted object: volume_72e07e1e-1567-4071-8204-c29cb26d2660/20260703094710/az_nova_backup_eba702ee-9959-40fe-9093-1eecff8dbaa6-00035 in container: volumebackups. {{(pid=101319) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 09:47:26.103503 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-f2328ac8-0306-44eb-b2b5-223cab8b003f tempest-VolumesBackupsTest-118275719 None] deleted object: volume_72e07e1e-1567-4071-8204-c29cb26d2660/20260703094710/az_nova_backup_eba702ee-9959-40fe-9093-1eecff8dbaa6-00036 in container: volumebackups. {{(pid=101319) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 09:47:26.130732 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-f2328ac8-0306-44eb-b2b5-223cab8b003f tempest-VolumesBackupsTest-118275719 None] deleted object: volume_72e07e1e-1567-4071-8204-c29cb26d2660/20260703094710/az_nova_backup_eba702ee-9959-40fe-9093-1eecff8dbaa6-00037 in container: volumebackups. {{(pid=101319) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 09:47:26.137862 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-75ba68df-8a8d-48ad-9be6-295988b8d81d tempest-VolumesBackupsTest-2142009639 None] backup MD5 for volume_8a0b1cfb-8ea1-46a0-aac3-b254107b98ef/20260703094720/az_nova_backup_86118233-3d57-47ad-8781-cab6c54e4d53-00009: 25e317773f308e446cc84c503a6d1f85 {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 09:47:26.138019 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-75ba68df-8a8d-48ad-9be6-295988b8d81d tempest-VolumesBackupsTest-2142009639 None] Calling eventlet.sleep(0) {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 09:47:26.161296 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-f2328ac8-0306-44eb-b2b5-223cab8b003f tempest-VolumesBackupsTest-118275719 None] deleted object: volume_72e07e1e-1567-4071-8204-c29cb26d2660/20260703094710/az_nova_backup_eba702ee-9959-40fe-9093-1eecff8dbaa6-00038 in container: volumebackups. {{(pid=101319) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 09:47:26.197798 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-f2328ac8-0306-44eb-b2b5-223cab8b003f tempest-VolumesBackupsTest-118275719 None] deleted object: volume_72e07e1e-1567-4071-8204-c29cb26d2660/20260703094710/az_nova_backup_eba702ee-9959-40fe-9093-1eecff8dbaa6-00039 in container: volumebackups. {{(pid=101319) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 09:47:26.229149 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-f2328ac8-0306-44eb-b2b5-223cab8b003f tempest-VolumesBackupsTest-118275719 None] deleted object: volume_72e07e1e-1567-4071-8204-c29cb26d2660/20260703094710/az_nova_backup_eba702ee-9959-40fe-9093-1eecff8dbaa6-00040 in container: volumebackups. {{(pid=101319) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 09:47:26.268121 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-f2328ac8-0306-44eb-b2b5-223cab8b003f tempest-VolumesBackupsTest-118275719 None] deleted object: volume_72e07e1e-1567-4071-8204-c29cb26d2660/20260703094710/az_nova_backup_eba702ee-9959-40fe-9093-1eecff8dbaa6-00041 in container: volumebackups. {{(pid=101319) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 09:47:26.302813 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-f2328ac8-0306-44eb-b2b5-223cab8b003f tempest-VolumesBackupsTest-118275719 None] deleted object: volume_72e07e1e-1567-4071-8204-c29cb26d2660/20260703094710/az_nova_backup_eba702ee-9959-40fe-9093-1eecff8dbaa6-00042 in container: volumebackups. {{(pid=101319) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 09:47:26.334259 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-f2328ac8-0306-44eb-b2b5-223cab8b003f tempest-VolumesBackupsTest-118275719 None] deleted object: volume_72e07e1e-1567-4071-8204-c29cb26d2660/20260703094710/az_nova_backup_eba702ee-9959-40fe-9093-1eecff8dbaa6-00043 in container: volumebackups. {{(pid=101319) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 09:47:26.377561 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-f2328ac8-0306-44eb-b2b5-223cab8b003f tempest-VolumesBackupsTest-118275719 None] deleted object: volume_72e07e1e-1567-4071-8204-c29cb26d2660/20260703094710/az_nova_backup_eba702ee-9959-40fe-9093-1eecff8dbaa6-00044 in container: volumebackups. {{(pid=101319) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 09:47:26.381266 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-75ba68df-8a8d-48ad-9be6-295988b8d81d tempest-VolumesBackupsTest-2142009639 None] Backing up chunk of data from volume. {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 09:47:26.423146 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-f2328ac8-0306-44eb-b2b5-223cab8b003f tempest-VolumesBackupsTest-118275719 None] deleted object: volume_72e07e1e-1567-4071-8204-c29cb26d2660/20260703094710/az_nova_backup_eba702ee-9959-40fe-9093-1eecff8dbaa6-00045 in container: volumebackups. {{(pid=101319) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 09:47:26.472950 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-f2328ac8-0306-44eb-b2b5-223cab8b003f tempest-VolumesBackupsTest-118275719 None] deleted object: volume_72e07e1e-1567-4071-8204-c29cb26d2660/20260703094710/az_nova_backup_eba702ee-9959-40fe-9093-1eecff8dbaa6-00046 in container: volumebackups. {{(pid=101319) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 09:47:26.505516 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-f2328ac8-0306-44eb-b2b5-223cab8b003f tempest-VolumesBackupsTest-118275719 None] deleted object: volume_72e07e1e-1567-4071-8204-c29cb26d2660/20260703094710/az_nova_backup_eba702ee-9959-40fe-9093-1eecff8dbaa6-00047 in container: volumebackups. {{(pid=101319) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 09:47:26.533835 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-f2328ac8-0306-44eb-b2b5-223cab8b003f tempest-VolumesBackupsTest-118275719 None] deleted object: volume_72e07e1e-1567-4071-8204-c29cb26d2660/20260703094710/az_nova_backup_eba702ee-9959-40fe-9093-1eecff8dbaa6-00048 in container: volumebackups. {{(pid=101319) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 09:47:26.559207 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-f2328ac8-0306-44eb-b2b5-223cab8b003f tempest-VolumesBackupsTest-118275719 None] deleted object: volume_72e07e1e-1567-4071-8204-c29cb26d2660/20260703094710/az_nova_backup_eba702ee-9959-40fe-9093-1eecff8dbaa6-00049 in container: volumebackups. {{(pid=101319) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 09:47:26.586852 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-f2328ac8-0306-44eb-b2b5-223cab8b003f tempest-VolumesBackupsTest-118275719 None] deleted object: volume_72e07e1e-1567-4071-8204-c29cb26d2660/20260703094710/az_nova_backup_eba702ee-9959-40fe-9093-1eecff8dbaa6-00050 in container: volumebackups. {{(pid=101319) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 09:47:26.611112 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-f2328ac8-0306-44eb-b2b5-223cab8b003f tempest-VolumesBackupsTest-118275719 None] deleted object: volume_72e07e1e-1567-4071-8204-c29cb26d2660/20260703094710/az_nova_backup_eba702ee-9959-40fe-9093-1eecff8dbaa6-00051 in container: volumebackups. {{(pid=101319) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 09:47:26.638391 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-f2328ac8-0306-44eb-b2b5-223cab8b003f tempest-VolumesBackupsTest-118275719 None] deleted object: volume_72e07e1e-1567-4071-8204-c29cb26d2660/20260703094710/az_nova_backup_eba702ee-9959-40fe-9093-1eecff8dbaa6-00052 in container: volumebackups. {{(pid=101319) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 09:47:26.652304 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-75ba68df-8a8d-48ad-9be6-295988b8d81d tempest-VolumesBackupsTest-2142009639 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101319) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 09:47:26.652527 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-75ba68df-8a8d-48ad-9be6-295988b8d81d tempest-VolumesBackupsTest-2142009639 None] About to put_object {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 09:47:26.685263 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-f2328ac8-0306-44eb-b2b5-223cab8b003f tempest-VolumesBackupsTest-118275719 None] deleted object: volume_72e07e1e-1567-4071-8204-c29cb26d2660/20260703094710/az_nova_backup_eba702ee-9959-40fe-9093-1eecff8dbaa6-00053 in container: volumebackups. {{(pid=101319) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 09:47:26.717751 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-f2328ac8-0306-44eb-b2b5-223cab8b003f tempest-VolumesBackupsTest-118275719 None] deleted object: volume_72e07e1e-1567-4071-8204-c29cb26d2660/20260703094710/az_nova_backup_eba702ee-9959-40fe-9093-1eecff8dbaa6-00054 in container: volumebackups. {{(pid=101319) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 09:47:26.740544 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-f2328ac8-0306-44eb-b2b5-223cab8b003f tempest-VolumesBackupsTest-118275719 None] deleted object: volume_72e07e1e-1567-4071-8204-c29cb26d2660/20260703094710/az_nova_backup_eba702ee-9959-40fe-9093-1eecff8dbaa6-00055 in container: volumebackups. {{(pid=101319) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 09:47:26.765843 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-f2328ac8-0306-44eb-b2b5-223cab8b003f tempest-VolumesBackupsTest-118275719 None] deleted object: volume_72e07e1e-1567-4071-8204-c29cb26d2660/20260703094710/az_nova_backup_eba702ee-9959-40fe-9093-1eecff8dbaa6-00056 in container: volumebackups. {{(pid=101319) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 09:47:26.788399 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-f2328ac8-0306-44eb-b2b5-223cab8b003f tempest-VolumesBackupsTest-118275719 None] deleted object: volume_72e07e1e-1567-4071-8204-c29cb26d2660/20260703094710/az_nova_backup_eba702ee-9959-40fe-9093-1eecff8dbaa6-00057 in container: volumebackups. {{(pid=101319) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 09:47:26.795657 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-75ba68df-8a8d-48ad-9be6-295988b8d81d tempest-VolumesBackupsTest-2142009639 None] backup MD5 for volume_8a0b1cfb-8ea1-46a0-aac3-b254107b98ef/20260703094720/az_nova_backup_86118233-3d57-47ad-8781-cab6c54e4d53-00010: 25e317773f308e446cc84c503a6d1f85 {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 09:47:26.795836 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-75ba68df-8a8d-48ad-9be6-295988b8d81d tempest-VolumesBackupsTest-2142009639 None] Calling eventlet.sleep(0) {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 09:47:26.818062 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-f2328ac8-0306-44eb-b2b5-223cab8b003f tempest-VolumesBackupsTest-118275719 None] deleted object: volume_72e07e1e-1567-4071-8204-c29cb26d2660/20260703094710/az_nova_backup_eba702ee-9959-40fe-9093-1eecff8dbaa6-00058 in container: volumebackups. {{(pid=101319) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 09:47:26.858936 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-f2328ac8-0306-44eb-b2b5-223cab8b003f tempest-VolumesBackupsTest-118275719 None] deleted object: volume_72e07e1e-1567-4071-8204-c29cb26d2660/20260703094710/az_nova_backup_eba702ee-9959-40fe-9093-1eecff8dbaa6-00059 in container: volumebackups. {{(pid=101319) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 09:47:26.884972 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-f2328ac8-0306-44eb-b2b5-223cab8b003f tempest-VolumesBackupsTest-118275719 None] deleted object: volume_72e07e1e-1567-4071-8204-c29cb26d2660/20260703094710/az_nova_backup_eba702ee-9959-40fe-9093-1eecff8dbaa6-00060 in container: volumebackups. {{(pid=101319) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 09:47:26.912421 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-f2328ac8-0306-44eb-b2b5-223cab8b003f tempest-VolumesBackupsTest-118275719 None] deleted object: volume_72e07e1e-1567-4071-8204-c29cb26d2660/20260703094710/az_nova_backup_eba702ee-9959-40fe-9093-1eecff8dbaa6-00061 in container: volumebackups. {{(pid=101319) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 09:47:26.980427 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-f2328ac8-0306-44eb-b2b5-223cab8b003f tempest-VolumesBackupsTest-118275719 None] deleted object: volume_72e07e1e-1567-4071-8204-c29cb26d2660/20260703094710/az_nova_backup_eba702ee-9959-40fe-9093-1eecff8dbaa6-00062 in container: volumebackups. {{(pid=101319) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 09:47:27.005971 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-75ba68df-8a8d-48ad-9be6-295988b8d81d tempest-VolumesBackupsTest-2142009639 None] Backing up chunk of data from volume. {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 09:47:27.022527 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-f2328ac8-0306-44eb-b2b5-223cab8b003f tempest-VolumesBackupsTest-118275719 None] deleted object: volume_72e07e1e-1567-4071-8204-c29cb26d2660/20260703094710/az_nova_backup_eba702ee-9959-40fe-9093-1eecff8dbaa6-00063 in container: volumebackups. {{(pid=101319) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 09:47:27.058604 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-f2328ac8-0306-44eb-b2b5-223cab8b003f tempest-VolumesBackupsTest-118275719 None] deleted object: volume_72e07e1e-1567-4071-8204-c29cb26d2660/20260703094710/az_nova_backup_eba702ee-9959-40fe-9093-1eecff8dbaa6-00064 in container: volumebackups. {{(pid=101319) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 09:47:27.096264 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-f2328ac8-0306-44eb-b2b5-223cab8b003f tempest-VolumesBackupsTest-118275719 None] deleted object: volume_72e07e1e-1567-4071-8204-c29cb26d2660/20260703094710/az_nova_backup_eba702ee-9959-40fe-9093-1eecff8dbaa6-00065 in container: volumebackups. {{(pid=101319) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 09:47:27.139504 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-f2328ac8-0306-44eb-b2b5-223cab8b003f tempest-VolumesBackupsTest-118275719 None] deleted object: volume_72e07e1e-1567-4071-8204-c29cb26d2660/20260703094710/az_nova_backup_eba702ee-9959-40fe-9093-1eecff8dbaa6-00066 in container: volumebackups. {{(pid=101319) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 09:47:27.173841 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-f2328ac8-0306-44eb-b2b5-223cab8b003f tempest-VolumesBackupsTest-118275719 None] deleted object: volume_72e07e1e-1567-4071-8204-c29cb26d2660/20260703094710/az_nova_backup_eba702ee-9959-40fe-9093-1eecff8dbaa6-00067 in container: volumebackups. {{(pid=101319) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 09:47:27.209455 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-f2328ac8-0306-44eb-b2b5-223cab8b003f tempest-VolumesBackupsTest-118275719 None] deleted object: volume_72e07e1e-1567-4071-8204-c29cb26d2660/20260703094710/az_nova_backup_eba702ee-9959-40fe-9093-1eecff8dbaa6-00068 in container: volumebackups. {{(pid=101319) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 09:47:27.236819 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-f2328ac8-0306-44eb-b2b5-223cab8b003f tempest-VolumesBackupsTest-118275719 None] deleted object: volume_72e07e1e-1567-4071-8204-c29cb26d2660/20260703094710/az_nova_backup_eba702ee-9959-40fe-9093-1eecff8dbaa6-00069 in container: volumebackups. {{(pid=101319) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 09:47:27.262790 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-f2328ac8-0306-44eb-b2b5-223cab8b003f tempest-VolumesBackupsTest-118275719 None] deleted object: volume_72e07e1e-1567-4071-8204-c29cb26d2660/20260703094710/az_nova_backup_eba702ee-9959-40fe-9093-1eecff8dbaa6-00070 in container: volumebackups. {{(pid=101319) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 09:47:27.262993 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-75ba68df-8a8d-48ad-9be6-295988b8d81d tempest-VolumesBackupsTest-2142009639 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101319) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 09:47:27.263119 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-75ba68df-8a8d-48ad-9be6-295988b8d81d tempest-VolumesBackupsTest-2142009639 None] About to put_object {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 09:47:27.291990 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-f2328ac8-0306-44eb-b2b5-223cab8b003f tempest-VolumesBackupsTest-118275719 None] deleted object: volume_72e07e1e-1567-4071-8204-c29cb26d2660/20260703094710/az_nova_backup_eba702ee-9959-40fe-9093-1eecff8dbaa6-00071 in container: volumebackups. {{(pid=101319) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 09:47:27.329536 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-f2328ac8-0306-44eb-b2b5-223cab8b003f tempest-VolumesBackupsTest-118275719 None] deleted object: volume_72e07e1e-1567-4071-8204-c29cb26d2660/20260703094710/az_nova_backup_eba702ee-9959-40fe-9093-1eecff8dbaa6-00072 in container: volumebackups. {{(pid=101319) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 09:47:27.355125 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-f2328ac8-0306-44eb-b2b5-223cab8b003f tempest-VolumesBackupsTest-118275719 None] deleted object: volume_72e07e1e-1567-4071-8204-c29cb26d2660/20260703094710/az_nova_backup_eba702ee-9959-40fe-9093-1eecff8dbaa6-00073 in container: volumebackups. {{(pid=101319) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 09:47:27.382506 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-f2328ac8-0306-44eb-b2b5-223cab8b003f tempest-VolumesBackupsTest-118275719 None] deleted object: volume_72e07e1e-1567-4071-8204-c29cb26d2660/20260703094710/az_nova_backup_eba702ee-9959-40fe-9093-1eecff8dbaa6-00074 in container: volumebackups. {{(pid=101319) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 09:47:27.386504 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-75ba68df-8a8d-48ad-9be6-295988b8d81d tempest-VolumesBackupsTest-2142009639 None] backup MD5 for volume_8a0b1cfb-8ea1-46a0-aac3-b254107b98ef/20260703094720/az_nova_backup_86118233-3d57-47ad-8781-cab6c54e4d53-00011: 25e317773f308e446cc84c503a6d1f85 {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 09:47:27.386794 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-75ba68df-8a8d-48ad-9be6-295988b8d81d tempest-VolumesBackupsTest-2142009639 None] Calling eventlet.sleep(0) {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 09:47:27.412427 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-f2328ac8-0306-44eb-b2b5-223cab8b003f tempest-VolumesBackupsTest-118275719 None] deleted object: volume_72e07e1e-1567-4071-8204-c29cb26d2660/20260703094710/az_nova_backup_eba702ee-9959-40fe-9093-1eecff8dbaa6-00075 in container: volumebackups. {{(pid=101319) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 09:47:27.436830 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-f2328ac8-0306-44eb-b2b5-223cab8b003f tempest-VolumesBackupsTest-118275719 None] deleted object: volume_72e07e1e-1567-4071-8204-c29cb26d2660/20260703094710/az_nova_backup_eba702ee-9959-40fe-9093-1eecff8dbaa6-00076 in container: volumebackups. {{(pid=101319) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 09:47:27.463429 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-f2328ac8-0306-44eb-b2b5-223cab8b003f tempest-VolumesBackupsTest-118275719 None] deleted object: volume_72e07e1e-1567-4071-8204-c29cb26d2660/20260703094710/az_nova_backup_eba702ee-9959-40fe-9093-1eecff8dbaa6-00077 in container: volumebackups. {{(pid=101319) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 09:47:27.491428 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-f2328ac8-0306-44eb-b2b5-223cab8b003f tempest-VolumesBackupsTest-118275719 None] deleted object: volume_72e07e1e-1567-4071-8204-c29cb26d2660/20260703094710/az_nova_backup_eba702ee-9959-40fe-9093-1eecff8dbaa6-00078 in container: volumebackups. {{(pid=101319) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 09:47:27.538306 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-f2328ac8-0306-44eb-b2b5-223cab8b003f tempest-VolumesBackupsTest-118275719 None] deleted object: volume_72e07e1e-1567-4071-8204-c29cb26d2660/20260703094710/az_nova_backup_eba702ee-9959-40fe-9093-1eecff8dbaa6-00079 in container: volumebackups. {{(pid=101319) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 09:47:27.585529 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-f2328ac8-0306-44eb-b2b5-223cab8b003f tempest-VolumesBackupsTest-118275719 None] deleted object: volume_72e07e1e-1567-4071-8204-c29cb26d2660/20260703094710/az_nova_backup_eba702ee-9959-40fe-9093-1eecff8dbaa6-00080 in container: volumebackups. {{(pid=101319) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 09:47:27.631582 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-75ba68df-8a8d-48ad-9be6-295988b8d81d tempest-VolumesBackupsTest-2142009639 None] Backing up chunk of data from volume. {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 09:47:27.657427 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-f2328ac8-0306-44eb-b2b5-223cab8b003f tempest-VolumesBackupsTest-118275719 None] deleted object: volume_72e07e1e-1567-4071-8204-c29cb26d2660/20260703094710/az_nova_backup_eba702ee-9959-40fe-9093-1eecff8dbaa6-00081 in container: volumebackups. {{(pid=101319) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 09:47:27.744702 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-f2328ac8-0306-44eb-b2b5-223cab8b003f tempest-VolumesBackupsTest-118275719 None] deleted object: volume_72e07e1e-1567-4071-8204-c29cb26d2660/20260703094710/az_nova_backup_eba702ee-9959-40fe-9093-1eecff8dbaa6-00082 in container: volumebackups. {{(pid=101319) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 09:47:27.830888 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-f2328ac8-0306-44eb-b2b5-223cab8b003f tempest-VolumesBackupsTest-118275719 None] deleted object: volume_72e07e1e-1567-4071-8204-c29cb26d2660/20260703094710/az_nova_backup_eba702ee-9959-40fe-9093-1eecff8dbaa6-00083 in container: volumebackups. {{(pid=101319) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 09:47:27.870744 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-f2328ac8-0306-44eb-b2b5-223cab8b003f tempest-VolumesBackupsTest-118275719 None] deleted object: volume_72e07e1e-1567-4071-8204-c29cb26d2660/20260703094710/az_nova_backup_eba702ee-9959-40fe-9093-1eecff8dbaa6-00084 in container: volumebackups. {{(pid=101319) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 09:47:27.872764 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-75ba68df-8a8d-48ad-9be6-295988b8d81d tempest-VolumesBackupsTest-2142009639 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101319) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 09:47:27.872967 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-75ba68df-8a8d-48ad-9be6-295988b8d81d tempest-VolumesBackupsTest-2142009639 None] About to put_object {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 09:47:27.895918 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-f2328ac8-0306-44eb-b2b5-223cab8b003f tempest-VolumesBackupsTest-118275719 None] deleted object: volume_72e07e1e-1567-4071-8204-c29cb26d2660/20260703094710/az_nova_backup_eba702ee-9959-40fe-9093-1eecff8dbaa6-00085 in container: volumebackups. {{(pid=101319) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 09:47:27.951517 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-f2328ac8-0306-44eb-b2b5-223cab8b003f tempest-VolumesBackupsTest-118275719 None] deleted object: volume_72e07e1e-1567-4071-8204-c29cb26d2660/20260703094710/az_nova_backup_eba702ee-9959-40fe-9093-1eecff8dbaa6-00086 in container: volumebackups. {{(pid=101319) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 09:47:27.998078 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-f2328ac8-0306-44eb-b2b5-223cab8b003f tempest-VolumesBackupsTest-118275719 None] deleted object: volume_72e07e1e-1567-4071-8204-c29cb26d2660/20260703094710/az_nova_backup_eba702ee-9959-40fe-9093-1eecff8dbaa6-00087 in container: volumebackups. {{(pid=101319) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 09:47:28.001111 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-75ba68df-8a8d-48ad-9be6-295988b8d81d tempest-VolumesBackupsTest-2142009639 None] backup MD5 for volume_8a0b1cfb-8ea1-46a0-aac3-b254107b98ef/20260703094720/az_nova_backup_86118233-3d57-47ad-8781-cab6c54e4d53-00012: 25e317773f308e446cc84c503a6d1f85 {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 09:47:28.001111 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-75ba68df-8a8d-48ad-9be6-295988b8d81d tempest-VolumesBackupsTest-2142009639 None] Calling eventlet.sleep(0) {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 09:47:28.028021 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-f2328ac8-0306-44eb-b2b5-223cab8b003f tempest-VolumesBackupsTest-118275719 None] deleted object: volume_72e07e1e-1567-4071-8204-c29cb26d2660/20260703094710/az_nova_backup_eba702ee-9959-40fe-9093-1eecff8dbaa6-00088 in container: volumebackups. {{(pid=101319) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 09:47:28.073102 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-f2328ac8-0306-44eb-b2b5-223cab8b003f tempest-VolumesBackupsTest-118275719 None] deleted object: volume_72e07e1e-1567-4071-8204-c29cb26d2660/20260703094710/az_nova_backup_eba702ee-9959-40fe-9093-1eecff8dbaa6-00089 in container: volumebackups. {{(pid=101319) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 09:47:28.108358 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-f2328ac8-0306-44eb-b2b5-223cab8b003f tempest-VolumesBackupsTest-118275719 None] deleted object: volume_72e07e1e-1567-4071-8204-c29cb26d2660/20260703094710/az_nova_backup_eba702ee-9959-40fe-9093-1eecff8dbaa6-00090 in container: volumebackups. {{(pid=101319) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 09:47:28.149124 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-f2328ac8-0306-44eb-b2b5-223cab8b003f tempest-VolumesBackupsTest-118275719 None] deleted object: volume_72e07e1e-1567-4071-8204-c29cb26d2660/20260703094710/az_nova_backup_eba702ee-9959-40fe-9093-1eecff8dbaa6-00091 in container: volumebackups. {{(pid=101319) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 09:47:28.188828 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-f2328ac8-0306-44eb-b2b5-223cab8b003f tempest-VolumesBackupsTest-118275719 None] deleted object: volume_72e07e1e-1567-4071-8204-c29cb26d2660/20260703094710/az_nova_backup_eba702ee-9959-40fe-9093-1eecff8dbaa6-00092 in container: volumebackups. {{(pid=101319) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 09:47:28.195279 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-75ba68df-8a8d-48ad-9be6-295988b8d81d tempest-VolumesBackupsTest-2142009639 None] Backing up chunk of data from volume. {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 09:47:28.224302 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-f2328ac8-0306-44eb-b2b5-223cab8b003f tempest-VolumesBackupsTest-118275719 None] deleted object: volume_72e07e1e-1567-4071-8204-c29cb26d2660/20260703094710/az_nova_backup_eba702ee-9959-40fe-9093-1eecff8dbaa6-00093 in container: volumebackups. {{(pid=101319) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 09:47:28.269294 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-f2328ac8-0306-44eb-b2b5-223cab8b003f tempest-VolumesBackupsTest-118275719 None] deleted object: volume_72e07e1e-1567-4071-8204-c29cb26d2660/20260703094710/az_nova_backup_eba702ee-9959-40fe-9093-1eecff8dbaa6-00094 in container: volumebackups. {{(pid=101319) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 09:47:28.328827 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-f2328ac8-0306-44eb-b2b5-223cab8b003f tempest-VolumesBackupsTest-118275719 None] deleted object: volume_72e07e1e-1567-4071-8204-c29cb26d2660/20260703094710/az_nova_backup_eba702ee-9959-40fe-9093-1eecff8dbaa6-00095 in container: volumebackups. {{(pid=101319) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 09:47:28.365267 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-f2328ac8-0306-44eb-b2b5-223cab8b003f tempest-VolumesBackupsTest-118275719 None] deleted object: volume_72e07e1e-1567-4071-8204-c29cb26d2660/20260703094710/az_nova_backup_eba702ee-9959-40fe-9093-1eecff8dbaa6-00096 in container: volumebackups. {{(pid=101319) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 09:47:28.394643 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-f2328ac8-0306-44eb-b2b5-223cab8b003f tempest-VolumesBackupsTest-118275719 None] deleted object: volume_72e07e1e-1567-4071-8204-c29cb26d2660/20260703094710/az_nova_backup_eba702ee-9959-40fe-9093-1eecff8dbaa6-00097 in container: volumebackups. {{(pid=101319) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 09:47:28.425782 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-f2328ac8-0306-44eb-b2b5-223cab8b003f tempest-VolumesBackupsTest-118275719 None] deleted object: volume_72e07e1e-1567-4071-8204-c29cb26d2660/20260703094710/az_nova_backup_eba702ee-9959-40fe-9093-1eecff8dbaa6-00098 in container: volumebackups. {{(pid=101319) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 09:47:28.452838 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-f2328ac8-0306-44eb-b2b5-223cab8b003f tempest-VolumesBackupsTest-118275719 None] deleted object: volume_72e07e1e-1567-4071-8204-c29cb26d2660/20260703094710/az_nova_backup_eba702ee-9959-40fe-9093-1eecff8dbaa6-00099 in container: volumebackups. {{(pid=101319) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 09:47:28.455465 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-75ba68df-8a8d-48ad-9be6-295988b8d81d tempest-VolumesBackupsTest-2142009639 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101319) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 09:47:28.455637 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-75ba68df-8a8d-48ad-9be6-295988b8d81d tempest-VolumesBackupsTest-2142009639 None] About to put_object {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 09:47:28.481068 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-f2328ac8-0306-44eb-b2b5-223cab8b003f tempest-VolumesBackupsTest-118275719 None] deleted object: volume_72e07e1e-1567-4071-8204-c29cb26d2660/20260703094710/az_nova_backup_eba702ee-9959-40fe-9093-1eecff8dbaa6-00100 in container: volumebackups. {{(pid=101319) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 09:47:28.501735 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-f2328ac8-0306-44eb-b2b5-223cab8b003f tempest-VolumesBackupsTest-118275719 None] deleted object: volume_72e07e1e-1567-4071-8204-c29cb26d2660/20260703094710/az_nova_backup_eba702ee-9959-40fe-9093-1eecff8dbaa6-00101 in container: volumebackups. {{(pid=101319) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 09:47:28.526977 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-f2328ac8-0306-44eb-b2b5-223cab8b003f tempest-VolumesBackupsTest-118275719 None] deleted object: volume_72e07e1e-1567-4071-8204-c29cb26d2660/20260703094710/az_nova_backup_eba702ee-9959-40fe-9093-1eecff8dbaa6-00102 in container: volumebackups. {{(pid=101319) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 09:47:28.544781 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-f2328ac8-0306-44eb-b2b5-223cab8b003f tempest-VolumesBackupsTest-118275719 None] deleted object: volume_72e07e1e-1567-4071-8204-c29cb26d2660/20260703094710/az_nova_backup_eba702ee-9959-40fe-9093-1eecff8dbaa6-00103 in container: volumebackups. {{(pid=101319) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 09:47:28.564386 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-f2328ac8-0306-44eb-b2b5-223cab8b003f tempest-VolumesBackupsTest-118275719 None] deleted object: volume_72e07e1e-1567-4071-8204-c29cb26d2660/20260703094710/az_nova_backup_eba702ee-9959-40fe-9093-1eecff8dbaa6-00104 in container: volumebackups. {{(pid=101319) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 09:47:28.569790 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-75ba68df-8a8d-48ad-9be6-295988b8d81d tempest-VolumesBackupsTest-2142009639 None] backup MD5 for volume_8a0b1cfb-8ea1-46a0-aac3-b254107b98ef/20260703094720/az_nova_backup_86118233-3d57-47ad-8781-cab6c54e4d53-00013: 25e317773f308e446cc84c503a6d1f85 {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 09:47:28.569962 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-75ba68df-8a8d-48ad-9be6-295988b8d81d tempest-VolumesBackupsTest-2142009639 None] Calling eventlet.sleep(0) {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 09:47:28.582850 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-f2328ac8-0306-44eb-b2b5-223cab8b003f tempest-VolumesBackupsTest-118275719 None] deleted object: volume_72e07e1e-1567-4071-8204-c29cb26d2660/20260703094710/az_nova_backup_eba702ee-9959-40fe-9093-1eecff8dbaa6-00105 in container: volumebackups. {{(pid=101319) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 09:47:28.626601 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-f2328ac8-0306-44eb-b2b5-223cab8b003f tempest-VolumesBackupsTest-118275719 None] deleted object: volume_72e07e1e-1567-4071-8204-c29cb26d2660/20260703094710/az_nova_backup_eba702ee-9959-40fe-9093-1eecff8dbaa6-00106 in container: volumebackups. {{(pid=101319) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 09:47:28.676551 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-f2328ac8-0306-44eb-b2b5-223cab8b003f tempest-VolumesBackupsTest-118275719 None] deleted object: volume_72e07e1e-1567-4071-8204-c29cb26d2660/20260703094710/az_nova_backup_eba702ee-9959-40fe-9093-1eecff8dbaa6-00107 in container: volumebackups. {{(pid=101319) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 09:47:28.712822 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-f2328ac8-0306-44eb-b2b5-223cab8b003f tempest-VolumesBackupsTest-118275719 None] deleted object: volume_72e07e1e-1567-4071-8204-c29cb26d2660/20260703094710/az_nova_backup_eba702ee-9959-40fe-9093-1eecff8dbaa6-00108 in container: volumebackups. {{(pid=101319) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 09:47:28.752994 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-f2328ac8-0306-44eb-b2b5-223cab8b003f tempest-VolumesBackupsTest-118275719 None] deleted object: volume_72e07e1e-1567-4071-8204-c29cb26d2660/20260703094710/az_nova_backup_eba702ee-9959-40fe-9093-1eecff8dbaa6-00109 in container: volumebackups. {{(pid=101319) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 09:47:28.780989 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-f2328ac8-0306-44eb-b2b5-223cab8b003f tempest-VolumesBackupsTest-118275719 None] deleted object: volume_72e07e1e-1567-4071-8204-c29cb26d2660/20260703094710/az_nova_backup_eba702ee-9959-40fe-9093-1eecff8dbaa6-00110 in container: volumebackups. {{(pid=101319) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 09:47:28.800874 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-75ba68df-8a8d-48ad-9be6-295988b8d81d tempest-VolumesBackupsTest-2142009639 None] Backing up chunk of data from volume. {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 09:47:28.805925 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-f2328ac8-0306-44eb-b2b5-223cab8b003f tempest-VolumesBackupsTest-118275719 None] deleted object: volume_72e07e1e-1567-4071-8204-c29cb26d2660/20260703094710/az_nova_backup_eba702ee-9959-40fe-9093-1eecff8dbaa6_metadata in container: volumebackups. {{(pid=101319) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 09:47:28.838617 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-f2328ac8-0306-44eb-b2b5-223cab8b003f tempest-VolumesBackupsTest-118275719 None] deleted object: volume_72e07e1e-1567-4071-8204-c29cb26d2660/20260703094710/az_nova_backup_eba702ee-9959-40fe-9093-1eecff8dbaa6_sha256file in container: volumebackups. {{(pid=101319) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 09:47:28.838810 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-f2328ac8-0306-44eb-b2b5-223cab8b003f tempest-VolumesBackupsTest-118275719 None] delete eba702ee-9959-40fe-9093-1eecff8dbaa6 finished. {{(pid=101319) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:848}} Jul 03 09:47:28.881837 np0000004400 cinder-backup[101319]: DEBUG cinder.quota [None req-f2328ac8-0306-44eb-b2b5-223cab8b003f tempest-VolumesBackupsTest-118275719 None] Created reservations ['f0365153-75c7-4c2d-8411-423c62b6f388', '7739892c-c241-446c-9eb4-6522f0113776'] {{(pid=101319) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 09:47:28.919296 np0000004400 cinder-backup[101319]: INFO cinder.backup.manager [None req-f2328ac8-0306-44eb-b2b5-223cab8b003f tempest-VolumesBackupsTest-118275719 None] Delete backup finished, backup eba702ee-9959-40fe-9093-1eecff8dbaa6 deleted. Jul 03 09:47:29.058988 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-75ba68df-8a8d-48ad-9be6-295988b8d81d tempest-VolumesBackupsTest-2142009639 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101319) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 09:47:29.059126 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-75ba68df-8a8d-48ad-9be6-295988b8d81d tempest-VolumesBackupsTest-2142009639 None] About to put_object {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 09:47:29.180596 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-75ba68df-8a8d-48ad-9be6-295988b8d81d tempest-VolumesBackupsTest-2142009639 None] backup MD5 for volume_8a0b1cfb-8ea1-46a0-aac3-b254107b98ef/20260703094720/az_nova_backup_86118233-3d57-47ad-8781-cab6c54e4d53-00014: 25e317773f308e446cc84c503a6d1f85 {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 09:47:29.180912 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-75ba68df-8a8d-48ad-9be6-295988b8d81d tempest-VolumesBackupsTest-2142009639 None] Calling eventlet.sleep(0) {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 09:47:29.369684 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-75ba68df-8a8d-48ad-9be6-295988b8d81d tempest-VolumesBackupsTest-2142009639 None] Backing up chunk of data from volume. {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 09:47:29.614662 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-75ba68df-8a8d-48ad-9be6-295988b8d81d tempest-VolumesBackupsTest-2142009639 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101319) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 09:47:29.614787 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-75ba68df-8a8d-48ad-9be6-295988b8d81d tempest-VolumesBackupsTest-2142009639 None] About to put_object {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 09:47:29.721523 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-75ba68df-8a8d-48ad-9be6-295988b8d81d tempest-VolumesBackupsTest-2142009639 None] backup MD5 for volume_8a0b1cfb-8ea1-46a0-aac3-b254107b98ef/20260703094720/az_nova_backup_86118233-3d57-47ad-8781-cab6c54e4d53-00015: 25e317773f308e446cc84c503a6d1f85 {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 09:47:29.721786 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-75ba68df-8a8d-48ad-9be6-295988b8d81d tempest-VolumesBackupsTest-2142009639 None] Calling eventlet.sleep(0) {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 09:47:29.925471 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-75ba68df-8a8d-48ad-9be6-295988b8d81d tempest-VolumesBackupsTest-2142009639 None] Backing up chunk of data from volume. {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 09:47:30.188281 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-75ba68df-8a8d-48ad-9be6-295988b8d81d tempest-VolumesBackupsTest-2142009639 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101319) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 09:47:30.188731 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-75ba68df-8a8d-48ad-9be6-295988b8d81d tempest-VolumesBackupsTest-2142009639 None] About to put_object {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 09:47:30.292332 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-75ba68df-8a8d-48ad-9be6-295988b8d81d tempest-VolumesBackupsTest-2142009639 None] backup MD5 for volume_8a0b1cfb-8ea1-46a0-aac3-b254107b98ef/20260703094720/az_nova_backup_86118233-3d57-47ad-8781-cab6c54e4d53-00016: 25e317773f308e446cc84c503a6d1f85 {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 09:47:30.292332 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-75ba68df-8a8d-48ad-9be6-295988b8d81d tempest-VolumesBackupsTest-2142009639 None] Calling eventlet.sleep(0) {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 09:47:30.316857 np0000004400 cinder-backup[101319]: INFO cinder.backup.manager [None req-8d6ad746-1d02-417b-bc15-9bf41e42b4b9 tempest-VolumesBackupsTest-118275719 None] Delete backup started, backup: 8b377d15-3804-4a9c-ad2d-e8e1359c0ee5. Jul 03 09:47:30.316909 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.drivers.swift [None req-8d6ad746-1d02-417b-bc15-9bf41e42b4b9 tempest-VolumesBackupsTest-118275719 None] Using swift URL https://10.4.3.95:8080/v1/AUTH_a484ec9218bf417bb9d7575ae6370646 {{(pid=101319) initialize /opt/stack/cinder/cinder/backup/drivers/swift.py:300}} Jul 03 09:47:30.317126 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.drivers.swift [None req-8d6ad746-1d02-417b-bc15-9bf41e42b4b9 tempest-VolumesBackupsTest-118275719 None] Connect to https://10.4.3.95:8080/v1/AUTH_ in "per_user" mode {{(pid=101319) initialize /opt/stack/cinder/cinder/backup/drivers/swift.py:301}} Jul 03 09:47:30.317713 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-8d6ad746-1d02-417b-bc15-9bf41e42b4b9 tempest-VolumesBackupsTest-118275719 None] delete started, backup: 8b377d15-3804-4a9c-ad2d-e8e1359c0ee5, container: volumebackups, prefix: volume_72e07e1e-1567-4071-8204-c29cb26d2660/20260703094546/az_nova_backup_8b377d15-3804-4a9c-ad2d-e8e1359c0ee5. {{(pid=101319) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:822}} Jul 03 09:47:30.380110 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-8d6ad746-1d02-417b-bc15-9bf41e42b4b9 tempest-VolumesBackupsTest-118275719 None] generated object list: ['volume_72e07e1e-1567-4071-8204-c29cb26d2660/20260703094546/az_nova_backup_8b377d15-3804-4a9c-ad2d-e8e1359c0ee5-00001', 'volume_72e07e1e-1567-4071-8204-c29cb26d2660/20260703094546/az_nova_backup_8b377d15-3804-4a9c-ad2d-e8e1359c0ee5-00002', 'volume_72e07e1e-1567-4071-8204-c29cb26d2660/20260703094546/az_nova_backup_8b377d15-3804-4a9c-ad2d-e8e1359c0ee5-00003', 'volume_72e07e1e-1567-4071-8204-c29cb26d2660/20260703094546/az_nova_backup_8b377d15-3804-4a9c-ad2d-e8e1359c0ee5-00004', 'volume_72e07e1e-1567-4071-8204-c29cb26d2660/20260703094546/az_nova_backup_8b377d15-3804-4a9c-ad2d-e8e1359c0ee5-00005', 'volume_72e07e1e-1567-4071-8204-c29cb26d2660/20260703094546/az_nova_backup_8b377d15-3804-4a9c-ad2d-e8e1359c0ee5-00006', 'volume_72e07e1e-1567-4071-8204-c29cb26d2660/20260703094546/az_nova_backup_8b377d15-3804-4a9c-ad2d-e8e1359c0ee5-00007', 'volume_72e07e1e-1567-4071-8204-c29cb26d2660/20260703094546/az_nova_backup_8b377d15-3804-4a9c-ad2d-e8e1359c0ee5-00008', 'volume_72e07e1e-1567-4071-8204-c29cb26d2660/20260703094546/az_nova_backup_8b377d15-3804-4a9c-ad2d-e8e1359c0ee5-00009', 'volume_72e07e1e-1567-4071-8204-c29cb26d2660/20260703094546/az_nova_backup_8b377d15-3804-4a9c-ad2d-e8e1359c0ee5-00010', 'volume_72e07e1e-1567-4071-8204-c29cb26d2660/20260703094546/az_nova_backup_8b377d15-3804-4a9c-ad2d-e8e1359c0ee5-00011', 'volume_72e07e1e-1567-4071-8204-c29cb26d2660/20260703094546/az_nova_backup_8b377d15-3804-4a9c-ad2d-e8e1359c0ee5-00012', 'volume_72e07e1e-1567-4071-8204-c29cb26d2660/20260703094546/az_nova_backup_8b377d15-3804-4a9c-ad2d-e8e1359c0ee5-00013', 'volume_72e07e1e-1567-4071-8204-c29cb26d2660/20260703094546/az_nova_backup_8b377d15-3804-4a9c-ad2d-e8e1359c0ee5-00014', 'volume_72e07e1e-1567-4071-8204-c29cb26d2660/20260703094546/az_nova_backup_8b377d15-3804-4a9c-ad2d-e8e1359c0ee5-00015', 'volume_72e07e1e-1567-4071-8204-c29cb26d2660/20260703094546/az_nova_backup_8b377d15-3804-4a9c-ad2d-e8e1359c0ee5-00016', 'volume_72e07e1e-1567-4071-8204-c29cb26d2660/20260703094546/az_nova_backup_8b377d15-3804-4a9c-ad2d-e8e1359c0ee5-00017', 'volume_72e07e1e-1567-4071-8204-c29cb26d2660/20260703094546/az_nova_backup_8b377d15-3804-4a9c-ad2d-e8e1359c0ee5-00018', 'volume_72e07e1e-1567-4071-8204-c29cb26d2660/20260703094546/az_nova_backup_8b377d15-3804-4a9c-ad2d-e8e1359c0ee5-00019', 'volume_72e07e1e-1567-4071-8204-c29cb26d2660/20260703094546/az_nova_backup_8b377d15-3804-4a9c-ad2d-e8e1359c0ee5-00020', 'volume_72e07e1e-1567-4071-8204-c29cb26d2660/20260703094546/az_nova_backup_8b377d15-3804-4a9c-ad2d-e8e1359c0ee5-00021', 'volume_72e07e1e-1567-4071-8204-c29cb26d2660/20260703094546/az_nova_backup_8b377d15-3804-4a9c-ad2d-e8e1359c0ee5_metadata', 'volume_72e07e1e-1567-4071-8204-c29cb26d2660/20260703094546/az_nova_backup_8b377d15-3804-4a9c-ad2d-e8e1359c0ee5_sha256file']. {{(pid=101319) _generate_object_names /opt/stack/cinder/cinder/backup/chunkeddriver.py:260}} Jul 03 09:47:30.409676 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-8d6ad746-1d02-417b-bc15-9bf41e42b4b9 tempest-VolumesBackupsTest-118275719 None] deleted object: volume_72e07e1e-1567-4071-8204-c29cb26d2660/20260703094546/az_nova_backup_8b377d15-3804-4a9c-ad2d-e8e1359c0ee5-00001 in container: volumebackups. {{(pid=101319) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 09:47:30.442659 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-8d6ad746-1d02-417b-bc15-9bf41e42b4b9 tempest-VolumesBackupsTest-118275719 None] deleted object: volume_72e07e1e-1567-4071-8204-c29cb26d2660/20260703094546/az_nova_backup_8b377d15-3804-4a9c-ad2d-e8e1359c0ee5-00002 in container: volumebackups. {{(pid=101319) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 09:47:30.474692 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-8d6ad746-1d02-417b-bc15-9bf41e42b4b9 tempest-VolumesBackupsTest-118275719 None] deleted object: volume_72e07e1e-1567-4071-8204-c29cb26d2660/20260703094546/az_nova_backup_8b377d15-3804-4a9c-ad2d-e8e1359c0ee5-00003 in container: volumebackups. {{(pid=101319) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 09:47:30.507306 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-8d6ad746-1d02-417b-bc15-9bf41e42b4b9 tempest-VolumesBackupsTest-118275719 None] deleted object: volume_72e07e1e-1567-4071-8204-c29cb26d2660/20260703094546/az_nova_backup_8b377d15-3804-4a9c-ad2d-e8e1359c0ee5-00004 in container: volumebackups. {{(pid=101319) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 09:47:30.515527 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-75ba68df-8a8d-48ad-9be6-295988b8d81d tempest-VolumesBackupsTest-2142009639 None] Backing up chunk of data from volume. {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 09:47:30.535031 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-8d6ad746-1d02-417b-bc15-9bf41e42b4b9 tempest-VolumesBackupsTest-118275719 None] deleted object: volume_72e07e1e-1567-4071-8204-c29cb26d2660/20260703094546/az_nova_backup_8b377d15-3804-4a9c-ad2d-e8e1359c0ee5-00005 in container: volumebackups. {{(pid=101319) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 09:47:30.557269 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-8d6ad746-1d02-417b-bc15-9bf41e42b4b9 tempest-VolumesBackupsTest-118275719 None] deleted object: volume_72e07e1e-1567-4071-8204-c29cb26d2660/20260703094546/az_nova_backup_8b377d15-3804-4a9c-ad2d-e8e1359c0ee5-00006 in container: volumebackups. {{(pid=101319) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 09:47:30.581335 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-8d6ad746-1d02-417b-bc15-9bf41e42b4b9 tempest-VolumesBackupsTest-118275719 None] deleted object: volume_72e07e1e-1567-4071-8204-c29cb26d2660/20260703094546/az_nova_backup_8b377d15-3804-4a9c-ad2d-e8e1359c0ee5-00007 in container: volumebackups. {{(pid=101319) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 09:47:30.613592 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-8d6ad746-1d02-417b-bc15-9bf41e42b4b9 tempest-VolumesBackupsTest-118275719 None] deleted object: volume_72e07e1e-1567-4071-8204-c29cb26d2660/20260703094546/az_nova_backup_8b377d15-3804-4a9c-ad2d-e8e1359c0ee5-00008 in container: volumebackups. {{(pid=101319) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 09:47:30.641397 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-8d6ad746-1d02-417b-bc15-9bf41e42b4b9 tempest-VolumesBackupsTest-118275719 None] deleted object: volume_72e07e1e-1567-4071-8204-c29cb26d2660/20260703094546/az_nova_backup_8b377d15-3804-4a9c-ad2d-e8e1359c0ee5-00009 in container: volumebackups. {{(pid=101319) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 09:47:30.663589 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-8d6ad746-1d02-417b-bc15-9bf41e42b4b9 tempest-VolumesBackupsTest-118275719 None] deleted object: volume_72e07e1e-1567-4071-8204-c29cb26d2660/20260703094546/az_nova_backup_8b377d15-3804-4a9c-ad2d-e8e1359c0ee5-00010 in container: volumebackups. {{(pid=101319) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 09:47:30.689691 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-8d6ad746-1d02-417b-bc15-9bf41e42b4b9 tempest-VolumesBackupsTest-118275719 None] deleted object: volume_72e07e1e-1567-4071-8204-c29cb26d2660/20260703094546/az_nova_backup_8b377d15-3804-4a9c-ad2d-e8e1359c0ee5-00011 in container: volumebackups. {{(pid=101319) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 09:47:30.718941 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-8d6ad746-1d02-417b-bc15-9bf41e42b4b9 tempest-VolumesBackupsTest-118275719 None] deleted object: volume_72e07e1e-1567-4071-8204-c29cb26d2660/20260703094546/az_nova_backup_8b377d15-3804-4a9c-ad2d-e8e1359c0ee5-00012 in container: volumebackups. {{(pid=101319) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 09:47:30.740870 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-8d6ad746-1d02-417b-bc15-9bf41e42b4b9 tempest-VolumesBackupsTest-118275719 None] deleted object: volume_72e07e1e-1567-4071-8204-c29cb26d2660/20260703094546/az_nova_backup_8b377d15-3804-4a9c-ad2d-e8e1359c0ee5-00013 in container: volumebackups. {{(pid=101319) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 09:47:30.765833 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-8d6ad746-1d02-417b-bc15-9bf41e42b4b9 tempest-VolumesBackupsTest-118275719 None] deleted object: volume_72e07e1e-1567-4071-8204-c29cb26d2660/20260703094546/az_nova_backup_8b377d15-3804-4a9c-ad2d-e8e1359c0ee5-00014 in container: volumebackups. {{(pid=101319) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 09:47:30.766090 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-75ba68df-8a8d-48ad-9be6-295988b8d81d tempest-VolumesBackupsTest-2142009639 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101319) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 09:47:30.766270 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-75ba68df-8a8d-48ad-9be6-295988b8d81d tempest-VolumesBackupsTest-2142009639 None] About to put_object {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 09:47:30.791462 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-8d6ad746-1d02-417b-bc15-9bf41e42b4b9 tempest-VolumesBackupsTest-118275719 None] deleted object: volume_72e07e1e-1567-4071-8204-c29cb26d2660/20260703094546/az_nova_backup_8b377d15-3804-4a9c-ad2d-e8e1359c0ee5-00015 in container: volumebackups. {{(pid=101319) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 09:47:30.814328 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-8d6ad746-1d02-417b-bc15-9bf41e42b4b9 tempest-VolumesBackupsTest-118275719 None] deleted object: volume_72e07e1e-1567-4071-8204-c29cb26d2660/20260703094546/az_nova_backup_8b377d15-3804-4a9c-ad2d-e8e1359c0ee5-00016 in container: volumebackups. {{(pid=101319) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 09:47:30.841200 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-8d6ad746-1d02-417b-bc15-9bf41e42b4b9 tempest-VolumesBackupsTest-118275719 None] deleted object: volume_72e07e1e-1567-4071-8204-c29cb26d2660/20260703094546/az_nova_backup_8b377d15-3804-4a9c-ad2d-e8e1359c0ee5-00017 in container: volumebackups. {{(pid=101319) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 09:47:30.866384 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-8d6ad746-1d02-417b-bc15-9bf41e42b4b9 tempest-VolumesBackupsTest-118275719 None] deleted object: volume_72e07e1e-1567-4071-8204-c29cb26d2660/20260703094546/az_nova_backup_8b377d15-3804-4a9c-ad2d-e8e1359c0ee5-00018 in container: volumebackups. {{(pid=101319) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 09:47:30.875687 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-75ba68df-8a8d-48ad-9be6-295988b8d81d tempest-VolumesBackupsTest-2142009639 None] backup MD5 for volume_8a0b1cfb-8ea1-46a0-aac3-b254107b98ef/20260703094720/az_nova_backup_86118233-3d57-47ad-8781-cab6c54e4d53-00017: 25e317773f308e446cc84c503a6d1f85 {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 09:47:30.875816 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-75ba68df-8a8d-48ad-9be6-295988b8d81d tempest-VolumesBackupsTest-2142009639 None] Calling eventlet.sleep(0) {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 09:47:30.903898 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-8d6ad746-1d02-417b-bc15-9bf41e42b4b9 tempest-VolumesBackupsTest-118275719 None] deleted object: volume_72e07e1e-1567-4071-8204-c29cb26d2660/20260703094546/az_nova_backup_8b377d15-3804-4a9c-ad2d-e8e1359c0ee5-00019 in container: volumebackups. {{(pid=101319) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 09:47:30.912814 np0000004400 cinder-backup[101319]: DEBUG oslo_db.sqlalchemy.engines [None req-75ba68df-8a8d-48ad-9be6-295988b8d81d tempest-VolumesBackupsTest-2142009639 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=101319) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 03 09:47:30.927531 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-8d6ad746-1d02-417b-bc15-9bf41e42b4b9 tempest-VolumesBackupsTest-118275719 None] deleted object: volume_72e07e1e-1567-4071-8204-c29cb26d2660/20260703094546/az_nova_backup_8b377d15-3804-4a9c-ad2d-e8e1359c0ee5-00020 in container: volumebackups. {{(pid=101319) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 09:47:30.948066 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-8d6ad746-1d02-417b-bc15-9bf41e42b4b9 tempest-VolumesBackupsTest-118275719 None] deleted object: volume_72e07e1e-1567-4071-8204-c29cb26d2660/20260703094546/az_nova_backup_8b377d15-3804-4a9c-ad2d-e8e1359c0ee5-00021 in container: volumebackups. {{(pid=101319) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 09:47:30.980153 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-8d6ad746-1d02-417b-bc15-9bf41e42b4b9 tempest-VolumesBackupsTest-118275719 None] deleted object: volume_72e07e1e-1567-4071-8204-c29cb26d2660/20260703094546/az_nova_backup_8b377d15-3804-4a9c-ad2d-e8e1359c0ee5_metadata in container: volumebackups. {{(pid=101319) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 09:47:31.008808 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-8d6ad746-1d02-417b-bc15-9bf41e42b4b9 tempest-VolumesBackupsTest-118275719 None] deleted object: volume_72e07e1e-1567-4071-8204-c29cb26d2660/20260703094546/az_nova_backup_8b377d15-3804-4a9c-ad2d-e8e1359c0ee5_sha256file in container: volumebackups. {{(pid=101319) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 09:47:31.009681 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-8d6ad746-1d02-417b-bc15-9bf41e42b4b9 tempest-VolumesBackupsTest-118275719 None] delete 8b377d15-3804-4a9c-ad2d-e8e1359c0ee5 finished. {{(pid=101319) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:848}} Jul 03 09:47:31.025796 np0000004400 cinder-backup[101319]: DEBUG cinder.quota [None req-8d6ad746-1d02-417b-bc15-9bf41e42b4b9 tempest-VolumesBackupsTest-118275719 None] Created reservations ['44c19349-41a0-4995-8b18-4dea6bd371aa', 'f936828b-5d8c-4b4e-aa8b-ebdfd51f33cb'] {{(pid=101319) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 09:47:31.049560 np0000004400 cinder-backup[101319]: INFO cinder.backup.manager [None req-8d6ad746-1d02-417b-bc15-9bf41e42b4b9 tempest-VolumesBackupsTest-118275719 None] Delete backup finished, backup 8b377d15-3804-4a9c-ad2d-e8e1359c0ee5 deleted. Jul 03 09:47:31.097427 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-75ba68df-8a8d-48ad-9be6-295988b8d81d tempest-VolumesBackupsTest-2142009639 None] Backing up chunk of data from volume. {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 09:47:31.349599 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-75ba68df-8a8d-48ad-9be6-295988b8d81d tempest-VolumesBackupsTest-2142009639 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101319) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 09:47:31.349599 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-75ba68df-8a8d-48ad-9be6-295988b8d81d tempest-VolumesBackupsTest-2142009639 None] About to put_object {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 09:47:31.467756 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-75ba68df-8a8d-48ad-9be6-295988b8d81d tempest-VolumesBackupsTest-2142009639 None] backup MD5 for volume_8a0b1cfb-8ea1-46a0-aac3-b254107b98ef/20260703094720/az_nova_backup_86118233-3d57-47ad-8781-cab6c54e4d53-00018: 25e317773f308e446cc84c503a6d1f85 {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 09:47:31.468013 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-75ba68df-8a8d-48ad-9be6-295988b8d81d tempest-VolumesBackupsTest-2142009639 None] Calling eventlet.sleep(0) {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 09:47:31.659446 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-75ba68df-8a8d-48ad-9be6-295988b8d81d tempest-VolumesBackupsTest-2142009639 None] Backing up chunk of data from volume. {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 09:47:31.902547 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-75ba68df-8a8d-48ad-9be6-295988b8d81d tempest-VolumesBackupsTest-2142009639 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101319) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 09:47:31.902714 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-75ba68df-8a8d-48ad-9be6-295988b8d81d tempest-VolumesBackupsTest-2142009639 None] About to put_object {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 09:47:32.007497 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-75ba68df-8a8d-48ad-9be6-295988b8d81d tempest-VolumesBackupsTest-2142009639 None] backup MD5 for volume_8a0b1cfb-8ea1-46a0-aac3-b254107b98ef/20260703094720/az_nova_backup_86118233-3d57-47ad-8781-cab6c54e4d53-00019: 25e317773f308e446cc84c503a6d1f85 {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 09:47:32.008439 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-75ba68df-8a8d-48ad-9be6-295988b8d81d tempest-VolumesBackupsTest-2142009639 None] Calling eventlet.sleep(0) {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 09:47:32.183561 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-75ba68df-8a8d-48ad-9be6-295988b8d81d tempest-VolumesBackupsTest-2142009639 None] Backing up chunk of data from volume. {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 09:47:32.423031 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-75ba68df-8a8d-48ad-9be6-295988b8d81d tempest-VolumesBackupsTest-2142009639 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101319) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 09:47:32.423525 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-75ba68df-8a8d-48ad-9be6-295988b8d81d tempest-VolumesBackupsTest-2142009639 None] About to put_object {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 09:47:32.526978 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-75ba68df-8a8d-48ad-9be6-295988b8d81d tempest-VolumesBackupsTest-2142009639 None] backup MD5 for volume_8a0b1cfb-8ea1-46a0-aac3-b254107b98ef/20260703094720/az_nova_backup_86118233-3d57-47ad-8781-cab6c54e4d53-00020: 25e317773f308e446cc84c503a6d1f85 {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 09:47:32.527145 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-75ba68df-8a8d-48ad-9be6-295988b8d81d tempest-VolumesBackupsTest-2142009639 None] Calling eventlet.sleep(0) {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 09:47:32.633428 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-75ba68df-8a8d-48ad-9be6-295988b8d81d tempest-VolumesBackupsTest-2142009639 None] Backing up chunk of data from volume. {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 09:47:32.752319 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-75ba68df-8a8d-48ad-9be6-295988b8d81d tempest-VolumesBackupsTest-2142009639 None] Compressed 25165824 bytes of data to 24470 bytes using zlib. {{(pid=101319) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 09:47:32.752489 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-75ba68df-8a8d-48ad-9be6-295988b8d81d tempest-VolumesBackupsTest-2142009639 None] About to put_object {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 09:47:32.818790 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-75ba68df-8a8d-48ad-9be6-295988b8d81d tempest-VolumesBackupsTest-2142009639 None] backup MD5 for volume_8a0b1cfb-8ea1-46a0-aac3-b254107b98ef/20260703094720/az_nova_backup_86118233-3d57-47ad-8781-cab6c54e4d53-00021: 77377273b0a4b61febdbf7bbf52b9db9 {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 09:47:32.818944 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-75ba68df-8a8d-48ad-9be6-295988b8d81d tempest-VolumesBackupsTest-2142009639 None] Calling eventlet.sleep(0) {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 09:47:32.824721 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.driver [None req-75ba68df-8a8d-48ad-9be6-295988b8d81d tempest-VolumesBackupsTest-2142009639 None] Getting metadata type 'volume-base-metadata' {{(pid=101319) _save_vol_base_meta /opt/stack/cinder/cinder/backup/driver.py:79}} Jul 03 09:47:32.828816 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.driver [None req-75ba68df-8a8d-48ad-9be6-295988b8d81d tempest-VolumesBackupsTest-2142009639 None] Completed fetching metadata type 'volume-base-metadata' {{(pid=101319) _save_vol_base_meta /opt/stack/cinder/cinder/backup/driver.py:98}} Jul 03 09:47:32.828988 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.driver [None req-75ba68df-8a8d-48ad-9be6-295988b8d81d tempest-VolumesBackupsTest-2142009639 None] Getting metadata type 'volume-metadata' {{(pid=101319) _save_vol_meta /opt/stack/cinder/cinder/backup/driver.py:109}} Jul 03 09:47:32.832478 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.driver [None req-75ba68df-8a8d-48ad-9be6-295988b8d81d tempest-VolumesBackupsTest-2142009639 None] No metadata type 'volume-metadata' available {{(pid=101319) _save_vol_meta /opt/stack/cinder/cinder/backup/driver.py:123}} Jul 03 09:47:32.832667 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.driver [None req-75ba68df-8a8d-48ad-9be6-295988b8d81d tempest-VolumesBackupsTest-2142009639 None] Getting metadata type 'volume-glance-metadata' {{(pid=101319) _save_vol_glance_meta /opt/stack/cinder/cinder/backup/driver.py:132}} Jul 03 09:47:32.835051 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.driver [None req-75ba68df-8a8d-48ad-9be6-295988b8d81d tempest-VolumesBackupsTest-2142009639 None] No metadata type 'volume-glance-metadata' available {{(pid=101319) _save_vol_glance_meta /opt/stack/cinder/cinder/backup/driver.py:147}} Jul 03 09:47:32.835295 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-75ba68df-8a8d-48ad-9be6-295988b8d81d tempest-VolumesBackupsTest-2142009639 None] _write_sha256file started, container name: tempest-volumesbackupstest-backup-container-106419071, sha256file filename: volume_8a0b1cfb-8ea1-46a0-aac3-b254107b98ef/20260703094720/az_nova_backup_86118233-3d57-47ad-8781-cab6c54e4d53_sha256file. {{(pid=101319) _write_sha256file /opt/stack/cinder/cinder/backup/chunkeddriver.py:299}} Jul 03 09:47:32.887506 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-75ba68df-8a8d-48ad-9be6-295988b8d81d tempest-VolumesBackupsTest-2142009639 None] _write_sha256file finished. {{(pid=101319) _write_sha256file /opt/stack/cinder/cinder/backup/chunkeddriver.py:315}} Jul 03 09:47:32.888156 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-75ba68df-8a8d-48ad-9be6-295988b8d81d tempest-VolumesBackupsTest-2142009639 None] _write_metadata started, container name: tempest-volumesbackupstest-backup-container-106419071, metadata filename: volume_8a0b1cfb-8ea1-46a0-aac3-b254107b98ef/20260703094720/az_nova_backup_86118233-3d57-47ad-8781-cab6c54e4d53_metadata. {{(pid=101319) _write_metadata /opt/stack/cinder/cinder/backup/chunkeddriver.py:276}} Jul 03 09:47:32.908335 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-75ba68df-8a8d-48ad-9be6-295988b8d81d tempest-VolumesBackupsTest-2142009639 None] _write_metadata finished. Metadata: b'{\n "backup_description": null,\n "backup_id": "86118233-3d57-47ad-8781-cab6c54e4d53",\n "backup_name": "tempest-VolumesBackupsTest-Backup-693599398",\n "created_at": "2026-07-03 09:47:17+00:00",\n "objects": [\n {\n "volume_8a0b1cfb-8ea1-46a0-aac3-b254107b98ef/20260703094720/az_nova_backup_86118233-3d57-47ad-8781-cab6c54e4d53-00001": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 0\n }\n },\n {\n "volume_8a0b1cfb-8ea1-46a0-aac3-b254107b98ef/20260703094720/az_nova_backup_86118233-3d57-47ad-8781-cab6c54e4d53-00002": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 52428800\n }\n },\n {\n "volume_8a0b1cfb-8ea1-46a0-aac3-b254107b98ef/20260703094720/az_nova_backup_86118233-3d57-47ad-8781-cab6c54e4d53-00003": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 104857600\n }\n },\n {\n "volume_8a0b1cfb-8ea1-46a0-aac3-b254107b98ef/20260703094720/az_nova_backup_86118233-3d57-47ad-8781-cab6c54e4d53-00004": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 157286400\n }\n },\n {\n "volume_8a0b1cfb-8ea1-46a0-aac3-b254107b98ef/20260703094720/az_nova_backup_86118233-3d57-47ad-8781-cab6c54e4d53-00005": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 209715200\n }\n },\n {\n "volume_8a0b1cfb-8ea1-46a0-aac3-b254107b98ef/20260703094720/az_nova_backup_86118233-3d57-47ad-8781-cab6c54e4d53-00006": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 262144000\n }\n },\n {\n "volume_8a0b1cfb-8ea1-46a0-aac3-b254107b98ef/20260703094720/az_nova_backup_86118233-3d57-47ad-8781-cab6c54e4d53-00007": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 314572800\n }\n },\n {\n "volume_8a0b1cfb-8ea1-46a0-aac3-b254107b98ef/20260703094720/az_nova_backup_86118233-3d57-47ad-8781-cab6c54e4d53-00008": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 367001600\n }\n },\n {\n "volume_8a0b1cfb-8ea1-46a0-aac3-b254107b98ef/20260703094720/az_nova_backup_86118233-3d57-47ad-8781-cab6c54e4d53-00009": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 419430400\n }\n },\n {\n "volume_8a0b1cfb-8ea1-46a0-aac3-b254107b98ef/20260703094720/az_nova_backup_86118233-3d57-47ad-8781-cab6c54e4d53-00010": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 471859200\n }\n },\n {\n "volume_8a0b1cfb-8ea1-46a0-aac3-b254107b98ef/20260703094720/az_nova_backup_86118233-3d57-47ad-8781-cab6c54e4d53-00011": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 524288000\n }\n },\n {\n "volume_8a0b1cfb-8ea1-46a0-aac3-b254107b98ef/20260703094720/az_nova_backup_86118233-3d57-47ad-8781-cab6c54e4d53-00012": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 576716800\n }\n },\n {\n "volume_8a0b1cfb-8ea1-46a0-aac3-b254107b98ef/20260703094720/az_nova_backup_86118233-3d57-47ad-8781-cab6c54e4d53-00013": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 629145600\n }\n },\n {\n "volume_8a0b1cfb-8ea1-46a0-aac3-b254107b98ef/20260703094720/az_nova_backup_86118233-3d57-47ad-8781-cab6c54e4d53-00014": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 681574400\n }\n },\n {\n "volume_8a0b1cfb-8ea1-46a0-aac3-b254107b98ef/20260703094720/az_nova_backup_86118233-3d57-47ad-8781-cab6c54e4d53-00015": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 734003200\n }\n },\n {\n "volume_8a0b1cfb-8ea1-46a0-aac3-b254107b98ef/20260703094720/az_nova_backup_86118233-3d57-47ad-8781-cab6c54e4d53-00016": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 786432000\n }\n },\n {\n "volume_8a0b1cfb-8ea1-46a0-aac3-b254107b98ef/20260703094720/az_nova_backup_86118233-3d57-47ad-8781-cab6c54e4d53-00017": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 838860800\n }\n },\n {\n "volume_8a0b1cfb-8ea1-46a0-aac3-b254107b98ef/20260703094720/az_nova_backup_86118233-3d57-47ad-8781-cab6c54e4d53-00018": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 891289600\n }\n },\n {\n "volume_8a0b1cfb-8ea1-46a0-aac3-b254107b98ef/20260703094720/az_nova_backup_86118233-3d57-47ad-8781-cab6c54e4d53-00019": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 943718400\n }\n },\n {\n "volume_8a0b1cfb-8ea1-46a0-aac3-b254107b98ef/20260703094720/az_nova_backup_86118233-3d57-47ad-8781-cab6c54e4d53-00020": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 996147200\n }\n },\n {\n "volume_8a0b1cfb-8ea1-46a0-aac3-b254107b98ef/20260703094720/az_nova_backup_86118233-3d57-47ad-8781-cab6c54e4d53-00021": {\n "compression": "zlib",\n "length": 25165824,\n "md5": "77377273b0a4b61febdbf7bbf52b9db9",\n "offset": 1048576000\n }\n }\n ],\n "parent_id": null,\n "version": "1.0.0",\n "volume_id": "8a0b1cfb-8ea1-46a0-aac3-b254107b98ef",\n "volume_meta": "{\\"version\\": 2, \\"volume-base-metadata\\": {\\"id\\": \\"8a0b1cfb-8ea1-46a0-aac3-b254107b98ef\\", \\"_name_id\\": null, \\"use_quota\\": true, \\"ec2_id\\": null, \\"user_id\\": \\"91463b6c437c4711a49d3c31c513a101\\", \\"project_id\\": \\"59044e18a5b24b19a7b9b8a380f2e1a0\\", \\"snapshot_id\\": null, \\"cluster_name\\": null, \\"host\\": \\"np0000004400@storpool#default\\", \\"size\\": 1, \\"availability_zone\\": \\"nova\\", \\"status\\": \\"backing-up\\", \\"attach_status\\": \\"attached\\", \\"migration_status\\": null, \\"scheduled_at\\": \\"2026-07-03T09:46:10.000000\\", \\"launched_at\\": \\"2026-07-03T09:46:10.000000\\", \\"terminated_at\\": null, \\"display_name\\": \\"tempest-VolumesBackupsTest-Volume-175473569\\", \\"display_description\\": null, \\"provider_location\\": null, \\"provider_auth\\": null, \\"provider_geometry\\": null, \\"provider_id\\": null, \\"volume_type_id\\": \\"03e13fe6-0e30-4803-ace0-725d38e6dc24\\", \\"source_volid\\": null, \\"encryption_key_id\\": null, \\"consistencygroup_id\\": null, \\"group_id\\": null, \\"bootable\\": false, \\"multiattach\\": false, \\"replication_status\\": null, \\"replication_extended_status\\": null, \\"replication_driver_data\\": null, \\"previous_status\\": \\"in-use\\", \\"service_uuid\\": \\"6d4b0e79-fefe-4744-b25f-34be05095200\\", \\"shared_targets\\": true, \\"deleted_at\\": null, \\"deleted\\": false, \\"created_at\\": \\"2026-07-03T09:46:10.000000\\", \\"updated_at\\": \\"2026-07-03T09:47:17.000000\\"}}"\n}'. {{(pid=101319) _write_metadata /opt/stack/cinder/cinder/backup/chunkeddriver.py:295}} Jul 03 09:47:32.914291 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-75ba68df-8a8d-48ad-9be6-295988b8d81d tempest-VolumesBackupsTest-2142009639 None] backup 86118233-3d57-47ad-8781-cab6c54e4d53 finished. {{(pid=101319) _finalize_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:462}} Jul 03 09:47:33.038007 np0000004400 cinder-backup[101319]: DEBUG oslo_concurrency.processutils [None req-75ba68df-8a8d-48ad-9be6-295988b8d81d tempest-VolumesBackupsTest-2142009639 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chown 0 /dev/sde {{(pid=101319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 09:47:33.056070 np0000004400 sudo[141099]: stack : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chown 0 /dev/sde Jul 03 09:47:33.056900 np0000004400 sudo[141099]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1002) Jul 03 09:47:33.374886 np0000004400 sudo[141099]: pam_unix(sudo:session): session closed for user root Jul 03 09:47:33.377078 np0000004400 cinder-backup[101319]: DEBUG oslo_concurrency.processutils [None req-75ba68df-8a8d-48ad-9be6-295988b8d81d tempest-VolumesBackupsTest-2142009639 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chown 0 /dev/sde" returned: 0 in 0.339s {{(pid=101319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 09:47:33.377684 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-75ba68df-8a8d-48ad-9be6-295988b8d81d tempest-VolumesBackupsTest-2142009639 None] ==> disconnect_volume: call "{'args': (, {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-298b8723-c4d1-455f-aef8-665b62a8001f', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '298b8723-c4d1-455f-aef8-665b62a8001f', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': False}, {'type': 'block', 'scsi_wwn': '33000000090d3e696', 'path': '/dev/sde'}), 'kwargs': {'force': True, 'ignore_errors': True}}" {{(pid=101319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}} Jul 03 09:47:33.377862 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.base [None req-75ba68df-8a8d-48ad-9be6-295988b8d81d tempest-VolumesBackupsTest-2142009639 None] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=101319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jul 03 09:47:33.378333 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.base [None req-75ba68df-8a8d-48ad-9be6-295988b8d81d tempest-VolumesBackupsTest-2142009639 None] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.000s {{(pid=101319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jul 03 09:47:33.378708 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-75ba68df-8a8d-48ad-9be6-295988b8d81d tempest-VolumesBackupsTest-2142009639 None] _get_connection_devices called with parameters: connection_properties={'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-298b8723-c4d1-455f-aef8-665b62a8001f', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '298b8723-c4d1-455f-aef8-665b62a8001f', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': False}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=101319) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:847}} Jul 03 09:47:33.389301 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-75ba68df-8a8d-48ad-9be6-295988b8d81d tempest-VolumesBackupsTest-2142009639 None] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS: Jul 03 09:47:33.389301 np0000004400 cinder-backup[101319]: No targets found. Jul 03 09:47:33.389301 np0000004400 cinder-backup[101319]: iSNS: Jul 03 09:47:33.389301 np0000004400 cinder-backup[101319]: No targets found. Jul 03 09:47:33.389301 np0000004400 cinder-backup[101319]: STATIC: Jul 03 09:47:33.389301 np0000004400 cinder-backup[101319]: Target: iqn.2023-03.storpool.com:os--volume-8a0b1cfb-8ea1-46a0-aac3-b254107b98ef Jul 03 09:47:33.389301 np0000004400 cinder-backup[101319]: Portal: 192.168.50.100:3260,-1 Jul 03 09:47:33.389301 np0000004400 cinder-backup[101319]: Iface Name: default Jul 03 09:47:33.389301 np0000004400 cinder-backup[101319]: Portal: 192.168.40.100:3260,-1 Jul 03 09:47:33.389301 np0000004400 cinder-backup[101319]: Iface Name: default Jul 03 09:47:33.389301 np0000004400 cinder-backup[101319]: Target: iqn.2023-03.storpool.com:os--volume-9e9ca83c-acc7-4d33-b467-06911ac48096 Jul 03 09:47:33.389301 np0000004400 cinder-backup[101319]: Portal: 192.168.50.100:3260,-1 Jul 03 09:47:33.389301 np0000004400 cinder-backup[101319]: Iface Name: default Jul 03 09:47:33.389301 np0000004400 cinder-backup[101319]: Portal: 192.168.40.100:3260,-1 Jul 03 09:47:33.389301 np0000004400 cinder-backup[101319]: Iface Name: default Jul 03 09:47:33.389301 np0000004400 cinder-backup[101319]: Target: iqn.2023-03.storpool.com:os--volume-298b8723-c4d1-455f-aef8-665b62a8001f Jul 03 09:47:33.389301 np0000004400 cinder-backup[101319]: Portal: 192.168.40.100:3260,-1 Jul 03 09:47:33.389301 np0000004400 cinder-backup[101319]: Iface Name: default Jul 03 09:47:33.389301 np0000004400 cinder-backup[101319]: FIRMWARE: Jul 03 09:47:33.389301 np0000004400 cinder-backup[101319]: No targets found. Jul 03 09:47:33.389301 np0000004400 cinder-backup[101319]: stderr= {{(pid=101319) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jul 03 09:47:33.389770 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-75ba68df-8a8d-48ad-9be6-295988b8d81d tempest-VolumesBackupsTest-2142009639 None] Regex to get portals from discoverydb: ^SENDTARGETS: Jul 03 09:47:33.389770 np0000004400 cinder-backup[101319]: .*?^DiscoveryAddress: 192.168.40.100,3260.*? Jul 03 09:47:33.389770 np0000004400 cinder-backup[101319]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=101319) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:390}} Jul 03 09:47:33.389770 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-75ba68df-8a8d-48ad-9be6-295988b8d81d tempest-VolumesBackupsTest-2142009639 None] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-298b8723-c4d1-455f-aef8-665b62a8001f', 0)] {{(pid=101319) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:858}} Jul 03 09:47:33.411962 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-75ba68df-8a8d-48ad-9be6-295988b8d81d tempest-VolumesBackupsTest-2142009639 None] iscsiadm ('-m', 'session'): stdout=tcp: [120] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8a0b1cfb-8ea1-46a0-aac3-b254107b98ef (non-flash) Jul 03 09:47:33.411962 np0000004400 cinder-backup[101319]: tcp: [121] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8a0b1cfb-8ea1-46a0-aac3-b254107b98ef (non-flash) Jul 03 09:47:33.411962 np0000004400 cinder-backup[101319]: tcp: [122] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-298b8723-c4d1-455f-aef8-665b62a8001f (non-flash) Jul 03 09:47:33.411962 np0000004400 cinder-backup[101319]: tcp: [123] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9e9ca83c-acc7-4d33-b467-06911ac48096 (non-flash) Jul 03 09:47:33.411962 np0000004400 cinder-backup[101319]: tcp: [124] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9e9ca83c-acc7-4d33-b467-06911ac48096 (non-flash) Jul 03 09:47:33.411962 np0000004400 cinder-backup[101319]: stderr= {{(pid=101319) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jul 03 09:47:33.412184 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-75ba68df-8a8d-48ad-9be6-295988b8d81d tempest-VolumesBackupsTest-2142009639 None] iscsi session list stdout=tcp: [120] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8a0b1cfb-8ea1-46a0-aac3-b254107b98ef (non-flash) Jul 03 09:47:33.412184 np0000004400 cinder-backup[101319]: tcp: [121] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8a0b1cfb-8ea1-46a0-aac3-b254107b98ef (non-flash) Jul 03 09:47:33.412184 np0000004400 cinder-backup[101319]: tcp: [122] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-298b8723-c4d1-455f-aef8-665b62a8001f (non-flash) Jul 03 09:47:33.412184 np0000004400 cinder-backup[101319]: tcp: [123] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9e9ca83c-acc7-4d33-b467-06911ac48096 (non-flash) Jul 03 09:47:33.412184 np0000004400 cinder-backup[101319]: tcp: [124] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9e9ca83c-acc7-4d33-b467-06911ac48096 (non-flash) Jul 03 09:47:33.412184 np0000004400 cinder-backup[101319]: stderr= {{(pid=101319) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jul 03 09:47:33.412184 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-75ba68df-8a8d-48ad-9be6-295988b8d81d tempest-VolumesBackupsTest-2142009639 None] Sessions list: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-8a0b1cfb-8ea1-46a0-aac3-b254107b98ef', '120'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-8a0b1cfb-8ea1-46a0-aac3-b254107b98ef', '121'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-298b8723-c4d1-455f-aef8-665b62a8001f', '122'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-9e9ca83c-acc7-4d33-b467-06911ac48096', '123'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-9e9ca83c-acc7-4d33-b467-06911ac48096', '124')] {{(pid=101319) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:866}} Jul 03 09:47:33.412363 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-75ba68df-8a8d-48ad-9be6-295988b8d81d tempest-VolumesBackupsTest-2142009639 None] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-298b8723-c4d1-455f-aef8-665b62a8001f, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-298b8723-c4d1-455f-aef8-665b62a8001f', '122')] {{(pid=101319) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}} Jul 03 09:47:33.413314 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-75ba68df-8a8d-48ad-9be6-295988b8d81d tempest-VolumesBackupsTest-2142009639 None] Resulting device map defaultdict(. at 0x7e76e753c360>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-298b8723-c4d1-455f-aef8-665b62a8001f'): ({'sde'}, set())}) {{(pid=101319) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:912}} Jul 03 09:47:33.414616 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.linuxscsi [None req-75ba68df-8a8d-48ad-9be6-295988b8d81d tempest-VolumesBackupsTest-2142009639 None] Removing single pathed devices sde {{(pid=101319) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}} Jul 03 09:47:33.423026 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.linuxscsi [None req-75ba68df-8a8d-48ad-9be6-295988b8d81d tempest-VolumesBackupsTest-2142009639 None] Flushing IO for device /dev/sde {{(pid=101319) flush_device_io /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:461}} Jul 03 09:47:33.430674 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.linuxscsi [None req-75ba68df-8a8d-48ad-9be6-295988b8d81d tempest-VolumesBackupsTest-2142009639 None] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=101319) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}} Jul 03 09:47:33.475905 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.linuxscsi [None req-75ba68df-8a8d-48ad-9be6-295988b8d81d tempest-VolumesBackupsTest-2142009639 None] Checking to see if SCSI volumes sde have been removed. {{(pid=101319) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}} Jul 03 09:47:33.476087 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.linuxscsi [None req-75ba68df-8a8d-48ad-9be6-295988b8d81d tempest-VolumesBackupsTest-2142009639 None] SCSI volumes sde have been removed. {{(pid=101319) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}} Jul 03 09:47:33.477031 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.linuxscsi [None req-75ba68df-8a8d-48ad-9be6-295988b8d81d tempest-VolumesBackupsTest-2142009639 None] Checking to see if device paths {'sde'} are still under multipathd monitoring {{(pid=101319) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}} Jul 03 09:47:33.487205 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.linuxscsi [None req-75ba68df-8a8d-48ad-9be6-295988b8d81d tempest-VolumesBackupsTest-2142009639 None] Device paths {'sde'} have been removed from multipathd monitoring. {{(pid=101319) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}} Jul 03 09:47:33.487511 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-75ba68df-8a8d-48ad-9be6-295988b8d81d tempest-VolumesBackupsTest-2142009639 None] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-298b8723-c4d1-455f-aef8-665b62a8001f')] {{(pid=101319) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1225}} Jul 03 09:47:33.496886 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-75ba68df-8a8d-48ad-9be6-295988b8d81d tempest-VolumesBackupsTest-2142009639 None] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=101319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 03 09:47:33.529044 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-75ba68df-8a8d-48ad-9be6-295988b8d81d tempest-VolumesBackupsTest-2142009639 None] iscsiadm ('--logout',): stdout=Logging out of session [sid: 122, target: iqn.2023-03.storpool.com:os--volume-298b8723-c4d1-455f-aef8-665b62a8001f, portal: 192.168.40.100,3260] Jul 03 09:47:33.529044 np0000004400 cinder-backup[101319]: Logout of [sid: 122, target: iqn.2023-03.storpool.com:os--volume-298b8723-c4d1-455f-aef8-665b62a8001f, portal: 192.168.40.100,3260] successful. Jul 03 09:47:33.529044 np0000004400 cinder-backup[101319]: stderr= {{(pid=101319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 03 09:47:33.543270 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-75ba68df-8a8d-48ad-9be6-295988b8d81d tempest-VolumesBackupsTest-2142009639 None] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=101319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 03 09:47:33.543648 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.base [None req-75ba68df-8a8d-48ad-9be6-295988b8d81d tempest-VolumesBackupsTest-2142009639 None] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.165s {{(pid=101319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jul 03 09:47:33.543833 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-75ba68df-8a8d-48ad-9be6-295988b8d81d tempest-VolumesBackupsTest-2142009639 None] <== disconnect_volume: return (166ms) None {{(pid=101319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}} Jul 03 09:47:34.020000 np0000004400 cinder-backup[101319]: INFO cinder.backup.manager [None req-ff9a2cd5-68dc-4b82-8fd3-82fb094c7b84 tempest-VolumesBackupsTest-118275719 None] Create backup started, backup: 06482a6e-a410-44d6-85cf-84392df124bc volume: e49954d5-d017-43d5-8565-25ce9e2693f9 snapshot: 8390eb5b-bd3e-44f3-b7d0-6825270b65e8. Jul 03 09:47:34.028521 np0000004400 cinder-backup[101319]: INFO cinder.backup.manager [None req-ff9a2cd5-68dc-4b82-8fd3-82fb094c7b84 tempest-VolumesBackupsTest-118275719 None] Call Volume Manager to get_backup_device for Backup(availability_zone='nova',container=None,created_at=2026-07-03T09:47:33Z,data_timestamp=2026-07-03T09:47:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesBackupsTest-Backup-1365674745',encryption_key_id=None,fail_reason=None,host='np0000004400',id=06482a6e-a410-44d6-85cf-84392df124bc,metadata={},num_dependent_backups=0,object_count=0,parent=None,parent_id=None,project_id='a484ec9218bf417bb9d7575ae6370646',restore_volume_id=None,service='cinder.backup.drivers.swift.SwiftBackupDriver',service_metadata=None,size=1,snapshot_id='8390eb5b-bd3e-44f3-b7d0-6825270b65e8',status='creating',temp_snapshot_id=None,temp_volume_id=None,updated_at=None,user_id='b861df2a13684334b293b1f348152e37',volume_id=e49954d5-d017-43d5-8565-25ce9e2693f9) Jul 03 09:47:34.087393 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.drivers.swift [None req-ff9a2cd5-68dc-4b82-8fd3-82fb094c7b84 tempest-VolumesBackupsTest-118275719 None] Using swift URL https://10.4.3.95:8080/v1/AUTH_a484ec9218bf417bb9d7575ae6370646 {{(pid=101319) initialize /opt/stack/cinder/cinder/backup/drivers/swift.py:300}} Jul 03 09:47:34.087567 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.drivers.swift [None req-ff9a2cd5-68dc-4b82-8fd3-82fb094c7b84 tempest-VolumesBackupsTest-118275719 None] Connect to https://10.4.3.95:8080/v1/AUTH_ in "per_user" mode {{(pid=101319) initialize /opt/stack/cinder/cinder/backup/drivers/swift.py:301}} Jul 03 09:47:34.087806 np0000004400 cinder-backup[101319]: DEBUG os_brick.utils [None req-ff9a2cd5-68dc-4b82-8fd3-82fb094c7b84 tempest-VolumesBackupsTest-118275719 None] ==> get_connector_properties: call "{'root_helper': 'sudo cinder-rootwrap /etc/cinder/rootwrap.conf', 'my_ip': '10.4.3.95', 'multipath': False, 'enforce_multipath': False, 'host': None, 'execute': None}" {{(pid=101319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}} Jul 03 09:47:34.100029 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.scaleio [None req-ff9a2cd5-68dc-4b82-8fd3-82fb094c7b84 tempest-VolumesBackupsTest-118275719 None] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=101319) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}} Jul 03 09:47:34.120861 np0000004400 cinder-backup[101319]: DEBUG oslo_concurrency.processutils [None req-ff9a2cd5-68dc-4b82-8fd3-82fb094c7b84 tempest-VolumesBackupsTest-118275719 None] Running cmd (subprocess): nvme version {{(pid=101319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 09:47:34.130312 np0000004400 cinder-backup[101319]: DEBUG oslo_concurrency.processutils [None req-ff9a2cd5-68dc-4b82-8fd3-82fb094c7b84 tempest-VolumesBackupsTest-118275719 None] 'nvme version' failed. Not Retrying. {{(pid=101319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 03 09:47:34.130594 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.nvmeof [None req-ff9a2cd5-68dc-4b82-8fd3-82fb094c7b84 tempest-VolumesBackupsTest-118275719 None] nvme not present on system {{(pid=101319) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}} Jul 03 09:47:34.138197 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.lightos [None req-ff9a2cd5-68dc-4b82-8fd3-82fb094c7b84 tempest-VolumesBackupsTest-118275719 None] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=101319) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}} Jul 03 09:47:34.139468 np0000004400 cinder-backup[101319]: INFO os_brick.initiator.connectors.lightos [None req-ff9a2cd5-68dc-4b82-8fd3-82fb094c7b84 tempest-VolumesBackupsTest-118275719 None] Current host hostNQN and IP(s) are ['10.4.3.95', 'fe80::f816:3eff:fe47:268c', '192.168.40.6', 'fe80::f816:3eff:febf:7be2', '192.168.50.6', 'fe80::f816:3eff:fe99:8914', '192.168.10.6', 'fe80::f816:3eff:fe2f:e696', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::bc9d:84ff:fec2:6b49', 'fe80::fc16:3eff:fe97:90a6', 'fe80::8435:18ff:feb9:798c', 'fe80::fc16:3eff:feda:9a9f', 'fe80::28c1:27ff:fe3c:5528', 'fe80::fc16:3eff:fec1:41ad', 'fe80::4007:baff:fe0f:8f44'] Jul 03 09:47:34.139610 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.lightos [None req-ff9a2cd5-68dc-4b82-8fd3-82fb094c7b84 tempest-VolumesBackupsTest-118275719 None] LIGHTOS: did not find dsc, continuing anyway. {{(pid=101319) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}} Jul 03 09:47:34.139736 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.lightos [None req-ff9a2cd5-68dc-4b82-8fd3-82fb094c7b84 tempest-VolumesBackupsTest-118275719 None] LIGHTOS: no hostnqn found. {{(pid=101319) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}} Jul 03 09:47:34.140095 np0000004400 cinder-backup[101319]: DEBUG os_brick.utils [None req-ff9a2cd5-68dc-4b82-8fd3-82fb094c7b84 tempest-VolumesBackupsTest-118275719 None] <== get_connector_properties: return (52ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.95', 'host': 'np0000004400', 'multipath': False, 'enforce_multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:ae7e5bb0ebe6', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': '6b284368-d0ba-4d18-af6f-4998d3955c52', 'nvme_native_multipath': False} {{(pid=101319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}} Jul 03 09:47:34.592486 np0000004400 cinder-backup[101319]: DEBUG oslo_db.sqlalchemy.engines [None req-75ba68df-8a8d-48ad-9be6-295988b8d81d tempest-VolumesBackupsTest-2142009639 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=101319) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 03 09:47:34.643060 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connector [None req-ff9a2cd5-68dc-4b82-8fd3-82fb094c7b84 tempest-VolumesBackupsTest-118275719 None] Factory for iscsi on None {{(pid=101319) factory /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connector.py:243}} Jul 03 09:47:34.643471 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-ff9a2cd5-68dc-4b82-8fd3-82fb094c7b84 tempest-VolumesBackupsTest-118275719 None] ==> connect_volume: call "{'self': , 'connection_properties': {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-25552aca-10fe-4ac0-affd-19717e76efc4', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '25552aca-10fe-4ac0-affd-19717e76efc4', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': False}}" {{(pid=101319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}} Jul 03 09:47:34.643652 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.base [None req-ff9a2cd5-68dc-4b82-8fd3-82fb094c7b84 tempest-VolumesBackupsTest-118275719 None] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=101319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jul 03 09:47:34.658671 np0000004400 cinder-backup[101319]: INFO cinder.backup.manager [None req-75ba68df-8a8d-48ad-9be6-295988b8d81d tempest-VolumesBackupsTest-2142009639 None] Create backup finished. backup: 86118233-3d57-47ad-8781-cab6c54e4d53. Jul 03 09:47:35.575042 np0000004400 cinder-backup[101319]: INFO cinder.backup.manager [None req-ff8d1fd5-0609-46f4-aa85-d9226f0ecff8 tempest-VolumesBackupsTest-2142009639 None] Create backup started, backup: b1aa5ad9-985a-4f8b-a2fb-778a315501a9 volume: 8a0b1cfb-8ea1-46a0-aac3-b254107b98ef. Jul 03 09:47:35.583338 np0000004400 cinder-backup[101319]: INFO cinder.backup.manager [None req-ff8d1fd5-0609-46f4-aa85-d9226f0ecff8 tempest-VolumesBackupsTest-2142009639 None] Call Volume Manager to get_backup_device for Backup(availability_zone='nova',container=None,created_at=2026-07-03T09:47:35Z,data_timestamp=2026-07-03T09:47:35Z,deleted=False,deleted_at=None,display_description=None,display_name=None,encryption_key_id=None,fail_reason=None,host='np0000004400',id=b1aa5ad9-985a-4f8b-a2fb-778a315501a9,metadata={},num_dependent_backups=0,object_count=0,parent=Backup(86118233-3d57-47ad-8781-cab6c54e4d53),parent_id='86118233-3d57-47ad-8781-cab6c54e4d53',project_id='59044e18a5b24b19a7b9b8a380f2e1a0',restore_volume_id=None,service='cinder.backup.drivers.swift.SwiftBackupDriver',service_metadata=None,size=1,snapshot_id=None,status='creating',temp_snapshot_id=None,temp_volume_id=None,updated_at=None,user_id='91463b6c437c4711a49d3c31c513a101',volume_id=8a0b1cfb-8ea1-46a0-aac3-b254107b98ef) Jul 03 09:47:35.641814 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.drivers.swift [None req-ff8d1fd5-0609-46f4-aa85-d9226f0ecff8 tempest-VolumesBackupsTest-2142009639 None] Using swift URL https://10.4.3.95:8080/v1/AUTH_59044e18a5b24b19a7b9b8a380f2e1a0 {{(pid=101319) initialize /opt/stack/cinder/cinder/backup/drivers/swift.py:300}} Jul 03 09:47:35.642145 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.drivers.swift [None req-ff8d1fd5-0609-46f4-aa85-d9226f0ecff8 tempest-VolumesBackupsTest-2142009639 None] Connect to https://10.4.3.95:8080/v1/AUTH_ in "per_user" mode {{(pid=101319) initialize /opt/stack/cinder/cinder/backup/drivers/swift.py:301}} Jul 03 09:47:35.642322 np0000004400 cinder-backup[101319]: DEBUG os_brick.utils [None req-ff8d1fd5-0609-46f4-aa85-d9226f0ecff8 tempest-VolumesBackupsTest-2142009639 None] ==> get_connector_properties: call "{'root_helper': 'sudo cinder-rootwrap /etc/cinder/rootwrap.conf', 'my_ip': '10.4.3.95', 'multipath': False, 'enforce_multipath': False, 'host': None, 'execute': None}" {{(pid=101319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}} Jul 03 09:47:35.652185 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.scaleio [None req-ff8d1fd5-0609-46f4-aa85-d9226f0ecff8 tempest-VolumesBackupsTest-2142009639 None] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=101319) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}} Jul 03 09:47:35.671924 np0000004400 cinder-backup[101319]: DEBUG oslo_concurrency.processutils [None req-ff8d1fd5-0609-46f4-aa85-d9226f0ecff8 tempest-VolumesBackupsTest-2142009639 None] Running cmd (subprocess): nvme version {{(pid=101319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 09:47:35.686817 np0000004400 cinder-backup[101319]: DEBUG oslo_concurrency.processutils [None req-ff8d1fd5-0609-46f4-aa85-d9226f0ecff8 tempest-VolumesBackupsTest-2142009639 None] 'nvme version' failed. Not Retrying. {{(pid=101319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 03 09:47:35.686917 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.nvmeof [None req-ff8d1fd5-0609-46f4-aa85-d9226f0ecff8 tempest-VolumesBackupsTest-2142009639 None] nvme not present on system {{(pid=101319) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}} Jul 03 09:47:35.697151 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.lightos [None req-ff8d1fd5-0609-46f4-aa85-d9226f0ecff8 tempest-VolumesBackupsTest-2142009639 None] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=101319) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}} Jul 03 09:47:35.698240 np0000004400 cinder-backup[101319]: INFO os_brick.initiator.connectors.lightos [None req-ff8d1fd5-0609-46f4-aa85-d9226f0ecff8 tempest-VolumesBackupsTest-2142009639 None] Current host hostNQN and IP(s) are ['10.4.3.95', 'fe80::f816:3eff:fe47:268c', '192.168.40.6', 'fe80::f816:3eff:febf:7be2', '192.168.50.6', 'fe80::f816:3eff:fe99:8914', '192.168.10.6', 'fe80::f816:3eff:fe2f:e696', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::bc9d:84ff:fec2:6b49', 'fe80::fc16:3eff:fe97:90a6', 'fe80::8435:18ff:feb9:798c', 'fe80::fc16:3eff:feda:9a9f', 'fe80::28c1:27ff:fe3c:5528', 'fe80::fc16:3eff:fec1:41ad', 'fe80::4007:baff:fe0f:8f44'] Jul 03 09:47:35.698432 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.lightos [None req-ff8d1fd5-0609-46f4-aa85-d9226f0ecff8 tempest-VolumesBackupsTest-2142009639 None] LIGHTOS: did not find dsc, continuing anyway. {{(pid=101319) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}} Jul 03 09:47:35.698645 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.lightos [None req-ff8d1fd5-0609-46f4-aa85-d9226f0ecff8 tempest-VolumesBackupsTest-2142009639 None] LIGHTOS: no hostnqn found. {{(pid=101319) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}} Jul 03 09:47:35.698993 np0000004400 cinder-backup[101319]: DEBUG os_brick.utils [None req-ff8d1fd5-0609-46f4-aa85-d9226f0ecff8 tempest-VolumesBackupsTest-2142009639 None] <== get_connector_properties: return (56ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.95', 'host': 'np0000004400', 'multipath': False, 'enforce_multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:ae7e5bb0ebe6', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': '6b284368-d0ba-4d18-af6f-4998d3955c52', 'nvme_native_multipath': False} {{(pid=101319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}} Jul 03 09:47:36.204241 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connector [None req-ff8d1fd5-0609-46f4-aa85-d9226f0ecff8 tempest-VolumesBackupsTest-2142009639 None] Factory for iscsi on None {{(pid=101319) factory /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connector.py:243}} Jul 03 09:47:36.204936 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-ff8d1fd5-0609-46f4-aa85-d9226f0ecff8 tempest-VolumesBackupsTest-2142009639 None] ==> connect_volume: call "{'self': , 'connection_properties': {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-7ec8624e-70c1-4cb2-bb18-1a0e48d27629', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '7ec8624e-70c1-4cb2-bb18-1a0e48d27629', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': False}}" {{(pid=101319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}} Jul 03 09:47:36.205595 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.base [None req-ff8d1fd5-0609-46f4-aa85-d9226f0ecff8 tempest-VolumesBackupsTest-2142009639 None] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=101319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jul 03 09:47:37.111487 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.base [None req-ff9a2cd5-68dc-4b82-8fd3-82fb094c7b84 tempest-VolumesBackupsTest-118275719 None] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 2.468s {{(pid=101319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jul 03 09:47:37.111833 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.base [None req-ff9a2cd5-68dc-4b82-8fd3-82fb094c7b84 tempest-VolumesBackupsTest-118275719 None] Connection properties {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-25552aca-10fe-4ac0-affd-19717e76efc4', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '25552aca-10fe-4ac0-affd-19717e76efc4', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': False} {{(pid=101319) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}} Jul 03 09:47:37.122994 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.base [None req-ff9a2cd5-68dc-4b82-8fd3-82fb094c7b84 tempest-VolumesBackupsTest-118275719 None] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-25552aca-10fe-4ac0-affd-19717e76efc4" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=101319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jul 03 09:47:37.123467 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.base [None req-ff9a2cd5-68dc-4b82-8fd3-82fb094c7b84 tempest-VolumesBackupsTest-118275719 None] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-25552aca-10fe-4ac0-affd-19717e76efc4" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=101319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jul 03 09:47:37.123660 np0000004400 cinder-backup[101319]: INFO os_brick.initiator.connectors.iscsi [None req-ff9a2cd5-68dc-4b82-8fd3-82fb094c7b84 tempest-VolumesBackupsTest-118275719 None] Trying to connect to iSCSI portal 192.168.40.100:3260 Jul 03 09:47:37.133092 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-ff9a2cd5-68dc-4b82-8fd3-82fb094c7b84 tempest-VolumesBackupsTest-118275719 None] iscsiadm (): stdout= stderr=iscsiadm: No records found Jul 03 09:47:37.133092 np0000004400 cinder-backup[101319]: {{(pid=101319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 03 09:47:37.143097 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-ff9a2cd5-68dc-4b82-8fd3-82fb094c7b84 tempest-VolumesBackupsTest-118275719 None] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-25552aca-10fe-4ac0-affd-19717e76efc4] added Jul 03 09:47:37.143097 np0000004400 cinder-backup[101319]: stderr=iscsiadm: Config file line 363 does not have value Jul 03 09:47:37.143097 np0000004400 cinder-backup[101319]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs' Jul 03 09:47:37.143097 np0000004400 cinder-backup[101319]: iscsiadm: Config file line 363 does not have value Jul 03 09:47:37.143097 np0000004400 cinder-backup[101319]: iscsiadm: Config file line 363 does not have value Jul 03 09:47:37.143097 np0000004400 cinder-backup[101319]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs' Jul 03 09:47:37.143097 np0000004400 cinder-backup[101319]: {{(pid=101319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 03 09:47:37.143295 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-ff9a2cd5-68dc-4b82-8fd3-82fb094c7b84 tempest-VolumesBackupsTest-118275719 None] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=101319) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}} Jul 03 09:47:37.143689 np0000004400 cinder-backup[101319]: DEBUG os_brick.utils [None req-ff9a2cd5-68dc-4b82-8fd3-82fb094c7b84 tempest-VolumesBackupsTest-118275719 None] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0199(s), this was the 1st time calling it. {{(pid=101319) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}} Jul 03 09:47:37.143885 np0000004400 cinder-backup[101319]: DEBUG os_brick.utils [None req-ff9a2cd5-68dc-4b82-8fd3-82fb094c7b84 tempest-VolumesBackupsTest-118275719 None] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=101319) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}} Jul 03 09:47:38.145453 np0000004400 cinder-backup[101319]: INFO os_brick.initiator.connectors.iscsi [None req-ff9a2cd5-68dc-4b82-8fd3-82fb094c7b84 tempest-VolumesBackupsTest-118275719 None] Trying to connect to iSCSI portal 192.168.40.100:3260 Jul 03 09:47:38.158269 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-ff9a2cd5-68dc-4b82-8fd3-82fb094c7b84 tempest-VolumesBackupsTest-118275719 None] iscsiadm (): stdout=# BEGIN RECORD 2.1.9 Jul 03 09:47:38.158269 np0000004400 cinder-backup[101319]: node.name = iqn.2023-03.storpool.com:os--volume-25552aca-10fe-4ac0-affd-19717e76efc4 Jul 03 09:47:38.158269 np0000004400 cinder-backup[101319]: node.tpgt = -1 Jul 03 09:47:38.158269 np0000004400 cinder-backup[101319]: node.startup = manual Jul 03 09:47:38.158269 np0000004400 cinder-backup[101319]: node.leading_login = No Jul 03 09:47:38.158269 np0000004400 cinder-backup[101319]: iface.iscsi_ifacename = default Jul 03 09:47:38.158269 np0000004400 cinder-backup[101319]: iface.net_ifacename = Jul 03 09:47:38.158269 np0000004400 cinder-backup[101319]: iface.ipaddress = Jul 03 09:47:38.158269 np0000004400 cinder-backup[101319]: iface.prefix_len = 0 Jul 03 09:47:38.158269 np0000004400 cinder-backup[101319]: iface.hwaddress = Jul 03 09:47:38.158269 np0000004400 cinder-backup[101319]: iface.transport_name = tcp Jul 03 09:47:38.158269 np0000004400 cinder-backup[101319]: iface.initiatorname = Jul 03 09:47:38.158269 np0000004400 cinder-backup[101319]: iface.state = Jul 03 09:47:38.158269 np0000004400 cinder-backup[101319]: iface.vlan_id = 0 Jul 03 09:47:38.158269 np0000004400 cinder-backup[101319]: iface.vlan_priority = 0 Jul 03 09:47:38.158269 np0000004400 cinder-backup[101319]: iface.vlan_state = Jul 03 09:47:38.158269 np0000004400 cinder-backup[101319]: iface.iface_num = 0 Jul 03 09:47:38.158269 np0000004400 cinder-backup[101319]: iface.mtu = 0 Jul 03 09:47:38.158269 np0000004400 cinder-backup[101319]: iface.port = 0 Jul 03 09:47:38.158269 np0000004400 cinder-backup[101319]: iface.bootproto = Jul 03 09:47:38.158269 np0000004400 cinder-backup[101319]: iface.subnet_mask = Jul 03 09:47:38.158269 np0000004400 cinder-backup[101319]: iface.gateway = Jul 03 09:47:38.158269 np0000004400 cinder-backup[101319]: iface.dhcp_alt_client_id_state = Jul 03 09:47:38.158269 np0000004400 cinder-backup[101319]: iface.dhcp_alt_client_id = Jul 03 09:47:38.158269 np0000004400 cinder-backup[101319]: iface.dhcp_dns = Jul 03 09:47:38.158269 np0000004400 cinder-backup[101319]: iface.dhcp_learn_iqn = Jul 03 09:47:38.158269 np0000004400 cinder-backup[101319]: iface.dhcp_req_vendor_id_state = Jul 03 09:47:38.158269 np0000004400 cinder-backup[101319]: iface.dhcp_vendor_id_state = Jul 03 09:47:38.158269 np0000004400 cinder-backup[101319]: iface.dhcp_vendor_id = Jul 03 09:47:38.158269 np0000004400 cinder-backup[101319]: iface.dhcp_slp_da = Jul 03 09:47:38.158269 np0000004400 cinder-backup[101319]: iface.fragmentation = Jul 03 09:47:38.158269 np0000004400 cinder-backup[101319]: iface.gratuitous_arp = Jul 03 09:47:38.158269 np0000004400 cinder-backup[101319]: iface.incoming_forwarding = Jul 03 09:47:38.158269 np0000004400 cinder-backup[101319]: iface.tos_state = Jul 03 09:47:38.158269 np0000004400 cinder-backup[101319]: iface.tos = 0 Jul 03 09:47:38.158269 np0000004400 cinder-backup[101319]: iface.ttl = 0 Jul 03 09:47:38.158269 np0000004400 cinder-backup[101319]: iface.delayed_ack = Jul 03 09:47:38.158269 np0000004400 cinder-backup[101319]: iface.tcp_nagle = Jul 03 09:47:38.158269 np0000004400 cinder-backup[101319]: iface.tcp_wsf_state = Jul 03 09:47:38.158269 np0000004400 cinder-backup[101319]: iface.tcp_wsf = 0 Jul 03 09:47:38.158269 np0000004400 cinder-backup[101319]: iface.tcp_timer_scale = 0 Jul 03 09:47:38.158269 np0000004400 cinder-backup[101319]: iface.tcp_timestamp = Jul 03 09:47:38.158269 np0000004400 cinder-backup[101319]: iface.redirect = Jul 03 09:47:38.158269 np0000004400 cinder-backup[101319]: iface.def_task_mgmt_timeout = 0 Jul 03 09:47:38.158269 np0000004400 cinder-backup[101319]: iface.header_digest = Jul 03 09:47:38.158269 np0000004400 cinder-backup[101319]: iface.data_digest = Jul 03 09:47:38.158269 np0000004400 cinder-backup[101319]: iface.immediate_data = Jul 03 09:47:38.158269 np0000004400 cinder-backup[101319]: iface.initial_r2t = Jul 03 09:47:38.158269 np0000004400 cinder-backup[101319]: iface.data_seq_inorder = Jul 03 09:47:38.158269 np0000004400 cinder-backup[101319]: iface.data_pdu_inorder = Jul 03 09:47:38.158269 np0000004400 cinder-backup[101319]: iface.erl = 0 Jul 03 09:47:38.158269 np0000004400 cinder-backup[101319]: iface.max_receive_data_len = 0 Jul 03 09:47:38.158269 np0000004400 cinder-backup[101319]: iface.first_burst_len = 0 Jul 03 09:47:38.158269 np0000004400 cinder-backup[101319]: iface.max_outstanding_r2t = 0 Jul 03 09:47:38.158269 np0000004400 cinder-backup[101319]: iface.max_burst_len = 0 Jul 03 09:47:38.158269 np0000004400 cinder-backup[101319]: iface.chap_auth = Jul 03 09:47:38.158269 np0000004400 cinder-backup[101319]: iface.bidi_chap = Jul 03 09:47:38.158269 np0000004400 cinder-backup[101319]: iface.strict_login_compliance = Jul 03 09:47:38.158269 np0000004400 cinder-backup[101319]: iface.discovery_auth = Jul 03 09:47:38.158269 np0000004400 cinder-backup[101319]: iface.discovery_logout = Jul 03 09:47:38.158269 np0000004400 cinder-backup[101319]: node.discovery_address = Jul 03 09:47:38.158269 np0000004400 cinder-backup[101319]: node.discovery_port = 0 Jul 03 09:47:38.158269 np0000004400 cinder-backup[101319]: node.discovery_type = fw Jul 03 09:47:38.158269 np0000004400 cinder-backup[101319]: node.session.initial_cmdsn = 0 Jul 03 09:47:38.158269 np0000004400 cinder-backup[101319]: node.session.initial_login_retry_max = 8 Jul 03 09:47:38.158269 np0000004400 cinder-backup[101319]: node.session.xmit_thread_priority = 0 Jul 03 09:47:38.158269 np0000004400 cinder-backup[101319]: node.session.cmds_max = 128 Jul 03 09:47:38.158269 np0000004400 cinder-backup[101319]: node.session.queue_depth = 32 Jul 03 09:47:38.158269 np0000004400 cinder-backup[101319]: node.session.nr_sessions = 1 Jul 03 09:47:38.158269 np0000004400 cinder-backup[101319]: node.session.auth.authmethod = None Jul 03 09:47:38.158269 np0000004400 cinder-backup[101319]: node.session.auth.username = Jul 03 09:47:38.158269 np0000004400 cinder-backup[101319]: node.session.auth.password = *** Jul 03 09:47:38.158269 np0000004400 cinder-backup[101319]: node.session.auth.username_in = Jul 03 09:47:38.158269 np0000004400 cinder-backup[101319]: node.session.auth.password_in = Jul 03 09:47:38.158269 np0000004400 cinder-backup[101319]: node.session.auth.chap_algs = SHA256 Jul 03 09:47:38.158269 np0000004400 cinder-backup[101319]: node.session.timeo.replacement_timeout = 120 Jul 03 09:47:38.158269 np0000004400 cinder-backup[101319]: node.session.err_timeo.abort_timeout = 15 Jul 03 09:47:38.158269 np0000004400 cinder-backup[101319]: node.session.err_timeo.lu_reset_timeout = 30 Jul 03 09:47:38.158269 np0000004400 cinder-backup[101319]: node.session.err_timeo.tgt_reset_timeout = 30 Jul 03 09:47:38.158269 np0000004400 cinder-backup[101319]: node.session.err_timeo.host_reset_timeout = 60 Jul 03 09:47:38.158269 np0000004400 cinder-backup[101319]: node.session.iscsi.FastAbort = Yes Jul 03 09:47:38.158269 np0000004400 cinder-backup[101319]: node.session.iscsi.InitialR2T = No Jul 03 09:47:38.158269 np0000004400 cinder-backup[101319]: node.session.iscsi.ImmediateData = Yes Jul 03 09:47:38.158269 np0000004400 cinder-backup[101319]: node.session.iscsi.FirstBurstLength = 262144 Jul 03 09:47:38.158269 np0000004400 cinder-backup[101319]: node.session.iscsi.MaxBurstLength = 16776192 Jul 03 09:47:38.158269 np0000004400 cinder-backup[101319]: node.session.iscsi.DefaultTime2Retain = 0 Jul 03 09:47:38.158269 np0000004400 cinder-backup[101319]: node.session.iscsi.DefaultTime2Wait = 2 Jul 03 09:47:38.158269 np0000004400 cinder-backup[101319]: node.session.iscsi.MaxConnections = 1 Jul 03 09:47:38.158269 np0000004400 cinder-backup[101319]: node.session.iscsi.MaxOutstandingR2T = 1 Jul 03 09:47:38.158269 np0000004400 cinder-backup[101319]: node.session.iscsi.ERL = 0 Jul 03 09:47:38.158269 np0000004400 cinder-backup[101319]: node.session.scan = auto Jul 03 09:47:38.158269 np0000004400 cinder-backup[101319]: node.session.reopen_max = 0 Jul 03 09:47:38.158269 np0000004400 cinder-backup[101319]: node.conn[0].address = 192.168.40.100 Jul 03 09:47:38.158269 np0000004400 cinder-backup[101319]: node.conn[0].port = 3260 Jul 03 09:47:38.158269 np0000004400 cinder-backup[101319]: node.conn[0].startup = manual Jul 03 09:47:38.158269 np0000004400 cinder-backup[101319]: node.conn[0].tcp.window_size = 524288 Jul 03 09:47:38.158269 np0000004400 cinder-backup[101319]: node.conn[0].tcp.type_of_service = 0 Jul 03 09:47:38.158269 np0000004400 cinder-backup[101319]: node.conn[0].timeo.logout_timeout = 15 Jul 03 09:47:38.158269 np0000004400 cinder-backup[101319]: node.conn[0].timeo.login_timeout = 15 Jul 03 09:47:38.158269 np0000004400 cinder-backup[101319]: node.conn[0].timeo.auth_timeout = 45 Jul 03 09:47:38.158269 np0000004400 cinder-backup[101319]: node.conn[0].timeo.noop_out_interval = 5 Jul 03 09:47:38.158269 np0000004400 cinder-backup[101319]: node.conn[0].timeo.noop_out_timeout = 5 Jul 03 09:47:38.158269 np0000004400 cinder-backup[101319]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0 Jul 03 09:47:38.158269 np0000004400 cinder-backup[101319]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144 Jul 03 09:47:38.158269 np0000004400 cinder-backup[101319]: node.conn[0].iscsi.HeaderDigest = None Jul 03 09:47:38.158269 np0000004400 cinder-backup[101319]: node.conn[0].iscsi.DataDigest = None Jul 03 09:47:38.158269 np0000004400 cinder-backup[101319]: node.conn[0].iscsi.IFMarker = No Jul 03 09:47:38.158269 np0000004400 cinder-backup[101319]: node.conn[0].iscsi.OFMarker = No Jul 03 09:47:38.158269 np0000004400 cinder-backup[101319]: # END RECORD Jul 03 09:47:38.158269 np0000004400 cinder-backup[101319]: stderr= {{(pid=101319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 03 09:47:38.170256 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-ff9a2cd5-68dc-4b82-8fd3-82fb094c7b84 tempest-VolumesBackupsTest-118275719 None] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=101319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 03 09:47:38.183592 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-ff9a2cd5-68dc-4b82-8fd3-82fb094c7b84 tempest-VolumesBackupsTest-118275719 None] iscsiadm ('-m', 'session'): stdout=tcp: [120] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8a0b1cfb-8ea1-46a0-aac3-b254107b98ef (non-flash) Jul 03 09:47:38.183592 np0000004400 cinder-backup[101319]: tcp: [121] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8a0b1cfb-8ea1-46a0-aac3-b254107b98ef (non-flash) Jul 03 09:47:38.183592 np0000004400 cinder-backup[101319]: tcp: [123] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9e9ca83c-acc7-4d33-b467-06911ac48096 (non-flash) Jul 03 09:47:38.183592 np0000004400 cinder-backup[101319]: tcp: [124] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9e9ca83c-acc7-4d33-b467-06911ac48096 (non-flash) Jul 03 09:47:38.183592 np0000004400 cinder-backup[101319]: tcp: [125] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-cecb2427-56d6-41d1-8f15-9cd5f07e9735 (non-flash) Jul 03 09:47:38.183592 np0000004400 cinder-backup[101319]: tcp: [126] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-cecb2427-56d6-41d1-8f15-9cd5f07e9735 (non-flash) Jul 03 09:47:38.183592 np0000004400 cinder-backup[101319]: stderr= {{(pid=101319) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jul 03 09:47:38.183787 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-ff9a2cd5-68dc-4b82-8fd3-82fb094c7b84 tempest-VolumesBackupsTest-118275719 None] iscsi session list stdout=tcp: [120] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8a0b1cfb-8ea1-46a0-aac3-b254107b98ef (non-flash) Jul 03 09:47:38.183787 np0000004400 cinder-backup[101319]: tcp: [121] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8a0b1cfb-8ea1-46a0-aac3-b254107b98ef (non-flash) Jul 03 09:47:38.183787 np0000004400 cinder-backup[101319]: tcp: [123] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9e9ca83c-acc7-4d33-b467-06911ac48096 (non-flash) Jul 03 09:47:38.183787 np0000004400 cinder-backup[101319]: tcp: [124] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9e9ca83c-acc7-4d33-b467-06911ac48096 (non-flash) Jul 03 09:47:38.183787 np0000004400 cinder-backup[101319]: tcp: [125] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-cecb2427-56d6-41d1-8f15-9cd5f07e9735 (non-flash) Jul 03 09:47:38.183787 np0000004400 cinder-backup[101319]: tcp: [126] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-cecb2427-56d6-41d1-8f15-9cd5f07e9735 (non-flash) Jul 03 09:47:38.183787 np0000004400 cinder-backup[101319]: stderr= {{(pid=101319) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jul 03 09:47:38.218728 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-ff9a2cd5-68dc-4b82-8fd3-82fb094c7b84 tempest-VolumesBackupsTest-118275719 None] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-25552aca-10fe-4ac0-affd-19717e76efc4, portal: 192.168.40.100,3260] Jul 03 09:47:38.218728 np0000004400 cinder-backup[101319]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-25552aca-10fe-4ac0-affd-19717e76efc4, portal: 192.168.40.100,3260] successful. Jul 03 09:47:38.218728 np0000004400 cinder-backup[101319]: stderr= {{(pid=101319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 03 09:47:38.231105 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-ff9a2cd5-68dc-4b82-8fd3-82fb094c7b84 tempest-VolumesBackupsTest-118275719 None] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=101319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 03 09:47:38.244775 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-ff9a2cd5-68dc-4b82-8fd3-82fb094c7b84 tempest-VolumesBackupsTest-118275719 None] iscsiadm ('-m', 'session'): stdout=tcp: [120] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8a0b1cfb-8ea1-46a0-aac3-b254107b98ef (non-flash) Jul 03 09:47:38.244775 np0000004400 cinder-backup[101319]: tcp: [121] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8a0b1cfb-8ea1-46a0-aac3-b254107b98ef (non-flash) Jul 03 09:47:38.244775 np0000004400 cinder-backup[101319]: tcp: [123] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9e9ca83c-acc7-4d33-b467-06911ac48096 (non-flash) Jul 03 09:47:38.244775 np0000004400 cinder-backup[101319]: tcp: [124] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9e9ca83c-acc7-4d33-b467-06911ac48096 (non-flash) Jul 03 09:47:38.244775 np0000004400 cinder-backup[101319]: tcp: [125] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-cecb2427-56d6-41d1-8f15-9cd5f07e9735 (non-flash) Jul 03 09:47:38.244775 np0000004400 cinder-backup[101319]: tcp: [126] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-cecb2427-56d6-41d1-8f15-9cd5f07e9735 (non-flash) Jul 03 09:47:38.244775 np0000004400 cinder-backup[101319]: tcp: [127] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-25552aca-10fe-4ac0-affd-19717e76efc4 (non-flash) Jul 03 09:47:38.244775 np0000004400 cinder-backup[101319]: stderr= {{(pid=101319) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jul 03 09:47:38.244976 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-ff9a2cd5-68dc-4b82-8fd3-82fb094c7b84 tempest-VolumesBackupsTest-118275719 None] iscsi session list stdout=tcp: [120] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8a0b1cfb-8ea1-46a0-aac3-b254107b98ef (non-flash) Jul 03 09:47:38.244976 np0000004400 cinder-backup[101319]: tcp: [121] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8a0b1cfb-8ea1-46a0-aac3-b254107b98ef (non-flash) Jul 03 09:47:38.244976 np0000004400 cinder-backup[101319]: tcp: [123] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9e9ca83c-acc7-4d33-b467-06911ac48096 (non-flash) Jul 03 09:47:38.244976 np0000004400 cinder-backup[101319]: tcp: [124] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9e9ca83c-acc7-4d33-b467-06911ac48096 (non-flash) Jul 03 09:47:38.244976 np0000004400 cinder-backup[101319]: tcp: [125] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-cecb2427-56d6-41d1-8f15-9cd5f07e9735 (non-flash) Jul 03 09:47:38.244976 np0000004400 cinder-backup[101319]: tcp: [126] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-cecb2427-56d6-41d1-8f15-9cd5f07e9735 (non-flash) Jul 03 09:47:38.244976 np0000004400 cinder-backup[101319]: tcp: [127] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-25552aca-10fe-4ac0-affd-19717e76efc4 (non-flash) Jul 03 09:47:38.244976 np0000004400 cinder-backup[101319]: stderr= {{(pid=101319) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jul 03 09:47:38.245251 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.base [None req-ff9a2cd5-68dc-4b82-8fd3-82fb094c7b84 tempest-VolumesBackupsTest-118275719 None] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-25552aca-10fe-4ac0-affd-19717e76efc4" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.122s {{(pid=101319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jul 03 09:47:38.245426 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-ff9a2cd5-68dc-4b82-8fd3-82fb094c7b84 tempest-VolumesBackupsTest-118275719 None] Connected to 192.168.40.100:3260 {{(pid=101319) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}} Jul 03 09:47:38.246212 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.linuxscsi [None req-ff9a2cd5-68dc-4b82-8fd3-82fb094c7b84 tempest-VolumesBackupsTest-118275719 None] HCTL ('13', '-', '-', 0) found on session 127 with lun 0 {{(pid=101319) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}} Jul 03 09:47:38.246336 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.linuxscsi [None req-ff9a2cd5-68dc-4b82-8fd3-82fb094c7b84 tempest-VolumesBackupsTest-118275719 None] Scanning host 13 c: -, t: -, l: 0) {{(pid=101319) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}} Jul 03 09:47:38.262907 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.linuxscsi [None req-ff9a2cd5-68dc-4b82-8fd3-82fb094c7b84 tempest-VolumesBackupsTest-118275719 None] Searching for a device in session 127 and hctl ['13', '*', '*', 0] yield: sdh {{(pid=101319) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}} Jul 03 09:47:38.263073 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-ff9a2cd5-68dc-4b82-8fd3-82fb094c7b84 tempest-VolumesBackupsTest-118275719 None] Connected to sdh using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-25552aca-10fe-4ac0-affd-19717e76efc4', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '25552aca-10fe-4ac0-affd-19717e76efc4', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': False} {{(pid=101319) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}} Jul 03 09:47:39.265658 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.base [None req-ff9a2cd5-68dc-4b82-8fd3-82fb094c7b84 tempest-VolumesBackupsTest-118275719 None] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 2.154s {{(pid=101319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jul 03 09:47:39.266088 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-ff9a2cd5-68dc-4b82-8fd3-82fb094c7b84 tempest-VolumesBackupsTest-118275719 None] <== connect_volume: return (4622ms) {'type': 'block', 'scsi_wwn': 'SStorPool_iSCSI_DISK_1034578903445799090', 'path': '/dev/sdh'} {{(pid=101319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}} Jul 03 09:47:39.266486 np0000004400 cinder-backup[101319]: DEBUG oslo_concurrency.processutils [None req-ff9a2cd5-68dc-4b82-8fd3-82fb094c7b84 tempest-VolumesBackupsTest-118275719 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chown 1002 /dev/sdh {{(pid=101319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 09:47:39.275978 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.base [None req-ff8d1fd5-0609-46f4-aa85-d9226f0ecff8 tempest-VolumesBackupsTest-2142009639 None] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 3.070s {{(pid=101319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jul 03 09:47:39.276612 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.base [None req-ff8d1fd5-0609-46f4-aa85-d9226f0ecff8 tempest-VolumesBackupsTest-2142009639 None] Connection properties {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-7ec8624e-70c1-4cb2-bb18-1a0e48d27629', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '7ec8624e-70c1-4cb2-bb18-1a0e48d27629', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': False} {{(pid=101319) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}} Jul 03 09:47:39.285586 np0000004400 sudo[141524]: stack : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chown 1002 /dev/sdh Jul 03 09:47:39.286203 np0000004400 sudo[141524]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1002) Jul 03 09:47:39.288080 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.base [None req-ff8d1fd5-0609-46f4-aa85-d9226f0ecff8 tempest-VolumesBackupsTest-2142009639 None] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-7ec8624e-70c1-4cb2-bb18-1a0e48d27629" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=101319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jul 03 09:47:39.288611 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.base [None req-ff8d1fd5-0609-46f4-aa85-d9226f0ecff8 tempest-VolumesBackupsTest-2142009639 None] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-7ec8624e-70c1-4cb2-bb18-1a0e48d27629" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=101319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jul 03 09:47:39.288863 np0000004400 cinder-backup[101319]: INFO os_brick.initiator.connectors.iscsi [None req-ff8d1fd5-0609-46f4-aa85-d9226f0ecff8 tempest-VolumesBackupsTest-2142009639 None] Trying to connect to iSCSI portal 192.168.40.100:3260 Jul 03 09:47:39.300441 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-ff8d1fd5-0609-46f4-aa85-d9226f0ecff8 tempest-VolumesBackupsTest-2142009639 None] iscsiadm (): stdout= stderr=iscsiadm: No records found Jul 03 09:47:39.300441 np0000004400 cinder-backup[101319]: {{(pid=101319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 03 09:47:39.311165 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-ff8d1fd5-0609-46f4-aa85-d9226f0ecff8 tempest-VolumesBackupsTest-2142009639 None] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-7ec8624e-70c1-4cb2-bb18-1a0e48d27629] added Jul 03 09:47:39.311165 np0000004400 cinder-backup[101319]: stderr=iscsiadm: Config file line 363 does not have value Jul 03 09:47:39.311165 np0000004400 cinder-backup[101319]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs' Jul 03 09:47:39.311165 np0000004400 cinder-backup[101319]: iscsiadm: Config file line 363 does not have value Jul 03 09:47:39.311165 np0000004400 cinder-backup[101319]: iscsiadm: Config file line 363 does not have value Jul 03 09:47:39.311165 np0000004400 cinder-backup[101319]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs' Jul 03 09:47:39.311165 np0000004400 cinder-backup[101319]: {{(pid=101319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 03 09:47:39.311416 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-ff8d1fd5-0609-46f4-aa85-d9226f0ecff8 tempest-VolumesBackupsTest-2142009639 None] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=101319) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}} Jul 03 09:47:39.311984 np0000004400 cinder-backup[101319]: DEBUG os_brick.utils [None req-ff8d1fd5-0609-46f4-aa85-d9226f0ecff8 tempest-VolumesBackupsTest-2142009639 None] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.023(s), this was the 1st time calling it. {{(pid=101319) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}} Jul 03 09:47:39.312176 np0000004400 cinder-backup[101319]: DEBUG os_brick.utils [None req-ff8d1fd5-0609-46f4-aa85-d9226f0ecff8 tempest-VolumesBackupsTest-2142009639 None] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=101319) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}} Jul 03 09:47:39.572441 np0000004400 sudo[141524]: pam_unix(sudo:session): session closed for user root Jul 03 09:47:39.574022 np0000004400 cinder-backup[101319]: DEBUG oslo_concurrency.processutils [None req-ff9a2cd5-68dc-4b82-8fd3-82fb094c7b84 tempest-VolumesBackupsTest-118275719 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chown 1002 /dev/sdh" returned: 0 in 0.308s {{(pid=101319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 09:47:39.610809 np0000004400 cinder-backup[101319]: DEBUG oslo_db.sqlalchemy.engines [None req-ff9a2cd5-68dc-4b82-8fd3-82fb094c7b84 tempest-VolumesBackupsTest-118275719 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=101319) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 03 09:47:39.616182 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-ff9a2cd5-68dc-4b82-8fd3-82fb094c7b84 tempest-VolumesBackupsTest-118275719 None] _create_container started, container: volumebackups,backup: 06482a6e-a410-44d6-85cf-84392df124bc. {{(pid=101319) _create_container /opt/stack/cinder/cinder/backup/chunkeddriver.py:249}} Jul 03 09:47:39.664789 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.drivers.swift [None req-ff9a2cd5-68dc-4b82-8fd3-82fb094c7b84 tempest-VolumesBackupsTest-118275719 None] generate_object_name_prefix: volume_e49954d5-d017-43d5-8565-25ce9e2693f9/20260703094739/az_nova_backup_06482a6e-a410-44d6-85cf-84392df124bc {{(pid=101319) _generate_object_name_prefix /opt/stack/cinder/cinder/backup/drivers/swift.py:452}} Jul 03 09:47:39.676668 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-ff9a2cd5-68dc-4b82-8fd3-82fb094c7b84 tempest-VolumesBackupsTest-118275719 None] starting backup of volume: e49954d5-d017-43d5-8565-25ce9e2693f9, volume size: 1073741824, object names prefix volume_e49954d5-d017-43d5-8565-25ce9e2693f9/20260703094739/az_nova_backup_06482a6e-a410-44d6-85cf-84392df124bc, availability zone: nova {{(pid=101319) _prepare_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:359}} Jul 03 09:47:39.856317 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-ff9a2cd5-68dc-4b82-8fd3-82fb094c7b84 tempest-VolumesBackupsTest-118275719 None] Backing up chunk of data from volume. {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 09:47:40.106501 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-ff9a2cd5-68dc-4b82-8fd3-82fb094c7b84 tempest-VolumesBackupsTest-118275719 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101319) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 09:47:40.106623 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-ff9a2cd5-68dc-4b82-8fd3-82fb094c7b84 tempest-VolumesBackupsTest-118275719 None] About to put_object {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 09:47:40.207243 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-ff9a2cd5-68dc-4b82-8fd3-82fb094c7b84 tempest-VolumesBackupsTest-118275719 None] backup MD5 for volume_e49954d5-d017-43d5-8565-25ce9e2693f9/20260703094739/az_nova_backup_06482a6e-a410-44d6-85cf-84392df124bc-00001: 25e317773f308e446cc84c503a6d1f85 {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 09:47:40.207436 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-ff9a2cd5-68dc-4b82-8fd3-82fb094c7b84 tempest-VolumesBackupsTest-118275719 None] Calling eventlet.sleep(0) {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 09:47:40.314082 np0000004400 cinder-backup[101319]: INFO os_brick.initiator.connectors.iscsi [None req-ff8d1fd5-0609-46f4-aa85-d9226f0ecff8 tempest-VolumesBackupsTest-2142009639 None] Trying to connect to iSCSI portal 192.168.40.100:3260 Jul 03 09:47:40.326895 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-ff8d1fd5-0609-46f4-aa85-d9226f0ecff8 tempest-VolumesBackupsTest-2142009639 None] iscsiadm (): stdout=# BEGIN RECORD 2.1.9 Jul 03 09:47:40.326895 np0000004400 cinder-backup[101319]: node.name = iqn.2023-03.storpool.com:os--volume-7ec8624e-70c1-4cb2-bb18-1a0e48d27629 Jul 03 09:47:40.326895 np0000004400 cinder-backup[101319]: node.tpgt = -1 Jul 03 09:47:40.326895 np0000004400 cinder-backup[101319]: node.startup = manual Jul 03 09:47:40.326895 np0000004400 cinder-backup[101319]: node.leading_login = No Jul 03 09:47:40.326895 np0000004400 cinder-backup[101319]: iface.iscsi_ifacename = default Jul 03 09:47:40.326895 np0000004400 cinder-backup[101319]: iface.net_ifacename = Jul 03 09:47:40.326895 np0000004400 cinder-backup[101319]: iface.ipaddress = Jul 03 09:47:40.326895 np0000004400 cinder-backup[101319]: iface.prefix_len = 0 Jul 03 09:47:40.326895 np0000004400 cinder-backup[101319]: iface.hwaddress = Jul 03 09:47:40.326895 np0000004400 cinder-backup[101319]: iface.transport_name = tcp Jul 03 09:47:40.326895 np0000004400 cinder-backup[101319]: iface.initiatorname = Jul 03 09:47:40.326895 np0000004400 cinder-backup[101319]: iface.state = Jul 03 09:47:40.326895 np0000004400 cinder-backup[101319]: iface.vlan_id = 0 Jul 03 09:47:40.326895 np0000004400 cinder-backup[101319]: iface.vlan_priority = 0 Jul 03 09:47:40.326895 np0000004400 cinder-backup[101319]: iface.vlan_state = Jul 03 09:47:40.326895 np0000004400 cinder-backup[101319]: iface.iface_num = 0 Jul 03 09:47:40.326895 np0000004400 cinder-backup[101319]: iface.mtu = 0 Jul 03 09:47:40.326895 np0000004400 cinder-backup[101319]: iface.port = 0 Jul 03 09:47:40.326895 np0000004400 cinder-backup[101319]: iface.bootproto = Jul 03 09:47:40.326895 np0000004400 cinder-backup[101319]: iface.subnet_mask = Jul 03 09:47:40.326895 np0000004400 cinder-backup[101319]: iface.gateway = Jul 03 09:47:40.326895 np0000004400 cinder-backup[101319]: iface.dhcp_alt_client_id_state = Jul 03 09:47:40.326895 np0000004400 cinder-backup[101319]: iface.dhcp_alt_client_id = Jul 03 09:47:40.326895 np0000004400 cinder-backup[101319]: iface.dhcp_dns = Jul 03 09:47:40.326895 np0000004400 cinder-backup[101319]: iface.dhcp_learn_iqn = Jul 03 09:47:40.326895 np0000004400 cinder-backup[101319]: iface.dhcp_req_vendor_id_state = Jul 03 09:47:40.326895 np0000004400 cinder-backup[101319]: iface.dhcp_vendor_id_state = Jul 03 09:47:40.326895 np0000004400 cinder-backup[101319]: iface.dhcp_vendor_id = Jul 03 09:47:40.326895 np0000004400 cinder-backup[101319]: iface.dhcp_slp_da = Jul 03 09:47:40.326895 np0000004400 cinder-backup[101319]: iface.fragmentation = Jul 03 09:47:40.326895 np0000004400 cinder-backup[101319]: iface.gratuitous_arp = Jul 03 09:47:40.326895 np0000004400 cinder-backup[101319]: iface.incoming_forwarding = Jul 03 09:47:40.326895 np0000004400 cinder-backup[101319]: iface.tos_state = Jul 03 09:47:40.326895 np0000004400 cinder-backup[101319]: iface.tos = 0 Jul 03 09:47:40.326895 np0000004400 cinder-backup[101319]: iface.ttl = 0 Jul 03 09:47:40.326895 np0000004400 cinder-backup[101319]: iface.delayed_ack = Jul 03 09:47:40.326895 np0000004400 cinder-backup[101319]: iface.tcp_nagle = Jul 03 09:47:40.326895 np0000004400 cinder-backup[101319]: iface.tcp_wsf_state = Jul 03 09:47:40.326895 np0000004400 cinder-backup[101319]: iface.tcp_wsf = 0 Jul 03 09:47:40.326895 np0000004400 cinder-backup[101319]: iface.tcp_timer_scale = 0 Jul 03 09:47:40.326895 np0000004400 cinder-backup[101319]: iface.tcp_timestamp = Jul 03 09:47:40.326895 np0000004400 cinder-backup[101319]: iface.redirect = Jul 03 09:47:40.326895 np0000004400 cinder-backup[101319]: iface.def_task_mgmt_timeout = 0 Jul 03 09:47:40.326895 np0000004400 cinder-backup[101319]: iface.header_digest = Jul 03 09:47:40.326895 np0000004400 cinder-backup[101319]: iface.data_digest = Jul 03 09:47:40.326895 np0000004400 cinder-backup[101319]: iface.immediate_data = Jul 03 09:47:40.326895 np0000004400 cinder-backup[101319]: iface.initial_r2t = Jul 03 09:47:40.326895 np0000004400 cinder-backup[101319]: iface.data_seq_inorder = Jul 03 09:47:40.326895 np0000004400 cinder-backup[101319]: iface.data_pdu_inorder = Jul 03 09:47:40.326895 np0000004400 cinder-backup[101319]: iface.erl = 0 Jul 03 09:47:40.326895 np0000004400 cinder-backup[101319]: iface.max_receive_data_len = 0 Jul 03 09:47:40.326895 np0000004400 cinder-backup[101319]: iface.first_burst_len = 0 Jul 03 09:47:40.326895 np0000004400 cinder-backup[101319]: iface.max_outstanding_r2t = 0 Jul 03 09:47:40.326895 np0000004400 cinder-backup[101319]: iface.max_burst_len = 0 Jul 03 09:47:40.326895 np0000004400 cinder-backup[101319]: iface.chap_auth = Jul 03 09:47:40.326895 np0000004400 cinder-backup[101319]: iface.bidi_chap = Jul 03 09:47:40.326895 np0000004400 cinder-backup[101319]: iface.strict_login_compliance = Jul 03 09:47:40.326895 np0000004400 cinder-backup[101319]: iface.discovery_auth = Jul 03 09:47:40.326895 np0000004400 cinder-backup[101319]: iface.discovery_logout = Jul 03 09:47:40.326895 np0000004400 cinder-backup[101319]: node.discovery_address = Jul 03 09:47:40.326895 np0000004400 cinder-backup[101319]: node.discovery_port = 0 Jul 03 09:47:40.326895 np0000004400 cinder-backup[101319]: node.discovery_type = fw Jul 03 09:47:40.326895 np0000004400 cinder-backup[101319]: node.session.initial_cmdsn = 0 Jul 03 09:47:40.326895 np0000004400 cinder-backup[101319]: node.session.initial_login_retry_max = 8 Jul 03 09:47:40.326895 np0000004400 cinder-backup[101319]: node.session.xmit_thread_priority = 0 Jul 03 09:47:40.326895 np0000004400 cinder-backup[101319]: node.session.cmds_max = 128 Jul 03 09:47:40.326895 np0000004400 cinder-backup[101319]: node.session.queue_depth = 32 Jul 03 09:47:40.326895 np0000004400 cinder-backup[101319]: node.session.nr_sessions = 1 Jul 03 09:47:40.326895 np0000004400 cinder-backup[101319]: node.session.auth.authmethod = None Jul 03 09:47:40.326895 np0000004400 cinder-backup[101319]: node.session.auth.username = Jul 03 09:47:40.326895 np0000004400 cinder-backup[101319]: node.session.auth.password = *** Jul 03 09:47:40.326895 np0000004400 cinder-backup[101319]: node.session.auth.username_in = Jul 03 09:47:40.326895 np0000004400 cinder-backup[101319]: node.session.auth.password_in = Jul 03 09:47:40.326895 np0000004400 cinder-backup[101319]: node.session.auth.chap_algs = SHA256 Jul 03 09:47:40.326895 np0000004400 cinder-backup[101319]: node.session.timeo.replacement_timeout = 120 Jul 03 09:47:40.326895 np0000004400 cinder-backup[101319]: node.session.err_timeo.abort_timeout = 15 Jul 03 09:47:40.326895 np0000004400 cinder-backup[101319]: node.session.err_timeo.lu_reset_timeout = 30 Jul 03 09:47:40.326895 np0000004400 cinder-backup[101319]: node.session.err_timeo.tgt_reset_timeout = 30 Jul 03 09:47:40.326895 np0000004400 cinder-backup[101319]: node.session.err_timeo.host_reset_timeout = 60 Jul 03 09:47:40.326895 np0000004400 cinder-backup[101319]: node.session.iscsi.FastAbort = Yes Jul 03 09:47:40.326895 np0000004400 cinder-backup[101319]: node.session.iscsi.InitialR2T = No Jul 03 09:47:40.326895 np0000004400 cinder-backup[101319]: node.session.iscsi.ImmediateData = Yes Jul 03 09:47:40.326895 np0000004400 cinder-backup[101319]: node.session.iscsi.FirstBurstLength = 262144 Jul 03 09:47:40.326895 np0000004400 cinder-backup[101319]: node.session.iscsi.MaxBurstLength = 16776192 Jul 03 09:47:40.326895 np0000004400 cinder-backup[101319]: node.session.iscsi.DefaultTime2Retain = 0 Jul 03 09:47:40.326895 np0000004400 cinder-backup[101319]: node.session.iscsi.DefaultTime2Wait = 2 Jul 03 09:47:40.326895 np0000004400 cinder-backup[101319]: node.session.iscsi.MaxConnections = 1 Jul 03 09:47:40.326895 np0000004400 cinder-backup[101319]: node.session.iscsi.MaxOutstandingR2T = 1 Jul 03 09:47:40.326895 np0000004400 cinder-backup[101319]: node.session.iscsi.ERL = 0 Jul 03 09:47:40.326895 np0000004400 cinder-backup[101319]: node.session.scan = auto Jul 03 09:47:40.326895 np0000004400 cinder-backup[101319]: node.session.reopen_max = 0 Jul 03 09:47:40.326895 np0000004400 cinder-backup[101319]: node.conn[0].address = 192.168.40.100 Jul 03 09:47:40.326895 np0000004400 cinder-backup[101319]: node.conn[0].port = 3260 Jul 03 09:47:40.326895 np0000004400 cinder-backup[101319]: node.conn[0].startup = manual Jul 03 09:47:40.326895 np0000004400 cinder-backup[101319]: node.conn[0].tcp.window_size = 524288 Jul 03 09:47:40.326895 np0000004400 cinder-backup[101319]: node.conn[0].tcp.type_of_service = 0 Jul 03 09:47:40.326895 np0000004400 cinder-backup[101319]: node.conn[0].timeo.logout_timeout = 15 Jul 03 09:47:40.326895 np0000004400 cinder-backup[101319]: node.conn[0].timeo.login_timeout = 15 Jul 03 09:47:40.326895 np0000004400 cinder-backup[101319]: node.conn[0].timeo.auth_timeout = 45 Jul 03 09:47:40.326895 np0000004400 cinder-backup[101319]: node.conn[0].timeo.noop_out_interval = 5 Jul 03 09:47:40.326895 np0000004400 cinder-backup[101319]: node.conn[0].timeo.noop_out_timeout = 5 Jul 03 09:47:40.326895 np0000004400 cinder-backup[101319]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0 Jul 03 09:47:40.326895 np0000004400 cinder-backup[101319]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144 Jul 03 09:47:40.326895 np0000004400 cinder-backup[101319]: node.conn[0].iscsi.HeaderDigest = None Jul 03 09:47:40.326895 np0000004400 cinder-backup[101319]: node.conn[0].iscsi.DataDigest = None Jul 03 09:47:40.326895 np0000004400 cinder-backup[101319]: node.conn[0].iscsi.IFMarker = No Jul 03 09:47:40.326895 np0000004400 cinder-backup[101319]: node.conn[0].iscsi.OFMarker = No Jul 03 09:47:40.326895 np0000004400 cinder-backup[101319]: # END RECORD Jul 03 09:47:40.326895 np0000004400 cinder-backup[101319]: stderr= {{(pid=101319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 03 09:47:40.338872 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-ff8d1fd5-0609-46f4-aa85-d9226f0ecff8 tempest-VolumesBackupsTest-2142009639 None] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=101319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 03 09:47:40.352854 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-ff8d1fd5-0609-46f4-aa85-d9226f0ecff8 tempest-VolumesBackupsTest-2142009639 None] iscsiadm ('-m', 'session'): stdout=tcp: [120] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8a0b1cfb-8ea1-46a0-aac3-b254107b98ef (non-flash) Jul 03 09:47:40.352854 np0000004400 cinder-backup[101319]: tcp: [121] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8a0b1cfb-8ea1-46a0-aac3-b254107b98ef (non-flash) Jul 03 09:47:40.352854 np0000004400 cinder-backup[101319]: tcp: [123] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9e9ca83c-acc7-4d33-b467-06911ac48096 (non-flash) Jul 03 09:47:40.352854 np0000004400 cinder-backup[101319]: tcp: [124] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9e9ca83c-acc7-4d33-b467-06911ac48096 (non-flash) Jul 03 09:47:40.352854 np0000004400 cinder-backup[101319]: tcp: [125] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-cecb2427-56d6-41d1-8f15-9cd5f07e9735 (non-flash) Jul 03 09:47:40.352854 np0000004400 cinder-backup[101319]: tcp: [126] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-cecb2427-56d6-41d1-8f15-9cd5f07e9735 (non-flash) Jul 03 09:47:40.352854 np0000004400 cinder-backup[101319]: tcp: [127] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-25552aca-10fe-4ac0-affd-19717e76efc4 (non-flash) Jul 03 09:47:40.352854 np0000004400 cinder-backup[101319]: stderr= {{(pid=101319) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jul 03 09:47:40.353144 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-ff8d1fd5-0609-46f4-aa85-d9226f0ecff8 tempest-VolumesBackupsTest-2142009639 None] iscsi session list stdout=tcp: [120] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8a0b1cfb-8ea1-46a0-aac3-b254107b98ef (non-flash) Jul 03 09:47:40.353144 np0000004400 cinder-backup[101319]: tcp: [121] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8a0b1cfb-8ea1-46a0-aac3-b254107b98ef (non-flash) Jul 03 09:47:40.353144 np0000004400 cinder-backup[101319]: tcp: [123] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9e9ca83c-acc7-4d33-b467-06911ac48096 (non-flash) Jul 03 09:47:40.353144 np0000004400 cinder-backup[101319]: tcp: [124] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9e9ca83c-acc7-4d33-b467-06911ac48096 (non-flash) Jul 03 09:47:40.353144 np0000004400 cinder-backup[101319]: tcp: [125] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-cecb2427-56d6-41d1-8f15-9cd5f07e9735 (non-flash) Jul 03 09:47:40.353144 np0000004400 cinder-backup[101319]: tcp: [126] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-cecb2427-56d6-41d1-8f15-9cd5f07e9735 (non-flash) Jul 03 09:47:40.353144 np0000004400 cinder-backup[101319]: tcp: [127] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-25552aca-10fe-4ac0-affd-19717e76efc4 (non-flash) Jul 03 09:47:40.353144 np0000004400 cinder-backup[101319]: stderr= {{(pid=101319) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jul 03 09:47:40.368451 np0000004400 cinder-backup[101319]: DEBUG oslo_service.periodic_task [None req-ffd932d2-122c-4e68-b5ba-628aff7ae7b8 None None] Running periodic task BackupManager.publish_service_capabilities {{(pid=101319) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 03 09:47:40.371672 np0000004400 cinder-backup[101319]: DEBUG cinder.manager [None req-ffd932d2-122c-4e68-b5ba-628aff7ae7b8 None None] Notifying Schedulers of capabilities ... {{(pid=101319) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 03 09:47:40.405014 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-ff8d1fd5-0609-46f4-aa85-d9226f0ecff8 tempest-VolumesBackupsTest-2142009639 None] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-7ec8624e-70c1-4cb2-bb18-1a0e48d27629, portal: 192.168.40.100,3260] Jul 03 09:47:40.405014 np0000004400 cinder-backup[101319]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-7ec8624e-70c1-4cb2-bb18-1a0e48d27629, portal: 192.168.40.100,3260] successful. Jul 03 09:47:40.405014 np0000004400 cinder-backup[101319]: stderr= {{(pid=101319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 03 09:47:40.407869 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-ff9a2cd5-68dc-4b82-8fd3-82fb094c7b84 tempest-VolumesBackupsTest-118275719 None] Backing up chunk of data from volume. {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 09:47:40.417425 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-ff8d1fd5-0609-46f4-aa85-d9226f0ecff8 tempest-VolumesBackupsTest-2142009639 None] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=101319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 03 09:47:40.431715 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-ff8d1fd5-0609-46f4-aa85-d9226f0ecff8 tempest-VolumesBackupsTest-2142009639 None] iscsiadm ('-m', 'session'): stdout=tcp: [120] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8a0b1cfb-8ea1-46a0-aac3-b254107b98ef (non-flash) Jul 03 09:47:40.431715 np0000004400 cinder-backup[101319]: tcp: [121] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8a0b1cfb-8ea1-46a0-aac3-b254107b98ef (non-flash) Jul 03 09:47:40.431715 np0000004400 cinder-backup[101319]: tcp: [123] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9e9ca83c-acc7-4d33-b467-06911ac48096 (non-flash) Jul 03 09:47:40.431715 np0000004400 cinder-backup[101319]: tcp: [124] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9e9ca83c-acc7-4d33-b467-06911ac48096 (non-flash) Jul 03 09:47:40.431715 np0000004400 cinder-backup[101319]: tcp: [125] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-cecb2427-56d6-41d1-8f15-9cd5f07e9735 (non-flash) Jul 03 09:47:40.431715 np0000004400 cinder-backup[101319]: tcp: [126] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-cecb2427-56d6-41d1-8f15-9cd5f07e9735 (non-flash) Jul 03 09:47:40.431715 np0000004400 cinder-backup[101319]: tcp: [127] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-25552aca-10fe-4ac0-affd-19717e76efc4 (non-flash) Jul 03 09:47:40.431715 np0000004400 cinder-backup[101319]: tcp: [128] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7ec8624e-70c1-4cb2-bb18-1a0e48d27629 (non-flash) Jul 03 09:47:40.431715 np0000004400 cinder-backup[101319]: stderr= {{(pid=101319) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jul 03 09:47:40.432001 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-ff8d1fd5-0609-46f4-aa85-d9226f0ecff8 tempest-VolumesBackupsTest-2142009639 None] iscsi session list stdout=tcp: [120] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8a0b1cfb-8ea1-46a0-aac3-b254107b98ef (non-flash) Jul 03 09:47:40.432001 np0000004400 cinder-backup[101319]: tcp: [121] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8a0b1cfb-8ea1-46a0-aac3-b254107b98ef (non-flash) Jul 03 09:47:40.432001 np0000004400 cinder-backup[101319]: tcp: [123] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9e9ca83c-acc7-4d33-b467-06911ac48096 (non-flash) Jul 03 09:47:40.432001 np0000004400 cinder-backup[101319]: tcp: [124] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9e9ca83c-acc7-4d33-b467-06911ac48096 (non-flash) Jul 03 09:47:40.432001 np0000004400 cinder-backup[101319]: tcp: [125] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-cecb2427-56d6-41d1-8f15-9cd5f07e9735 (non-flash) Jul 03 09:47:40.432001 np0000004400 cinder-backup[101319]: tcp: [126] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-cecb2427-56d6-41d1-8f15-9cd5f07e9735 (non-flash) Jul 03 09:47:40.432001 np0000004400 cinder-backup[101319]: tcp: [127] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-25552aca-10fe-4ac0-affd-19717e76efc4 (non-flash) Jul 03 09:47:40.432001 np0000004400 cinder-backup[101319]: tcp: [128] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7ec8624e-70c1-4cb2-bb18-1a0e48d27629 (non-flash) Jul 03 09:47:40.432001 np0000004400 cinder-backup[101319]: stderr= {{(pid=101319) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jul 03 09:47:40.432260 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.base [None req-ff8d1fd5-0609-46f4-aa85-d9226f0ecff8 tempest-VolumesBackupsTest-2142009639 None] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-7ec8624e-70c1-4cb2-bb18-1a0e48d27629" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.144s {{(pid=101319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jul 03 09:47:40.432337 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-ff8d1fd5-0609-46f4-aa85-d9226f0ecff8 tempest-VolumesBackupsTest-2142009639 None] Connected to 192.168.40.100:3260 {{(pid=101319) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}} Jul 03 09:47:40.433218 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.linuxscsi [None req-ff8d1fd5-0609-46f4-aa85-d9226f0ecff8 tempest-VolumesBackupsTest-2142009639 None] HCTL ('14', '-', '-', 0) found on session 128 with lun 0 {{(pid=101319) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}} Jul 03 09:47:40.433338 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.linuxscsi [None req-ff8d1fd5-0609-46f4-aa85-d9226f0ecff8 tempest-VolumesBackupsTest-2142009639 None] Scanning host 14 c: -, t: -, l: 0) {{(pid=101319) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}} Jul 03 09:47:40.450947 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.linuxscsi [None req-ff8d1fd5-0609-46f4-aa85-d9226f0ecff8 tempest-VolumesBackupsTest-2142009639 None] Searching for a device in session 128 and hctl ['14', '*', '*', 0] yield: sdi {{(pid=101319) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}} Jul 03 09:47:40.451177 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-ff8d1fd5-0609-46f4-aa85-d9226f0ecff8 tempest-VolumesBackupsTest-2142009639 None] Connected to sdi using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-7ec8624e-70c1-4cb2-bb18-1a0e48d27629', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '7ec8624e-70c1-4cb2-bb18-1a0e48d27629', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': False} {{(pid=101319) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}} Jul 03 09:47:40.661982 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-ff9a2cd5-68dc-4b82-8fd3-82fb094c7b84 tempest-VolumesBackupsTest-118275719 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101319) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 09:47:40.662155 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-ff9a2cd5-68dc-4b82-8fd3-82fb094c7b84 tempest-VolumesBackupsTest-118275719 None] About to put_object {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 09:47:40.765600 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-ff9a2cd5-68dc-4b82-8fd3-82fb094c7b84 tempest-VolumesBackupsTest-118275719 None] backup MD5 for volume_e49954d5-d017-43d5-8565-25ce9e2693f9/20260703094739/az_nova_backup_06482a6e-a410-44d6-85cf-84392df124bc-00002: 25e317773f308e446cc84c503a6d1f85 {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 09:47:40.765792 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-ff9a2cd5-68dc-4b82-8fd3-82fb094c7b84 tempest-VolumesBackupsTest-118275719 None] Calling eventlet.sleep(0) {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 09:47:40.947180 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-ff9a2cd5-68dc-4b82-8fd3-82fb094c7b84 tempest-VolumesBackupsTest-118275719 None] Backing up chunk of data from volume. {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 09:47:41.186000 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-ff9a2cd5-68dc-4b82-8fd3-82fb094c7b84 tempest-VolumesBackupsTest-118275719 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101319) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 09:47:41.186190 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-ff9a2cd5-68dc-4b82-8fd3-82fb094c7b84 tempest-VolumesBackupsTest-118275719 None] About to put_object {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 09:47:41.281462 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-ff9a2cd5-68dc-4b82-8fd3-82fb094c7b84 tempest-VolumesBackupsTest-118275719 None] backup MD5 for volume_e49954d5-d017-43d5-8565-25ce9e2693f9/20260703094739/az_nova_backup_06482a6e-a410-44d6-85cf-84392df124bc-00003: 25e317773f308e446cc84c503a6d1f85 {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 09:47:41.281659 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-ff9a2cd5-68dc-4b82-8fd3-82fb094c7b84 tempest-VolumesBackupsTest-118275719 None] Calling eventlet.sleep(0) {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 09:47:41.457159 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.base [None req-ff8d1fd5-0609-46f4-aa85-d9226f0ecff8 tempest-VolumesBackupsTest-2142009639 None] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 2.182s {{(pid=101319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jul 03 09:47:41.457526 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-ff8d1fd5-0609-46f4-aa85-d9226f0ecff8 tempest-VolumesBackupsTest-2142009639 None] <== connect_volume: return (5252ms) {'type': 'block', 'scsi_wwn': '3300000004d97aa9b', 'path': '/dev/sdi'} {{(pid=101319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}} Jul 03 09:47:41.457765 np0000004400 cinder-backup[101319]: DEBUG oslo_concurrency.processutils [None req-ff8d1fd5-0609-46f4-aa85-d9226f0ecff8 tempest-VolumesBackupsTest-2142009639 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chown 1002 /dev/sdi {{(pid=101319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 09:47:41.470103 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-ff9a2cd5-68dc-4b82-8fd3-82fb094c7b84 tempest-VolumesBackupsTest-118275719 None] Backing up chunk of data from volume. {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 09:47:41.478808 np0000004400 sudo[141591]: stack : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chown 1002 /dev/sdi Jul 03 09:47:41.479420 np0000004400 sudo[141591]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1002) Jul 03 09:47:41.722396 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-ff9a2cd5-68dc-4b82-8fd3-82fb094c7b84 tempest-VolumesBackupsTest-118275719 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101319) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 09:47:41.723206 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-ff9a2cd5-68dc-4b82-8fd3-82fb094c7b84 tempest-VolumesBackupsTest-118275719 None] About to put_object {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 09:47:41.795467 np0000004400 sudo[141591]: pam_unix(sudo:session): session closed for user root Jul 03 09:47:41.797093 np0000004400 cinder-backup[101319]: DEBUG oslo_concurrency.processutils [None req-ff8d1fd5-0609-46f4-aa85-d9226f0ecff8 tempest-VolumesBackupsTest-2142009639 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chown 1002 /dev/sdi" returned: 0 in 0.339s {{(pid=101319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 09:47:41.803367 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-ff8d1fd5-0609-46f4-aa85-d9226f0ecff8 tempest-VolumesBackupsTest-2142009639 None] _read_sha256file started, container name: tempest-volumesbackupstest-backup-container-106419071, sha256 filename: volume_8a0b1cfb-8ea1-46a0-aac3-b254107b98ef/20260703094720/az_nova_backup_86118233-3d57-47ad-8781-cab6c54e4d53_sha256file. {{(pid=101319) _read_sha256file /opt/stack/cinder/cinder/backup/chunkeddriver.py:333}} Jul 03 09:47:41.842714 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-ff8d1fd5-0609-46f4-aa85-d9226f0ecff8 tempest-VolumesBackupsTest-2142009639 None] _read_sha256file finished. {{(pid=101319) _read_sha256file /opt/stack/cinder/cinder/backup/chunkeddriver.py:340}} Jul 03 09:47:41.849309 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-ff8d1fd5-0609-46f4-aa85-d9226f0ecff8 tempest-VolumesBackupsTest-2142009639 None] _create_container started, container: volumebackups,backup: b1aa5ad9-985a-4f8b-a2fb-778a315501a9. {{(pid=101319) _create_container /opt/stack/cinder/cinder/backup/chunkeddriver.py:249}} Jul 03 09:47:41.852419 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-ff9a2cd5-68dc-4b82-8fd3-82fb094c7b84 tempest-VolumesBackupsTest-118275719 None] backup MD5 for volume_e49954d5-d017-43d5-8565-25ce9e2693f9/20260703094739/az_nova_backup_06482a6e-a410-44d6-85cf-84392df124bc-00004: 25e317773f308e446cc84c503a6d1f85 {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 09:47:41.852419 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-ff9a2cd5-68dc-4b82-8fd3-82fb094c7b84 tempest-VolumesBackupsTest-118275719 None] Calling eventlet.sleep(0) {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 09:47:41.930534 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.drivers.swift [None req-ff8d1fd5-0609-46f4-aa85-d9226f0ecff8 tempest-VolumesBackupsTest-2142009639 None] generate_object_name_prefix: volume_8a0b1cfb-8ea1-46a0-aac3-b254107b98ef/20260703094741/az_nova_backup_b1aa5ad9-985a-4f8b-a2fb-778a315501a9 {{(pid=101319) _generate_object_name_prefix /opt/stack/cinder/cinder/backup/drivers/swift.py:452}} Jul 03 09:47:41.940000 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-ff8d1fd5-0609-46f4-aa85-d9226f0ecff8 tempest-VolumesBackupsTest-2142009639 None] starting backup of volume: 8a0b1cfb-8ea1-46a0-aac3-b254107b98ef, volume size: 1073741824, object names prefix volume_8a0b1cfb-8ea1-46a0-aac3-b254107b98ef/20260703094741/az_nova_backup_b1aa5ad9-985a-4f8b-a2fb-778a315501a9, availability zone: nova {{(pid=101319) _prepare_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:359}} Jul 03 09:47:42.193544 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-ff9a2cd5-68dc-4b82-8fd3-82fb094c7b84 tempest-VolumesBackupsTest-118275719 None] Backing up chunk of data from volume. {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 09:47:42.449843 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-ff9a2cd5-68dc-4b82-8fd3-82fb094c7b84 tempest-VolumesBackupsTest-118275719 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101319) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 09:47:42.449974 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-ff9a2cd5-68dc-4b82-8fd3-82fb094c7b84 tempest-VolumesBackupsTest-118275719 None] About to put_object {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 09:47:42.567331 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-ff9a2cd5-68dc-4b82-8fd3-82fb094c7b84 tempest-VolumesBackupsTest-118275719 None] backup MD5 for volume_e49954d5-d017-43d5-8565-25ce9e2693f9/20260703094739/az_nova_backup_06482a6e-a410-44d6-85cf-84392df124bc-00005: 25e317773f308e446cc84c503a6d1f85 {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 09:47:42.567827 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-ff9a2cd5-68dc-4b82-8fd3-82fb094c7b84 tempest-VolumesBackupsTest-118275719 None] Calling eventlet.sleep(0) {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 09:47:42.835348 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-ff9a2cd5-68dc-4b82-8fd3-82fb094c7b84 tempest-VolumesBackupsTest-118275719 None] Backing up chunk of data from volume. {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 09:47:43.104899 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-ff9a2cd5-68dc-4b82-8fd3-82fb094c7b84 tempest-VolumesBackupsTest-118275719 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101319) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 09:47:43.104899 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-ff9a2cd5-68dc-4b82-8fd3-82fb094c7b84 tempest-VolumesBackupsTest-118275719 None] About to put_object {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 09:47:43.227099 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-ff9a2cd5-68dc-4b82-8fd3-82fb094c7b84 tempest-VolumesBackupsTest-118275719 None] backup MD5 for volume_e49954d5-d017-43d5-8565-25ce9e2693f9/20260703094739/az_nova_backup_06482a6e-a410-44d6-85cf-84392df124bc-00006: 25e317773f308e446cc84c503a6d1f85 {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 09:47:43.227099 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-ff9a2cd5-68dc-4b82-8fd3-82fb094c7b84 tempest-VolumesBackupsTest-118275719 None] Calling eventlet.sleep(0) {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 09:47:43.480067 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-ff9a2cd5-68dc-4b82-8fd3-82fb094c7b84 tempest-VolumesBackupsTest-118275719 None] Backing up chunk of data from volume. {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 09:47:43.747318 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-ff9a2cd5-68dc-4b82-8fd3-82fb094c7b84 tempest-VolumesBackupsTest-118275719 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101319) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 09:47:43.747812 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-ff9a2cd5-68dc-4b82-8fd3-82fb094c7b84 tempest-VolumesBackupsTest-118275719 None] About to put_object {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 09:47:43.850589 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-ff9a2cd5-68dc-4b82-8fd3-82fb094c7b84 tempest-VolumesBackupsTest-118275719 None] backup MD5 for volume_e49954d5-d017-43d5-8565-25ce9e2693f9/20260703094739/az_nova_backup_06482a6e-a410-44d6-85cf-84392df124bc-00007: 25e317773f308e446cc84c503a6d1f85 {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 09:47:43.850721 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-ff9a2cd5-68dc-4b82-8fd3-82fb094c7b84 tempest-VolumesBackupsTest-118275719 None] Calling eventlet.sleep(0) {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 09:47:44.175098 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-ff9a2cd5-68dc-4b82-8fd3-82fb094c7b84 tempest-VolumesBackupsTest-118275719 None] Backing up chunk of data from volume. {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 09:47:44.425201 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-ff9a2cd5-68dc-4b82-8fd3-82fb094c7b84 tempest-VolumesBackupsTest-118275719 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101319) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 09:47:44.425366 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-ff9a2cd5-68dc-4b82-8fd3-82fb094c7b84 tempest-VolumesBackupsTest-118275719 None] About to put_object {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 09:47:44.548461 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-ff9a2cd5-68dc-4b82-8fd3-82fb094c7b84 tempest-VolumesBackupsTest-118275719 None] backup MD5 for volume_e49954d5-d017-43d5-8565-25ce9e2693f9/20260703094739/az_nova_backup_06482a6e-a410-44d6-85cf-84392df124bc-00008: 25e317773f308e446cc84c503a6d1f85 {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 09:47:44.548649 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-ff9a2cd5-68dc-4b82-8fd3-82fb094c7b84 tempest-VolumesBackupsTest-118275719 None] Calling eventlet.sleep(0) {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 09:47:44.884067 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-ff9a2cd5-68dc-4b82-8fd3-82fb094c7b84 tempest-VolumesBackupsTest-118275719 None] Backing up chunk of data from volume. {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 09:47:45.141320 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-ff9a2cd5-68dc-4b82-8fd3-82fb094c7b84 tempest-VolumesBackupsTest-118275719 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101319) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 09:47:45.141471 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-ff9a2cd5-68dc-4b82-8fd3-82fb094c7b84 tempest-VolumesBackupsTest-118275719 None] About to put_object {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 09:47:45.348769 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-ff9a2cd5-68dc-4b82-8fd3-82fb094c7b84 tempest-VolumesBackupsTest-118275719 None] backup MD5 for volume_e49954d5-d017-43d5-8565-25ce9e2693f9/20260703094739/az_nova_backup_06482a6e-a410-44d6-85cf-84392df124bc-00009: 25e317773f308e446cc84c503a6d1f85 {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 09:47:45.348996 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-ff9a2cd5-68dc-4b82-8fd3-82fb094c7b84 tempest-VolumesBackupsTest-118275719 None] Calling eventlet.sleep(0) {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 09:47:45.590585 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-ff9a2cd5-68dc-4b82-8fd3-82fb094c7b84 tempest-VolumesBackupsTest-118275719 None] Backing up chunk of data from volume. {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 09:47:45.867838 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-ff9a2cd5-68dc-4b82-8fd3-82fb094c7b84 tempest-VolumesBackupsTest-118275719 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101319) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 09:47:45.868198 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-ff9a2cd5-68dc-4b82-8fd3-82fb094c7b84 tempest-VolumesBackupsTest-118275719 None] About to put_object {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 09:47:45.979237 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-ff9a2cd5-68dc-4b82-8fd3-82fb094c7b84 tempest-VolumesBackupsTest-118275719 None] backup MD5 for volume_e49954d5-d017-43d5-8565-25ce9e2693f9/20260703094739/az_nova_backup_06482a6e-a410-44d6-85cf-84392df124bc-00010: 25e317773f308e446cc84c503a6d1f85 {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 09:47:45.979702 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-ff9a2cd5-68dc-4b82-8fd3-82fb094c7b84 tempest-VolumesBackupsTest-118275719 None] Calling eventlet.sleep(0) {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 09:47:46.248641 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-ff9a2cd5-68dc-4b82-8fd3-82fb094c7b84 tempest-VolumesBackupsTest-118275719 None] Backing up chunk of data from volume. {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 09:47:46.548610 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-ff9a2cd5-68dc-4b82-8fd3-82fb094c7b84 tempest-VolumesBackupsTest-118275719 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101319) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 09:47:46.548610 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-ff9a2cd5-68dc-4b82-8fd3-82fb094c7b84 tempest-VolumesBackupsTest-118275719 None] About to put_object {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 09:47:46.666685 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-ff9a2cd5-68dc-4b82-8fd3-82fb094c7b84 tempest-VolumesBackupsTest-118275719 None] backup MD5 for volume_e49954d5-d017-43d5-8565-25ce9e2693f9/20260703094739/az_nova_backup_06482a6e-a410-44d6-85cf-84392df124bc-00011: 25e317773f308e446cc84c503a6d1f85 {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 09:47:46.666836 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-ff9a2cd5-68dc-4b82-8fd3-82fb094c7b84 tempest-VolumesBackupsTest-118275719 None] Calling eventlet.sleep(0) {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 09:47:46.707521 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.driver [None req-ff8d1fd5-0609-46f4-aa85-d9226f0ecff8 tempest-VolumesBackupsTest-2142009639 None] Getting metadata type 'volume-base-metadata' {{(pid=101319) _save_vol_base_meta /opt/stack/cinder/cinder/backup/driver.py:79}} Jul 03 09:47:46.726793 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.driver [None req-ff8d1fd5-0609-46f4-aa85-d9226f0ecff8 tempest-VolumesBackupsTest-2142009639 None] Completed fetching metadata type 'volume-base-metadata' {{(pid=101319) _save_vol_base_meta /opt/stack/cinder/cinder/backup/driver.py:98}} Jul 03 09:47:46.727196 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.driver [None req-ff8d1fd5-0609-46f4-aa85-d9226f0ecff8 tempest-VolumesBackupsTest-2142009639 None] Getting metadata type 'volume-metadata' {{(pid=101319) _save_vol_meta /opt/stack/cinder/cinder/backup/driver.py:109}} Jul 03 09:47:46.732467 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.driver [None req-ff8d1fd5-0609-46f4-aa85-d9226f0ecff8 tempest-VolumesBackupsTest-2142009639 None] No metadata type 'volume-metadata' available {{(pid=101319) _save_vol_meta /opt/stack/cinder/cinder/backup/driver.py:123}} Jul 03 09:47:46.732749 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.driver [None req-ff8d1fd5-0609-46f4-aa85-d9226f0ecff8 tempest-VolumesBackupsTest-2142009639 None] Getting metadata type 'volume-glance-metadata' {{(pid=101319) _save_vol_glance_meta /opt/stack/cinder/cinder/backup/driver.py:132}} Jul 03 09:47:46.738589 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.driver [None req-ff8d1fd5-0609-46f4-aa85-d9226f0ecff8 tempest-VolumesBackupsTest-2142009639 None] No metadata type 'volume-glance-metadata' available {{(pid=101319) _save_vol_glance_meta /opt/stack/cinder/cinder/backup/driver.py:147}} Jul 03 09:47:46.738589 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-ff8d1fd5-0609-46f4-aa85-d9226f0ecff8 tempest-VolumesBackupsTest-2142009639 None] _write_sha256file started, container name: volumebackups, sha256file filename: volume_8a0b1cfb-8ea1-46a0-aac3-b254107b98ef/20260703094741/az_nova_backup_b1aa5ad9-985a-4f8b-a2fb-778a315501a9_sha256file. {{(pid=101319) _write_sha256file /opt/stack/cinder/cinder/backup/chunkeddriver.py:299}} Jul 03 09:47:46.834760 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-ff8d1fd5-0609-46f4-aa85-d9226f0ecff8 tempest-VolumesBackupsTest-2142009639 None] _write_sha256file finished. {{(pid=101319) _write_sha256file /opt/stack/cinder/cinder/backup/chunkeddriver.py:315}} Jul 03 09:47:46.834760 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-ff8d1fd5-0609-46f4-aa85-d9226f0ecff8 tempest-VolumesBackupsTest-2142009639 None] _write_metadata started, container name: volumebackups, metadata filename: volume_8a0b1cfb-8ea1-46a0-aac3-b254107b98ef/20260703094741/az_nova_backup_b1aa5ad9-985a-4f8b-a2fb-778a315501a9_metadata. {{(pid=101319) _write_metadata /opt/stack/cinder/cinder/backup/chunkeddriver.py:276}} Jul 03 09:47:46.877907 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-ff9a2cd5-68dc-4b82-8fd3-82fb094c7b84 tempest-VolumesBackupsTest-118275719 None] Backing up chunk of data from volume. {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 09:47:46.914202 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-ff8d1fd5-0609-46f4-aa85-d9226f0ecff8 tempest-VolumesBackupsTest-2142009639 None] _write_metadata finished. Metadata: b'{\n "backup_description": null,\n "backup_id": "b1aa5ad9-985a-4f8b-a2fb-778a315501a9",\n "backup_name": null,\n "created_at": "2026-07-03 09:47:36+00:00",\n "objects": [],\n "parent_id": "86118233-3d57-47ad-8781-cab6c54e4d53",\n "version": "1.0.0",\n "volume_id": "8a0b1cfb-8ea1-46a0-aac3-b254107b98ef",\n "volume_meta": "{\\"version\\": 2, \\"volume-base-metadata\\": {\\"id\\": \\"8a0b1cfb-8ea1-46a0-aac3-b254107b98ef\\", \\"_name_id\\": null, \\"use_quota\\": true, \\"ec2_id\\": null, \\"user_id\\": \\"91463b6c437c4711a49d3c31c513a101\\", \\"project_id\\": \\"59044e18a5b24b19a7b9b8a380f2e1a0\\", \\"snapshot_id\\": null, \\"cluster_name\\": null, \\"host\\": \\"np0000004400@storpool#default\\", \\"size\\": 1, \\"availability_zone\\": \\"nova\\", \\"status\\": \\"backing-up\\", \\"attach_status\\": \\"attached\\", \\"migration_status\\": null, \\"scheduled_at\\": \\"2026-07-03T09:46:10.000000\\", \\"launched_at\\": \\"2026-07-03T09:46:10.000000\\", \\"terminated_at\\": null, \\"display_name\\": \\"tempest-VolumesBackupsTest-Volume-175473569\\", \\"display_description\\": null, \\"provider_location\\": null, \\"provider_auth\\": null, \\"provider_geometry\\": null, \\"provider_id\\": null, \\"volume_type_id\\": \\"03e13fe6-0e30-4803-ace0-725d38e6dc24\\", \\"source_volid\\": null, \\"encryption_key_id\\": null, \\"consistencygroup_id\\": null, \\"group_id\\": null, \\"bootable\\": false, \\"multiattach\\": false, \\"replication_status\\": null, \\"replication_extended_status\\": null, \\"replication_driver_data\\": null, \\"previous_status\\": \\"in-use\\", \\"service_uuid\\": \\"6d4b0e79-fefe-4744-b25f-34be05095200\\", \\"shared_targets\\": true, \\"deleted_at\\": null, \\"deleted\\": false, \\"created_at\\": \\"2026-07-03T09:46:10.000000\\", \\"updated_at\\": \\"2026-07-03T09:47:36.000000\\"}}"\n}'. {{(pid=101319) _write_metadata /opt/stack/cinder/cinder/backup/chunkeddriver.py:295}} Jul 03 09:47:46.928989 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-ff8d1fd5-0609-46f4-aa85-d9226f0ecff8 tempest-VolumesBackupsTest-2142009639 None] backup b1aa5ad9-985a-4f8b-a2fb-778a315501a9 finished. {{(pid=101319) _finalize_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:462}} Jul 03 09:47:47.056650 np0000004400 cinder-backup[101319]: DEBUG oslo_concurrency.processutils [None req-ff8d1fd5-0609-46f4-aa85-d9226f0ecff8 tempest-VolumesBackupsTest-2142009639 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chown 0 /dev/sdi {{(pid=101319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 09:47:47.076326 np0000004400 sudo[141945]: stack : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chown 0 /dev/sdi Jul 03 09:47:47.076926 np0000004400 sudo[141945]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1002) Jul 03 09:47:47.117676 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-ff9a2cd5-68dc-4b82-8fd3-82fb094c7b84 tempest-VolumesBackupsTest-118275719 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101319) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 09:47:47.117853 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-ff9a2cd5-68dc-4b82-8fd3-82fb094c7b84 tempest-VolumesBackupsTest-118275719 None] About to put_object {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 09:47:47.242016 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-ff9a2cd5-68dc-4b82-8fd3-82fb094c7b84 tempest-VolumesBackupsTest-118275719 None] backup MD5 for volume_e49954d5-d017-43d5-8565-25ce9e2693f9/20260703094739/az_nova_backup_06482a6e-a410-44d6-85cf-84392df124bc-00012: 25e317773f308e446cc84c503a6d1f85 {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 09:47:47.242142 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-ff9a2cd5-68dc-4b82-8fd3-82fb094c7b84 tempest-VolumesBackupsTest-118275719 None] Calling eventlet.sleep(0) {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 09:47:47.421914 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-ff9a2cd5-68dc-4b82-8fd3-82fb094c7b84 tempest-VolumesBackupsTest-118275719 None] Backing up chunk of data from volume. {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 09:47:47.422316 np0000004400 sudo[141945]: pam_unix(sudo:session): session closed for user root Jul 03 09:47:47.423870 np0000004400 cinder-backup[101319]: DEBUG oslo_concurrency.processutils [None req-ff8d1fd5-0609-46f4-aa85-d9226f0ecff8 tempest-VolumesBackupsTest-2142009639 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chown 0 /dev/sdi" returned: 0 in 0.368s {{(pid=101319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 09:47:47.424375 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-ff8d1fd5-0609-46f4-aa85-d9226f0ecff8 tempest-VolumesBackupsTest-2142009639 None] ==> disconnect_volume: call "{'args': (, {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-7ec8624e-70c1-4cb2-bb18-1a0e48d27629', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '7ec8624e-70c1-4cb2-bb18-1a0e48d27629', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': False}, {'type': 'block', 'scsi_wwn': '3300000004d97aa9b', 'path': '/dev/sdi'}), 'kwargs': {'force': True, 'ignore_errors': True}}" {{(pid=101319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}} Jul 03 09:47:47.424620 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.base [None req-ff8d1fd5-0609-46f4-aa85-d9226f0ecff8 tempest-VolumesBackupsTest-2142009639 None] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=101319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jul 03 09:47:47.425068 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.base [None req-ff8d1fd5-0609-46f4-aa85-d9226f0ecff8 tempest-VolumesBackupsTest-2142009639 None] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=101319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jul 03 09:47:47.425454 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-ff8d1fd5-0609-46f4-aa85-d9226f0ecff8 tempest-VolumesBackupsTest-2142009639 None] _get_connection_devices called with parameters: connection_properties={'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-7ec8624e-70c1-4cb2-bb18-1a0e48d27629', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '7ec8624e-70c1-4cb2-bb18-1a0e48d27629', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': False}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=101319) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:847}} Jul 03 09:47:47.436638 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-ff8d1fd5-0609-46f4-aa85-d9226f0ecff8 tempest-VolumesBackupsTest-2142009639 None] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS: Jul 03 09:47:47.436638 np0000004400 cinder-backup[101319]: No targets found. Jul 03 09:47:47.436638 np0000004400 cinder-backup[101319]: iSNS: Jul 03 09:47:47.436638 np0000004400 cinder-backup[101319]: No targets found. Jul 03 09:47:47.436638 np0000004400 cinder-backup[101319]: STATIC: Jul 03 09:47:47.436638 np0000004400 cinder-backup[101319]: Target: iqn.2023-03.storpool.com:os--volume-8a0b1cfb-8ea1-46a0-aac3-b254107b98ef Jul 03 09:47:47.436638 np0000004400 cinder-backup[101319]: Portal: 192.168.50.100:3260,-1 Jul 03 09:47:47.436638 np0000004400 cinder-backup[101319]: Iface Name: default Jul 03 09:47:47.436638 np0000004400 cinder-backup[101319]: Portal: 192.168.40.100:3260,-1 Jul 03 09:47:47.436638 np0000004400 cinder-backup[101319]: Iface Name: default Jul 03 09:47:47.436638 np0000004400 cinder-backup[101319]: Target: iqn.2023-03.storpool.com:os--volume-25552aca-10fe-4ac0-affd-19717e76efc4 Jul 03 09:47:47.436638 np0000004400 cinder-backup[101319]: Portal: 192.168.40.100:3260,-1 Jul 03 09:47:47.436638 np0000004400 cinder-backup[101319]: Iface Name: default Jul 03 09:47:47.436638 np0000004400 cinder-backup[101319]: Target: iqn.2023-03.storpool.com:os--volume-9e9ca83c-acc7-4d33-b467-06911ac48096 Jul 03 09:47:47.436638 np0000004400 cinder-backup[101319]: Portal: 192.168.50.100:3260,-1 Jul 03 09:47:47.436638 np0000004400 cinder-backup[101319]: Iface Name: default Jul 03 09:47:47.436638 np0000004400 cinder-backup[101319]: Portal: 192.168.40.100:3260,-1 Jul 03 09:47:47.436638 np0000004400 cinder-backup[101319]: Iface Name: default Jul 03 09:47:47.436638 np0000004400 cinder-backup[101319]: Target: iqn.2023-03.storpool.com:os--volume-8bf608ef-9b9f-4d7b-acde-5ab351c0c98b Jul 03 09:47:47.436638 np0000004400 cinder-backup[101319]: Portal: 192.168.50.100:3260,-1 Jul 03 09:47:47.436638 np0000004400 cinder-backup[101319]: Iface Name: default Jul 03 09:47:47.436638 np0000004400 cinder-backup[101319]: Portal: 192.168.40.100:3260,-1 Jul 03 09:47:47.436638 np0000004400 cinder-backup[101319]: Iface Name: default Jul 03 09:47:47.436638 np0000004400 cinder-backup[101319]: Target: iqn.2023-03.storpool.com:os--volume-7ec8624e-70c1-4cb2-bb18-1a0e48d27629 Jul 03 09:47:47.436638 np0000004400 cinder-backup[101319]: Portal: 192.168.40.100:3260,-1 Jul 03 09:47:47.436638 np0000004400 cinder-backup[101319]: Iface Name: default Jul 03 09:47:47.436638 np0000004400 cinder-backup[101319]: FIRMWARE: Jul 03 09:47:47.436638 np0000004400 cinder-backup[101319]: No targets found. Jul 03 09:47:47.436638 np0000004400 cinder-backup[101319]: stderr= {{(pid=101319) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jul 03 09:47:47.437549 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-ff8d1fd5-0609-46f4-aa85-d9226f0ecff8 tempest-VolumesBackupsTest-2142009639 None] Regex to get portals from discoverydb: ^SENDTARGETS: Jul 03 09:47:47.437549 np0000004400 cinder-backup[101319]: .*?^DiscoveryAddress: 192.168.40.100,3260.*? Jul 03 09:47:47.437549 np0000004400 cinder-backup[101319]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=101319) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:390}} Jul 03 09:47:47.437549 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-ff8d1fd5-0609-46f4-aa85-d9226f0ecff8 tempest-VolumesBackupsTest-2142009639 None] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-7ec8624e-70c1-4cb2-bb18-1a0e48d27629', 0)] {{(pid=101319) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:858}} Jul 03 09:47:47.466816 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-ff8d1fd5-0609-46f4-aa85-d9226f0ecff8 tempest-VolumesBackupsTest-2142009639 None] iscsiadm ('-m', 'session'): stdout=tcp: [120] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8a0b1cfb-8ea1-46a0-aac3-b254107b98ef (non-flash) Jul 03 09:47:47.466816 np0000004400 cinder-backup[101319]: tcp: [121] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8a0b1cfb-8ea1-46a0-aac3-b254107b98ef (non-flash) Jul 03 09:47:47.466816 np0000004400 cinder-backup[101319]: tcp: [123] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9e9ca83c-acc7-4d33-b467-06911ac48096 (non-flash) Jul 03 09:47:47.466816 np0000004400 cinder-backup[101319]: tcp: [124] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9e9ca83c-acc7-4d33-b467-06911ac48096 (non-flash) Jul 03 09:47:47.466816 np0000004400 cinder-backup[101319]: tcp: [127] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-25552aca-10fe-4ac0-affd-19717e76efc4 (non-flash) Jul 03 09:47:47.466816 np0000004400 cinder-backup[101319]: tcp: [128] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7ec8624e-70c1-4cb2-bb18-1a0e48d27629 (non-flash) Jul 03 09:47:47.466816 np0000004400 cinder-backup[101319]: tcp: [129] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8bf608ef-9b9f-4d7b-acde-5ab351c0c98b (non-flash) Jul 03 09:47:47.466816 np0000004400 cinder-backup[101319]: tcp: [130] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8bf608ef-9b9f-4d7b-acde-5ab351c0c98b (non-flash) Jul 03 09:47:47.466816 np0000004400 cinder-backup[101319]: stderr= {{(pid=101319) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jul 03 09:47:47.467208 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-ff8d1fd5-0609-46f4-aa85-d9226f0ecff8 tempest-VolumesBackupsTest-2142009639 None] iscsi session list stdout=tcp: [120] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8a0b1cfb-8ea1-46a0-aac3-b254107b98ef (non-flash) Jul 03 09:47:47.467208 np0000004400 cinder-backup[101319]: tcp: [121] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8a0b1cfb-8ea1-46a0-aac3-b254107b98ef (non-flash) Jul 03 09:47:47.467208 np0000004400 cinder-backup[101319]: tcp: [123] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9e9ca83c-acc7-4d33-b467-06911ac48096 (non-flash) Jul 03 09:47:47.467208 np0000004400 cinder-backup[101319]: tcp: [124] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9e9ca83c-acc7-4d33-b467-06911ac48096 (non-flash) Jul 03 09:47:47.467208 np0000004400 cinder-backup[101319]: tcp: [127] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-25552aca-10fe-4ac0-affd-19717e76efc4 (non-flash) Jul 03 09:47:47.467208 np0000004400 cinder-backup[101319]: tcp: [128] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7ec8624e-70c1-4cb2-bb18-1a0e48d27629 (non-flash) Jul 03 09:47:47.467208 np0000004400 cinder-backup[101319]: tcp: [129] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8bf608ef-9b9f-4d7b-acde-5ab351c0c98b (non-flash) Jul 03 09:47:47.467208 np0000004400 cinder-backup[101319]: tcp: [130] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8bf608ef-9b9f-4d7b-acde-5ab351c0c98b (non-flash) Jul 03 09:47:47.467208 np0000004400 cinder-backup[101319]: stderr= {{(pid=101319) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jul 03 09:47:47.467208 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-ff8d1fd5-0609-46f4-aa85-d9226f0ecff8 tempest-VolumesBackupsTest-2142009639 None] Sessions list: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-8a0b1cfb-8ea1-46a0-aac3-b254107b98ef', '120'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-8a0b1cfb-8ea1-46a0-aac3-b254107b98ef', '121'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-9e9ca83c-acc7-4d33-b467-06911ac48096', '123'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-9e9ca83c-acc7-4d33-b467-06911ac48096', '124'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-25552aca-10fe-4ac0-affd-19717e76efc4', '127'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-7ec8624e-70c1-4cb2-bb18-1a0e48d27629', '128'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-8bf608ef-9b9f-4d7b-acde-5ab351c0c98b', '129'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-8bf608ef-9b9f-4d7b-acde-5ab351c0c98b', '130')] {{(pid=101319) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:866}} Jul 03 09:47:47.467652 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-ff8d1fd5-0609-46f4-aa85-d9226f0ecff8 tempest-VolumesBackupsTest-2142009639 None] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-7ec8624e-70c1-4cb2-bb18-1a0e48d27629, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-7ec8624e-70c1-4cb2-bb18-1a0e48d27629', '128')] {{(pid=101319) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}} Jul 03 09:47:47.468422 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-ff8d1fd5-0609-46f4-aa85-d9226f0ecff8 tempest-VolumesBackupsTest-2142009639 None] Resulting device map defaultdict(. at 0x7e76e6d1d6c0>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-7ec8624e-70c1-4cb2-bb18-1a0e48d27629'): ({'sdi'}, set())}) {{(pid=101319) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:912}} Jul 03 09:47:47.468691 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.linuxscsi [None req-ff8d1fd5-0609-46f4-aa85-d9226f0ecff8 tempest-VolumesBackupsTest-2142009639 None] Removing single pathed devices sdi {{(pid=101319) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}} Jul 03 09:47:47.480928 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.linuxscsi [None req-ff8d1fd5-0609-46f4-aa85-d9226f0ecff8 tempest-VolumesBackupsTest-2142009639 None] Flushing IO for device /dev/sdi {{(pid=101319) flush_device_io /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:461}} Jul 03 09:47:47.489042 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.linuxscsi [None req-ff8d1fd5-0609-46f4-aa85-d9226f0ecff8 tempest-VolumesBackupsTest-2142009639 None] Remove SCSI device /dev/sdi with /sys/block/sdi/device/delete {{(pid=101319) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}} Jul 03 09:47:47.529916 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.linuxscsi [None req-ff8d1fd5-0609-46f4-aa85-d9226f0ecff8 tempest-VolumesBackupsTest-2142009639 None] Checking to see if SCSI volumes sdi have been removed. {{(pid=101319) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}} Jul 03 09:47:47.530073 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.linuxscsi [None req-ff8d1fd5-0609-46f4-aa85-d9226f0ecff8 tempest-VolumesBackupsTest-2142009639 None] SCSI volumes sdi have been removed. {{(pid=101319) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}} Jul 03 09:47:47.531018 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.linuxscsi [None req-ff8d1fd5-0609-46f4-aa85-d9226f0ecff8 tempest-VolumesBackupsTest-2142009639 None] Checking to see if device paths {'sdi'} are still under multipathd monitoring {{(pid=101319) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}} Jul 03 09:47:47.542644 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.linuxscsi [None req-ff8d1fd5-0609-46f4-aa85-d9226f0ecff8 tempest-VolumesBackupsTest-2142009639 None] Device paths {'sdi'} have been removed from multipathd monitoring. {{(pid=101319) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}} Jul 03 09:47:47.542887 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-ff8d1fd5-0609-46f4-aa85-d9226f0ecff8 tempest-VolumesBackupsTest-2142009639 None] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-7ec8624e-70c1-4cb2-bb18-1a0e48d27629')] {{(pid=101319) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1225}} Jul 03 09:47:47.554727 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-ff8d1fd5-0609-46f4-aa85-d9226f0ecff8 tempest-VolumesBackupsTest-2142009639 None] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=101319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 03 09:47:47.589863 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-ff8d1fd5-0609-46f4-aa85-d9226f0ecff8 tempest-VolumesBackupsTest-2142009639 None] iscsiadm ('--logout',): stdout=Logging out of session [sid: 128, target: iqn.2023-03.storpool.com:os--volume-7ec8624e-70c1-4cb2-bb18-1a0e48d27629, portal: 192.168.40.100,3260] Jul 03 09:47:47.589863 np0000004400 cinder-backup[101319]: Logout of [sid: 128, target: iqn.2023-03.storpool.com:os--volume-7ec8624e-70c1-4cb2-bb18-1a0e48d27629, portal: 192.168.40.100,3260] successful. Jul 03 09:47:47.589863 np0000004400 cinder-backup[101319]: stderr= {{(pid=101319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 03 09:47:47.608207 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-ff8d1fd5-0609-46f4-aa85-d9226f0ecff8 tempest-VolumesBackupsTest-2142009639 None] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=101319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 03 09:47:47.608450 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.base [None req-ff8d1fd5-0609-46f4-aa85-d9226f0ecff8 tempest-VolumesBackupsTest-2142009639 None] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.183s {{(pid=101319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jul 03 09:47:47.608615 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-ff8d1fd5-0609-46f4-aa85-d9226f0ecff8 tempest-VolumesBackupsTest-2142009639 None] <== disconnect_volume: return (183ms) None {{(pid=101319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}} Jul 03 09:47:47.674360 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-ff9a2cd5-68dc-4b82-8fd3-82fb094c7b84 tempest-VolumesBackupsTest-118275719 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101319) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 09:47:47.674565 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-ff9a2cd5-68dc-4b82-8fd3-82fb094c7b84 tempest-VolumesBackupsTest-118275719 None] About to put_object {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 09:47:47.797204 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-ff9a2cd5-68dc-4b82-8fd3-82fb094c7b84 tempest-VolumesBackupsTest-118275719 None] backup MD5 for volume_e49954d5-d017-43d5-8565-25ce9e2693f9/20260703094739/az_nova_backup_06482a6e-a410-44d6-85cf-84392df124bc-00013: 25e317773f308e446cc84c503a6d1f85 {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 09:47:47.797204 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-ff9a2cd5-68dc-4b82-8fd3-82fb094c7b84 tempest-VolumesBackupsTest-118275719 None] Calling eventlet.sleep(0) {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 09:47:48.017771 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-ff9a2cd5-68dc-4b82-8fd3-82fb094c7b84 tempest-VolumesBackupsTest-118275719 None] Backing up chunk of data from volume. {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 09:47:48.290126 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-ff9a2cd5-68dc-4b82-8fd3-82fb094c7b84 tempest-VolumesBackupsTest-118275719 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101319) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 09:47:48.290126 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-ff9a2cd5-68dc-4b82-8fd3-82fb094c7b84 tempest-VolumesBackupsTest-118275719 None] About to put_object {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 09:47:48.390766 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-ff9a2cd5-68dc-4b82-8fd3-82fb094c7b84 tempest-VolumesBackupsTest-118275719 None] backup MD5 for volume_e49954d5-d017-43d5-8565-25ce9e2693f9/20260703094739/az_nova_backup_06482a6e-a410-44d6-85cf-84392df124bc-00014: 25e317773f308e446cc84c503a6d1f85 {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 09:47:48.390766 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-ff9a2cd5-68dc-4b82-8fd3-82fb094c7b84 tempest-VolumesBackupsTest-118275719 None] Calling eventlet.sleep(0) {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 09:47:48.575222 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-ff9a2cd5-68dc-4b82-8fd3-82fb094c7b84 tempest-VolumesBackupsTest-118275719 None] Backing up chunk of data from volume. {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 09:47:48.659275 np0000004400 cinder-backup[101319]: INFO cinder.backup.manager [None req-ff8d1fd5-0609-46f4-aa85-d9226f0ecff8 tempest-VolumesBackupsTest-2142009639 None] Create backup finished. backup: b1aa5ad9-985a-4f8b-a2fb-778a315501a9. Jul 03 09:47:48.833235 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-ff9a2cd5-68dc-4b82-8fd3-82fb094c7b84 tempest-VolumesBackupsTest-118275719 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101319) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 09:47:48.833436 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-ff9a2cd5-68dc-4b82-8fd3-82fb094c7b84 tempest-VolumesBackupsTest-118275719 None] About to put_object {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 09:47:48.918293 np0000004400 cinder-backup[101319]: INFO cinder.backup.manager [None req-fc5ed60f-9305-42d8-96e0-28980f9068be tempest-VolumesBackupsTest-2142009639 None] Delete backup started, backup: b1aa5ad9-985a-4f8b-a2fb-778a315501a9. Jul 03 09:47:48.927585 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.drivers.swift [None req-fc5ed60f-9305-42d8-96e0-28980f9068be tempest-VolumesBackupsTest-2142009639 None] Using swift URL https://10.4.3.95:8080/v1/AUTH_59044e18a5b24b19a7b9b8a380f2e1a0 {{(pid=101319) initialize /opt/stack/cinder/cinder/backup/drivers/swift.py:300}} Jul 03 09:47:48.927921 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.drivers.swift [None req-fc5ed60f-9305-42d8-96e0-28980f9068be tempest-VolumesBackupsTest-2142009639 None] Connect to https://10.4.3.95:8080/v1/AUTH_ in "per_user" mode {{(pid=101319) initialize /opt/stack/cinder/cinder/backup/drivers/swift.py:301}} Jul 03 09:47:48.928208 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-fc5ed60f-9305-42d8-96e0-28980f9068be tempest-VolumesBackupsTest-2142009639 None] delete started, backup: b1aa5ad9-985a-4f8b-a2fb-778a315501a9, container: volumebackups, prefix: volume_8a0b1cfb-8ea1-46a0-aac3-b254107b98ef/20260703094741/az_nova_backup_b1aa5ad9-985a-4f8b-a2fb-778a315501a9. {{(pid=101319) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:822}} Jul 03 09:47:48.939633 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-ff9a2cd5-68dc-4b82-8fd3-82fb094c7b84 tempest-VolumesBackupsTest-118275719 None] backup MD5 for volume_e49954d5-d017-43d5-8565-25ce9e2693f9/20260703094739/az_nova_backup_06482a6e-a410-44d6-85cf-84392df124bc-00015: 25e317773f308e446cc84c503a6d1f85 {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 09:47:48.939809 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-ff9a2cd5-68dc-4b82-8fd3-82fb094c7b84 tempest-VolumesBackupsTest-118275719 None] Calling eventlet.sleep(0) {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 09:47:48.983022 np0000004400 cinder-backup[101319]: DEBUG oslo_db.sqlalchemy.engines [None req-ff9a2cd5-68dc-4b82-8fd3-82fb094c7b84 tempest-VolumesBackupsTest-118275719 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=101319) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 03 09:47:48.993351 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-fc5ed60f-9305-42d8-96e0-28980f9068be tempest-VolumesBackupsTest-2142009639 None] generated object list: ['volume_8a0b1cfb-8ea1-46a0-aac3-b254107b98ef/20260703094741/az_nova_backup_b1aa5ad9-985a-4f8b-a2fb-778a315501a9_metadata', 'volume_8a0b1cfb-8ea1-46a0-aac3-b254107b98ef/20260703094741/az_nova_backup_b1aa5ad9-985a-4f8b-a2fb-778a315501a9_sha256file']. {{(pid=101319) _generate_object_names /opt/stack/cinder/cinder/backup/chunkeddriver.py:260}} Jul 03 09:47:49.015426 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-fc5ed60f-9305-42d8-96e0-28980f9068be tempest-VolumesBackupsTest-2142009639 None] deleted object: volume_8a0b1cfb-8ea1-46a0-aac3-b254107b98ef/20260703094741/az_nova_backup_b1aa5ad9-985a-4f8b-a2fb-778a315501a9_metadata in container: volumebackups. {{(pid=101319) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 09:47:49.037961 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-fc5ed60f-9305-42d8-96e0-28980f9068be tempest-VolumesBackupsTest-2142009639 None] deleted object: volume_8a0b1cfb-8ea1-46a0-aac3-b254107b98ef/20260703094741/az_nova_backup_b1aa5ad9-985a-4f8b-a2fb-778a315501a9_sha256file in container: volumebackups. {{(pid=101319) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 09:47:49.038175 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-fc5ed60f-9305-42d8-96e0-28980f9068be tempest-VolumesBackupsTest-2142009639 None] delete b1aa5ad9-985a-4f8b-a2fb-778a315501a9 finished. {{(pid=101319) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:848}} Jul 03 09:47:49.051913 np0000004400 cinder-backup[101319]: DEBUG cinder.quota [None req-fc5ed60f-9305-42d8-96e0-28980f9068be tempest-VolumesBackupsTest-2142009639 None] Created reservations ['ae8509b3-a123-4baa-896a-45a5363bab2c', '52193bba-42b9-470f-a86f-0df905c78c72'] {{(pid=101319) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 09:47:49.073514 np0000004400 cinder-backup[101319]: INFO cinder.backup.manager [None req-fc5ed60f-9305-42d8-96e0-28980f9068be tempest-VolumesBackupsTest-2142009639 None] Delete backup finished, backup b1aa5ad9-985a-4f8b-a2fb-778a315501a9 deleted. Jul 03 09:47:49.185646 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-ff9a2cd5-68dc-4b82-8fd3-82fb094c7b84 tempest-VolumesBackupsTest-118275719 None] Backing up chunk of data from volume. {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 09:47:49.441854 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-ff9a2cd5-68dc-4b82-8fd3-82fb094c7b84 tempest-VolumesBackupsTest-118275719 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101319) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 09:47:49.442253 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-ff9a2cd5-68dc-4b82-8fd3-82fb094c7b84 tempest-VolumesBackupsTest-118275719 None] About to put_object {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 09:47:49.541602 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-ff9a2cd5-68dc-4b82-8fd3-82fb094c7b84 tempest-VolumesBackupsTest-118275719 None] backup MD5 for volume_e49954d5-d017-43d5-8565-25ce9e2693f9/20260703094739/az_nova_backup_06482a6e-a410-44d6-85cf-84392df124bc-00016: 25e317773f308e446cc84c503a6d1f85 {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 09:47:49.541602 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-ff9a2cd5-68dc-4b82-8fd3-82fb094c7b84 tempest-VolumesBackupsTest-118275719 None] Calling eventlet.sleep(0) {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 09:47:49.723593 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-ff9a2cd5-68dc-4b82-8fd3-82fb094c7b84 tempest-VolumesBackupsTest-118275719 None] Backing up chunk of data from volume. {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 09:47:49.978178 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-ff9a2cd5-68dc-4b82-8fd3-82fb094c7b84 tempest-VolumesBackupsTest-118275719 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101319) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 09:47:49.979371 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-ff9a2cd5-68dc-4b82-8fd3-82fb094c7b84 tempest-VolumesBackupsTest-118275719 None] About to put_object {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 09:47:50.068788 np0000004400 cinder-backup[101319]: INFO cinder.backup.manager [None req-7222a40f-51a0-40fa-9d1b-daf340fa3b17 tempest-VolumesBackupsTest-2142009639 None] Create backup started, backup: 8763861d-eff9-45d6-812c-fb65cb7ebea7 volume: 8a0b1cfb-8ea1-46a0-aac3-b254107b98ef. Jul 03 09:47:50.074786 np0000004400 cinder-backup[101319]: INFO cinder.backup.manager [None req-7222a40f-51a0-40fa-9d1b-daf340fa3b17 tempest-VolumesBackupsTest-2142009639 None] Call Volume Manager to get_backup_device for Backup(availability_zone='nova',container='tempest-volumesbackupstest-backup-container-422378187',created_at=2026-07-03T09:47:50Z,data_timestamp=2026-07-03T09:47:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesBackupsTest-Backup-2013885995',encryption_key_id=None,fail_reason=None,host='np0000004400',id=8763861d-eff9-45d6-812c-fb65cb7ebea7,metadata={},num_dependent_backups=0,object_count=0,parent=Backup(86118233-3d57-47ad-8781-cab6c54e4d53),parent_id='86118233-3d57-47ad-8781-cab6c54e4d53',project_id='59044e18a5b24b19a7b9b8a380f2e1a0',restore_volume_id=None,service='cinder.backup.drivers.swift.SwiftBackupDriver',service_metadata=None,size=1,snapshot_id=None,status='creating',temp_snapshot_id=None,temp_volume_id=None,updated_at=None,user_id='91463b6c437c4711a49d3c31c513a101',volume_id=8a0b1cfb-8ea1-46a0-aac3-b254107b98ef) Jul 03 09:47:50.092576 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-ff9a2cd5-68dc-4b82-8fd3-82fb094c7b84 tempest-VolumesBackupsTest-118275719 None] backup MD5 for volume_e49954d5-d017-43d5-8565-25ce9e2693f9/20260703094739/az_nova_backup_06482a6e-a410-44d6-85cf-84392df124bc-00017: 25e317773f308e446cc84c503a6d1f85 {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 09:47:50.092761 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-ff9a2cd5-68dc-4b82-8fd3-82fb094c7b84 tempest-VolumesBackupsTest-118275719 None] Calling eventlet.sleep(0) {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 09:47:50.164782 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.drivers.swift [None req-7222a40f-51a0-40fa-9d1b-daf340fa3b17 tempest-VolumesBackupsTest-2142009639 None] Using swift URL https://10.4.3.95:8080/v1/AUTH_59044e18a5b24b19a7b9b8a380f2e1a0 {{(pid=101319) initialize /opt/stack/cinder/cinder/backup/drivers/swift.py:300}} Jul 03 09:47:50.165284 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.drivers.swift [None req-7222a40f-51a0-40fa-9d1b-daf340fa3b17 tempest-VolumesBackupsTest-2142009639 None] Connect to https://10.4.3.95:8080/v1/AUTH_ in "per_user" mode {{(pid=101319) initialize /opt/stack/cinder/cinder/backup/drivers/swift.py:301}} Jul 03 09:47:50.165673 np0000004400 cinder-backup[101319]: DEBUG os_brick.utils [None req-7222a40f-51a0-40fa-9d1b-daf340fa3b17 tempest-VolumesBackupsTest-2142009639 None] ==> get_connector_properties: call "{'root_helper': 'sudo cinder-rootwrap /etc/cinder/rootwrap.conf', 'my_ip': '10.4.3.95', 'multipath': False, 'enforce_multipath': False, 'host': None, 'execute': None}" {{(pid=101319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}} Jul 03 09:47:50.177424 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.scaleio [None req-7222a40f-51a0-40fa-9d1b-daf340fa3b17 tempest-VolumesBackupsTest-2142009639 None] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=101319) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}} Jul 03 09:47:50.195606 np0000004400 cinder-backup[101319]: DEBUG oslo_concurrency.processutils [None req-7222a40f-51a0-40fa-9d1b-daf340fa3b17 tempest-VolumesBackupsTest-2142009639 None] Running cmd (subprocess): nvme version {{(pid=101319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 09:47:50.211931 np0000004400 cinder-backup[101319]: DEBUG oslo_concurrency.processutils [None req-7222a40f-51a0-40fa-9d1b-daf340fa3b17 tempest-VolumesBackupsTest-2142009639 None] 'nvme version' failed. Not Retrying. {{(pid=101319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 03 09:47:50.215430 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.nvmeof [None req-7222a40f-51a0-40fa-9d1b-daf340fa3b17 tempest-VolumesBackupsTest-2142009639 None] nvme not present on system {{(pid=101319) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}} Jul 03 09:47:50.220655 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.lightos [None req-7222a40f-51a0-40fa-9d1b-daf340fa3b17 tempest-VolumesBackupsTest-2142009639 None] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=101319) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}} Jul 03 09:47:50.221910 np0000004400 cinder-backup[101319]: INFO os_brick.initiator.connectors.lightos [None req-7222a40f-51a0-40fa-9d1b-daf340fa3b17 tempest-VolumesBackupsTest-2142009639 None] Current host hostNQN and IP(s) are ['10.4.3.95', 'fe80::f816:3eff:fe47:268c', '192.168.40.6', 'fe80::f816:3eff:febf:7be2', '192.168.50.6', 'fe80::f816:3eff:fe99:8914', '192.168.10.6', 'fe80::f816:3eff:fe2f:e696', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::bc9d:84ff:fec2:6b49', 'fe80::fc16:3eff:fe97:90a6', 'fe80::8435:18ff:feb9:798c', 'fe80::fc16:3eff:feda:9a9f', 'fe80::28c1:27ff:fe3c:5528', 'fe80::fc16:3eff:fec1:41ad', 'fe80::4007:baff:fe0f:8f44', 'fe80::fc16:3eff:fe61:2930', 'fe80::fcb0:4aff:fe6d:1fcf'] Jul 03 09:47:50.222059 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.lightos [None req-7222a40f-51a0-40fa-9d1b-daf340fa3b17 tempest-VolumesBackupsTest-2142009639 None] LIGHTOS: did not find dsc, continuing anyway. {{(pid=101319) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}} Jul 03 09:47:50.222217 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.lightos [None req-7222a40f-51a0-40fa-9d1b-daf340fa3b17 tempest-VolumesBackupsTest-2142009639 None] LIGHTOS: no hostnqn found. {{(pid=101319) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}} Jul 03 09:47:50.222571 np0000004400 cinder-backup[101319]: DEBUG os_brick.utils [None req-7222a40f-51a0-40fa-9d1b-daf340fa3b17 tempest-VolumesBackupsTest-2142009639 None] <== get_connector_properties: return (56ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.95', 'host': 'np0000004400', 'multipath': False, 'enforce_multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:ae7e5bb0ebe6', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': '6b284368-d0ba-4d18-af6f-4998d3955c52', 'nvme_native_multipath': False} {{(pid=101319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}} Jul 03 09:47:50.340002 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-ff9a2cd5-68dc-4b82-8fd3-82fb094c7b84 tempest-VolumesBackupsTest-118275719 None] Backing up chunk of data from volume. {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 09:47:50.586573 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-ff9a2cd5-68dc-4b82-8fd3-82fb094c7b84 tempest-VolumesBackupsTest-118275719 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101319) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 09:47:50.587042 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-ff9a2cd5-68dc-4b82-8fd3-82fb094c7b84 tempest-VolumesBackupsTest-118275719 None] About to put_object {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 09:47:50.687935 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-ff9a2cd5-68dc-4b82-8fd3-82fb094c7b84 tempest-VolumesBackupsTest-118275719 None] backup MD5 for volume_e49954d5-d017-43d5-8565-25ce9e2693f9/20260703094739/az_nova_backup_06482a6e-a410-44d6-85cf-84392df124bc-00018: 25e317773f308e446cc84c503a6d1f85 {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 09:47:50.688145 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-ff9a2cd5-68dc-4b82-8fd3-82fb094c7b84 tempest-VolumesBackupsTest-118275719 None] Calling eventlet.sleep(0) {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 09:47:50.721274 np0000004400 cinder-backup[101319]: DEBUG oslo_db.sqlalchemy.engines [None req-ff9a2cd5-68dc-4b82-8fd3-82fb094c7b84 tempest-VolumesBackupsTest-118275719 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=101319) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 03 09:47:50.726259 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connector [None req-7222a40f-51a0-40fa-9d1b-daf340fa3b17 tempest-VolumesBackupsTest-2142009639 None] Factory for iscsi on None {{(pid=101319) factory /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connector.py:243}} Jul 03 09:47:50.726760 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-7222a40f-51a0-40fa-9d1b-daf340fa3b17 tempest-VolumesBackupsTest-2142009639 None] ==> connect_volume: call "{'self': , 'connection_properties': {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-17bc2851-cb3a-4797-93e7-4d33135c0ea1', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '17bc2851-cb3a-4797-93e7-4d33135c0ea1', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': False}}" {{(pid=101319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}} Jul 03 09:47:50.726981 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.base [None req-7222a40f-51a0-40fa-9d1b-daf340fa3b17 tempest-VolumesBackupsTest-2142009639 None] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=101319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jul 03 09:47:50.875507 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-ff9a2cd5-68dc-4b82-8fd3-82fb094c7b84 tempest-VolumesBackupsTest-118275719 None] Backing up chunk of data from volume. {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 09:47:51.115425 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-ff9a2cd5-68dc-4b82-8fd3-82fb094c7b84 tempest-VolumesBackupsTest-118275719 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101319) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 09:47:51.115666 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-ff9a2cd5-68dc-4b82-8fd3-82fb094c7b84 tempest-VolumesBackupsTest-118275719 None] About to put_object {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 09:47:51.216098 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-ff9a2cd5-68dc-4b82-8fd3-82fb094c7b84 tempest-VolumesBackupsTest-118275719 None] backup MD5 for volume_e49954d5-d017-43d5-8565-25ce9e2693f9/20260703094739/az_nova_backup_06482a6e-a410-44d6-85cf-84392df124bc-00019: 25e317773f308e446cc84c503a6d1f85 {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 09:47:51.216224 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-ff9a2cd5-68dc-4b82-8fd3-82fb094c7b84 tempest-VolumesBackupsTest-118275719 None] Calling eventlet.sleep(0) {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 09:47:51.405611 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-ff9a2cd5-68dc-4b82-8fd3-82fb094c7b84 tempest-VolumesBackupsTest-118275719 None] Backing up chunk of data from volume. {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 09:47:51.648303 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-ff9a2cd5-68dc-4b82-8fd3-82fb094c7b84 tempest-VolumesBackupsTest-118275719 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101319) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 09:47:51.648739 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-ff9a2cd5-68dc-4b82-8fd3-82fb094c7b84 tempest-VolumesBackupsTest-118275719 None] About to put_object {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 09:47:51.746286 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-ff9a2cd5-68dc-4b82-8fd3-82fb094c7b84 tempest-VolumesBackupsTest-118275719 None] backup MD5 for volume_e49954d5-d017-43d5-8565-25ce9e2693f9/20260703094739/az_nova_backup_06482a6e-a410-44d6-85cf-84392df124bc-00020: 25e317773f308e446cc84c503a6d1f85 {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 09:47:51.746449 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-ff9a2cd5-68dc-4b82-8fd3-82fb094c7b84 tempest-VolumesBackupsTest-118275719 None] Calling eventlet.sleep(0) {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 09:47:51.857715 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-ff9a2cd5-68dc-4b82-8fd3-82fb094c7b84 tempest-VolumesBackupsTest-118275719 None] Backing up chunk of data from volume. {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 09:47:51.980343 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-ff9a2cd5-68dc-4b82-8fd3-82fb094c7b84 tempest-VolumesBackupsTest-118275719 None] Compressed 25165824 bytes of data to 24470 bytes using zlib. {{(pid=101319) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 09:47:51.980554 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-ff9a2cd5-68dc-4b82-8fd3-82fb094c7b84 tempest-VolumesBackupsTest-118275719 None] About to put_object {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 09:47:52.042976 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-ff9a2cd5-68dc-4b82-8fd3-82fb094c7b84 tempest-VolumesBackupsTest-118275719 None] backup MD5 for volume_e49954d5-d017-43d5-8565-25ce9e2693f9/20260703094739/az_nova_backup_06482a6e-a410-44d6-85cf-84392df124bc-00021: 77377273b0a4b61febdbf7bbf52b9db9 {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 09:47:52.043126 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-ff9a2cd5-68dc-4b82-8fd3-82fb094c7b84 tempest-VolumesBackupsTest-118275719 None] Calling eventlet.sleep(0) {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 09:47:52.052055 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.driver [None req-ff9a2cd5-68dc-4b82-8fd3-82fb094c7b84 tempest-VolumesBackupsTest-118275719 None] Getting metadata type 'volume-base-metadata' {{(pid=101319) _save_vol_base_meta /opt/stack/cinder/cinder/backup/driver.py:79}} Jul 03 09:47:52.058634 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.driver [None req-ff9a2cd5-68dc-4b82-8fd3-82fb094c7b84 tempest-VolumesBackupsTest-118275719 None] Completed fetching metadata type 'volume-base-metadata' {{(pid=101319) _save_vol_base_meta /opt/stack/cinder/cinder/backup/driver.py:98}} Jul 03 09:47:52.058871 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.driver [None req-ff9a2cd5-68dc-4b82-8fd3-82fb094c7b84 tempest-VolumesBackupsTest-118275719 None] Getting metadata type 'volume-metadata' {{(pid=101319) _save_vol_meta /opt/stack/cinder/cinder/backup/driver.py:109}} Jul 03 09:47:52.066022 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.driver [None req-ff9a2cd5-68dc-4b82-8fd3-82fb094c7b84 tempest-VolumesBackupsTest-118275719 None] No metadata type 'volume-metadata' available {{(pid=101319) _save_vol_meta /opt/stack/cinder/cinder/backup/driver.py:123}} Jul 03 09:47:52.066236 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.driver [None req-ff9a2cd5-68dc-4b82-8fd3-82fb094c7b84 tempest-VolumesBackupsTest-118275719 None] Getting metadata type 'volume-glance-metadata' {{(pid=101319) _save_vol_glance_meta /opt/stack/cinder/cinder/backup/driver.py:132}} Jul 03 09:47:52.069829 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.driver [None req-ff9a2cd5-68dc-4b82-8fd3-82fb094c7b84 tempest-VolumesBackupsTest-118275719 None] No metadata type 'volume-glance-metadata' available {{(pid=101319) _save_vol_glance_meta /opt/stack/cinder/cinder/backup/driver.py:147}} Jul 03 09:47:52.070108 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-ff9a2cd5-68dc-4b82-8fd3-82fb094c7b84 tempest-VolumesBackupsTest-118275719 None] _write_sha256file started, container name: volumebackups, sha256file filename: volume_e49954d5-d017-43d5-8565-25ce9e2693f9/20260703094739/az_nova_backup_06482a6e-a410-44d6-85cf-84392df124bc_sha256file. {{(pid=101319) _write_sha256file /opt/stack/cinder/cinder/backup/chunkeddriver.py:299}} Jul 03 09:47:52.135985 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-ff9a2cd5-68dc-4b82-8fd3-82fb094c7b84 tempest-VolumesBackupsTest-118275719 None] _write_sha256file finished. {{(pid=101319) _write_sha256file /opt/stack/cinder/cinder/backup/chunkeddriver.py:315}} Jul 03 09:47:52.136836 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-ff9a2cd5-68dc-4b82-8fd3-82fb094c7b84 tempest-VolumesBackupsTest-118275719 None] _write_metadata started, container name: volumebackups, metadata filename: volume_e49954d5-d017-43d5-8565-25ce9e2693f9/20260703094739/az_nova_backup_06482a6e-a410-44d6-85cf-84392df124bc_metadata. {{(pid=101319) _write_metadata /opt/stack/cinder/cinder/backup/chunkeddriver.py:276}} Jul 03 09:47:52.167597 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-ff9a2cd5-68dc-4b82-8fd3-82fb094c7b84 tempest-VolumesBackupsTest-118275719 None] _write_metadata finished. Metadata: b'{\n "backup_description": null,\n "backup_id": "06482a6e-a410-44d6-85cf-84392df124bc",\n "backup_name": "tempest-VolumesBackupsTest-Backup-1365674745",\n "created_at": "2026-07-03 09:47:34+00:00",\n "objects": [\n {\n "volume_e49954d5-d017-43d5-8565-25ce9e2693f9/20260703094739/az_nova_backup_06482a6e-a410-44d6-85cf-84392df124bc-00001": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 0\n }\n },\n {\n "volume_e49954d5-d017-43d5-8565-25ce9e2693f9/20260703094739/az_nova_backup_06482a6e-a410-44d6-85cf-84392df124bc-00002": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 52428800\n }\n },\n {\n "volume_e49954d5-d017-43d5-8565-25ce9e2693f9/20260703094739/az_nova_backup_06482a6e-a410-44d6-85cf-84392df124bc-00003": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 104857600\n }\n },\n {\n "volume_e49954d5-d017-43d5-8565-25ce9e2693f9/20260703094739/az_nova_backup_06482a6e-a410-44d6-85cf-84392df124bc-00004": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 157286400\n }\n },\n {\n "volume_e49954d5-d017-43d5-8565-25ce9e2693f9/20260703094739/az_nova_backup_06482a6e-a410-44d6-85cf-84392df124bc-00005": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 209715200\n }\n },\n {\n "volume_e49954d5-d017-43d5-8565-25ce9e2693f9/20260703094739/az_nova_backup_06482a6e-a410-44d6-85cf-84392df124bc-00006": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 262144000\n }\n },\n {\n "volume_e49954d5-d017-43d5-8565-25ce9e2693f9/20260703094739/az_nova_backup_06482a6e-a410-44d6-85cf-84392df124bc-00007": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 314572800\n }\n },\n {\n "volume_e49954d5-d017-43d5-8565-25ce9e2693f9/20260703094739/az_nova_backup_06482a6e-a410-44d6-85cf-84392df124bc-00008": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 367001600\n }\n },\n {\n "volume_e49954d5-d017-43d5-8565-25ce9e2693f9/20260703094739/az_nova_backup_06482a6e-a410-44d6-85cf-84392df124bc-00009": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 419430400\n }\n },\n {\n "volume_e49954d5-d017-43d5-8565-25ce9e2693f9/20260703094739/az_nova_backup_06482a6e-a410-44d6-85cf-84392df124bc-00010": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 471859200\n }\n },\n {\n "volume_e49954d5-d017-43d5-8565-25ce9e2693f9/20260703094739/az_nova_backup_06482a6e-a410-44d6-85cf-84392df124bc-00011": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 524288000\n }\n },\n {\n "volume_e49954d5-d017-43d5-8565-25ce9e2693f9/20260703094739/az_nova_backup_06482a6e-a410-44d6-85cf-84392df124bc-00012": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 576716800\n }\n },\n {\n "volume_e49954d5-d017-43d5-8565-25ce9e2693f9/20260703094739/az_nova_backup_06482a6e-a410-44d6-85cf-84392df124bc-00013": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 629145600\n }\n },\n {\n "volume_e49954d5-d017-43d5-8565-25ce9e2693f9/20260703094739/az_nova_backup_06482a6e-a410-44d6-85cf-84392df124bc-00014": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 681574400\n }\n },\n {\n "volume_e49954d5-d017-43d5-8565-25ce9e2693f9/20260703094739/az_nova_backup_06482a6e-a410-44d6-85cf-84392df124bc-00015": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 734003200\n }\n },\n {\n "volume_e49954d5-d017-43d5-8565-25ce9e2693f9/20260703094739/az_nova_backup_06482a6e-a410-44d6-85cf-84392df124bc-00016": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 786432000\n }\n },\n {\n "volume_e49954d5-d017-43d5-8565-25ce9e2693f9/20260703094739/az_nova_backup_06482a6e-a410-44d6-85cf-84392df124bc-00017": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 838860800\n }\n },\n {\n "volume_e49954d5-d017-43d5-8565-25ce9e2693f9/20260703094739/az_nova_backup_06482a6e-a410-44d6-85cf-84392df124bc-00018": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 891289600\n }\n },\n {\n "volume_e49954d5-d017-43d5-8565-25ce9e2693f9/20260703094739/az_nova_backup_06482a6e-a410-44d6-85cf-84392df124bc-00019": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 943718400\n }\n },\n {\n "volume_e49954d5-d017-43d5-8565-25ce9e2693f9/20260703094739/az_nova_backup_06482a6e-a410-44d6-85cf-84392df124bc-00020": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 996147200\n }\n },\n {\n "volume_e49954d5-d017-43d5-8565-25ce9e2693f9/20260703094739/az_nova_backup_06482a6e-a410-44d6-85cf-84392df124bc-00021": {\n "compression": "zlib",\n "length": 25165824,\n "md5": "77377273b0a4b61febdbf7bbf52b9db9",\n "offset": 1048576000\n }\n }\n ],\n "parent_id": null,\n "version": "1.0.0",\n "volume_id": "e49954d5-d017-43d5-8565-25ce9e2693f9",\n "volume_meta": "{\\"version\\": 2, \\"volume-base-metadata\\": {\\"id\\": \\"e49954d5-d017-43d5-8565-25ce9e2693f9\\", \\"_name_id\\": null, \\"use_quota\\": true, \\"ec2_id\\": null, \\"user_id\\": \\"b861df2a13684334b293b1f348152e37\\", \\"project_id\\": \\"a484ec9218bf417bb9d7575ae6370646\\", \\"snapshot_id\\": null, \\"cluster_name\\": null, \\"host\\": \\"np0000004400@storpool#template_virtual\\", \\"size\\": 1, \\"availability_zone\\": \\"nova\\", \\"status\\": \\"available\\", \\"attach_status\\": \\"detached\\", \\"migration_status\\": null, \\"scheduled_at\\": \\"2026-07-03T09:47:32.000000\\", \\"launched_at\\": \\"2026-07-03T09:47:32.000000\\", \\"terminated_at\\": null, \\"display_name\\": \\"tempest-VolumesBackupsTest-Volume-731300880\\", \\"display_description\\": null, \\"provider_location\\": null, \\"provider_auth\\": null, \\"provider_geometry\\": null, \\"provider_id\\": null, \\"volume_type_id\\": \\"03e13fe6-0e30-4803-ace0-725d38e6dc24\\", \\"source_volid\\": null, \\"encryption_key_id\\": null, \\"consistencygroup_id\\": null, \\"group_id\\": null, \\"bootable\\": false, \\"multiattach\\": false, \\"replication_status\\": null, \\"replication_extended_status\\": null, \\"replication_driver_data\\": null, \\"previous_status\\": null, \\"service_uuid\\": \\"6d4b0e79-fefe-4744-b25f-34be05095200\\", \\"shared_targets\\": true, \\"deleted_at\\": null, \\"deleted\\": false, \\"created_at\\": \\"2026-07-03T09:47:31.000000\\", \\"updated_at\\": \\"2026-07-03T09:47:32.000000\\"}}"\n}'. {{(pid=101319) _write_metadata /opt/stack/cinder/cinder/backup/chunkeddriver.py:295}} Jul 03 09:47:52.175529 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-ff9a2cd5-68dc-4b82-8fd3-82fb094c7b84 tempest-VolumesBackupsTest-118275719 None] backup 06482a6e-a410-44d6-85cf-84392df124bc finished. {{(pid=101319) _finalize_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:462}} Jul 03 09:47:52.307283 np0000004400 cinder-backup[101319]: DEBUG oslo_concurrency.processutils [None req-ff9a2cd5-68dc-4b82-8fd3-82fb094c7b84 tempest-VolumesBackupsTest-118275719 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chown 0 /dev/sdh {{(pid=101319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 09:47:52.313789 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.base [None req-7222a40f-51a0-40fa-9d1b-daf340fa3b17 tempest-VolumesBackupsTest-2142009639 None] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 1.586s {{(pid=101319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jul 03 09:47:52.314149 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.base [None req-7222a40f-51a0-40fa-9d1b-daf340fa3b17 tempest-VolumesBackupsTest-2142009639 None] Connection properties {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-17bc2851-cb3a-4797-93e7-4d33135c0ea1', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '17bc2851-cb3a-4797-93e7-4d33135c0ea1', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': False} {{(pid=101319) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}} Jul 03 09:47:52.324503 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.base [None req-7222a40f-51a0-40fa-9d1b-daf340fa3b17 tempest-VolumesBackupsTest-2142009639 None] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-17bc2851-cb3a-4797-93e7-4d33135c0ea1" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=101319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jul 03 09:47:52.324685 np0000004400 sudo[142179]: stack : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chown 0 /dev/sdh Jul 03 09:47:52.324988 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.base [None req-7222a40f-51a0-40fa-9d1b-daf340fa3b17 tempest-VolumesBackupsTest-2142009639 None] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-17bc2851-cb3a-4797-93e7-4d33135c0ea1" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=101319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jul 03 09:47:52.325242 np0000004400 cinder-backup[101319]: INFO os_brick.initiator.connectors.iscsi [None req-7222a40f-51a0-40fa-9d1b-daf340fa3b17 tempest-VolumesBackupsTest-2142009639 None] Trying to connect to iSCSI portal 192.168.40.100:3260 Jul 03 09:47:52.325432 np0000004400 sudo[142179]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1002) Jul 03 09:47:52.336050 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-7222a40f-51a0-40fa-9d1b-daf340fa3b17 tempest-VolumesBackupsTest-2142009639 None] iscsiadm (): stdout= stderr=iscsiadm: No records found Jul 03 09:47:52.336050 np0000004400 cinder-backup[101319]: {{(pid=101319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 03 09:47:52.346954 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-7222a40f-51a0-40fa-9d1b-daf340fa3b17 tempest-VolumesBackupsTest-2142009639 None] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-17bc2851-cb3a-4797-93e7-4d33135c0ea1] added Jul 03 09:47:52.346954 np0000004400 cinder-backup[101319]: stderr=iscsiadm: Config file line 363 does not have value Jul 03 09:47:52.346954 np0000004400 cinder-backup[101319]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs' Jul 03 09:47:52.346954 np0000004400 cinder-backup[101319]: iscsiadm: Config file line 363 does not have value Jul 03 09:47:52.346954 np0000004400 cinder-backup[101319]: iscsiadm: Config file line 363 does not have value Jul 03 09:47:52.346954 np0000004400 cinder-backup[101319]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs' Jul 03 09:47:52.346954 np0000004400 cinder-backup[101319]: {{(pid=101319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 03 09:47:52.346954 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-7222a40f-51a0-40fa-9d1b-daf340fa3b17 tempest-VolumesBackupsTest-2142009639 None] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=101319) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}} Jul 03 09:47:52.347362 np0000004400 cinder-backup[101319]: DEBUG os_brick.utils [None req-7222a40f-51a0-40fa-9d1b-daf340fa3b17 tempest-VolumesBackupsTest-2142009639 None] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.022(s), this was the 1st time calling it. {{(pid=101319) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}} Jul 03 09:47:52.347432 np0000004400 cinder-backup[101319]: DEBUG os_brick.utils [None req-7222a40f-51a0-40fa-9d1b-daf340fa3b17 tempest-VolumesBackupsTest-2142009639 None] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=101319) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}} Jul 03 09:47:52.631054 np0000004400 sudo[142179]: pam_unix(sudo:session): session closed for user root Jul 03 09:47:52.633082 np0000004400 cinder-backup[101319]: DEBUG oslo_concurrency.processutils [None req-ff9a2cd5-68dc-4b82-8fd3-82fb094c7b84 tempest-VolumesBackupsTest-118275719 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chown 0 /dev/sdh" returned: 0 in 0.326s {{(pid=101319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 09:47:52.633820 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-ff9a2cd5-68dc-4b82-8fd3-82fb094c7b84 tempest-VolumesBackupsTest-118275719 None] ==> disconnect_volume: call "{'args': (, {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-25552aca-10fe-4ac0-affd-19717e76efc4', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '25552aca-10fe-4ac0-affd-19717e76efc4', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': False}, {'type': 'block', 'scsi_wwn': 'SStorPool_iSCSI_DISK_1034578903445799090', 'path': '/dev/sdh'}), 'kwargs': {'force': True, 'ignore_errors': True}}" {{(pid=101319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}} Jul 03 09:47:52.634104 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.base [None req-ff9a2cd5-68dc-4b82-8fd3-82fb094c7b84 tempest-VolumesBackupsTest-118275719 None] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=101319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jul 03 09:47:53.348560 np0000004400 cinder-backup[101319]: INFO os_brick.initiator.connectors.iscsi [None req-7222a40f-51a0-40fa-9d1b-daf340fa3b17 tempest-VolumesBackupsTest-2142009639 None] Trying to connect to iSCSI portal 192.168.40.100:3260 Jul 03 09:47:53.360940 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-7222a40f-51a0-40fa-9d1b-daf340fa3b17 tempest-VolumesBackupsTest-2142009639 None] iscsiadm (): stdout=# BEGIN RECORD 2.1.9 Jul 03 09:47:53.360940 np0000004400 cinder-backup[101319]: node.name = iqn.2023-03.storpool.com:os--volume-17bc2851-cb3a-4797-93e7-4d33135c0ea1 Jul 03 09:47:53.360940 np0000004400 cinder-backup[101319]: node.tpgt = -1 Jul 03 09:47:53.360940 np0000004400 cinder-backup[101319]: node.startup = manual Jul 03 09:47:53.360940 np0000004400 cinder-backup[101319]: node.leading_login = No Jul 03 09:47:53.360940 np0000004400 cinder-backup[101319]: iface.iscsi_ifacename = default Jul 03 09:47:53.360940 np0000004400 cinder-backup[101319]: iface.net_ifacename = Jul 03 09:47:53.360940 np0000004400 cinder-backup[101319]: iface.ipaddress = Jul 03 09:47:53.360940 np0000004400 cinder-backup[101319]: iface.prefix_len = 0 Jul 03 09:47:53.360940 np0000004400 cinder-backup[101319]: iface.hwaddress = Jul 03 09:47:53.360940 np0000004400 cinder-backup[101319]: iface.transport_name = tcp Jul 03 09:47:53.360940 np0000004400 cinder-backup[101319]: iface.initiatorname = Jul 03 09:47:53.360940 np0000004400 cinder-backup[101319]: iface.state = Jul 03 09:47:53.360940 np0000004400 cinder-backup[101319]: iface.vlan_id = 0 Jul 03 09:47:53.360940 np0000004400 cinder-backup[101319]: iface.vlan_priority = 0 Jul 03 09:47:53.360940 np0000004400 cinder-backup[101319]: iface.vlan_state = Jul 03 09:47:53.360940 np0000004400 cinder-backup[101319]: iface.iface_num = 0 Jul 03 09:47:53.360940 np0000004400 cinder-backup[101319]: iface.mtu = 0 Jul 03 09:47:53.360940 np0000004400 cinder-backup[101319]: iface.port = 0 Jul 03 09:47:53.360940 np0000004400 cinder-backup[101319]: iface.bootproto = Jul 03 09:47:53.360940 np0000004400 cinder-backup[101319]: iface.subnet_mask = Jul 03 09:47:53.360940 np0000004400 cinder-backup[101319]: iface.gateway = Jul 03 09:47:53.360940 np0000004400 cinder-backup[101319]: iface.dhcp_alt_client_id_state = Jul 03 09:47:53.360940 np0000004400 cinder-backup[101319]: iface.dhcp_alt_client_id = Jul 03 09:47:53.360940 np0000004400 cinder-backup[101319]: iface.dhcp_dns = Jul 03 09:47:53.360940 np0000004400 cinder-backup[101319]: iface.dhcp_learn_iqn = Jul 03 09:47:53.360940 np0000004400 cinder-backup[101319]: iface.dhcp_req_vendor_id_state = Jul 03 09:47:53.360940 np0000004400 cinder-backup[101319]: iface.dhcp_vendor_id_state = Jul 03 09:47:53.360940 np0000004400 cinder-backup[101319]: iface.dhcp_vendor_id = Jul 03 09:47:53.360940 np0000004400 cinder-backup[101319]: iface.dhcp_slp_da = Jul 03 09:47:53.360940 np0000004400 cinder-backup[101319]: iface.fragmentation = Jul 03 09:47:53.360940 np0000004400 cinder-backup[101319]: iface.gratuitous_arp = Jul 03 09:47:53.360940 np0000004400 cinder-backup[101319]: iface.incoming_forwarding = Jul 03 09:47:53.360940 np0000004400 cinder-backup[101319]: iface.tos_state = Jul 03 09:47:53.360940 np0000004400 cinder-backup[101319]: iface.tos = 0 Jul 03 09:47:53.360940 np0000004400 cinder-backup[101319]: iface.ttl = 0 Jul 03 09:47:53.360940 np0000004400 cinder-backup[101319]: iface.delayed_ack = Jul 03 09:47:53.360940 np0000004400 cinder-backup[101319]: iface.tcp_nagle = Jul 03 09:47:53.360940 np0000004400 cinder-backup[101319]: iface.tcp_wsf_state = Jul 03 09:47:53.360940 np0000004400 cinder-backup[101319]: iface.tcp_wsf = 0 Jul 03 09:47:53.360940 np0000004400 cinder-backup[101319]: iface.tcp_timer_scale = 0 Jul 03 09:47:53.360940 np0000004400 cinder-backup[101319]: iface.tcp_timestamp = Jul 03 09:47:53.360940 np0000004400 cinder-backup[101319]: iface.redirect = Jul 03 09:47:53.360940 np0000004400 cinder-backup[101319]: iface.def_task_mgmt_timeout = 0 Jul 03 09:47:53.360940 np0000004400 cinder-backup[101319]: iface.header_digest = Jul 03 09:47:53.360940 np0000004400 cinder-backup[101319]: iface.data_digest = Jul 03 09:47:53.360940 np0000004400 cinder-backup[101319]: iface.immediate_data = Jul 03 09:47:53.360940 np0000004400 cinder-backup[101319]: iface.initial_r2t = Jul 03 09:47:53.360940 np0000004400 cinder-backup[101319]: iface.data_seq_inorder = Jul 03 09:47:53.360940 np0000004400 cinder-backup[101319]: iface.data_pdu_inorder = Jul 03 09:47:53.360940 np0000004400 cinder-backup[101319]: iface.erl = 0 Jul 03 09:47:53.360940 np0000004400 cinder-backup[101319]: iface.max_receive_data_len = 0 Jul 03 09:47:53.360940 np0000004400 cinder-backup[101319]: iface.first_burst_len = 0 Jul 03 09:47:53.360940 np0000004400 cinder-backup[101319]: iface.max_outstanding_r2t = 0 Jul 03 09:47:53.360940 np0000004400 cinder-backup[101319]: iface.max_burst_len = 0 Jul 03 09:47:53.360940 np0000004400 cinder-backup[101319]: iface.chap_auth = Jul 03 09:47:53.360940 np0000004400 cinder-backup[101319]: iface.bidi_chap = Jul 03 09:47:53.360940 np0000004400 cinder-backup[101319]: iface.strict_login_compliance = Jul 03 09:47:53.360940 np0000004400 cinder-backup[101319]: iface.discovery_auth = Jul 03 09:47:53.360940 np0000004400 cinder-backup[101319]: iface.discovery_logout = Jul 03 09:47:53.360940 np0000004400 cinder-backup[101319]: node.discovery_address = Jul 03 09:47:53.360940 np0000004400 cinder-backup[101319]: node.discovery_port = 0 Jul 03 09:47:53.360940 np0000004400 cinder-backup[101319]: node.discovery_type = fw Jul 03 09:47:53.360940 np0000004400 cinder-backup[101319]: node.session.initial_cmdsn = 0 Jul 03 09:47:53.360940 np0000004400 cinder-backup[101319]: node.session.initial_login_retry_max = 8 Jul 03 09:47:53.360940 np0000004400 cinder-backup[101319]: node.session.xmit_thread_priority = 0 Jul 03 09:47:53.360940 np0000004400 cinder-backup[101319]: node.session.cmds_max = 128 Jul 03 09:47:53.360940 np0000004400 cinder-backup[101319]: node.session.queue_depth = 32 Jul 03 09:47:53.360940 np0000004400 cinder-backup[101319]: node.session.nr_sessions = 1 Jul 03 09:47:53.360940 np0000004400 cinder-backup[101319]: node.session.auth.authmethod = None Jul 03 09:47:53.360940 np0000004400 cinder-backup[101319]: node.session.auth.username = Jul 03 09:47:53.360940 np0000004400 cinder-backup[101319]: node.session.auth.password = *** Jul 03 09:47:53.360940 np0000004400 cinder-backup[101319]: node.session.auth.username_in = Jul 03 09:47:53.360940 np0000004400 cinder-backup[101319]: node.session.auth.password_in = Jul 03 09:47:53.360940 np0000004400 cinder-backup[101319]: node.session.auth.chap_algs = SHA256 Jul 03 09:47:53.360940 np0000004400 cinder-backup[101319]: node.session.timeo.replacement_timeout = 120 Jul 03 09:47:53.360940 np0000004400 cinder-backup[101319]: node.session.err_timeo.abort_timeout = 15 Jul 03 09:47:53.360940 np0000004400 cinder-backup[101319]: node.session.err_timeo.lu_reset_timeout = 30 Jul 03 09:47:53.360940 np0000004400 cinder-backup[101319]: node.session.err_timeo.tgt_reset_timeout = 30 Jul 03 09:47:53.360940 np0000004400 cinder-backup[101319]: node.session.err_timeo.host_reset_timeout = 60 Jul 03 09:47:53.360940 np0000004400 cinder-backup[101319]: node.session.iscsi.FastAbort = Yes Jul 03 09:47:53.360940 np0000004400 cinder-backup[101319]: node.session.iscsi.InitialR2T = No Jul 03 09:47:53.360940 np0000004400 cinder-backup[101319]: node.session.iscsi.ImmediateData = Yes Jul 03 09:47:53.360940 np0000004400 cinder-backup[101319]: node.session.iscsi.FirstBurstLength = 262144 Jul 03 09:47:53.360940 np0000004400 cinder-backup[101319]: node.session.iscsi.MaxBurstLength = 16776192 Jul 03 09:47:53.360940 np0000004400 cinder-backup[101319]: node.session.iscsi.DefaultTime2Retain = 0 Jul 03 09:47:53.360940 np0000004400 cinder-backup[101319]: node.session.iscsi.DefaultTime2Wait = 2 Jul 03 09:47:53.360940 np0000004400 cinder-backup[101319]: node.session.iscsi.MaxConnections = 1 Jul 03 09:47:53.360940 np0000004400 cinder-backup[101319]: node.session.iscsi.MaxOutstandingR2T = 1 Jul 03 09:47:53.360940 np0000004400 cinder-backup[101319]: node.session.iscsi.ERL = 0 Jul 03 09:47:53.360940 np0000004400 cinder-backup[101319]: node.session.scan = auto Jul 03 09:47:53.360940 np0000004400 cinder-backup[101319]: node.session.reopen_max = 0 Jul 03 09:47:53.360940 np0000004400 cinder-backup[101319]: node.conn[0].address = 192.168.40.100 Jul 03 09:47:53.360940 np0000004400 cinder-backup[101319]: node.conn[0].port = 3260 Jul 03 09:47:53.360940 np0000004400 cinder-backup[101319]: node.conn[0].startup = manual Jul 03 09:47:53.360940 np0000004400 cinder-backup[101319]: node.conn[0].tcp.window_size = 524288 Jul 03 09:47:53.360940 np0000004400 cinder-backup[101319]: node.conn[0].tcp.type_of_service = 0 Jul 03 09:47:53.360940 np0000004400 cinder-backup[101319]: node.conn[0].timeo.logout_timeout = 15 Jul 03 09:47:53.360940 np0000004400 cinder-backup[101319]: node.conn[0].timeo.login_timeout = 15 Jul 03 09:47:53.360940 np0000004400 cinder-backup[101319]: node.conn[0].timeo.auth_timeout = 45 Jul 03 09:47:53.360940 np0000004400 cinder-backup[101319]: node.conn[0].timeo.noop_out_interval = 5 Jul 03 09:47:53.360940 np0000004400 cinder-backup[101319]: node.conn[0].timeo.noop_out_timeout = 5 Jul 03 09:47:53.360940 np0000004400 cinder-backup[101319]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0 Jul 03 09:47:53.360940 np0000004400 cinder-backup[101319]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144 Jul 03 09:47:53.360940 np0000004400 cinder-backup[101319]: node.conn[0].iscsi.HeaderDigest = None Jul 03 09:47:53.360940 np0000004400 cinder-backup[101319]: node.conn[0].iscsi.DataDigest = None Jul 03 09:47:53.360940 np0000004400 cinder-backup[101319]: node.conn[0].iscsi.IFMarker = No Jul 03 09:47:53.360940 np0000004400 cinder-backup[101319]: node.conn[0].iscsi.OFMarker = No Jul 03 09:47:53.360940 np0000004400 cinder-backup[101319]: # END RECORD Jul 03 09:47:53.360940 np0000004400 cinder-backup[101319]: stderr= {{(pid=101319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 03 09:47:53.374858 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-7222a40f-51a0-40fa-9d1b-daf340fa3b17 tempest-VolumesBackupsTest-2142009639 None] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=101319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 03 09:47:53.387938 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-7222a40f-51a0-40fa-9d1b-daf340fa3b17 tempest-VolumesBackupsTest-2142009639 None] iscsiadm ('-m', 'session'): stdout=tcp: [120] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8a0b1cfb-8ea1-46a0-aac3-b254107b98ef (non-flash) Jul 03 09:47:53.387938 np0000004400 cinder-backup[101319]: tcp: [121] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8a0b1cfb-8ea1-46a0-aac3-b254107b98ef (non-flash) Jul 03 09:47:53.387938 np0000004400 cinder-backup[101319]: tcp: [127] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-25552aca-10fe-4ac0-affd-19717e76efc4 (non-flash) Jul 03 09:47:53.387938 np0000004400 cinder-backup[101319]: tcp: [129] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8bf608ef-9b9f-4d7b-acde-5ab351c0c98b (non-flash) Jul 03 09:47:53.387938 np0000004400 cinder-backup[101319]: tcp: [130] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8bf608ef-9b9f-4d7b-acde-5ab351c0c98b (non-flash) Jul 03 09:47:53.387938 np0000004400 cinder-backup[101319]: tcp: [131] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5a7e8b1b-2c9f-4abc-adf4-93f8e3df7477 (non-flash) Jul 03 09:47:53.387938 np0000004400 cinder-backup[101319]: tcp: [132] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5a7e8b1b-2c9f-4abc-adf4-93f8e3df7477 (non-flash) Jul 03 09:47:53.387938 np0000004400 cinder-backup[101319]: stderr= {{(pid=101319) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jul 03 09:47:53.388116 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-7222a40f-51a0-40fa-9d1b-daf340fa3b17 tempest-VolumesBackupsTest-2142009639 None] iscsi session list stdout=tcp: [120] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8a0b1cfb-8ea1-46a0-aac3-b254107b98ef (non-flash) Jul 03 09:47:53.388116 np0000004400 cinder-backup[101319]: tcp: [121] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8a0b1cfb-8ea1-46a0-aac3-b254107b98ef (non-flash) Jul 03 09:47:53.388116 np0000004400 cinder-backup[101319]: tcp: [127] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-25552aca-10fe-4ac0-affd-19717e76efc4 (non-flash) Jul 03 09:47:53.388116 np0000004400 cinder-backup[101319]: tcp: [129] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8bf608ef-9b9f-4d7b-acde-5ab351c0c98b (non-flash) Jul 03 09:47:53.388116 np0000004400 cinder-backup[101319]: tcp: [130] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8bf608ef-9b9f-4d7b-acde-5ab351c0c98b (non-flash) Jul 03 09:47:53.388116 np0000004400 cinder-backup[101319]: tcp: [131] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5a7e8b1b-2c9f-4abc-adf4-93f8e3df7477 (non-flash) Jul 03 09:47:53.388116 np0000004400 cinder-backup[101319]: tcp: [132] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5a7e8b1b-2c9f-4abc-adf4-93f8e3df7477 (non-flash) Jul 03 09:47:53.388116 np0000004400 cinder-backup[101319]: stderr= {{(pid=101319) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jul 03 09:47:53.424189 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-7222a40f-51a0-40fa-9d1b-daf340fa3b17 tempest-VolumesBackupsTest-2142009639 None] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-17bc2851-cb3a-4797-93e7-4d33135c0ea1, portal: 192.168.40.100,3260] Jul 03 09:47:53.424189 np0000004400 cinder-backup[101319]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-17bc2851-cb3a-4797-93e7-4d33135c0ea1, portal: 192.168.40.100,3260] successful. Jul 03 09:47:53.424189 np0000004400 cinder-backup[101319]: stderr= {{(pid=101319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 03 09:47:53.434022 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-7222a40f-51a0-40fa-9d1b-daf340fa3b17 tempest-VolumesBackupsTest-2142009639 None] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=101319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 03 09:47:53.449182 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-7222a40f-51a0-40fa-9d1b-daf340fa3b17 tempest-VolumesBackupsTest-2142009639 None] iscsiadm ('-m', 'session'): stdout=tcp: [120] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8a0b1cfb-8ea1-46a0-aac3-b254107b98ef (non-flash) Jul 03 09:47:53.449182 np0000004400 cinder-backup[101319]: tcp: [121] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8a0b1cfb-8ea1-46a0-aac3-b254107b98ef (non-flash) Jul 03 09:47:53.449182 np0000004400 cinder-backup[101319]: tcp: [127] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-25552aca-10fe-4ac0-affd-19717e76efc4 (non-flash) Jul 03 09:47:53.449182 np0000004400 cinder-backup[101319]: tcp: [129] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8bf608ef-9b9f-4d7b-acde-5ab351c0c98b (non-flash) Jul 03 09:47:53.449182 np0000004400 cinder-backup[101319]: tcp: [130] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8bf608ef-9b9f-4d7b-acde-5ab351c0c98b (non-flash) Jul 03 09:47:53.449182 np0000004400 cinder-backup[101319]: tcp: [131] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5a7e8b1b-2c9f-4abc-adf4-93f8e3df7477 (non-flash) Jul 03 09:47:53.449182 np0000004400 cinder-backup[101319]: tcp: [132] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5a7e8b1b-2c9f-4abc-adf4-93f8e3df7477 (non-flash) Jul 03 09:47:53.449182 np0000004400 cinder-backup[101319]: tcp: [133] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-17bc2851-cb3a-4797-93e7-4d33135c0ea1 (non-flash) Jul 03 09:47:53.449182 np0000004400 cinder-backup[101319]: stderr= {{(pid=101319) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jul 03 09:47:53.449571 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-7222a40f-51a0-40fa-9d1b-daf340fa3b17 tempest-VolumesBackupsTest-2142009639 None] iscsi session list stdout=tcp: [120] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8a0b1cfb-8ea1-46a0-aac3-b254107b98ef (non-flash) Jul 03 09:47:53.449571 np0000004400 cinder-backup[101319]: tcp: [121] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8a0b1cfb-8ea1-46a0-aac3-b254107b98ef (non-flash) Jul 03 09:47:53.449571 np0000004400 cinder-backup[101319]: tcp: [127] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-25552aca-10fe-4ac0-affd-19717e76efc4 (non-flash) Jul 03 09:47:53.449571 np0000004400 cinder-backup[101319]: tcp: [129] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8bf608ef-9b9f-4d7b-acde-5ab351c0c98b (non-flash) Jul 03 09:47:53.449571 np0000004400 cinder-backup[101319]: tcp: [130] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8bf608ef-9b9f-4d7b-acde-5ab351c0c98b (non-flash) Jul 03 09:47:53.449571 np0000004400 cinder-backup[101319]: tcp: [131] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5a7e8b1b-2c9f-4abc-adf4-93f8e3df7477 (non-flash) Jul 03 09:47:53.449571 np0000004400 cinder-backup[101319]: tcp: [132] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5a7e8b1b-2c9f-4abc-adf4-93f8e3df7477 (non-flash) Jul 03 09:47:53.449571 np0000004400 cinder-backup[101319]: tcp: [133] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-17bc2851-cb3a-4797-93e7-4d33135c0ea1 (non-flash) Jul 03 09:47:53.449571 np0000004400 cinder-backup[101319]: stderr= {{(pid=101319) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jul 03 09:47:53.449777 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.base [None req-7222a40f-51a0-40fa-9d1b-daf340fa3b17 tempest-VolumesBackupsTest-2142009639 None] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-17bc2851-cb3a-4797-93e7-4d33135c0ea1" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.125s {{(pid=101319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jul 03 09:47:53.449852 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-7222a40f-51a0-40fa-9d1b-daf340fa3b17 tempest-VolumesBackupsTest-2142009639 None] Connected to 192.168.40.100:3260 {{(pid=101319) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}} Jul 03 09:47:53.450641 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.linuxscsi [None req-7222a40f-51a0-40fa-9d1b-daf340fa3b17 tempest-VolumesBackupsTest-2142009639 None] HCTL ('7', '-', '-', 0) found on session 133 with lun 0 {{(pid=101319) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}} Jul 03 09:47:53.450757 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.linuxscsi [None req-7222a40f-51a0-40fa-9d1b-daf340fa3b17 tempest-VolumesBackupsTest-2142009639 None] Scanning host 7 c: -, t: -, l: 0) {{(pid=101319) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}} Jul 03 09:47:53.472378 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.linuxscsi [None req-7222a40f-51a0-40fa-9d1b-daf340fa3b17 tempest-VolumesBackupsTest-2142009639 None] Searching for a device in session 133 and hctl ['7', '*', '*', 0] yield: None {{(pid=101319) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}} Jul 03 09:47:54.464824 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.linuxscsi [None req-7222a40f-51a0-40fa-9d1b-daf340fa3b17 tempest-VolumesBackupsTest-2142009639 None] Searching for a device in session 133 and hctl ['7', '*', '*', 0] yield: sdb {{(pid=101319) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}} Jul 03 09:47:54.465265 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-7222a40f-51a0-40fa-9d1b-daf340fa3b17 tempest-VolumesBackupsTest-2142009639 None] Connected to sdb using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-17bc2851-cb3a-4797-93e7-4d33135c0ea1', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '17bc2851-cb3a-4797-93e7-4d33135c0ea1', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': False} {{(pid=101319) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}} Jul 03 09:47:54.467510 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.base [None req-7222a40f-51a0-40fa-9d1b-daf340fa3b17 tempest-VolumesBackupsTest-2142009639 None] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 2.154s {{(pid=101319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jul 03 09:47:54.467815 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-7222a40f-51a0-40fa-9d1b-daf340fa3b17 tempest-VolumesBackupsTest-2142009639 None] <== connect_volume: return (3741ms) {'type': 'block', 'scsi_wwn': '3300000009b00c8ee', 'path': '/dev/sdb'} {{(pid=101319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}} Jul 03 09:47:54.471559 np0000004400 cinder-backup[101319]: DEBUG oslo_concurrency.processutils [None req-7222a40f-51a0-40fa-9d1b-daf340fa3b17 tempest-VolumesBackupsTest-2142009639 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chown 1002 /dev/sdb {{(pid=101319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 09:47:54.480352 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.base [None req-ff9a2cd5-68dc-4b82-8fd3-82fb094c7b84 tempest-VolumesBackupsTest-118275719 None] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 1.845s {{(pid=101319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jul 03 09:47:54.481550 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-ff9a2cd5-68dc-4b82-8fd3-82fb094c7b84 tempest-VolumesBackupsTest-118275719 None] _get_connection_devices called with parameters: connection_properties={'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-25552aca-10fe-4ac0-affd-19717e76efc4', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '25552aca-10fe-4ac0-affd-19717e76efc4', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': False}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=101319) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:847}} Jul 03 09:47:54.493848 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-ff9a2cd5-68dc-4b82-8fd3-82fb094c7b84 tempest-VolumesBackupsTest-118275719 None] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS: Jul 03 09:47:54.493848 np0000004400 cinder-backup[101319]: No targets found. Jul 03 09:47:54.493848 np0000004400 cinder-backup[101319]: iSNS: Jul 03 09:47:54.493848 np0000004400 cinder-backup[101319]: No targets found. Jul 03 09:47:54.493848 np0000004400 cinder-backup[101319]: STATIC: Jul 03 09:47:54.493848 np0000004400 cinder-backup[101319]: Target: iqn.2023-03.storpool.com:os--volume-8a0b1cfb-8ea1-46a0-aac3-b254107b98ef Jul 03 09:47:54.493848 np0000004400 cinder-backup[101319]: Portal: 192.168.50.100:3260,-1 Jul 03 09:47:54.493848 np0000004400 cinder-backup[101319]: Iface Name: default Jul 03 09:47:54.493848 np0000004400 cinder-backup[101319]: Portal: 192.168.40.100:3260,-1 Jul 03 09:47:54.493848 np0000004400 cinder-backup[101319]: Iface Name: default Jul 03 09:47:54.493848 np0000004400 cinder-backup[101319]: Target: iqn.2023-03.storpool.com:os--volume-25552aca-10fe-4ac0-affd-19717e76efc4 Jul 03 09:47:54.493848 np0000004400 cinder-backup[101319]: Portal: 192.168.40.100:3260,-1 Jul 03 09:47:54.493848 np0000004400 cinder-backup[101319]: Iface Name: default Jul 03 09:47:54.493848 np0000004400 cinder-backup[101319]: Target: iqn.2023-03.storpool.com:os--volume-8bf608ef-9b9f-4d7b-acde-5ab351c0c98b Jul 03 09:47:54.493848 np0000004400 cinder-backup[101319]: Portal: 192.168.50.100:3260,-1 Jul 03 09:47:54.493848 np0000004400 cinder-backup[101319]: Iface Name: default Jul 03 09:47:54.493848 np0000004400 cinder-backup[101319]: Portal: 192.168.40.100:3260,-1 Jul 03 09:47:54.493848 np0000004400 cinder-backup[101319]: Iface Name: default Jul 03 09:47:54.493848 np0000004400 cinder-backup[101319]: Target: iqn.2023-03.storpool.com:os--volume-17bc2851-cb3a-4797-93e7-4d33135c0ea1 Jul 03 09:47:54.493848 np0000004400 cinder-backup[101319]: Portal: 192.168.40.100:3260,-1 Jul 03 09:47:54.493848 np0000004400 cinder-backup[101319]: Iface Name: default Jul 03 09:47:54.493848 np0000004400 cinder-backup[101319]: Target: iqn.2023-03.storpool.com:os--volume-5a7e8b1b-2c9f-4abc-adf4-93f8e3df7477 Jul 03 09:47:54.493848 np0000004400 cinder-backup[101319]: Portal: 192.168.50.100:3260,-1 Jul 03 09:47:54.493848 np0000004400 cinder-backup[101319]: Iface Name: default Jul 03 09:47:54.493848 np0000004400 cinder-backup[101319]: Portal: 192.168.40.100:3260,-1 Jul 03 09:47:54.493848 np0000004400 cinder-backup[101319]: Iface Name: default Jul 03 09:47:54.493848 np0000004400 cinder-backup[101319]: FIRMWARE: Jul 03 09:47:54.493848 np0000004400 cinder-backup[101319]: No targets found. Jul 03 09:47:54.493848 np0000004400 cinder-backup[101319]: stderr= {{(pid=101319) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jul 03 09:47:54.494870 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-ff9a2cd5-68dc-4b82-8fd3-82fb094c7b84 tempest-VolumesBackupsTest-118275719 None] Regex to get portals from discoverydb: ^SENDTARGETS: Jul 03 09:47:54.494870 np0000004400 cinder-backup[101319]: .*?^DiscoveryAddress: 192.168.40.100,3260.*? Jul 03 09:47:54.494870 np0000004400 cinder-backup[101319]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=101319) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:390}} Jul 03 09:47:54.495291 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-ff9a2cd5-68dc-4b82-8fd3-82fb094c7b84 tempest-VolumesBackupsTest-118275719 None] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-25552aca-10fe-4ac0-affd-19717e76efc4', 0)] {{(pid=101319) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:858}} Jul 03 09:47:54.495553 np0000004400 sudo[142280]: stack : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chown 1002 /dev/sdb Jul 03 09:47:54.496310 np0000004400 sudo[142280]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1002) Jul 03 09:47:54.522348 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-ff9a2cd5-68dc-4b82-8fd3-82fb094c7b84 tempest-VolumesBackupsTest-118275719 None] iscsiadm ('-m', 'session'): stdout=tcp: [120] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8a0b1cfb-8ea1-46a0-aac3-b254107b98ef (non-flash) Jul 03 09:47:54.522348 np0000004400 cinder-backup[101319]: tcp: [121] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8a0b1cfb-8ea1-46a0-aac3-b254107b98ef (non-flash) Jul 03 09:47:54.522348 np0000004400 cinder-backup[101319]: tcp: [127] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-25552aca-10fe-4ac0-affd-19717e76efc4 (non-flash) Jul 03 09:47:54.522348 np0000004400 cinder-backup[101319]: tcp: [129] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8bf608ef-9b9f-4d7b-acde-5ab351c0c98b (non-flash) Jul 03 09:47:54.522348 np0000004400 cinder-backup[101319]: tcp: [130] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8bf608ef-9b9f-4d7b-acde-5ab351c0c98b (non-flash) Jul 03 09:47:54.522348 np0000004400 cinder-backup[101319]: tcp: [131] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5a7e8b1b-2c9f-4abc-adf4-93f8e3df7477 (non-flash) Jul 03 09:47:54.522348 np0000004400 cinder-backup[101319]: tcp: [132] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5a7e8b1b-2c9f-4abc-adf4-93f8e3df7477 (non-flash) Jul 03 09:47:54.522348 np0000004400 cinder-backup[101319]: tcp: [133] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-17bc2851-cb3a-4797-93e7-4d33135c0ea1 (non-flash) Jul 03 09:47:54.522348 np0000004400 cinder-backup[101319]: stderr= {{(pid=101319) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jul 03 09:47:54.522717 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-ff9a2cd5-68dc-4b82-8fd3-82fb094c7b84 tempest-VolumesBackupsTest-118275719 None] iscsi session list stdout=tcp: [120] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8a0b1cfb-8ea1-46a0-aac3-b254107b98ef (non-flash) Jul 03 09:47:54.522717 np0000004400 cinder-backup[101319]: tcp: [121] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8a0b1cfb-8ea1-46a0-aac3-b254107b98ef (non-flash) Jul 03 09:47:54.522717 np0000004400 cinder-backup[101319]: tcp: [127] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-25552aca-10fe-4ac0-affd-19717e76efc4 (non-flash) Jul 03 09:47:54.522717 np0000004400 cinder-backup[101319]: tcp: [129] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8bf608ef-9b9f-4d7b-acde-5ab351c0c98b (non-flash) Jul 03 09:47:54.522717 np0000004400 cinder-backup[101319]: tcp: [130] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8bf608ef-9b9f-4d7b-acde-5ab351c0c98b (non-flash) Jul 03 09:47:54.522717 np0000004400 cinder-backup[101319]: tcp: [131] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5a7e8b1b-2c9f-4abc-adf4-93f8e3df7477 (non-flash) Jul 03 09:47:54.522717 np0000004400 cinder-backup[101319]: tcp: [132] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5a7e8b1b-2c9f-4abc-adf4-93f8e3df7477 (non-flash) Jul 03 09:47:54.522717 np0000004400 cinder-backup[101319]: tcp: [133] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-17bc2851-cb3a-4797-93e7-4d33135c0ea1 (non-flash) Jul 03 09:47:54.522717 np0000004400 cinder-backup[101319]: stderr= {{(pid=101319) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jul 03 09:47:54.523280 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-ff9a2cd5-68dc-4b82-8fd3-82fb094c7b84 tempest-VolumesBackupsTest-118275719 None] Sessions list: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-8a0b1cfb-8ea1-46a0-aac3-b254107b98ef', '120'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-8a0b1cfb-8ea1-46a0-aac3-b254107b98ef', '121'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-25552aca-10fe-4ac0-affd-19717e76efc4', '127'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-8bf608ef-9b9f-4d7b-acde-5ab351c0c98b', '129'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-8bf608ef-9b9f-4d7b-acde-5ab351c0c98b', '130'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-5a7e8b1b-2c9f-4abc-adf4-93f8e3df7477', '131'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-5a7e8b1b-2c9f-4abc-adf4-93f8e3df7477', '132'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-17bc2851-cb3a-4797-93e7-4d33135c0ea1', '133')] {{(pid=101319) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:866}} Jul 03 09:47:54.523280 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-ff9a2cd5-68dc-4b82-8fd3-82fb094c7b84 tempest-VolumesBackupsTest-118275719 None] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-25552aca-10fe-4ac0-affd-19717e76efc4, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-25552aca-10fe-4ac0-affd-19717e76efc4', '127')] {{(pid=101319) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}} Jul 03 09:47:54.524582 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-ff9a2cd5-68dc-4b82-8fd3-82fb094c7b84 tempest-VolumesBackupsTest-118275719 None] Resulting device map defaultdict(. at 0x7e7705874180>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-25552aca-10fe-4ac0-affd-19717e76efc4'): ({'sdh'}, set())}) {{(pid=101319) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:912}} Jul 03 09:47:54.527483 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.linuxscsi [None req-ff9a2cd5-68dc-4b82-8fd3-82fb094c7b84 tempest-VolumesBackupsTest-118275719 None] Removing single pathed devices sdh {{(pid=101319) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}} Jul 03 09:47:54.539597 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.linuxscsi [None req-ff9a2cd5-68dc-4b82-8fd3-82fb094c7b84 tempest-VolumesBackupsTest-118275719 None] Flushing IO for device /dev/sdh {{(pid=101319) flush_device_io /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:461}} Jul 03 09:47:54.550303 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.linuxscsi [None req-ff9a2cd5-68dc-4b82-8fd3-82fb094c7b84 tempest-VolumesBackupsTest-118275719 None] Remove SCSI device /dev/sdh with /sys/block/sdh/device/delete {{(pid=101319) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}} Jul 03 09:47:54.607429 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.linuxscsi [None req-ff9a2cd5-68dc-4b82-8fd3-82fb094c7b84 tempest-VolumesBackupsTest-118275719 None] Checking to see if SCSI volumes sdh have been removed. {{(pid=101319) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}} Jul 03 09:47:54.607429 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.linuxscsi [None req-ff9a2cd5-68dc-4b82-8fd3-82fb094c7b84 tempest-VolumesBackupsTest-118275719 None] SCSI volumes sdh have been removed. {{(pid=101319) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}} Jul 03 09:47:54.607721 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.linuxscsi [None req-ff9a2cd5-68dc-4b82-8fd3-82fb094c7b84 tempest-VolumesBackupsTest-118275719 None] Checking to see if device paths {'sdh'} are still under multipathd monitoring {{(pid=101319) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}} Jul 03 09:47:54.619000 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.linuxscsi [None req-ff9a2cd5-68dc-4b82-8fd3-82fb094c7b84 tempest-VolumesBackupsTest-118275719 None] Device paths {'sdh'} have been removed from multipathd monitoring. {{(pid=101319) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}} Jul 03 09:47:54.619309 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-ff9a2cd5-68dc-4b82-8fd3-82fb094c7b84 tempest-VolumesBackupsTest-118275719 None] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-25552aca-10fe-4ac0-affd-19717e76efc4')] {{(pid=101319) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1225}} Jul 03 09:47:54.633216 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-ff9a2cd5-68dc-4b82-8fd3-82fb094c7b84 tempest-VolumesBackupsTest-118275719 None] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=101319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 03 09:47:54.662779 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-ff9a2cd5-68dc-4b82-8fd3-82fb094c7b84 tempest-VolumesBackupsTest-118275719 None] iscsiadm ('--logout',): stdout=Logging out of session [sid: 127, target: iqn.2023-03.storpool.com:os--volume-25552aca-10fe-4ac0-affd-19717e76efc4, portal: 192.168.40.100,3260] Jul 03 09:47:54.662779 np0000004400 cinder-backup[101319]: Logout of [sid: 127, target: iqn.2023-03.storpool.com:os--volume-25552aca-10fe-4ac0-affd-19717e76efc4, portal: 192.168.40.100,3260] successful. Jul 03 09:47:54.662779 np0000004400 cinder-backup[101319]: stderr= {{(pid=101319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 03 09:47:54.679435 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-ff9a2cd5-68dc-4b82-8fd3-82fb094c7b84 tempest-VolumesBackupsTest-118275719 None] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=101319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 03 09:47:54.680286 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.base [None req-ff9a2cd5-68dc-4b82-8fd3-82fb094c7b84 tempest-VolumesBackupsTest-118275719 None] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.201s {{(pid=101319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jul 03 09:47:54.680286 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-ff9a2cd5-68dc-4b82-8fd3-82fb094c7b84 tempest-VolumesBackupsTest-118275719 None] <== disconnect_volume: return (2046ms) None {{(pid=101319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}} Jul 03 09:47:54.837196 np0000004400 sudo[142280]: pam_unix(sudo:session): session closed for user root Jul 03 09:47:54.839200 np0000004400 cinder-backup[101319]: DEBUG oslo_concurrency.processutils [None req-7222a40f-51a0-40fa-9d1b-daf340fa3b17 tempest-VolumesBackupsTest-2142009639 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chown 1002 /dev/sdb" returned: 0 in 0.371s {{(pid=101319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 09:47:54.847060 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-7222a40f-51a0-40fa-9d1b-daf340fa3b17 tempest-VolumesBackupsTest-2142009639 None] _read_sha256file started, container name: tempest-volumesbackupstest-backup-container-106419071, sha256 filename: volume_8a0b1cfb-8ea1-46a0-aac3-b254107b98ef/20260703094720/az_nova_backup_86118233-3d57-47ad-8781-cab6c54e4d53_sha256file. {{(pid=101319) _read_sha256file /opt/stack/cinder/cinder/backup/chunkeddriver.py:333}} Jul 03 09:47:55.025315 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-7222a40f-51a0-40fa-9d1b-daf340fa3b17 tempest-VolumesBackupsTest-2142009639 None] _read_sha256file finished. {{(pid=101319) _read_sha256file /opt/stack/cinder/cinder/backup/chunkeddriver.py:340}} Jul 03 09:47:55.045842 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-7222a40f-51a0-40fa-9d1b-daf340fa3b17 tempest-VolumesBackupsTest-2142009639 None] _create_container started, container: tempest-volumesbackupstest-backup-container-422378187,backup: 8763861d-eff9-45d6-812c-fb65cb7ebea7. {{(pid=101319) _create_container /opt/stack/cinder/cinder/backup/chunkeddriver.py:249}} Jul 03 09:47:55.152137 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.drivers.swift [None req-7222a40f-51a0-40fa-9d1b-daf340fa3b17 tempest-VolumesBackupsTest-2142009639 None] generate_object_name_prefix: volume_8a0b1cfb-8ea1-46a0-aac3-b254107b98ef/20260703094755/az_nova_backup_8763861d-eff9-45d6-812c-fb65cb7ebea7 {{(pid=101319) _generate_object_name_prefix /opt/stack/cinder/cinder/backup/drivers/swift.py:452}} Jul 03 09:47:55.190118 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-7222a40f-51a0-40fa-9d1b-daf340fa3b17 tempest-VolumesBackupsTest-2142009639 None] starting backup of volume: 8a0b1cfb-8ea1-46a0-aac3-b254107b98ef, volume size: 1073741824, object names prefix volume_8a0b1cfb-8ea1-46a0-aac3-b254107b98ef/20260703094755/az_nova_backup_8763861d-eff9-45d6-812c-fb65cb7ebea7, availability zone: nova {{(pid=101319) _prepare_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:359}} Jul 03 09:47:55.793076 np0000004400 cinder-backup[101319]: INFO cinder.backup.manager [None req-ff9a2cd5-68dc-4b82-8fd3-82fb094c7b84 tempest-VolumesBackupsTest-118275719 None] Create backup finished. backup: 06482a6e-a410-44d6-85cf-84392df124bc. Jul 03 09:47:56.139217 np0000004400 cinder-backup[101319]: DEBUG dbcounter [-] [101319] Writing DB stats cinder:SELECT=214,cinder:UPDATE=71,cinder:INSERT=13 {{(pid=101319) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 03 09:47:56.422155 np0000004400 cinder-backup[101319]: INFO cinder.backup.manager [None req-30fa3f82-9c3a-4d49-8642-fb1160e3254f tempest-VolumesBackupsTest-118275719 None] Delete backup started, backup: 06482a6e-a410-44d6-85cf-84392df124bc. Jul 03 09:47:56.428422 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.drivers.swift [None req-30fa3f82-9c3a-4d49-8642-fb1160e3254f tempest-VolumesBackupsTest-118275719 None] Using swift URL https://10.4.3.95:8080/v1/AUTH_a484ec9218bf417bb9d7575ae6370646 {{(pid=101319) initialize /opt/stack/cinder/cinder/backup/drivers/swift.py:300}} Jul 03 09:47:56.428635 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.drivers.swift [None req-30fa3f82-9c3a-4d49-8642-fb1160e3254f tempest-VolumesBackupsTest-118275719 None] Connect to https://10.4.3.95:8080/v1/AUTH_ in "per_user" mode {{(pid=101319) initialize /opt/stack/cinder/cinder/backup/drivers/swift.py:301}} Jul 03 09:47:56.428740 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-30fa3f82-9c3a-4d49-8642-fb1160e3254f tempest-VolumesBackupsTest-118275719 None] delete started, backup: 06482a6e-a410-44d6-85cf-84392df124bc, container: volumebackups, prefix: volume_e49954d5-d017-43d5-8565-25ce9e2693f9/20260703094739/az_nova_backup_06482a6e-a410-44d6-85cf-84392df124bc. {{(pid=101319) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:822}} Jul 03 09:47:56.517868 np0000004400 cinder-backup[101319]: DEBUG oslo_db.sqlalchemy.engines [None req-7222a40f-51a0-40fa-9d1b-daf340fa3b17 tempest-VolumesBackupsTest-2142009639 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=101319) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 03 09:47:56.522755 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-30fa3f82-9c3a-4d49-8642-fb1160e3254f tempest-VolumesBackupsTest-118275719 None] generated object list: ['volume_e49954d5-d017-43d5-8565-25ce9e2693f9/20260703094739/az_nova_backup_06482a6e-a410-44d6-85cf-84392df124bc-00001', 'volume_e49954d5-d017-43d5-8565-25ce9e2693f9/20260703094739/az_nova_backup_06482a6e-a410-44d6-85cf-84392df124bc-00002', 'volume_e49954d5-d017-43d5-8565-25ce9e2693f9/20260703094739/az_nova_backup_06482a6e-a410-44d6-85cf-84392df124bc-00003', 'volume_e49954d5-d017-43d5-8565-25ce9e2693f9/20260703094739/az_nova_backup_06482a6e-a410-44d6-85cf-84392df124bc-00004', 'volume_e49954d5-d017-43d5-8565-25ce9e2693f9/20260703094739/az_nova_backup_06482a6e-a410-44d6-85cf-84392df124bc-00005', 'volume_e49954d5-d017-43d5-8565-25ce9e2693f9/20260703094739/az_nova_backup_06482a6e-a410-44d6-85cf-84392df124bc-00006', 'volume_e49954d5-d017-43d5-8565-25ce9e2693f9/20260703094739/az_nova_backup_06482a6e-a410-44d6-85cf-84392df124bc-00007', 'volume_e49954d5-d017-43d5-8565-25ce9e2693f9/20260703094739/az_nova_backup_06482a6e-a410-44d6-85cf-84392df124bc-00008', 'volume_e49954d5-d017-43d5-8565-25ce9e2693f9/20260703094739/az_nova_backup_06482a6e-a410-44d6-85cf-84392df124bc-00009', 'volume_e49954d5-d017-43d5-8565-25ce9e2693f9/20260703094739/az_nova_backup_06482a6e-a410-44d6-85cf-84392df124bc-00010', 'volume_e49954d5-d017-43d5-8565-25ce9e2693f9/20260703094739/az_nova_backup_06482a6e-a410-44d6-85cf-84392df124bc-00011', 'volume_e49954d5-d017-43d5-8565-25ce9e2693f9/20260703094739/az_nova_backup_06482a6e-a410-44d6-85cf-84392df124bc-00012', 'volume_e49954d5-d017-43d5-8565-25ce9e2693f9/20260703094739/az_nova_backup_06482a6e-a410-44d6-85cf-84392df124bc-00013', 'volume_e49954d5-d017-43d5-8565-25ce9e2693f9/20260703094739/az_nova_backup_06482a6e-a410-44d6-85cf-84392df124bc-00014', 'volume_e49954d5-d017-43d5-8565-25ce9e2693f9/20260703094739/az_nova_backup_06482a6e-a410-44d6-85cf-84392df124bc-00015', 'volume_e49954d5-d017-43d5-8565-25ce9e2693f9/20260703094739/az_nova_backup_06482a6e-a410-44d6-85cf-84392df124bc-00016', 'volume_e49954d5-d017-43d5-8565-25ce9e2693f9/20260703094739/az_nova_backup_06482a6e-a410-44d6-85cf-84392df124bc-00017', 'volume_e49954d5-d017-43d5-8565-25ce9e2693f9/20260703094739/az_nova_backup_06482a6e-a410-44d6-85cf-84392df124bc-00018', 'volume_e49954d5-d017-43d5-8565-25ce9e2693f9/20260703094739/az_nova_backup_06482a6e-a410-44d6-85cf-84392df124bc-00019', 'volume_e49954d5-d017-43d5-8565-25ce9e2693f9/20260703094739/az_nova_backup_06482a6e-a410-44d6-85cf-84392df124bc-00020', 'volume_e49954d5-d017-43d5-8565-25ce9e2693f9/20260703094739/az_nova_backup_06482a6e-a410-44d6-85cf-84392df124bc-00021', 'volume_e49954d5-d017-43d5-8565-25ce9e2693f9/20260703094739/az_nova_backup_06482a6e-a410-44d6-85cf-84392df124bc_metadata', 'volume_e49954d5-d017-43d5-8565-25ce9e2693f9/20260703094739/az_nova_backup_06482a6e-a410-44d6-85cf-84392df124bc_sha256file']. {{(pid=101319) _generate_object_names /opt/stack/cinder/cinder/backup/chunkeddriver.py:260}} Jul 03 09:47:56.545985 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-30fa3f82-9c3a-4d49-8642-fb1160e3254f tempest-VolumesBackupsTest-118275719 None] deleted object: volume_e49954d5-d017-43d5-8565-25ce9e2693f9/20260703094739/az_nova_backup_06482a6e-a410-44d6-85cf-84392df124bc-00001 in container: volumebackups. {{(pid=101319) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 09:47:56.572570 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-30fa3f82-9c3a-4d49-8642-fb1160e3254f tempest-VolumesBackupsTest-118275719 None] deleted object: volume_e49954d5-d017-43d5-8565-25ce9e2693f9/20260703094739/az_nova_backup_06482a6e-a410-44d6-85cf-84392df124bc-00002 in container: volumebackups. {{(pid=101319) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 09:47:56.595091 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-30fa3f82-9c3a-4d49-8642-fb1160e3254f tempest-VolumesBackupsTest-118275719 None] deleted object: volume_e49954d5-d017-43d5-8565-25ce9e2693f9/20260703094739/az_nova_backup_06482a6e-a410-44d6-85cf-84392df124bc-00003 in container: volumebackups. {{(pid=101319) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 09:47:56.621788 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-30fa3f82-9c3a-4d49-8642-fb1160e3254f tempest-VolumesBackupsTest-118275719 None] deleted object: volume_e49954d5-d017-43d5-8565-25ce9e2693f9/20260703094739/az_nova_backup_06482a6e-a410-44d6-85cf-84392df124bc-00004 in container: volumebackups. {{(pid=101319) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 09:47:56.649153 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-30fa3f82-9c3a-4d49-8642-fb1160e3254f tempest-VolumesBackupsTest-118275719 None] deleted object: volume_e49954d5-d017-43d5-8565-25ce9e2693f9/20260703094739/az_nova_backup_06482a6e-a410-44d6-85cf-84392df124bc-00005 in container: volumebackups. {{(pid=101319) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 09:47:56.677510 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-30fa3f82-9c3a-4d49-8642-fb1160e3254f tempest-VolumesBackupsTest-118275719 None] deleted object: volume_e49954d5-d017-43d5-8565-25ce9e2693f9/20260703094739/az_nova_backup_06482a6e-a410-44d6-85cf-84392df124bc-00006 in container: volumebackups. {{(pid=101319) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 09:47:56.928179 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-30fa3f82-9c3a-4d49-8642-fb1160e3254f tempest-VolumesBackupsTest-118275719 None] deleted object: volume_e49954d5-d017-43d5-8565-25ce9e2693f9/20260703094739/az_nova_backup_06482a6e-a410-44d6-85cf-84392df124bc-00007 in container: volumebackups. {{(pid=101319) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 09:47:56.986560 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-30fa3f82-9c3a-4d49-8642-fb1160e3254f tempest-VolumesBackupsTest-118275719 None] deleted object: volume_e49954d5-d017-43d5-8565-25ce9e2693f9/20260703094739/az_nova_backup_06482a6e-a410-44d6-85cf-84392df124bc-00008 in container: volumebackups. {{(pid=101319) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 09:47:57.011844 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-30fa3f82-9c3a-4d49-8642-fb1160e3254f tempest-VolumesBackupsTest-118275719 None] deleted object: volume_e49954d5-d017-43d5-8565-25ce9e2693f9/20260703094739/az_nova_backup_06482a6e-a410-44d6-85cf-84392df124bc-00009 in container: volumebackups. {{(pid=101319) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 09:47:57.046855 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-30fa3f82-9c3a-4d49-8642-fb1160e3254f tempest-VolumesBackupsTest-118275719 None] deleted object: volume_e49954d5-d017-43d5-8565-25ce9e2693f9/20260703094739/az_nova_backup_06482a6e-a410-44d6-85cf-84392df124bc-00010 in container: volumebackups. {{(pid=101319) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 09:47:57.074053 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-30fa3f82-9c3a-4d49-8642-fb1160e3254f tempest-VolumesBackupsTest-118275719 None] deleted object: volume_e49954d5-d017-43d5-8565-25ce9e2693f9/20260703094739/az_nova_backup_06482a6e-a410-44d6-85cf-84392df124bc-00011 in container: volumebackups. {{(pid=101319) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 09:47:57.098789 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-30fa3f82-9c3a-4d49-8642-fb1160e3254f tempest-VolumesBackupsTest-118275719 None] deleted object: volume_e49954d5-d017-43d5-8565-25ce9e2693f9/20260703094739/az_nova_backup_06482a6e-a410-44d6-85cf-84392df124bc-00012 in container: volumebackups. {{(pid=101319) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 09:47:57.149279 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-30fa3f82-9c3a-4d49-8642-fb1160e3254f tempest-VolumesBackupsTest-118275719 None] deleted object: volume_e49954d5-d017-43d5-8565-25ce9e2693f9/20260703094739/az_nova_backup_06482a6e-a410-44d6-85cf-84392df124bc-00013 in container: volumebackups. {{(pid=101319) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 09:47:57.173280 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-30fa3f82-9c3a-4d49-8642-fb1160e3254f tempest-VolumesBackupsTest-118275719 None] deleted object: volume_e49954d5-d017-43d5-8565-25ce9e2693f9/20260703094739/az_nova_backup_06482a6e-a410-44d6-85cf-84392df124bc-00014 in container: volumebackups. {{(pid=101319) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 09:47:57.199951 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-30fa3f82-9c3a-4d49-8642-fb1160e3254f tempest-VolumesBackupsTest-118275719 None] deleted object: volume_e49954d5-d017-43d5-8565-25ce9e2693f9/20260703094739/az_nova_backup_06482a6e-a410-44d6-85cf-84392df124bc-00015 in container: volumebackups. {{(pid=101319) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 09:47:57.224921 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-30fa3f82-9c3a-4d49-8642-fb1160e3254f tempest-VolumesBackupsTest-118275719 None] deleted object: volume_e49954d5-d017-43d5-8565-25ce9e2693f9/20260703094739/az_nova_backup_06482a6e-a410-44d6-85cf-84392df124bc-00016 in container: volumebackups. {{(pid=101319) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 09:47:57.249909 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-30fa3f82-9c3a-4d49-8642-fb1160e3254f tempest-VolumesBackupsTest-118275719 None] deleted object: volume_e49954d5-d017-43d5-8565-25ce9e2693f9/20260703094739/az_nova_backup_06482a6e-a410-44d6-85cf-84392df124bc-00017 in container: volumebackups. {{(pid=101319) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 09:47:57.321060 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-30fa3f82-9c3a-4d49-8642-fb1160e3254f tempest-VolumesBackupsTest-118275719 None] deleted object: volume_e49954d5-d017-43d5-8565-25ce9e2693f9/20260703094739/az_nova_backup_06482a6e-a410-44d6-85cf-84392df124bc-00018 in container: volumebackups. {{(pid=101319) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 09:47:57.342605 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-30fa3f82-9c3a-4d49-8642-fb1160e3254f tempest-VolumesBackupsTest-118275719 None] deleted object: volume_e49954d5-d017-43d5-8565-25ce9e2693f9/20260703094739/az_nova_backup_06482a6e-a410-44d6-85cf-84392df124bc-00019 in container: volumebackups. {{(pid=101319) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 09:47:57.411590 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-30fa3f82-9c3a-4d49-8642-fb1160e3254f tempest-VolumesBackupsTest-118275719 None] deleted object: volume_e49954d5-d017-43d5-8565-25ce9e2693f9/20260703094739/az_nova_backup_06482a6e-a410-44d6-85cf-84392df124bc-00020 in container: volumebackups. {{(pid=101319) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 09:47:57.439225 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-30fa3f82-9c3a-4d49-8642-fb1160e3254f tempest-VolumesBackupsTest-118275719 None] deleted object: volume_e49954d5-d017-43d5-8565-25ce9e2693f9/20260703094739/az_nova_backup_06482a6e-a410-44d6-85cf-84392df124bc-00021 in container: volumebackups. {{(pid=101319) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 09:47:57.464770 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-30fa3f82-9c3a-4d49-8642-fb1160e3254f tempest-VolumesBackupsTest-118275719 None] deleted object: volume_e49954d5-d017-43d5-8565-25ce9e2693f9/20260703094739/az_nova_backup_06482a6e-a410-44d6-85cf-84392df124bc_metadata in container: volumebackups. {{(pid=101319) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 09:47:57.494167 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-30fa3f82-9c3a-4d49-8642-fb1160e3254f tempest-VolumesBackupsTest-118275719 None] deleted object: volume_e49954d5-d017-43d5-8565-25ce9e2693f9/20260703094739/az_nova_backup_06482a6e-a410-44d6-85cf-84392df124bc_sha256file in container: volumebackups. {{(pid=101319) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 09:47:57.494529 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-30fa3f82-9c3a-4d49-8642-fb1160e3254f tempest-VolumesBackupsTest-118275719 None] delete 06482a6e-a410-44d6-85cf-84392df124bc finished. {{(pid=101319) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:848}} Jul 03 09:47:57.518712 np0000004400 cinder-backup[101319]: DEBUG cinder.quota [None req-30fa3f82-9c3a-4d49-8642-fb1160e3254f tempest-VolumesBackupsTest-118275719 None] Created reservations ['e3841680-b683-4159-b91b-43ff2d289dfe', 'b3e7f1dc-3cda-4263-96e5-5280f14ff792'] {{(pid=101319) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 09:47:57.543147 np0000004400 cinder-backup[101319]: INFO cinder.backup.manager [None req-30fa3f82-9c3a-4d49-8642-fb1160e3254f tempest-VolumesBackupsTest-118275719 None] Delete backup finished, backup 06482a6e-a410-44d6-85cf-84392df124bc deleted. Jul 03 09:47:58.159064 np0000004400 cinder-backup[101319]: INFO cinder.backup.manager [None req-2d74be38-53f4-4512-acc2-41535a13bff9 tempest-ProjectAdminTests39-820123544 None] Create backup started, backup: cc724ce5-d7d3-4792-9be0-9c59b7436ba7 volume: 9699c5a1-ca0a-4162-91dc-8afd21ba1199. Jul 03 09:47:58.168444 np0000004400 cinder-backup[101319]: INFO cinder.backup.manager [None req-2d74be38-53f4-4512-acc2-41535a13bff9 tempest-ProjectAdminTests39-820123544 None] Call Volume Manager to get_backup_device for Backup(availability_zone='nova',container=None,created_at=2026-07-03T09:47:58Z,data_timestamp=2026-07-03T09:47:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-type-Backup-41157617',encryption_key_id=None,fail_reason=None,host='np0000004400',id=cc724ce5-d7d3-4792-9be0-9c59b7436ba7,metadata={},num_dependent_backups=0,object_count=0,parent=None,parent_id=None,project_id='0e4281ba5ea047598fa5801fdd6a9aa9',restore_volume_id=None,service='cinder.backup.drivers.swift.SwiftBackupDriver',service_metadata=None,size=1,snapshot_id=None,status='creating',temp_snapshot_id=None,temp_volume_id=None,updated_at=None,user_id='4e83159ea8d54d7a9c8de6d76997a7d2',volume_id=9699c5a1-ca0a-4162-91dc-8afd21ba1199) Jul 03 09:47:58.205782 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.drivers.swift [None req-2d74be38-53f4-4512-acc2-41535a13bff9 tempest-ProjectAdminTests39-820123544 None] Using swift URL https://10.4.3.95:8080/v1/AUTH_0e4281ba5ea047598fa5801fdd6a9aa9 {{(pid=101319) initialize /opt/stack/cinder/cinder/backup/drivers/swift.py:300}} Jul 03 09:47:58.206721 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.drivers.swift [None req-2d74be38-53f4-4512-acc2-41535a13bff9 tempest-ProjectAdminTests39-820123544 None] Connect to https://10.4.3.95:8080/v1/AUTH_ in "per_user" mode {{(pid=101319) initialize /opt/stack/cinder/cinder/backup/drivers/swift.py:301}} Jul 03 09:47:58.206915 np0000004400 cinder-backup[101319]: DEBUG os_brick.utils [None req-2d74be38-53f4-4512-acc2-41535a13bff9 tempest-ProjectAdminTests39-820123544 None] ==> get_connector_properties: call "{'root_helper': 'sudo cinder-rootwrap /etc/cinder/rootwrap.conf', 'my_ip': '10.4.3.95', 'multipath': False, 'enforce_multipath': False, 'host': None, 'execute': None}" {{(pid=101319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}} Jul 03 09:47:58.220755 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.scaleio [None req-2d74be38-53f4-4512-acc2-41535a13bff9 tempest-ProjectAdminTests39-820123544 None] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=101319) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}} Jul 03 09:47:58.261440 np0000004400 cinder-backup[101319]: DEBUG oslo_concurrency.processutils [None req-2d74be38-53f4-4512-acc2-41535a13bff9 tempest-ProjectAdminTests39-820123544 None] Running cmd (subprocess): nvme version {{(pid=101319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 09:47:58.288564 np0000004400 cinder-backup[101319]: DEBUG oslo_concurrency.processutils [None req-2d74be38-53f4-4512-acc2-41535a13bff9 tempest-ProjectAdminTests39-820123544 None] 'nvme version' failed. Not Retrying. {{(pid=101319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 03 09:47:58.289073 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.nvmeof [None req-2d74be38-53f4-4512-acc2-41535a13bff9 tempest-ProjectAdminTests39-820123544 None] nvme not present on system {{(pid=101319) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}} Jul 03 09:47:58.301964 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.lightos [None req-2d74be38-53f4-4512-acc2-41535a13bff9 tempest-ProjectAdminTests39-820123544 None] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=101319) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}} Jul 03 09:47:58.303145 np0000004400 cinder-backup[101319]: INFO os_brick.initiator.connectors.lightos [None req-2d74be38-53f4-4512-acc2-41535a13bff9 tempest-ProjectAdminTests39-820123544 None] Current host hostNQN and IP(s) are ['10.4.3.95', 'fe80::f816:3eff:fe47:268c', '192.168.40.6', 'fe80::f816:3eff:febf:7be2', '192.168.50.6', 'fe80::f816:3eff:fe99:8914', '192.168.10.6', 'fe80::f816:3eff:fe2f:e696', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::bc9d:84ff:fec2:6b49', 'fe80::fc16:3eff:fe97:90a6', 'fe80::8435:18ff:feb9:798c', 'fe80::fc16:3eff:feda:9a9f', 'fe80::28c1:27ff:fe3c:5528', 'fe80::fc16:3eff:fec1:41ad', 'fe80::4007:baff:fe0f:8f44', 'fe80::fc16:3eff:fe61:2930', 'fe80::fcb0:4aff:fe6d:1fcf'] Jul 03 09:47:58.303385 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.lightos [None req-2d74be38-53f4-4512-acc2-41535a13bff9 tempest-ProjectAdminTests39-820123544 None] LIGHTOS: did not find dsc, continuing anyway. {{(pid=101319) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}} Jul 03 09:47:58.303626 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.lightos [None req-2d74be38-53f4-4512-acc2-41535a13bff9 tempest-ProjectAdminTests39-820123544 None] LIGHTOS: no hostnqn found. {{(pid=101319) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}} Jul 03 09:47:58.304105 np0000004400 cinder-backup[101319]: DEBUG os_brick.utils [None req-2d74be38-53f4-4512-acc2-41535a13bff9 tempest-ProjectAdminTests39-820123544 None] <== get_connector_properties: return (97ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.95', 'host': 'np0000004400', 'multipath': False, 'enforce_multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:ae7e5bb0ebe6', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': '6b284368-d0ba-4d18-af6f-4998d3955c52', 'nvme_native_multipath': False} {{(pid=101319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}} Jul 03 09:47:58.386917 np0000004400 cinder-backup[101319]: DEBUG oslo_db.sqlalchemy.engines [None req-7222a40f-51a0-40fa-9d1b-daf340fa3b17 tempest-VolumesBackupsTest-2142009639 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=101319) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 03 09:47:58.811965 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connector [None req-2d74be38-53f4-4512-acc2-41535a13bff9 tempest-ProjectAdminTests39-820123544 None] Factory for iscsi on None {{(pid=101319) factory /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connector.py:243}} Jul 03 09:47:58.812512 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-2d74be38-53f4-4512-acc2-41535a13bff9 tempest-ProjectAdminTests39-820123544 None] ==> connect_volume: call "{'self': , 'connection_properties': {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-9699c5a1-ca0a-4162-91dc-8afd21ba1199', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '9699c5a1-ca0a-4162-91dc-8afd21ba1199', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': False}}" {{(pid=101319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}} Jul 03 09:47:58.813103 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.base [None req-2d74be38-53f4-4512-acc2-41535a13bff9 tempest-ProjectAdminTests39-820123544 None] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=101319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jul 03 09:47:58.813482 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.base [None req-2d74be38-53f4-4512-acc2-41535a13bff9 tempest-ProjectAdminTests39-820123544 None] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=101319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jul 03 09:47:58.813756 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.base [None req-2d74be38-53f4-4512-acc2-41535a13bff9 tempest-ProjectAdminTests39-820123544 None] Connection properties {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-9699c5a1-ca0a-4162-91dc-8afd21ba1199', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '9699c5a1-ca0a-4162-91dc-8afd21ba1199', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': False} {{(pid=101319) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}} Jul 03 09:47:58.824248 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.base [None req-2d74be38-53f4-4512-acc2-41535a13bff9 tempest-ProjectAdminTests39-820123544 None] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-9699c5a1-ca0a-4162-91dc-8afd21ba1199" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=101319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jul 03 09:47:58.824800 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.base [None req-2d74be38-53f4-4512-acc2-41535a13bff9 tempest-ProjectAdminTests39-820123544 None] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-9699c5a1-ca0a-4162-91dc-8afd21ba1199" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=101319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jul 03 09:47:58.828172 np0000004400 cinder-backup[101319]: INFO os_brick.initiator.connectors.iscsi [None req-2d74be38-53f4-4512-acc2-41535a13bff9 tempest-ProjectAdminTests39-820123544 None] Trying to connect to iSCSI portal 192.168.40.100:3260 Jul 03 09:47:58.836885 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-2d74be38-53f4-4512-acc2-41535a13bff9 tempest-ProjectAdminTests39-820123544 None] iscsiadm (): stdout= stderr=iscsiadm: No records found Jul 03 09:47:58.836885 np0000004400 cinder-backup[101319]: {{(pid=101319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 03 09:47:58.847550 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-2d74be38-53f4-4512-acc2-41535a13bff9 tempest-ProjectAdminTests39-820123544 None] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-9699c5a1-ca0a-4162-91dc-8afd21ba1199] added Jul 03 09:47:58.847550 np0000004400 cinder-backup[101319]: stderr=iscsiadm: Config file line 363 does not have value Jul 03 09:47:58.847550 np0000004400 cinder-backup[101319]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs' Jul 03 09:47:58.847550 np0000004400 cinder-backup[101319]: iscsiadm: Config file line 363 does not have value Jul 03 09:47:58.847550 np0000004400 cinder-backup[101319]: iscsiadm: Config file line 363 does not have value Jul 03 09:47:58.847550 np0000004400 cinder-backup[101319]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs' Jul 03 09:47:58.847550 np0000004400 cinder-backup[101319]: {{(pid=101319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 03 09:47:58.847908 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-2d74be38-53f4-4512-acc2-41535a13bff9 tempest-ProjectAdminTests39-820123544 None] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=101319) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}} Jul 03 09:47:58.848277 np0000004400 cinder-backup[101319]: DEBUG os_brick.utils [None req-2d74be38-53f4-4512-acc2-41535a13bff9 tempest-ProjectAdminTests39-820123544 None] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0231(s), this was the 1st time calling it. {{(pid=101319) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}} Jul 03 09:47:58.848629 np0000004400 cinder-backup[101319]: DEBUG os_brick.utils [None req-2d74be38-53f4-4512-acc2-41535a13bff9 tempest-ProjectAdminTests39-820123544 None] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=101319) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}} Jul 03 09:47:59.849754 np0000004400 cinder-backup[101319]: INFO os_brick.initiator.connectors.iscsi [None req-2d74be38-53f4-4512-acc2-41535a13bff9 tempest-ProjectAdminTests39-820123544 None] Trying to connect to iSCSI portal 192.168.40.100:3260 Jul 03 09:47:59.878191 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-2d74be38-53f4-4512-acc2-41535a13bff9 tempest-ProjectAdminTests39-820123544 None] iscsiadm (): stdout=# BEGIN RECORD 2.1.9 Jul 03 09:47:59.878191 np0000004400 cinder-backup[101319]: node.name = iqn.2023-03.storpool.com:os--volume-9699c5a1-ca0a-4162-91dc-8afd21ba1199 Jul 03 09:47:59.878191 np0000004400 cinder-backup[101319]: node.tpgt = -1 Jul 03 09:47:59.878191 np0000004400 cinder-backup[101319]: node.startup = manual Jul 03 09:47:59.878191 np0000004400 cinder-backup[101319]: node.leading_login = No Jul 03 09:47:59.878191 np0000004400 cinder-backup[101319]: iface.iscsi_ifacename = default Jul 03 09:47:59.878191 np0000004400 cinder-backup[101319]: iface.net_ifacename = Jul 03 09:47:59.878191 np0000004400 cinder-backup[101319]: iface.ipaddress = Jul 03 09:47:59.878191 np0000004400 cinder-backup[101319]: iface.prefix_len = 0 Jul 03 09:47:59.878191 np0000004400 cinder-backup[101319]: iface.hwaddress = Jul 03 09:47:59.878191 np0000004400 cinder-backup[101319]: iface.transport_name = tcp Jul 03 09:47:59.878191 np0000004400 cinder-backup[101319]: iface.initiatorname = Jul 03 09:47:59.878191 np0000004400 cinder-backup[101319]: iface.state = Jul 03 09:47:59.878191 np0000004400 cinder-backup[101319]: iface.vlan_id = 0 Jul 03 09:47:59.878191 np0000004400 cinder-backup[101319]: iface.vlan_priority = 0 Jul 03 09:47:59.878191 np0000004400 cinder-backup[101319]: iface.vlan_state = Jul 03 09:47:59.878191 np0000004400 cinder-backup[101319]: iface.iface_num = 0 Jul 03 09:47:59.878191 np0000004400 cinder-backup[101319]: iface.mtu = 0 Jul 03 09:47:59.878191 np0000004400 cinder-backup[101319]: iface.port = 0 Jul 03 09:47:59.878191 np0000004400 cinder-backup[101319]: iface.bootproto = Jul 03 09:47:59.878191 np0000004400 cinder-backup[101319]: iface.subnet_mask = Jul 03 09:47:59.878191 np0000004400 cinder-backup[101319]: iface.gateway = Jul 03 09:47:59.878191 np0000004400 cinder-backup[101319]: iface.dhcp_alt_client_id_state = Jul 03 09:47:59.878191 np0000004400 cinder-backup[101319]: iface.dhcp_alt_client_id = Jul 03 09:47:59.878191 np0000004400 cinder-backup[101319]: iface.dhcp_dns = Jul 03 09:47:59.878191 np0000004400 cinder-backup[101319]: iface.dhcp_learn_iqn = Jul 03 09:47:59.878191 np0000004400 cinder-backup[101319]: iface.dhcp_req_vendor_id_state = Jul 03 09:47:59.878191 np0000004400 cinder-backup[101319]: iface.dhcp_vendor_id_state = Jul 03 09:47:59.878191 np0000004400 cinder-backup[101319]: iface.dhcp_vendor_id = Jul 03 09:47:59.878191 np0000004400 cinder-backup[101319]: iface.dhcp_slp_da = Jul 03 09:47:59.878191 np0000004400 cinder-backup[101319]: iface.fragmentation = Jul 03 09:47:59.878191 np0000004400 cinder-backup[101319]: iface.gratuitous_arp = Jul 03 09:47:59.878191 np0000004400 cinder-backup[101319]: iface.incoming_forwarding = Jul 03 09:47:59.878191 np0000004400 cinder-backup[101319]: iface.tos_state = Jul 03 09:47:59.878191 np0000004400 cinder-backup[101319]: iface.tos = 0 Jul 03 09:47:59.878191 np0000004400 cinder-backup[101319]: iface.ttl = 0 Jul 03 09:47:59.878191 np0000004400 cinder-backup[101319]: iface.delayed_ack = Jul 03 09:47:59.878191 np0000004400 cinder-backup[101319]: iface.tcp_nagle = Jul 03 09:47:59.878191 np0000004400 cinder-backup[101319]: iface.tcp_wsf_state = Jul 03 09:47:59.878191 np0000004400 cinder-backup[101319]: iface.tcp_wsf = 0 Jul 03 09:47:59.878191 np0000004400 cinder-backup[101319]: iface.tcp_timer_scale = 0 Jul 03 09:47:59.878191 np0000004400 cinder-backup[101319]: iface.tcp_timestamp = Jul 03 09:47:59.878191 np0000004400 cinder-backup[101319]: iface.redirect = Jul 03 09:47:59.878191 np0000004400 cinder-backup[101319]: iface.def_task_mgmt_timeout = 0 Jul 03 09:47:59.878191 np0000004400 cinder-backup[101319]: iface.header_digest = Jul 03 09:47:59.878191 np0000004400 cinder-backup[101319]: iface.data_digest = Jul 03 09:47:59.878191 np0000004400 cinder-backup[101319]: iface.immediate_data = Jul 03 09:47:59.878191 np0000004400 cinder-backup[101319]: iface.initial_r2t = Jul 03 09:47:59.878191 np0000004400 cinder-backup[101319]: iface.data_seq_inorder = Jul 03 09:47:59.878191 np0000004400 cinder-backup[101319]: iface.data_pdu_inorder = Jul 03 09:47:59.878191 np0000004400 cinder-backup[101319]: iface.erl = 0 Jul 03 09:47:59.878191 np0000004400 cinder-backup[101319]: iface.max_receive_data_len = 0 Jul 03 09:47:59.878191 np0000004400 cinder-backup[101319]: iface.first_burst_len = 0 Jul 03 09:47:59.878191 np0000004400 cinder-backup[101319]: iface.max_outstanding_r2t = 0 Jul 03 09:47:59.878191 np0000004400 cinder-backup[101319]: iface.max_burst_len = 0 Jul 03 09:47:59.878191 np0000004400 cinder-backup[101319]: iface.chap_auth = Jul 03 09:47:59.878191 np0000004400 cinder-backup[101319]: iface.bidi_chap = Jul 03 09:47:59.878191 np0000004400 cinder-backup[101319]: iface.strict_login_compliance = Jul 03 09:47:59.878191 np0000004400 cinder-backup[101319]: iface.discovery_auth = Jul 03 09:47:59.878191 np0000004400 cinder-backup[101319]: iface.discovery_logout = Jul 03 09:47:59.878191 np0000004400 cinder-backup[101319]: node.discovery_address = Jul 03 09:47:59.878191 np0000004400 cinder-backup[101319]: node.discovery_port = 0 Jul 03 09:47:59.878191 np0000004400 cinder-backup[101319]: node.discovery_type = fw Jul 03 09:47:59.878191 np0000004400 cinder-backup[101319]: node.session.initial_cmdsn = 0 Jul 03 09:47:59.878191 np0000004400 cinder-backup[101319]: node.session.initial_login_retry_max = 8 Jul 03 09:47:59.878191 np0000004400 cinder-backup[101319]: node.session.xmit_thread_priority = 0 Jul 03 09:47:59.878191 np0000004400 cinder-backup[101319]: node.session.cmds_max = 128 Jul 03 09:47:59.878191 np0000004400 cinder-backup[101319]: node.session.queue_depth = 32 Jul 03 09:47:59.878191 np0000004400 cinder-backup[101319]: node.session.nr_sessions = 1 Jul 03 09:47:59.878191 np0000004400 cinder-backup[101319]: node.session.auth.authmethod = None Jul 03 09:47:59.878191 np0000004400 cinder-backup[101319]: node.session.auth.username = Jul 03 09:47:59.878191 np0000004400 cinder-backup[101319]: node.session.auth.password = *** Jul 03 09:47:59.878191 np0000004400 cinder-backup[101319]: node.session.auth.username_in = Jul 03 09:47:59.878191 np0000004400 cinder-backup[101319]: node.session.auth.password_in = Jul 03 09:47:59.878191 np0000004400 cinder-backup[101319]: node.session.auth.chap_algs = SHA256 Jul 03 09:47:59.878191 np0000004400 cinder-backup[101319]: node.session.timeo.replacement_timeout = 120 Jul 03 09:47:59.878191 np0000004400 cinder-backup[101319]: node.session.err_timeo.abort_timeout = 15 Jul 03 09:47:59.878191 np0000004400 cinder-backup[101319]: node.session.err_timeo.lu_reset_timeout = 30 Jul 03 09:47:59.878191 np0000004400 cinder-backup[101319]: node.session.err_timeo.tgt_reset_timeout = 30 Jul 03 09:47:59.878191 np0000004400 cinder-backup[101319]: node.session.err_timeo.host_reset_timeout = 60 Jul 03 09:47:59.878191 np0000004400 cinder-backup[101319]: node.session.iscsi.FastAbort = Yes Jul 03 09:47:59.878191 np0000004400 cinder-backup[101319]: node.session.iscsi.InitialR2T = No Jul 03 09:47:59.878191 np0000004400 cinder-backup[101319]: node.session.iscsi.ImmediateData = Yes Jul 03 09:47:59.878191 np0000004400 cinder-backup[101319]: node.session.iscsi.FirstBurstLength = 262144 Jul 03 09:47:59.878191 np0000004400 cinder-backup[101319]: node.session.iscsi.MaxBurstLength = 16776192 Jul 03 09:47:59.878191 np0000004400 cinder-backup[101319]: node.session.iscsi.DefaultTime2Retain = 0 Jul 03 09:47:59.878191 np0000004400 cinder-backup[101319]: node.session.iscsi.DefaultTime2Wait = 2 Jul 03 09:47:59.878191 np0000004400 cinder-backup[101319]: node.session.iscsi.MaxConnections = 1 Jul 03 09:47:59.878191 np0000004400 cinder-backup[101319]: node.session.iscsi.MaxOutstandingR2T = 1 Jul 03 09:47:59.878191 np0000004400 cinder-backup[101319]: node.session.iscsi.ERL = 0 Jul 03 09:47:59.878191 np0000004400 cinder-backup[101319]: node.session.scan = auto Jul 03 09:47:59.878191 np0000004400 cinder-backup[101319]: node.session.reopen_max = 0 Jul 03 09:47:59.878191 np0000004400 cinder-backup[101319]: node.conn[0].address = 192.168.40.100 Jul 03 09:47:59.878191 np0000004400 cinder-backup[101319]: node.conn[0].port = 3260 Jul 03 09:47:59.878191 np0000004400 cinder-backup[101319]: node.conn[0].startup = manual Jul 03 09:47:59.878191 np0000004400 cinder-backup[101319]: node.conn[0].tcp.window_size = 524288 Jul 03 09:47:59.878191 np0000004400 cinder-backup[101319]: node.conn[0].tcp.type_of_service = 0 Jul 03 09:47:59.878191 np0000004400 cinder-backup[101319]: node.conn[0].timeo.logout_timeout = 15 Jul 03 09:47:59.878191 np0000004400 cinder-backup[101319]: node.conn[0].timeo.login_timeout = 15 Jul 03 09:47:59.878191 np0000004400 cinder-backup[101319]: node.conn[0].timeo.auth_timeout = 45 Jul 03 09:47:59.878191 np0000004400 cinder-backup[101319]: node.conn[0].timeo.noop_out_interval = 5 Jul 03 09:47:59.878191 np0000004400 cinder-backup[101319]: node.conn[0].timeo.noop_out_timeout = 5 Jul 03 09:47:59.878191 np0000004400 cinder-backup[101319]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0 Jul 03 09:47:59.878191 np0000004400 cinder-backup[101319]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144 Jul 03 09:47:59.878191 np0000004400 cinder-backup[101319]: node.conn[0].iscsi.HeaderDigest = None Jul 03 09:47:59.878191 np0000004400 cinder-backup[101319]: node.conn[0].iscsi.DataDigest = None Jul 03 09:47:59.878191 np0000004400 cinder-backup[101319]: node.conn[0].iscsi.IFMarker = No Jul 03 09:47:59.878191 np0000004400 cinder-backup[101319]: node.conn[0].iscsi.OFMarker = No Jul 03 09:47:59.878191 np0000004400 cinder-backup[101319]: # END RECORD Jul 03 09:47:59.878191 np0000004400 cinder-backup[101319]: stderr= {{(pid=101319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 03 09:47:59.905788 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-2d74be38-53f4-4512-acc2-41535a13bff9 tempest-ProjectAdminTests39-820123544 None] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=101319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 03 09:47:59.925976 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-2d74be38-53f4-4512-acc2-41535a13bff9 tempest-ProjectAdminTests39-820123544 None] iscsiadm ('-m', 'session'): stdout=tcp: [120] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8a0b1cfb-8ea1-46a0-aac3-b254107b98ef (non-flash) Jul 03 09:47:59.925976 np0000004400 cinder-backup[101319]: tcp: [121] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8a0b1cfb-8ea1-46a0-aac3-b254107b98ef (non-flash) Jul 03 09:47:59.925976 np0000004400 cinder-backup[101319]: tcp: [131] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5a7e8b1b-2c9f-4abc-adf4-93f8e3df7477 (non-flash) Jul 03 09:47:59.925976 np0000004400 cinder-backup[101319]: tcp: [132] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5a7e8b1b-2c9f-4abc-adf4-93f8e3df7477 (non-flash) Jul 03 09:47:59.925976 np0000004400 cinder-backup[101319]: tcp: [133] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-17bc2851-cb3a-4797-93e7-4d33135c0ea1 (non-flash) Jul 03 09:47:59.925976 np0000004400 cinder-backup[101319]: tcp: [134] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-126e9ee0-d9b5-4c59-b3ee-5d49eb8e8373 (non-flash) Jul 03 09:47:59.925976 np0000004400 cinder-backup[101319]: tcp: [135] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-126e9ee0-d9b5-4c59-b3ee-5d49eb8e8373 (non-flash) Jul 03 09:47:59.925976 np0000004400 cinder-backup[101319]: stderr= {{(pid=101319) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jul 03 09:47:59.926178 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-2d74be38-53f4-4512-acc2-41535a13bff9 tempest-ProjectAdminTests39-820123544 None] iscsi session list stdout=tcp: [120] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8a0b1cfb-8ea1-46a0-aac3-b254107b98ef (non-flash) Jul 03 09:47:59.926178 np0000004400 cinder-backup[101319]: tcp: [121] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8a0b1cfb-8ea1-46a0-aac3-b254107b98ef (non-flash) Jul 03 09:47:59.926178 np0000004400 cinder-backup[101319]: tcp: [131] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5a7e8b1b-2c9f-4abc-adf4-93f8e3df7477 (non-flash) Jul 03 09:47:59.926178 np0000004400 cinder-backup[101319]: tcp: [132] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5a7e8b1b-2c9f-4abc-adf4-93f8e3df7477 (non-flash) Jul 03 09:47:59.926178 np0000004400 cinder-backup[101319]: tcp: [133] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-17bc2851-cb3a-4797-93e7-4d33135c0ea1 (non-flash) Jul 03 09:47:59.926178 np0000004400 cinder-backup[101319]: tcp: [134] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-126e9ee0-d9b5-4c59-b3ee-5d49eb8e8373 (non-flash) Jul 03 09:47:59.926178 np0000004400 cinder-backup[101319]: tcp: [135] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-126e9ee0-d9b5-4c59-b3ee-5d49eb8e8373 (non-flash) Jul 03 09:47:59.926178 np0000004400 cinder-backup[101319]: stderr= {{(pid=101319) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jul 03 09:47:59.973120 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-2d74be38-53f4-4512-acc2-41535a13bff9 tempest-ProjectAdminTests39-820123544 None] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-9699c5a1-ca0a-4162-91dc-8afd21ba1199, portal: 192.168.40.100,3260] Jul 03 09:47:59.973120 np0000004400 cinder-backup[101319]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-9699c5a1-ca0a-4162-91dc-8afd21ba1199, portal: 192.168.40.100,3260] successful. Jul 03 09:47:59.973120 np0000004400 cinder-backup[101319]: stderr= {{(pid=101319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 03 09:47:59.994421 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-2d74be38-53f4-4512-acc2-41535a13bff9 tempest-ProjectAdminTests39-820123544 None] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=101319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 03 09:48:00.020042 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-2d74be38-53f4-4512-acc2-41535a13bff9 tempest-ProjectAdminTests39-820123544 None] iscsiadm ('-m', 'session'): stdout=tcp: [120] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8a0b1cfb-8ea1-46a0-aac3-b254107b98ef (non-flash) Jul 03 09:48:00.020042 np0000004400 cinder-backup[101319]: tcp: [121] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8a0b1cfb-8ea1-46a0-aac3-b254107b98ef (non-flash) Jul 03 09:48:00.020042 np0000004400 cinder-backup[101319]: tcp: [131] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5a7e8b1b-2c9f-4abc-adf4-93f8e3df7477 (non-flash) Jul 03 09:48:00.020042 np0000004400 cinder-backup[101319]: tcp: [132] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5a7e8b1b-2c9f-4abc-adf4-93f8e3df7477 (non-flash) Jul 03 09:48:00.020042 np0000004400 cinder-backup[101319]: tcp: [133] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-17bc2851-cb3a-4797-93e7-4d33135c0ea1 (non-flash) Jul 03 09:48:00.020042 np0000004400 cinder-backup[101319]: tcp: [134] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-126e9ee0-d9b5-4c59-b3ee-5d49eb8e8373 (non-flash) Jul 03 09:48:00.020042 np0000004400 cinder-backup[101319]: tcp: [135] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-126e9ee0-d9b5-4c59-b3ee-5d49eb8e8373 (non-flash) Jul 03 09:48:00.020042 np0000004400 cinder-backup[101319]: tcp: [136] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9699c5a1-ca0a-4162-91dc-8afd21ba1199 (non-flash) Jul 03 09:48:00.020042 np0000004400 cinder-backup[101319]: stderr= {{(pid=101319) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jul 03 09:48:00.020042 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-2d74be38-53f4-4512-acc2-41535a13bff9 tempest-ProjectAdminTests39-820123544 None] iscsi session list stdout=tcp: [120] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8a0b1cfb-8ea1-46a0-aac3-b254107b98ef (non-flash) Jul 03 09:48:00.020042 np0000004400 cinder-backup[101319]: tcp: [121] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8a0b1cfb-8ea1-46a0-aac3-b254107b98ef (non-flash) Jul 03 09:48:00.020042 np0000004400 cinder-backup[101319]: tcp: [131] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5a7e8b1b-2c9f-4abc-adf4-93f8e3df7477 (non-flash) Jul 03 09:48:00.020042 np0000004400 cinder-backup[101319]: tcp: [132] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5a7e8b1b-2c9f-4abc-adf4-93f8e3df7477 (non-flash) Jul 03 09:48:00.020042 np0000004400 cinder-backup[101319]: tcp: [133] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-17bc2851-cb3a-4797-93e7-4d33135c0ea1 (non-flash) Jul 03 09:48:00.020042 np0000004400 cinder-backup[101319]: tcp: [134] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-126e9ee0-d9b5-4c59-b3ee-5d49eb8e8373 (non-flash) Jul 03 09:48:00.020042 np0000004400 cinder-backup[101319]: tcp: [135] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-126e9ee0-d9b5-4c59-b3ee-5d49eb8e8373 (non-flash) Jul 03 09:48:00.020042 np0000004400 cinder-backup[101319]: tcp: [136] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9699c5a1-ca0a-4162-91dc-8afd21ba1199 (non-flash) Jul 03 09:48:00.020042 np0000004400 cinder-backup[101319]: stderr= {{(pid=101319) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jul 03 09:48:00.020042 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.base [None req-2d74be38-53f4-4512-acc2-41535a13bff9 tempest-ProjectAdminTests39-820123544 None] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-9699c5a1-ca0a-4162-91dc-8afd21ba1199" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.193s {{(pid=101319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jul 03 09:48:00.020042 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-2d74be38-53f4-4512-acc2-41535a13bff9 tempest-ProjectAdminTests39-820123544 None] Connected to 192.168.40.100:3260 {{(pid=101319) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}} Jul 03 09:48:00.020042 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.linuxscsi [None req-2d74be38-53f4-4512-acc2-41535a13bff9 tempest-ProjectAdminTests39-820123544 None] HCTL ('10', '-', '-', 0) found on session 136 with lun 0 {{(pid=101319) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}} Jul 03 09:48:00.020042 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.linuxscsi [None req-2d74be38-53f4-4512-acc2-41535a13bff9 tempest-ProjectAdminTests39-820123544 None] Scanning host 10 c: -, t: -, l: 0) {{(pid=101319) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}} Jul 03 09:48:00.043127 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.linuxscsi [None req-2d74be38-53f4-4512-acc2-41535a13bff9 tempest-ProjectAdminTests39-820123544 None] Searching for a device in session 136 and hctl ['10', '*', '*', 0] yield: None {{(pid=101319) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}} Jul 03 09:48:00.694482 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.driver [None req-7222a40f-51a0-40fa-9d1b-daf340fa3b17 tempest-VolumesBackupsTest-2142009639 None] Getting metadata type 'volume-base-metadata' {{(pid=101319) _save_vol_base_meta /opt/stack/cinder/cinder/backup/driver.py:79}} Jul 03 09:48:00.703542 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.driver [None req-7222a40f-51a0-40fa-9d1b-daf340fa3b17 tempest-VolumesBackupsTest-2142009639 None] Completed fetching metadata type 'volume-base-metadata' {{(pid=101319) _save_vol_base_meta /opt/stack/cinder/cinder/backup/driver.py:98}} Jul 03 09:48:00.703807 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.driver [None req-7222a40f-51a0-40fa-9d1b-daf340fa3b17 tempest-VolumesBackupsTest-2142009639 None] Getting metadata type 'volume-metadata' {{(pid=101319) _save_vol_meta /opt/stack/cinder/cinder/backup/driver.py:109}} Jul 03 09:48:00.708979 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.driver [None req-7222a40f-51a0-40fa-9d1b-daf340fa3b17 tempest-VolumesBackupsTest-2142009639 None] No metadata type 'volume-metadata' available {{(pid=101319) _save_vol_meta /opt/stack/cinder/cinder/backup/driver.py:123}} Jul 03 09:48:00.709217 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.driver [None req-7222a40f-51a0-40fa-9d1b-daf340fa3b17 tempest-VolumesBackupsTest-2142009639 None] Getting metadata type 'volume-glance-metadata' {{(pid=101319) _save_vol_glance_meta /opt/stack/cinder/cinder/backup/driver.py:132}} Jul 03 09:48:00.716683 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.driver [None req-7222a40f-51a0-40fa-9d1b-daf340fa3b17 tempest-VolumesBackupsTest-2142009639 None] No metadata type 'volume-glance-metadata' available {{(pid=101319) _save_vol_glance_meta /opt/stack/cinder/cinder/backup/driver.py:147}} Jul 03 09:48:00.717033 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-7222a40f-51a0-40fa-9d1b-daf340fa3b17 tempest-VolumesBackupsTest-2142009639 None] _write_sha256file started, container name: tempest-volumesbackupstest-backup-container-422378187, sha256file filename: volume_8a0b1cfb-8ea1-46a0-aac3-b254107b98ef/20260703094755/az_nova_backup_8763861d-eff9-45d6-812c-fb65cb7ebea7_sha256file. {{(pid=101319) _write_sha256file /opt/stack/cinder/cinder/backup/chunkeddriver.py:299}} Jul 03 09:48:00.817765 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-7222a40f-51a0-40fa-9d1b-daf340fa3b17 tempest-VolumesBackupsTest-2142009639 None] _write_sha256file finished. {{(pid=101319) _write_sha256file /opt/stack/cinder/cinder/backup/chunkeddriver.py:315}} Jul 03 09:48:00.818619 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-7222a40f-51a0-40fa-9d1b-daf340fa3b17 tempest-VolumesBackupsTest-2142009639 None] _write_metadata started, container name: tempest-volumesbackupstest-backup-container-422378187, metadata filename: volume_8a0b1cfb-8ea1-46a0-aac3-b254107b98ef/20260703094755/az_nova_backup_8763861d-eff9-45d6-812c-fb65cb7ebea7_metadata. {{(pid=101319) _write_metadata /opt/stack/cinder/cinder/backup/chunkeddriver.py:276}} Jul 03 09:48:00.852046 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-7222a40f-51a0-40fa-9d1b-daf340fa3b17 tempest-VolumesBackupsTest-2142009639 None] _write_metadata finished. Metadata: b'{\n "backup_description": null,\n "backup_id": "8763861d-eff9-45d6-812c-fb65cb7ebea7",\n "backup_name": "tempest-VolumesBackupsTest-Backup-2013885995",\n "created_at": "2026-07-03 09:47:50+00:00",\n "objects": [],\n "parent_id": "86118233-3d57-47ad-8781-cab6c54e4d53",\n "version": "1.0.0",\n "volume_id": "8a0b1cfb-8ea1-46a0-aac3-b254107b98ef",\n "volume_meta": "{\\"version\\": 2, \\"volume-base-metadata\\": {\\"id\\": \\"8a0b1cfb-8ea1-46a0-aac3-b254107b98ef\\", \\"_name_id\\": null, \\"use_quota\\": true, \\"ec2_id\\": null, \\"user_id\\": \\"91463b6c437c4711a49d3c31c513a101\\", \\"project_id\\": \\"59044e18a5b24b19a7b9b8a380f2e1a0\\", \\"snapshot_id\\": null, \\"cluster_name\\": null, \\"host\\": \\"np0000004400@storpool#default\\", \\"size\\": 1, \\"availability_zone\\": \\"nova\\", \\"status\\": \\"backing-up\\", \\"attach_status\\": \\"attached\\", \\"migration_status\\": null, \\"scheduled_at\\": \\"2026-07-03T09:46:10.000000\\", \\"launched_at\\": \\"2026-07-03T09:46:10.000000\\", \\"terminated_at\\": null, \\"display_name\\": \\"tempest-VolumesBackupsTest-Volume-175473569\\", \\"display_description\\": null, \\"provider_location\\": null, \\"provider_auth\\": null, \\"provider_geometry\\": null, \\"provider_id\\": null, \\"volume_type_id\\": \\"03e13fe6-0e30-4803-ace0-725d38e6dc24\\", \\"source_volid\\": null, \\"encryption_key_id\\": null, \\"consistencygroup_id\\": null, \\"group_id\\": null, \\"bootable\\": false, \\"multiattach\\": false, \\"replication_status\\": null, \\"replication_extended_status\\": null, \\"replication_driver_data\\": null, \\"previous_status\\": \\"in-use\\", \\"service_uuid\\": \\"6d4b0e79-fefe-4744-b25f-34be05095200\\", \\"shared_targets\\": true, \\"deleted_at\\": null, \\"deleted\\": false, \\"created_at\\": \\"2026-07-03T09:46:10.000000\\", \\"updated_at\\": \\"2026-07-03T09:47:50.000000\\"}}"\n}'. {{(pid=101319) _write_metadata /opt/stack/cinder/cinder/backup/chunkeddriver.py:295}} Jul 03 09:48:00.866111 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-7222a40f-51a0-40fa-9d1b-daf340fa3b17 tempest-VolumesBackupsTest-2142009639 None] backup 8763861d-eff9-45d6-812c-fb65cb7ebea7 finished. {{(pid=101319) _finalize_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:462}} Jul 03 09:48:00.998180 np0000004400 cinder-backup[101319]: DEBUG oslo_concurrency.processutils [None req-7222a40f-51a0-40fa-9d1b-daf340fa3b17 tempest-VolumesBackupsTest-2142009639 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chown 0 /dev/sdb {{(pid=101319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 09:48:01.022249 np0000004400 sudo[142548]: stack : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chown 0 /dev/sdb Jul 03 09:48:01.023143 np0000004400 sudo[142548]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1002) Jul 03 09:48:01.044702 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.linuxscsi [None req-2d74be38-53f4-4512-acc2-41535a13bff9 tempest-ProjectAdminTests39-820123544 None] Searching for a device in session 136 and hctl ['10', '*', '*', 0] yield: sde {{(pid=101319) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}} Jul 03 09:48:01.044979 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-2d74be38-53f4-4512-acc2-41535a13bff9 tempest-ProjectAdminTests39-820123544 None] Connected to sde using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-9699c5a1-ca0a-4162-91dc-8afd21ba1199', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '9699c5a1-ca0a-4162-91dc-8afd21ba1199', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': False} {{(pid=101319) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}} Jul 03 09:48:01.045912 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.base [None req-2d74be38-53f4-4512-acc2-41535a13bff9 tempest-ProjectAdminTests39-820123544 None] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 2.232s {{(pid=101319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jul 03 09:48:01.046125 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-2d74be38-53f4-4512-acc2-41535a13bff9 tempest-ProjectAdminTests39-820123544 None] <== connect_volume: return (2233ms) {'type': 'block', 'scsi_wwn': '330000000297c8939', 'path': '/dev/sde'} {{(pid=101319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}} Jul 03 09:48:01.046629 np0000004400 cinder-backup[101319]: DEBUG oslo_concurrency.processutils [None req-2d74be38-53f4-4512-acc2-41535a13bff9 tempest-ProjectAdminTests39-820123544 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chown 1002 /dev/sde {{(pid=101319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 09:48:01.063324 np0000004400 sudo[142554]: stack : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chown 1002 /dev/sde Jul 03 09:48:01.063949 np0000004400 sudo[142554]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1002) Jul 03 09:48:01.355425 np0000004400 sudo[142548]: pam_unix(sudo:session): session closed for user root Jul 03 09:48:01.358578 np0000004400 cinder-backup[101319]: DEBUG oslo_concurrency.processutils [None req-7222a40f-51a0-40fa-9d1b-daf340fa3b17 tempest-VolumesBackupsTest-2142009639 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chown 0 /dev/sdb" returned: 0 in 0.359s {{(pid=101319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 09:48:01.358697 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-7222a40f-51a0-40fa-9d1b-daf340fa3b17 tempest-VolumesBackupsTest-2142009639 None] ==> disconnect_volume: call "{'args': (, {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-17bc2851-cb3a-4797-93e7-4d33135c0ea1', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '17bc2851-cb3a-4797-93e7-4d33135c0ea1', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': False}, {'type': 'block', 'scsi_wwn': '3300000009b00c8ee', 'path': '/dev/sdb'}), 'kwargs': {'force': True, 'ignore_errors': True}}" {{(pid=101319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}} Jul 03 09:48:01.358983 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.base [None req-7222a40f-51a0-40fa-9d1b-daf340fa3b17 tempest-VolumesBackupsTest-2142009639 None] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=101319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jul 03 09:48:01.359949 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.base [None req-7222a40f-51a0-40fa-9d1b-daf340fa3b17 tempest-VolumesBackupsTest-2142009639 None] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=101319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jul 03 09:48:01.360593 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-7222a40f-51a0-40fa-9d1b-daf340fa3b17 tempest-VolumesBackupsTest-2142009639 None] _get_connection_devices called with parameters: connection_properties={'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-17bc2851-cb3a-4797-93e7-4d33135c0ea1', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '17bc2851-cb3a-4797-93e7-4d33135c0ea1', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': False}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=101319) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:847}} Jul 03 09:48:01.374566 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-7222a40f-51a0-40fa-9d1b-daf340fa3b17 tempest-VolumesBackupsTest-2142009639 None] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS: Jul 03 09:48:01.374566 np0000004400 cinder-backup[101319]: No targets found. Jul 03 09:48:01.374566 np0000004400 cinder-backup[101319]: iSNS: Jul 03 09:48:01.374566 np0000004400 cinder-backup[101319]: No targets found. Jul 03 09:48:01.374566 np0000004400 cinder-backup[101319]: STATIC: Jul 03 09:48:01.374566 np0000004400 cinder-backup[101319]: Target: iqn.2023-03.storpool.com:os--volume-8a0b1cfb-8ea1-46a0-aac3-b254107b98ef Jul 03 09:48:01.374566 np0000004400 cinder-backup[101319]: Portal: 192.168.50.100:3260,-1 Jul 03 09:48:01.374566 np0000004400 cinder-backup[101319]: Iface Name: default Jul 03 09:48:01.374566 np0000004400 cinder-backup[101319]: Portal: 192.168.40.100:3260,-1 Jul 03 09:48:01.374566 np0000004400 cinder-backup[101319]: Iface Name: default Jul 03 09:48:01.374566 np0000004400 cinder-backup[101319]: Target: iqn.2023-03.storpool.com:os--volume-9699c5a1-ca0a-4162-91dc-8afd21ba1199 Jul 03 09:48:01.374566 np0000004400 cinder-backup[101319]: Portal: 192.168.40.100:3260,-1 Jul 03 09:48:01.374566 np0000004400 cinder-backup[101319]: Iface Name: default Jul 03 09:48:01.374566 np0000004400 cinder-backup[101319]: Target: iqn.2023-03.storpool.com:os--volume-17bc2851-cb3a-4797-93e7-4d33135c0ea1 Jul 03 09:48:01.374566 np0000004400 cinder-backup[101319]: Portal: 192.168.40.100:3260,-1 Jul 03 09:48:01.374566 np0000004400 cinder-backup[101319]: Iface Name: default Jul 03 09:48:01.374566 np0000004400 cinder-backup[101319]: Target: iqn.2023-03.storpool.com:os--volume-5a7e8b1b-2c9f-4abc-adf4-93f8e3df7477 Jul 03 09:48:01.374566 np0000004400 cinder-backup[101319]: Portal: 192.168.50.100:3260,-1 Jul 03 09:48:01.374566 np0000004400 cinder-backup[101319]: Iface Name: default Jul 03 09:48:01.374566 np0000004400 cinder-backup[101319]: Portal: 192.168.40.100:3260,-1 Jul 03 09:48:01.374566 np0000004400 cinder-backup[101319]: Iface Name: default Jul 03 09:48:01.374566 np0000004400 cinder-backup[101319]: Target: iqn.2023-03.storpool.com:os--volume-126e9ee0-d9b5-4c59-b3ee-5d49eb8e8373 Jul 03 09:48:01.374566 np0000004400 cinder-backup[101319]: Portal: 192.168.50.100:3260,-1 Jul 03 09:48:01.374566 np0000004400 cinder-backup[101319]: Iface Name: default Jul 03 09:48:01.374566 np0000004400 cinder-backup[101319]: Portal: 192.168.40.100:3260,-1 Jul 03 09:48:01.374566 np0000004400 cinder-backup[101319]: Iface Name: default Jul 03 09:48:01.374566 np0000004400 cinder-backup[101319]: FIRMWARE: Jul 03 09:48:01.374566 np0000004400 cinder-backup[101319]: No targets found. Jul 03 09:48:01.374566 np0000004400 cinder-backup[101319]: stderr= {{(pid=101319) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jul 03 09:48:01.375665 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-7222a40f-51a0-40fa-9d1b-daf340fa3b17 tempest-VolumesBackupsTest-2142009639 None] Regex to get portals from discoverydb: ^SENDTARGETS: Jul 03 09:48:01.375665 np0000004400 cinder-backup[101319]: .*?^DiscoveryAddress: 192.168.40.100,3260.*? Jul 03 09:48:01.375665 np0000004400 cinder-backup[101319]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=101319) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:390}} Jul 03 09:48:01.375665 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-7222a40f-51a0-40fa-9d1b-daf340fa3b17 tempest-VolumesBackupsTest-2142009639 None] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-17bc2851-cb3a-4797-93e7-4d33135c0ea1', 0)] {{(pid=101319) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:858}} Jul 03 09:48:01.379642 np0000004400 sudo[142554]: pam_unix(sudo:session): session closed for user root Jul 03 09:48:01.381664 np0000004400 cinder-backup[101319]: DEBUG oslo_concurrency.processutils [None req-2d74be38-53f4-4512-acc2-41535a13bff9 tempest-ProjectAdminTests39-820123544 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chown 1002 /dev/sde" returned: 0 in 0.335s {{(pid=101319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 09:48:01.401771 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-2d74be38-53f4-4512-acc2-41535a13bff9 tempest-ProjectAdminTests39-820123544 None] _create_container started, container: volumebackups,backup: cc724ce5-d7d3-4792-9be0-9c59b7436ba7. {{(pid=101319) _create_container /opt/stack/cinder/cinder/backup/chunkeddriver.py:249}} Jul 03 09:48:01.412092 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-7222a40f-51a0-40fa-9d1b-daf340fa3b17 tempest-VolumesBackupsTest-2142009639 None] iscsiadm ('-m', 'session'): stdout=tcp: [120] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8a0b1cfb-8ea1-46a0-aac3-b254107b98ef (non-flash) Jul 03 09:48:01.412092 np0000004400 cinder-backup[101319]: tcp: [121] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8a0b1cfb-8ea1-46a0-aac3-b254107b98ef (non-flash) Jul 03 09:48:01.412092 np0000004400 cinder-backup[101319]: tcp: [131] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5a7e8b1b-2c9f-4abc-adf4-93f8e3df7477 (non-flash) Jul 03 09:48:01.412092 np0000004400 cinder-backup[101319]: tcp: [132] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5a7e8b1b-2c9f-4abc-adf4-93f8e3df7477 (non-flash) Jul 03 09:48:01.412092 np0000004400 cinder-backup[101319]: tcp: [133] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-17bc2851-cb3a-4797-93e7-4d33135c0ea1 (non-flash) Jul 03 09:48:01.412092 np0000004400 cinder-backup[101319]: tcp: [134] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-126e9ee0-d9b5-4c59-b3ee-5d49eb8e8373 (non-flash) Jul 03 09:48:01.412092 np0000004400 cinder-backup[101319]: tcp: [135] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-126e9ee0-d9b5-4c59-b3ee-5d49eb8e8373 (non-flash) Jul 03 09:48:01.412092 np0000004400 cinder-backup[101319]: tcp: [136] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9699c5a1-ca0a-4162-91dc-8afd21ba1199 (non-flash) Jul 03 09:48:01.412092 np0000004400 cinder-backup[101319]: stderr= {{(pid=101319) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jul 03 09:48:01.412508 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-7222a40f-51a0-40fa-9d1b-daf340fa3b17 tempest-VolumesBackupsTest-2142009639 None] iscsi session list stdout=tcp: [120] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8a0b1cfb-8ea1-46a0-aac3-b254107b98ef (non-flash) Jul 03 09:48:01.412508 np0000004400 cinder-backup[101319]: tcp: [121] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8a0b1cfb-8ea1-46a0-aac3-b254107b98ef (non-flash) Jul 03 09:48:01.412508 np0000004400 cinder-backup[101319]: tcp: [131] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5a7e8b1b-2c9f-4abc-adf4-93f8e3df7477 (non-flash) Jul 03 09:48:01.412508 np0000004400 cinder-backup[101319]: tcp: [132] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5a7e8b1b-2c9f-4abc-adf4-93f8e3df7477 (non-flash) Jul 03 09:48:01.412508 np0000004400 cinder-backup[101319]: tcp: [133] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-17bc2851-cb3a-4797-93e7-4d33135c0ea1 (non-flash) Jul 03 09:48:01.412508 np0000004400 cinder-backup[101319]: tcp: [134] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-126e9ee0-d9b5-4c59-b3ee-5d49eb8e8373 (non-flash) Jul 03 09:48:01.412508 np0000004400 cinder-backup[101319]: tcp: [135] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-126e9ee0-d9b5-4c59-b3ee-5d49eb8e8373 (non-flash) Jul 03 09:48:01.412508 np0000004400 cinder-backup[101319]: tcp: [136] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9699c5a1-ca0a-4162-91dc-8afd21ba1199 (non-flash) Jul 03 09:48:01.412508 np0000004400 cinder-backup[101319]: stderr= {{(pid=101319) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jul 03 09:48:01.412770 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-7222a40f-51a0-40fa-9d1b-daf340fa3b17 tempest-VolumesBackupsTest-2142009639 None] Sessions list: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-8a0b1cfb-8ea1-46a0-aac3-b254107b98ef', '120'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-8a0b1cfb-8ea1-46a0-aac3-b254107b98ef', '121'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-5a7e8b1b-2c9f-4abc-adf4-93f8e3df7477', '131'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-5a7e8b1b-2c9f-4abc-adf4-93f8e3df7477', '132'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-17bc2851-cb3a-4797-93e7-4d33135c0ea1', '133'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-126e9ee0-d9b5-4c59-b3ee-5d49eb8e8373', '134'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-126e9ee0-d9b5-4c59-b3ee-5d49eb8e8373', '135'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-9699c5a1-ca0a-4162-91dc-8afd21ba1199', '136')] {{(pid=101319) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:866}} Jul 03 09:48:01.412857 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-7222a40f-51a0-40fa-9d1b-daf340fa3b17 tempest-VolumesBackupsTest-2142009639 None] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-17bc2851-cb3a-4797-93e7-4d33135c0ea1, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-17bc2851-cb3a-4797-93e7-4d33135c0ea1', '133')] {{(pid=101319) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}} Jul 03 09:48:01.414194 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-7222a40f-51a0-40fa-9d1b-daf340fa3b17 tempest-VolumesBackupsTest-2142009639 None] Resulting device map defaultdict(. at 0x7e76e6d1efc0>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-17bc2851-cb3a-4797-93e7-4d33135c0ea1'): ({'sdb'}, set())}) {{(pid=101319) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:912}} Jul 03 09:48:01.414517 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.linuxscsi [None req-7222a40f-51a0-40fa-9d1b-daf340fa3b17 tempest-VolumesBackupsTest-2142009639 None] Removing single pathed devices sdb {{(pid=101319) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}} Jul 03 09:48:01.432173 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.linuxscsi [None req-7222a40f-51a0-40fa-9d1b-daf340fa3b17 tempest-VolumesBackupsTest-2142009639 None] Flushing IO for device /dev/sdb {{(pid=101319) flush_device_io /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:461}} Jul 03 09:48:01.446284 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.linuxscsi [None req-7222a40f-51a0-40fa-9d1b-daf340fa3b17 tempest-VolumesBackupsTest-2142009639 None] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=101319) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}} Jul 03 09:48:01.496756 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.linuxscsi [None req-7222a40f-51a0-40fa-9d1b-daf340fa3b17 tempest-VolumesBackupsTest-2142009639 None] Checking to see if SCSI volumes sdb have been removed. {{(pid=101319) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}} Jul 03 09:48:01.496959 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.linuxscsi [None req-7222a40f-51a0-40fa-9d1b-daf340fa3b17 tempest-VolumesBackupsTest-2142009639 None] SCSI volumes sdb have been removed. {{(pid=101319) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}} Jul 03 09:48:01.497962 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.linuxscsi [None req-7222a40f-51a0-40fa-9d1b-daf340fa3b17 tempest-VolumesBackupsTest-2142009639 None] Checking to see if device paths {'sdb'} are still under multipathd monitoring {{(pid=101319) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}} Jul 03 09:48:01.510651 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.linuxscsi [None req-7222a40f-51a0-40fa-9d1b-daf340fa3b17 tempest-VolumesBackupsTest-2142009639 None] Device paths {'sdb'} have been removed from multipathd monitoring. {{(pid=101319) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}} Jul 03 09:48:01.510651 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-7222a40f-51a0-40fa-9d1b-daf340fa3b17 tempest-VolumesBackupsTest-2142009639 None] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-17bc2851-cb3a-4797-93e7-4d33135c0ea1')] {{(pid=101319) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1225}} Jul 03 09:48:01.525197 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-7222a40f-51a0-40fa-9d1b-daf340fa3b17 tempest-VolumesBackupsTest-2142009639 None] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=101319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 03 09:48:01.561956 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-7222a40f-51a0-40fa-9d1b-daf340fa3b17 tempest-VolumesBackupsTest-2142009639 None] iscsiadm ('--logout',): stdout=Logging out of session [sid: 133, target: iqn.2023-03.storpool.com:os--volume-17bc2851-cb3a-4797-93e7-4d33135c0ea1, portal: 192.168.40.100,3260] Jul 03 09:48:01.561956 np0000004400 cinder-backup[101319]: Logout of [sid: 133, target: iqn.2023-03.storpool.com:os--volume-17bc2851-cb3a-4797-93e7-4d33135c0ea1, portal: 192.168.40.100,3260] successful. Jul 03 09:48:01.561956 np0000004400 cinder-backup[101319]: stderr= {{(pid=101319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 03 09:48:01.579893 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-7222a40f-51a0-40fa-9d1b-daf340fa3b17 tempest-VolumesBackupsTest-2142009639 None] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=101319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 03 09:48:01.580139 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.base [None req-7222a40f-51a0-40fa-9d1b-daf340fa3b17 tempest-VolumesBackupsTest-2142009639 None] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.220s {{(pid=101319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jul 03 09:48:01.580341 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-7222a40f-51a0-40fa-9d1b-daf340fa3b17 tempest-VolumesBackupsTest-2142009639 None] <== disconnect_volume: return (221ms) None {{(pid=101319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}} Jul 03 09:48:01.689437 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.drivers.swift [None req-2d74be38-53f4-4512-acc2-41535a13bff9 tempest-ProjectAdminTests39-820123544 None] generate_object_name_prefix: volume_9699c5a1-ca0a-4162-91dc-8afd21ba1199/20260703094801/az_nova_backup_cc724ce5-d7d3-4792-9be0-9c59b7436ba7 {{(pid=101319) _generate_object_name_prefix /opt/stack/cinder/cinder/backup/drivers/swift.py:452}} Jul 03 09:48:01.697004 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-2d74be38-53f4-4512-acc2-41535a13bff9 tempest-ProjectAdminTests39-820123544 None] starting backup of volume: 9699c5a1-ca0a-4162-91dc-8afd21ba1199, volume size: 1073741824, object names prefix volume_9699c5a1-ca0a-4162-91dc-8afd21ba1199/20260703094801/az_nova_backup_cc724ce5-d7d3-4792-9be0-9c59b7436ba7, availability zone: nova {{(pid=101319) _prepare_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:359}} Jul 03 09:48:01.994694 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-2d74be38-53f4-4512-acc2-41535a13bff9 tempest-ProjectAdminTests39-820123544 None] Backing up chunk of data from volume. {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 09:48:02.253336 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-2d74be38-53f4-4512-acc2-41535a13bff9 tempest-ProjectAdminTests39-820123544 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101319) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 09:48:02.253699 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-2d74be38-53f4-4512-acc2-41535a13bff9 tempest-ProjectAdminTests39-820123544 None] About to put_object {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 09:48:02.375522 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-2d74be38-53f4-4512-acc2-41535a13bff9 tempest-ProjectAdminTests39-820123544 None] backup MD5 for volume_9699c5a1-ca0a-4162-91dc-8afd21ba1199/20260703094801/az_nova_backup_cc724ce5-d7d3-4792-9be0-9c59b7436ba7-00001: 25e317773f308e446cc84c503a6d1f85 {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 09:48:02.375775 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-2d74be38-53f4-4512-acc2-41535a13bff9 tempest-ProjectAdminTests39-820123544 None] Calling eventlet.sleep(0) {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 09:48:02.638616 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-2d74be38-53f4-4512-acc2-41535a13bff9 tempest-ProjectAdminTests39-820123544 None] Backing up chunk of data from volume. {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 09:48:02.726881 np0000004400 cinder-backup[101319]: INFO cinder.backup.manager [None req-7222a40f-51a0-40fa-9d1b-daf340fa3b17 tempest-VolumesBackupsTest-2142009639 None] Create backup finished. backup: 8763861d-eff9-45d6-812c-fb65cb7ebea7. Jul 03 09:48:02.896551 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-2d74be38-53f4-4512-acc2-41535a13bff9 tempest-ProjectAdminTests39-820123544 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101319) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 09:48:02.896677 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-2d74be38-53f4-4512-acc2-41535a13bff9 tempest-ProjectAdminTests39-820123544 None] About to put_object {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 09:48:03.256609 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-2d74be38-53f4-4512-acc2-41535a13bff9 tempest-ProjectAdminTests39-820123544 None] backup MD5 for volume_9699c5a1-ca0a-4162-91dc-8afd21ba1199/20260703094801/az_nova_backup_cc724ce5-d7d3-4792-9be0-9c59b7436ba7-00002: 25e317773f308e446cc84c503a6d1f85 {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 09:48:03.257131 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-2d74be38-53f4-4512-acc2-41535a13bff9 tempest-ProjectAdminTests39-820123544 None] Calling eventlet.sleep(0) {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 09:48:03.469118 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-2d74be38-53f4-4512-acc2-41535a13bff9 tempest-ProjectAdminTests39-820123544 None] Backing up chunk of data from volume. {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 09:48:03.494750 np0000004400 cinder-backup[101319]: INFO cinder.backup.manager [None req-15303d33-c7eb-4962-8e3b-6f1c44da1ece tempest-VolumesBackupsTest-2142009639 None] Delete backup started, backup: 8763861d-eff9-45d6-812c-fb65cb7ebea7. Jul 03 09:48:03.505473 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.drivers.swift [None req-15303d33-c7eb-4962-8e3b-6f1c44da1ece tempest-VolumesBackupsTest-2142009639 None] Using swift URL https://10.4.3.95:8080/v1/AUTH_59044e18a5b24b19a7b9b8a380f2e1a0 {{(pid=101319) initialize /opt/stack/cinder/cinder/backup/drivers/swift.py:300}} Jul 03 09:48:03.505821 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.drivers.swift [None req-15303d33-c7eb-4962-8e3b-6f1c44da1ece tempest-VolumesBackupsTest-2142009639 None] Connect to https://10.4.3.95:8080/v1/AUTH_ in "per_user" mode {{(pid=101319) initialize /opt/stack/cinder/cinder/backup/drivers/swift.py:301}} Jul 03 09:48:03.506007 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-15303d33-c7eb-4962-8e3b-6f1c44da1ece tempest-VolumesBackupsTest-2142009639 None] delete started, backup: 8763861d-eff9-45d6-812c-fb65cb7ebea7, container: tempest-volumesbackupstest-backup-container-422378187, prefix: volume_8a0b1cfb-8ea1-46a0-aac3-b254107b98ef/20260703094755/az_nova_backup_8763861d-eff9-45d6-812c-fb65cb7ebea7. {{(pid=101319) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:822}} Jul 03 09:48:03.555331 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-15303d33-c7eb-4962-8e3b-6f1c44da1ece tempest-VolumesBackupsTest-2142009639 None] generated object list: ['volume_8a0b1cfb-8ea1-46a0-aac3-b254107b98ef/20260703094755/az_nova_backup_8763861d-eff9-45d6-812c-fb65cb7ebea7_metadata', 'volume_8a0b1cfb-8ea1-46a0-aac3-b254107b98ef/20260703094755/az_nova_backup_8763861d-eff9-45d6-812c-fb65cb7ebea7_sha256file']. {{(pid=101319) _generate_object_names /opt/stack/cinder/cinder/backup/chunkeddriver.py:260}} Jul 03 09:48:03.576564 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-15303d33-c7eb-4962-8e3b-6f1c44da1ece tempest-VolumesBackupsTest-2142009639 None] deleted object: volume_8a0b1cfb-8ea1-46a0-aac3-b254107b98ef/20260703094755/az_nova_backup_8763861d-eff9-45d6-812c-fb65cb7ebea7_metadata in container: tempest-volumesbackupstest-backup-container-422378187. {{(pid=101319) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 09:48:03.598354 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-15303d33-c7eb-4962-8e3b-6f1c44da1ece tempest-VolumesBackupsTest-2142009639 None] deleted object: volume_8a0b1cfb-8ea1-46a0-aac3-b254107b98ef/20260703094755/az_nova_backup_8763861d-eff9-45d6-812c-fb65cb7ebea7_sha256file in container: tempest-volumesbackupstest-backup-container-422378187. {{(pid=101319) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 09:48:03.598567 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-15303d33-c7eb-4962-8e3b-6f1c44da1ece tempest-VolumesBackupsTest-2142009639 None] delete 8763861d-eff9-45d6-812c-fb65cb7ebea7 finished. {{(pid=101319) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:848}} Jul 03 09:48:03.635081 np0000004400 cinder-backup[101319]: DEBUG oslo_db.sqlalchemy.engines [None req-15303d33-c7eb-4962-8e3b-6f1c44da1ece tempest-VolumesBackupsTest-2142009639 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=101319) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 03 09:48:03.661094 np0000004400 cinder-backup[101319]: DEBUG cinder.quota [None req-15303d33-c7eb-4962-8e3b-6f1c44da1ece tempest-VolumesBackupsTest-2142009639 None] Created reservations ['169b8f03-e5d1-4d05-b9d0-1676930b2fe3', '8cc208e1-9b8d-4e99-953b-a127230d704d'] {{(pid=101319) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 09:48:03.713645 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-2d74be38-53f4-4512-acc2-41535a13bff9 tempest-ProjectAdminTests39-820123544 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101319) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 09:48:03.713788 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-2d74be38-53f4-4512-acc2-41535a13bff9 tempest-ProjectAdminTests39-820123544 None] About to put_object {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 09:48:03.724000 np0000004400 cinder-backup[101319]: INFO cinder.backup.manager [None req-15303d33-c7eb-4962-8e3b-6f1c44da1ece tempest-VolumesBackupsTest-2142009639 None] Delete backup finished, backup 8763861d-eff9-45d6-812c-fb65cb7ebea7 deleted. Jul 03 09:48:03.888989 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-2d74be38-53f4-4512-acc2-41535a13bff9 tempest-ProjectAdminTests39-820123544 None] backup MD5 for volume_9699c5a1-ca0a-4162-91dc-8afd21ba1199/20260703094801/az_nova_backup_cc724ce5-d7d3-4792-9be0-9c59b7436ba7-00003: 25e317773f308e446cc84c503a6d1f85 {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 09:48:03.888989 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-2d74be38-53f4-4512-acc2-41535a13bff9 tempest-ProjectAdminTests39-820123544 None] Calling eventlet.sleep(0) {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 09:48:04.061987 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-2d74be38-53f4-4512-acc2-41535a13bff9 tempest-ProjectAdminTests39-820123544 None] Backing up chunk of data from volume. {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 09:48:04.306093 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-2d74be38-53f4-4512-acc2-41535a13bff9 tempest-ProjectAdminTests39-820123544 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101319) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 09:48:04.306619 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-2d74be38-53f4-4512-acc2-41535a13bff9 tempest-ProjectAdminTests39-820123544 None] About to put_object {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 09:48:04.418178 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-2d74be38-53f4-4512-acc2-41535a13bff9 tempest-ProjectAdminTests39-820123544 None] backup MD5 for volume_9699c5a1-ca0a-4162-91dc-8afd21ba1199/20260703094801/az_nova_backup_cc724ce5-d7d3-4792-9be0-9c59b7436ba7-00004: 25e317773f308e446cc84c503a6d1f85 {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 09:48:04.418366 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-2d74be38-53f4-4512-acc2-41535a13bff9 tempest-ProjectAdminTests39-820123544 None] Calling eventlet.sleep(0) {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 09:48:04.602045 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-2d74be38-53f4-4512-acc2-41535a13bff9 tempest-ProjectAdminTests39-820123544 None] Backing up chunk of data from volume. {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 09:48:04.642987 np0000004400 cinder-backup[101319]: INFO cinder.backup.manager [None req-1f912912-6a94-438f-bc11-5388a9d9b632 tempest-VolumesBackupsTest-2142009639 None] Delete backup started, backup: 86118233-3d57-47ad-8781-cab6c54e4d53. Jul 03 09:48:04.645902 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.drivers.swift [None req-1f912912-6a94-438f-bc11-5388a9d9b632 tempest-VolumesBackupsTest-2142009639 None] Using swift URL https://10.4.3.95:8080/v1/AUTH_59044e18a5b24b19a7b9b8a380f2e1a0 {{(pid=101319) initialize /opt/stack/cinder/cinder/backup/drivers/swift.py:300}} Jul 03 09:48:04.646295 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.drivers.swift [None req-1f912912-6a94-438f-bc11-5388a9d9b632 tempest-VolumesBackupsTest-2142009639 None] Connect to https://10.4.3.95:8080/v1/AUTH_ in "per_user" mode {{(pid=101319) initialize /opt/stack/cinder/cinder/backup/drivers/swift.py:301}} Jul 03 09:48:04.646476 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-1f912912-6a94-438f-bc11-5388a9d9b632 tempest-VolumesBackupsTest-2142009639 None] delete started, backup: 86118233-3d57-47ad-8781-cab6c54e4d53, container: tempest-volumesbackupstest-backup-container-106419071, prefix: volume_8a0b1cfb-8ea1-46a0-aac3-b254107b98ef/20260703094720/az_nova_backup_86118233-3d57-47ad-8781-cab6c54e4d53. {{(pid=101319) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:822}} Jul 03 09:48:04.698350 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-1f912912-6a94-438f-bc11-5388a9d9b632 tempest-VolumesBackupsTest-2142009639 None] generated object list: ['volume_8a0b1cfb-8ea1-46a0-aac3-b254107b98ef/20260703094720/az_nova_backup_86118233-3d57-47ad-8781-cab6c54e4d53-00001', 'volume_8a0b1cfb-8ea1-46a0-aac3-b254107b98ef/20260703094720/az_nova_backup_86118233-3d57-47ad-8781-cab6c54e4d53-00002', 'volume_8a0b1cfb-8ea1-46a0-aac3-b254107b98ef/20260703094720/az_nova_backup_86118233-3d57-47ad-8781-cab6c54e4d53-00003', 'volume_8a0b1cfb-8ea1-46a0-aac3-b254107b98ef/20260703094720/az_nova_backup_86118233-3d57-47ad-8781-cab6c54e4d53-00004', 'volume_8a0b1cfb-8ea1-46a0-aac3-b254107b98ef/20260703094720/az_nova_backup_86118233-3d57-47ad-8781-cab6c54e4d53-00005', 'volume_8a0b1cfb-8ea1-46a0-aac3-b254107b98ef/20260703094720/az_nova_backup_86118233-3d57-47ad-8781-cab6c54e4d53-00006', 'volume_8a0b1cfb-8ea1-46a0-aac3-b254107b98ef/20260703094720/az_nova_backup_86118233-3d57-47ad-8781-cab6c54e4d53-00007', 'volume_8a0b1cfb-8ea1-46a0-aac3-b254107b98ef/20260703094720/az_nova_backup_86118233-3d57-47ad-8781-cab6c54e4d53-00008', 'volume_8a0b1cfb-8ea1-46a0-aac3-b254107b98ef/20260703094720/az_nova_backup_86118233-3d57-47ad-8781-cab6c54e4d53-00009', 'volume_8a0b1cfb-8ea1-46a0-aac3-b254107b98ef/20260703094720/az_nova_backup_86118233-3d57-47ad-8781-cab6c54e4d53-00010', 'volume_8a0b1cfb-8ea1-46a0-aac3-b254107b98ef/20260703094720/az_nova_backup_86118233-3d57-47ad-8781-cab6c54e4d53-00011', 'volume_8a0b1cfb-8ea1-46a0-aac3-b254107b98ef/20260703094720/az_nova_backup_86118233-3d57-47ad-8781-cab6c54e4d53-00012', 'volume_8a0b1cfb-8ea1-46a0-aac3-b254107b98ef/20260703094720/az_nova_backup_86118233-3d57-47ad-8781-cab6c54e4d53-00013', 'volume_8a0b1cfb-8ea1-46a0-aac3-b254107b98ef/20260703094720/az_nova_backup_86118233-3d57-47ad-8781-cab6c54e4d53-00014', 'volume_8a0b1cfb-8ea1-46a0-aac3-b254107b98ef/20260703094720/az_nova_backup_86118233-3d57-47ad-8781-cab6c54e4d53-00015', 'volume_8a0b1cfb-8ea1-46a0-aac3-b254107b98ef/20260703094720/az_nova_backup_86118233-3d57-47ad-8781-cab6c54e4d53-00016', 'volume_8a0b1cfb-8ea1-46a0-aac3-b254107b98ef/20260703094720/az_nova_backup_86118233-3d57-47ad-8781-cab6c54e4d53-00017', 'volume_8a0b1cfb-8ea1-46a0-aac3-b254107b98ef/20260703094720/az_nova_backup_86118233-3d57-47ad-8781-cab6c54e4d53-00018', 'volume_8a0b1cfb-8ea1-46a0-aac3-b254107b98ef/20260703094720/az_nova_backup_86118233-3d57-47ad-8781-cab6c54e4d53-00019', 'volume_8a0b1cfb-8ea1-46a0-aac3-b254107b98ef/20260703094720/az_nova_backup_86118233-3d57-47ad-8781-cab6c54e4d53-00020', 'volume_8a0b1cfb-8ea1-46a0-aac3-b254107b98ef/20260703094720/az_nova_backup_86118233-3d57-47ad-8781-cab6c54e4d53-00021', 'volume_8a0b1cfb-8ea1-46a0-aac3-b254107b98ef/20260703094720/az_nova_backup_86118233-3d57-47ad-8781-cab6c54e4d53_metadata', 'volume_8a0b1cfb-8ea1-46a0-aac3-b254107b98ef/20260703094720/az_nova_backup_86118233-3d57-47ad-8781-cab6c54e4d53_sha256file']. {{(pid=101319) _generate_object_names /opt/stack/cinder/cinder/backup/chunkeddriver.py:260}} Jul 03 09:48:04.723264 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-1f912912-6a94-438f-bc11-5388a9d9b632 tempest-VolumesBackupsTest-2142009639 None] deleted object: volume_8a0b1cfb-8ea1-46a0-aac3-b254107b98ef/20260703094720/az_nova_backup_86118233-3d57-47ad-8781-cab6c54e4d53-00001 in container: tempest-volumesbackupstest-backup-container-106419071. {{(pid=101319) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 09:48:04.743359 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-1f912912-6a94-438f-bc11-5388a9d9b632 tempest-VolumesBackupsTest-2142009639 None] deleted object: volume_8a0b1cfb-8ea1-46a0-aac3-b254107b98ef/20260703094720/az_nova_backup_86118233-3d57-47ad-8781-cab6c54e4d53-00002 in container: tempest-volumesbackupstest-backup-container-106419071. {{(pid=101319) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 09:48:04.765254 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-1f912912-6a94-438f-bc11-5388a9d9b632 tempest-VolumesBackupsTest-2142009639 None] deleted object: volume_8a0b1cfb-8ea1-46a0-aac3-b254107b98ef/20260703094720/az_nova_backup_86118233-3d57-47ad-8781-cab6c54e4d53-00003 in container: tempest-volumesbackupstest-backup-container-106419071. {{(pid=101319) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 09:48:04.818812 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-1f912912-6a94-438f-bc11-5388a9d9b632 tempest-VolumesBackupsTest-2142009639 None] deleted object: volume_8a0b1cfb-8ea1-46a0-aac3-b254107b98ef/20260703094720/az_nova_backup_86118233-3d57-47ad-8781-cab6c54e4d53-00004 in container: tempest-volumesbackupstest-backup-container-106419071. {{(pid=101319) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 09:48:04.841664 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-2d74be38-53f4-4512-acc2-41535a13bff9 tempest-ProjectAdminTests39-820123544 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101319) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 09:48:04.841664 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-2d74be38-53f4-4512-acc2-41535a13bff9 tempest-ProjectAdminTests39-820123544 None] About to put_object {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 09:48:04.855796 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-1f912912-6a94-438f-bc11-5388a9d9b632 tempest-VolumesBackupsTest-2142009639 None] deleted object: volume_8a0b1cfb-8ea1-46a0-aac3-b254107b98ef/20260703094720/az_nova_backup_86118233-3d57-47ad-8781-cab6c54e4d53-00005 in container: tempest-volumesbackupstest-backup-container-106419071. {{(pid=101319) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 09:48:04.886148 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-1f912912-6a94-438f-bc11-5388a9d9b632 tempest-VolumesBackupsTest-2142009639 None] deleted object: volume_8a0b1cfb-8ea1-46a0-aac3-b254107b98ef/20260703094720/az_nova_backup_86118233-3d57-47ad-8781-cab6c54e4d53-00006 in container: tempest-volumesbackupstest-backup-container-106419071. {{(pid=101319) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 09:48:04.911216 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-1f912912-6a94-438f-bc11-5388a9d9b632 tempest-VolumesBackupsTest-2142009639 None] deleted object: volume_8a0b1cfb-8ea1-46a0-aac3-b254107b98ef/20260703094720/az_nova_backup_86118233-3d57-47ad-8781-cab6c54e4d53-00007 in container: tempest-volumesbackupstest-backup-container-106419071. {{(pid=101319) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 09:48:04.939363 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-1f912912-6a94-438f-bc11-5388a9d9b632 tempest-VolumesBackupsTest-2142009639 None] deleted object: volume_8a0b1cfb-8ea1-46a0-aac3-b254107b98ef/20260703094720/az_nova_backup_86118233-3d57-47ad-8781-cab6c54e4d53-00008 in container: tempest-volumesbackupstest-backup-container-106419071. {{(pid=101319) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 09:48:04.948933 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-2d74be38-53f4-4512-acc2-41535a13bff9 tempest-ProjectAdminTests39-820123544 None] backup MD5 for volume_9699c5a1-ca0a-4162-91dc-8afd21ba1199/20260703094801/az_nova_backup_cc724ce5-d7d3-4792-9be0-9c59b7436ba7-00005: 25e317773f308e446cc84c503a6d1f85 {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 09:48:04.949131 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-2d74be38-53f4-4512-acc2-41535a13bff9 tempest-ProjectAdminTests39-820123544 None] Calling eventlet.sleep(0) {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 09:48:04.976213 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-1f912912-6a94-438f-bc11-5388a9d9b632 tempest-VolumesBackupsTest-2142009639 None] deleted object: volume_8a0b1cfb-8ea1-46a0-aac3-b254107b98ef/20260703094720/az_nova_backup_86118233-3d57-47ad-8781-cab6c54e4d53-00009 in container: tempest-volumesbackupstest-backup-container-106419071. {{(pid=101319) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 09:48:04.984060 np0000004400 cinder-backup[101319]: DEBUG oslo_db.sqlalchemy.engines [None req-2d74be38-53f4-4512-acc2-41535a13bff9 tempest-ProjectAdminTests39-820123544 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=101319) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 03 09:48:04.999238 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-1f912912-6a94-438f-bc11-5388a9d9b632 tempest-VolumesBackupsTest-2142009639 None] deleted object: volume_8a0b1cfb-8ea1-46a0-aac3-b254107b98ef/20260703094720/az_nova_backup_86118233-3d57-47ad-8781-cab6c54e4d53-00010 in container: tempest-volumesbackupstest-backup-container-106419071. {{(pid=101319) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 09:48:05.019112 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-1f912912-6a94-438f-bc11-5388a9d9b632 tempest-VolumesBackupsTest-2142009639 None] deleted object: volume_8a0b1cfb-8ea1-46a0-aac3-b254107b98ef/20260703094720/az_nova_backup_86118233-3d57-47ad-8781-cab6c54e4d53-00011 in container: tempest-volumesbackupstest-backup-container-106419071. {{(pid=101319) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 09:48:05.038835 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-1f912912-6a94-438f-bc11-5388a9d9b632 tempest-VolumesBackupsTest-2142009639 None] deleted object: volume_8a0b1cfb-8ea1-46a0-aac3-b254107b98ef/20260703094720/az_nova_backup_86118233-3d57-47ad-8781-cab6c54e4d53-00012 in container: tempest-volumesbackupstest-backup-container-106419071. {{(pid=101319) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 09:48:05.061272 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-1f912912-6a94-438f-bc11-5388a9d9b632 tempest-VolumesBackupsTest-2142009639 None] deleted object: volume_8a0b1cfb-8ea1-46a0-aac3-b254107b98ef/20260703094720/az_nova_backup_86118233-3d57-47ad-8781-cab6c54e4d53-00013 in container: tempest-volumesbackupstest-backup-container-106419071. {{(pid=101319) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 09:48:05.087137 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-1f912912-6a94-438f-bc11-5388a9d9b632 tempest-VolumesBackupsTest-2142009639 None] deleted object: volume_8a0b1cfb-8ea1-46a0-aac3-b254107b98ef/20260703094720/az_nova_backup_86118233-3d57-47ad-8781-cab6c54e4d53-00014 in container: tempest-volumesbackupstest-backup-container-106419071. {{(pid=101319) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 09:48:05.113339 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-1f912912-6a94-438f-bc11-5388a9d9b632 tempest-VolumesBackupsTest-2142009639 None] deleted object: volume_8a0b1cfb-8ea1-46a0-aac3-b254107b98ef/20260703094720/az_nova_backup_86118233-3d57-47ad-8781-cab6c54e4d53-00015 in container: tempest-volumesbackupstest-backup-container-106419071. {{(pid=101319) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 09:48:05.140087 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-1f912912-6a94-438f-bc11-5388a9d9b632 tempest-VolumesBackupsTest-2142009639 None] deleted object: volume_8a0b1cfb-8ea1-46a0-aac3-b254107b98ef/20260703094720/az_nova_backup_86118233-3d57-47ad-8781-cab6c54e4d53-00016 in container: tempest-volumesbackupstest-backup-container-106419071. {{(pid=101319) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 09:48:05.159715 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-1f912912-6a94-438f-bc11-5388a9d9b632 tempest-VolumesBackupsTest-2142009639 None] deleted object: volume_8a0b1cfb-8ea1-46a0-aac3-b254107b98ef/20260703094720/az_nova_backup_86118233-3d57-47ad-8781-cab6c54e4d53-00017 in container: tempest-volumesbackupstest-backup-container-106419071. {{(pid=101319) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 09:48:05.180104 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-1f912912-6a94-438f-bc11-5388a9d9b632 tempest-VolumesBackupsTest-2142009639 None] deleted object: volume_8a0b1cfb-8ea1-46a0-aac3-b254107b98ef/20260703094720/az_nova_backup_86118233-3d57-47ad-8781-cab6c54e4d53-00018 in container: tempest-volumesbackupstest-backup-container-106419071. {{(pid=101319) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 09:48:05.182457 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-2d74be38-53f4-4512-acc2-41535a13bff9 tempest-ProjectAdminTests39-820123544 None] Backing up chunk of data from volume. {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 09:48:05.195786 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-1f912912-6a94-438f-bc11-5388a9d9b632 tempest-VolumesBackupsTest-2142009639 None] deleted object: volume_8a0b1cfb-8ea1-46a0-aac3-b254107b98ef/20260703094720/az_nova_backup_86118233-3d57-47ad-8781-cab6c54e4d53-00019 in container: tempest-volumesbackupstest-backup-container-106419071. {{(pid=101319) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 09:48:05.216759 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-1f912912-6a94-438f-bc11-5388a9d9b632 tempest-VolumesBackupsTest-2142009639 None] deleted object: volume_8a0b1cfb-8ea1-46a0-aac3-b254107b98ef/20260703094720/az_nova_backup_86118233-3d57-47ad-8781-cab6c54e4d53-00020 in container: tempest-volumesbackupstest-backup-container-106419071. {{(pid=101319) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 09:48:05.237512 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-1f912912-6a94-438f-bc11-5388a9d9b632 tempest-VolumesBackupsTest-2142009639 None] deleted object: volume_8a0b1cfb-8ea1-46a0-aac3-b254107b98ef/20260703094720/az_nova_backup_86118233-3d57-47ad-8781-cab6c54e4d53-00021 in container: tempest-volumesbackupstest-backup-container-106419071. {{(pid=101319) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 09:48:05.256011 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-1f912912-6a94-438f-bc11-5388a9d9b632 tempest-VolumesBackupsTest-2142009639 None] deleted object: volume_8a0b1cfb-8ea1-46a0-aac3-b254107b98ef/20260703094720/az_nova_backup_86118233-3d57-47ad-8781-cab6c54e4d53_metadata in container: tempest-volumesbackupstest-backup-container-106419071. {{(pid=101319) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 09:48:05.276981 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-1f912912-6a94-438f-bc11-5388a9d9b632 tempest-VolumesBackupsTest-2142009639 None] deleted object: volume_8a0b1cfb-8ea1-46a0-aac3-b254107b98ef/20260703094720/az_nova_backup_86118233-3d57-47ad-8781-cab6c54e4d53_sha256file in container: tempest-volumesbackupstest-backup-container-106419071. {{(pid=101319) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 09:48:05.277195 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-1f912912-6a94-438f-bc11-5388a9d9b632 tempest-VolumesBackupsTest-2142009639 None] delete 86118233-3d57-47ad-8781-cab6c54e4d53 finished. {{(pid=101319) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:848}} Jul 03 09:48:05.291056 np0000004400 cinder-backup[101319]: DEBUG cinder.quota [None req-1f912912-6a94-438f-bc11-5388a9d9b632 tempest-VolumesBackupsTest-2142009639 None] Created reservations ['4aafd64d-6eb2-4680-9f72-0c98542a83cc', 'dae2a6be-f9ce-4bc8-9f6b-035cb6c38a96'] {{(pid=101319) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 09:48:05.313183 np0000004400 cinder-backup[101319]: INFO cinder.backup.manager [None req-1f912912-6a94-438f-bc11-5388a9d9b632 tempest-VolumesBackupsTest-2142009639 None] Delete backup finished, backup 86118233-3d57-47ad-8781-cab6c54e4d53 deleted. Jul 03 09:48:05.421976 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-2d74be38-53f4-4512-acc2-41535a13bff9 tempest-ProjectAdminTests39-820123544 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101319) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 09:48:05.421976 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-2d74be38-53f4-4512-acc2-41535a13bff9 tempest-ProjectAdminTests39-820123544 None] About to put_object {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 09:48:05.524578 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-2d74be38-53f4-4512-acc2-41535a13bff9 tempest-ProjectAdminTests39-820123544 None] backup MD5 for volume_9699c5a1-ca0a-4162-91dc-8afd21ba1199/20260703094801/az_nova_backup_cc724ce5-d7d3-4792-9be0-9c59b7436ba7-00006: 25e317773f308e446cc84c503a6d1f85 {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 09:48:05.524770 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-2d74be38-53f4-4512-acc2-41535a13bff9 tempest-ProjectAdminTests39-820123544 None] Calling eventlet.sleep(0) {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 09:48:05.700688 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-2d74be38-53f4-4512-acc2-41535a13bff9 tempest-ProjectAdminTests39-820123544 None] Backing up chunk of data from volume. {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 09:48:05.948180 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-2d74be38-53f4-4512-acc2-41535a13bff9 tempest-ProjectAdminTests39-820123544 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101319) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 09:48:05.948350 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-2d74be38-53f4-4512-acc2-41535a13bff9 tempest-ProjectAdminTests39-820123544 None] About to put_object {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 09:48:06.046192 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-2d74be38-53f4-4512-acc2-41535a13bff9 tempest-ProjectAdminTests39-820123544 None] backup MD5 for volume_9699c5a1-ca0a-4162-91dc-8afd21ba1199/20260703094801/az_nova_backup_cc724ce5-d7d3-4792-9be0-9c59b7436ba7-00007: 25e317773f308e446cc84c503a6d1f85 {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 09:48:06.046192 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-2d74be38-53f4-4512-acc2-41535a13bff9 tempest-ProjectAdminTests39-820123544 None] Calling eventlet.sleep(0) {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 09:48:06.228164 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-2d74be38-53f4-4512-acc2-41535a13bff9 tempest-ProjectAdminTests39-820123544 None] Backing up chunk of data from volume. {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 09:48:06.470344 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-2d74be38-53f4-4512-acc2-41535a13bff9 tempest-ProjectAdminTests39-820123544 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101319) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 09:48:06.470667 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-2d74be38-53f4-4512-acc2-41535a13bff9 tempest-ProjectAdminTests39-820123544 None] About to put_object {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 09:48:06.566198 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-2d74be38-53f4-4512-acc2-41535a13bff9 tempest-ProjectAdminTests39-820123544 None] backup MD5 for volume_9699c5a1-ca0a-4162-91dc-8afd21ba1199/20260703094801/az_nova_backup_cc724ce5-d7d3-4792-9be0-9c59b7436ba7-00008: 25e317773f308e446cc84c503a6d1f85 {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 09:48:06.566198 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-2d74be38-53f4-4512-acc2-41535a13bff9 tempest-ProjectAdminTests39-820123544 None] Calling eventlet.sleep(0) {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 09:48:06.737840 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-2d74be38-53f4-4512-acc2-41535a13bff9 tempest-ProjectAdminTests39-820123544 None] Backing up chunk of data from volume. {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 09:48:06.983821 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-2d74be38-53f4-4512-acc2-41535a13bff9 tempest-ProjectAdminTests39-820123544 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101319) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 09:48:06.984032 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-2d74be38-53f4-4512-acc2-41535a13bff9 tempest-ProjectAdminTests39-820123544 None] About to put_object {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 09:48:07.083955 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-2d74be38-53f4-4512-acc2-41535a13bff9 tempest-ProjectAdminTests39-820123544 None] backup MD5 for volume_9699c5a1-ca0a-4162-91dc-8afd21ba1199/20260703094801/az_nova_backup_cc724ce5-d7d3-4792-9be0-9c59b7436ba7-00009: 25e317773f308e446cc84c503a6d1f85 {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 09:48:07.084213 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-2d74be38-53f4-4512-acc2-41535a13bff9 tempest-ProjectAdminTests39-820123544 None] Calling eventlet.sleep(0) {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 09:48:07.284317 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-2d74be38-53f4-4512-acc2-41535a13bff9 tempest-ProjectAdminTests39-820123544 None] Backing up chunk of data from volume. {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 09:48:07.534158 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-2d74be38-53f4-4512-acc2-41535a13bff9 tempest-ProjectAdminTests39-820123544 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101319) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 09:48:07.534572 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-2d74be38-53f4-4512-acc2-41535a13bff9 tempest-ProjectAdminTests39-820123544 None] About to put_object {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 09:48:07.634155 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-2d74be38-53f4-4512-acc2-41535a13bff9 tempest-ProjectAdminTests39-820123544 None] backup MD5 for volume_9699c5a1-ca0a-4162-91dc-8afd21ba1199/20260703094801/az_nova_backup_cc724ce5-d7d3-4792-9be0-9c59b7436ba7-00010: 25e317773f308e446cc84c503a6d1f85 {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 09:48:07.634279 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-2d74be38-53f4-4512-acc2-41535a13bff9 tempest-ProjectAdminTests39-820123544 None] Calling eventlet.sleep(0) {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 09:48:07.806636 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-2d74be38-53f4-4512-acc2-41535a13bff9 tempest-ProjectAdminTests39-820123544 None] Backing up chunk of data from volume. {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 09:48:08.045394 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-2d74be38-53f4-4512-acc2-41535a13bff9 tempest-ProjectAdminTests39-820123544 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101319) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 09:48:08.045615 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-2d74be38-53f4-4512-acc2-41535a13bff9 tempest-ProjectAdminTests39-820123544 None] About to put_object {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 09:48:08.161016 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-2d74be38-53f4-4512-acc2-41535a13bff9 tempest-ProjectAdminTests39-820123544 None] backup MD5 for volume_9699c5a1-ca0a-4162-91dc-8afd21ba1199/20260703094801/az_nova_backup_cc724ce5-d7d3-4792-9be0-9c59b7436ba7-00011: 25e317773f308e446cc84c503a6d1f85 {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 09:48:08.161216 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-2d74be38-53f4-4512-acc2-41535a13bff9 tempest-ProjectAdminTests39-820123544 None] Calling eventlet.sleep(0) {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 09:48:08.347998 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-2d74be38-53f4-4512-acc2-41535a13bff9 tempest-ProjectAdminTests39-820123544 None] Backing up chunk of data from volume. {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 09:48:08.596858 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-2d74be38-53f4-4512-acc2-41535a13bff9 tempest-ProjectAdminTests39-820123544 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101319) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 09:48:08.597235 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-2d74be38-53f4-4512-acc2-41535a13bff9 tempest-ProjectAdminTests39-820123544 None] About to put_object {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 09:48:08.698557 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-2d74be38-53f4-4512-acc2-41535a13bff9 tempest-ProjectAdminTests39-820123544 None] backup MD5 for volume_9699c5a1-ca0a-4162-91dc-8afd21ba1199/20260703094801/az_nova_backup_cc724ce5-d7d3-4792-9be0-9c59b7436ba7-00012: 25e317773f308e446cc84c503a6d1f85 {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 09:48:08.698722 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-2d74be38-53f4-4512-acc2-41535a13bff9 tempest-ProjectAdminTests39-820123544 None] Calling eventlet.sleep(0) {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 09:48:08.877259 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-2d74be38-53f4-4512-acc2-41535a13bff9 tempest-ProjectAdminTests39-820123544 None] Backing up chunk of data from volume. {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 09:48:09.126023 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-2d74be38-53f4-4512-acc2-41535a13bff9 tempest-ProjectAdminTests39-820123544 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101319) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 09:48:09.126153 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-2d74be38-53f4-4512-acc2-41535a13bff9 tempest-ProjectAdminTests39-820123544 None] About to put_object {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 09:48:09.229565 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-2d74be38-53f4-4512-acc2-41535a13bff9 tempest-ProjectAdminTests39-820123544 None] backup MD5 for volume_9699c5a1-ca0a-4162-91dc-8afd21ba1199/20260703094801/az_nova_backup_cc724ce5-d7d3-4792-9be0-9c59b7436ba7-00013: 25e317773f308e446cc84c503a6d1f85 {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 09:48:09.229716 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-2d74be38-53f4-4512-acc2-41535a13bff9 tempest-ProjectAdminTests39-820123544 None] Calling eventlet.sleep(0) {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 09:48:09.407982 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-2d74be38-53f4-4512-acc2-41535a13bff9 tempest-ProjectAdminTests39-820123544 None] Backing up chunk of data from volume. {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 09:48:09.658803 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-2d74be38-53f4-4512-acc2-41535a13bff9 tempest-ProjectAdminTests39-820123544 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101319) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 09:48:09.659174 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-2d74be38-53f4-4512-acc2-41535a13bff9 tempest-ProjectAdminTests39-820123544 None] About to put_object {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 09:48:09.762631 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-2d74be38-53f4-4512-acc2-41535a13bff9 tempest-ProjectAdminTests39-820123544 None] backup MD5 for volume_9699c5a1-ca0a-4162-91dc-8afd21ba1199/20260703094801/az_nova_backup_cc724ce5-d7d3-4792-9be0-9c59b7436ba7-00014: 25e317773f308e446cc84c503a6d1f85 {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 09:48:09.762836 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-2d74be38-53f4-4512-acc2-41535a13bff9 tempest-ProjectAdminTests39-820123544 None] Calling eventlet.sleep(0) {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 09:48:09.964849 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-2d74be38-53f4-4512-acc2-41535a13bff9 tempest-ProjectAdminTests39-820123544 None] Backing up chunk of data from volume. {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 09:48:10.220904 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-2d74be38-53f4-4512-acc2-41535a13bff9 tempest-ProjectAdminTests39-820123544 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101319) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 09:48:10.221137 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-2d74be38-53f4-4512-acc2-41535a13bff9 tempest-ProjectAdminTests39-820123544 None] About to put_object {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 09:48:10.520504 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-2d74be38-53f4-4512-acc2-41535a13bff9 tempest-ProjectAdminTests39-820123544 None] backup MD5 for volume_9699c5a1-ca0a-4162-91dc-8afd21ba1199/20260703094801/az_nova_backup_cc724ce5-d7d3-4792-9be0-9c59b7436ba7-00015: 25e317773f308e446cc84c503a6d1f85 {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 09:48:10.520662 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-2d74be38-53f4-4512-acc2-41535a13bff9 tempest-ProjectAdminTests39-820123544 None] Calling eventlet.sleep(0) {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 09:48:10.855648 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-2d74be38-53f4-4512-acc2-41535a13bff9 tempest-ProjectAdminTests39-820123544 None] Backing up chunk of data from volume. {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 09:48:11.099030 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-2d74be38-53f4-4512-acc2-41535a13bff9 tempest-ProjectAdminTests39-820123544 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101319) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 09:48:11.099291 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-2d74be38-53f4-4512-acc2-41535a13bff9 tempest-ProjectAdminTests39-820123544 None] About to put_object {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 09:48:11.306561 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-2d74be38-53f4-4512-acc2-41535a13bff9 tempest-ProjectAdminTests39-820123544 None] backup MD5 for volume_9699c5a1-ca0a-4162-91dc-8afd21ba1199/20260703094801/az_nova_backup_cc724ce5-d7d3-4792-9be0-9c59b7436ba7-00016: 25e317773f308e446cc84c503a6d1f85 {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 09:48:11.306561 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-2d74be38-53f4-4512-acc2-41535a13bff9 tempest-ProjectAdminTests39-820123544 None] Calling eventlet.sleep(0) {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 09:48:11.663151 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-2d74be38-53f4-4512-acc2-41535a13bff9 tempest-ProjectAdminTests39-820123544 None] Backing up chunk of data from volume. {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 09:48:11.918265 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-2d74be38-53f4-4512-acc2-41535a13bff9 tempest-ProjectAdminTests39-820123544 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101319) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 09:48:11.918729 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-2d74be38-53f4-4512-acc2-41535a13bff9 tempest-ProjectAdminTests39-820123544 None] About to put_object {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 09:48:12.038681 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-2d74be38-53f4-4512-acc2-41535a13bff9 tempest-ProjectAdminTests39-820123544 None] backup MD5 for volume_9699c5a1-ca0a-4162-91dc-8afd21ba1199/20260703094801/az_nova_backup_cc724ce5-d7d3-4792-9be0-9c59b7436ba7-00017: 25e317773f308e446cc84c503a6d1f85 {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 09:48:12.038801 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-2d74be38-53f4-4512-acc2-41535a13bff9 tempest-ProjectAdminTests39-820123544 None] Calling eventlet.sleep(0) {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 09:48:12.388236 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-2d74be38-53f4-4512-acc2-41535a13bff9 tempest-ProjectAdminTests39-820123544 None] Backing up chunk of data from volume. {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 09:48:12.639173 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-2d74be38-53f4-4512-acc2-41535a13bff9 tempest-ProjectAdminTests39-820123544 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101319) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 09:48:12.639173 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-2d74be38-53f4-4512-acc2-41535a13bff9 tempest-ProjectAdminTests39-820123544 None] About to put_object {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 09:48:12.752161 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-2d74be38-53f4-4512-acc2-41535a13bff9 tempest-ProjectAdminTests39-820123544 None] backup MD5 for volume_9699c5a1-ca0a-4162-91dc-8afd21ba1199/20260703094801/az_nova_backup_cc724ce5-d7d3-4792-9be0-9c59b7436ba7-00018: 25e317773f308e446cc84c503a6d1f85 {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 09:48:12.752374 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-2d74be38-53f4-4512-acc2-41535a13bff9 tempest-ProjectAdminTests39-820123544 None] Calling eventlet.sleep(0) {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 09:48:13.135544 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-2d74be38-53f4-4512-acc2-41535a13bff9 tempest-ProjectAdminTests39-820123544 None] Backing up chunk of data from volume. {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 09:48:13.400597 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-2d74be38-53f4-4512-acc2-41535a13bff9 tempest-ProjectAdminTests39-820123544 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101319) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 09:48:13.400597 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-2d74be38-53f4-4512-acc2-41535a13bff9 tempest-ProjectAdminTests39-820123544 None] About to put_object {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 09:48:13.515633 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-2d74be38-53f4-4512-acc2-41535a13bff9 tempest-ProjectAdminTests39-820123544 None] backup MD5 for volume_9699c5a1-ca0a-4162-91dc-8afd21ba1199/20260703094801/az_nova_backup_cc724ce5-d7d3-4792-9be0-9c59b7436ba7-00019: 25e317773f308e446cc84c503a6d1f85 {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 09:48:13.515753 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-2d74be38-53f4-4512-acc2-41535a13bff9 tempest-ProjectAdminTests39-820123544 None] Calling eventlet.sleep(0) {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 09:48:13.725935 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-2d74be38-53f4-4512-acc2-41535a13bff9 tempest-ProjectAdminTests39-820123544 None] Backing up chunk of data from volume. {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 09:48:13.979550 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-2d74be38-53f4-4512-acc2-41535a13bff9 tempest-ProjectAdminTests39-820123544 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101319) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 09:48:13.979746 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-2d74be38-53f4-4512-acc2-41535a13bff9 tempest-ProjectAdminTests39-820123544 None] About to put_object {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 09:48:14.091373 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-2d74be38-53f4-4512-acc2-41535a13bff9 tempest-ProjectAdminTests39-820123544 None] backup MD5 for volume_9699c5a1-ca0a-4162-91dc-8afd21ba1199/20260703094801/az_nova_backup_cc724ce5-d7d3-4792-9be0-9c59b7436ba7-00020: 25e317773f308e446cc84c503a6d1f85 {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 09:48:14.091558 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-2d74be38-53f4-4512-acc2-41535a13bff9 tempest-ProjectAdminTests39-820123544 None] Calling eventlet.sleep(0) {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 09:48:14.206911 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-2d74be38-53f4-4512-acc2-41535a13bff9 tempest-ProjectAdminTests39-820123544 None] Backing up chunk of data from volume. {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 09:48:14.334000 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-2d74be38-53f4-4512-acc2-41535a13bff9 tempest-ProjectAdminTests39-820123544 None] Compressed 25165824 bytes of data to 24470 bytes using zlib. {{(pid=101319) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 09:48:14.334132 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-2d74be38-53f4-4512-acc2-41535a13bff9 tempest-ProjectAdminTests39-820123544 None] About to put_object {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 09:48:14.410154 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-2d74be38-53f4-4512-acc2-41535a13bff9 tempest-ProjectAdminTests39-820123544 None] backup MD5 for volume_9699c5a1-ca0a-4162-91dc-8afd21ba1199/20260703094801/az_nova_backup_cc724ce5-d7d3-4792-9be0-9c59b7436ba7-00021: 77377273b0a4b61febdbf7bbf52b9db9 {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 09:48:14.410387 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-2d74be38-53f4-4512-acc2-41535a13bff9 tempest-ProjectAdminTests39-820123544 None] Calling eventlet.sleep(0) {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 09:48:14.417978 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.driver [None req-2d74be38-53f4-4512-acc2-41535a13bff9 tempest-ProjectAdminTests39-820123544 None] Getting metadata type 'volume-base-metadata' {{(pid=101319) _save_vol_base_meta /opt/stack/cinder/cinder/backup/driver.py:79}} Jul 03 09:48:14.423300 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.driver [None req-2d74be38-53f4-4512-acc2-41535a13bff9 tempest-ProjectAdminTests39-820123544 None] Completed fetching metadata type 'volume-base-metadata' {{(pid=101319) _save_vol_base_meta /opt/stack/cinder/cinder/backup/driver.py:98}} Jul 03 09:48:14.423481 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.driver [None req-2d74be38-53f4-4512-acc2-41535a13bff9 tempest-ProjectAdminTests39-820123544 None] Getting metadata type 'volume-metadata' {{(pid=101319) _save_vol_meta /opt/stack/cinder/cinder/backup/driver.py:109}} Jul 03 09:48:14.427119 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.driver [None req-2d74be38-53f4-4512-acc2-41535a13bff9 tempest-ProjectAdminTests39-820123544 None] No metadata type 'volume-metadata' available {{(pid=101319) _save_vol_meta /opt/stack/cinder/cinder/backup/driver.py:123}} Jul 03 09:48:14.427259 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.driver [None req-2d74be38-53f4-4512-acc2-41535a13bff9 tempest-ProjectAdminTests39-820123544 None] Getting metadata type 'volume-glance-metadata' {{(pid=101319) _save_vol_glance_meta /opt/stack/cinder/cinder/backup/driver.py:132}} Jul 03 09:48:14.429822 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.driver [None req-2d74be38-53f4-4512-acc2-41535a13bff9 tempest-ProjectAdminTests39-820123544 None] No metadata type 'volume-glance-metadata' available {{(pid=101319) _save_vol_glance_meta /opt/stack/cinder/cinder/backup/driver.py:147}} Jul 03 09:48:14.430061 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-2d74be38-53f4-4512-acc2-41535a13bff9 tempest-ProjectAdminTests39-820123544 None] _write_sha256file started, container name: volumebackups, sha256file filename: volume_9699c5a1-ca0a-4162-91dc-8afd21ba1199/20260703094801/az_nova_backup_cc724ce5-d7d3-4792-9be0-9c59b7436ba7_sha256file. {{(pid=101319) _write_sha256file /opt/stack/cinder/cinder/backup/chunkeddriver.py:299}} Jul 03 09:48:14.495249 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-2d74be38-53f4-4512-acc2-41535a13bff9 tempest-ProjectAdminTests39-820123544 None] _write_sha256file finished. {{(pid=101319) _write_sha256file /opt/stack/cinder/cinder/backup/chunkeddriver.py:315}} Jul 03 09:48:14.495851 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-2d74be38-53f4-4512-acc2-41535a13bff9 tempest-ProjectAdminTests39-820123544 None] _write_metadata started, container name: volumebackups, metadata filename: volume_9699c5a1-ca0a-4162-91dc-8afd21ba1199/20260703094801/az_nova_backup_cc724ce5-d7d3-4792-9be0-9c59b7436ba7_metadata. {{(pid=101319) _write_metadata /opt/stack/cinder/cinder/backup/chunkeddriver.py:276}} Jul 03 09:48:14.526199 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-2d74be38-53f4-4512-acc2-41535a13bff9 tempest-ProjectAdminTests39-820123544 None] _write_metadata finished. Metadata: b'{\n "backup_description": null,\n "backup_id": "cc724ce5-d7d3-4792-9be0-9c59b7436ba7",\n "backup_name": "tempest-type-Backup-41157617",\n "created_at": "2026-07-03 09:47:58+00:00",\n "objects": [\n {\n "volume_9699c5a1-ca0a-4162-91dc-8afd21ba1199/20260703094801/az_nova_backup_cc724ce5-d7d3-4792-9be0-9c59b7436ba7-00001": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 0\n }\n },\n {\n "volume_9699c5a1-ca0a-4162-91dc-8afd21ba1199/20260703094801/az_nova_backup_cc724ce5-d7d3-4792-9be0-9c59b7436ba7-00002": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 52428800\n }\n },\n {\n "volume_9699c5a1-ca0a-4162-91dc-8afd21ba1199/20260703094801/az_nova_backup_cc724ce5-d7d3-4792-9be0-9c59b7436ba7-00003": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 104857600\n }\n },\n {\n "volume_9699c5a1-ca0a-4162-91dc-8afd21ba1199/20260703094801/az_nova_backup_cc724ce5-d7d3-4792-9be0-9c59b7436ba7-00004": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 157286400\n }\n },\n {\n "volume_9699c5a1-ca0a-4162-91dc-8afd21ba1199/20260703094801/az_nova_backup_cc724ce5-d7d3-4792-9be0-9c59b7436ba7-00005": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 209715200\n }\n },\n {\n "volume_9699c5a1-ca0a-4162-91dc-8afd21ba1199/20260703094801/az_nova_backup_cc724ce5-d7d3-4792-9be0-9c59b7436ba7-00006": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 262144000\n }\n },\n {\n "volume_9699c5a1-ca0a-4162-91dc-8afd21ba1199/20260703094801/az_nova_backup_cc724ce5-d7d3-4792-9be0-9c59b7436ba7-00007": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 314572800\n }\n },\n {\n "volume_9699c5a1-ca0a-4162-91dc-8afd21ba1199/20260703094801/az_nova_backup_cc724ce5-d7d3-4792-9be0-9c59b7436ba7-00008": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 367001600\n }\n },\n {\n "volume_9699c5a1-ca0a-4162-91dc-8afd21ba1199/20260703094801/az_nova_backup_cc724ce5-d7d3-4792-9be0-9c59b7436ba7-00009": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 419430400\n }\n },\n {\n "volume_9699c5a1-ca0a-4162-91dc-8afd21ba1199/20260703094801/az_nova_backup_cc724ce5-d7d3-4792-9be0-9c59b7436ba7-00010": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 471859200\n }\n },\n {\n "volume_9699c5a1-ca0a-4162-91dc-8afd21ba1199/20260703094801/az_nova_backup_cc724ce5-d7d3-4792-9be0-9c59b7436ba7-00011": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 524288000\n }\n },\n {\n "volume_9699c5a1-ca0a-4162-91dc-8afd21ba1199/20260703094801/az_nova_backup_cc724ce5-d7d3-4792-9be0-9c59b7436ba7-00012": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 576716800\n }\n },\n {\n "volume_9699c5a1-ca0a-4162-91dc-8afd21ba1199/20260703094801/az_nova_backup_cc724ce5-d7d3-4792-9be0-9c59b7436ba7-00013": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 629145600\n }\n },\n {\n "volume_9699c5a1-ca0a-4162-91dc-8afd21ba1199/20260703094801/az_nova_backup_cc724ce5-d7d3-4792-9be0-9c59b7436ba7-00014": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 681574400\n }\n },\n {\n "volume_9699c5a1-ca0a-4162-91dc-8afd21ba1199/20260703094801/az_nova_backup_cc724ce5-d7d3-4792-9be0-9c59b7436ba7-00015": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 734003200\n }\n },\n {\n "volume_9699c5a1-ca0a-4162-91dc-8afd21ba1199/20260703094801/az_nova_backup_cc724ce5-d7d3-4792-9be0-9c59b7436ba7-00016": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 786432000\n }\n },\n {\n "volume_9699c5a1-ca0a-4162-91dc-8afd21ba1199/20260703094801/az_nova_backup_cc724ce5-d7d3-4792-9be0-9c59b7436ba7-00017": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 838860800\n }\n },\n {\n "volume_9699c5a1-ca0a-4162-91dc-8afd21ba1199/20260703094801/az_nova_backup_cc724ce5-d7d3-4792-9be0-9c59b7436ba7-00018": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 891289600\n }\n },\n {\n "volume_9699c5a1-ca0a-4162-91dc-8afd21ba1199/20260703094801/az_nova_backup_cc724ce5-d7d3-4792-9be0-9c59b7436ba7-00019": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 943718400\n }\n },\n {\n "volume_9699c5a1-ca0a-4162-91dc-8afd21ba1199/20260703094801/az_nova_backup_cc724ce5-d7d3-4792-9be0-9c59b7436ba7-00020": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 996147200\n }\n },\n {\n "volume_9699c5a1-ca0a-4162-91dc-8afd21ba1199/20260703094801/az_nova_backup_cc724ce5-d7d3-4792-9be0-9c59b7436ba7-00021": {\n "compression": "zlib",\n "length": 25165824,\n "md5": "77377273b0a4b61febdbf7bbf52b9db9",\n "offset": 1048576000\n }\n }\n ],\n "parent_id": null,\n "version": "1.0.0",\n "volume_id": "9699c5a1-ca0a-4162-91dc-8afd21ba1199",\n "volume_meta": "{\\"version\\": 2, \\"volume-base-metadata\\": {\\"id\\": \\"9699c5a1-ca0a-4162-91dc-8afd21ba1199\\", \\"_name_id\\": null, \\"use_quota\\": true, \\"ec2_id\\": null, \\"user_id\\": \\"4e83159ea8d54d7a9c8de6d76997a7d2\\", \\"project_id\\": \\"0e4281ba5ea047598fa5801fdd6a9aa9\\", \\"snapshot_id\\": null, \\"cluster_name\\": null, \\"host\\": \\"np0000004400@storpool#default\\", \\"size\\": 1, \\"availability_zone\\": \\"nova\\", \\"status\\": \\"backing-up\\", \\"attach_status\\": \\"detached\\", \\"migration_status\\": null, \\"scheduled_at\\": \\"2026-07-03T09:47:57.000000\\", \\"launched_at\\": \\"2026-07-03T09:47:57.000000\\", \\"terminated_at\\": null, \\"display_name\\": \\"tempest-VolumeV3RbacBaseTests-Volume-303653784\\", \\"display_description\\": null, \\"provider_location\\": null, \\"provider_auth\\": null, \\"provider_geometry\\": null, \\"provider_id\\": null, \\"volume_type_id\\": \\"03e13fe6-0e30-4803-ace0-725d38e6dc24\\", \\"source_volid\\": null, \\"encryption_key_id\\": null, \\"consistencygroup_id\\": null, \\"group_id\\": null, \\"bootable\\": false, \\"multiattach\\": false, \\"replication_status\\": null, \\"replication_extended_status\\": null, \\"replication_driver_data\\": null, \\"previous_status\\": \\"available\\", \\"service_uuid\\": \\"6d4b0e79-fefe-4744-b25f-34be05095200\\", \\"shared_targets\\": true, \\"deleted_at\\": null, \\"deleted\\": false, \\"created_at\\": \\"2026-07-03T09:47:57.000000\\", \\"updated_at\\": \\"2026-07-03T09:47:58.000000\\"}}"\n}'. {{(pid=101319) _write_metadata /opt/stack/cinder/cinder/backup/chunkeddriver.py:295}} Jul 03 09:48:14.538095 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-2d74be38-53f4-4512-acc2-41535a13bff9 tempest-ProjectAdminTests39-820123544 None] backup cc724ce5-d7d3-4792-9be0-9c59b7436ba7 finished. {{(pid=101319) _finalize_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:462}} Jul 03 09:48:14.660169 np0000004400 cinder-backup[101319]: DEBUG oslo_concurrency.processutils [None req-2d74be38-53f4-4512-acc2-41535a13bff9 tempest-ProjectAdminTests39-820123544 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chown 0 /dev/sde {{(pid=101319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 09:48:14.683494 np0000004400 sudo[143000]: stack : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chown 0 /dev/sde Jul 03 09:48:14.684174 np0000004400 sudo[143000]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1002) Jul 03 09:48:14.973060 np0000004400 sudo[143000]: pam_unix(sudo:session): session closed for user root Jul 03 09:48:14.975128 np0000004400 cinder-backup[101319]: DEBUG oslo_concurrency.processutils [None req-2d74be38-53f4-4512-acc2-41535a13bff9 tempest-ProjectAdminTests39-820123544 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chown 0 /dev/sde" returned: 0 in 0.315s {{(pid=101319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 09:48:14.975877 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-2d74be38-53f4-4512-acc2-41535a13bff9 tempest-ProjectAdminTests39-820123544 None] ==> disconnect_volume: call "{'args': (, {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-9699c5a1-ca0a-4162-91dc-8afd21ba1199', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '9699c5a1-ca0a-4162-91dc-8afd21ba1199', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': False}, {'type': 'block', 'scsi_wwn': '330000000297c8939', 'path': '/dev/sde'}), 'kwargs': {'force': True, 'ignore_errors': True}}" {{(pid=101319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}} Jul 03 09:48:14.976079 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.base [None req-2d74be38-53f4-4512-acc2-41535a13bff9 tempest-ProjectAdminTests39-820123544 None] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=101319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jul 03 09:48:14.977622 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.base [None req-2d74be38-53f4-4512-acc2-41535a13bff9 tempest-ProjectAdminTests39-820123544 None] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=101319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jul 03 09:48:14.977622 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-2d74be38-53f4-4512-acc2-41535a13bff9 tempest-ProjectAdminTests39-820123544 None] _get_connection_devices called with parameters: connection_properties={'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-9699c5a1-ca0a-4162-91dc-8afd21ba1199', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '9699c5a1-ca0a-4162-91dc-8afd21ba1199', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': False}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=101319) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:847}} Jul 03 09:48:14.987034 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-2d74be38-53f4-4512-acc2-41535a13bff9 tempest-ProjectAdminTests39-820123544 None] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS: Jul 03 09:48:14.987034 np0000004400 cinder-backup[101319]: No targets found. Jul 03 09:48:14.987034 np0000004400 cinder-backup[101319]: iSNS: Jul 03 09:48:14.987034 np0000004400 cinder-backup[101319]: No targets found. Jul 03 09:48:14.987034 np0000004400 cinder-backup[101319]: STATIC: Jul 03 09:48:14.987034 np0000004400 cinder-backup[101319]: Target: iqn.2023-03.storpool.com:os--volume-9699c5a1-ca0a-4162-91dc-8afd21ba1199 Jul 03 09:48:14.987034 np0000004400 cinder-backup[101319]: Portal: 192.168.40.100:3260,-1 Jul 03 09:48:14.987034 np0000004400 cinder-backup[101319]: Iface Name: default Jul 03 09:48:14.987034 np0000004400 cinder-backup[101319]: Target: iqn.2023-03.storpool.com:os--volume-5a7e8b1b-2c9f-4abc-adf4-93f8e3df7477 Jul 03 09:48:14.987034 np0000004400 cinder-backup[101319]: Portal: 192.168.50.100:3260,-1 Jul 03 09:48:14.987034 np0000004400 cinder-backup[101319]: Iface Name: default Jul 03 09:48:14.987034 np0000004400 cinder-backup[101319]: Portal: 192.168.40.100:3260,-1 Jul 03 09:48:14.987034 np0000004400 cinder-backup[101319]: Iface Name: default Jul 03 09:48:14.987034 np0000004400 cinder-backup[101319]: FIRMWARE: Jul 03 09:48:14.987034 np0000004400 cinder-backup[101319]: No targets found. Jul 03 09:48:14.987034 np0000004400 cinder-backup[101319]: stderr= {{(pid=101319) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jul 03 09:48:14.987560 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-2d74be38-53f4-4512-acc2-41535a13bff9 tempest-ProjectAdminTests39-820123544 None] Regex to get portals from discoverydb: ^SENDTARGETS: Jul 03 09:48:14.987560 np0000004400 cinder-backup[101319]: .*?^DiscoveryAddress: 192.168.40.100,3260.*? Jul 03 09:48:14.987560 np0000004400 cinder-backup[101319]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=101319) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:390}} Jul 03 09:48:14.987625 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-2d74be38-53f4-4512-acc2-41535a13bff9 tempest-ProjectAdminTests39-820123544 None] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-9699c5a1-ca0a-4162-91dc-8afd21ba1199', 0)] {{(pid=101319) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:858}} Jul 03 09:48:15.008935 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-2d74be38-53f4-4512-acc2-41535a13bff9 tempest-ProjectAdminTests39-820123544 None] iscsiadm ('-m', 'session'): stdout=tcp: [136] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9699c5a1-ca0a-4162-91dc-8afd21ba1199 (non-flash) Jul 03 09:48:15.008935 np0000004400 cinder-backup[101319]: tcp: [137] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5a7e8b1b-2c9f-4abc-adf4-93f8e3df7477 (non-flash) Jul 03 09:48:15.008935 np0000004400 cinder-backup[101319]: tcp: [138] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5a7e8b1b-2c9f-4abc-adf4-93f8e3df7477 (non-flash) Jul 03 09:48:15.008935 np0000004400 cinder-backup[101319]: stderr= {{(pid=101319) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jul 03 09:48:15.009125 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-2d74be38-53f4-4512-acc2-41535a13bff9 tempest-ProjectAdminTests39-820123544 None] iscsi session list stdout=tcp: [136] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9699c5a1-ca0a-4162-91dc-8afd21ba1199 (non-flash) Jul 03 09:48:15.009125 np0000004400 cinder-backup[101319]: tcp: [137] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5a7e8b1b-2c9f-4abc-adf4-93f8e3df7477 (non-flash) Jul 03 09:48:15.009125 np0000004400 cinder-backup[101319]: tcp: [138] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5a7e8b1b-2c9f-4abc-adf4-93f8e3df7477 (non-flash) Jul 03 09:48:15.009125 np0000004400 cinder-backup[101319]: stderr= {{(pid=101319) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jul 03 09:48:15.009355 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-2d74be38-53f4-4512-acc2-41535a13bff9 tempest-ProjectAdminTests39-820123544 None] Sessions list: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-9699c5a1-ca0a-4162-91dc-8afd21ba1199', '136'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-5a7e8b1b-2c9f-4abc-adf4-93f8e3df7477', '137'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-5a7e8b1b-2c9f-4abc-adf4-93f8e3df7477', '138')] {{(pid=101319) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:866}} Jul 03 09:48:15.009570 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-2d74be38-53f4-4512-acc2-41535a13bff9 tempest-ProjectAdminTests39-820123544 None] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-9699c5a1-ca0a-4162-91dc-8afd21ba1199, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-9699c5a1-ca0a-4162-91dc-8afd21ba1199', '136')] {{(pid=101319) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}} Jul 03 09:48:15.010393 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-2d74be38-53f4-4512-acc2-41535a13bff9 tempest-ProjectAdminTests39-820123544 None] Resulting device map defaultdict(. at 0x7e76e71931a0>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-9699c5a1-ca0a-4162-91dc-8afd21ba1199'): ({'sde'}, set())}) {{(pid=101319) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:912}} Jul 03 09:48:15.010658 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.linuxscsi [None req-2d74be38-53f4-4512-acc2-41535a13bff9 tempest-ProjectAdminTests39-820123544 None] Removing single pathed devices sde {{(pid=101319) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}} Jul 03 09:48:15.020260 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.linuxscsi [None req-2d74be38-53f4-4512-acc2-41535a13bff9 tempest-ProjectAdminTests39-820123544 None] Flushing IO for device /dev/sde {{(pid=101319) flush_device_io /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:461}} Jul 03 09:48:15.028972 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.linuxscsi [None req-2d74be38-53f4-4512-acc2-41535a13bff9 tempest-ProjectAdminTests39-820123544 None] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=101319) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}} Jul 03 09:48:15.089971 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.linuxscsi [None req-2d74be38-53f4-4512-acc2-41535a13bff9 tempest-ProjectAdminTests39-820123544 None] Checking to see if SCSI volumes sde have been removed. {{(pid=101319) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}} Jul 03 09:48:15.090037 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.linuxscsi [None req-2d74be38-53f4-4512-acc2-41535a13bff9 tempest-ProjectAdminTests39-820123544 None] SCSI volumes sde have been removed. {{(pid=101319) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}} Jul 03 09:48:15.090873 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.linuxscsi [None req-2d74be38-53f4-4512-acc2-41535a13bff9 tempest-ProjectAdminTests39-820123544 None] Checking to see if device paths {'sde'} are still under multipathd monitoring {{(pid=101319) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}} Jul 03 09:48:15.100494 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.linuxscsi [None req-2d74be38-53f4-4512-acc2-41535a13bff9 tempest-ProjectAdminTests39-820123544 None] Device paths {'sde'} have been removed from multipathd monitoring. {{(pid=101319) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}} Jul 03 09:48:15.100725 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-2d74be38-53f4-4512-acc2-41535a13bff9 tempest-ProjectAdminTests39-820123544 None] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-9699c5a1-ca0a-4162-91dc-8afd21ba1199')] {{(pid=101319) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1225}} Jul 03 09:48:15.111667 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-2d74be38-53f4-4512-acc2-41535a13bff9 tempest-ProjectAdminTests39-820123544 None] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=101319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 03 09:48:15.138532 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-2d74be38-53f4-4512-acc2-41535a13bff9 tempest-ProjectAdminTests39-820123544 None] iscsiadm ('--logout',): stdout=Logging out of session [sid: 136, target: iqn.2023-03.storpool.com:os--volume-9699c5a1-ca0a-4162-91dc-8afd21ba1199, portal: 192.168.40.100,3260] Jul 03 09:48:15.138532 np0000004400 cinder-backup[101319]: Logout of [sid: 136, target: iqn.2023-03.storpool.com:os--volume-9699c5a1-ca0a-4162-91dc-8afd21ba1199, portal: 192.168.40.100,3260] successful. Jul 03 09:48:15.138532 np0000004400 cinder-backup[101319]: stderr= {{(pid=101319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 03 09:48:15.150030 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-2d74be38-53f4-4512-acc2-41535a13bff9 tempest-ProjectAdminTests39-820123544 None] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=101319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 03 09:48:15.151653 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.base [None req-2d74be38-53f4-4512-acc2-41535a13bff9 tempest-ProjectAdminTests39-820123544 None] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.174s {{(pid=101319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jul 03 09:48:15.151653 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-2d74be38-53f4-4512-acc2-41535a13bff9 tempest-ProjectAdminTests39-820123544 None] <== disconnect_volume: return (174ms) None {{(pid=101319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}} Jul 03 09:48:16.168963 np0000004400 cinder-backup[101319]: INFO cinder.backup.manager [None req-2d74be38-53f4-4512-acc2-41535a13bff9 tempest-ProjectAdminTests39-820123544 None] Create backup finished. backup: cc724ce5-d7d3-4792-9be0-9c59b7436ba7. Jul 03 09:48:16.648974 np0000004400 cinder-backup[101319]: INFO cinder.backup.manager [None req-29595766-a3fa-415c-ab10-b7b8f5e931f8 tempest-ProjectAdminTests39-820123544 None] Delete backup started, backup: cc724ce5-d7d3-4792-9be0-9c59b7436ba7. Jul 03 09:48:16.654693 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.drivers.swift [None req-29595766-a3fa-415c-ab10-b7b8f5e931f8 tempest-ProjectAdminTests39-820123544 None] Using swift URL https://10.4.3.95:8080/v1/AUTH_0e4281ba5ea047598fa5801fdd6a9aa9 {{(pid=101319) initialize /opt/stack/cinder/cinder/backup/drivers/swift.py:300}} Jul 03 09:48:16.654833 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.drivers.swift [None req-29595766-a3fa-415c-ab10-b7b8f5e931f8 tempest-ProjectAdminTests39-820123544 None] Connect to https://10.4.3.95:8080/v1/AUTH_ in "per_user" mode {{(pid=101319) initialize /opt/stack/cinder/cinder/backup/drivers/swift.py:301}} Jul 03 09:48:16.655021 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-29595766-a3fa-415c-ab10-b7b8f5e931f8 tempest-ProjectAdminTests39-820123544 None] delete started, backup: cc724ce5-d7d3-4792-9be0-9c59b7436ba7, container: volumebackups, prefix: volume_9699c5a1-ca0a-4162-91dc-8afd21ba1199/20260703094801/az_nova_backup_cc724ce5-d7d3-4792-9be0-9c59b7436ba7. {{(pid=101319) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:822}} Jul 03 09:48:16.697588 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-29595766-a3fa-415c-ab10-b7b8f5e931f8 tempest-ProjectAdminTests39-820123544 None] generated object list: ['volume_9699c5a1-ca0a-4162-91dc-8afd21ba1199/20260703094801/az_nova_backup_cc724ce5-d7d3-4792-9be0-9c59b7436ba7-00001', 'volume_9699c5a1-ca0a-4162-91dc-8afd21ba1199/20260703094801/az_nova_backup_cc724ce5-d7d3-4792-9be0-9c59b7436ba7-00002', 'volume_9699c5a1-ca0a-4162-91dc-8afd21ba1199/20260703094801/az_nova_backup_cc724ce5-d7d3-4792-9be0-9c59b7436ba7-00003', 'volume_9699c5a1-ca0a-4162-91dc-8afd21ba1199/20260703094801/az_nova_backup_cc724ce5-d7d3-4792-9be0-9c59b7436ba7-00004', 'volume_9699c5a1-ca0a-4162-91dc-8afd21ba1199/20260703094801/az_nova_backup_cc724ce5-d7d3-4792-9be0-9c59b7436ba7-00005', 'volume_9699c5a1-ca0a-4162-91dc-8afd21ba1199/20260703094801/az_nova_backup_cc724ce5-d7d3-4792-9be0-9c59b7436ba7-00006', 'volume_9699c5a1-ca0a-4162-91dc-8afd21ba1199/20260703094801/az_nova_backup_cc724ce5-d7d3-4792-9be0-9c59b7436ba7-00007', 'volume_9699c5a1-ca0a-4162-91dc-8afd21ba1199/20260703094801/az_nova_backup_cc724ce5-d7d3-4792-9be0-9c59b7436ba7-00008', 'volume_9699c5a1-ca0a-4162-91dc-8afd21ba1199/20260703094801/az_nova_backup_cc724ce5-d7d3-4792-9be0-9c59b7436ba7-00009', 'volume_9699c5a1-ca0a-4162-91dc-8afd21ba1199/20260703094801/az_nova_backup_cc724ce5-d7d3-4792-9be0-9c59b7436ba7-00010', 'volume_9699c5a1-ca0a-4162-91dc-8afd21ba1199/20260703094801/az_nova_backup_cc724ce5-d7d3-4792-9be0-9c59b7436ba7-00011', 'volume_9699c5a1-ca0a-4162-91dc-8afd21ba1199/20260703094801/az_nova_backup_cc724ce5-d7d3-4792-9be0-9c59b7436ba7-00012', 'volume_9699c5a1-ca0a-4162-91dc-8afd21ba1199/20260703094801/az_nova_backup_cc724ce5-d7d3-4792-9be0-9c59b7436ba7-00013', 'volume_9699c5a1-ca0a-4162-91dc-8afd21ba1199/20260703094801/az_nova_backup_cc724ce5-d7d3-4792-9be0-9c59b7436ba7-00014', 'volume_9699c5a1-ca0a-4162-91dc-8afd21ba1199/20260703094801/az_nova_backup_cc724ce5-d7d3-4792-9be0-9c59b7436ba7-00015', 'volume_9699c5a1-ca0a-4162-91dc-8afd21ba1199/20260703094801/az_nova_backup_cc724ce5-d7d3-4792-9be0-9c59b7436ba7-00016', 'volume_9699c5a1-ca0a-4162-91dc-8afd21ba1199/20260703094801/az_nova_backup_cc724ce5-d7d3-4792-9be0-9c59b7436ba7-00017', 'volume_9699c5a1-ca0a-4162-91dc-8afd21ba1199/20260703094801/az_nova_backup_cc724ce5-d7d3-4792-9be0-9c59b7436ba7-00018', 'volume_9699c5a1-ca0a-4162-91dc-8afd21ba1199/20260703094801/az_nova_backup_cc724ce5-d7d3-4792-9be0-9c59b7436ba7-00019', 'volume_9699c5a1-ca0a-4162-91dc-8afd21ba1199/20260703094801/az_nova_backup_cc724ce5-d7d3-4792-9be0-9c59b7436ba7-00020', 'volume_9699c5a1-ca0a-4162-91dc-8afd21ba1199/20260703094801/az_nova_backup_cc724ce5-d7d3-4792-9be0-9c59b7436ba7-00021', 'volume_9699c5a1-ca0a-4162-91dc-8afd21ba1199/20260703094801/az_nova_backup_cc724ce5-d7d3-4792-9be0-9c59b7436ba7_metadata', 'volume_9699c5a1-ca0a-4162-91dc-8afd21ba1199/20260703094801/az_nova_backup_cc724ce5-d7d3-4792-9be0-9c59b7436ba7_sha256file']. {{(pid=101319) _generate_object_names /opt/stack/cinder/cinder/backup/chunkeddriver.py:260}} Jul 03 09:48:16.715881 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-29595766-a3fa-415c-ab10-b7b8f5e931f8 tempest-ProjectAdminTests39-820123544 None] deleted object: volume_9699c5a1-ca0a-4162-91dc-8afd21ba1199/20260703094801/az_nova_backup_cc724ce5-d7d3-4792-9be0-9c59b7436ba7-00001 in container: volumebackups. {{(pid=101319) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 09:48:16.734519 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-29595766-a3fa-415c-ab10-b7b8f5e931f8 tempest-ProjectAdminTests39-820123544 None] deleted object: volume_9699c5a1-ca0a-4162-91dc-8afd21ba1199/20260703094801/az_nova_backup_cc724ce5-d7d3-4792-9be0-9c59b7436ba7-00002 in container: volumebackups. {{(pid=101319) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 09:48:16.752815 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-29595766-a3fa-415c-ab10-b7b8f5e931f8 tempest-ProjectAdminTests39-820123544 None] deleted object: volume_9699c5a1-ca0a-4162-91dc-8afd21ba1199/20260703094801/az_nova_backup_cc724ce5-d7d3-4792-9be0-9c59b7436ba7-00003 in container: volumebackups. {{(pid=101319) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 09:48:16.770518 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-29595766-a3fa-415c-ab10-b7b8f5e931f8 tempest-ProjectAdminTests39-820123544 None] deleted object: volume_9699c5a1-ca0a-4162-91dc-8afd21ba1199/20260703094801/az_nova_backup_cc724ce5-d7d3-4792-9be0-9c59b7436ba7-00004 in container: volumebackups. {{(pid=101319) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 09:48:16.788941 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-29595766-a3fa-415c-ab10-b7b8f5e931f8 tempest-ProjectAdminTests39-820123544 None] deleted object: volume_9699c5a1-ca0a-4162-91dc-8afd21ba1199/20260703094801/az_nova_backup_cc724ce5-d7d3-4792-9be0-9c59b7436ba7-00005 in container: volumebackups. {{(pid=101319) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 09:48:16.807763 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-29595766-a3fa-415c-ab10-b7b8f5e931f8 tempest-ProjectAdminTests39-820123544 None] deleted object: volume_9699c5a1-ca0a-4162-91dc-8afd21ba1199/20260703094801/az_nova_backup_cc724ce5-d7d3-4792-9be0-9c59b7436ba7-00006 in container: volumebackups. {{(pid=101319) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 09:48:16.826704 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-29595766-a3fa-415c-ab10-b7b8f5e931f8 tempest-ProjectAdminTests39-820123544 None] deleted object: volume_9699c5a1-ca0a-4162-91dc-8afd21ba1199/20260703094801/az_nova_backup_cc724ce5-d7d3-4792-9be0-9c59b7436ba7-00007 in container: volumebackups. {{(pid=101319) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 09:48:16.844055 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-29595766-a3fa-415c-ab10-b7b8f5e931f8 tempest-ProjectAdminTests39-820123544 None] deleted object: volume_9699c5a1-ca0a-4162-91dc-8afd21ba1199/20260703094801/az_nova_backup_cc724ce5-d7d3-4792-9be0-9c59b7436ba7-00008 in container: volumebackups. {{(pid=101319) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 09:48:16.859954 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-29595766-a3fa-415c-ab10-b7b8f5e931f8 tempest-ProjectAdminTests39-820123544 None] deleted object: volume_9699c5a1-ca0a-4162-91dc-8afd21ba1199/20260703094801/az_nova_backup_cc724ce5-d7d3-4792-9be0-9c59b7436ba7-00009 in container: volumebackups. {{(pid=101319) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 09:48:16.877958 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-29595766-a3fa-415c-ab10-b7b8f5e931f8 tempest-ProjectAdminTests39-820123544 None] deleted object: volume_9699c5a1-ca0a-4162-91dc-8afd21ba1199/20260703094801/az_nova_backup_cc724ce5-d7d3-4792-9be0-9c59b7436ba7-00010 in container: volumebackups. {{(pid=101319) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 09:48:16.893547 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-29595766-a3fa-415c-ab10-b7b8f5e931f8 tempest-ProjectAdminTests39-820123544 None] deleted object: volume_9699c5a1-ca0a-4162-91dc-8afd21ba1199/20260703094801/az_nova_backup_cc724ce5-d7d3-4792-9be0-9c59b7436ba7-00011 in container: volumebackups. {{(pid=101319) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 09:48:16.911418 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-29595766-a3fa-415c-ab10-b7b8f5e931f8 tempest-ProjectAdminTests39-820123544 None] deleted object: volume_9699c5a1-ca0a-4162-91dc-8afd21ba1199/20260703094801/az_nova_backup_cc724ce5-d7d3-4792-9be0-9c59b7436ba7-00012 in container: volumebackups. {{(pid=101319) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 09:48:16.928663 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-29595766-a3fa-415c-ab10-b7b8f5e931f8 tempest-ProjectAdminTests39-820123544 None] deleted object: volume_9699c5a1-ca0a-4162-91dc-8afd21ba1199/20260703094801/az_nova_backup_cc724ce5-d7d3-4792-9be0-9c59b7436ba7-00013 in container: volumebackups. {{(pid=101319) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 09:48:16.946393 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-29595766-a3fa-415c-ab10-b7b8f5e931f8 tempest-ProjectAdminTests39-820123544 None] deleted object: volume_9699c5a1-ca0a-4162-91dc-8afd21ba1199/20260703094801/az_nova_backup_cc724ce5-d7d3-4792-9be0-9c59b7436ba7-00014 in container: volumebackups. {{(pid=101319) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 09:48:16.970041 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-29595766-a3fa-415c-ab10-b7b8f5e931f8 tempest-ProjectAdminTests39-820123544 None] deleted object: volume_9699c5a1-ca0a-4162-91dc-8afd21ba1199/20260703094801/az_nova_backup_cc724ce5-d7d3-4792-9be0-9c59b7436ba7-00015 in container: volumebackups. {{(pid=101319) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 09:48:16.987377 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-29595766-a3fa-415c-ab10-b7b8f5e931f8 tempest-ProjectAdminTests39-820123544 None] deleted object: volume_9699c5a1-ca0a-4162-91dc-8afd21ba1199/20260703094801/az_nova_backup_cc724ce5-d7d3-4792-9be0-9c59b7436ba7-00016 in container: volumebackups. {{(pid=101319) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 09:48:17.003606 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-29595766-a3fa-415c-ab10-b7b8f5e931f8 tempest-ProjectAdminTests39-820123544 None] deleted object: volume_9699c5a1-ca0a-4162-91dc-8afd21ba1199/20260703094801/az_nova_backup_cc724ce5-d7d3-4792-9be0-9c59b7436ba7-00017 in container: volumebackups. {{(pid=101319) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 09:48:17.020738 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-29595766-a3fa-415c-ab10-b7b8f5e931f8 tempest-ProjectAdminTests39-820123544 None] deleted object: volume_9699c5a1-ca0a-4162-91dc-8afd21ba1199/20260703094801/az_nova_backup_cc724ce5-d7d3-4792-9be0-9c59b7436ba7-00018 in container: volumebackups. {{(pid=101319) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 09:48:17.038352 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-29595766-a3fa-415c-ab10-b7b8f5e931f8 tempest-ProjectAdminTests39-820123544 None] deleted object: volume_9699c5a1-ca0a-4162-91dc-8afd21ba1199/20260703094801/az_nova_backup_cc724ce5-d7d3-4792-9be0-9c59b7436ba7-00019 in container: volumebackups. {{(pid=101319) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 09:48:17.057007 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-29595766-a3fa-415c-ab10-b7b8f5e931f8 tempest-ProjectAdminTests39-820123544 None] deleted object: volume_9699c5a1-ca0a-4162-91dc-8afd21ba1199/20260703094801/az_nova_backup_cc724ce5-d7d3-4792-9be0-9c59b7436ba7-00020 in container: volumebackups. {{(pid=101319) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 09:48:17.075813 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-29595766-a3fa-415c-ab10-b7b8f5e931f8 tempest-ProjectAdminTests39-820123544 None] deleted object: volume_9699c5a1-ca0a-4162-91dc-8afd21ba1199/20260703094801/az_nova_backup_cc724ce5-d7d3-4792-9be0-9c59b7436ba7-00021 in container: volumebackups. {{(pid=101319) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 09:48:17.093399 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-29595766-a3fa-415c-ab10-b7b8f5e931f8 tempest-ProjectAdminTests39-820123544 None] deleted object: volume_9699c5a1-ca0a-4162-91dc-8afd21ba1199/20260703094801/az_nova_backup_cc724ce5-d7d3-4792-9be0-9c59b7436ba7_metadata in container: volumebackups. {{(pid=101319) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 09:48:17.111073 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-29595766-a3fa-415c-ab10-b7b8f5e931f8 tempest-ProjectAdminTests39-820123544 None] deleted object: volume_9699c5a1-ca0a-4162-91dc-8afd21ba1199/20260703094801/az_nova_backup_cc724ce5-d7d3-4792-9be0-9c59b7436ba7_sha256file in container: volumebackups. {{(pid=101319) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 09:48:17.111283 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-29595766-a3fa-415c-ab10-b7b8f5e931f8 tempest-ProjectAdminTests39-820123544 None] delete cc724ce5-d7d3-4792-9be0-9c59b7436ba7 finished. {{(pid=101319) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:848}} Jul 03 09:48:17.145371 np0000004400 cinder-backup[101319]: DEBUG oslo_db.sqlalchemy.engines [None req-29595766-a3fa-415c-ab10-b7b8f5e931f8 tempest-ProjectAdminTests39-820123544 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=101319) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 03 09:48:17.164326 np0000004400 cinder-backup[101319]: DEBUG cinder.quota [None req-29595766-a3fa-415c-ab10-b7b8f5e931f8 tempest-ProjectAdminTests39-820123544 None] Created reservations ['f4879fb0-787d-4c8f-b55d-2a3b959607e2', '6fefdd3d-1666-4e2f-95fa-e7d86f64f5b4'] {{(pid=101319) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 09:48:17.181117 np0000004400 cinder-backup[101319]: INFO cinder.backup.manager [None req-29595766-a3fa-415c-ab10-b7b8f5e931f8 tempest-ProjectAdminTests39-820123544 None] Delete backup finished, backup cc724ce5-d7d3-4792-9be0-9c59b7436ba7 deleted. Jul 03 09:48:21.541295 np0000004400 cinder-backup[101319]: INFO cinder.backup.manager [None req-16952a16-edcb-4adf-a3a4-d12a6dc72b77 tempest-VolumesBackupsV39Test-815084545 None] Create backup started, backup: c9ad8b37-057e-4c52-a459-b8dbd5e67dfe volume: 0600698e-1197-4d21-aefe-cadad145a000. Jul 03 09:48:21.548219 np0000004400 cinder-backup[101319]: INFO cinder.backup.manager [None req-16952a16-edcb-4adf-a3a4-d12a6dc72b77 tempest-VolumesBackupsV39Test-815084545 None] Call Volume Manager to get_backup_device for Backup(availability_zone='nova',container='tempest-volumesbackupsv39test-backup-container-1091695867',created_at=2026-07-03T09:48:21Z,data_timestamp=2026-07-03T09:48:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesBackupsV39Test-Backup-359999758',encryption_key_id=None,fail_reason=None,host='np0000004400',id=c9ad8b37-057e-4c52-a459-b8dbd5e67dfe,metadata={},num_dependent_backups=0,object_count=0,parent=None,parent_id=None,project_id='a163ee758b634041aa04043788fd0787',restore_volume_id=None,service='cinder.backup.drivers.swift.SwiftBackupDriver',service_metadata=None,size=1,snapshot_id=None,status='creating',temp_snapshot_id=None,temp_volume_id=None,updated_at=None,user_id='397ed9eb6ae84765a81b8b15ec1b9fb6',volume_id=0600698e-1197-4d21-aefe-cadad145a000) Jul 03 09:48:21.572801 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.drivers.swift [None req-16952a16-edcb-4adf-a3a4-d12a6dc72b77 tempest-VolumesBackupsV39Test-815084545 None] Using swift URL https://10.4.3.95:8080/v1/AUTH_a163ee758b634041aa04043788fd0787 {{(pid=101319) initialize /opt/stack/cinder/cinder/backup/drivers/swift.py:300}} Jul 03 09:48:21.573229 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.drivers.swift [None req-16952a16-edcb-4adf-a3a4-d12a6dc72b77 tempest-VolumesBackupsV39Test-815084545 None] Connect to https://10.4.3.95:8080/v1/AUTH_ in "per_user" mode {{(pid=101319) initialize /opt/stack/cinder/cinder/backup/drivers/swift.py:301}} Jul 03 09:48:21.573344 np0000004400 cinder-backup[101319]: DEBUG os_brick.utils [None req-16952a16-edcb-4adf-a3a4-d12a6dc72b77 tempest-VolumesBackupsV39Test-815084545 None] ==> get_connector_properties: call "{'root_helper': 'sudo cinder-rootwrap /etc/cinder/rootwrap.conf', 'my_ip': '10.4.3.95', 'multipath': False, 'enforce_multipath': False, 'host': None, 'execute': None}" {{(pid=101319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}} Jul 03 09:48:21.582997 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.scaleio [None req-16952a16-edcb-4adf-a3a4-d12a6dc72b77 tempest-VolumesBackupsV39Test-815084545 None] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=101319) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}} Jul 03 09:48:21.601963 np0000004400 cinder-backup[101319]: DEBUG oslo_concurrency.processutils [None req-16952a16-edcb-4adf-a3a4-d12a6dc72b77 tempest-VolumesBackupsV39Test-815084545 None] Running cmd (subprocess): nvme version {{(pid=101319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 09:48:21.618264 np0000004400 cinder-backup[101319]: DEBUG oslo_concurrency.processutils [None req-16952a16-edcb-4adf-a3a4-d12a6dc72b77 tempest-VolumesBackupsV39Test-815084545 None] 'nvme version' failed. Not Retrying. {{(pid=101319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 03 09:48:21.618552 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.nvmeof [None req-16952a16-edcb-4adf-a3a4-d12a6dc72b77 tempest-VolumesBackupsV39Test-815084545 None] nvme not present on system {{(pid=101319) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}} Jul 03 09:48:21.627221 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.lightos [None req-16952a16-edcb-4adf-a3a4-d12a6dc72b77 tempest-VolumesBackupsV39Test-815084545 None] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=101319) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}} Jul 03 09:48:21.628193 np0000004400 cinder-backup[101319]: INFO os_brick.initiator.connectors.lightos [None req-16952a16-edcb-4adf-a3a4-d12a6dc72b77 tempest-VolumesBackupsV39Test-815084545 None] Current host hostNQN and IP(s) are ['10.4.3.95', 'fe80::f816:3eff:fe47:268c', '192.168.40.6', 'fe80::f816:3eff:febf:7be2', '192.168.50.6', 'fe80::f816:3eff:fe99:8914', '192.168.10.6', 'fe80::f816:3eff:fe2f:e696', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::bc9d:84ff:fec2:6b49', 'fe80::fc16:3eff:fe61:2930', 'fe80::fcb0:4aff:fe6d:1fcf'] Jul 03 09:48:21.628296 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.lightos [None req-16952a16-edcb-4adf-a3a4-d12a6dc72b77 tempest-VolumesBackupsV39Test-815084545 None] LIGHTOS: did not find dsc, continuing anyway. {{(pid=101319) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}} Jul 03 09:48:21.628472 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.lightos [None req-16952a16-edcb-4adf-a3a4-d12a6dc72b77 tempest-VolumesBackupsV39Test-815084545 None] LIGHTOS: no hostnqn found. {{(pid=101319) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}} Jul 03 09:48:21.628700 np0000004400 cinder-backup[101319]: DEBUG os_brick.utils [None req-16952a16-edcb-4adf-a3a4-d12a6dc72b77 tempest-VolumesBackupsV39Test-815084545 None] <== get_connector_properties: return (54ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.95', 'host': 'np0000004400', 'multipath': False, 'enforce_multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:ae7e5bb0ebe6', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': '6b284368-d0ba-4d18-af6f-4998d3955c52', 'nvme_native_multipath': False} {{(pid=101319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}} Jul 03 09:48:21.794531 np0000004400 cinder-backup[101319]: DEBUG oslo_db.sqlalchemy.engines [None req-6c55ca9c-9a26-443f-9295-6da378b448f0 tempest-ProjectReaderTests39-1540523434 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=101319) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 03 09:48:21.801371 np0000004400 cinder-backup[101319]: INFO cinder.backup.manager [None req-6c55ca9c-9a26-443f-9295-6da378b448f0 tempest-ProjectReaderTests39-1540523434 None] Create backup started, backup: 1704ffd8-504c-4b12-adcf-b7f1a0cead28 volume: 45625dd9-520e-4033-b160-f3175cfdc32a. Jul 03 09:48:21.805160 np0000004400 cinder-backup[101319]: INFO cinder.backup.manager [None req-6c55ca9c-9a26-443f-9295-6da378b448f0 tempest-ProjectReaderTests39-1540523434 None] Call Volume Manager to get_backup_device for Backup(availability_zone='nova',container=None,created_at=2026-07-03T09:48:21Z,data_timestamp=2026-07-03T09:48:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-type-Backup-1224812444',encryption_key_id=None,fail_reason=None,host='np0000004400',id=1704ffd8-504c-4b12-adcf-b7f1a0cead28,metadata={},num_dependent_backups=0,object_count=0,parent=None,parent_id=None,project_id='ff0cd0be3a0a4eb083a7aed4c49f30ea',restore_volume_id=None,service='cinder.backup.drivers.swift.SwiftBackupDriver',service_metadata=None,size=1,snapshot_id=None,status='creating',temp_snapshot_id=None,temp_volume_id=None,updated_at=None,user_id='b6d990452d324a66a307cc4e39b454d4',volume_id=45625dd9-520e-4033-b160-f3175cfdc32a) Jul 03 09:48:21.826332 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.drivers.swift [None req-6c55ca9c-9a26-443f-9295-6da378b448f0 tempest-ProjectReaderTests39-1540523434 None] Using swift URL https://10.4.3.95:8080/v1/AUTH_ff0cd0be3a0a4eb083a7aed4c49f30ea {{(pid=101319) initialize /opt/stack/cinder/cinder/backup/drivers/swift.py:300}} Jul 03 09:48:21.826543 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.drivers.swift [None req-6c55ca9c-9a26-443f-9295-6da378b448f0 tempest-ProjectReaderTests39-1540523434 None] Connect to https://10.4.3.95:8080/v1/AUTH_ in "per_user" mode {{(pid=101319) initialize /opt/stack/cinder/cinder/backup/drivers/swift.py:301}} Jul 03 09:48:21.826941 np0000004400 cinder-backup[101319]: DEBUG os_brick.utils [None req-6c55ca9c-9a26-443f-9295-6da378b448f0 tempest-ProjectReaderTests39-1540523434 None] ==> get_connector_properties: call "{'root_helper': 'sudo cinder-rootwrap /etc/cinder/rootwrap.conf', 'my_ip': '10.4.3.95', 'multipath': False, 'enforce_multipath': False, 'host': None, 'execute': None}" {{(pid=101319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}} Jul 03 09:48:21.837999 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.scaleio [None req-6c55ca9c-9a26-443f-9295-6da378b448f0 tempest-ProjectReaderTests39-1540523434 None] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=101319) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}} Jul 03 09:48:21.854305 np0000004400 cinder-backup[101319]: DEBUG oslo_concurrency.processutils [None req-6c55ca9c-9a26-443f-9295-6da378b448f0 tempest-ProjectReaderTests39-1540523434 None] Running cmd (subprocess): nvme version {{(pid=101319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 09:48:21.869139 np0000004400 cinder-backup[101319]: DEBUG oslo_concurrency.processutils [None req-6c55ca9c-9a26-443f-9295-6da378b448f0 tempest-ProjectReaderTests39-1540523434 None] 'nvme version' failed. Not Retrying. {{(pid=101319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 03 09:48:21.869499 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.nvmeof [None req-6c55ca9c-9a26-443f-9295-6da378b448f0 tempest-ProjectReaderTests39-1540523434 None] nvme not present on system {{(pid=101319) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}} Jul 03 09:48:21.877196 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.lightos [None req-6c55ca9c-9a26-443f-9295-6da378b448f0 tempest-ProjectReaderTests39-1540523434 None] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=101319) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}} Jul 03 09:48:21.878123 np0000004400 cinder-backup[101319]: INFO os_brick.initiator.connectors.lightos [None req-6c55ca9c-9a26-443f-9295-6da378b448f0 tempest-ProjectReaderTests39-1540523434 None] Current host hostNQN and IP(s) are ['10.4.3.95', 'fe80::f816:3eff:fe47:268c', '192.168.40.6', 'fe80::f816:3eff:febf:7be2', '192.168.50.6', 'fe80::f816:3eff:fe99:8914', '192.168.10.6', 'fe80::f816:3eff:fe2f:e696', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::bc9d:84ff:fec2:6b49', 'fe80::fc16:3eff:fe61:2930', 'fe80::fcb0:4aff:fe6d:1fcf'] Jul 03 09:48:21.878267 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.lightos [None req-6c55ca9c-9a26-443f-9295-6da378b448f0 tempest-ProjectReaderTests39-1540523434 None] LIGHTOS: did not find dsc, continuing anyway. {{(pid=101319) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}} Jul 03 09:48:21.878337 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.lightos [None req-6c55ca9c-9a26-443f-9295-6da378b448f0 tempest-ProjectReaderTests39-1540523434 None] LIGHTOS: no hostnqn found. {{(pid=101319) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}} Jul 03 09:48:21.878604 np0000004400 cinder-backup[101319]: DEBUG os_brick.utils [None req-6c55ca9c-9a26-443f-9295-6da378b448f0 tempest-ProjectReaderTests39-1540523434 None] <== get_connector_properties: return (51ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.95', 'host': 'np0000004400', 'multipath': False, 'enforce_multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:ae7e5bb0ebe6', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': '6b284368-d0ba-4d18-af6f-4998d3955c52', 'nvme_native_multipath': False} {{(pid=101319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}} Jul 03 09:48:22.132581 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connector [None req-16952a16-edcb-4adf-a3a4-d12a6dc72b77 tempest-VolumesBackupsV39Test-815084545 None] Factory for iscsi on None {{(pid=101319) factory /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connector.py:243}} Jul 03 09:48:22.132961 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-16952a16-edcb-4adf-a3a4-d12a6dc72b77 tempest-VolumesBackupsV39Test-815084545 None] ==> connect_volume: call "{'self': , 'connection_properties': {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-0600698e-1197-4d21-aefe-cadad145a000', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '0600698e-1197-4d21-aefe-cadad145a000', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': False}}" {{(pid=101319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}} Jul 03 09:48:22.133161 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.base [None req-16952a16-edcb-4adf-a3a4-d12a6dc72b77 tempest-VolumesBackupsV39Test-815084545 None] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=101319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jul 03 09:48:22.133697 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.base [None req-16952a16-edcb-4adf-a3a4-d12a6dc72b77 tempest-VolumesBackupsV39Test-815084545 None] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=101319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jul 03 09:48:22.133946 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.base [None req-16952a16-edcb-4adf-a3a4-d12a6dc72b77 tempest-VolumesBackupsV39Test-815084545 None] Connection properties {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-0600698e-1197-4d21-aefe-cadad145a000', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '0600698e-1197-4d21-aefe-cadad145a000', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': False} {{(pid=101319) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}} Jul 03 09:48:22.145748 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.base [None req-16952a16-edcb-4adf-a3a4-d12a6dc72b77 tempest-VolumesBackupsV39Test-815084545 None] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-0600698e-1197-4d21-aefe-cadad145a000" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=101319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jul 03 09:48:22.146171 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.base [None req-16952a16-edcb-4adf-a3a4-d12a6dc72b77 tempest-VolumesBackupsV39Test-815084545 None] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-0600698e-1197-4d21-aefe-cadad145a000" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=101319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jul 03 09:48:22.146395 np0000004400 cinder-backup[101319]: INFO os_brick.initiator.connectors.iscsi [None req-16952a16-edcb-4adf-a3a4-d12a6dc72b77 tempest-VolumesBackupsV39Test-815084545 None] Trying to connect to iSCSI portal 192.168.40.100:3260 Jul 03 09:48:22.155889 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-16952a16-edcb-4adf-a3a4-d12a6dc72b77 tempest-VolumesBackupsV39Test-815084545 None] iscsiadm (): stdout= stderr=iscsiadm: No records found Jul 03 09:48:22.155889 np0000004400 cinder-backup[101319]: {{(pid=101319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 03 09:48:22.166716 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-16952a16-edcb-4adf-a3a4-d12a6dc72b77 tempest-VolumesBackupsV39Test-815084545 None] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-0600698e-1197-4d21-aefe-cadad145a000] added Jul 03 09:48:22.166716 np0000004400 cinder-backup[101319]: stderr=iscsiadm: Config file line 363 does not have value Jul 03 09:48:22.166716 np0000004400 cinder-backup[101319]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs' Jul 03 09:48:22.166716 np0000004400 cinder-backup[101319]: iscsiadm: Config file line 363 does not have value Jul 03 09:48:22.166716 np0000004400 cinder-backup[101319]: iscsiadm: Config file line 363 does not have value Jul 03 09:48:22.166716 np0000004400 cinder-backup[101319]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs' Jul 03 09:48:22.166716 np0000004400 cinder-backup[101319]: {{(pid=101319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 03 09:48:22.166920 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-16952a16-edcb-4adf-a3a4-d12a6dc72b77 tempest-VolumesBackupsV39Test-815084545 None] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=101319) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}} Jul 03 09:48:22.167277 np0000004400 cinder-backup[101319]: DEBUG os_brick.utils [None req-16952a16-edcb-4adf-a3a4-d12a6dc72b77 tempest-VolumesBackupsV39Test-815084545 None] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0208(s), this was the 1st time calling it. {{(pid=101319) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}} Jul 03 09:48:22.167509 np0000004400 cinder-backup[101319]: DEBUG os_brick.utils [None req-16952a16-edcb-4adf-a3a4-d12a6dc72b77 tempest-VolumesBackupsV39Test-815084545 None] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=101319) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}} Jul 03 09:48:22.383514 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connector [None req-6c55ca9c-9a26-443f-9295-6da378b448f0 tempest-ProjectReaderTests39-1540523434 None] Factory for iscsi on None {{(pid=101319) factory /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connector.py:243}} Jul 03 09:48:22.383514 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-6c55ca9c-9a26-443f-9295-6da378b448f0 tempest-ProjectReaderTests39-1540523434 None] ==> connect_volume: call "{'self': , 'connection_properties': {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-45625dd9-520e-4033-b160-f3175cfdc32a', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '45625dd9-520e-4033-b160-f3175cfdc32a', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': False}}" {{(pid=101319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}} Jul 03 09:48:22.383696 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.base [None req-6c55ca9c-9a26-443f-9295-6da378b448f0 tempest-ProjectReaderTests39-1540523434 None] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=101319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jul 03 09:48:23.168549 np0000004400 cinder-backup[101319]: INFO os_brick.initiator.connectors.iscsi [None req-16952a16-edcb-4adf-a3a4-d12a6dc72b77 tempest-VolumesBackupsV39Test-815084545 None] Trying to connect to iSCSI portal 192.168.40.100:3260 Jul 03 09:48:23.180338 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-16952a16-edcb-4adf-a3a4-d12a6dc72b77 tempest-VolumesBackupsV39Test-815084545 None] iscsiadm (): stdout=# BEGIN RECORD 2.1.9 Jul 03 09:48:23.180338 np0000004400 cinder-backup[101319]: node.name = iqn.2023-03.storpool.com:os--volume-0600698e-1197-4d21-aefe-cadad145a000 Jul 03 09:48:23.180338 np0000004400 cinder-backup[101319]: node.tpgt = -1 Jul 03 09:48:23.180338 np0000004400 cinder-backup[101319]: node.startup = manual Jul 03 09:48:23.180338 np0000004400 cinder-backup[101319]: node.leading_login = No Jul 03 09:48:23.180338 np0000004400 cinder-backup[101319]: iface.iscsi_ifacename = default Jul 03 09:48:23.180338 np0000004400 cinder-backup[101319]: iface.net_ifacename = Jul 03 09:48:23.180338 np0000004400 cinder-backup[101319]: iface.ipaddress = Jul 03 09:48:23.180338 np0000004400 cinder-backup[101319]: iface.prefix_len = 0 Jul 03 09:48:23.180338 np0000004400 cinder-backup[101319]: iface.hwaddress = Jul 03 09:48:23.180338 np0000004400 cinder-backup[101319]: iface.transport_name = tcp Jul 03 09:48:23.180338 np0000004400 cinder-backup[101319]: iface.initiatorname = Jul 03 09:48:23.180338 np0000004400 cinder-backup[101319]: iface.state = Jul 03 09:48:23.180338 np0000004400 cinder-backup[101319]: iface.vlan_id = 0 Jul 03 09:48:23.180338 np0000004400 cinder-backup[101319]: iface.vlan_priority = 0 Jul 03 09:48:23.180338 np0000004400 cinder-backup[101319]: iface.vlan_state = Jul 03 09:48:23.180338 np0000004400 cinder-backup[101319]: iface.iface_num = 0 Jul 03 09:48:23.180338 np0000004400 cinder-backup[101319]: iface.mtu = 0 Jul 03 09:48:23.180338 np0000004400 cinder-backup[101319]: iface.port = 0 Jul 03 09:48:23.180338 np0000004400 cinder-backup[101319]: iface.bootproto = Jul 03 09:48:23.180338 np0000004400 cinder-backup[101319]: iface.subnet_mask = Jul 03 09:48:23.180338 np0000004400 cinder-backup[101319]: iface.gateway = Jul 03 09:48:23.180338 np0000004400 cinder-backup[101319]: iface.dhcp_alt_client_id_state = Jul 03 09:48:23.180338 np0000004400 cinder-backup[101319]: iface.dhcp_alt_client_id = Jul 03 09:48:23.180338 np0000004400 cinder-backup[101319]: iface.dhcp_dns = Jul 03 09:48:23.180338 np0000004400 cinder-backup[101319]: iface.dhcp_learn_iqn = Jul 03 09:48:23.180338 np0000004400 cinder-backup[101319]: iface.dhcp_req_vendor_id_state = Jul 03 09:48:23.180338 np0000004400 cinder-backup[101319]: iface.dhcp_vendor_id_state = Jul 03 09:48:23.180338 np0000004400 cinder-backup[101319]: iface.dhcp_vendor_id = Jul 03 09:48:23.180338 np0000004400 cinder-backup[101319]: iface.dhcp_slp_da = Jul 03 09:48:23.180338 np0000004400 cinder-backup[101319]: iface.fragmentation = Jul 03 09:48:23.180338 np0000004400 cinder-backup[101319]: iface.gratuitous_arp = Jul 03 09:48:23.180338 np0000004400 cinder-backup[101319]: iface.incoming_forwarding = Jul 03 09:48:23.180338 np0000004400 cinder-backup[101319]: iface.tos_state = Jul 03 09:48:23.180338 np0000004400 cinder-backup[101319]: iface.tos = 0 Jul 03 09:48:23.180338 np0000004400 cinder-backup[101319]: iface.ttl = 0 Jul 03 09:48:23.180338 np0000004400 cinder-backup[101319]: iface.delayed_ack = Jul 03 09:48:23.180338 np0000004400 cinder-backup[101319]: iface.tcp_nagle = Jul 03 09:48:23.180338 np0000004400 cinder-backup[101319]: iface.tcp_wsf_state = Jul 03 09:48:23.180338 np0000004400 cinder-backup[101319]: iface.tcp_wsf = 0 Jul 03 09:48:23.180338 np0000004400 cinder-backup[101319]: iface.tcp_timer_scale = 0 Jul 03 09:48:23.180338 np0000004400 cinder-backup[101319]: iface.tcp_timestamp = Jul 03 09:48:23.180338 np0000004400 cinder-backup[101319]: iface.redirect = Jul 03 09:48:23.180338 np0000004400 cinder-backup[101319]: iface.def_task_mgmt_timeout = 0 Jul 03 09:48:23.180338 np0000004400 cinder-backup[101319]: iface.header_digest = Jul 03 09:48:23.180338 np0000004400 cinder-backup[101319]: iface.data_digest = Jul 03 09:48:23.180338 np0000004400 cinder-backup[101319]: iface.immediate_data = Jul 03 09:48:23.180338 np0000004400 cinder-backup[101319]: iface.initial_r2t = Jul 03 09:48:23.180338 np0000004400 cinder-backup[101319]: iface.data_seq_inorder = Jul 03 09:48:23.180338 np0000004400 cinder-backup[101319]: iface.data_pdu_inorder = Jul 03 09:48:23.180338 np0000004400 cinder-backup[101319]: iface.erl = 0 Jul 03 09:48:23.180338 np0000004400 cinder-backup[101319]: iface.max_receive_data_len = 0 Jul 03 09:48:23.180338 np0000004400 cinder-backup[101319]: iface.first_burst_len = 0 Jul 03 09:48:23.180338 np0000004400 cinder-backup[101319]: iface.max_outstanding_r2t = 0 Jul 03 09:48:23.180338 np0000004400 cinder-backup[101319]: iface.max_burst_len = 0 Jul 03 09:48:23.180338 np0000004400 cinder-backup[101319]: iface.chap_auth = Jul 03 09:48:23.180338 np0000004400 cinder-backup[101319]: iface.bidi_chap = Jul 03 09:48:23.180338 np0000004400 cinder-backup[101319]: iface.strict_login_compliance = Jul 03 09:48:23.180338 np0000004400 cinder-backup[101319]: iface.discovery_auth = Jul 03 09:48:23.180338 np0000004400 cinder-backup[101319]: iface.discovery_logout = Jul 03 09:48:23.180338 np0000004400 cinder-backup[101319]: node.discovery_address = Jul 03 09:48:23.180338 np0000004400 cinder-backup[101319]: node.discovery_port = 0 Jul 03 09:48:23.180338 np0000004400 cinder-backup[101319]: node.discovery_type = fw Jul 03 09:48:23.180338 np0000004400 cinder-backup[101319]: node.session.initial_cmdsn = 0 Jul 03 09:48:23.180338 np0000004400 cinder-backup[101319]: node.session.initial_login_retry_max = 8 Jul 03 09:48:23.180338 np0000004400 cinder-backup[101319]: node.session.xmit_thread_priority = 0 Jul 03 09:48:23.180338 np0000004400 cinder-backup[101319]: node.session.cmds_max = 128 Jul 03 09:48:23.180338 np0000004400 cinder-backup[101319]: node.session.queue_depth = 32 Jul 03 09:48:23.180338 np0000004400 cinder-backup[101319]: node.session.nr_sessions = 1 Jul 03 09:48:23.180338 np0000004400 cinder-backup[101319]: node.session.auth.authmethod = None Jul 03 09:48:23.180338 np0000004400 cinder-backup[101319]: node.session.auth.username = Jul 03 09:48:23.180338 np0000004400 cinder-backup[101319]: node.session.auth.password = *** Jul 03 09:48:23.180338 np0000004400 cinder-backup[101319]: node.session.auth.username_in = Jul 03 09:48:23.180338 np0000004400 cinder-backup[101319]: node.session.auth.password_in = Jul 03 09:48:23.180338 np0000004400 cinder-backup[101319]: node.session.auth.chap_algs = SHA256 Jul 03 09:48:23.180338 np0000004400 cinder-backup[101319]: node.session.timeo.replacement_timeout = 120 Jul 03 09:48:23.180338 np0000004400 cinder-backup[101319]: node.session.err_timeo.abort_timeout = 15 Jul 03 09:48:23.180338 np0000004400 cinder-backup[101319]: node.session.err_timeo.lu_reset_timeout = 30 Jul 03 09:48:23.180338 np0000004400 cinder-backup[101319]: node.session.err_timeo.tgt_reset_timeout = 30 Jul 03 09:48:23.180338 np0000004400 cinder-backup[101319]: node.session.err_timeo.host_reset_timeout = 60 Jul 03 09:48:23.180338 np0000004400 cinder-backup[101319]: node.session.iscsi.FastAbort = Yes Jul 03 09:48:23.180338 np0000004400 cinder-backup[101319]: node.session.iscsi.InitialR2T = No Jul 03 09:48:23.180338 np0000004400 cinder-backup[101319]: node.session.iscsi.ImmediateData = Yes Jul 03 09:48:23.180338 np0000004400 cinder-backup[101319]: node.session.iscsi.FirstBurstLength = 262144 Jul 03 09:48:23.180338 np0000004400 cinder-backup[101319]: node.session.iscsi.MaxBurstLength = 16776192 Jul 03 09:48:23.180338 np0000004400 cinder-backup[101319]: node.session.iscsi.DefaultTime2Retain = 0 Jul 03 09:48:23.180338 np0000004400 cinder-backup[101319]: node.session.iscsi.DefaultTime2Wait = 2 Jul 03 09:48:23.180338 np0000004400 cinder-backup[101319]: node.session.iscsi.MaxConnections = 1 Jul 03 09:48:23.180338 np0000004400 cinder-backup[101319]: node.session.iscsi.MaxOutstandingR2T = 1 Jul 03 09:48:23.180338 np0000004400 cinder-backup[101319]: node.session.iscsi.ERL = 0 Jul 03 09:48:23.180338 np0000004400 cinder-backup[101319]: node.session.scan = auto Jul 03 09:48:23.180338 np0000004400 cinder-backup[101319]: node.session.reopen_max = 0 Jul 03 09:48:23.180338 np0000004400 cinder-backup[101319]: node.conn[0].address = 192.168.40.100 Jul 03 09:48:23.180338 np0000004400 cinder-backup[101319]: node.conn[0].port = 3260 Jul 03 09:48:23.180338 np0000004400 cinder-backup[101319]: node.conn[0].startup = manual Jul 03 09:48:23.180338 np0000004400 cinder-backup[101319]: node.conn[0].tcp.window_size = 524288 Jul 03 09:48:23.180338 np0000004400 cinder-backup[101319]: node.conn[0].tcp.type_of_service = 0 Jul 03 09:48:23.180338 np0000004400 cinder-backup[101319]: node.conn[0].timeo.logout_timeout = 15 Jul 03 09:48:23.180338 np0000004400 cinder-backup[101319]: node.conn[0].timeo.login_timeout = 15 Jul 03 09:48:23.180338 np0000004400 cinder-backup[101319]: node.conn[0].timeo.auth_timeout = 45 Jul 03 09:48:23.180338 np0000004400 cinder-backup[101319]: node.conn[0].timeo.noop_out_interval = 5 Jul 03 09:48:23.180338 np0000004400 cinder-backup[101319]: node.conn[0].timeo.noop_out_timeout = 5 Jul 03 09:48:23.180338 np0000004400 cinder-backup[101319]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0 Jul 03 09:48:23.180338 np0000004400 cinder-backup[101319]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144 Jul 03 09:48:23.180338 np0000004400 cinder-backup[101319]: node.conn[0].iscsi.HeaderDigest = None Jul 03 09:48:23.180338 np0000004400 cinder-backup[101319]: node.conn[0].iscsi.DataDigest = None Jul 03 09:48:23.180338 np0000004400 cinder-backup[101319]: node.conn[0].iscsi.IFMarker = No Jul 03 09:48:23.180338 np0000004400 cinder-backup[101319]: node.conn[0].iscsi.OFMarker = No Jul 03 09:48:23.180338 np0000004400 cinder-backup[101319]: # END RECORD Jul 03 09:48:23.180338 np0000004400 cinder-backup[101319]: stderr= {{(pid=101319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 03 09:48:23.190927 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-16952a16-edcb-4adf-a3a4-d12a6dc72b77 tempest-VolumesBackupsV39Test-815084545 None] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=101319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 03 09:48:23.200124 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-16952a16-edcb-4adf-a3a4-d12a6dc72b77 tempest-VolumesBackupsV39Test-815084545 None] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions. Jul 03 09:48:23.200124 np0000004400 cinder-backup[101319]: {{(pid=101319) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jul 03 09:48:23.200271 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-16952a16-edcb-4adf-a3a4-d12a6dc72b77 tempest-VolumesBackupsV39Test-815084545 None] iscsi session list stdout= stderr=iscsiadm: No active sessions. Jul 03 09:48:23.200271 np0000004400 cinder-backup[101319]: {{(pid=101319) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jul 03 09:48:23.200423 np0000004400 cinder-backup[101319]: WARNING os_brick.initiator.connectors.iscsi [None req-16952a16-edcb-4adf-a3a4-d12a6dc72b77 tempest-VolumesBackupsV39Test-815084545 None] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions. Jul 03 09:48:23.200423 np0000004400 cinder-backup[101319]: Jul 03 09:48:23.224951 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-16952a16-edcb-4adf-a3a4-d12a6dc72b77 tempest-VolumesBackupsV39Test-815084545 None] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-0600698e-1197-4d21-aefe-cadad145a000, portal: 192.168.40.100,3260] Jul 03 09:48:23.224951 np0000004400 cinder-backup[101319]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-0600698e-1197-4d21-aefe-cadad145a000, portal: 192.168.40.100,3260] successful. Jul 03 09:48:23.224951 np0000004400 cinder-backup[101319]: stderr= {{(pid=101319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 03 09:48:23.236943 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-16952a16-edcb-4adf-a3a4-d12a6dc72b77 tempest-VolumesBackupsV39Test-815084545 None] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=101319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 03 09:48:23.248003 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-16952a16-edcb-4adf-a3a4-d12a6dc72b77 tempest-VolumesBackupsV39Test-815084545 None] iscsiadm ('-m', 'session'): stdout=tcp: [139] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0600698e-1197-4d21-aefe-cadad145a000 (non-flash) Jul 03 09:48:23.248003 np0000004400 cinder-backup[101319]: stderr= {{(pid=101319) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jul 03 09:48:23.248162 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-16952a16-edcb-4adf-a3a4-d12a6dc72b77 tempest-VolumesBackupsV39Test-815084545 None] iscsi session list stdout=tcp: [139] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0600698e-1197-4d21-aefe-cadad145a000 (non-flash) Jul 03 09:48:23.248162 np0000004400 cinder-backup[101319]: stderr= {{(pid=101319) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jul 03 09:48:23.248516 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.base [None req-16952a16-edcb-4adf-a3a4-d12a6dc72b77 tempest-VolumesBackupsV39Test-815084545 None] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-0600698e-1197-4d21-aefe-cadad145a000" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.102s {{(pid=101319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jul 03 09:48:23.248654 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-16952a16-edcb-4adf-a3a4-d12a6dc72b77 tempest-VolumesBackupsV39Test-815084545 None] Connected to 192.168.40.100:3260 {{(pid=101319) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}} Jul 03 09:48:23.249103 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.linuxscsi [None req-16952a16-edcb-4adf-a3a4-d12a6dc72b77 tempest-VolumesBackupsV39Test-815084545 None] HCTL ('7', '-', '-', 0) found on session 139 with lun 0 {{(pid=101319) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}} Jul 03 09:48:23.249247 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.linuxscsi [None req-16952a16-edcb-4adf-a3a4-d12a6dc72b77 tempest-VolumesBackupsV39Test-815084545 None] Scanning host 7 c: -, t: -, l: 0) {{(pid=101319) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}} Jul 03 09:48:23.260287 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.linuxscsi [None req-16952a16-edcb-4adf-a3a4-d12a6dc72b77 tempest-VolumesBackupsV39Test-815084545 None] Searching for a device in session 139 and hctl ['7', '*', '*', 0] yield: sdb {{(pid=101319) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}} Jul 03 09:48:23.260519 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-16952a16-edcb-4adf-a3a4-d12a6dc72b77 tempest-VolumesBackupsV39Test-815084545 None] Connected to sdb using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-0600698e-1197-4d21-aefe-cadad145a000', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '0600698e-1197-4d21-aefe-cadad145a000', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': False} {{(pid=101319) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}} Jul 03 09:48:24.262135 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.base [None req-16952a16-edcb-4adf-a3a4-d12a6dc72b77 tempest-VolumesBackupsV39Test-815084545 None] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 2.128s {{(pid=101319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jul 03 09:48:24.262639 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-16952a16-edcb-4adf-a3a4-d12a6dc72b77 tempest-VolumesBackupsV39Test-815084545 None] <== connect_volume: return (2129ms) {'type': 'block', 'scsi_wwn': 'SStorPool_iSCSI_DISK_1034578903445799113', 'path': '/dev/sdb'} {{(pid=101319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}} Jul 03 09:48:24.262711 np0000004400 cinder-backup[101319]: DEBUG oslo_concurrency.processutils [None req-16952a16-edcb-4adf-a3a4-d12a6dc72b77 tempest-VolumesBackupsV39Test-815084545 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chown 1002 /dev/sdb {{(pid=101319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 09:48:24.268683 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.base [None req-6c55ca9c-9a26-443f-9295-6da378b448f0 tempest-ProjectReaderTests39-1540523434 None] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 1.884s {{(pid=101319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jul 03 09:48:24.269422 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.base [None req-6c55ca9c-9a26-443f-9295-6da378b448f0 tempest-ProjectReaderTests39-1540523434 None] Connection properties {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-45625dd9-520e-4033-b160-f3175cfdc32a', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '45625dd9-520e-4033-b160-f3175cfdc32a', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': False} {{(pid=101319) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}} Jul 03 09:48:24.279954 np0000004400 sudo[143142]: stack : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chown 1002 /dev/sdb Jul 03 09:48:24.280571 np0000004400 sudo[143142]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1002) Jul 03 09:48:24.289545 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.base [None req-6c55ca9c-9a26-443f-9295-6da378b448f0 tempest-ProjectReaderTests39-1540523434 None] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-45625dd9-520e-4033-b160-f3175cfdc32a" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=101319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jul 03 09:48:24.290180 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.base [None req-6c55ca9c-9a26-443f-9295-6da378b448f0 tempest-ProjectReaderTests39-1540523434 None] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-45625dd9-520e-4033-b160-f3175cfdc32a" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=101319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jul 03 09:48:24.290387 np0000004400 cinder-backup[101319]: INFO os_brick.initiator.connectors.iscsi [None req-6c55ca9c-9a26-443f-9295-6da378b448f0 tempest-ProjectReaderTests39-1540523434 None] Trying to connect to iSCSI portal 192.168.40.100:3260 Jul 03 09:48:24.300249 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-6c55ca9c-9a26-443f-9295-6da378b448f0 tempest-ProjectReaderTests39-1540523434 None] iscsiadm (): stdout= stderr=iscsiadm: No records found Jul 03 09:48:24.300249 np0000004400 cinder-backup[101319]: {{(pid=101319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 03 09:48:24.311995 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-6c55ca9c-9a26-443f-9295-6da378b448f0 tempest-ProjectReaderTests39-1540523434 None] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-45625dd9-520e-4033-b160-f3175cfdc32a] added Jul 03 09:48:24.311995 np0000004400 cinder-backup[101319]: stderr=iscsiadm: Config file line 363 does not have value Jul 03 09:48:24.311995 np0000004400 cinder-backup[101319]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs' Jul 03 09:48:24.311995 np0000004400 cinder-backup[101319]: iscsiadm: Config file line 363 does not have value Jul 03 09:48:24.311995 np0000004400 cinder-backup[101319]: iscsiadm: Config file line 363 does not have value Jul 03 09:48:24.311995 np0000004400 cinder-backup[101319]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs' Jul 03 09:48:24.311995 np0000004400 cinder-backup[101319]: {{(pid=101319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 03 09:48:24.312158 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-6c55ca9c-9a26-443f-9295-6da378b448f0 tempest-ProjectReaderTests39-1540523434 None] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=101319) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}} Jul 03 09:48:24.312674 np0000004400 cinder-backup[101319]: DEBUG os_brick.utils [None req-6c55ca9c-9a26-443f-9295-6da378b448f0 tempest-ProjectReaderTests39-1540523434 None] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0223(s), this was the 1st time calling it. {{(pid=101319) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}} Jul 03 09:48:24.312880 np0000004400 cinder-backup[101319]: DEBUG os_brick.utils [None req-6c55ca9c-9a26-443f-9295-6da378b448f0 tempest-ProjectReaderTests39-1540523434 None] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=101319) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}} Jul 03 09:48:24.573813 np0000004400 cinder-backup[101319]: DEBUG oslo_concurrency.processutils [None req-16952a16-edcb-4adf-a3a4-d12a6dc72b77 tempest-VolumesBackupsV39Test-815084545 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chown 1002 /dev/sdb" returned: 0 in 0.311s {{(pid=101319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 09:48:24.571863 np0000004400 sudo[143142]: pam_unix(sudo:session): session closed for user root Jul 03 09:48:24.619482 np0000004400 cinder-backup[101319]: DEBUG oslo_db.sqlalchemy.engines [None req-16952a16-edcb-4adf-a3a4-d12a6dc72b77 tempest-VolumesBackupsV39Test-815084545 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=101319) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 03 09:48:24.625779 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-16952a16-edcb-4adf-a3a4-d12a6dc72b77 tempest-VolumesBackupsV39Test-815084545 None] _create_container started, container: tempest-volumesbackupsv39test-backup-container-1091695867,backup: c9ad8b37-057e-4c52-a459-b8dbd5e67dfe. {{(pid=101319) _create_container /opt/stack/cinder/cinder/backup/chunkeddriver.py:249}} Jul 03 09:48:24.777136 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.drivers.swift [None req-16952a16-edcb-4adf-a3a4-d12a6dc72b77 tempest-VolumesBackupsV39Test-815084545 None] generate_object_name_prefix: volume_0600698e-1197-4d21-aefe-cadad145a000/20260703094824/az_nova_backup_c9ad8b37-057e-4c52-a459-b8dbd5e67dfe {{(pid=101319) _generate_object_name_prefix /opt/stack/cinder/cinder/backup/drivers/swift.py:452}} Jul 03 09:48:24.784201 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-16952a16-edcb-4adf-a3a4-d12a6dc72b77 tempest-VolumesBackupsV39Test-815084545 None] starting backup of volume: 0600698e-1197-4d21-aefe-cadad145a000, volume size: 1073741824, object names prefix volume_0600698e-1197-4d21-aefe-cadad145a000/20260703094824/az_nova_backup_c9ad8b37-057e-4c52-a459-b8dbd5e67dfe, availability zone: nova {{(pid=101319) _prepare_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:359}} Jul 03 09:48:24.983592 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-16952a16-edcb-4adf-a3a4-d12a6dc72b77 tempest-VolumesBackupsV39Test-815084545 None] Backing up chunk of data from volume. {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 09:48:25.254606 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-16952a16-edcb-4adf-a3a4-d12a6dc72b77 tempest-VolumesBackupsV39Test-815084545 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101319) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 09:48:25.254873 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-16952a16-edcb-4adf-a3a4-d12a6dc72b77 tempest-VolumesBackupsV39Test-815084545 None] About to put_object {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 09:48:25.314314 np0000004400 cinder-backup[101319]: INFO os_brick.initiator.connectors.iscsi [None req-6c55ca9c-9a26-443f-9295-6da378b448f0 tempest-ProjectReaderTests39-1540523434 None] Trying to connect to iSCSI portal 192.168.40.100:3260 Jul 03 09:48:25.326018 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-6c55ca9c-9a26-443f-9295-6da378b448f0 tempest-ProjectReaderTests39-1540523434 None] iscsiadm (): stdout=# BEGIN RECORD 2.1.9 Jul 03 09:48:25.326018 np0000004400 cinder-backup[101319]: node.name = iqn.2023-03.storpool.com:os--volume-45625dd9-520e-4033-b160-f3175cfdc32a Jul 03 09:48:25.326018 np0000004400 cinder-backup[101319]: node.tpgt = -1 Jul 03 09:48:25.326018 np0000004400 cinder-backup[101319]: node.startup = manual Jul 03 09:48:25.326018 np0000004400 cinder-backup[101319]: node.leading_login = No Jul 03 09:48:25.326018 np0000004400 cinder-backup[101319]: iface.iscsi_ifacename = default Jul 03 09:48:25.326018 np0000004400 cinder-backup[101319]: iface.net_ifacename = Jul 03 09:48:25.326018 np0000004400 cinder-backup[101319]: iface.ipaddress = Jul 03 09:48:25.326018 np0000004400 cinder-backup[101319]: iface.prefix_len = 0 Jul 03 09:48:25.326018 np0000004400 cinder-backup[101319]: iface.hwaddress = Jul 03 09:48:25.326018 np0000004400 cinder-backup[101319]: iface.transport_name = tcp Jul 03 09:48:25.326018 np0000004400 cinder-backup[101319]: iface.initiatorname = Jul 03 09:48:25.326018 np0000004400 cinder-backup[101319]: iface.state = Jul 03 09:48:25.326018 np0000004400 cinder-backup[101319]: iface.vlan_id = 0 Jul 03 09:48:25.326018 np0000004400 cinder-backup[101319]: iface.vlan_priority = 0 Jul 03 09:48:25.326018 np0000004400 cinder-backup[101319]: iface.vlan_state = Jul 03 09:48:25.326018 np0000004400 cinder-backup[101319]: iface.iface_num = 0 Jul 03 09:48:25.326018 np0000004400 cinder-backup[101319]: iface.mtu = 0 Jul 03 09:48:25.326018 np0000004400 cinder-backup[101319]: iface.port = 0 Jul 03 09:48:25.326018 np0000004400 cinder-backup[101319]: iface.bootproto = Jul 03 09:48:25.326018 np0000004400 cinder-backup[101319]: iface.subnet_mask = Jul 03 09:48:25.326018 np0000004400 cinder-backup[101319]: iface.gateway = Jul 03 09:48:25.326018 np0000004400 cinder-backup[101319]: iface.dhcp_alt_client_id_state = Jul 03 09:48:25.326018 np0000004400 cinder-backup[101319]: iface.dhcp_alt_client_id = Jul 03 09:48:25.326018 np0000004400 cinder-backup[101319]: iface.dhcp_dns = Jul 03 09:48:25.326018 np0000004400 cinder-backup[101319]: iface.dhcp_learn_iqn = Jul 03 09:48:25.326018 np0000004400 cinder-backup[101319]: iface.dhcp_req_vendor_id_state = Jul 03 09:48:25.326018 np0000004400 cinder-backup[101319]: iface.dhcp_vendor_id_state = Jul 03 09:48:25.326018 np0000004400 cinder-backup[101319]: iface.dhcp_vendor_id = Jul 03 09:48:25.326018 np0000004400 cinder-backup[101319]: iface.dhcp_slp_da = Jul 03 09:48:25.326018 np0000004400 cinder-backup[101319]: iface.fragmentation = Jul 03 09:48:25.326018 np0000004400 cinder-backup[101319]: iface.gratuitous_arp = Jul 03 09:48:25.326018 np0000004400 cinder-backup[101319]: iface.incoming_forwarding = Jul 03 09:48:25.326018 np0000004400 cinder-backup[101319]: iface.tos_state = Jul 03 09:48:25.326018 np0000004400 cinder-backup[101319]: iface.tos = 0 Jul 03 09:48:25.326018 np0000004400 cinder-backup[101319]: iface.ttl = 0 Jul 03 09:48:25.326018 np0000004400 cinder-backup[101319]: iface.delayed_ack = Jul 03 09:48:25.326018 np0000004400 cinder-backup[101319]: iface.tcp_nagle = Jul 03 09:48:25.326018 np0000004400 cinder-backup[101319]: iface.tcp_wsf_state = Jul 03 09:48:25.326018 np0000004400 cinder-backup[101319]: iface.tcp_wsf = 0 Jul 03 09:48:25.326018 np0000004400 cinder-backup[101319]: iface.tcp_timer_scale = 0 Jul 03 09:48:25.326018 np0000004400 cinder-backup[101319]: iface.tcp_timestamp = Jul 03 09:48:25.326018 np0000004400 cinder-backup[101319]: iface.redirect = Jul 03 09:48:25.326018 np0000004400 cinder-backup[101319]: iface.def_task_mgmt_timeout = 0 Jul 03 09:48:25.326018 np0000004400 cinder-backup[101319]: iface.header_digest = Jul 03 09:48:25.326018 np0000004400 cinder-backup[101319]: iface.data_digest = Jul 03 09:48:25.326018 np0000004400 cinder-backup[101319]: iface.immediate_data = Jul 03 09:48:25.326018 np0000004400 cinder-backup[101319]: iface.initial_r2t = Jul 03 09:48:25.326018 np0000004400 cinder-backup[101319]: iface.data_seq_inorder = Jul 03 09:48:25.326018 np0000004400 cinder-backup[101319]: iface.data_pdu_inorder = Jul 03 09:48:25.326018 np0000004400 cinder-backup[101319]: iface.erl = 0 Jul 03 09:48:25.326018 np0000004400 cinder-backup[101319]: iface.max_receive_data_len = 0 Jul 03 09:48:25.326018 np0000004400 cinder-backup[101319]: iface.first_burst_len = 0 Jul 03 09:48:25.326018 np0000004400 cinder-backup[101319]: iface.max_outstanding_r2t = 0 Jul 03 09:48:25.326018 np0000004400 cinder-backup[101319]: iface.max_burst_len = 0 Jul 03 09:48:25.326018 np0000004400 cinder-backup[101319]: iface.chap_auth = Jul 03 09:48:25.326018 np0000004400 cinder-backup[101319]: iface.bidi_chap = Jul 03 09:48:25.326018 np0000004400 cinder-backup[101319]: iface.strict_login_compliance = Jul 03 09:48:25.326018 np0000004400 cinder-backup[101319]: iface.discovery_auth = Jul 03 09:48:25.326018 np0000004400 cinder-backup[101319]: iface.discovery_logout = Jul 03 09:48:25.326018 np0000004400 cinder-backup[101319]: node.discovery_address = Jul 03 09:48:25.326018 np0000004400 cinder-backup[101319]: node.discovery_port = 0 Jul 03 09:48:25.326018 np0000004400 cinder-backup[101319]: node.discovery_type = fw Jul 03 09:48:25.326018 np0000004400 cinder-backup[101319]: node.session.initial_cmdsn = 0 Jul 03 09:48:25.326018 np0000004400 cinder-backup[101319]: node.session.initial_login_retry_max = 8 Jul 03 09:48:25.326018 np0000004400 cinder-backup[101319]: node.session.xmit_thread_priority = 0 Jul 03 09:48:25.326018 np0000004400 cinder-backup[101319]: node.session.cmds_max = 128 Jul 03 09:48:25.326018 np0000004400 cinder-backup[101319]: node.session.queue_depth = 32 Jul 03 09:48:25.326018 np0000004400 cinder-backup[101319]: node.session.nr_sessions = 1 Jul 03 09:48:25.326018 np0000004400 cinder-backup[101319]: node.session.auth.authmethod = None Jul 03 09:48:25.326018 np0000004400 cinder-backup[101319]: node.session.auth.username = Jul 03 09:48:25.326018 np0000004400 cinder-backup[101319]: node.session.auth.password = *** Jul 03 09:48:25.326018 np0000004400 cinder-backup[101319]: node.session.auth.username_in = Jul 03 09:48:25.326018 np0000004400 cinder-backup[101319]: node.session.auth.password_in = Jul 03 09:48:25.326018 np0000004400 cinder-backup[101319]: node.session.auth.chap_algs = SHA256 Jul 03 09:48:25.326018 np0000004400 cinder-backup[101319]: node.session.timeo.replacement_timeout = 120 Jul 03 09:48:25.326018 np0000004400 cinder-backup[101319]: node.session.err_timeo.abort_timeout = 15 Jul 03 09:48:25.326018 np0000004400 cinder-backup[101319]: node.session.err_timeo.lu_reset_timeout = 30 Jul 03 09:48:25.326018 np0000004400 cinder-backup[101319]: node.session.err_timeo.tgt_reset_timeout = 30 Jul 03 09:48:25.326018 np0000004400 cinder-backup[101319]: node.session.err_timeo.host_reset_timeout = 60 Jul 03 09:48:25.326018 np0000004400 cinder-backup[101319]: node.session.iscsi.FastAbort = Yes Jul 03 09:48:25.326018 np0000004400 cinder-backup[101319]: node.session.iscsi.InitialR2T = No Jul 03 09:48:25.326018 np0000004400 cinder-backup[101319]: node.session.iscsi.ImmediateData = Yes Jul 03 09:48:25.326018 np0000004400 cinder-backup[101319]: node.session.iscsi.FirstBurstLength = 262144 Jul 03 09:48:25.326018 np0000004400 cinder-backup[101319]: node.session.iscsi.MaxBurstLength = 16776192 Jul 03 09:48:25.326018 np0000004400 cinder-backup[101319]: node.session.iscsi.DefaultTime2Retain = 0 Jul 03 09:48:25.326018 np0000004400 cinder-backup[101319]: node.session.iscsi.DefaultTime2Wait = 2 Jul 03 09:48:25.326018 np0000004400 cinder-backup[101319]: node.session.iscsi.MaxConnections = 1 Jul 03 09:48:25.326018 np0000004400 cinder-backup[101319]: node.session.iscsi.MaxOutstandingR2T = 1 Jul 03 09:48:25.326018 np0000004400 cinder-backup[101319]: node.session.iscsi.ERL = 0 Jul 03 09:48:25.326018 np0000004400 cinder-backup[101319]: node.session.scan = auto Jul 03 09:48:25.326018 np0000004400 cinder-backup[101319]: node.session.reopen_max = 0 Jul 03 09:48:25.326018 np0000004400 cinder-backup[101319]: node.conn[0].address = 192.168.40.100 Jul 03 09:48:25.326018 np0000004400 cinder-backup[101319]: node.conn[0].port = 3260 Jul 03 09:48:25.326018 np0000004400 cinder-backup[101319]: node.conn[0].startup = manual Jul 03 09:48:25.326018 np0000004400 cinder-backup[101319]: node.conn[0].tcp.window_size = 524288 Jul 03 09:48:25.326018 np0000004400 cinder-backup[101319]: node.conn[0].tcp.type_of_service = 0 Jul 03 09:48:25.326018 np0000004400 cinder-backup[101319]: node.conn[0].timeo.logout_timeout = 15 Jul 03 09:48:25.326018 np0000004400 cinder-backup[101319]: node.conn[0].timeo.login_timeout = 15 Jul 03 09:48:25.326018 np0000004400 cinder-backup[101319]: node.conn[0].timeo.auth_timeout = 45 Jul 03 09:48:25.326018 np0000004400 cinder-backup[101319]: node.conn[0].timeo.noop_out_interval = 5 Jul 03 09:48:25.326018 np0000004400 cinder-backup[101319]: node.conn[0].timeo.noop_out_timeout = 5 Jul 03 09:48:25.326018 np0000004400 cinder-backup[101319]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0 Jul 03 09:48:25.326018 np0000004400 cinder-backup[101319]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144 Jul 03 09:48:25.326018 np0000004400 cinder-backup[101319]: node.conn[0].iscsi.HeaderDigest = None Jul 03 09:48:25.326018 np0000004400 cinder-backup[101319]: node.conn[0].iscsi.DataDigest = None Jul 03 09:48:25.326018 np0000004400 cinder-backup[101319]: node.conn[0].iscsi.IFMarker = No Jul 03 09:48:25.326018 np0000004400 cinder-backup[101319]: node.conn[0].iscsi.OFMarker = No Jul 03 09:48:25.326018 np0000004400 cinder-backup[101319]: # END RECORD Jul 03 09:48:25.326018 np0000004400 cinder-backup[101319]: stderr= {{(pid=101319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 03 09:48:25.336772 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-6c55ca9c-9a26-443f-9295-6da378b448f0 tempest-ProjectReaderTests39-1540523434 None] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=101319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 03 09:48:25.347006 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-6c55ca9c-9a26-443f-9295-6da378b448f0 tempest-ProjectReaderTests39-1540523434 None] iscsiadm ('-m', 'session'): stdout=tcp: [139] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0600698e-1197-4d21-aefe-cadad145a000 (non-flash) Jul 03 09:48:25.347006 np0000004400 cinder-backup[101319]: stderr= {{(pid=101319) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jul 03 09:48:25.347229 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-6c55ca9c-9a26-443f-9295-6da378b448f0 tempest-ProjectReaderTests39-1540523434 None] iscsi session list stdout=tcp: [139] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0600698e-1197-4d21-aefe-cadad145a000 (non-flash) Jul 03 09:48:25.347229 np0000004400 cinder-backup[101319]: stderr= {{(pid=101319) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jul 03 09:48:25.375143 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-16952a16-edcb-4adf-a3a4-d12a6dc72b77 tempest-VolumesBackupsV39Test-815084545 None] backup MD5 for volume_0600698e-1197-4d21-aefe-cadad145a000/20260703094824/az_nova_backup_c9ad8b37-057e-4c52-a459-b8dbd5e67dfe-00001: 25e317773f308e446cc84c503a6d1f85 {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 09:48:25.375338 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-16952a16-edcb-4adf-a3a4-d12a6dc72b77 tempest-VolumesBackupsV39Test-815084545 None] Calling eventlet.sleep(0) {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 09:48:25.377458 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-6c55ca9c-9a26-443f-9295-6da378b448f0 tempest-ProjectReaderTests39-1540523434 None] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-45625dd9-520e-4033-b160-f3175cfdc32a, portal: 192.168.40.100,3260] Jul 03 09:48:25.377458 np0000004400 cinder-backup[101319]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-45625dd9-520e-4033-b160-f3175cfdc32a, portal: 192.168.40.100,3260] successful. Jul 03 09:48:25.377458 np0000004400 cinder-backup[101319]: stderr= {{(pid=101319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 03 09:48:25.390646 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-6c55ca9c-9a26-443f-9295-6da378b448f0 tempest-ProjectReaderTests39-1540523434 None] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=101319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 03 09:48:25.405840 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-6c55ca9c-9a26-443f-9295-6da378b448f0 tempest-ProjectReaderTests39-1540523434 None] iscsiadm ('-m', 'session'): stdout=tcp: [139] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0600698e-1197-4d21-aefe-cadad145a000 (non-flash) Jul 03 09:48:25.405840 np0000004400 cinder-backup[101319]: tcp: [140] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-45625dd9-520e-4033-b160-f3175cfdc32a (non-flash) Jul 03 09:48:25.405840 np0000004400 cinder-backup[101319]: stderr= {{(pid=101319) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jul 03 09:48:25.406050 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-6c55ca9c-9a26-443f-9295-6da378b448f0 tempest-ProjectReaderTests39-1540523434 None] iscsi session list stdout=tcp: [139] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0600698e-1197-4d21-aefe-cadad145a000 (non-flash) Jul 03 09:48:25.406050 np0000004400 cinder-backup[101319]: tcp: [140] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-45625dd9-520e-4033-b160-f3175cfdc32a (non-flash) Jul 03 09:48:25.406050 np0000004400 cinder-backup[101319]: stderr= {{(pid=101319) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jul 03 09:48:25.407962 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.base [None req-6c55ca9c-9a26-443f-9295-6da378b448f0 tempest-ProjectReaderTests39-1540523434 None] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-45625dd9-520e-4033-b160-f3175cfdc32a" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.117s {{(pid=101319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jul 03 09:48:25.408139 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-6c55ca9c-9a26-443f-9295-6da378b448f0 tempest-ProjectReaderTests39-1540523434 None] Connected to 192.168.40.100:3260 {{(pid=101319) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}} Jul 03 09:48:25.410192 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.linuxscsi [None req-6c55ca9c-9a26-443f-9295-6da378b448f0 tempest-ProjectReaderTests39-1540523434 None] HCTL ('8', '-', '-', 0) found on session 140 with lun 0 {{(pid=101319) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}} Jul 03 09:48:25.410846 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.linuxscsi [None req-6c55ca9c-9a26-443f-9295-6da378b448f0 tempest-ProjectReaderTests39-1540523434 None] Scanning host 8 c: -, t: -, l: 0) {{(pid=101319) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}} Jul 03 09:48:25.432984 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.linuxscsi [None req-6c55ca9c-9a26-443f-9295-6da378b448f0 tempest-ProjectReaderTests39-1540523434 None] Searching for a device in session 140 and hctl ['8', '*', '*', 0] yield: sdc {{(pid=101319) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}} Jul 03 09:48:25.432984 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-6c55ca9c-9a26-443f-9295-6da378b448f0 tempest-ProjectReaderTests39-1540523434 None] Connected to sdc using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-45625dd9-520e-4033-b160-f3175cfdc32a', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '45625dd9-520e-4033-b160-f3175cfdc32a', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': False} {{(pid=101319) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}} Jul 03 09:48:25.559053 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-16952a16-edcb-4adf-a3a4-d12a6dc72b77 tempest-VolumesBackupsV39Test-815084545 None] Backing up chunk of data from volume. {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 09:48:25.808647 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-16952a16-edcb-4adf-a3a4-d12a6dc72b77 tempest-VolumesBackupsV39Test-815084545 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101319) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 09:48:25.808757 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-16952a16-edcb-4adf-a3a4-d12a6dc72b77 tempest-VolumesBackupsV39Test-815084545 None] About to put_object {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 09:48:25.911632 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-16952a16-edcb-4adf-a3a4-d12a6dc72b77 tempest-VolumesBackupsV39Test-815084545 None] backup MD5 for volume_0600698e-1197-4d21-aefe-cadad145a000/20260703094824/az_nova_backup_c9ad8b37-057e-4c52-a459-b8dbd5e67dfe-00002: 25e317773f308e446cc84c503a6d1f85 {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 09:48:25.911632 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-16952a16-edcb-4adf-a3a4-d12a6dc72b77 tempest-VolumesBackupsV39Test-815084545 None] Calling eventlet.sleep(0) {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 09:48:26.115293 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-16952a16-edcb-4adf-a3a4-d12a6dc72b77 tempest-VolumesBackupsV39Test-815084545 None] Backing up chunk of data from volume. {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 09:48:26.374434 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-16952a16-edcb-4adf-a3a4-d12a6dc72b77 tempest-VolumesBackupsV39Test-815084545 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101319) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 09:48:26.374745 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-16952a16-edcb-4adf-a3a4-d12a6dc72b77 tempest-VolumesBackupsV39Test-815084545 None] About to put_object {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 09:48:26.435163 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.base [None req-6c55ca9c-9a26-443f-9295-6da378b448f0 tempest-ProjectReaderTests39-1540523434 None] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 2.167s {{(pid=101319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jul 03 09:48:26.435462 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-6c55ca9c-9a26-443f-9295-6da378b448f0 tempest-ProjectReaderTests39-1540523434 None] <== connect_volume: return (4051ms) {'type': 'block', 'scsi_wwn': '3300000009020126e', 'path': '/dev/sdc'} {{(pid=101319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}} Jul 03 09:48:26.435840 np0000004400 cinder-backup[101319]: DEBUG oslo_concurrency.processutils [None req-6c55ca9c-9a26-443f-9295-6da378b448f0 tempest-ProjectReaderTests39-1540523434 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chown 1002 /dev/sdc {{(pid=101319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 09:48:26.456115 np0000004400 sudo[143194]: stack : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chown 1002 /dev/sdc Jul 03 09:48:26.456743 np0000004400 sudo[143194]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1002) Jul 03 09:48:26.478637 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-16952a16-edcb-4adf-a3a4-d12a6dc72b77 tempest-VolumesBackupsV39Test-815084545 None] backup MD5 for volume_0600698e-1197-4d21-aefe-cadad145a000/20260703094824/az_nova_backup_c9ad8b37-057e-4c52-a459-b8dbd5e67dfe-00003: 25e317773f308e446cc84c503a6d1f85 {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 09:48:26.478839 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-16952a16-edcb-4adf-a3a4-d12a6dc72b77 tempest-VolumesBackupsV39Test-815084545 None] Calling eventlet.sleep(0) {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 09:48:26.682935 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-16952a16-edcb-4adf-a3a4-d12a6dc72b77 tempest-VolumesBackupsV39Test-815084545 None] Backing up chunk of data from volume. {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 09:48:26.770400 np0000004400 sudo[143194]: pam_unix(sudo:session): session closed for user root Jul 03 09:48:26.772711 np0000004400 cinder-backup[101319]: DEBUG oslo_concurrency.processutils [None req-6c55ca9c-9a26-443f-9295-6da378b448f0 tempest-ProjectReaderTests39-1540523434 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chown 1002 /dev/sdc" returned: 0 in 0.336s {{(pid=101319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 09:48:26.780816 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-6c55ca9c-9a26-443f-9295-6da378b448f0 tempest-ProjectReaderTests39-1540523434 None] _create_container started, container: volumebackups,backup: 1704ffd8-504c-4b12-adcf-b7f1a0cead28. {{(pid=101319) _create_container /opt/stack/cinder/cinder/backup/chunkeddriver.py:249}} Jul 03 09:48:26.930337 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-16952a16-edcb-4adf-a3a4-d12a6dc72b77 tempest-VolumesBackupsV39Test-815084545 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101319) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 09:48:26.930528 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-16952a16-edcb-4adf-a3a4-d12a6dc72b77 tempest-VolumesBackupsV39Test-815084545 None] About to put_object {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 09:48:27.016717 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.drivers.swift [None req-6c55ca9c-9a26-443f-9295-6da378b448f0 tempest-ProjectReaderTests39-1540523434 None] generate_object_name_prefix: volume_45625dd9-520e-4033-b160-f3175cfdc32a/20260703094827/az_nova_backup_1704ffd8-504c-4b12-adcf-b7f1a0cead28 {{(pid=101319) _generate_object_name_prefix /opt/stack/cinder/cinder/backup/drivers/swift.py:452}} Jul 03 09:48:27.024718 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-6c55ca9c-9a26-443f-9295-6da378b448f0 tempest-ProjectReaderTests39-1540523434 None] starting backup of volume: 45625dd9-520e-4033-b160-f3175cfdc32a, volume size: 1073741824, object names prefix volume_45625dd9-520e-4033-b160-f3175cfdc32a/20260703094827/az_nova_backup_1704ffd8-504c-4b12-adcf-b7f1a0cead28, availability zone: nova {{(pid=101319) _prepare_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:359}} Jul 03 09:48:27.033739 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-16952a16-edcb-4adf-a3a4-d12a6dc72b77 tempest-VolumesBackupsV39Test-815084545 None] backup MD5 for volume_0600698e-1197-4d21-aefe-cadad145a000/20260703094824/az_nova_backup_c9ad8b37-057e-4c52-a459-b8dbd5e67dfe-00004: 25e317773f308e446cc84c503a6d1f85 {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 09:48:27.033995 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-16952a16-edcb-4adf-a3a4-d12a6dc72b77 tempest-VolumesBackupsV39Test-815084545 None] Calling eventlet.sleep(0) {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 09:48:27.329361 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-16952a16-edcb-4adf-a3a4-d12a6dc72b77 tempest-VolumesBackupsV39Test-815084545 None] Backing up chunk of data from volume. {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 09:48:27.333296 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-6c55ca9c-9a26-443f-9295-6da378b448f0 tempest-ProjectReaderTests39-1540523434 None] Backing up chunk of data from volume. {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 09:48:27.590116 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-16952a16-edcb-4adf-a3a4-d12a6dc72b77 tempest-VolumesBackupsV39Test-815084545 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101319) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 09:48:27.590665 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-16952a16-edcb-4adf-a3a4-d12a6dc72b77 tempest-VolumesBackupsV39Test-815084545 None] About to put_object {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 09:48:27.590665 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-6c55ca9c-9a26-443f-9295-6da378b448f0 tempest-ProjectReaderTests39-1540523434 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101319) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 09:48:27.590665 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-6c55ca9c-9a26-443f-9295-6da378b448f0 tempest-ProjectReaderTests39-1540523434 None] About to put_object {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 09:48:27.699081 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-16952a16-edcb-4adf-a3a4-d12a6dc72b77 tempest-VolumesBackupsV39Test-815084545 None] backup MD5 for volume_0600698e-1197-4d21-aefe-cadad145a000/20260703094824/az_nova_backup_c9ad8b37-057e-4c52-a459-b8dbd5e67dfe-00005: 25e317773f308e446cc84c503a6d1f85 {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 09:48:27.699299 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-16952a16-edcb-4adf-a3a4-d12a6dc72b77 tempest-VolumesBackupsV39Test-815084545 None] Calling eventlet.sleep(0) {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 09:48:27.733257 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-6c55ca9c-9a26-443f-9295-6da378b448f0 tempest-ProjectReaderTests39-1540523434 None] backup MD5 for volume_45625dd9-520e-4033-b160-f3175cfdc32a/20260703094827/az_nova_backup_1704ffd8-504c-4b12-adcf-b7f1a0cead28-00001: 25e317773f308e446cc84c503a6d1f85 {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 09:48:27.733486 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-6c55ca9c-9a26-443f-9295-6da378b448f0 tempest-ProjectReaderTests39-1540523434 None] Calling eventlet.sleep(0) {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 09:48:27.981196 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-16952a16-edcb-4adf-a3a4-d12a6dc72b77 tempest-VolumesBackupsV39Test-815084545 None] Backing up chunk of data from volume. {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 09:48:28.009124 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-6c55ca9c-9a26-443f-9295-6da378b448f0 tempest-ProjectReaderTests39-1540523434 None] Backing up chunk of data from volume. {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 09:48:28.238880 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-16952a16-edcb-4adf-a3a4-d12a6dc72b77 tempest-VolumesBackupsV39Test-815084545 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101319) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 09:48:28.238880 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-16952a16-edcb-4adf-a3a4-d12a6dc72b77 tempest-VolumesBackupsV39Test-815084545 None] About to put_object {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 09:48:28.276487 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-6c55ca9c-9a26-443f-9295-6da378b448f0 tempest-ProjectReaderTests39-1540523434 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101319) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 09:48:28.276487 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-6c55ca9c-9a26-443f-9295-6da378b448f0 tempest-ProjectReaderTests39-1540523434 None] About to put_object {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 09:48:28.362686 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-16952a16-edcb-4adf-a3a4-d12a6dc72b77 tempest-VolumesBackupsV39Test-815084545 None] backup MD5 for volume_0600698e-1197-4d21-aefe-cadad145a000/20260703094824/az_nova_backup_c9ad8b37-057e-4c52-a459-b8dbd5e67dfe-00006: 25e317773f308e446cc84c503a6d1f85 {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 09:48:28.362686 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-16952a16-edcb-4adf-a3a4-d12a6dc72b77 tempest-VolumesBackupsV39Test-815084545 None] Calling eventlet.sleep(0) {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 09:48:28.406857 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-6c55ca9c-9a26-443f-9295-6da378b448f0 tempest-ProjectReaderTests39-1540523434 None] backup MD5 for volume_45625dd9-520e-4033-b160-f3175cfdc32a/20260703094827/az_nova_backup_1704ffd8-504c-4b12-adcf-b7f1a0cead28-00002: 25e317773f308e446cc84c503a6d1f85 {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 09:48:28.406857 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-6c55ca9c-9a26-443f-9295-6da378b448f0 tempest-ProjectReaderTests39-1540523434 None] Calling eventlet.sleep(0) {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 09:48:28.603706 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-16952a16-edcb-4adf-a3a4-d12a6dc72b77 tempest-VolumesBackupsV39Test-815084545 None] Backing up chunk of data from volume. {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 09:48:28.680238 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-6c55ca9c-9a26-443f-9295-6da378b448f0 tempest-ProjectReaderTests39-1540523434 None] Backing up chunk of data from volume. {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 09:48:28.855934 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-16952a16-edcb-4adf-a3a4-d12a6dc72b77 tempest-VolumesBackupsV39Test-815084545 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101319) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 09:48:28.856174 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-16952a16-edcb-4adf-a3a4-d12a6dc72b77 tempest-VolumesBackupsV39Test-815084545 None] About to put_object {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 09:48:28.928379 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-6c55ca9c-9a26-443f-9295-6da378b448f0 tempest-ProjectReaderTests39-1540523434 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101319) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 09:48:28.928603 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-6c55ca9c-9a26-443f-9295-6da378b448f0 tempest-ProjectReaderTests39-1540523434 None] About to put_object {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 09:48:28.985027 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-16952a16-edcb-4adf-a3a4-d12a6dc72b77 tempest-VolumesBackupsV39Test-815084545 None] backup MD5 for volume_0600698e-1197-4d21-aefe-cadad145a000/20260703094824/az_nova_backup_c9ad8b37-057e-4c52-a459-b8dbd5e67dfe-00007: 25e317773f308e446cc84c503a6d1f85 {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 09:48:28.985228 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-16952a16-edcb-4adf-a3a4-d12a6dc72b77 tempest-VolumesBackupsV39Test-815084545 None] Calling eventlet.sleep(0) {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 09:48:29.035631 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-6c55ca9c-9a26-443f-9295-6da378b448f0 tempest-ProjectReaderTests39-1540523434 None] backup MD5 for volume_45625dd9-520e-4033-b160-f3175cfdc32a/20260703094827/az_nova_backup_1704ffd8-504c-4b12-adcf-b7f1a0cead28-00003: 25e317773f308e446cc84c503a6d1f85 {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 09:48:29.036178 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-6c55ca9c-9a26-443f-9295-6da378b448f0 tempest-ProjectReaderTests39-1540523434 None] Calling eventlet.sleep(0) {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 09:48:29.219938 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-16952a16-edcb-4adf-a3a4-d12a6dc72b77 tempest-VolumesBackupsV39Test-815084545 None] Backing up chunk of data from volume. {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 09:48:29.301296 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-6c55ca9c-9a26-443f-9295-6da378b448f0 tempest-ProjectReaderTests39-1540523434 None] Backing up chunk of data from volume. {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 09:48:29.482514 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-16952a16-edcb-4adf-a3a4-d12a6dc72b77 tempest-VolumesBackupsV39Test-815084545 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101319) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 09:48:29.482700 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-16952a16-edcb-4adf-a3a4-d12a6dc72b77 tempest-VolumesBackupsV39Test-815084545 None] About to put_object {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 09:48:29.558590 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-6c55ca9c-9a26-443f-9295-6da378b448f0 tempest-ProjectReaderTests39-1540523434 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101319) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 09:48:29.558851 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-6c55ca9c-9a26-443f-9295-6da378b448f0 tempest-ProjectReaderTests39-1540523434 None] About to put_object {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 09:48:29.604752 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-16952a16-edcb-4adf-a3a4-d12a6dc72b77 tempest-VolumesBackupsV39Test-815084545 None] backup MD5 for volume_0600698e-1197-4d21-aefe-cadad145a000/20260703094824/az_nova_backup_c9ad8b37-057e-4c52-a459-b8dbd5e67dfe-00008: 25e317773f308e446cc84c503a6d1f85 {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 09:48:29.605120 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-16952a16-edcb-4adf-a3a4-d12a6dc72b77 tempest-VolumesBackupsV39Test-815084545 None] Calling eventlet.sleep(0) {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 09:48:29.661714 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-6c55ca9c-9a26-443f-9295-6da378b448f0 tempest-ProjectReaderTests39-1540523434 None] backup MD5 for volume_45625dd9-520e-4033-b160-f3175cfdc32a/20260703094827/az_nova_backup_1704ffd8-504c-4b12-adcf-b7f1a0cead28-00004: 25e317773f308e446cc84c503a6d1f85 {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 09:48:29.661912 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-6c55ca9c-9a26-443f-9295-6da378b448f0 tempest-ProjectReaderTests39-1540523434 None] Calling eventlet.sleep(0) {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 09:48:29.859045 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-16952a16-edcb-4adf-a3a4-d12a6dc72b77 tempest-VolumesBackupsV39Test-815084545 None] Backing up chunk of data from volume. {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 09:48:29.935170 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-6c55ca9c-9a26-443f-9295-6da378b448f0 tempest-ProjectReaderTests39-1540523434 None] Backing up chunk of data from volume. {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 09:48:30.140597 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-16952a16-edcb-4adf-a3a4-d12a6dc72b77 tempest-VolumesBackupsV39Test-815084545 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101319) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 09:48:30.140703 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-16952a16-edcb-4adf-a3a4-d12a6dc72b77 tempest-VolumesBackupsV39Test-815084545 None] About to put_object {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 09:48:30.202629 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-6c55ca9c-9a26-443f-9295-6da378b448f0 tempest-ProjectReaderTests39-1540523434 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101319) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 09:48:30.202765 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-6c55ca9c-9a26-443f-9295-6da378b448f0 tempest-ProjectReaderTests39-1540523434 None] About to put_object {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 09:48:30.246140 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-16952a16-edcb-4adf-a3a4-d12a6dc72b77 tempest-VolumesBackupsV39Test-815084545 None] backup MD5 for volume_0600698e-1197-4d21-aefe-cadad145a000/20260703094824/az_nova_backup_c9ad8b37-057e-4c52-a459-b8dbd5e67dfe-00009: 25e317773f308e446cc84c503a6d1f85 {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 09:48:30.246353 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-16952a16-edcb-4adf-a3a4-d12a6dc72b77 tempest-VolumesBackupsV39Test-815084545 None] Calling eventlet.sleep(0) {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 09:48:30.327235 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-6c55ca9c-9a26-443f-9295-6da378b448f0 tempest-ProjectReaderTests39-1540523434 None] backup MD5 for volume_45625dd9-520e-4033-b160-f3175cfdc32a/20260703094827/az_nova_backup_1704ffd8-504c-4b12-adcf-b7f1a0cead28-00005: 25e317773f308e446cc84c503a6d1f85 {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 09:48:30.327526 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-6c55ca9c-9a26-443f-9295-6da378b448f0 tempest-ProjectReaderTests39-1540523434 None] Calling eventlet.sleep(0) {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 09:48:30.553963 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-16952a16-edcb-4adf-a3a4-d12a6dc72b77 tempest-VolumesBackupsV39Test-815084545 None] Backing up chunk of data from volume. {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 09:48:30.576359 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-6c55ca9c-9a26-443f-9295-6da378b448f0 tempest-ProjectReaderTests39-1540523434 None] Backing up chunk of data from volume. {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 09:48:30.830246 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-16952a16-edcb-4adf-a3a4-d12a6dc72b77 tempest-VolumesBackupsV39Test-815084545 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101319) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 09:48:30.830688 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-16952a16-edcb-4adf-a3a4-d12a6dc72b77 tempest-VolumesBackupsV39Test-815084545 None] About to put_object {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 09:48:30.844120 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-6c55ca9c-9a26-443f-9295-6da378b448f0 tempest-ProjectReaderTests39-1540523434 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101319) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 09:48:30.844319 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-6c55ca9c-9a26-443f-9295-6da378b448f0 tempest-ProjectReaderTests39-1540523434 None] About to put_object {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 09:48:30.942498 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-16952a16-edcb-4adf-a3a4-d12a6dc72b77 tempest-VolumesBackupsV39Test-815084545 None] backup MD5 for volume_0600698e-1197-4d21-aefe-cadad145a000/20260703094824/az_nova_backup_c9ad8b37-057e-4c52-a459-b8dbd5e67dfe-00010: 25e317773f308e446cc84c503a6d1f85 {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 09:48:30.942736 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-16952a16-edcb-4adf-a3a4-d12a6dc72b77 tempest-VolumesBackupsV39Test-815084545 None] Calling eventlet.sleep(0) {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 09:48:30.954275 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-6c55ca9c-9a26-443f-9295-6da378b448f0 tempest-ProjectReaderTests39-1540523434 None] backup MD5 for volume_45625dd9-520e-4033-b160-f3175cfdc32a/20260703094827/az_nova_backup_1704ffd8-504c-4b12-adcf-b7f1a0cead28-00006: 25e317773f308e446cc84c503a6d1f85 {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 09:48:30.954744 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-6c55ca9c-9a26-443f-9295-6da378b448f0 tempest-ProjectReaderTests39-1540523434 None] Calling eventlet.sleep(0) {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 09:48:31.211446 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-16952a16-edcb-4adf-a3a4-d12a6dc72b77 tempest-VolumesBackupsV39Test-815084545 None] Backing up chunk of data from volume. {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 09:48:31.257109 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-6c55ca9c-9a26-443f-9295-6da378b448f0 tempest-ProjectReaderTests39-1540523434 None] Backing up chunk of data from volume. {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 09:48:31.456759 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-16952a16-edcb-4adf-a3a4-d12a6dc72b77 tempest-VolumesBackupsV39Test-815084545 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101319) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 09:48:31.456986 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-16952a16-edcb-4adf-a3a4-d12a6dc72b77 tempest-VolumesBackupsV39Test-815084545 None] About to put_object {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 09:48:31.509276 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-6c55ca9c-9a26-443f-9295-6da378b448f0 tempest-ProjectReaderTests39-1540523434 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101319) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 09:48:31.509536 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-6c55ca9c-9a26-443f-9295-6da378b448f0 tempest-ProjectReaderTests39-1540523434 None] About to put_object {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 09:48:31.572946 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-16952a16-edcb-4adf-a3a4-d12a6dc72b77 tempest-VolumesBackupsV39Test-815084545 None] backup MD5 for volume_0600698e-1197-4d21-aefe-cadad145a000/20260703094824/az_nova_backup_c9ad8b37-057e-4c52-a459-b8dbd5e67dfe-00011: 25e317773f308e446cc84c503a6d1f85 {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 09:48:31.572946 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-16952a16-edcb-4adf-a3a4-d12a6dc72b77 tempest-VolumesBackupsV39Test-815084545 None] Calling eventlet.sleep(0) {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 09:48:31.613050 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-6c55ca9c-9a26-443f-9295-6da378b448f0 tempest-ProjectReaderTests39-1540523434 None] backup MD5 for volume_45625dd9-520e-4033-b160-f3175cfdc32a/20260703094827/az_nova_backup_1704ffd8-504c-4b12-adcf-b7f1a0cead28-00007: 25e317773f308e446cc84c503a6d1f85 {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 09:48:31.614961 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-6c55ca9c-9a26-443f-9295-6da378b448f0 tempest-ProjectReaderTests39-1540523434 None] Calling eventlet.sleep(0) {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 09:48:31.821824 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-16952a16-edcb-4adf-a3a4-d12a6dc72b77 tempest-VolumesBackupsV39Test-815084545 None] Backing up chunk of data from volume. {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 09:48:31.869792 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-6c55ca9c-9a26-443f-9295-6da378b448f0 tempest-ProjectReaderTests39-1540523434 None] Backing up chunk of data from volume. {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 09:48:32.091025 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-16952a16-edcb-4adf-a3a4-d12a6dc72b77 tempest-VolumesBackupsV39Test-815084545 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101319) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 09:48:32.091227 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-16952a16-edcb-4adf-a3a4-d12a6dc72b77 tempest-VolumesBackupsV39Test-815084545 None] About to put_object {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 09:48:32.149484 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-6c55ca9c-9a26-443f-9295-6da378b448f0 tempest-ProjectReaderTests39-1540523434 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101319) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 09:48:32.153400 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-6c55ca9c-9a26-443f-9295-6da378b448f0 tempest-ProjectReaderTests39-1540523434 None] About to put_object {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 09:48:32.225483 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-16952a16-edcb-4adf-a3a4-d12a6dc72b77 tempest-VolumesBackupsV39Test-815084545 None] backup MD5 for volume_0600698e-1197-4d21-aefe-cadad145a000/20260703094824/az_nova_backup_c9ad8b37-057e-4c52-a459-b8dbd5e67dfe-00012: 25e317773f308e446cc84c503a6d1f85 {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 09:48:32.225771 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-16952a16-edcb-4adf-a3a4-d12a6dc72b77 tempest-VolumesBackupsV39Test-815084545 None] Calling eventlet.sleep(0) {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 09:48:32.299920 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-6c55ca9c-9a26-443f-9295-6da378b448f0 tempest-ProjectReaderTests39-1540523434 None] backup MD5 for volume_45625dd9-520e-4033-b160-f3175cfdc32a/20260703094827/az_nova_backup_1704ffd8-504c-4b12-adcf-b7f1a0cead28-00008: 25e317773f308e446cc84c503a6d1f85 {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 09:48:32.300169 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-6c55ca9c-9a26-443f-9295-6da378b448f0 tempest-ProjectReaderTests39-1540523434 None] Calling eventlet.sleep(0) {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 09:48:32.515492 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-16952a16-edcb-4adf-a3a4-d12a6dc72b77 tempest-VolumesBackupsV39Test-815084545 None] Backing up chunk of data from volume. {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 09:48:32.577851 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-6c55ca9c-9a26-443f-9295-6da378b448f0 tempest-ProjectReaderTests39-1540523434 None] Backing up chunk of data from volume. {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 09:48:32.762426 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-16952a16-edcb-4adf-a3a4-d12a6dc72b77 tempest-VolumesBackupsV39Test-815084545 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101319) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 09:48:32.762674 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-16952a16-edcb-4adf-a3a4-d12a6dc72b77 tempest-VolumesBackupsV39Test-815084545 None] About to put_object {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 09:48:32.825949 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-6c55ca9c-9a26-443f-9295-6da378b448f0 tempest-ProjectReaderTests39-1540523434 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101319) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 09:48:32.826124 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-6c55ca9c-9a26-443f-9295-6da378b448f0 tempest-ProjectReaderTests39-1540523434 None] About to put_object {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 09:48:32.877129 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-16952a16-edcb-4adf-a3a4-d12a6dc72b77 tempest-VolumesBackupsV39Test-815084545 None] backup MD5 for volume_0600698e-1197-4d21-aefe-cadad145a000/20260703094824/az_nova_backup_c9ad8b37-057e-4c52-a459-b8dbd5e67dfe-00013: 25e317773f308e446cc84c503a6d1f85 {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 09:48:32.877609 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-16952a16-edcb-4adf-a3a4-d12a6dc72b77 tempest-VolumesBackupsV39Test-815084545 None] Calling eventlet.sleep(0) {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 09:48:32.949682 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-6c55ca9c-9a26-443f-9295-6da378b448f0 tempest-ProjectReaderTests39-1540523434 None] backup MD5 for volume_45625dd9-520e-4033-b160-f3175cfdc32a/20260703094827/az_nova_backup_1704ffd8-504c-4b12-adcf-b7f1a0cead28-00009: 25e317773f308e446cc84c503a6d1f85 {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 09:48:32.949682 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-6c55ca9c-9a26-443f-9295-6da378b448f0 tempest-ProjectReaderTests39-1540523434 None] Calling eventlet.sleep(0) {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 09:48:33.105495 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-16952a16-edcb-4adf-a3a4-d12a6dc72b77 tempest-VolumesBackupsV39Test-815084545 None] Backing up chunk of data from volume. {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 09:48:33.175078 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-6c55ca9c-9a26-443f-9295-6da378b448f0 tempest-ProjectReaderTests39-1540523434 None] Backing up chunk of data from volume. {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 09:48:33.361773 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-16952a16-edcb-4adf-a3a4-d12a6dc72b77 tempest-VolumesBackupsV39Test-815084545 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101319) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 09:48:33.361896 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-16952a16-edcb-4adf-a3a4-d12a6dc72b77 tempest-VolumesBackupsV39Test-815084545 None] About to put_object {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 09:48:33.427975 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-6c55ca9c-9a26-443f-9295-6da378b448f0 tempest-ProjectReaderTests39-1540523434 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101319) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 09:48:33.427975 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-6c55ca9c-9a26-443f-9295-6da378b448f0 tempest-ProjectReaderTests39-1540523434 None] About to put_object {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 09:48:33.494463 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-16952a16-edcb-4adf-a3a4-d12a6dc72b77 tempest-VolumesBackupsV39Test-815084545 None] backup MD5 for volume_0600698e-1197-4d21-aefe-cadad145a000/20260703094824/az_nova_backup_c9ad8b37-057e-4c52-a459-b8dbd5e67dfe-00014: 25e317773f308e446cc84c503a6d1f85 {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 09:48:33.494463 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-16952a16-edcb-4adf-a3a4-d12a6dc72b77 tempest-VolumesBackupsV39Test-815084545 None] Calling eventlet.sleep(0) {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 09:48:33.556892 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-6c55ca9c-9a26-443f-9295-6da378b448f0 tempest-ProjectReaderTests39-1540523434 None] backup MD5 for volume_45625dd9-520e-4033-b160-f3175cfdc32a/20260703094827/az_nova_backup_1704ffd8-504c-4b12-adcf-b7f1a0cead28-00010: 25e317773f308e446cc84c503a6d1f85 {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 09:48:33.557132 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-6c55ca9c-9a26-443f-9295-6da378b448f0 tempest-ProjectReaderTests39-1540523434 None] Calling eventlet.sleep(0) {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 09:48:33.785762 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-16952a16-edcb-4adf-a3a4-d12a6dc72b77 tempest-VolumesBackupsV39Test-815084545 None] Backing up chunk of data from volume. {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 09:48:33.840242 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-6c55ca9c-9a26-443f-9295-6da378b448f0 tempest-ProjectReaderTests39-1540523434 None] Backing up chunk of data from volume. {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 09:48:34.025294 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-16952a16-edcb-4adf-a3a4-d12a6dc72b77 tempest-VolumesBackupsV39Test-815084545 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101319) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 09:48:34.025639 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-16952a16-edcb-4adf-a3a4-d12a6dc72b77 tempest-VolumesBackupsV39Test-815084545 None] About to put_object {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 09:48:34.086960 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-6c55ca9c-9a26-443f-9295-6da378b448f0 tempest-ProjectReaderTests39-1540523434 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101319) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 09:48:34.087074 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-6c55ca9c-9a26-443f-9295-6da378b448f0 tempest-ProjectReaderTests39-1540523434 None] About to put_object {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 09:48:34.166177 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-16952a16-edcb-4adf-a3a4-d12a6dc72b77 tempest-VolumesBackupsV39Test-815084545 None] backup MD5 for volume_0600698e-1197-4d21-aefe-cadad145a000/20260703094824/az_nova_backup_c9ad8b37-057e-4c52-a459-b8dbd5e67dfe-00015: 25e317773f308e446cc84c503a6d1f85 {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 09:48:34.166177 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-16952a16-edcb-4adf-a3a4-d12a6dc72b77 tempest-VolumesBackupsV39Test-815084545 None] Calling eventlet.sleep(0) {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 09:48:34.230179 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-6c55ca9c-9a26-443f-9295-6da378b448f0 tempest-ProjectReaderTests39-1540523434 None] backup MD5 for volume_45625dd9-520e-4033-b160-f3175cfdc32a/20260703094827/az_nova_backup_1704ffd8-504c-4b12-adcf-b7f1a0cead28-00011: 25e317773f308e446cc84c503a6d1f85 {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 09:48:34.230327 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-6c55ca9c-9a26-443f-9295-6da378b448f0 tempest-ProjectReaderTests39-1540523434 None] Calling eventlet.sleep(0) {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 09:48:34.410951 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-16952a16-edcb-4adf-a3a4-d12a6dc72b77 tempest-VolumesBackupsV39Test-815084545 None] Backing up chunk of data from volume. {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 09:48:34.484508 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-6c55ca9c-9a26-443f-9295-6da378b448f0 tempest-ProjectReaderTests39-1540523434 None] Backing up chunk of data from volume. {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 09:48:34.660684 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-16952a16-edcb-4adf-a3a4-d12a6dc72b77 tempest-VolumesBackupsV39Test-815084545 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101319) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 09:48:34.660844 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-16952a16-edcb-4adf-a3a4-d12a6dc72b77 tempest-VolumesBackupsV39Test-815084545 None] About to put_object {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 09:48:34.759378 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-6c55ca9c-9a26-443f-9295-6da378b448f0 tempest-ProjectReaderTests39-1540523434 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101319) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 09:48:34.759556 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-6c55ca9c-9a26-443f-9295-6da378b448f0 tempest-ProjectReaderTests39-1540523434 None] About to put_object {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 09:48:34.786886 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-16952a16-edcb-4adf-a3a4-d12a6dc72b77 tempest-VolumesBackupsV39Test-815084545 None] backup MD5 for volume_0600698e-1197-4d21-aefe-cadad145a000/20260703094824/az_nova_backup_c9ad8b37-057e-4c52-a459-b8dbd5e67dfe-00016: 25e317773f308e446cc84c503a6d1f85 {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 09:48:34.787038 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-16952a16-edcb-4adf-a3a4-d12a6dc72b77 tempest-VolumesBackupsV39Test-815084545 None] Calling eventlet.sleep(0) {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 09:48:34.976087 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-6c55ca9c-9a26-443f-9295-6da378b448f0 tempest-ProjectReaderTests39-1540523434 None] backup MD5 for volume_45625dd9-520e-4033-b160-f3175cfdc32a/20260703094827/az_nova_backup_1704ffd8-504c-4b12-adcf-b7f1a0cead28-00012: 25e317773f308e446cc84c503a6d1f85 {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 09:48:34.976336 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-6c55ca9c-9a26-443f-9295-6da378b448f0 tempest-ProjectReaderTests39-1540523434 None] Calling eventlet.sleep(0) {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 09:48:34.981777 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-16952a16-edcb-4adf-a3a4-d12a6dc72b77 tempest-VolumesBackupsV39Test-815084545 None] Backing up chunk of data from volume. {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 09:48:35.168681 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-6c55ca9c-9a26-443f-9295-6da378b448f0 tempest-ProjectReaderTests39-1540523434 None] Backing up chunk of data from volume. {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 09:48:35.242069 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-16952a16-edcb-4adf-a3a4-d12a6dc72b77 tempest-VolumesBackupsV39Test-815084545 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101319) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 09:48:35.242358 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-16952a16-edcb-4adf-a3a4-d12a6dc72b77 tempest-VolumesBackupsV39Test-815084545 None] About to put_object {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 09:48:35.352370 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-16952a16-edcb-4adf-a3a4-d12a6dc72b77 tempest-VolumesBackupsV39Test-815084545 None] backup MD5 for volume_0600698e-1197-4d21-aefe-cadad145a000/20260703094824/az_nova_backup_c9ad8b37-057e-4c52-a459-b8dbd5e67dfe-00017: 25e317773f308e446cc84c503a6d1f85 {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 09:48:35.352547 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-16952a16-edcb-4adf-a3a4-d12a6dc72b77 tempest-VolumesBackupsV39Test-815084545 None] Calling eventlet.sleep(0) {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 09:48:35.449753 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-6c55ca9c-9a26-443f-9295-6da378b448f0 tempest-ProjectReaderTests39-1540523434 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101319) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 09:48:35.449928 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-6c55ca9c-9a26-443f-9295-6da378b448f0 tempest-ProjectReaderTests39-1540523434 None] About to put_object {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 09:48:35.522360 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-16952a16-edcb-4adf-a3a4-d12a6dc72b77 tempest-VolumesBackupsV39Test-815084545 None] Backing up chunk of data from volume. {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 09:48:35.583623 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-6c55ca9c-9a26-443f-9295-6da378b448f0 tempest-ProjectReaderTests39-1540523434 None] backup MD5 for volume_45625dd9-520e-4033-b160-f3175cfdc32a/20260703094827/az_nova_backup_1704ffd8-504c-4b12-adcf-b7f1a0cead28-00013: 25e317773f308e446cc84c503a6d1f85 {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 09:48:35.583787 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-6c55ca9c-9a26-443f-9295-6da378b448f0 tempest-ProjectReaderTests39-1540523434 None] Calling eventlet.sleep(0) {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 09:48:35.779085 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-6c55ca9c-9a26-443f-9295-6da378b448f0 tempest-ProjectReaderTests39-1540523434 None] Backing up chunk of data from volume. {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 09:48:35.865753 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-16952a16-edcb-4adf-a3a4-d12a6dc72b77 tempest-VolumesBackupsV39Test-815084545 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101319) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 09:48:35.865875 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-16952a16-edcb-4adf-a3a4-d12a6dc72b77 tempest-VolumesBackupsV39Test-815084545 None] About to put_object {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 09:48:35.987919 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-16952a16-edcb-4adf-a3a4-d12a6dc72b77 tempest-VolumesBackupsV39Test-815084545 None] backup MD5 for volume_0600698e-1197-4d21-aefe-cadad145a000/20260703094824/az_nova_backup_c9ad8b37-057e-4c52-a459-b8dbd5e67dfe-00018: 25e317773f308e446cc84c503a6d1f85 {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 09:48:35.990541 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-16952a16-edcb-4adf-a3a4-d12a6dc72b77 tempest-VolumesBackupsV39Test-815084545 None] Calling eventlet.sleep(0) {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 09:48:36.040665 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-6c55ca9c-9a26-443f-9295-6da378b448f0 tempest-ProjectReaderTests39-1540523434 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101319) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 09:48:36.040828 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-6c55ca9c-9a26-443f-9295-6da378b448f0 tempest-ProjectReaderTests39-1540523434 None] About to put_object {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 09:48:36.164676 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-6c55ca9c-9a26-443f-9295-6da378b448f0 tempest-ProjectReaderTests39-1540523434 None] backup MD5 for volume_45625dd9-520e-4033-b160-f3175cfdc32a/20260703094827/az_nova_backup_1704ffd8-504c-4b12-adcf-b7f1a0cead28-00014: 25e317773f308e446cc84c503a6d1f85 {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 09:48:36.164892 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-6c55ca9c-9a26-443f-9295-6da378b448f0 tempest-ProjectReaderTests39-1540523434 None] Calling eventlet.sleep(0) {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 09:48:36.169963 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-16952a16-edcb-4adf-a3a4-d12a6dc72b77 tempest-VolumesBackupsV39Test-815084545 None] Backing up chunk of data from volume. {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 09:48:36.371521 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-6c55ca9c-9a26-443f-9295-6da378b448f0 tempest-ProjectReaderTests39-1540523434 None] Backing up chunk of data from volume. {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 09:48:36.451259 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-16952a16-edcb-4adf-a3a4-d12a6dc72b77 tempest-VolumesBackupsV39Test-815084545 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101319) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 09:48:36.451431 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-16952a16-edcb-4adf-a3a4-d12a6dc72b77 tempest-VolumesBackupsV39Test-815084545 None] About to put_object {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 09:48:36.581092 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-16952a16-edcb-4adf-a3a4-d12a6dc72b77 tempest-VolumesBackupsV39Test-815084545 None] backup MD5 for volume_0600698e-1197-4d21-aefe-cadad145a000/20260703094824/az_nova_backup_c9ad8b37-057e-4c52-a459-b8dbd5e67dfe-00019: 25e317773f308e446cc84c503a6d1f85 {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 09:48:36.581092 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-16952a16-edcb-4adf-a3a4-d12a6dc72b77 tempest-VolumesBackupsV39Test-815084545 None] Calling eventlet.sleep(0) {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 09:48:36.625085 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-6c55ca9c-9a26-443f-9295-6da378b448f0 tempest-ProjectReaderTests39-1540523434 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101319) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 09:48:36.625238 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-6c55ca9c-9a26-443f-9295-6da378b448f0 tempest-ProjectReaderTests39-1540523434 None] About to put_object {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 09:48:36.772958 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-16952a16-edcb-4adf-a3a4-d12a6dc72b77 tempest-VolumesBackupsV39Test-815084545 None] Backing up chunk of data from volume. {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 09:48:36.792024 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-6c55ca9c-9a26-443f-9295-6da378b448f0 tempest-ProjectReaderTests39-1540523434 None] backup MD5 for volume_45625dd9-520e-4033-b160-f3175cfdc32a/20260703094827/az_nova_backup_1704ffd8-504c-4b12-adcf-b7f1a0cead28-00015: 25e317773f308e446cc84c503a6d1f85 {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 09:48:36.792183 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-6c55ca9c-9a26-443f-9295-6da378b448f0 tempest-ProjectReaderTests39-1540523434 None] Calling eventlet.sleep(0) {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 09:48:36.989043 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-6c55ca9c-9a26-443f-9295-6da378b448f0 tempest-ProjectReaderTests39-1540523434 None] Backing up chunk of data from volume. {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 09:48:37.040168 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-16952a16-edcb-4adf-a3a4-d12a6dc72b77 tempest-VolumesBackupsV39Test-815084545 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101319) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 09:48:37.040328 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-16952a16-edcb-4adf-a3a4-d12a6dc72b77 tempest-VolumesBackupsV39Test-815084545 None] About to put_object {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 09:48:37.159100 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-16952a16-edcb-4adf-a3a4-d12a6dc72b77 tempest-VolumesBackupsV39Test-815084545 None] backup MD5 for volume_0600698e-1197-4d21-aefe-cadad145a000/20260703094824/az_nova_backup_c9ad8b37-057e-4c52-a459-b8dbd5e67dfe-00020: 25e317773f308e446cc84c503a6d1f85 {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 09:48:37.159100 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-16952a16-edcb-4adf-a3a4-d12a6dc72b77 tempest-VolumesBackupsV39Test-815084545 None] Calling eventlet.sleep(0) {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 09:48:37.256707 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-6c55ca9c-9a26-443f-9295-6da378b448f0 tempest-ProjectReaderTests39-1540523434 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101319) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 09:48:37.257211 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-6c55ca9c-9a26-443f-9295-6da378b448f0 tempest-ProjectReaderTests39-1540523434 None] About to put_object {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 09:48:37.279790 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-16952a16-edcb-4adf-a3a4-d12a6dc72b77 tempest-VolumesBackupsV39Test-815084545 None] Backing up chunk of data from volume. {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 09:48:37.404781 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-6c55ca9c-9a26-443f-9295-6da378b448f0 tempest-ProjectReaderTests39-1540523434 None] backup MD5 for volume_45625dd9-520e-4033-b160-f3175cfdc32a/20260703094827/az_nova_backup_1704ffd8-504c-4b12-adcf-b7f1a0cead28-00016: 25e317773f308e446cc84c503a6d1f85 {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 09:48:37.404971 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-6c55ca9c-9a26-443f-9295-6da378b448f0 tempest-ProjectReaderTests39-1540523434 None] Calling eventlet.sleep(0) {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 09:48:37.427154 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-16952a16-edcb-4adf-a3a4-d12a6dc72b77 tempest-VolumesBackupsV39Test-815084545 None] Compressed 25165824 bytes of data to 24470 bytes using zlib. {{(pid=101319) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 09:48:37.427283 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-16952a16-edcb-4adf-a3a4-d12a6dc72b77 tempest-VolumesBackupsV39Test-815084545 None] About to put_object {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 09:48:37.525564 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-16952a16-edcb-4adf-a3a4-d12a6dc72b77 tempest-VolumesBackupsV39Test-815084545 None] backup MD5 for volume_0600698e-1197-4d21-aefe-cadad145a000/20260703094824/az_nova_backup_c9ad8b37-057e-4c52-a459-b8dbd5e67dfe-00021: 77377273b0a4b61febdbf7bbf52b9db9 {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 09:48:37.525743 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-16952a16-edcb-4adf-a3a4-d12a6dc72b77 tempest-VolumesBackupsV39Test-815084545 None] Calling eventlet.sleep(0) {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 09:48:37.534513 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.driver [None req-16952a16-edcb-4adf-a3a4-d12a6dc72b77 tempest-VolumesBackupsV39Test-815084545 None] Getting metadata type 'volume-base-metadata' {{(pid=101319) _save_vol_base_meta /opt/stack/cinder/cinder/backup/driver.py:79}} Jul 03 09:48:37.545724 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.driver [None req-16952a16-edcb-4adf-a3a4-d12a6dc72b77 tempest-VolumesBackupsV39Test-815084545 None] Completed fetching metadata type 'volume-base-metadata' {{(pid=101319) _save_vol_base_meta /opt/stack/cinder/cinder/backup/driver.py:98}} Jul 03 09:48:37.545724 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.driver [None req-16952a16-edcb-4adf-a3a4-d12a6dc72b77 tempest-VolumesBackupsV39Test-815084545 None] Getting metadata type 'volume-metadata' {{(pid=101319) _save_vol_meta /opt/stack/cinder/cinder/backup/driver.py:109}} Jul 03 09:48:37.549580 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.driver [None req-16952a16-edcb-4adf-a3a4-d12a6dc72b77 tempest-VolumesBackupsV39Test-815084545 None] No metadata type 'volume-metadata' available {{(pid=101319) _save_vol_meta /opt/stack/cinder/cinder/backup/driver.py:123}} Jul 03 09:48:37.549782 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.driver [None req-16952a16-edcb-4adf-a3a4-d12a6dc72b77 tempest-VolumesBackupsV39Test-815084545 None] Getting metadata type 'volume-glance-metadata' {{(pid=101319) _save_vol_glance_meta /opt/stack/cinder/cinder/backup/driver.py:132}} Jul 03 09:48:37.553485 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.driver [None req-16952a16-edcb-4adf-a3a4-d12a6dc72b77 tempest-VolumesBackupsV39Test-815084545 None] No metadata type 'volume-glance-metadata' available {{(pid=101319) _save_vol_glance_meta /opt/stack/cinder/cinder/backup/driver.py:147}} Jul 03 09:48:37.553796 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-16952a16-edcb-4adf-a3a4-d12a6dc72b77 tempest-VolumesBackupsV39Test-815084545 None] _write_sha256file started, container name: tempest-volumesbackupsv39test-backup-container-1091695867, sha256file filename: volume_0600698e-1197-4d21-aefe-cadad145a000/20260703094824/az_nova_backup_c9ad8b37-057e-4c52-a459-b8dbd5e67dfe_sha256file. {{(pid=101319) _write_sha256file /opt/stack/cinder/cinder/backup/chunkeddriver.py:299}} Jul 03 09:48:37.650930 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-6c55ca9c-9a26-443f-9295-6da378b448f0 tempest-ProjectReaderTests39-1540523434 None] Backing up chunk of data from volume. {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 09:48:37.651352 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-16952a16-edcb-4adf-a3a4-d12a6dc72b77 tempest-VolumesBackupsV39Test-815084545 None] _write_sha256file finished. {{(pid=101319) _write_sha256file /opt/stack/cinder/cinder/backup/chunkeddriver.py:315}} Jul 03 09:48:37.652081 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-16952a16-edcb-4adf-a3a4-d12a6dc72b77 tempest-VolumesBackupsV39Test-815084545 None] _write_metadata started, container name: tempest-volumesbackupsv39test-backup-container-1091695867, metadata filename: volume_0600698e-1197-4d21-aefe-cadad145a000/20260703094824/az_nova_backup_c9ad8b37-057e-4c52-a459-b8dbd5e67dfe_metadata. {{(pid=101319) _write_metadata /opt/stack/cinder/cinder/backup/chunkeddriver.py:276}} Jul 03 09:48:37.696314 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-16952a16-edcb-4adf-a3a4-d12a6dc72b77 tempest-VolumesBackupsV39Test-815084545 None] _write_metadata finished. Metadata: b'{\n "backup_description": null,\n "backup_id": "c9ad8b37-057e-4c52-a459-b8dbd5e67dfe",\n "backup_name": "tempest-VolumesBackupsV39Test-Backup-359999758",\n "created_at": "2026-07-03 09:48:21+00:00",\n "objects": [\n {\n "volume_0600698e-1197-4d21-aefe-cadad145a000/20260703094824/az_nova_backup_c9ad8b37-057e-4c52-a459-b8dbd5e67dfe-00001": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 0\n }\n },\n {\n "volume_0600698e-1197-4d21-aefe-cadad145a000/20260703094824/az_nova_backup_c9ad8b37-057e-4c52-a459-b8dbd5e67dfe-00002": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 52428800\n }\n },\n {\n "volume_0600698e-1197-4d21-aefe-cadad145a000/20260703094824/az_nova_backup_c9ad8b37-057e-4c52-a459-b8dbd5e67dfe-00003": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 104857600\n }\n },\n {\n "volume_0600698e-1197-4d21-aefe-cadad145a000/20260703094824/az_nova_backup_c9ad8b37-057e-4c52-a459-b8dbd5e67dfe-00004": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 157286400\n }\n },\n {\n "volume_0600698e-1197-4d21-aefe-cadad145a000/20260703094824/az_nova_backup_c9ad8b37-057e-4c52-a459-b8dbd5e67dfe-00005": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 209715200\n }\n },\n {\n "volume_0600698e-1197-4d21-aefe-cadad145a000/20260703094824/az_nova_backup_c9ad8b37-057e-4c52-a459-b8dbd5e67dfe-00006": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 262144000\n }\n },\n {\n "volume_0600698e-1197-4d21-aefe-cadad145a000/20260703094824/az_nova_backup_c9ad8b37-057e-4c52-a459-b8dbd5e67dfe-00007": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 314572800\n }\n },\n {\n "volume_0600698e-1197-4d21-aefe-cadad145a000/20260703094824/az_nova_backup_c9ad8b37-057e-4c52-a459-b8dbd5e67dfe-00008": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 367001600\n }\n },\n {\n "volume_0600698e-1197-4d21-aefe-cadad145a000/20260703094824/az_nova_backup_c9ad8b37-057e-4c52-a459-b8dbd5e67dfe-00009": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 419430400\n }\n },\n {\n "volume_0600698e-1197-4d21-aefe-cadad145a000/20260703094824/az_nova_backup_c9ad8b37-057e-4c52-a459-b8dbd5e67dfe-00010": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 471859200\n }\n },\n {\n "volume_0600698e-1197-4d21-aefe-cadad145a000/20260703094824/az_nova_backup_c9ad8b37-057e-4c52-a459-b8dbd5e67dfe-00011": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 524288000\n }\n },\n {\n "volume_0600698e-1197-4d21-aefe-cadad145a000/20260703094824/az_nova_backup_c9ad8b37-057e-4c52-a459-b8dbd5e67dfe-00012": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 576716800\n }\n },\n {\n "volume_0600698e-1197-4d21-aefe-cadad145a000/20260703094824/az_nova_backup_c9ad8b37-057e-4c52-a459-b8dbd5e67dfe-00013": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 629145600\n }\n },\n {\n "volume_0600698e-1197-4d21-aefe-cadad145a000/20260703094824/az_nova_backup_c9ad8b37-057e-4c52-a459-b8dbd5e67dfe-00014": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 681574400\n }\n },\n {\n "volume_0600698e-1197-4d21-aefe-cadad145a000/20260703094824/az_nova_backup_c9ad8b37-057e-4c52-a459-b8dbd5e67dfe-00015": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 734003200\n }\n },\n {\n "volume_0600698e-1197-4d21-aefe-cadad145a000/20260703094824/az_nova_backup_c9ad8b37-057e-4c52-a459-b8dbd5e67dfe-00016": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 786432000\n }\n },\n {\n "volume_0600698e-1197-4d21-aefe-cadad145a000/20260703094824/az_nova_backup_c9ad8b37-057e-4c52-a459-b8dbd5e67dfe-00017": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 838860800\n }\n },\n {\n "volume_0600698e-1197-4d21-aefe-cadad145a000/20260703094824/az_nova_backup_c9ad8b37-057e-4c52-a459-b8dbd5e67dfe-00018": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 891289600\n }\n },\n {\n "volume_0600698e-1197-4d21-aefe-cadad145a000/20260703094824/az_nova_backup_c9ad8b37-057e-4c52-a459-b8dbd5e67dfe-00019": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 943718400\n }\n },\n {\n "volume_0600698e-1197-4d21-aefe-cadad145a000/20260703094824/az_nova_backup_c9ad8b37-057e-4c52-a459-b8dbd5e67dfe-00020": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 996147200\n }\n },\n {\n "volume_0600698e-1197-4d21-aefe-cadad145a000/20260703094824/az_nova_backup_c9ad8b37-057e-4c52-a459-b8dbd5e67dfe-00021": {\n "compression": "zlib",\n "length": 25165824,\n "md5": "77377273b0a4b61febdbf7bbf52b9db9",\n "offset": 1048576000\n }\n }\n ],\n "parent_id": null,\n "version": "1.0.0",\n "volume_id": "0600698e-1197-4d21-aefe-cadad145a000",\n "volume_meta": "{\\"version\\": 2, \\"volume-base-metadata\\": {\\"id\\": \\"0600698e-1197-4d21-aefe-cadad145a000\\", \\"_name_id\\": null, \\"use_quota\\": true, \\"ec2_id\\": null, \\"user_id\\": \\"397ed9eb6ae84765a81b8b15ec1b9fb6\\", \\"project_id\\": \\"a163ee758b634041aa04043788fd0787\\", \\"snapshot_id\\": null, \\"cluster_name\\": null, \\"host\\": \\"np0000004400@storpool#default\\", \\"size\\": 1, \\"availability_zone\\": \\"nova\\", \\"status\\": \\"backing-up\\", \\"attach_status\\": \\"detached\\", \\"migration_status\\": null, \\"scheduled_at\\": \\"2026-07-03T09:48:20.000000\\", \\"launched_at\\": \\"2026-07-03T09:48:20.000000\\", \\"terminated_at\\": null, \\"display_name\\": \\"tempest-VolumesBackupsV39Test-Volume-672608313\\", \\"display_description\\": null, \\"provider_location\\": null, \\"provider_auth\\": null, \\"provider_geometry\\": null, \\"provider_id\\": null, \\"volume_type_id\\": \\"03e13fe6-0e30-4803-ace0-725d38e6dc24\\", \\"source_volid\\": null, \\"encryption_key_id\\": null, \\"consistencygroup_id\\": null, \\"group_id\\": null, \\"bootable\\": false, \\"multiattach\\": false, \\"replication_status\\": null, \\"replication_extended_status\\": null, \\"replication_driver_data\\": null, \\"previous_status\\": \\"available\\", \\"service_uuid\\": \\"6d4b0e79-fefe-4744-b25f-34be05095200\\", \\"shared_targets\\": true, \\"deleted_at\\": null, \\"deleted\\": false, \\"created_at\\": \\"2026-07-03T09:48:20.000000\\", \\"updated_at\\": \\"2026-07-03T09:48:21.000000\\"}}"\n}'. {{(pid=101319) _write_metadata /opt/stack/cinder/cinder/backup/chunkeddriver.py:295}} Jul 03 09:48:37.712707 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-16952a16-edcb-4adf-a3a4-d12a6dc72b77 tempest-VolumesBackupsV39Test-815084545 None] backup c9ad8b37-057e-4c52-a459-b8dbd5e67dfe finished. {{(pid=101319) _finalize_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:462}} Jul 03 09:48:37.850858 np0000004400 cinder-backup[101319]: DEBUG oslo_concurrency.processutils [None req-16952a16-edcb-4adf-a3a4-d12a6dc72b77 tempest-VolumesBackupsV39Test-815084545 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chown 0 /dev/sdb {{(pid=101319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 09:48:37.871578 np0000004400 sudo[143509]: stack : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chown 0 /dev/sdb Jul 03 09:48:37.872248 np0000004400 sudo[143509]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1002) Jul 03 09:48:37.920265 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-6c55ca9c-9a26-443f-9295-6da378b448f0 tempest-ProjectReaderTests39-1540523434 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101319) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 09:48:37.920464 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-6c55ca9c-9a26-443f-9295-6da378b448f0 tempest-ProjectReaderTests39-1540523434 None] About to put_object {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 09:48:38.051845 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-6c55ca9c-9a26-443f-9295-6da378b448f0 tempest-ProjectReaderTests39-1540523434 None] backup MD5 for volume_45625dd9-520e-4033-b160-f3175cfdc32a/20260703094827/az_nova_backup_1704ffd8-504c-4b12-adcf-b7f1a0cead28-00017: 25e317773f308e446cc84c503a6d1f85 {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 09:48:38.051985 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-6c55ca9c-9a26-443f-9295-6da378b448f0 tempest-ProjectReaderTests39-1540523434 None] Calling eventlet.sleep(0) {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 09:48:38.198299 np0000004400 sudo[143509]: pam_unix(sudo:session): session closed for user root Jul 03 09:48:38.200680 np0000004400 cinder-backup[101319]: DEBUG oslo_concurrency.processutils [None req-16952a16-edcb-4adf-a3a4-d12a6dc72b77 tempest-VolumesBackupsV39Test-815084545 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chown 0 /dev/sdb" returned: 0 in 0.350s {{(pid=101319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 09:48:38.201155 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-16952a16-edcb-4adf-a3a4-d12a6dc72b77 tempest-VolumesBackupsV39Test-815084545 None] ==> disconnect_volume: call "{'args': (, {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-0600698e-1197-4d21-aefe-cadad145a000', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '0600698e-1197-4d21-aefe-cadad145a000', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': False}, {'type': 'block', 'scsi_wwn': 'SStorPool_iSCSI_DISK_1034578903445799113', 'path': '/dev/sdb'}), 'kwargs': {'force': True, 'ignore_errors': True}}" {{(pid=101319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}} Jul 03 09:48:38.201348 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.base [None req-16952a16-edcb-4adf-a3a4-d12a6dc72b77 tempest-VolumesBackupsV39Test-815084545 None] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=101319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jul 03 09:48:38.201821 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.base [None req-16952a16-edcb-4adf-a3a4-d12a6dc72b77 tempest-VolumesBackupsV39Test-815084545 None] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.000s {{(pid=101319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jul 03 09:48:38.202156 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-16952a16-edcb-4adf-a3a4-d12a6dc72b77 tempest-VolumesBackupsV39Test-815084545 None] _get_connection_devices called with parameters: connection_properties={'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-0600698e-1197-4d21-aefe-cadad145a000', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '0600698e-1197-4d21-aefe-cadad145a000', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': False}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=101319) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:847}} Jul 03 09:48:38.212073 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-16952a16-edcb-4adf-a3a4-d12a6dc72b77 tempest-VolumesBackupsV39Test-815084545 None] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS: Jul 03 09:48:38.212073 np0000004400 cinder-backup[101319]: No targets found. Jul 03 09:48:38.212073 np0000004400 cinder-backup[101319]: iSNS: Jul 03 09:48:38.212073 np0000004400 cinder-backup[101319]: No targets found. Jul 03 09:48:38.212073 np0000004400 cinder-backup[101319]: STATIC: Jul 03 09:48:38.212073 np0000004400 cinder-backup[101319]: Target: iqn.2023-03.storpool.com:os--volume-9d5c4a10-6ade-4a1f-853a-c86139da6207 Jul 03 09:48:38.212073 np0000004400 cinder-backup[101319]: Portal: 192.168.50.100:3260,-1 Jul 03 09:48:38.212073 np0000004400 cinder-backup[101319]: Iface Name: default Jul 03 09:48:38.212073 np0000004400 cinder-backup[101319]: Portal: 192.168.40.100:3260,-1 Jul 03 09:48:38.212073 np0000004400 cinder-backup[101319]: Iface Name: default Jul 03 09:48:38.212073 np0000004400 cinder-backup[101319]: Target: iqn.2023-03.storpool.com:os--volume-45625dd9-520e-4033-b160-f3175cfdc32a Jul 03 09:48:38.212073 np0000004400 cinder-backup[101319]: Portal: 192.168.40.100:3260,-1 Jul 03 09:48:38.212073 np0000004400 cinder-backup[101319]: Iface Name: default Jul 03 09:48:38.212073 np0000004400 cinder-backup[101319]: Target: iqn.2023-03.storpool.com:os--volume-0600698e-1197-4d21-aefe-cadad145a000 Jul 03 09:48:38.212073 np0000004400 cinder-backup[101319]: Portal: 192.168.40.100:3260,-1 Jul 03 09:48:38.212073 np0000004400 cinder-backup[101319]: Iface Name: default Jul 03 09:48:38.212073 np0000004400 cinder-backup[101319]: FIRMWARE: Jul 03 09:48:38.212073 np0000004400 cinder-backup[101319]: No targets found. Jul 03 09:48:38.212073 np0000004400 cinder-backup[101319]: stderr= {{(pid=101319) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jul 03 09:48:38.212503 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-16952a16-edcb-4adf-a3a4-d12a6dc72b77 tempest-VolumesBackupsV39Test-815084545 None] Regex to get portals from discoverydb: ^SENDTARGETS: Jul 03 09:48:38.212503 np0000004400 cinder-backup[101319]: .*?^DiscoveryAddress: 192.168.40.100,3260.*? Jul 03 09:48:38.212503 np0000004400 cinder-backup[101319]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=101319) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:390}} Jul 03 09:48:38.212593 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-16952a16-edcb-4adf-a3a4-d12a6dc72b77 tempest-VolumesBackupsV39Test-815084545 None] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-0600698e-1197-4d21-aefe-cadad145a000', 0)] {{(pid=101319) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:858}} Jul 03 09:48:38.234084 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-16952a16-edcb-4adf-a3a4-d12a6dc72b77 tempest-VolumesBackupsV39Test-815084545 None] iscsiadm ('-m', 'session'): stdout=tcp: [139] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0600698e-1197-4d21-aefe-cadad145a000 (non-flash) Jul 03 09:48:38.234084 np0000004400 cinder-backup[101319]: tcp: [140] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-45625dd9-520e-4033-b160-f3175cfdc32a (non-flash) Jul 03 09:48:38.234084 np0000004400 cinder-backup[101319]: tcp: [141] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9d5c4a10-6ade-4a1f-853a-c86139da6207 (non-flash) Jul 03 09:48:38.234084 np0000004400 cinder-backup[101319]: tcp: [142] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9d5c4a10-6ade-4a1f-853a-c86139da6207 (non-flash) Jul 03 09:48:38.234084 np0000004400 cinder-backup[101319]: stderr= {{(pid=101319) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jul 03 09:48:38.234260 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-16952a16-edcb-4adf-a3a4-d12a6dc72b77 tempest-VolumesBackupsV39Test-815084545 None] iscsi session list stdout=tcp: [139] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0600698e-1197-4d21-aefe-cadad145a000 (non-flash) Jul 03 09:48:38.234260 np0000004400 cinder-backup[101319]: tcp: [140] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-45625dd9-520e-4033-b160-f3175cfdc32a (non-flash) Jul 03 09:48:38.234260 np0000004400 cinder-backup[101319]: tcp: [141] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9d5c4a10-6ade-4a1f-853a-c86139da6207 (non-flash) Jul 03 09:48:38.234260 np0000004400 cinder-backup[101319]: tcp: [142] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9d5c4a10-6ade-4a1f-853a-c86139da6207 (non-flash) Jul 03 09:48:38.234260 np0000004400 cinder-backup[101319]: stderr= {{(pid=101319) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jul 03 09:48:38.234516 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-16952a16-edcb-4adf-a3a4-d12a6dc72b77 tempest-VolumesBackupsV39Test-815084545 None] Sessions list: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-0600698e-1197-4d21-aefe-cadad145a000', '139'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-45625dd9-520e-4033-b160-f3175cfdc32a', '140'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-9d5c4a10-6ade-4a1f-853a-c86139da6207', '141'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-9d5c4a10-6ade-4a1f-853a-c86139da6207', '142')] {{(pid=101319) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:866}} Jul 03 09:48:38.234726 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-16952a16-edcb-4adf-a3a4-d12a6dc72b77 tempest-VolumesBackupsV39Test-815084545 None] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-0600698e-1197-4d21-aefe-cadad145a000, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-0600698e-1197-4d21-aefe-cadad145a000', '139')] {{(pid=101319) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}} Jul 03 09:48:38.236000 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-16952a16-edcb-4adf-a3a4-d12a6dc72b77 tempest-VolumesBackupsV39Test-815084545 None] Resulting device map defaultdict(. at 0x7e7705874040>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-0600698e-1197-4d21-aefe-cadad145a000'): ({'sdb'}, set())}) {{(pid=101319) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:912}} Jul 03 09:48:38.236290 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.linuxscsi [None req-16952a16-edcb-4adf-a3a4-d12a6dc72b77 tempest-VolumesBackupsV39Test-815084545 None] Removing single pathed devices sdb {{(pid=101319) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}} Jul 03 09:48:38.245376 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-6c55ca9c-9a26-443f-9295-6da378b448f0 tempest-ProjectReaderTests39-1540523434 None] Backing up chunk of data from volume. {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 09:48:38.246303 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.linuxscsi [None req-16952a16-edcb-4adf-a3a4-d12a6dc72b77 tempest-VolumesBackupsV39Test-815084545 None] Flushing IO for device /dev/sdb {{(pid=101319) flush_device_io /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:461}} Jul 03 09:48:38.257498 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.linuxscsi [None req-16952a16-edcb-4adf-a3a4-d12a6dc72b77 tempest-VolumesBackupsV39Test-815084545 None] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=101319) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}} Jul 03 09:48:38.313841 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.linuxscsi [None req-16952a16-edcb-4adf-a3a4-d12a6dc72b77 tempest-VolumesBackupsV39Test-815084545 None] Checking to see if SCSI volumes sdb have been removed. {{(pid=101319) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}} Jul 03 09:48:38.314020 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.linuxscsi [None req-16952a16-edcb-4adf-a3a4-d12a6dc72b77 tempest-VolumesBackupsV39Test-815084545 None] SCSI volumes sdb have been removed. {{(pid=101319) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}} Jul 03 09:48:38.314870 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.linuxscsi [None req-16952a16-edcb-4adf-a3a4-d12a6dc72b77 tempest-VolumesBackupsV39Test-815084545 None] Checking to see if device paths {'sdb'} are still under multipathd monitoring {{(pid=101319) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}} Jul 03 09:48:38.327438 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.linuxscsi [None req-16952a16-edcb-4adf-a3a4-d12a6dc72b77 tempest-VolumesBackupsV39Test-815084545 None] Device paths {'sdb'} have been removed from multipathd monitoring. {{(pid=101319) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}} Jul 03 09:48:38.327762 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-16952a16-edcb-4adf-a3a4-d12a6dc72b77 tempest-VolumesBackupsV39Test-815084545 None] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-0600698e-1197-4d21-aefe-cadad145a000')] {{(pid=101319) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1225}} Jul 03 09:48:38.339723 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-16952a16-edcb-4adf-a3a4-d12a6dc72b77 tempest-VolumesBackupsV39Test-815084545 None] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=101319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 03 09:48:38.380574 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-16952a16-edcb-4adf-a3a4-d12a6dc72b77 tempest-VolumesBackupsV39Test-815084545 None] iscsiadm ('--logout',): stdout=Logging out of session [sid: 139, target: iqn.2023-03.storpool.com:os--volume-0600698e-1197-4d21-aefe-cadad145a000, portal: 192.168.40.100,3260] Jul 03 09:48:38.380574 np0000004400 cinder-backup[101319]: Logout of [sid: 139, target: iqn.2023-03.storpool.com:os--volume-0600698e-1197-4d21-aefe-cadad145a000, portal: 192.168.40.100,3260] successful. Jul 03 09:48:38.380574 np0000004400 cinder-backup[101319]: stderr= {{(pid=101319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 03 09:48:38.396257 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-16952a16-edcb-4adf-a3a4-d12a6dc72b77 tempest-VolumesBackupsV39Test-815084545 None] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=101319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 03 09:48:38.396531 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.base [None req-16952a16-edcb-4adf-a3a4-d12a6dc72b77 tempest-VolumesBackupsV39Test-815084545 None] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.195s {{(pid=101319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jul 03 09:48:38.396675 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-16952a16-edcb-4adf-a3a4-d12a6dc72b77 tempest-VolumesBackupsV39Test-815084545 None] <== disconnect_volume: return (195ms) None {{(pid=101319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}} Jul 03 09:48:38.499573 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-6c55ca9c-9a26-443f-9295-6da378b448f0 tempest-ProjectReaderTests39-1540523434 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101319) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 09:48:38.499811 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-6c55ca9c-9a26-443f-9295-6da378b448f0 tempest-ProjectReaderTests39-1540523434 None] About to put_object {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 09:48:38.629533 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-6c55ca9c-9a26-443f-9295-6da378b448f0 tempest-ProjectReaderTests39-1540523434 None] backup MD5 for volume_45625dd9-520e-4033-b160-f3175cfdc32a/20260703094827/az_nova_backup_1704ffd8-504c-4b12-adcf-b7f1a0cead28-00018: 25e317773f308e446cc84c503a6d1f85 {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 09:48:38.629722 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-6c55ca9c-9a26-443f-9295-6da378b448f0 tempest-ProjectReaderTests39-1540523434 None] Calling eventlet.sleep(0) {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 09:48:38.823693 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-6c55ca9c-9a26-443f-9295-6da378b448f0 tempest-ProjectReaderTests39-1540523434 None] Backing up chunk of data from volume. {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 09:48:39.089122 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-6c55ca9c-9a26-443f-9295-6da378b448f0 tempest-ProjectReaderTests39-1540523434 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101319) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 09:48:39.089122 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-6c55ca9c-9a26-443f-9295-6da378b448f0 tempest-ProjectReaderTests39-1540523434 None] About to put_object {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 09:48:39.203501 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-6c55ca9c-9a26-443f-9295-6da378b448f0 tempest-ProjectReaderTests39-1540523434 None] backup MD5 for volume_45625dd9-520e-4033-b160-f3175cfdc32a/20260703094827/az_nova_backup_1704ffd8-504c-4b12-adcf-b7f1a0cead28-00019: 25e317773f308e446cc84c503a6d1f85 {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 09:48:39.203622 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-6c55ca9c-9a26-443f-9295-6da378b448f0 tempest-ProjectReaderTests39-1540523434 None] Calling eventlet.sleep(0) {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 09:48:39.423203 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-6c55ca9c-9a26-443f-9295-6da378b448f0 tempest-ProjectReaderTests39-1540523434 None] Backing up chunk of data from volume. {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 09:48:39.438592 np0000004400 cinder-backup[101319]: INFO cinder.backup.manager [None req-16952a16-edcb-4adf-a3a4-d12a6dc72b77 tempest-VolumesBackupsV39Test-815084545 None] Create backup finished. backup: c9ad8b37-057e-4c52-a459-b8dbd5e67dfe. Jul 03 09:48:39.672954 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-6c55ca9c-9a26-443f-9295-6da378b448f0 tempest-ProjectReaderTests39-1540523434 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101319) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 09:48:39.673114 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-6c55ca9c-9a26-443f-9295-6da378b448f0 tempest-ProjectReaderTests39-1540523434 None] About to put_object {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 09:48:39.799643 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-6c55ca9c-9a26-443f-9295-6da378b448f0 tempest-ProjectReaderTests39-1540523434 None] backup MD5 for volume_45625dd9-520e-4033-b160-f3175cfdc32a/20260703094827/az_nova_backup_1704ffd8-504c-4b12-adcf-b7f1a0cead28-00020: 25e317773f308e446cc84c503a6d1f85 {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 09:48:39.799794 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-6c55ca9c-9a26-443f-9295-6da378b448f0 tempest-ProjectReaderTests39-1540523434 None] Calling eventlet.sleep(0) {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 09:48:39.909355 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-6c55ca9c-9a26-443f-9295-6da378b448f0 tempest-ProjectReaderTests39-1540523434 None] Backing up chunk of data from volume. {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 09:48:40.024990 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-6c55ca9c-9a26-443f-9295-6da378b448f0 tempest-ProjectReaderTests39-1540523434 None] Compressed 25165824 bytes of data to 24470 bytes using zlib. {{(pid=101319) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 09:48:40.025101 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-6c55ca9c-9a26-443f-9295-6da378b448f0 tempest-ProjectReaderTests39-1540523434 None] About to put_object {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 09:48:40.110938 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-6c55ca9c-9a26-443f-9295-6da378b448f0 tempest-ProjectReaderTests39-1540523434 None] backup MD5 for volume_45625dd9-520e-4033-b160-f3175cfdc32a/20260703094827/az_nova_backup_1704ffd8-504c-4b12-adcf-b7f1a0cead28-00021: 77377273b0a4b61febdbf7bbf52b9db9 {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 09:48:40.111091 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-6c55ca9c-9a26-443f-9295-6da378b448f0 tempest-ProjectReaderTests39-1540523434 None] Calling eventlet.sleep(0) {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 09:48:40.118369 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.driver [None req-6c55ca9c-9a26-443f-9295-6da378b448f0 tempest-ProjectReaderTests39-1540523434 None] Getting metadata type 'volume-base-metadata' {{(pid=101319) _save_vol_base_meta /opt/stack/cinder/cinder/backup/driver.py:79}} Jul 03 09:48:40.128354 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.driver [None req-6c55ca9c-9a26-443f-9295-6da378b448f0 tempest-ProjectReaderTests39-1540523434 None] Completed fetching metadata type 'volume-base-metadata' {{(pid=101319) _save_vol_base_meta /opt/stack/cinder/cinder/backup/driver.py:98}} Jul 03 09:48:40.128634 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.driver [None req-6c55ca9c-9a26-443f-9295-6da378b448f0 tempest-ProjectReaderTests39-1540523434 None] Getting metadata type 'volume-metadata' {{(pid=101319) _save_vol_meta /opt/stack/cinder/cinder/backup/driver.py:109}} Jul 03 09:48:40.134347 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.driver [None req-6c55ca9c-9a26-443f-9295-6da378b448f0 tempest-ProjectReaderTests39-1540523434 None] No metadata type 'volume-metadata' available {{(pid=101319) _save_vol_meta /opt/stack/cinder/cinder/backup/driver.py:123}} Jul 03 09:48:40.134601 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.driver [None req-6c55ca9c-9a26-443f-9295-6da378b448f0 tempest-ProjectReaderTests39-1540523434 None] Getting metadata type 'volume-glance-metadata' {{(pid=101319) _save_vol_glance_meta /opt/stack/cinder/cinder/backup/driver.py:132}} Jul 03 09:48:40.139015 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.driver [None req-6c55ca9c-9a26-443f-9295-6da378b448f0 tempest-ProjectReaderTests39-1540523434 None] No metadata type 'volume-glance-metadata' available {{(pid=101319) _save_vol_glance_meta /opt/stack/cinder/cinder/backup/driver.py:147}} Jul 03 09:48:40.139373 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-6c55ca9c-9a26-443f-9295-6da378b448f0 tempest-ProjectReaderTests39-1540523434 None] _write_sha256file started, container name: volumebackups, sha256file filename: volume_45625dd9-520e-4033-b160-f3175cfdc32a/20260703094827/az_nova_backup_1704ffd8-504c-4b12-adcf-b7f1a0cead28_sha256file. {{(pid=101319) _write_sha256file /opt/stack/cinder/cinder/backup/chunkeddriver.py:299}} Jul 03 09:48:40.191091 np0000004400 cinder-backup[101319]: INFO cinder.backup.manager [None req-2ab525ed-64b7-405a-8dfa-110c5d18ee25 tempest-VolumesBackupsV39Test-815084545 None] Delete backup started, backup: c9ad8b37-057e-4c52-a459-b8dbd5e67dfe. Jul 03 09:48:40.195888 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.drivers.swift [None req-2ab525ed-64b7-405a-8dfa-110c5d18ee25 tempest-VolumesBackupsV39Test-815084545 None] Using swift URL https://10.4.3.95:8080/v1/AUTH_a163ee758b634041aa04043788fd0787 {{(pid=101319) initialize /opt/stack/cinder/cinder/backup/drivers/swift.py:300}} Jul 03 09:48:40.196466 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.drivers.swift [None req-2ab525ed-64b7-405a-8dfa-110c5d18ee25 tempest-VolumesBackupsV39Test-815084545 None] Connect to https://10.4.3.95:8080/v1/AUTH_ in "per_user" mode {{(pid=101319) initialize /opt/stack/cinder/cinder/backup/drivers/swift.py:301}} Jul 03 09:48:40.196579 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-2ab525ed-64b7-405a-8dfa-110c5d18ee25 tempest-VolumesBackupsV39Test-815084545 None] delete started, backup: c9ad8b37-057e-4c52-a459-b8dbd5e67dfe, container: tempest-volumesbackupsv39test-backup-container-1091695867, prefix: volume_0600698e-1197-4d21-aefe-cadad145a000/20260703094824/az_nova_backup_c9ad8b37-057e-4c52-a459-b8dbd5e67dfe. {{(pid=101319) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:822}} Jul 03 09:48:40.236804 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-6c55ca9c-9a26-443f-9295-6da378b448f0 tempest-ProjectReaderTests39-1540523434 None] _write_sha256file finished. {{(pid=101319) _write_sha256file /opt/stack/cinder/cinder/backup/chunkeddriver.py:315}} Jul 03 09:48:40.237347 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-6c55ca9c-9a26-443f-9295-6da378b448f0 tempest-ProjectReaderTests39-1540523434 None] _write_metadata started, container name: volumebackups, metadata filename: volume_45625dd9-520e-4033-b160-f3175cfdc32a/20260703094827/az_nova_backup_1704ffd8-504c-4b12-adcf-b7f1a0cead28_metadata. {{(pid=101319) _write_metadata /opt/stack/cinder/cinder/backup/chunkeddriver.py:276}} Jul 03 09:48:40.303619 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-2ab525ed-64b7-405a-8dfa-110c5d18ee25 tempest-VolumesBackupsV39Test-815084545 None] generated object list: ['volume_0600698e-1197-4d21-aefe-cadad145a000/20260703094824/az_nova_backup_c9ad8b37-057e-4c52-a459-b8dbd5e67dfe-00001', 'volume_0600698e-1197-4d21-aefe-cadad145a000/20260703094824/az_nova_backup_c9ad8b37-057e-4c52-a459-b8dbd5e67dfe-00002', 'volume_0600698e-1197-4d21-aefe-cadad145a000/20260703094824/az_nova_backup_c9ad8b37-057e-4c52-a459-b8dbd5e67dfe-00003', 'volume_0600698e-1197-4d21-aefe-cadad145a000/20260703094824/az_nova_backup_c9ad8b37-057e-4c52-a459-b8dbd5e67dfe-00004', 'volume_0600698e-1197-4d21-aefe-cadad145a000/20260703094824/az_nova_backup_c9ad8b37-057e-4c52-a459-b8dbd5e67dfe-00005', 'volume_0600698e-1197-4d21-aefe-cadad145a000/20260703094824/az_nova_backup_c9ad8b37-057e-4c52-a459-b8dbd5e67dfe-00006', 'volume_0600698e-1197-4d21-aefe-cadad145a000/20260703094824/az_nova_backup_c9ad8b37-057e-4c52-a459-b8dbd5e67dfe-00007', 'volume_0600698e-1197-4d21-aefe-cadad145a000/20260703094824/az_nova_backup_c9ad8b37-057e-4c52-a459-b8dbd5e67dfe-00008', 'volume_0600698e-1197-4d21-aefe-cadad145a000/20260703094824/az_nova_backup_c9ad8b37-057e-4c52-a459-b8dbd5e67dfe-00009', 'volume_0600698e-1197-4d21-aefe-cadad145a000/20260703094824/az_nova_backup_c9ad8b37-057e-4c52-a459-b8dbd5e67dfe-00010', 'volume_0600698e-1197-4d21-aefe-cadad145a000/20260703094824/az_nova_backup_c9ad8b37-057e-4c52-a459-b8dbd5e67dfe-00011', 'volume_0600698e-1197-4d21-aefe-cadad145a000/20260703094824/az_nova_backup_c9ad8b37-057e-4c52-a459-b8dbd5e67dfe-00012', 'volume_0600698e-1197-4d21-aefe-cadad145a000/20260703094824/az_nova_backup_c9ad8b37-057e-4c52-a459-b8dbd5e67dfe-00013', 'volume_0600698e-1197-4d21-aefe-cadad145a000/20260703094824/az_nova_backup_c9ad8b37-057e-4c52-a459-b8dbd5e67dfe-00014', 'volume_0600698e-1197-4d21-aefe-cadad145a000/20260703094824/az_nova_backup_c9ad8b37-057e-4c52-a459-b8dbd5e67dfe-00015', 'volume_0600698e-1197-4d21-aefe-cadad145a000/20260703094824/az_nova_backup_c9ad8b37-057e-4c52-a459-b8dbd5e67dfe-00016', 'volume_0600698e-1197-4d21-aefe-cadad145a000/20260703094824/az_nova_backup_c9ad8b37-057e-4c52-a459-b8dbd5e67dfe-00017', 'volume_0600698e-1197-4d21-aefe-cadad145a000/20260703094824/az_nova_backup_c9ad8b37-057e-4c52-a459-b8dbd5e67dfe-00018', 'volume_0600698e-1197-4d21-aefe-cadad145a000/20260703094824/az_nova_backup_c9ad8b37-057e-4c52-a459-b8dbd5e67dfe-00019', 'volume_0600698e-1197-4d21-aefe-cadad145a000/20260703094824/az_nova_backup_c9ad8b37-057e-4c52-a459-b8dbd5e67dfe-00020', 'volume_0600698e-1197-4d21-aefe-cadad145a000/20260703094824/az_nova_backup_c9ad8b37-057e-4c52-a459-b8dbd5e67dfe-00021', 'volume_0600698e-1197-4d21-aefe-cadad145a000/20260703094824/az_nova_backup_c9ad8b37-057e-4c52-a459-b8dbd5e67dfe_metadata', 'volume_0600698e-1197-4d21-aefe-cadad145a000/20260703094824/az_nova_backup_c9ad8b37-057e-4c52-a459-b8dbd5e67dfe_sha256file']. {{(pid=101319) _generate_object_names /opt/stack/cinder/cinder/backup/chunkeddriver.py:260}} Jul 03 09:48:40.304784 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-6c55ca9c-9a26-443f-9295-6da378b448f0 tempest-ProjectReaderTests39-1540523434 None] _write_metadata finished. Metadata: b'{\n "backup_description": null,\n "backup_id": "1704ffd8-504c-4b12-adcf-b7f1a0cead28",\n "backup_name": "tempest-type-Backup-1224812444",\n "created_at": "2026-07-03 09:48:22+00:00",\n "objects": [\n {\n "volume_45625dd9-520e-4033-b160-f3175cfdc32a/20260703094827/az_nova_backup_1704ffd8-504c-4b12-adcf-b7f1a0cead28-00001": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 0\n }\n },\n {\n "volume_45625dd9-520e-4033-b160-f3175cfdc32a/20260703094827/az_nova_backup_1704ffd8-504c-4b12-adcf-b7f1a0cead28-00002": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 52428800\n }\n },\n {\n "volume_45625dd9-520e-4033-b160-f3175cfdc32a/20260703094827/az_nova_backup_1704ffd8-504c-4b12-adcf-b7f1a0cead28-00003": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 104857600\n }\n },\n {\n "volume_45625dd9-520e-4033-b160-f3175cfdc32a/20260703094827/az_nova_backup_1704ffd8-504c-4b12-adcf-b7f1a0cead28-00004": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 157286400\n }\n },\n {\n "volume_45625dd9-520e-4033-b160-f3175cfdc32a/20260703094827/az_nova_backup_1704ffd8-504c-4b12-adcf-b7f1a0cead28-00005": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 209715200\n }\n },\n {\n "volume_45625dd9-520e-4033-b160-f3175cfdc32a/20260703094827/az_nova_backup_1704ffd8-504c-4b12-adcf-b7f1a0cead28-00006": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 262144000\n }\n },\n {\n "volume_45625dd9-520e-4033-b160-f3175cfdc32a/20260703094827/az_nova_backup_1704ffd8-504c-4b12-adcf-b7f1a0cead28-00007": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 314572800\n }\n },\n {\n "volume_45625dd9-520e-4033-b160-f3175cfdc32a/20260703094827/az_nova_backup_1704ffd8-504c-4b12-adcf-b7f1a0cead28-00008": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 367001600\n }\n },\n {\n "volume_45625dd9-520e-4033-b160-f3175cfdc32a/20260703094827/az_nova_backup_1704ffd8-504c-4b12-adcf-b7f1a0cead28-00009": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 419430400\n }\n },\n {\n "volume_45625dd9-520e-4033-b160-f3175cfdc32a/20260703094827/az_nova_backup_1704ffd8-504c-4b12-adcf-b7f1a0cead28-00010": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 471859200\n }\n },\n {\n "volume_45625dd9-520e-4033-b160-f3175cfdc32a/20260703094827/az_nova_backup_1704ffd8-504c-4b12-adcf-b7f1a0cead28-00011": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 524288000\n }\n },\n {\n "volume_45625dd9-520e-4033-b160-f3175cfdc32a/20260703094827/az_nova_backup_1704ffd8-504c-4b12-adcf-b7f1a0cead28-00012": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 576716800\n }\n },\n {\n "volume_45625dd9-520e-4033-b160-f3175cfdc32a/20260703094827/az_nova_backup_1704ffd8-504c-4b12-adcf-b7f1a0cead28-00013": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 629145600\n }\n },\n {\n "volume_45625dd9-520e-4033-b160-f3175cfdc32a/20260703094827/az_nova_backup_1704ffd8-504c-4b12-adcf-b7f1a0cead28-00014": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 681574400\n }\n },\n {\n "volume_45625dd9-520e-4033-b160-f3175cfdc32a/20260703094827/az_nova_backup_1704ffd8-504c-4b12-adcf-b7f1a0cead28-00015": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 734003200\n }\n },\n {\n "volume_45625dd9-520e-4033-b160-f3175cfdc32a/20260703094827/az_nova_backup_1704ffd8-504c-4b12-adcf-b7f1a0cead28-00016": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 786432000\n }\n },\n {\n "volume_45625dd9-520e-4033-b160-f3175cfdc32a/20260703094827/az_nova_backup_1704ffd8-504c-4b12-adcf-b7f1a0cead28-00017": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 838860800\n }\n },\n {\n "volume_45625dd9-520e-4033-b160-f3175cfdc32a/20260703094827/az_nova_backup_1704ffd8-504c-4b12-adcf-b7f1a0cead28-00018": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 891289600\n }\n },\n {\n "volume_45625dd9-520e-4033-b160-f3175cfdc32a/20260703094827/az_nova_backup_1704ffd8-504c-4b12-adcf-b7f1a0cead28-00019": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 943718400\n }\n },\n {\n "volume_45625dd9-520e-4033-b160-f3175cfdc32a/20260703094827/az_nova_backup_1704ffd8-504c-4b12-adcf-b7f1a0cead28-00020": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 996147200\n }\n },\n {\n "volume_45625dd9-520e-4033-b160-f3175cfdc32a/20260703094827/az_nova_backup_1704ffd8-504c-4b12-adcf-b7f1a0cead28-00021": {\n "compression": "zlib",\n "length": 25165824,\n "md5": "77377273b0a4b61febdbf7bbf52b9db9",\n "offset": 1048576000\n }\n }\n ],\n "parent_id": null,\n "version": "1.0.0",\n "volume_id": "45625dd9-520e-4033-b160-f3175cfdc32a",\n "volume_meta": "{\\"version\\": 2, \\"volume-base-metadata\\": {\\"id\\": \\"45625dd9-520e-4033-b160-f3175cfdc32a\\", \\"_name_id\\": null, \\"use_quota\\": true, \\"ec2_id\\": null, \\"user_id\\": \\"b6d990452d324a66a307cc4e39b454d4\\", \\"project_id\\": \\"ff0cd0be3a0a4eb083a7aed4c49f30ea\\", \\"snapshot_id\\": null, \\"cluster_name\\": null, \\"host\\": \\"np0000004400@storpool#default\\", \\"size\\": 1, \\"availability_zone\\": \\"nova\\", \\"status\\": \\"backing-up\\", \\"attach_status\\": \\"detached\\", \\"migration_status\\": null, \\"scheduled_at\\": \\"2026-07-03T09:48:21.000000\\", \\"launched_at\\": \\"2026-07-03T09:48:21.000000\\", \\"terminated_at\\": null, \\"display_name\\": \\"tempest-VolumeV3RbacBaseTests-Volume-2046907653\\", \\"display_description\\": null, \\"provider_location\\": null, \\"provider_auth\\": null, \\"provider_geometry\\": null, \\"provider_id\\": null, \\"volume_type_id\\": \\"03e13fe6-0e30-4803-ace0-725d38e6dc24\\", \\"source_volid\\": null, \\"encryption_key_id\\": null, \\"consistencygroup_id\\": null, \\"group_id\\": null, \\"bootable\\": false, \\"multiattach\\": false, \\"replication_status\\": null, \\"replication_extended_status\\": null, \\"replication_driver_data\\": null, \\"previous_status\\": \\"available\\", \\"service_uuid\\": \\"6d4b0e79-fefe-4744-b25f-34be05095200\\", \\"shared_targets\\": true, \\"deleted_at\\": null, \\"deleted\\": false, \\"created_at\\": \\"2026-07-03T09:48:21.000000\\", \\"updated_at\\": \\"2026-07-03T09:48:22.000000\\"}}"\n}'. {{(pid=101319) _write_metadata /opt/stack/cinder/cinder/backup/chunkeddriver.py:295}} Jul 03 09:48:40.344660 np0000004400 cinder-backup[101319]: DEBUG oslo_db.sqlalchemy.engines [None req-6c55ca9c-9a26-443f-9295-6da378b448f0 tempest-ProjectReaderTests39-1540523434 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=101319) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 03 09:48:40.368686 np0000004400 cinder-backup[101319]: DEBUG oslo_service.periodic_task [None req-ffd932d2-122c-4e68-b5ba-628aff7ae7b8 None None] Running periodic task BackupManager.publish_service_capabilities {{(pid=101319) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 03 09:48:40.368941 np0000004400 cinder-backup[101319]: DEBUG cinder.manager [None req-ffd932d2-122c-4e68-b5ba-628aff7ae7b8 None None] Notifying Schedulers of capabilities ... {{(pid=101319) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 03 09:48:40.371154 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-2ab525ed-64b7-405a-8dfa-110c5d18ee25 tempest-VolumesBackupsV39Test-815084545 None] deleted object: volume_0600698e-1197-4d21-aefe-cadad145a000/20260703094824/az_nova_backup_c9ad8b37-057e-4c52-a459-b8dbd5e67dfe-00001 in container: tempest-volumesbackupsv39test-backup-container-1091695867. {{(pid=101319) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 09:48:40.375623 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-6c55ca9c-9a26-443f-9295-6da378b448f0 tempest-ProjectReaderTests39-1540523434 None] backup 1704ffd8-504c-4b12-adcf-b7f1a0cead28 finished. {{(pid=101319) _finalize_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:462}} Jul 03 09:48:40.509504 np0000004400 cinder-backup[101319]: DEBUG oslo_concurrency.processutils [None req-6c55ca9c-9a26-443f-9295-6da378b448f0 tempest-ProjectReaderTests39-1540523434 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chown 0 /dev/sdc {{(pid=101319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 09:48:40.533604 np0000004400 sudo[143553]: stack : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chown 0 /dev/sdc Jul 03 09:48:40.534499 np0000004400 sudo[143553]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1002) Jul 03 09:48:40.547734 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-2ab525ed-64b7-405a-8dfa-110c5d18ee25 tempest-VolumesBackupsV39Test-815084545 None] deleted object: volume_0600698e-1197-4d21-aefe-cadad145a000/20260703094824/az_nova_backup_c9ad8b37-057e-4c52-a459-b8dbd5e67dfe-00002 in container: tempest-volumesbackupsv39test-backup-container-1091695867. {{(pid=101319) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 09:48:40.576185 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-2ab525ed-64b7-405a-8dfa-110c5d18ee25 tempest-VolumesBackupsV39Test-815084545 None] deleted object: volume_0600698e-1197-4d21-aefe-cadad145a000/20260703094824/az_nova_backup_c9ad8b37-057e-4c52-a459-b8dbd5e67dfe-00003 in container: tempest-volumesbackupsv39test-backup-container-1091695867. {{(pid=101319) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 09:48:40.607240 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-2ab525ed-64b7-405a-8dfa-110c5d18ee25 tempest-VolumesBackupsV39Test-815084545 None] deleted object: volume_0600698e-1197-4d21-aefe-cadad145a000/20260703094824/az_nova_backup_c9ad8b37-057e-4c52-a459-b8dbd5e67dfe-00004 in container: tempest-volumesbackupsv39test-backup-container-1091695867. {{(pid=101319) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 09:48:40.658713 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-2ab525ed-64b7-405a-8dfa-110c5d18ee25 tempest-VolumesBackupsV39Test-815084545 None] deleted object: volume_0600698e-1197-4d21-aefe-cadad145a000/20260703094824/az_nova_backup_c9ad8b37-057e-4c52-a459-b8dbd5e67dfe-00005 in container: tempest-volumesbackupsv39test-backup-container-1091695867. {{(pid=101319) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 09:48:40.705657 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-2ab525ed-64b7-405a-8dfa-110c5d18ee25 tempest-VolumesBackupsV39Test-815084545 None] deleted object: volume_0600698e-1197-4d21-aefe-cadad145a000/20260703094824/az_nova_backup_c9ad8b37-057e-4c52-a459-b8dbd5e67dfe-00006 in container: tempest-volumesbackupsv39test-backup-container-1091695867. {{(pid=101319) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 09:48:40.736760 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-2ab525ed-64b7-405a-8dfa-110c5d18ee25 tempest-VolumesBackupsV39Test-815084545 None] deleted object: volume_0600698e-1197-4d21-aefe-cadad145a000/20260703094824/az_nova_backup_c9ad8b37-057e-4c52-a459-b8dbd5e67dfe-00007 in container: tempest-volumesbackupsv39test-backup-container-1091695867. {{(pid=101319) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 09:48:40.772744 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-2ab525ed-64b7-405a-8dfa-110c5d18ee25 tempest-VolumesBackupsV39Test-815084545 None] deleted object: volume_0600698e-1197-4d21-aefe-cadad145a000/20260703094824/az_nova_backup_c9ad8b37-057e-4c52-a459-b8dbd5e67dfe-00008 in container: tempest-volumesbackupsv39test-backup-container-1091695867. {{(pid=101319) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 09:48:40.816496 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-2ab525ed-64b7-405a-8dfa-110c5d18ee25 tempest-VolumesBackupsV39Test-815084545 None] deleted object: volume_0600698e-1197-4d21-aefe-cadad145a000/20260703094824/az_nova_backup_c9ad8b37-057e-4c52-a459-b8dbd5e67dfe-00009 in container: tempest-volumesbackupsv39test-backup-container-1091695867. {{(pid=101319) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 09:48:40.839962 np0000004400 sudo[143553]: pam_unix(sudo:session): session closed for user root Jul 03 09:48:40.841629 np0000004400 cinder-backup[101319]: DEBUG oslo_concurrency.processutils [None req-6c55ca9c-9a26-443f-9295-6da378b448f0 tempest-ProjectReaderTests39-1540523434 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chown 0 /dev/sdc" returned: 0 in 0.332s {{(pid=101319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 09:48:40.842463 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-6c55ca9c-9a26-443f-9295-6da378b448f0 tempest-ProjectReaderTests39-1540523434 None] ==> disconnect_volume: call "{'args': (, {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-45625dd9-520e-4033-b160-f3175cfdc32a', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '45625dd9-520e-4033-b160-f3175cfdc32a', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': False}, {'type': 'block', 'scsi_wwn': '3300000009020126e', 'path': '/dev/sdc'}), 'kwargs': {'force': True, 'ignore_errors': True}}" {{(pid=101319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}} Jul 03 09:48:40.842463 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.base [None req-6c55ca9c-9a26-443f-9295-6da378b448f0 tempest-ProjectReaderTests39-1540523434 None] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=101319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jul 03 09:48:40.842722 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.base [None req-6c55ca9c-9a26-443f-9295-6da378b448f0 tempest-ProjectReaderTests39-1540523434 None] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.000s {{(pid=101319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jul 03 09:48:40.843063 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-6c55ca9c-9a26-443f-9295-6da378b448f0 tempest-ProjectReaderTests39-1540523434 None] _get_connection_devices called with parameters: connection_properties={'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-45625dd9-520e-4033-b160-f3175cfdc32a', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '45625dd9-520e-4033-b160-f3175cfdc32a', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': False}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=101319) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:847}} Jul 03 09:48:40.853277 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-6c55ca9c-9a26-443f-9295-6da378b448f0 tempest-ProjectReaderTests39-1540523434 None] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS: Jul 03 09:48:40.853277 np0000004400 cinder-backup[101319]: No targets found. Jul 03 09:48:40.853277 np0000004400 cinder-backup[101319]: iSNS: Jul 03 09:48:40.853277 np0000004400 cinder-backup[101319]: No targets found. Jul 03 09:48:40.853277 np0000004400 cinder-backup[101319]: STATIC: Jul 03 09:48:40.853277 np0000004400 cinder-backup[101319]: Target: iqn.2023-03.storpool.com:os--volume-9d5c4a10-6ade-4a1f-853a-c86139da6207 Jul 03 09:48:40.853277 np0000004400 cinder-backup[101319]: Portal: 192.168.50.100:3260,-1 Jul 03 09:48:40.853277 np0000004400 cinder-backup[101319]: Iface Name: default Jul 03 09:48:40.853277 np0000004400 cinder-backup[101319]: Portal: 192.168.40.100:3260,-1 Jul 03 09:48:40.853277 np0000004400 cinder-backup[101319]: Iface Name: default Jul 03 09:48:40.853277 np0000004400 cinder-backup[101319]: Target: iqn.2023-03.storpool.com:os--volume-45625dd9-520e-4033-b160-f3175cfdc32a Jul 03 09:48:40.853277 np0000004400 cinder-backup[101319]: Portal: 192.168.40.100:3260,-1 Jul 03 09:48:40.853277 np0000004400 cinder-backup[101319]: Iface Name: default Jul 03 09:48:40.853277 np0000004400 cinder-backup[101319]: FIRMWARE: Jul 03 09:48:40.853277 np0000004400 cinder-backup[101319]: No targets found. Jul 03 09:48:40.853277 np0000004400 cinder-backup[101319]: stderr= {{(pid=101319) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jul 03 09:48:40.854978 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-6c55ca9c-9a26-443f-9295-6da378b448f0 tempest-ProjectReaderTests39-1540523434 None] Regex to get portals from discoverydb: ^SENDTARGETS: Jul 03 09:48:40.854978 np0000004400 cinder-backup[101319]: .*?^DiscoveryAddress: 192.168.40.100,3260.*? Jul 03 09:48:40.854978 np0000004400 cinder-backup[101319]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=101319) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:390}} Jul 03 09:48:40.854978 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-6c55ca9c-9a26-443f-9295-6da378b448f0 tempest-ProjectReaderTests39-1540523434 None] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-45625dd9-520e-4033-b160-f3175cfdc32a', 0)] {{(pid=101319) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:858}} Jul 03 09:48:40.855562 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-2ab525ed-64b7-405a-8dfa-110c5d18ee25 tempest-VolumesBackupsV39Test-815084545 None] deleted object: volume_0600698e-1197-4d21-aefe-cadad145a000/20260703094824/az_nova_backup_c9ad8b37-057e-4c52-a459-b8dbd5e67dfe-00010 in container: tempest-volumesbackupsv39test-backup-container-1091695867. {{(pid=101319) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 09:48:40.878132 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-6c55ca9c-9a26-443f-9295-6da378b448f0 tempest-ProjectReaderTests39-1540523434 None] iscsiadm ('-m', 'session'): stdout=tcp: [140] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-45625dd9-520e-4033-b160-f3175cfdc32a (non-flash) Jul 03 09:48:40.878132 np0000004400 cinder-backup[101319]: tcp: [141] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9d5c4a10-6ade-4a1f-853a-c86139da6207 (non-flash) Jul 03 09:48:40.878132 np0000004400 cinder-backup[101319]: tcp: [142] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9d5c4a10-6ade-4a1f-853a-c86139da6207 (non-flash) Jul 03 09:48:40.878132 np0000004400 cinder-backup[101319]: stderr= {{(pid=101319) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jul 03 09:48:40.879031 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-6c55ca9c-9a26-443f-9295-6da378b448f0 tempest-ProjectReaderTests39-1540523434 None] iscsi session list stdout=tcp: [140] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-45625dd9-520e-4033-b160-f3175cfdc32a (non-flash) Jul 03 09:48:40.879031 np0000004400 cinder-backup[101319]: tcp: [141] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9d5c4a10-6ade-4a1f-853a-c86139da6207 (non-flash) Jul 03 09:48:40.879031 np0000004400 cinder-backup[101319]: tcp: [142] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9d5c4a10-6ade-4a1f-853a-c86139da6207 (non-flash) Jul 03 09:48:40.879031 np0000004400 cinder-backup[101319]: stderr= {{(pid=101319) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jul 03 09:48:40.879031 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-6c55ca9c-9a26-443f-9295-6da378b448f0 tempest-ProjectReaderTests39-1540523434 None] Sessions list: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-45625dd9-520e-4033-b160-f3175cfdc32a', '140'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-9d5c4a10-6ade-4a1f-853a-c86139da6207', '141'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-9d5c4a10-6ade-4a1f-853a-c86139da6207', '142')] {{(pid=101319) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:866}} Jul 03 09:48:40.879031 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-6c55ca9c-9a26-443f-9295-6da378b448f0 tempest-ProjectReaderTests39-1540523434 None] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-45625dd9-520e-4033-b160-f3175cfdc32a, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-45625dd9-520e-4033-b160-f3175cfdc32a', '140')] {{(pid=101319) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}} Jul 03 09:48:40.879371 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-6c55ca9c-9a26-443f-9295-6da378b448f0 tempest-ProjectReaderTests39-1540523434 None] Resulting device map defaultdict(. at 0x7e7705876700>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-45625dd9-520e-4033-b160-f3175cfdc32a'): ({'sdc'}, set())}) {{(pid=101319) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:912}} Jul 03 09:48:40.879579 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.linuxscsi [None req-6c55ca9c-9a26-443f-9295-6da378b448f0 tempest-ProjectReaderTests39-1540523434 None] Removing single pathed devices sdc {{(pid=101319) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}} Jul 03 09:48:40.889038 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.linuxscsi [None req-6c55ca9c-9a26-443f-9295-6da378b448f0 tempest-ProjectReaderTests39-1540523434 None] Flushing IO for device /dev/sdc {{(pid=101319) flush_device_io /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:461}} Jul 03 09:48:40.896730 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.linuxscsi [None req-6c55ca9c-9a26-443f-9295-6da378b448f0 tempest-ProjectReaderTests39-1540523434 None] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=101319) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}} Jul 03 09:48:40.905007 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-2ab525ed-64b7-405a-8dfa-110c5d18ee25 tempest-VolumesBackupsV39Test-815084545 None] deleted object: volume_0600698e-1197-4d21-aefe-cadad145a000/20260703094824/az_nova_backup_c9ad8b37-057e-4c52-a459-b8dbd5e67dfe-00011 in container: tempest-volumesbackupsv39test-backup-container-1091695867. {{(pid=101319) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 09:48:40.941768 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.linuxscsi [None req-6c55ca9c-9a26-443f-9295-6da378b448f0 tempest-ProjectReaderTests39-1540523434 None] Checking to see if SCSI volumes sdc have been removed. {{(pid=101319) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}} Jul 03 09:48:40.941938 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.linuxscsi [None req-6c55ca9c-9a26-443f-9295-6da378b448f0 tempest-ProjectReaderTests39-1540523434 None] SCSI volumes sdc have been removed. {{(pid=101319) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}} Jul 03 09:48:40.942569 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.linuxscsi [None req-6c55ca9c-9a26-443f-9295-6da378b448f0 tempest-ProjectReaderTests39-1540523434 None] Checking to see if device paths {'sdc'} are still under multipathd monitoring {{(pid=101319) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}} Jul 03 09:48:40.958112 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-2ab525ed-64b7-405a-8dfa-110c5d18ee25 tempest-VolumesBackupsV39Test-815084545 None] deleted object: volume_0600698e-1197-4d21-aefe-cadad145a000/20260703094824/az_nova_backup_c9ad8b37-057e-4c52-a459-b8dbd5e67dfe-00012 in container: tempest-volumesbackupsv39test-backup-container-1091695867. {{(pid=101319) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 09:48:40.958112 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.linuxscsi [None req-6c55ca9c-9a26-443f-9295-6da378b448f0 tempest-ProjectReaderTests39-1540523434 None] Device paths {'sdc'} have been removed from multipathd monitoring. {{(pid=101319) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}} Jul 03 09:48:40.958112 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-6c55ca9c-9a26-443f-9295-6da378b448f0 tempest-ProjectReaderTests39-1540523434 None] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-45625dd9-520e-4033-b160-f3175cfdc32a')] {{(pid=101319) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1225}} Jul 03 09:48:40.968772 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-6c55ca9c-9a26-443f-9295-6da378b448f0 tempest-ProjectReaderTests39-1540523434 None] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=101319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 03 09:48:40.990940 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-2ab525ed-64b7-405a-8dfa-110c5d18ee25 tempest-VolumesBackupsV39Test-815084545 None] deleted object: volume_0600698e-1197-4d21-aefe-cadad145a000/20260703094824/az_nova_backup_c9ad8b37-057e-4c52-a459-b8dbd5e67dfe-00013 in container: tempest-volumesbackupsv39test-backup-container-1091695867. {{(pid=101319) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 09:48:40.994495 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-6c55ca9c-9a26-443f-9295-6da378b448f0 tempest-ProjectReaderTests39-1540523434 None] iscsiadm ('--logout',): stdout=Logging out of session [sid: 140, target: iqn.2023-03.storpool.com:os--volume-45625dd9-520e-4033-b160-f3175cfdc32a, portal: 192.168.40.100,3260] Jul 03 09:48:40.994495 np0000004400 cinder-backup[101319]: Logout of [sid: 140, target: iqn.2023-03.storpool.com:os--volume-45625dd9-520e-4033-b160-f3175cfdc32a, portal: 192.168.40.100,3260] successful. Jul 03 09:48:40.994495 np0000004400 cinder-backup[101319]: stderr= {{(pid=101319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 03 09:48:41.005595 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-6c55ca9c-9a26-443f-9295-6da378b448f0 tempest-ProjectReaderTests39-1540523434 None] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=101319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 03 09:48:41.005821 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.base [None req-6c55ca9c-9a26-443f-9295-6da378b448f0 tempest-ProjectReaderTests39-1540523434 None] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.163s {{(pid=101319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jul 03 09:48:41.005953 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-6c55ca9c-9a26-443f-9295-6da378b448f0 tempest-ProjectReaderTests39-1540523434 None] <== disconnect_volume: return (163ms) None {{(pid=101319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}} Jul 03 09:48:41.028333 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-2ab525ed-64b7-405a-8dfa-110c5d18ee25 tempest-VolumesBackupsV39Test-815084545 None] deleted object: volume_0600698e-1197-4d21-aefe-cadad145a000/20260703094824/az_nova_backup_c9ad8b37-057e-4c52-a459-b8dbd5e67dfe-00014 in container: tempest-volumesbackupsv39test-backup-container-1091695867. {{(pid=101319) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 09:48:41.063772 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-2ab525ed-64b7-405a-8dfa-110c5d18ee25 tempest-VolumesBackupsV39Test-815084545 None] deleted object: volume_0600698e-1197-4d21-aefe-cadad145a000/20260703094824/az_nova_backup_c9ad8b37-057e-4c52-a459-b8dbd5e67dfe-00015 in container: tempest-volumesbackupsv39test-backup-container-1091695867. {{(pid=101319) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 09:48:41.099160 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-2ab525ed-64b7-405a-8dfa-110c5d18ee25 tempest-VolumesBackupsV39Test-815084545 None] deleted object: volume_0600698e-1197-4d21-aefe-cadad145a000/20260703094824/az_nova_backup_c9ad8b37-057e-4c52-a459-b8dbd5e67dfe-00016 in container: tempest-volumesbackupsv39test-backup-container-1091695867. {{(pid=101319) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 09:48:41.145993 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-2ab525ed-64b7-405a-8dfa-110c5d18ee25 tempest-VolumesBackupsV39Test-815084545 None] deleted object: volume_0600698e-1197-4d21-aefe-cadad145a000/20260703094824/az_nova_backup_c9ad8b37-057e-4c52-a459-b8dbd5e67dfe-00017 in container: tempest-volumesbackupsv39test-backup-container-1091695867. {{(pid=101319) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 09:48:41.177229 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-2ab525ed-64b7-405a-8dfa-110c5d18ee25 tempest-VolumesBackupsV39Test-815084545 None] deleted object: volume_0600698e-1197-4d21-aefe-cadad145a000/20260703094824/az_nova_backup_c9ad8b37-057e-4c52-a459-b8dbd5e67dfe-00018 in container: tempest-volumesbackupsv39test-backup-container-1091695867. {{(pid=101319) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 09:48:41.201867 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-2ab525ed-64b7-405a-8dfa-110c5d18ee25 tempest-VolumesBackupsV39Test-815084545 None] deleted object: volume_0600698e-1197-4d21-aefe-cadad145a000/20260703094824/az_nova_backup_c9ad8b37-057e-4c52-a459-b8dbd5e67dfe-00019 in container: tempest-volumesbackupsv39test-backup-container-1091695867. {{(pid=101319) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 09:48:41.232983 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-2ab525ed-64b7-405a-8dfa-110c5d18ee25 tempest-VolumesBackupsV39Test-815084545 None] deleted object: volume_0600698e-1197-4d21-aefe-cadad145a000/20260703094824/az_nova_backup_c9ad8b37-057e-4c52-a459-b8dbd5e67dfe-00020 in container: tempest-volumesbackupsv39test-backup-container-1091695867. {{(pid=101319) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 09:48:41.264189 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-2ab525ed-64b7-405a-8dfa-110c5d18ee25 tempest-VolumesBackupsV39Test-815084545 None] deleted object: volume_0600698e-1197-4d21-aefe-cadad145a000/20260703094824/az_nova_backup_c9ad8b37-057e-4c52-a459-b8dbd5e67dfe-00021 in container: tempest-volumesbackupsv39test-backup-container-1091695867. {{(pid=101319) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 09:48:41.295849 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-2ab525ed-64b7-405a-8dfa-110c5d18ee25 tempest-VolumesBackupsV39Test-815084545 None] deleted object: volume_0600698e-1197-4d21-aefe-cadad145a000/20260703094824/az_nova_backup_c9ad8b37-057e-4c52-a459-b8dbd5e67dfe_metadata in container: tempest-volumesbackupsv39test-backup-container-1091695867. {{(pid=101319) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 09:48:41.333124 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-2ab525ed-64b7-405a-8dfa-110c5d18ee25 tempest-VolumesBackupsV39Test-815084545 None] deleted object: volume_0600698e-1197-4d21-aefe-cadad145a000/20260703094824/az_nova_backup_c9ad8b37-057e-4c52-a459-b8dbd5e67dfe_sha256file in container: tempest-volumesbackupsv39test-backup-container-1091695867. {{(pid=101319) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 09:48:41.333354 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-2ab525ed-64b7-405a-8dfa-110c5d18ee25 tempest-VolumesBackupsV39Test-815084545 None] delete c9ad8b37-057e-4c52-a459-b8dbd5e67dfe finished. {{(pid=101319) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:848}} Jul 03 09:48:41.365583 np0000004400 cinder-backup[101319]: DEBUG cinder.quota [None req-2ab525ed-64b7-405a-8dfa-110c5d18ee25 tempest-VolumesBackupsV39Test-815084545 None] Created reservations ['9c8aa1dd-1660-4276-bc47-e4169a31c305', '7680d008-88bc-4d03-803d-a73b499cd45c'] {{(pid=101319) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 09:48:41.402848 np0000004400 cinder-backup[101319]: INFO cinder.backup.manager [None req-2ab525ed-64b7-405a-8dfa-110c5d18ee25 tempest-VolumesBackupsV39Test-815084545 None] Delete backup finished, backup c9ad8b37-057e-4c52-a459-b8dbd5e67dfe deleted. Jul 03 09:48:42.063269 np0000004400 cinder-backup[101319]: INFO cinder.backup.manager [None req-6c55ca9c-9a26-443f-9295-6da378b448f0 tempest-ProjectReaderTests39-1540523434 None] Create backup finished. backup: 1704ffd8-504c-4b12-adcf-b7f1a0cead28. Jul 03 09:48:42.312677 np0000004400 cinder-backup[101319]: INFO cinder.backup.manager [None req-c76ec9e8-e05e-4e40-af4b-264547b88ca0 tempest-ProjectReaderTests39-1540523434 None] Delete backup started, backup: 1704ffd8-504c-4b12-adcf-b7f1a0cead28. Jul 03 09:48:42.315841 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.drivers.swift [None req-c76ec9e8-e05e-4e40-af4b-264547b88ca0 tempest-ProjectReaderTests39-1540523434 None] Using swift URL https://10.4.3.95:8080/v1/AUTH_ff0cd0be3a0a4eb083a7aed4c49f30ea {{(pid=101319) initialize /opt/stack/cinder/cinder/backup/drivers/swift.py:300}} Jul 03 09:48:42.316097 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.drivers.swift [None req-c76ec9e8-e05e-4e40-af4b-264547b88ca0 tempest-ProjectReaderTests39-1540523434 None] Connect to https://10.4.3.95:8080/v1/AUTH_ in "per_user" mode {{(pid=101319) initialize /opt/stack/cinder/cinder/backup/drivers/swift.py:301}} Jul 03 09:48:42.316260 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-c76ec9e8-e05e-4e40-af4b-264547b88ca0 tempest-ProjectReaderTests39-1540523434 None] delete started, backup: 1704ffd8-504c-4b12-adcf-b7f1a0cead28, container: volumebackups, prefix: volume_45625dd9-520e-4033-b160-f3175cfdc32a/20260703094827/az_nova_backup_1704ffd8-504c-4b12-adcf-b7f1a0cead28. {{(pid=101319) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:822}} Jul 03 09:48:42.405769 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-c76ec9e8-e05e-4e40-af4b-264547b88ca0 tempest-ProjectReaderTests39-1540523434 None] generated object list: ['volume_45625dd9-520e-4033-b160-f3175cfdc32a/20260703094827/az_nova_backup_1704ffd8-504c-4b12-adcf-b7f1a0cead28-00001', 'volume_45625dd9-520e-4033-b160-f3175cfdc32a/20260703094827/az_nova_backup_1704ffd8-504c-4b12-adcf-b7f1a0cead28-00002', 'volume_45625dd9-520e-4033-b160-f3175cfdc32a/20260703094827/az_nova_backup_1704ffd8-504c-4b12-adcf-b7f1a0cead28-00003', 'volume_45625dd9-520e-4033-b160-f3175cfdc32a/20260703094827/az_nova_backup_1704ffd8-504c-4b12-adcf-b7f1a0cead28-00004', 'volume_45625dd9-520e-4033-b160-f3175cfdc32a/20260703094827/az_nova_backup_1704ffd8-504c-4b12-adcf-b7f1a0cead28-00005', 'volume_45625dd9-520e-4033-b160-f3175cfdc32a/20260703094827/az_nova_backup_1704ffd8-504c-4b12-adcf-b7f1a0cead28-00006', 'volume_45625dd9-520e-4033-b160-f3175cfdc32a/20260703094827/az_nova_backup_1704ffd8-504c-4b12-adcf-b7f1a0cead28-00007', 'volume_45625dd9-520e-4033-b160-f3175cfdc32a/20260703094827/az_nova_backup_1704ffd8-504c-4b12-adcf-b7f1a0cead28-00008', 'volume_45625dd9-520e-4033-b160-f3175cfdc32a/20260703094827/az_nova_backup_1704ffd8-504c-4b12-adcf-b7f1a0cead28-00009', 'volume_45625dd9-520e-4033-b160-f3175cfdc32a/20260703094827/az_nova_backup_1704ffd8-504c-4b12-adcf-b7f1a0cead28-00010', 'volume_45625dd9-520e-4033-b160-f3175cfdc32a/20260703094827/az_nova_backup_1704ffd8-504c-4b12-adcf-b7f1a0cead28-00011', 'volume_45625dd9-520e-4033-b160-f3175cfdc32a/20260703094827/az_nova_backup_1704ffd8-504c-4b12-adcf-b7f1a0cead28-00012', 'volume_45625dd9-520e-4033-b160-f3175cfdc32a/20260703094827/az_nova_backup_1704ffd8-504c-4b12-adcf-b7f1a0cead28-00013', 'volume_45625dd9-520e-4033-b160-f3175cfdc32a/20260703094827/az_nova_backup_1704ffd8-504c-4b12-adcf-b7f1a0cead28-00014', 'volume_45625dd9-520e-4033-b160-f3175cfdc32a/20260703094827/az_nova_backup_1704ffd8-504c-4b12-adcf-b7f1a0cead28-00015', 'volume_45625dd9-520e-4033-b160-f3175cfdc32a/20260703094827/az_nova_backup_1704ffd8-504c-4b12-adcf-b7f1a0cead28-00016', 'volume_45625dd9-520e-4033-b160-f3175cfdc32a/20260703094827/az_nova_backup_1704ffd8-504c-4b12-adcf-b7f1a0cead28-00017', 'volume_45625dd9-520e-4033-b160-f3175cfdc32a/20260703094827/az_nova_backup_1704ffd8-504c-4b12-adcf-b7f1a0cead28-00018', 'volume_45625dd9-520e-4033-b160-f3175cfdc32a/20260703094827/az_nova_backup_1704ffd8-504c-4b12-adcf-b7f1a0cead28-00019', 'volume_45625dd9-520e-4033-b160-f3175cfdc32a/20260703094827/az_nova_backup_1704ffd8-504c-4b12-adcf-b7f1a0cead28-00020', 'volume_45625dd9-520e-4033-b160-f3175cfdc32a/20260703094827/az_nova_backup_1704ffd8-504c-4b12-adcf-b7f1a0cead28-00021', 'volume_45625dd9-520e-4033-b160-f3175cfdc32a/20260703094827/az_nova_backup_1704ffd8-504c-4b12-adcf-b7f1a0cead28_metadata', 'volume_45625dd9-520e-4033-b160-f3175cfdc32a/20260703094827/az_nova_backup_1704ffd8-504c-4b12-adcf-b7f1a0cead28_sha256file']. {{(pid=101319) _generate_object_names /opt/stack/cinder/cinder/backup/chunkeddriver.py:260}} Jul 03 09:48:42.436036 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-c76ec9e8-e05e-4e40-af4b-264547b88ca0 tempest-ProjectReaderTests39-1540523434 None] deleted object: volume_45625dd9-520e-4033-b160-f3175cfdc32a/20260703094827/az_nova_backup_1704ffd8-504c-4b12-adcf-b7f1a0cead28-00001 in container: volumebackups. {{(pid=101319) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 09:48:42.480817 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-c76ec9e8-e05e-4e40-af4b-264547b88ca0 tempest-ProjectReaderTests39-1540523434 None] deleted object: volume_45625dd9-520e-4033-b160-f3175cfdc32a/20260703094827/az_nova_backup_1704ffd8-504c-4b12-adcf-b7f1a0cead28-00002 in container: volumebackups. {{(pid=101319) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 09:48:42.515940 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-c76ec9e8-e05e-4e40-af4b-264547b88ca0 tempest-ProjectReaderTests39-1540523434 None] deleted object: volume_45625dd9-520e-4033-b160-f3175cfdc32a/20260703094827/az_nova_backup_1704ffd8-504c-4b12-adcf-b7f1a0cead28-00003 in container: volumebackups. {{(pid=101319) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 09:48:42.555227 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-c76ec9e8-e05e-4e40-af4b-264547b88ca0 tempest-ProjectReaderTests39-1540523434 None] deleted object: volume_45625dd9-520e-4033-b160-f3175cfdc32a/20260703094827/az_nova_backup_1704ffd8-504c-4b12-adcf-b7f1a0cead28-00004 in container: volumebackups. {{(pid=101319) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 09:48:42.589990 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-c76ec9e8-e05e-4e40-af4b-264547b88ca0 tempest-ProjectReaderTests39-1540523434 None] deleted object: volume_45625dd9-520e-4033-b160-f3175cfdc32a/20260703094827/az_nova_backup_1704ffd8-504c-4b12-adcf-b7f1a0cead28-00005 in container: volumebackups. {{(pid=101319) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 09:48:42.633275 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-c76ec9e8-e05e-4e40-af4b-264547b88ca0 tempest-ProjectReaderTests39-1540523434 None] deleted object: volume_45625dd9-520e-4033-b160-f3175cfdc32a/20260703094827/az_nova_backup_1704ffd8-504c-4b12-adcf-b7f1a0cead28-00006 in container: volumebackups. {{(pid=101319) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 09:48:42.671350 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-c76ec9e8-e05e-4e40-af4b-264547b88ca0 tempest-ProjectReaderTests39-1540523434 None] deleted object: volume_45625dd9-520e-4033-b160-f3175cfdc32a/20260703094827/az_nova_backup_1704ffd8-504c-4b12-adcf-b7f1a0cead28-00007 in container: volumebackups. {{(pid=101319) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 09:48:42.702823 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-c76ec9e8-e05e-4e40-af4b-264547b88ca0 tempest-ProjectReaderTests39-1540523434 None] deleted object: volume_45625dd9-520e-4033-b160-f3175cfdc32a/20260703094827/az_nova_backup_1704ffd8-504c-4b12-adcf-b7f1a0cead28-00008 in container: volumebackups. {{(pid=101319) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 09:48:42.751428 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-c76ec9e8-e05e-4e40-af4b-264547b88ca0 tempest-ProjectReaderTests39-1540523434 None] deleted object: volume_45625dd9-520e-4033-b160-f3175cfdc32a/20260703094827/az_nova_backup_1704ffd8-504c-4b12-adcf-b7f1a0cead28-00009 in container: volumebackups. {{(pid=101319) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 09:48:42.786891 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-c76ec9e8-e05e-4e40-af4b-264547b88ca0 tempest-ProjectReaderTests39-1540523434 None] deleted object: volume_45625dd9-520e-4033-b160-f3175cfdc32a/20260703094827/az_nova_backup_1704ffd8-504c-4b12-adcf-b7f1a0cead28-00010 in container: volumebackups. {{(pid=101319) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 09:48:42.826526 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-c76ec9e8-e05e-4e40-af4b-264547b88ca0 tempest-ProjectReaderTests39-1540523434 None] deleted object: volume_45625dd9-520e-4033-b160-f3175cfdc32a/20260703094827/az_nova_backup_1704ffd8-504c-4b12-adcf-b7f1a0cead28-00011 in container: volumebackups. {{(pid=101319) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 09:48:42.864453 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-c76ec9e8-e05e-4e40-af4b-264547b88ca0 tempest-ProjectReaderTests39-1540523434 None] deleted object: volume_45625dd9-520e-4033-b160-f3175cfdc32a/20260703094827/az_nova_backup_1704ffd8-504c-4b12-adcf-b7f1a0cead28-00012 in container: volumebackups. {{(pid=101319) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 09:48:42.895892 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-c76ec9e8-e05e-4e40-af4b-264547b88ca0 tempest-ProjectReaderTests39-1540523434 None] deleted object: volume_45625dd9-520e-4033-b160-f3175cfdc32a/20260703094827/az_nova_backup_1704ffd8-504c-4b12-adcf-b7f1a0cead28-00013 in container: volumebackups. {{(pid=101319) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 09:48:42.930567 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-c76ec9e8-e05e-4e40-af4b-264547b88ca0 tempest-ProjectReaderTests39-1540523434 None] deleted object: volume_45625dd9-520e-4033-b160-f3175cfdc32a/20260703094827/az_nova_backup_1704ffd8-504c-4b12-adcf-b7f1a0cead28-00014 in container: volumebackups. {{(pid=101319) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 09:48:42.960537 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-c76ec9e8-e05e-4e40-af4b-264547b88ca0 tempest-ProjectReaderTests39-1540523434 None] deleted object: volume_45625dd9-520e-4033-b160-f3175cfdc32a/20260703094827/az_nova_backup_1704ffd8-504c-4b12-adcf-b7f1a0cead28-00015 in container: volumebackups. {{(pid=101319) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 09:48:42.991057 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-c76ec9e8-e05e-4e40-af4b-264547b88ca0 tempest-ProjectReaderTests39-1540523434 None] deleted object: volume_45625dd9-520e-4033-b160-f3175cfdc32a/20260703094827/az_nova_backup_1704ffd8-504c-4b12-adcf-b7f1a0cead28-00016 in container: volumebackups. {{(pid=101319) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 09:48:43.020190 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-c76ec9e8-e05e-4e40-af4b-264547b88ca0 tempest-ProjectReaderTests39-1540523434 None] deleted object: volume_45625dd9-520e-4033-b160-f3175cfdc32a/20260703094827/az_nova_backup_1704ffd8-504c-4b12-adcf-b7f1a0cead28-00017 in container: volumebackups. {{(pid=101319) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 09:48:43.045927 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-c76ec9e8-e05e-4e40-af4b-264547b88ca0 tempest-ProjectReaderTests39-1540523434 None] deleted object: volume_45625dd9-520e-4033-b160-f3175cfdc32a/20260703094827/az_nova_backup_1704ffd8-504c-4b12-adcf-b7f1a0cead28-00018 in container: volumebackups. {{(pid=101319) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 09:48:43.067423 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-c76ec9e8-e05e-4e40-af4b-264547b88ca0 tempest-ProjectReaderTests39-1540523434 None] deleted object: volume_45625dd9-520e-4033-b160-f3175cfdc32a/20260703094827/az_nova_backup_1704ffd8-504c-4b12-adcf-b7f1a0cead28-00019 in container: volumebackups. {{(pid=101319) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 09:48:43.095754 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-c76ec9e8-e05e-4e40-af4b-264547b88ca0 tempest-ProjectReaderTests39-1540523434 None] deleted object: volume_45625dd9-520e-4033-b160-f3175cfdc32a/20260703094827/az_nova_backup_1704ffd8-504c-4b12-adcf-b7f1a0cead28-00020 in container: volumebackups. {{(pid=101319) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 09:48:43.121377 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-c76ec9e8-e05e-4e40-af4b-264547b88ca0 tempest-ProjectReaderTests39-1540523434 None] deleted object: volume_45625dd9-520e-4033-b160-f3175cfdc32a/20260703094827/az_nova_backup_1704ffd8-504c-4b12-adcf-b7f1a0cead28-00021 in container: volumebackups. {{(pid=101319) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 09:48:43.149442 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-c76ec9e8-e05e-4e40-af4b-264547b88ca0 tempest-ProjectReaderTests39-1540523434 None] deleted object: volume_45625dd9-520e-4033-b160-f3175cfdc32a/20260703094827/az_nova_backup_1704ffd8-504c-4b12-adcf-b7f1a0cead28_metadata in container: volumebackups. {{(pid=101319) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 09:48:43.174336 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-c76ec9e8-e05e-4e40-af4b-264547b88ca0 tempest-ProjectReaderTests39-1540523434 None] deleted object: volume_45625dd9-520e-4033-b160-f3175cfdc32a/20260703094827/az_nova_backup_1704ffd8-504c-4b12-adcf-b7f1a0cead28_sha256file in container: volumebackups. {{(pid=101319) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 09:48:43.174788 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-c76ec9e8-e05e-4e40-af4b-264547b88ca0 tempest-ProjectReaderTests39-1540523434 None] delete 1704ffd8-504c-4b12-adcf-b7f1a0cead28 finished. {{(pid=101319) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:848}} Jul 03 09:48:43.231018 np0000004400 cinder-backup[101319]: DEBUG oslo_db.sqlalchemy.engines [None req-c76ec9e8-e05e-4e40-af4b-264547b88ca0 tempest-ProjectReaderTests39-1540523434 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=101319) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 03 09:48:43.263077 np0000004400 cinder-backup[101319]: DEBUG cinder.quota [None req-c76ec9e8-e05e-4e40-af4b-264547b88ca0 tempest-ProjectReaderTests39-1540523434 None] Created reservations ['11c51ad8-d1b9-4afb-934c-aadcdea2437c', 'eb8cd3b0-17de-4e30-a678-5aa7e9d57728'] {{(pid=101319) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 09:48:43.341834 np0000004400 cinder-backup[101319]: INFO cinder.backup.manager [None req-c76ec9e8-e05e-4e40-af4b-264547b88ca0 tempest-ProjectReaderTests39-1540523434 None] Delete backup finished, backup 1704ffd8-504c-4b12-adcf-b7f1a0cead28 deleted. Jul 03 09:48:53.310903 np0000004400 cinder-backup[101319]: DEBUG dbcounter [-] [101319] Writing DB stats cinder:SELECT=163,cinder:INSERT=12,cinder:UPDATE=60 {{(pid=101319) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 03 09:49:36.587545 np0000004400 cinder-backup[101319]: INFO cinder.backup.manager [None req-c1357d40-0422-4ef5-9555-fe9514348482 tempest-VolumesSnapshotTestJSON-1856009199 None] Create backup started, backup: f02acbcb-92f6-490b-9c9d-afe87bc4a5e0 volume: 89470c05-4a76-41e8-b5cb-f969bb59ce72 snapshot: 91fac6bd-ba8c-468f-bacb-31683614fdfa. Jul 03 09:49:36.591831 np0000004400 cinder-backup[101319]: INFO cinder.backup.manager [None req-c1357d40-0422-4ef5-9555-fe9514348482 tempest-VolumesSnapshotTestJSON-1856009199 None] Call Volume Manager to get_backup_device for Backup(availability_zone='nova',container='tempest-volumessnapshottestjson-backup-container-489263271',created_at=2026-07-03T09:49:36Z,data_timestamp=2026-07-03T09:49:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Backup-730309874',encryption_key_id=None,fail_reason=None,host='np0000004400',id=f02acbcb-92f6-490b-9c9d-afe87bc4a5e0,metadata={},num_dependent_backups=0,object_count=0,parent=None,parent_id=None,project_id='5895ffa0711d4d068874cf88aa93a069',restore_volume_id=None,service='cinder.backup.drivers.swift.SwiftBackupDriver',service_metadata=None,size=1,snapshot_id='91fac6bd-ba8c-468f-bacb-31683614fdfa',status='creating',temp_snapshot_id=None,temp_volume_id=None,updated_at=None,user_id='be16554eaca547c79f0d1fb80e58c3de',volume_id=89470c05-4a76-41e8-b5cb-f969bb59ce72) Jul 03 09:49:36.641470 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.drivers.swift [None req-c1357d40-0422-4ef5-9555-fe9514348482 tempest-VolumesSnapshotTestJSON-1856009199 None] Using swift URL https://10.4.3.95:8080/v1/AUTH_5895ffa0711d4d068874cf88aa93a069 {{(pid=101319) initialize /opt/stack/cinder/cinder/backup/drivers/swift.py:300}} Jul 03 09:49:36.641752 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.drivers.swift [None req-c1357d40-0422-4ef5-9555-fe9514348482 tempest-VolumesSnapshotTestJSON-1856009199 None] Connect to https://10.4.3.95:8080/v1/AUTH_ in "per_user" mode {{(pid=101319) initialize /opt/stack/cinder/cinder/backup/drivers/swift.py:301}} Jul 03 09:49:36.642036 np0000004400 cinder-backup[101319]: DEBUG os_brick.utils [None req-c1357d40-0422-4ef5-9555-fe9514348482 tempest-VolumesSnapshotTestJSON-1856009199 None] ==> get_connector_properties: call "{'root_helper': 'sudo cinder-rootwrap /etc/cinder/rootwrap.conf', 'my_ip': '10.4.3.95', 'multipath': False, 'enforce_multipath': False, 'host': None, 'execute': None}" {{(pid=101319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}} Jul 03 09:49:36.652366 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.scaleio [None req-c1357d40-0422-4ef5-9555-fe9514348482 tempest-VolumesSnapshotTestJSON-1856009199 None] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=101319) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}} Jul 03 09:49:36.672169 np0000004400 cinder-backup[101319]: DEBUG oslo_concurrency.processutils [None req-c1357d40-0422-4ef5-9555-fe9514348482 tempest-VolumesSnapshotTestJSON-1856009199 None] Running cmd (subprocess): nvme version {{(pid=101319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 09:49:36.685170 np0000004400 cinder-backup[101319]: DEBUG oslo_concurrency.processutils [None req-c1357d40-0422-4ef5-9555-fe9514348482 tempest-VolumesSnapshotTestJSON-1856009199 None] 'nvme version' failed. Not Retrying. {{(pid=101319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 03 09:49:36.685539 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.nvmeof [None req-c1357d40-0422-4ef5-9555-fe9514348482 tempest-VolumesSnapshotTestJSON-1856009199 None] nvme not present on system {{(pid=101319) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}} Jul 03 09:49:36.694022 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.lightos [None req-c1357d40-0422-4ef5-9555-fe9514348482 tempest-VolumesSnapshotTestJSON-1856009199 None] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=101319) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}} Jul 03 09:49:36.695240 np0000004400 cinder-backup[101319]: INFO os_brick.initiator.connectors.lightos [None req-c1357d40-0422-4ef5-9555-fe9514348482 tempest-VolumesSnapshotTestJSON-1856009199 None] Current host hostNQN and IP(s) are ['10.4.3.95', 'fe80::f816:3eff:fe47:268c', '192.168.40.6', 'fe80::f816:3eff:febf:7be2', '192.168.50.6', 'fe80::f816:3eff:fe99:8914', '192.168.10.6', 'fe80::f816:3eff:fe2f:e696', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::bc9d:84ff:fec2:6b49', 'fe80::fc16:3eff:fea9:3ae0', 'fe80::415:68ff:feec:ae5', 'fe80::fc16:3eff:fe61:2930', 'fe80::fcb0:4aff:fe6d:1fcf', 'fe80::fc16:3eff:fe45:be2a', 'fe80::4007:baff:fe0f:8f44', 'fe80::fc16:3eff:feb3:ab74', 'fe80::b099:12ff:feb4:ede7', 'fe80::fc16:3eff:fea4:74e5', 'fe80::fc16:3eff:fead:8372', 'fe80::8847:afff:fe79:6b4f'] Jul 03 09:49:36.695401 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.lightos [None req-c1357d40-0422-4ef5-9555-fe9514348482 tempest-VolumesSnapshotTestJSON-1856009199 None] LIGHTOS: did not find dsc, continuing anyway. {{(pid=101319) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}} Jul 03 09:49:36.695537 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.lightos [None req-c1357d40-0422-4ef5-9555-fe9514348482 tempest-VolumesSnapshotTestJSON-1856009199 None] LIGHTOS: no hostnqn found. {{(pid=101319) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}} Jul 03 09:49:36.695766 np0000004400 cinder-backup[101319]: DEBUG os_brick.utils [None req-c1357d40-0422-4ef5-9555-fe9514348482 tempest-VolumesSnapshotTestJSON-1856009199 None] <== get_connector_properties: return (53ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.95', 'host': 'np0000004400', 'multipath': False, 'enforce_multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:ae7e5bb0ebe6', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': '6b284368-d0ba-4d18-af6f-4998d3955c52', 'nvme_native_multipath': False} {{(pid=101319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}} Jul 03 09:49:37.198996 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connector [None req-c1357d40-0422-4ef5-9555-fe9514348482 tempest-VolumesSnapshotTestJSON-1856009199 None] Factory for iscsi on None {{(pid=101319) factory /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connector.py:243}} Jul 03 09:49:37.199501 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-c1357d40-0422-4ef5-9555-fe9514348482 tempest-VolumesSnapshotTestJSON-1856009199 None] ==> connect_volume: call "{'self': , 'connection_properties': {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-5d8d0f67-678e-41af-8039-de91e51e7d59', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '5d8d0f67-678e-41af-8039-de91e51e7d59', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': False}}" {{(pid=101319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}} Jul 03 09:49:37.199749 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.base [None req-c1357d40-0422-4ef5-9555-fe9514348482 tempest-VolumesSnapshotTestJSON-1856009199 None] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=101319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jul 03 09:49:37.200291 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.base [None req-c1357d40-0422-4ef5-9555-fe9514348482 tempest-VolumesSnapshotTestJSON-1856009199 None] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=101319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jul 03 09:49:37.200556 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.base [None req-c1357d40-0422-4ef5-9555-fe9514348482 tempest-VolumesSnapshotTestJSON-1856009199 None] Connection properties {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-5d8d0f67-678e-41af-8039-de91e51e7d59', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '5d8d0f67-678e-41af-8039-de91e51e7d59', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': False} {{(pid=101319) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}} Jul 03 09:49:37.211120 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.base [None req-c1357d40-0422-4ef5-9555-fe9514348482 tempest-VolumesSnapshotTestJSON-1856009199 None] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-5d8d0f67-678e-41af-8039-de91e51e7d59" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=101319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jul 03 09:49:37.211556 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.base [None req-c1357d40-0422-4ef5-9555-fe9514348482 tempest-VolumesSnapshotTestJSON-1856009199 None] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-5d8d0f67-678e-41af-8039-de91e51e7d59" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.000s {{(pid=101319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jul 03 09:49:37.211766 np0000004400 cinder-backup[101319]: INFO os_brick.initiator.connectors.iscsi [None req-c1357d40-0422-4ef5-9555-fe9514348482 tempest-VolumesSnapshotTestJSON-1856009199 None] Trying to connect to iSCSI portal 192.168.40.100:3260 Jul 03 09:49:37.220678 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-c1357d40-0422-4ef5-9555-fe9514348482 tempest-VolumesSnapshotTestJSON-1856009199 None] iscsiadm (): stdout= stderr=iscsiadm: No records found Jul 03 09:49:37.220678 np0000004400 cinder-backup[101319]: {{(pid=101319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 03 09:49:37.231927 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-c1357d40-0422-4ef5-9555-fe9514348482 tempest-VolumesSnapshotTestJSON-1856009199 None] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-5d8d0f67-678e-41af-8039-de91e51e7d59] added Jul 03 09:49:37.231927 np0000004400 cinder-backup[101319]: stderr=iscsiadm: Config file line 363 does not have value Jul 03 09:49:37.231927 np0000004400 cinder-backup[101319]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs' Jul 03 09:49:37.231927 np0000004400 cinder-backup[101319]: iscsiadm: Config file line 363 does not have value Jul 03 09:49:37.231927 np0000004400 cinder-backup[101319]: iscsiadm: Config file line 363 does not have value Jul 03 09:49:37.231927 np0000004400 cinder-backup[101319]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs' Jul 03 09:49:37.231927 np0000004400 cinder-backup[101319]: {{(pid=101319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 03 09:49:37.232320 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-c1357d40-0422-4ef5-9555-fe9514348482 tempest-VolumesSnapshotTestJSON-1856009199 None] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=101319) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}} Jul 03 09:49:37.232672 np0000004400 cinder-backup[101319]: DEBUG os_brick.utils [None req-c1357d40-0422-4ef5-9555-fe9514348482 tempest-VolumesSnapshotTestJSON-1856009199 None] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0207(s), this was the 1st time calling it. {{(pid=101319) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}} Jul 03 09:49:37.232889 np0000004400 cinder-backup[101319]: DEBUG os_brick.utils [None req-c1357d40-0422-4ef5-9555-fe9514348482 tempest-VolumesSnapshotTestJSON-1856009199 None] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=101319) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}} Jul 03 09:49:38.234694 np0000004400 cinder-backup[101319]: INFO os_brick.initiator.connectors.iscsi [None req-c1357d40-0422-4ef5-9555-fe9514348482 tempest-VolumesSnapshotTestJSON-1856009199 None] Trying to connect to iSCSI portal 192.168.40.100:3260 Jul 03 09:49:38.245023 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-c1357d40-0422-4ef5-9555-fe9514348482 tempest-VolumesSnapshotTestJSON-1856009199 None] iscsiadm (): stdout=# BEGIN RECORD 2.1.9 Jul 03 09:49:38.245023 np0000004400 cinder-backup[101319]: node.name = iqn.2023-03.storpool.com:os--volume-5d8d0f67-678e-41af-8039-de91e51e7d59 Jul 03 09:49:38.245023 np0000004400 cinder-backup[101319]: node.tpgt = -1 Jul 03 09:49:38.245023 np0000004400 cinder-backup[101319]: node.startup = manual Jul 03 09:49:38.245023 np0000004400 cinder-backup[101319]: node.leading_login = No Jul 03 09:49:38.245023 np0000004400 cinder-backup[101319]: iface.iscsi_ifacename = default Jul 03 09:49:38.245023 np0000004400 cinder-backup[101319]: iface.net_ifacename = Jul 03 09:49:38.245023 np0000004400 cinder-backup[101319]: iface.ipaddress = Jul 03 09:49:38.245023 np0000004400 cinder-backup[101319]: iface.prefix_len = 0 Jul 03 09:49:38.245023 np0000004400 cinder-backup[101319]: iface.hwaddress = Jul 03 09:49:38.245023 np0000004400 cinder-backup[101319]: iface.transport_name = tcp Jul 03 09:49:38.245023 np0000004400 cinder-backup[101319]: iface.initiatorname = Jul 03 09:49:38.245023 np0000004400 cinder-backup[101319]: iface.state = Jul 03 09:49:38.245023 np0000004400 cinder-backup[101319]: iface.vlan_id = 0 Jul 03 09:49:38.245023 np0000004400 cinder-backup[101319]: iface.vlan_priority = 0 Jul 03 09:49:38.245023 np0000004400 cinder-backup[101319]: iface.vlan_state = Jul 03 09:49:38.245023 np0000004400 cinder-backup[101319]: iface.iface_num = 0 Jul 03 09:49:38.245023 np0000004400 cinder-backup[101319]: iface.mtu = 0 Jul 03 09:49:38.245023 np0000004400 cinder-backup[101319]: iface.port = 0 Jul 03 09:49:38.245023 np0000004400 cinder-backup[101319]: iface.bootproto = Jul 03 09:49:38.245023 np0000004400 cinder-backup[101319]: iface.subnet_mask = Jul 03 09:49:38.245023 np0000004400 cinder-backup[101319]: iface.gateway = Jul 03 09:49:38.245023 np0000004400 cinder-backup[101319]: iface.dhcp_alt_client_id_state = Jul 03 09:49:38.245023 np0000004400 cinder-backup[101319]: iface.dhcp_alt_client_id = Jul 03 09:49:38.245023 np0000004400 cinder-backup[101319]: iface.dhcp_dns = Jul 03 09:49:38.245023 np0000004400 cinder-backup[101319]: iface.dhcp_learn_iqn = Jul 03 09:49:38.245023 np0000004400 cinder-backup[101319]: iface.dhcp_req_vendor_id_state = Jul 03 09:49:38.245023 np0000004400 cinder-backup[101319]: iface.dhcp_vendor_id_state = Jul 03 09:49:38.245023 np0000004400 cinder-backup[101319]: iface.dhcp_vendor_id = Jul 03 09:49:38.245023 np0000004400 cinder-backup[101319]: iface.dhcp_slp_da = Jul 03 09:49:38.245023 np0000004400 cinder-backup[101319]: iface.fragmentation = Jul 03 09:49:38.245023 np0000004400 cinder-backup[101319]: iface.gratuitous_arp = Jul 03 09:49:38.245023 np0000004400 cinder-backup[101319]: iface.incoming_forwarding = Jul 03 09:49:38.245023 np0000004400 cinder-backup[101319]: iface.tos_state = Jul 03 09:49:38.245023 np0000004400 cinder-backup[101319]: iface.tos = 0 Jul 03 09:49:38.245023 np0000004400 cinder-backup[101319]: iface.ttl = 0 Jul 03 09:49:38.245023 np0000004400 cinder-backup[101319]: iface.delayed_ack = Jul 03 09:49:38.245023 np0000004400 cinder-backup[101319]: iface.tcp_nagle = Jul 03 09:49:38.245023 np0000004400 cinder-backup[101319]: iface.tcp_wsf_state = Jul 03 09:49:38.245023 np0000004400 cinder-backup[101319]: iface.tcp_wsf = 0 Jul 03 09:49:38.245023 np0000004400 cinder-backup[101319]: iface.tcp_timer_scale = 0 Jul 03 09:49:38.245023 np0000004400 cinder-backup[101319]: iface.tcp_timestamp = Jul 03 09:49:38.245023 np0000004400 cinder-backup[101319]: iface.redirect = Jul 03 09:49:38.245023 np0000004400 cinder-backup[101319]: iface.def_task_mgmt_timeout = 0 Jul 03 09:49:38.245023 np0000004400 cinder-backup[101319]: iface.header_digest = Jul 03 09:49:38.245023 np0000004400 cinder-backup[101319]: iface.data_digest = Jul 03 09:49:38.245023 np0000004400 cinder-backup[101319]: iface.immediate_data = Jul 03 09:49:38.245023 np0000004400 cinder-backup[101319]: iface.initial_r2t = Jul 03 09:49:38.245023 np0000004400 cinder-backup[101319]: iface.data_seq_inorder = Jul 03 09:49:38.245023 np0000004400 cinder-backup[101319]: iface.data_pdu_inorder = Jul 03 09:49:38.245023 np0000004400 cinder-backup[101319]: iface.erl = 0 Jul 03 09:49:38.245023 np0000004400 cinder-backup[101319]: iface.max_receive_data_len = 0 Jul 03 09:49:38.245023 np0000004400 cinder-backup[101319]: iface.first_burst_len = 0 Jul 03 09:49:38.245023 np0000004400 cinder-backup[101319]: iface.max_outstanding_r2t = 0 Jul 03 09:49:38.245023 np0000004400 cinder-backup[101319]: iface.max_burst_len = 0 Jul 03 09:49:38.245023 np0000004400 cinder-backup[101319]: iface.chap_auth = Jul 03 09:49:38.245023 np0000004400 cinder-backup[101319]: iface.bidi_chap = Jul 03 09:49:38.245023 np0000004400 cinder-backup[101319]: iface.strict_login_compliance = Jul 03 09:49:38.245023 np0000004400 cinder-backup[101319]: iface.discovery_auth = Jul 03 09:49:38.245023 np0000004400 cinder-backup[101319]: iface.discovery_logout = Jul 03 09:49:38.245023 np0000004400 cinder-backup[101319]: node.discovery_address = Jul 03 09:49:38.245023 np0000004400 cinder-backup[101319]: node.discovery_port = 0 Jul 03 09:49:38.245023 np0000004400 cinder-backup[101319]: node.discovery_type = fw Jul 03 09:49:38.245023 np0000004400 cinder-backup[101319]: node.session.initial_cmdsn = 0 Jul 03 09:49:38.245023 np0000004400 cinder-backup[101319]: node.session.initial_login_retry_max = 8 Jul 03 09:49:38.245023 np0000004400 cinder-backup[101319]: node.session.xmit_thread_priority = 0 Jul 03 09:49:38.245023 np0000004400 cinder-backup[101319]: node.session.cmds_max = 128 Jul 03 09:49:38.245023 np0000004400 cinder-backup[101319]: node.session.queue_depth = 32 Jul 03 09:49:38.245023 np0000004400 cinder-backup[101319]: node.session.nr_sessions = 1 Jul 03 09:49:38.245023 np0000004400 cinder-backup[101319]: node.session.auth.authmethod = None Jul 03 09:49:38.245023 np0000004400 cinder-backup[101319]: node.session.auth.username = Jul 03 09:49:38.245023 np0000004400 cinder-backup[101319]: node.session.auth.password = *** Jul 03 09:49:38.245023 np0000004400 cinder-backup[101319]: node.session.auth.username_in = Jul 03 09:49:38.245023 np0000004400 cinder-backup[101319]: node.session.auth.password_in = Jul 03 09:49:38.245023 np0000004400 cinder-backup[101319]: node.session.auth.chap_algs = SHA256 Jul 03 09:49:38.245023 np0000004400 cinder-backup[101319]: node.session.timeo.replacement_timeout = 120 Jul 03 09:49:38.245023 np0000004400 cinder-backup[101319]: node.session.err_timeo.abort_timeout = 15 Jul 03 09:49:38.245023 np0000004400 cinder-backup[101319]: node.session.err_timeo.lu_reset_timeout = 30 Jul 03 09:49:38.245023 np0000004400 cinder-backup[101319]: node.session.err_timeo.tgt_reset_timeout = 30 Jul 03 09:49:38.245023 np0000004400 cinder-backup[101319]: node.session.err_timeo.host_reset_timeout = 60 Jul 03 09:49:38.245023 np0000004400 cinder-backup[101319]: node.session.iscsi.FastAbort = Yes Jul 03 09:49:38.245023 np0000004400 cinder-backup[101319]: node.session.iscsi.InitialR2T = No Jul 03 09:49:38.245023 np0000004400 cinder-backup[101319]: node.session.iscsi.ImmediateData = Yes Jul 03 09:49:38.245023 np0000004400 cinder-backup[101319]: node.session.iscsi.FirstBurstLength = 262144 Jul 03 09:49:38.245023 np0000004400 cinder-backup[101319]: node.session.iscsi.MaxBurstLength = 16776192 Jul 03 09:49:38.245023 np0000004400 cinder-backup[101319]: node.session.iscsi.DefaultTime2Retain = 0 Jul 03 09:49:38.245023 np0000004400 cinder-backup[101319]: node.session.iscsi.DefaultTime2Wait = 2 Jul 03 09:49:38.245023 np0000004400 cinder-backup[101319]: node.session.iscsi.MaxConnections = 1 Jul 03 09:49:38.245023 np0000004400 cinder-backup[101319]: node.session.iscsi.MaxOutstandingR2T = 1 Jul 03 09:49:38.245023 np0000004400 cinder-backup[101319]: node.session.iscsi.ERL = 0 Jul 03 09:49:38.245023 np0000004400 cinder-backup[101319]: node.session.scan = auto Jul 03 09:49:38.245023 np0000004400 cinder-backup[101319]: node.session.reopen_max = 0 Jul 03 09:49:38.245023 np0000004400 cinder-backup[101319]: node.conn[0].address = 192.168.40.100 Jul 03 09:49:38.245023 np0000004400 cinder-backup[101319]: node.conn[0].port = 3260 Jul 03 09:49:38.245023 np0000004400 cinder-backup[101319]: node.conn[0].startup = manual Jul 03 09:49:38.245023 np0000004400 cinder-backup[101319]: node.conn[0].tcp.window_size = 524288 Jul 03 09:49:38.245023 np0000004400 cinder-backup[101319]: node.conn[0].tcp.type_of_service = 0 Jul 03 09:49:38.245023 np0000004400 cinder-backup[101319]: node.conn[0].timeo.logout_timeout = 15 Jul 03 09:49:38.245023 np0000004400 cinder-backup[101319]: node.conn[0].timeo.login_timeout = 15 Jul 03 09:49:38.245023 np0000004400 cinder-backup[101319]: node.conn[0].timeo.auth_timeout = 45 Jul 03 09:49:38.245023 np0000004400 cinder-backup[101319]: node.conn[0].timeo.noop_out_interval = 5 Jul 03 09:49:38.245023 np0000004400 cinder-backup[101319]: node.conn[0].timeo.noop_out_timeout = 5 Jul 03 09:49:38.245023 np0000004400 cinder-backup[101319]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0 Jul 03 09:49:38.245023 np0000004400 cinder-backup[101319]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144 Jul 03 09:49:38.245023 np0000004400 cinder-backup[101319]: node.conn[0].iscsi.HeaderDigest = None Jul 03 09:49:38.245023 np0000004400 cinder-backup[101319]: node.conn[0].iscsi.DataDigest = None Jul 03 09:49:38.245023 np0000004400 cinder-backup[101319]: node.conn[0].iscsi.IFMarker = No Jul 03 09:49:38.245023 np0000004400 cinder-backup[101319]: node.conn[0].iscsi.OFMarker = No Jul 03 09:49:38.245023 np0000004400 cinder-backup[101319]: # END RECORD Jul 03 09:49:38.245023 np0000004400 cinder-backup[101319]: stderr= {{(pid=101319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 03 09:49:38.256104 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-c1357d40-0422-4ef5-9555-fe9514348482 tempest-VolumesSnapshotTestJSON-1856009199 None] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=101319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 03 09:49:38.267466 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-c1357d40-0422-4ef5-9555-fe9514348482 tempest-VolumesSnapshotTestJSON-1856009199 None] iscsiadm ('-m', 'session'): stdout=tcp: [147] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-6a9ae5e5-b04d-4c6d-84f2-0a422823a648 (non-flash) Jul 03 09:49:38.267466 np0000004400 cinder-backup[101319]: tcp: [148] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6a9ae5e5-b04d-4c6d-84f2-0a422823a648 (non-flash) Jul 03 09:49:38.267466 np0000004400 cinder-backup[101319]: stderr= {{(pid=101319) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jul 03 09:49:38.267688 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-c1357d40-0422-4ef5-9555-fe9514348482 tempest-VolumesSnapshotTestJSON-1856009199 None] iscsi session list stdout=tcp: [147] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-6a9ae5e5-b04d-4c6d-84f2-0a422823a648 (non-flash) Jul 03 09:49:38.267688 np0000004400 cinder-backup[101319]: tcp: [148] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6a9ae5e5-b04d-4c6d-84f2-0a422823a648 (non-flash) Jul 03 09:49:38.267688 np0000004400 cinder-backup[101319]: stderr= {{(pid=101319) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jul 03 09:49:38.297793 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-c1357d40-0422-4ef5-9555-fe9514348482 tempest-VolumesSnapshotTestJSON-1856009199 None] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-5d8d0f67-678e-41af-8039-de91e51e7d59, portal: 192.168.40.100,3260] Jul 03 09:49:38.297793 np0000004400 cinder-backup[101319]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-5d8d0f67-678e-41af-8039-de91e51e7d59, portal: 192.168.40.100,3260] successful. Jul 03 09:49:38.297793 np0000004400 cinder-backup[101319]: stderr= {{(pid=101319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 03 09:49:38.308492 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-c1357d40-0422-4ef5-9555-fe9514348482 tempest-VolumesSnapshotTestJSON-1856009199 None] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=101319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 03 09:49:38.320333 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-c1357d40-0422-4ef5-9555-fe9514348482 tempest-VolumesSnapshotTestJSON-1856009199 None] iscsiadm ('-m', 'session'): stdout=tcp: [147] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-6a9ae5e5-b04d-4c6d-84f2-0a422823a648 (non-flash) Jul 03 09:49:38.320333 np0000004400 cinder-backup[101319]: tcp: [148] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6a9ae5e5-b04d-4c6d-84f2-0a422823a648 (non-flash) Jul 03 09:49:38.320333 np0000004400 cinder-backup[101319]: tcp: [149] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5d8d0f67-678e-41af-8039-de91e51e7d59 (non-flash) Jul 03 09:49:38.320333 np0000004400 cinder-backup[101319]: stderr= {{(pid=101319) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jul 03 09:49:38.320629 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-c1357d40-0422-4ef5-9555-fe9514348482 tempest-VolumesSnapshotTestJSON-1856009199 None] iscsi session list stdout=tcp: [147] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-6a9ae5e5-b04d-4c6d-84f2-0a422823a648 (non-flash) Jul 03 09:49:38.320629 np0000004400 cinder-backup[101319]: tcp: [148] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6a9ae5e5-b04d-4c6d-84f2-0a422823a648 (non-flash) Jul 03 09:49:38.320629 np0000004400 cinder-backup[101319]: tcp: [149] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5d8d0f67-678e-41af-8039-de91e51e7d59 (non-flash) Jul 03 09:49:38.320629 np0000004400 cinder-backup[101319]: stderr= {{(pid=101319) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jul 03 09:49:38.321006 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.base [None req-c1357d40-0422-4ef5-9555-fe9514348482 tempest-VolumesSnapshotTestJSON-1856009199 None] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-5d8d0f67-678e-41af-8039-de91e51e7d59" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.109s {{(pid=101319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jul 03 09:49:38.321196 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-c1357d40-0422-4ef5-9555-fe9514348482 tempest-VolumesSnapshotTestJSON-1856009199 None] Connected to 192.168.40.100:3260 {{(pid=101319) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}} Jul 03 09:49:38.322013 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.linuxscsi [None req-c1357d40-0422-4ef5-9555-fe9514348482 tempest-VolumesSnapshotTestJSON-1856009199 None] HCTL ('9', '-', '-', 0) found on session 149 with lun 0 {{(pid=101319) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}} Jul 03 09:49:38.322195 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.linuxscsi [None req-c1357d40-0422-4ef5-9555-fe9514348482 tempest-VolumesSnapshotTestJSON-1856009199 None] Scanning host 9 c: -, t: -, l: 0) {{(pid=101319) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}} Jul 03 09:49:38.334824 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.linuxscsi [None req-c1357d40-0422-4ef5-9555-fe9514348482 tempest-VolumesSnapshotTestJSON-1856009199 None] Searching for a device in session 149 and hctl ['9', '*', '*', 0] yield: sdd {{(pid=101319) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}} Jul 03 09:49:38.334824 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-c1357d40-0422-4ef5-9555-fe9514348482 tempest-VolumesSnapshotTestJSON-1856009199 None] Connected to sdd using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-5d8d0f67-678e-41af-8039-de91e51e7d59', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '5d8d0f67-678e-41af-8039-de91e51e7d59', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': False} {{(pid=101319) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}} Jul 03 09:49:39.337240 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.base [None req-c1357d40-0422-4ef5-9555-fe9514348482 tempest-VolumesSnapshotTestJSON-1856009199 None] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 2.137s {{(pid=101319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jul 03 09:49:39.337679 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-c1357d40-0422-4ef5-9555-fe9514348482 tempest-VolumesSnapshotTestJSON-1856009199 None] <== connect_volume: return (2137ms) {'type': 'block', 'scsi_wwn': '33000000000e2b07f', 'path': '/dev/sdd'} {{(pid=101319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}} Jul 03 09:49:39.337857 np0000004400 cinder-backup[101319]: DEBUG oslo_concurrency.processutils [None req-c1357d40-0422-4ef5-9555-fe9514348482 tempest-VolumesSnapshotTestJSON-1856009199 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chown 1002 /dev/sdd {{(pid=101319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 09:49:39.355115 np0000004400 sudo[146020]: stack : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chown 1002 /dev/sdd Jul 03 09:49:39.355734 np0000004400 sudo[146020]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1002) Jul 03 09:49:39.657319 np0000004400 sudo[146020]: pam_unix(sudo:session): session closed for user root Jul 03 09:49:39.659754 np0000004400 cinder-backup[101319]: DEBUG oslo_concurrency.processutils [None req-c1357d40-0422-4ef5-9555-fe9514348482 tempest-VolumesSnapshotTestJSON-1856009199 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chown 1002 /dev/sdd" returned: 0 in 0.321s {{(pid=101319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 09:49:39.704146 np0000004400 cinder-backup[101319]: DEBUG oslo_db.sqlalchemy.engines [None req-c1357d40-0422-4ef5-9555-fe9514348482 tempest-VolumesSnapshotTestJSON-1856009199 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=101319) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 03 09:49:39.709814 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-c1357d40-0422-4ef5-9555-fe9514348482 tempest-VolumesSnapshotTestJSON-1856009199 None] _create_container started, container: tempest-volumessnapshottestjson-backup-container-489263271,backup: f02acbcb-92f6-490b-9c9d-afe87bc4a5e0. {{(pid=101319) _create_container /opt/stack/cinder/cinder/backup/chunkeddriver.py:249}} Jul 03 09:49:39.821083 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.drivers.swift [None req-c1357d40-0422-4ef5-9555-fe9514348482 tempest-VolumesSnapshotTestJSON-1856009199 None] generate_object_name_prefix: volume_89470c05-4a76-41e8-b5cb-f969bb59ce72/20260703094939/az_nova_backup_f02acbcb-92f6-490b-9c9d-afe87bc4a5e0 {{(pid=101319) _generate_object_name_prefix /opt/stack/cinder/cinder/backup/drivers/swift.py:452}} Jul 03 09:49:39.825814 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-c1357d40-0422-4ef5-9555-fe9514348482 tempest-VolumesSnapshotTestJSON-1856009199 None] starting backup of volume: 89470c05-4a76-41e8-b5cb-f969bb59ce72, volume size: 1073741824, object names prefix volume_89470c05-4a76-41e8-b5cb-f969bb59ce72/20260703094939/az_nova_backup_f02acbcb-92f6-490b-9c9d-afe87bc4a5e0, availability zone: nova {{(pid=101319) _prepare_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:359}} Jul 03 09:49:40.017072 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-c1357d40-0422-4ef5-9555-fe9514348482 tempest-VolumesSnapshotTestJSON-1856009199 None] Backing up chunk of data from volume. {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 09:49:40.259223 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-c1357d40-0422-4ef5-9555-fe9514348482 tempest-VolumesSnapshotTestJSON-1856009199 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101319) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 09:49:40.259569 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-c1357d40-0422-4ef5-9555-fe9514348482 tempest-VolumesSnapshotTestJSON-1856009199 None] About to put_object {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 09:49:40.365096 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-c1357d40-0422-4ef5-9555-fe9514348482 tempest-VolumesSnapshotTestJSON-1856009199 None] backup MD5 for volume_89470c05-4a76-41e8-b5cb-f969bb59ce72/20260703094939/az_nova_backup_f02acbcb-92f6-490b-9c9d-afe87bc4a5e0-00001: 25e317773f308e446cc84c503a6d1f85 {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 09:49:40.365518 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-c1357d40-0422-4ef5-9555-fe9514348482 tempest-VolumesSnapshotTestJSON-1856009199 None] Calling eventlet.sleep(0) {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 09:49:40.371630 np0000004400 cinder-backup[101319]: DEBUG oslo_service.periodic_task [None req-ffd932d2-122c-4e68-b5ba-628aff7ae7b8 None None] Running periodic task BackupManager.publish_service_capabilities {{(pid=101319) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 03 09:49:40.371926 np0000004400 cinder-backup[101319]: DEBUG cinder.manager [None req-ffd932d2-122c-4e68-b5ba-628aff7ae7b8 None None] Notifying Schedulers of capabilities ... {{(pid=101319) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 03 09:49:40.547067 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-c1357d40-0422-4ef5-9555-fe9514348482 tempest-VolumesSnapshotTestJSON-1856009199 None] Backing up chunk of data from volume. {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 09:49:40.785455 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-c1357d40-0422-4ef5-9555-fe9514348482 tempest-VolumesSnapshotTestJSON-1856009199 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101319) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 09:49:40.785614 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-c1357d40-0422-4ef5-9555-fe9514348482 tempest-VolumesSnapshotTestJSON-1856009199 None] About to put_object {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 09:49:40.896071 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-c1357d40-0422-4ef5-9555-fe9514348482 tempest-VolumesSnapshotTestJSON-1856009199 None] backup MD5 for volume_89470c05-4a76-41e8-b5cb-f969bb59ce72/20260703094939/az_nova_backup_f02acbcb-92f6-490b-9c9d-afe87bc4a5e0-00002: 25e317773f308e446cc84c503a6d1f85 {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 09:49:40.896293 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-c1357d40-0422-4ef5-9555-fe9514348482 tempest-VolumesSnapshotTestJSON-1856009199 None] Calling eventlet.sleep(0) {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 09:49:41.097428 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-c1357d40-0422-4ef5-9555-fe9514348482 tempest-VolumesSnapshotTestJSON-1856009199 None] Backing up chunk of data from volume. {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 09:49:41.344219 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-c1357d40-0422-4ef5-9555-fe9514348482 tempest-VolumesSnapshotTestJSON-1856009199 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101319) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 09:49:41.344219 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-c1357d40-0422-4ef5-9555-fe9514348482 tempest-VolumesSnapshotTestJSON-1856009199 None] About to put_object {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 09:49:41.441422 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-c1357d40-0422-4ef5-9555-fe9514348482 tempest-VolumesSnapshotTestJSON-1856009199 None] backup MD5 for volume_89470c05-4a76-41e8-b5cb-f969bb59ce72/20260703094939/az_nova_backup_f02acbcb-92f6-490b-9c9d-afe87bc4a5e0-00003: 25e317773f308e446cc84c503a6d1f85 {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 09:49:41.441422 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-c1357d40-0422-4ef5-9555-fe9514348482 tempest-VolumesSnapshotTestJSON-1856009199 None] Calling eventlet.sleep(0) {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 09:49:41.613036 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-c1357d40-0422-4ef5-9555-fe9514348482 tempest-VolumesSnapshotTestJSON-1856009199 None] Backing up chunk of data from volume. {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 09:49:41.853533 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-c1357d40-0422-4ef5-9555-fe9514348482 tempest-VolumesSnapshotTestJSON-1856009199 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101319) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 09:49:41.853533 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-c1357d40-0422-4ef5-9555-fe9514348482 tempest-VolumesSnapshotTestJSON-1856009199 None] About to put_object {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 09:49:41.954730 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-c1357d40-0422-4ef5-9555-fe9514348482 tempest-VolumesSnapshotTestJSON-1856009199 None] backup MD5 for volume_89470c05-4a76-41e8-b5cb-f969bb59ce72/20260703094939/az_nova_backup_f02acbcb-92f6-490b-9c9d-afe87bc4a5e0-00004: 25e317773f308e446cc84c503a6d1f85 {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 09:49:41.954919 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-c1357d40-0422-4ef5-9555-fe9514348482 tempest-VolumesSnapshotTestJSON-1856009199 None] Calling eventlet.sleep(0) {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 09:49:42.131007 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-c1357d40-0422-4ef5-9555-fe9514348482 tempest-VolumesSnapshotTestJSON-1856009199 None] Backing up chunk of data from volume. {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 09:49:42.370356 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-c1357d40-0422-4ef5-9555-fe9514348482 tempest-VolumesSnapshotTestJSON-1856009199 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101319) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 09:49:42.370686 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-c1357d40-0422-4ef5-9555-fe9514348482 tempest-VolumesSnapshotTestJSON-1856009199 None] About to put_object {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 09:49:42.467108 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-c1357d40-0422-4ef5-9555-fe9514348482 tempest-VolumesSnapshotTestJSON-1856009199 None] backup MD5 for volume_89470c05-4a76-41e8-b5cb-f969bb59ce72/20260703094939/az_nova_backup_f02acbcb-92f6-490b-9c9d-afe87bc4a5e0-00005: 25e317773f308e446cc84c503a6d1f85 {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 09:49:42.467590 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-c1357d40-0422-4ef5-9555-fe9514348482 tempest-VolumesSnapshotTestJSON-1856009199 None] Calling eventlet.sleep(0) {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 09:49:42.646315 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-c1357d40-0422-4ef5-9555-fe9514348482 tempest-VolumesSnapshotTestJSON-1856009199 None] Backing up chunk of data from volume. {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 09:49:42.890136 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-c1357d40-0422-4ef5-9555-fe9514348482 tempest-VolumesSnapshotTestJSON-1856009199 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101319) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 09:49:42.890136 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-c1357d40-0422-4ef5-9555-fe9514348482 tempest-VolumesSnapshotTestJSON-1856009199 None] About to put_object {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 09:49:42.988513 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-c1357d40-0422-4ef5-9555-fe9514348482 tempest-VolumesSnapshotTestJSON-1856009199 None] backup MD5 for volume_89470c05-4a76-41e8-b5cb-f969bb59ce72/20260703094939/az_nova_backup_f02acbcb-92f6-490b-9c9d-afe87bc4a5e0-00006: 25e317773f308e446cc84c503a6d1f85 {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 09:49:42.988703 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-c1357d40-0422-4ef5-9555-fe9514348482 tempest-VolumesSnapshotTestJSON-1856009199 None] Calling eventlet.sleep(0) {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 09:49:43.167108 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-c1357d40-0422-4ef5-9555-fe9514348482 tempest-VolumesSnapshotTestJSON-1856009199 None] Backing up chunk of data from volume. {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 09:49:43.405140 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-c1357d40-0422-4ef5-9555-fe9514348482 tempest-VolumesSnapshotTestJSON-1856009199 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101319) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 09:49:43.405314 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-c1357d40-0422-4ef5-9555-fe9514348482 tempest-VolumesSnapshotTestJSON-1856009199 None] About to put_object {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 09:49:43.501944 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-c1357d40-0422-4ef5-9555-fe9514348482 tempest-VolumesSnapshotTestJSON-1856009199 None] backup MD5 for volume_89470c05-4a76-41e8-b5cb-f969bb59ce72/20260703094939/az_nova_backup_f02acbcb-92f6-490b-9c9d-afe87bc4a5e0-00007: 25e317773f308e446cc84c503a6d1f85 {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 09:49:43.502402 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-c1357d40-0422-4ef5-9555-fe9514348482 tempest-VolumesSnapshotTestJSON-1856009199 None] Calling eventlet.sleep(0) {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 09:49:43.668464 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-c1357d40-0422-4ef5-9555-fe9514348482 tempest-VolumesSnapshotTestJSON-1856009199 None] Backing up chunk of data from volume. {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 09:49:43.909543 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-c1357d40-0422-4ef5-9555-fe9514348482 tempest-VolumesSnapshotTestJSON-1856009199 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101319) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 09:49:43.909760 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-c1357d40-0422-4ef5-9555-fe9514348482 tempest-VolumesSnapshotTestJSON-1856009199 None] About to put_object {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 09:49:44.008299 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-c1357d40-0422-4ef5-9555-fe9514348482 tempest-VolumesSnapshotTestJSON-1856009199 None] backup MD5 for volume_89470c05-4a76-41e8-b5cb-f969bb59ce72/20260703094939/az_nova_backup_f02acbcb-92f6-490b-9c9d-afe87bc4a5e0-00008: 25e317773f308e446cc84c503a6d1f85 {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 09:49:44.008494 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-c1357d40-0422-4ef5-9555-fe9514348482 tempest-VolumesSnapshotTestJSON-1856009199 None] Calling eventlet.sleep(0) {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 09:49:44.174784 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-c1357d40-0422-4ef5-9555-fe9514348482 tempest-VolumesSnapshotTestJSON-1856009199 None] Backing up chunk of data from volume. {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 09:49:44.437101 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-c1357d40-0422-4ef5-9555-fe9514348482 tempest-VolumesSnapshotTestJSON-1856009199 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101319) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 09:49:44.437270 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-c1357d40-0422-4ef5-9555-fe9514348482 tempest-VolumesSnapshotTestJSON-1856009199 None] About to put_object {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 09:49:44.546899 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-c1357d40-0422-4ef5-9555-fe9514348482 tempest-VolumesSnapshotTestJSON-1856009199 None] backup MD5 for volume_89470c05-4a76-41e8-b5cb-f969bb59ce72/20260703094939/az_nova_backup_f02acbcb-92f6-490b-9c9d-afe87bc4a5e0-00009: 25e317773f308e446cc84c503a6d1f85 {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 09:49:44.547348 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-c1357d40-0422-4ef5-9555-fe9514348482 tempest-VolumesSnapshotTestJSON-1856009199 None] Calling eventlet.sleep(0) {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 09:49:44.721937 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-c1357d40-0422-4ef5-9555-fe9514348482 tempest-VolumesSnapshotTestJSON-1856009199 None] Backing up chunk of data from volume. {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 09:49:44.968905 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-c1357d40-0422-4ef5-9555-fe9514348482 tempest-VolumesSnapshotTestJSON-1856009199 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101319) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 09:49:44.969073 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-c1357d40-0422-4ef5-9555-fe9514348482 tempest-VolumesSnapshotTestJSON-1856009199 None] About to put_object {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 09:49:45.070011 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-c1357d40-0422-4ef5-9555-fe9514348482 tempest-VolumesSnapshotTestJSON-1856009199 None] backup MD5 for volume_89470c05-4a76-41e8-b5cb-f969bb59ce72/20260703094939/az_nova_backup_f02acbcb-92f6-490b-9c9d-afe87bc4a5e0-00010: 25e317773f308e446cc84c503a6d1f85 {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 09:49:45.070140 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-c1357d40-0422-4ef5-9555-fe9514348482 tempest-VolumesSnapshotTestJSON-1856009199 None] Calling eventlet.sleep(0) {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 09:49:45.248436 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-c1357d40-0422-4ef5-9555-fe9514348482 tempest-VolumesSnapshotTestJSON-1856009199 None] Backing up chunk of data from volume. {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 09:49:45.499821 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-c1357d40-0422-4ef5-9555-fe9514348482 tempest-VolumesSnapshotTestJSON-1856009199 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101319) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 09:49:45.500364 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-c1357d40-0422-4ef5-9555-fe9514348482 tempest-VolumesSnapshotTestJSON-1856009199 None] About to put_object {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 09:49:45.598161 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-c1357d40-0422-4ef5-9555-fe9514348482 tempest-VolumesSnapshotTestJSON-1856009199 None] backup MD5 for volume_89470c05-4a76-41e8-b5cb-f969bb59ce72/20260703094939/az_nova_backup_f02acbcb-92f6-490b-9c9d-afe87bc4a5e0-00011: 25e317773f308e446cc84c503a6d1f85 {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 09:49:45.598161 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-c1357d40-0422-4ef5-9555-fe9514348482 tempest-VolumesSnapshotTestJSON-1856009199 None] Calling eventlet.sleep(0) {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 09:49:45.769955 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-c1357d40-0422-4ef5-9555-fe9514348482 tempest-VolumesSnapshotTestJSON-1856009199 None] Backing up chunk of data from volume. {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 09:49:46.033573 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-c1357d40-0422-4ef5-9555-fe9514348482 tempest-VolumesSnapshotTestJSON-1856009199 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101319) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 09:49:46.033745 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-c1357d40-0422-4ef5-9555-fe9514348482 tempest-VolumesSnapshotTestJSON-1856009199 None] About to put_object {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 09:49:46.136291 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-c1357d40-0422-4ef5-9555-fe9514348482 tempest-VolumesSnapshotTestJSON-1856009199 None] backup MD5 for volume_89470c05-4a76-41e8-b5cb-f969bb59ce72/20260703094939/az_nova_backup_f02acbcb-92f6-490b-9c9d-afe87bc4a5e0-00012: 25e317773f308e446cc84c503a6d1f85 {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 09:49:46.136490 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-c1357d40-0422-4ef5-9555-fe9514348482 tempest-VolumesSnapshotTestJSON-1856009199 None] Calling eventlet.sleep(0) {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 09:49:46.340709 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-c1357d40-0422-4ef5-9555-fe9514348482 tempest-VolumesSnapshotTestJSON-1856009199 None] Backing up chunk of data from volume. {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 09:49:46.589048 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-c1357d40-0422-4ef5-9555-fe9514348482 tempest-VolumesSnapshotTestJSON-1856009199 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101319) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 09:49:46.589184 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-c1357d40-0422-4ef5-9555-fe9514348482 tempest-VolumesSnapshotTestJSON-1856009199 None] About to put_object {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 09:49:46.688461 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-c1357d40-0422-4ef5-9555-fe9514348482 tempest-VolumesSnapshotTestJSON-1856009199 None] backup MD5 for volume_89470c05-4a76-41e8-b5cb-f969bb59ce72/20260703094939/az_nova_backup_f02acbcb-92f6-490b-9c9d-afe87bc4a5e0-00013: 25e317773f308e446cc84c503a6d1f85 {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 09:49:46.688839 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-c1357d40-0422-4ef5-9555-fe9514348482 tempest-VolumesSnapshotTestJSON-1856009199 None] Calling eventlet.sleep(0) {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 09:49:46.872574 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-c1357d40-0422-4ef5-9555-fe9514348482 tempest-VolumesSnapshotTestJSON-1856009199 None] Backing up chunk of data from volume. {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 09:49:47.110926 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-c1357d40-0422-4ef5-9555-fe9514348482 tempest-VolumesSnapshotTestJSON-1856009199 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101319) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 09:49:47.111064 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-c1357d40-0422-4ef5-9555-fe9514348482 tempest-VolumesSnapshotTestJSON-1856009199 None] About to put_object {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 09:49:47.207723 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-c1357d40-0422-4ef5-9555-fe9514348482 tempest-VolumesSnapshotTestJSON-1856009199 None] backup MD5 for volume_89470c05-4a76-41e8-b5cb-f969bb59ce72/20260703094939/az_nova_backup_f02acbcb-92f6-490b-9c9d-afe87bc4a5e0-00014: 25e317773f308e446cc84c503a6d1f85 {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 09:49:47.207862 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-c1357d40-0422-4ef5-9555-fe9514348482 tempest-VolumesSnapshotTestJSON-1856009199 None] Calling eventlet.sleep(0) {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 09:49:47.370656 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-c1357d40-0422-4ef5-9555-fe9514348482 tempest-VolumesSnapshotTestJSON-1856009199 None] Backing up chunk of data from volume. {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 09:49:47.609311 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-c1357d40-0422-4ef5-9555-fe9514348482 tempest-VolumesSnapshotTestJSON-1856009199 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101319) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 09:49:47.609471 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-c1357d40-0422-4ef5-9555-fe9514348482 tempest-VolumesSnapshotTestJSON-1856009199 None] About to put_object {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 09:49:47.705663 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-c1357d40-0422-4ef5-9555-fe9514348482 tempest-VolumesSnapshotTestJSON-1856009199 None] backup MD5 for volume_89470c05-4a76-41e8-b5cb-f969bb59ce72/20260703094939/az_nova_backup_f02acbcb-92f6-490b-9c9d-afe87bc4a5e0-00015: 25e317773f308e446cc84c503a6d1f85 {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 09:49:47.706156 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-c1357d40-0422-4ef5-9555-fe9514348482 tempest-VolumesSnapshotTestJSON-1856009199 None] Calling eventlet.sleep(0) {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 09:49:47.900122 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-c1357d40-0422-4ef5-9555-fe9514348482 tempest-VolumesSnapshotTestJSON-1856009199 None] Backing up chunk of data from volume. {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 09:49:48.137899 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-c1357d40-0422-4ef5-9555-fe9514348482 tempest-VolumesSnapshotTestJSON-1856009199 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101319) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 09:49:48.138044 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-c1357d40-0422-4ef5-9555-fe9514348482 tempest-VolumesSnapshotTestJSON-1856009199 None] About to put_object {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 09:49:48.244345 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-c1357d40-0422-4ef5-9555-fe9514348482 tempest-VolumesSnapshotTestJSON-1856009199 None] backup MD5 for volume_89470c05-4a76-41e8-b5cb-f969bb59ce72/20260703094939/az_nova_backup_f02acbcb-92f6-490b-9c9d-afe87bc4a5e0-00016: 25e317773f308e446cc84c503a6d1f85 {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 09:49:48.244577 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-c1357d40-0422-4ef5-9555-fe9514348482 tempest-VolumesSnapshotTestJSON-1856009199 None] Calling eventlet.sleep(0) {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 09:49:48.440121 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-c1357d40-0422-4ef5-9555-fe9514348482 tempest-VolumesSnapshotTestJSON-1856009199 None] Backing up chunk of data from volume. {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 09:49:48.676459 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-c1357d40-0422-4ef5-9555-fe9514348482 tempest-VolumesSnapshotTestJSON-1856009199 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101319) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 09:49:48.676607 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-c1357d40-0422-4ef5-9555-fe9514348482 tempest-VolumesSnapshotTestJSON-1856009199 None] About to put_object {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 09:49:48.774099 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-c1357d40-0422-4ef5-9555-fe9514348482 tempest-VolumesSnapshotTestJSON-1856009199 None] backup MD5 for volume_89470c05-4a76-41e8-b5cb-f969bb59ce72/20260703094939/az_nova_backup_f02acbcb-92f6-490b-9c9d-afe87bc4a5e0-00017: 25e317773f308e446cc84c503a6d1f85 {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 09:49:48.774497 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-c1357d40-0422-4ef5-9555-fe9514348482 tempest-VolumesSnapshotTestJSON-1856009199 None] Calling eventlet.sleep(0) {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 09:49:48.948425 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-c1357d40-0422-4ef5-9555-fe9514348482 tempest-VolumesSnapshotTestJSON-1856009199 None] Backing up chunk of data from volume. {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 09:49:49.188554 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-c1357d40-0422-4ef5-9555-fe9514348482 tempest-VolumesSnapshotTestJSON-1856009199 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101319) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 09:49:49.188681 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-c1357d40-0422-4ef5-9555-fe9514348482 tempest-VolumesSnapshotTestJSON-1856009199 None] About to put_object {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 09:49:49.285304 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-c1357d40-0422-4ef5-9555-fe9514348482 tempest-VolumesSnapshotTestJSON-1856009199 None] backup MD5 for volume_89470c05-4a76-41e8-b5cb-f969bb59ce72/20260703094939/az_nova_backup_f02acbcb-92f6-490b-9c9d-afe87bc4a5e0-00018: 25e317773f308e446cc84c503a6d1f85 {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 09:49:49.285500 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-c1357d40-0422-4ef5-9555-fe9514348482 tempest-VolumesSnapshotTestJSON-1856009199 None] Calling eventlet.sleep(0) {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 09:49:49.469283 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-c1357d40-0422-4ef5-9555-fe9514348482 tempest-VolumesSnapshotTestJSON-1856009199 None] Backing up chunk of data from volume. {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 09:49:49.710962 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-c1357d40-0422-4ef5-9555-fe9514348482 tempest-VolumesSnapshotTestJSON-1856009199 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101319) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 09:49:49.711135 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-c1357d40-0422-4ef5-9555-fe9514348482 tempest-VolumesSnapshotTestJSON-1856009199 None] About to put_object {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 09:49:49.811660 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-c1357d40-0422-4ef5-9555-fe9514348482 tempest-VolumesSnapshotTestJSON-1856009199 None] backup MD5 for volume_89470c05-4a76-41e8-b5cb-f969bb59ce72/20260703094939/az_nova_backup_f02acbcb-92f6-490b-9c9d-afe87bc4a5e0-00019: 25e317773f308e446cc84c503a6d1f85 {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 09:49:49.811993 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-c1357d40-0422-4ef5-9555-fe9514348482 tempest-VolumesSnapshotTestJSON-1856009199 None] Calling eventlet.sleep(0) {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 09:49:49.988762 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-c1357d40-0422-4ef5-9555-fe9514348482 tempest-VolumesSnapshotTestJSON-1856009199 None] Backing up chunk of data from volume. {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 09:49:50.235980 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-c1357d40-0422-4ef5-9555-fe9514348482 tempest-VolumesSnapshotTestJSON-1856009199 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101319) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 09:49:50.236194 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-c1357d40-0422-4ef5-9555-fe9514348482 tempest-VolumesSnapshotTestJSON-1856009199 None] About to put_object {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 09:49:50.335097 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-c1357d40-0422-4ef5-9555-fe9514348482 tempest-VolumesSnapshotTestJSON-1856009199 None] backup MD5 for volume_89470c05-4a76-41e8-b5cb-f969bb59ce72/20260703094939/az_nova_backup_f02acbcb-92f6-490b-9c9d-afe87bc4a5e0-00020: 25e317773f308e446cc84c503a6d1f85 {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 09:49:50.335330 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-c1357d40-0422-4ef5-9555-fe9514348482 tempest-VolumesSnapshotTestJSON-1856009199 None] Calling eventlet.sleep(0) {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 09:49:50.423496 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-c1357d40-0422-4ef5-9555-fe9514348482 tempest-VolumesSnapshotTestJSON-1856009199 None] Backing up chunk of data from volume. {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 09:49:50.539343 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-c1357d40-0422-4ef5-9555-fe9514348482 tempest-VolumesSnapshotTestJSON-1856009199 None] Compressed 25165824 bytes of data to 24470 bytes using zlib. {{(pid=101319) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 09:49:50.539531 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-c1357d40-0422-4ef5-9555-fe9514348482 tempest-VolumesSnapshotTestJSON-1856009199 None] About to put_object {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 09:49:50.597478 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-c1357d40-0422-4ef5-9555-fe9514348482 tempest-VolumesSnapshotTestJSON-1856009199 None] backup MD5 for volume_89470c05-4a76-41e8-b5cb-f969bb59ce72/20260703094939/az_nova_backup_f02acbcb-92f6-490b-9c9d-afe87bc4a5e0-00021: 77377273b0a4b61febdbf7bbf52b9db9 {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 09:49:50.597793 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-c1357d40-0422-4ef5-9555-fe9514348482 tempest-VolumesSnapshotTestJSON-1856009199 None] Calling eventlet.sleep(0) {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 09:49:50.605425 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.driver [None req-c1357d40-0422-4ef5-9555-fe9514348482 tempest-VolumesSnapshotTestJSON-1856009199 None] Getting metadata type 'volume-base-metadata' {{(pid=101319) _save_vol_base_meta /opt/stack/cinder/cinder/backup/driver.py:79}} Jul 03 09:49:50.611046 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.driver [None req-c1357d40-0422-4ef5-9555-fe9514348482 tempest-VolumesSnapshotTestJSON-1856009199 None] Completed fetching metadata type 'volume-base-metadata' {{(pid=101319) _save_vol_base_meta /opt/stack/cinder/cinder/backup/driver.py:98}} Jul 03 09:49:50.611270 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.driver [None req-c1357d40-0422-4ef5-9555-fe9514348482 tempest-VolumesSnapshotTestJSON-1856009199 None] Getting metadata type 'volume-metadata' {{(pid=101319) _save_vol_meta /opt/stack/cinder/cinder/backup/driver.py:109}} Jul 03 09:49:50.615878 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.driver [None req-c1357d40-0422-4ef5-9555-fe9514348482 tempest-VolumesSnapshotTestJSON-1856009199 None] No metadata type 'volume-metadata' available {{(pid=101319) _save_vol_meta /opt/stack/cinder/cinder/backup/driver.py:123}} Jul 03 09:49:50.616091 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.driver [None req-c1357d40-0422-4ef5-9555-fe9514348482 tempest-VolumesSnapshotTestJSON-1856009199 None] Getting metadata type 'volume-glance-metadata' {{(pid=101319) _save_vol_glance_meta /opt/stack/cinder/cinder/backup/driver.py:132}} Jul 03 09:49:50.619181 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.driver [None req-c1357d40-0422-4ef5-9555-fe9514348482 tempest-VolumesSnapshotTestJSON-1856009199 None] No metadata type 'volume-glance-metadata' available {{(pid=101319) _save_vol_glance_meta /opt/stack/cinder/cinder/backup/driver.py:147}} Jul 03 09:49:50.619436 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-c1357d40-0422-4ef5-9555-fe9514348482 tempest-VolumesSnapshotTestJSON-1856009199 None] _write_sha256file started, container name: tempest-volumessnapshottestjson-backup-container-489263271, sha256file filename: volume_89470c05-4a76-41e8-b5cb-f969bb59ce72/20260703094939/az_nova_backup_f02acbcb-92f6-490b-9c9d-afe87bc4a5e0_sha256file. {{(pid=101319) _write_sha256file /opt/stack/cinder/cinder/backup/chunkeddriver.py:299}} Jul 03 09:49:50.673723 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-c1357d40-0422-4ef5-9555-fe9514348482 tempest-VolumesSnapshotTestJSON-1856009199 None] _write_sha256file finished. {{(pid=101319) _write_sha256file /opt/stack/cinder/cinder/backup/chunkeddriver.py:315}} Jul 03 09:49:50.674327 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-c1357d40-0422-4ef5-9555-fe9514348482 tempest-VolumesSnapshotTestJSON-1856009199 None] _write_metadata started, container name: tempest-volumessnapshottestjson-backup-container-489263271, metadata filename: volume_89470c05-4a76-41e8-b5cb-f969bb59ce72/20260703094939/az_nova_backup_f02acbcb-92f6-490b-9c9d-afe87bc4a5e0_metadata. {{(pid=101319) _write_metadata /opt/stack/cinder/cinder/backup/chunkeddriver.py:276}} Jul 03 09:49:50.696765 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-c1357d40-0422-4ef5-9555-fe9514348482 tempest-VolumesSnapshotTestJSON-1856009199 None] _write_metadata finished. Metadata: b'{\n "backup_description": null,\n "backup_id": "f02acbcb-92f6-490b-9c9d-afe87bc4a5e0",\n "backup_name": "tempest-VolumesSnapshotTestJSON-Backup-730309874",\n "created_at": "2026-07-03 09:49:37+00:00",\n "objects": [\n {\n "volume_89470c05-4a76-41e8-b5cb-f969bb59ce72/20260703094939/az_nova_backup_f02acbcb-92f6-490b-9c9d-afe87bc4a5e0-00001": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 0\n }\n },\n {\n "volume_89470c05-4a76-41e8-b5cb-f969bb59ce72/20260703094939/az_nova_backup_f02acbcb-92f6-490b-9c9d-afe87bc4a5e0-00002": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 52428800\n }\n },\n {\n "volume_89470c05-4a76-41e8-b5cb-f969bb59ce72/20260703094939/az_nova_backup_f02acbcb-92f6-490b-9c9d-afe87bc4a5e0-00003": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 104857600\n }\n },\n {\n "volume_89470c05-4a76-41e8-b5cb-f969bb59ce72/20260703094939/az_nova_backup_f02acbcb-92f6-490b-9c9d-afe87bc4a5e0-00004": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 157286400\n }\n },\n {\n "volume_89470c05-4a76-41e8-b5cb-f969bb59ce72/20260703094939/az_nova_backup_f02acbcb-92f6-490b-9c9d-afe87bc4a5e0-00005": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 209715200\n }\n },\n {\n "volume_89470c05-4a76-41e8-b5cb-f969bb59ce72/20260703094939/az_nova_backup_f02acbcb-92f6-490b-9c9d-afe87bc4a5e0-00006": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 262144000\n }\n },\n {\n "volume_89470c05-4a76-41e8-b5cb-f969bb59ce72/20260703094939/az_nova_backup_f02acbcb-92f6-490b-9c9d-afe87bc4a5e0-00007": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 314572800\n }\n },\n {\n "volume_89470c05-4a76-41e8-b5cb-f969bb59ce72/20260703094939/az_nova_backup_f02acbcb-92f6-490b-9c9d-afe87bc4a5e0-00008": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 367001600\n }\n },\n {\n "volume_89470c05-4a76-41e8-b5cb-f969bb59ce72/20260703094939/az_nova_backup_f02acbcb-92f6-490b-9c9d-afe87bc4a5e0-00009": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 419430400\n }\n },\n {\n "volume_89470c05-4a76-41e8-b5cb-f969bb59ce72/20260703094939/az_nova_backup_f02acbcb-92f6-490b-9c9d-afe87bc4a5e0-00010": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 471859200\n }\n },\n {\n "volume_89470c05-4a76-41e8-b5cb-f969bb59ce72/20260703094939/az_nova_backup_f02acbcb-92f6-490b-9c9d-afe87bc4a5e0-00011": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 524288000\n }\n },\n {\n "volume_89470c05-4a76-41e8-b5cb-f969bb59ce72/20260703094939/az_nova_backup_f02acbcb-92f6-490b-9c9d-afe87bc4a5e0-00012": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 576716800\n }\n },\n {\n "volume_89470c05-4a76-41e8-b5cb-f969bb59ce72/20260703094939/az_nova_backup_f02acbcb-92f6-490b-9c9d-afe87bc4a5e0-00013": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 629145600\n }\n },\n {\n "volume_89470c05-4a76-41e8-b5cb-f969bb59ce72/20260703094939/az_nova_backup_f02acbcb-92f6-490b-9c9d-afe87bc4a5e0-00014": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 681574400\n }\n },\n {\n "volume_89470c05-4a76-41e8-b5cb-f969bb59ce72/20260703094939/az_nova_backup_f02acbcb-92f6-490b-9c9d-afe87bc4a5e0-00015": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 734003200\n }\n },\n {\n "volume_89470c05-4a76-41e8-b5cb-f969bb59ce72/20260703094939/az_nova_backup_f02acbcb-92f6-490b-9c9d-afe87bc4a5e0-00016": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 786432000\n }\n },\n {\n "volume_89470c05-4a76-41e8-b5cb-f969bb59ce72/20260703094939/az_nova_backup_f02acbcb-92f6-490b-9c9d-afe87bc4a5e0-00017": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 838860800\n }\n },\n {\n "volume_89470c05-4a76-41e8-b5cb-f969bb59ce72/20260703094939/az_nova_backup_f02acbcb-92f6-490b-9c9d-afe87bc4a5e0-00018": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 891289600\n }\n },\n {\n "volume_89470c05-4a76-41e8-b5cb-f969bb59ce72/20260703094939/az_nova_backup_f02acbcb-92f6-490b-9c9d-afe87bc4a5e0-00019": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 943718400\n }\n },\n {\n "volume_89470c05-4a76-41e8-b5cb-f969bb59ce72/20260703094939/az_nova_backup_f02acbcb-92f6-490b-9c9d-afe87bc4a5e0-00020": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 996147200\n }\n },\n {\n "volume_89470c05-4a76-41e8-b5cb-f969bb59ce72/20260703094939/az_nova_backup_f02acbcb-92f6-490b-9c9d-afe87bc4a5e0-00021": {\n "compression": "zlib",\n "length": 25165824,\n "md5": "77377273b0a4b61febdbf7bbf52b9db9",\n "offset": 1048576000\n }\n }\n ],\n "parent_id": null,\n "version": "1.0.0",\n "volume_id": "89470c05-4a76-41e8-b5cb-f969bb59ce72",\n "volume_meta": "{\\"version\\": 2, \\"volume-base-metadata\\": {\\"id\\": \\"89470c05-4a76-41e8-b5cb-f969bb59ce72\\", \\"_name_id\\": null, \\"use_quota\\": true, \\"ec2_id\\": null, \\"user_id\\": \\"be16554eaca547c79f0d1fb80e58c3de\\", \\"project_id\\": \\"5895ffa0711d4d068874cf88aa93a069\\", \\"snapshot_id\\": null, \\"cluster_name\\": null, \\"host\\": \\"np0000004400@storpool#default\\", \\"size\\": 1, \\"availability_zone\\": \\"nova\\", \\"status\\": \\"available\\", \\"attach_status\\": \\"detached\\", \\"migration_status\\": null, \\"scheduled_at\\": \\"2026-07-03T09:49:34.000000\\", \\"launched_at\\": \\"2026-07-03T09:49:34.000000\\", \\"terminated_at\\": null, \\"display_name\\": \\"tempest-VolumesSnapshotTestJSON-Volume-974515673\\", \\"display_description\\": null, \\"provider_location\\": null, \\"provider_auth\\": null, \\"provider_geometry\\": null, \\"provider_id\\": null, \\"volume_type_id\\": \\"03e13fe6-0e30-4803-ace0-725d38e6dc24\\", \\"source_volid\\": null, \\"encryption_key_id\\": null, \\"consistencygroup_id\\": null, \\"group_id\\": null, \\"bootable\\": false, \\"multiattach\\": false, \\"replication_status\\": null, \\"replication_extended_status\\": null, \\"replication_driver_data\\": null, \\"previous_status\\": null, \\"service_uuid\\": \\"6d4b0e79-fefe-4744-b25f-34be05095200\\", \\"shared_targets\\": true, \\"deleted_at\\": null, \\"deleted\\": false, \\"created_at\\": \\"2026-07-03T09:49:34.000000\\", \\"updated_at\\": \\"2026-07-03T09:49:34.000000\\"}}"\n}'. {{(pid=101319) _write_metadata /opt/stack/cinder/cinder/backup/chunkeddriver.py:295}} Jul 03 09:49:50.702359 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-c1357d40-0422-4ef5-9555-fe9514348482 tempest-VolumesSnapshotTestJSON-1856009199 None] backup f02acbcb-92f6-490b-9c9d-afe87bc4a5e0 finished. {{(pid=101319) _finalize_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:462}} Jul 03 09:49:50.828740 np0000004400 cinder-backup[101319]: DEBUG oslo_concurrency.processutils [None req-c1357d40-0422-4ef5-9555-fe9514348482 tempest-VolumesSnapshotTestJSON-1856009199 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chown 0 /dev/sdd {{(pid=101319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 09:49:50.846820 np0000004400 sudo[146419]: stack : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chown 0 /dev/sdd Jul 03 09:49:50.847392 np0000004400 sudo[146419]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1002) Jul 03 09:49:51.119260 np0000004400 sudo[146419]: pam_unix(sudo:session): session closed for user root Jul 03 09:49:51.122436 np0000004400 cinder-backup[101319]: DEBUG oslo_concurrency.processutils [None req-c1357d40-0422-4ef5-9555-fe9514348482 tempest-VolumesSnapshotTestJSON-1856009199 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chown 0 /dev/sdd" returned: 0 in 0.292s {{(pid=101319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 09:49:51.122436 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-c1357d40-0422-4ef5-9555-fe9514348482 tempest-VolumesSnapshotTestJSON-1856009199 None] ==> disconnect_volume: call "{'args': (, {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-5d8d0f67-678e-41af-8039-de91e51e7d59', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '5d8d0f67-678e-41af-8039-de91e51e7d59', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': False}, {'type': 'block', 'scsi_wwn': '33000000000e2b07f', 'path': '/dev/sdd'}), 'kwargs': {'force': True, 'ignore_errors': True}}" {{(pid=101319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}} Jul 03 09:49:51.122436 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.base [None req-c1357d40-0422-4ef5-9555-fe9514348482 tempest-VolumesSnapshotTestJSON-1856009199 None] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=101319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jul 03 09:49:57.896715 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.base [None req-c1357d40-0422-4ef5-9555-fe9514348482 tempest-VolumesSnapshotTestJSON-1856009199 None] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 6.774s {{(pid=101319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jul 03 09:49:57.897157 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-c1357d40-0422-4ef5-9555-fe9514348482 tempest-VolumesSnapshotTestJSON-1856009199 None] _get_connection_devices called with parameters: connection_properties={'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-5d8d0f67-678e-41af-8039-de91e51e7d59', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '5d8d0f67-678e-41af-8039-de91e51e7d59', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': False}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=101319) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:847}} Jul 03 09:49:57.910514 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-c1357d40-0422-4ef5-9555-fe9514348482 tempest-VolumesSnapshotTestJSON-1856009199 None] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS: Jul 03 09:49:57.910514 np0000004400 cinder-backup[101319]: No targets found. Jul 03 09:49:57.910514 np0000004400 cinder-backup[101319]: iSNS: Jul 03 09:49:57.910514 np0000004400 cinder-backup[101319]: No targets found. Jul 03 09:49:57.910514 np0000004400 cinder-backup[101319]: STATIC: Jul 03 09:49:57.910514 np0000004400 cinder-backup[101319]: Target: iqn.2023-03.storpool.com:os--volume-5cc24e92-462e-4718-bace-b59a9138d58a Jul 03 09:49:57.910514 np0000004400 cinder-backup[101319]: Portal: 192.168.50.100:3260,-1 Jul 03 09:49:57.910514 np0000004400 cinder-backup[101319]: Iface Name: default Jul 03 09:49:57.910514 np0000004400 cinder-backup[101319]: Portal: 192.168.40.100:3260,-1 Jul 03 09:49:57.910514 np0000004400 cinder-backup[101319]: Iface Name: default Jul 03 09:49:57.910514 np0000004400 cinder-backup[101319]: Target: iqn.2023-03.storpool.com:os--volume-5d8d0f67-678e-41af-8039-de91e51e7d59 Jul 03 09:49:57.910514 np0000004400 cinder-backup[101319]: Portal: 192.168.40.100:3260,-1 Jul 03 09:49:57.910514 np0000004400 cinder-backup[101319]: Iface Name: default Jul 03 09:49:57.910514 np0000004400 cinder-backup[101319]: Target: iqn.2023-03.storpool.com:os--volume-90e6e9e6-b34e-4585-8223-1000fc7deb53 Jul 03 09:49:57.910514 np0000004400 cinder-backup[101319]: Portal: 192.168.50.100:3260,-1 Jul 03 09:49:57.910514 np0000004400 cinder-backup[101319]: Iface Name: default Jul 03 09:49:57.910514 np0000004400 cinder-backup[101319]: Portal: 192.168.40.100:3260,-1 Jul 03 09:49:57.910514 np0000004400 cinder-backup[101319]: Iface Name: default Jul 03 09:49:57.910514 np0000004400 cinder-backup[101319]: Target: iqn.2023-03.storpool.com:os--volume-55a8229e-c2a5-428b-bfb4-401e03e84a21 Jul 03 09:49:57.910514 np0000004400 cinder-backup[101319]: Portal: 192.168.50.100:3260,-1 Jul 03 09:49:57.910514 np0000004400 cinder-backup[101319]: Iface Name: default Jul 03 09:49:57.910514 np0000004400 cinder-backup[101319]: Portal: 192.168.40.100:3260,-1 Jul 03 09:49:57.910514 np0000004400 cinder-backup[101319]: Iface Name: default Jul 03 09:49:57.910514 np0000004400 cinder-backup[101319]: Target: iqn.2023-03.storpool.com:os--volume-6a9ae5e5-b04d-4c6d-84f2-0a422823a648 Jul 03 09:49:57.910514 np0000004400 cinder-backup[101319]: Portal: 192.168.50.100:3260,-1 Jul 03 09:49:57.910514 np0000004400 cinder-backup[101319]: Iface Name: default Jul 03 09:49:57.910514 np0000004400 cinder-backup[101319]: Portal: 192.168.40.100:3260,-1 Jul 03 09:49:57.910514 np0000004400 cinder-backup[101319]: Iface Name: default Jul 03 09:49:57.910514 np0000004400 cinder-backup[101319]: Target: iqn.2023-03.storpool.com:os--volume-82bfae83-3eee-443c-ae03-64058eb18c4e Jul 03 09:49:57.910514 np0000004400 cinder-backup[101319]: Portal: 192.168.50.100:3260,-1 Jul 03 09:49:57.910514 np0000004400 cinder-backup[101319]: Iface Name: default Jul 03 09:49:57.910514 np0000004400 cinder-backup[101319]: Portal: 192.168.40.100:3260,-1 Jul 03 09:49:57.910514 np0000004400 cinder-backup[101319]: Iface Name: default Jul 03 09:49:57.910514 np0000004400 cinder-backup[101319]: FIRMWARE: Jul 03 09:49:57.910514 np0000004400 cinder-backup[101319]: No targets found. Jul 03 09:49:57.910514 np0000004400 cinder-backup[101319]: stderr= {{(pid=101319) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jul 03 09:49:57.911291 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-c1357d40-0422-4ef5-9555-fe9514348482 tempest-VolumesSnapshotTestJSON-1856009199 None] Regex to get portals from discoverydb: ^SENDTARGETS: Jul 03 09:49:57.911291 np0000004400 cinder-backup[101319]: .*?^DiscoveryAddress: 192.168.40.100,3260.*? Jul 03 09:49:57.911291 np0000004400 cinder-backup[101319]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=101319) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:390}} Jul 03 09:49:57.911291 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-c1357d40-0422-4ef5-9555-fe9514348482 tempest-VolumesSnapshotTestJSON-1856009199 None] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-5d8d0f67-678e-41af-8039-de91e51e7d59', 0)] {{(pid=101319) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:858}} Jul 03 09:49:57.942001 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-c1357d40-0422-4ef5-9555-fe9514348482 tempest-VolumesSnapshotTestJSON-1856009199 None] iscsiadm ('-m', 'session'): stdout=tcp: [147] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-6a9ae5e5-b04d-4c6d-84f2-0a422823a648 (non-flash) Jul 03 09:49:57.942001 np0000004400 cinder-backup[101319]: tcp: [148] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6a9ae5e5-b04d-4c6d-84f2-0a422823a648 (non-flash) Jul 03 09:49:57.942001 np0000004400 cinder-backup[101319]: tcp: [149] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5d8d0f67-678e-41af-8039-de91e51e7d59 (non-flash) Jul 03 09:49:57.942001 np0000004400 cinder-backup[101319]: tcp: [150] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-82bfae83-3eee-443c-ae03-64058eb18c4e (non-flash) Jul 03 09:49:57.942001 np0000004400 cinder-backup[101319]: tcp: [151] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-82bfae83-3eee-443c-ae03-64058eb18c4e (non-flash) Jul 03 09:49:57.942001 np0000004400 cinder-backup[101319]: tcp: [152] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5cc24e92-462e-4718-bace-b59a9138d58a (non-flash) Jul 03 09:49:57.942001 np0000004400 cinder-backup[101319]: tcp: [153] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5cc24e92-462e-4718-bace-b59a9138d58a (non-flash) Jul 03 09:49:57.942001 np0000004400 cinder-backup[101319]: tcp: [154] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-90e6e9e6-b34e-4585-8223-1000fc7deb53 (non-flash) Jul 03 09:49:57.942001 np0000004400 cinder-backup[101319]: tcp: [155] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-90e6e9e6-b34e-4585-8223-1000fc7deb53 (non-flash) Jul 03 09:49:57.942001 np0000004400 cinder-backup[101319]: tcp: [156] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-55a8229e-c2a5-428b-bfb4-401e03e84a21 (non-flash) Jul 03 09:49:57.942001 np0000004400 cinder-backup[101319]: tcp: [157] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-55a8229e-c2a5-428b-bfb4-401e03e84a21 (non-flash) Jul 03 09:49:57.942001 np0000004400 cinder-backup[101319]: stderr= {{(pid=101319) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jul 03 09:49:57.942461 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-c1357d40-0422-4ef5-9555-fe9514348482 tempest-VolumesSnapshotTestJSON-1856009199 None] iscsi session list stdout=tcp: [147] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-6a9ae5e5-b04d-4c6d-84f2-0a422823a648 (non-flash) Jul 03 09:49:57.942461 np0000004400 cinder-backup[101319]: tcp: [148] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6a9ae5e5-b04d-4c6d-84f2-0a422823a648 (non-flash) Jul 03 09:49:57.942461 np0000004400 cinder-backup[101319]: tcp: [149] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5d8d0f67-678e-41af-8039-de91e51e7d59 (non-flash) Jul 03 09:49:57.942461 np0000004400 cinder-backup[101319]: tcp: [150] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-82bfae83-3eee-443c-ae03-64058eb18c4e (non-flash) Jul 03 09:49:57.942461 np0000004400 cinder-backup[101319]: tcp: [151] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-82bfae83-3eee-443c-ae03-64058eb18c4e (non-flash) Jul 03 09:49:57.942461 np0000004400 cinder-backup[101319]: tcp: [152] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5cc24e92-462e-4718-bace-b59a9138d58a (non-flash) Jul 03 09:49:57.942461 np0000004400 cinder-backup[101319]: tcp: [153] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5cc24e92-462e-4718-bace-b59a9138d58a (non-flash) Jul 03 09:49:57.942461 np0000004400 cinder-backup[101319]: tcp: [154] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-90e6e9e6-b34e-4585-8223-1000fc7deb53 (non-flash) Jul 03 09:49:57.942461 np0000004400 cinder-backup[101319]: tcp: [155] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-90e6e9e6-b34e-4585-8223-1000fc7deb53 (non-flash) Jul 03 09:49:57.942461 np0000004400 cinder-backup[101319]: tcp: [156] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-55a8229e-c2a5-428b-bfb4-401e03e84a21 (non-flash) Jul 03 09:49:57.942461 np0000004400 cinder-backup[101319]: tcp: [157] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-55a8229e-c2a5-428b-bfb4-401e03e84a21 (non-flash) Jul 03 09:49:57.942461 np0000004400 cinder-backup[101319]: stderr= {{(pid=101319) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jul 03 09:49:57.942461 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-c1357d40-0422-4ef5-9555-fe9514348482 tempest-VolumesSnapshotTestJSON-1856009199 None] Sessions list: [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-6a9ae5e5-b04d-4c6d-84f2-0a422823a648', '147'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-6a9ae5e5-b04d-4c6d-84f2-0a422823a648', '148'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-5d8d0f67-678e-41af-8039-de91e51e7d59', '149'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-82bfae83-3eee-443c-ae03-64058eb18c4e', '150'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-82bfae83-3eee-443c-ae03-64058eb18c4e', '151'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-5cc24e92-462e-4718-bace-b59a9138d58a', '152'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-5cc24e92-462e-4718-bace-b59a9138d58a', '153'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-90e6e9e6-b34e-4585-8223-1000fc7deb53', '154'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-90e6e9e6-b34e-4585-8223-1000fc7deb53', '155'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-55a8229e-c2a5-428b-bfb4-401e03e84a21', '156'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-55a8229e-c2a5-428b-bfb4-401e03e84a21', '157')] {{(pid=101319) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:866}} Jul 03 09:49:57.943013 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-c1357d40-0422-4ef5-9555-fe9514348482 tempest-VolumesSnapshotTestJSON-1856009199 None] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-5d8d0f67-678e-41af-8039-de91e51e7d59, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-5d8d0f67-678e-41af-8039-de91e51e7d59', '149')] {{(pid=101319) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}} Jul 03 09:49:57.943911 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-c1357d40-0422-4ef5-9555-fe9514348482 tempest-VolumesSnapshotTestJSON-1856009199 None] Resulting device map defaultdict(. at 0x7e76e6db0b80>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-5d8d0f67-678e-41af-8039-de91e51e7d59'): ({'sdd'}, set())}) {{(pid=101319) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:912}} Jul 03 09:49:57.944152 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.linuxscsi [None req-c1357d40-0422-4ef5-9555-fe9514348482 tempest-VolumesSnapshotTestJSON-1856009199 None] Removing single pathed devices sdd {{(pid=101319) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}} Jul 03 09:49:57.958698 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.linuxscsi [None req-c1357d40-0422-4ef5-9555-fe9514348482 tempest-VolumesSnapshotTestJSON-1856009199 None] Flushing IO for device /dev/sdd {{(pid=101319) flush_device_io /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:461}} Jul 03 09:49:57.967429 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.linuxscsi [None req-c1357d40-0422-4ef5-9555-fe9514348482 tempest-VolumesSnapshotTestJSON-1856009199 None] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=101319) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}} Jul 03 09:49:58.007594 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.linuxscsi [None req-c1357d40-0422-4ef5-9555-fe9514348482 tempest-VolumesSnapshotTestJSON-1856009199 None] Checking to see if SCSI volumes sdd have been removed. {{(pid=101319) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}} Jul 03 09:49:58.007745 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.linuxscsi [None req-c1357d40-0422-4ef5-9555-fe9514348482 tempest-VolumesSnapshotTestJSON-1856009199 None] SCSI volumes sdd have been removed. {{(pid=101319) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}} Jul 03 09:49:58.008898 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.linuxscsi [None req-c1357d40-0422-4ef5-9555-fe9514348482 tempest-VolumesSnapshotTestJSON-1856009199 None] Checking to see if device paths {'sdd'} are still under multipathd monitoring {{(pid=101319) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}} Jul 03 09:49:58.020572 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.linuxscsi [None req-c1357d40-0422-4ef5-9555-fe9514348482 tempest-VolumesSnapshotTestJSON-1856009199 None] Device paths {'sdd'} have been removed from multipathd monitoring. {{(pid=101319) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}} Jul 03 09:49:58.020788 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-c1357d40-0422-4ef5-9555-fe9514348482 tempest-VolumesSnapshotTestJSON-1856009199 None] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-5d8d0f67-678e-41af-8039-de91e51e7d59')] {{(pid=101319) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1225}} Jul 03 09:49:58.031501 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-c1357d40-0422-4ef5-9555-fe9514348482 tempest-VolumesSnapshotTestJSON-1856009199 None] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=101319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 03 09:49:58.068182 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-c1357d40-0422-4ef5-9555-fe9514348482 tempest-VolumesSnapshotTestJSON-1856009199 None] iscsiadm ('--logout',): stdout=Logging out of session [sid: 149, target: iqn.2023-03.storpool.com:os--volume-5d8d0f67-678e-41af-8039-de91e51e7d59, portal: 192.168.40.100,3260] Jul 03 09:49:58.068182 np0000004400 cinder-backup[101319]: Logout of [sid: 149, target: iqn.2023-03.storpool.com:os--volume-5d8d0f67-678e-41af-8039-de91e51e7d59, portal: 192.168.40.100,3260] successful. Jul 03 09:49:58.068182 np0000004400 cinder-backup[101319]: stderr= {{(pid=101319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 03 09:49:58.085469 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-c1357d40-0422-4ef5-9555-fe9514348482 tempest-VolumesSnapshotTestJSON-1856009199 None] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=101319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 03 09:49:58.085733 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.base [None req-c1357d40-0422-4ef5-9555-fe9514348482 tempest-VolumesSnapshotTestJSON-1856009199 None] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.189s {{(pid=101319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jul 03 09:49:58.085883 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-c1357d40-0422-4ef5-9555-fe9514348482 tempest-VolumesSnapshotTestJSON-1856009199 None] <== disconnect_volume: return (6963ms) None {{(pid=101319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}} Jul 03 09:49:59.129028 np0000004400 cinder-backup[101319]: INFO cinder.backup.manager [None req-c1357d40-0422-4ef5-9555-fe9514348482 tempest-VolumesSnapshotTestJSON-1856009199 None] Create backup finished. backup: f02acbcb-92f6-490b-9c9d-afe87bc4a5e0. Jul 03 09:50:00.100174 np0000004400 cinder-backup[101319]: INFO cinder.backup.manager [None req-aab4a4d6-8d60-44fc-8f02-fb815a04b671 tempest-VolumesSnapshotTestJSON-1856009199 None] Delete backup started, backup: f02acbcb-92f6-490b-9c9d-afe87bc4a5e0. Jul 03 09:50:00.106542 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.drivers.swift [None req-aab4a4d6-8d60-44fc-8f02-fb815a04b671 tempest-VolumesSnapshotTestJSON-1856009199 None] Using swift URL https://10.4.3.95:8080/v1/AUTH_5895ffa0711d4d068874cf88aa93a069 {{(pid=101319) initialize /opt/stack/cinder/cinder/backup/drivers/swift.py:300}} Jul 03 09:50:00.106692 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.drivers.swift [None req-aab4a4d6-8d60-44fc-8f02-fb815a04b671 tempest-VolumesSnapshotTestJSON-1856009199 None] Connect to https://10.4.3.95:8080/v1/AUTH_ in "per_user" mode {{(pid=101319) initialize /opt/stack/cinder/cinder/backup/drivers/swift.py:301}} Jul 03 09:50:00.106836 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-aab4a4d6-8d60-44fc-8f02-fb815a04b671 tempest-VolumesSnapshotTestJSON-1856009199 None] delete started, backup: f02acbcb-92f6-490b-9c9d-afe87bc4a5e0, container: tempest-volumessnapshottestjson-backup-container-489263271, prefix: volume_89470c05-4a76-41e8-b5cb-f969bb59ce72/20260703094939/az_nova_backup_f02acbcb-92f6-490b-9c9d-afe87bc4a5e0. {{(pid=101319) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:822}} Jul 03 09:50:00.160624 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-aab4a4d6-8d60-44fc-8f02-fb815a04b671 tempest-VolumesSnapshotTestJSON-1856009199 None] generated object list: ['volume_89470c05-4a76-41e8-b5cb-f969bb59ce72/20260703094939/az_nova_backup_f02acbcb-92f6-490b-9c9d-afe87bc4a5e0-00001', 'volume_89470c05-4a76-41e8-b5cb-f969bb59ce72/20260703094939/az_nova_backup_f02acbcb-92f6-490b-9c9d-afe87bc4a5e0-00002', 'volume_89470c05-4a76-41e8-b5cb-f969bb59ce72/20260703094939/az_nova_backup_f02acbcb-92f6-490b-9c9d-afe87bc4a5e0-00003', 'volume_89470c05-4a76-41e8-b5cb-f969bb59ce72/20260703094939/az_nova_backup_f02acbcb-92f6-490b-9c9d-afe87bc4a5e0-00004', 'volume_89470c05-4a76-41e8-b5cb-f969bb59ce72/20260703094939/az_nova_backup_f02acbcb-92f6-490b-9c9d-afe87bc4a5e0-00005', 'volume_89470c05-4a76-41e8-b5cb-f969bb59ce72/20260703094939/az_nova_backup_f02acbcb-92f6-490b-9c9d-afe87bc4a5e0-00006', 'volume_89470c05-4a76-41e8-b5cb-f969bb59ce72/20260703094939/az_nova_backup_f02acbcb-92f6-490b-9c9d-afe87bc4a5e0-00007', 'volume_89470c05-4a76-41e8-b5cb-f969bb59ce72/20260703094939/az_nova_backup_f02acbcb-92f6-490b-9c9d-afe87bc4a5e0-00008', 'volume_89470c05-4a76-41e8-b5cb-f969bb59ce72/20260703094939/az_nova_backup_f02acbcb-92f6-490b-9c9d-afe87bc4a5e0-00009', 'volume_89470c05-4a76-41e8-b5cb-f969bb59ce72/20260703094939/az_nova_backup_f02acbcb-92f6-490b-9c9d-afe87bc4a5e0-00010', 'volume_89470c05-4a76-41e8-b5cb-f969bb59ce72/20260703094939/az_nova_backup_f02acbcb-92f6-490b-9c9d-afe87bc4a5e0-00011', 'volume_89470c05-4a76-41e8-b5cb-f969bb59ce72/20260703094939/az_nova_backup_f02acbcb-92f6-490b-9c9d-afe87bc4a5e0-00012', 'volume_89470c05-4a76-41e8-b5cb-f969bb59ce72/20260703094939/az_nova_backup_f02acbcb-92f6-490b-9c9d-afe87bc4a5e0-00013', 'volume_89470c05-4a76-41e8-b5cb-f969bb59ce72/20260703094939/az_nova_backup_f02acbcb-92f6-490b-9c9d-afe87bc4a5e0-00014', 'volume_89470c05-4a76-41e8-b5cb-f969bb59ce72/20260703094939/az_nova_backup_f02acbcb-92f6-490b-9c9d-afe87bc4a5e0-00015', 'volume_89470c05-4a76-41e8-b5cb-f969bb59ce72/20260703094939/az_nova_backup_f02acbcb-92f6-490b-9c9d-afe87bc4a5e0-00016', 'volume_89470c05-4a76-41e8-b5cb-f969bb59ce72/20260703094939/az_nova_backup_f02acbcb-92f6-490b-9c9d-afe87bc4a5e0-00017', 'volume_89470c05-4a76-41e8-b5cb-f969bb59ce72/20260703094939/az_nova_backup_f02acbcb-92f6-490b-9c9d-afe87bc4a5e0-00018', 'volume_89470c05-4a76-41e8-b5cb-f969bb59ce72/20260703094939/az_nova_backup_f02acbcb-92f6-490b-9c9d-afe87bc4a5e0-00019', 'volume_89470c05-4a76-41e8-b5cb-f969bb59ce72/20260703094939/az_nova_backup_f02acbcb-92f6-490b-9c9d-afe87bc4a5e0-00020', 'volume_89470c05-4a76-41e8-b5cb-f969bb59ce72/20260703094939/az_nova_backup_f02acbcb-92f6-490b-9c9d-afe87bc4a5e0-00021', 'volume_89470c05-4a76-41e8-b5cb-f969bb59ce72/20260703094939/az_nova_backup_f02acbcb-92f6-490b-9c9d-afe87bc4a5e0_metadata', 'volume_89470c05-4a76-41e8-b5cb-f969bb59ce72/20260703094939/az_nova_backup_f02acbcb-92f6-490b-9c9d-afe87bc4a5e0_sha256file']. {{(pid=101319) _generate_object_names /opt/stack/cinder/cinder/backup/chunkeddriver.py:260}} Jul 03 09:50:00.183710 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-aab4a4d6-8d60-44fc-8f02-fb815a04b671 tempest-VolumesSnapshotTestJSON-1856009199 None] deleted object: volume_89470c05-4a76-41e8-b5cb-f969bb59ce72/20260703094939/az_nova_backup_f02acbcb-92f6-490b-9c9d-afe87bc4a5e0-00001 in container: tempest-volumessnapshottestjson-backup-container-489263271. {{(pid=101319) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 09:50:00.201176 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-aab4a4d6-8d60-44fc-8f02-fb815a04b671 tempest-VolumesSnapshotTestJSON-1856009199 None] deleted object: volume_89470c05-4a76-41e8-b5cb-f969bb59ce72/20260703094939/az_nova_backup_f02acbcb-92f6-490b-9c9d-afe87bc4a5e0-00002 in container: tempest-volumessnapshottestjson-backup-container-489263271. {{(pid=101319) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 09:50:00.218838 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-aab4a4d6-8d60-44fc-8f02-fb815a04b671 tempest-VolumesSnapshotTestJSON-1856009199 None] deleted object: volume_89470c05-4a76-41e8-b5cb-f969bb59ce72/20260703094939/az_nova_backup_f02acbcb-92f6-490b-9c9d-afe87bc4a5e0-00003 in container: tempest-volumessnapshottestjson-backup-container-489263271. {{(pid=101319) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 09:50:00.236588 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-aab4a4d6-8d60-44fc-8f02-fb815a04b671 tempest-VolumesSnapshotTestJSON-1856009199 None] deleted object: volume_89470c05-4a76-41e8-b5cb-f969bb59ce72/20260703094939/az_nova_backup_f02acbcb-92f6-490b-9c9d-afe87bc4a5e0-00004 in container: tempest-volumessnapshottestjson-backup-container-489263271. {{(pid=101319) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 09:50:00.255412 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-aab4a4d6-8d60-44fc-8f02-fb815a04b671 tempest-VolumesSnapshotTestJSON-1856009199 None] deleted object: volume_89470c05-4a76-41e8-b5cb-f969bb59ce72/20260703094939/az_nova_backup_f02acbcb-92f6-490b-9c9d-afe87bc4a5e0-00005 in container: tempest-volumessnapshottestjson-backup-container-489263271. {{(pid=101319) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 09:50:00.275055 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-aab4a4d6-8d60-44fc-8f02-fb815a04b671 tempest-VolumesSnapshotTestJSON-1856009199 None] deleted object: volume_89470c05-4a76-41e8-b5cb-f969bb59ce72/20260703094939/az_nova_backup_f02acbcb-92f6-490b-9c9d-afe87bc4a5e0-00006 in container: tempest-volumessnapshottestjson-backup-container-489263271. {{(pid=101319) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 09:50:00.298618 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-aab4a4d6-8d60-44fc-8f02-fb815a04b671 tempest-VolumesSnapshotTestJSON-1856009199 None] deleted object: volume_89470c05-4a76-41e8-b5cb-f969bb59ce72/20260703094939/az_nova_backup_f02acbcb-92f6-490b-9c9d-afe87bc4a5e0-00007 in container: tempest-volumessnapshottestjson-backup-container-489263271. {{(pid=101319) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 09:50:00.318785 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-aab4a4d6-8d60-44fc-8f02-fb815a04b671 tempest-VolumesSnapshotTestJSON-1856009199 None] deleted object: volume_89470c05-4a76-41e8-b5cb-f969bb59ce72/20260703094939/az_nova_backup_f02acbcb-92f6-490b-9c9d-afe87bc4a5e0-00008 in container: tempest-volumessnapshottestjson-backup-container-489263271. {{(pid=101319) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 09:50:00.340112 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-aab4a4d6-8d60-44fc-8f02-fb815a04b671 tempest-VolumesSnapshotTestJSON-1856009199 None] deleted object: volume_89470c05-4a76-41e8-b5cb-f969bb59ce72/20260703094939/az_nova_backup_f02acbcb-92f6-490b-9c9d-afe87bc4a5e0-00009 in container: tempest-volumessnapshottestjson-backup-container-489263271. {{(pid=101319) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 09:50:00.359039 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-aab4a4d6-8d60-44fc-8f02-fb815a04b671 tempest-VolumesSnapshotTestJSON-1856009199 None] deleted object: volume_89470c05-4a76-41e8-b5cb-f969bb59ce72/20260703094939/az_nova_backup_f02acbcb-92f6-490b-9c9d-afe87bc4a5e0-00010 in container: tempest-volumessnapshottestjson-backup-container-489263271. {{(pid=101319) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 09:50:00.377048 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-aab4a4d6-8d60-44fc-8f02-fb815a04b671 tempest-VolumesSnapshotTestJSON-1856009199 None] deleted object: volume_89470c05-4a76-41e8-b5cb-f969bb59ce72/20260703094939/az_nova_backup_f02acbcb-92f6-490b-9c9d-afe87bc4a5e0-00011 in container: tempest-volumessnapshottestjson-backup-container-489263271. {{(pid=101319) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 09:50:00.398726 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-aab4a4d6-8d60-44fc-8f02-fb815a04b671 tempest-VolumesSnapshotTestJSON-1856009199 None] deleted object: volume_89470c05-4a76-41e8-b5cb-f969bb59ce72/20260703094939/az_nova_backup_f02acbcb-92f6-490b-9c9d-afe87bc4a5e0-00012 in container: tempest-volumessnapshottestjson-backup-container-489263271. {{(pid=101319) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 09:50:00.416716 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-aab4a4d6-8d60-44fc-8f02-fb815a04b671 tempest-VolumesSnapshotTestJSON-1856009199 None] deleted object: volume_89470c05-4a76-41e8-b5cb-f969bb59ce72/20260703094939/az_nova_backup_f02acbcb-92f6-490b-9c9d-afe87bc4a5e0-00013 in container: tempest-volumessnapshottestjson-backup-container-489263271. {{(pid=101319) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 09:50:00.436868 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-aab4a4d6-8d60-44fc-8f02-fb815a04b671 tempest-VolumesSnapshotTestJSON-1856009199 None] deleted object: volume_89470c05-4a76-41e8-b5cb-f969bb59ce72/20260703094939/az_nova_backup_f02acbcb-92f6-490b-9c9d-afe87bc4a5e0-00014 in container: tempest-volumessnapshottestjson-backup-container-489263271. {{(pid=101319) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 09:50:00.456990 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-aab4a4d6-8d60-44fc-8f02-fb815a04b671 tempest-VolumesSnapshotTestJSON-1856009199 None] deleted object: volume_89470c05-4a76-41e8-b5cb-f969bb59ce72/20260703094939/az_nova_backup_f02acbcb-92f6-490b-9c9d-afe87bc4a5e0-00015 in container: tempest-volumessnapshottestjson-backup-container-489263271. {{(pid=101319) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 09:50:00.476572 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-aab4a4d6-8d60-44fc-8f02-fb815a04b671 tempest-VolumesSnapshotTestJSON-1856009199 None] deleted object: volume_89470c05-4a76-41e8-b5cb-f969bb59ce72/20260703094939/az_nova_backup_f02acbcb-92f6-490b-9c9d-afe87bc4a5e0-00016 in container: tempest-volumessnapshottestjson-backup-container-489263271. {{(pid=101319) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 09:50:00.495078 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-aab4a4d6-8d60-44fc-8f02-fb815a04b671 tempest-VolumesSnapshotTestJSON-1856009199 None] deleted object: volume_89470c05-4a76-41e8-b5cb-f969bb59ce72/20260703094939/az_nova_backup_f02acbcb-92f6-490b-9c9d-afe87bc4a5e0-00017 in container: tempest-volumessnapshottestjson-backup-container-489263271. {{(pid=101319) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 09:50:00.517131 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-aab4a4d6-8d60-44fc-8f02-fb815a04b671 tempest-VolumesSnapshotTestJSON-1856009199 None] deleted object: volume_89470c05-4a76-41e8-b5cb-f969bb59ce72/20260703094939/az_nova_backup_f02acbcb-92f6-490b-9c9d-afe87bc4a5e0-00018 in container: tempest-volumessnapshottestjson-backup-container-489263271. {{(pid=101319) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 09:50:00.535863 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-aab4a4d6-8d60-44fc-8f02-fb815a04b671 tempest-VolumesSnapshotTestJSON-1856009199 None] deleted object: volume_89470c05-4a76-41e8-b5cb-f969bb59ce72/20260703094939/az_nova_backup_f02acbcb-92f6-490b-9c9d-afe87bc4a5e0-00019 in container: tempest-volumessnapshottestjson-backup-container-489263271. {{(pid=101319) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 09:50:00.554439 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-aab4a4d6-8d60-44fc-8f02-fb815a04b671 tempest-VolumesSnapshotTestJSON-1856009199 None] deleted object: volume_89470c05-4a76-41e8-b5cb-f969bb59ce72/20260703094939/az_nova_backup_f02acbcb-92f6-490b-9c9d-afe87bc4a5e0-00020 in container: tempest-volumessnapshottestjson-backup-container-489263271. {{(pid=101319) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 09:50:00.571312 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-aab4a4d6-8d60-44fc-8f02-fb815a04b671 tempest-VolumesSnapshotTestJSON-1856009199 None] deleted object: volume_89470c05-4a76-41e8-b5cb-f969bb59ce72/20260703094939/az_nova_backup_f02acbcb-92f6-490b-9c9d-afe87bc4a5e0-00021 in container: tempest-volumessnapshottestjson-backup-container-489263271. {{(pid=101319) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 09:50:00.590050 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-aab4a4d6-8d60-44fc-8f02-fb815a04b671 tempest-VolumesSnapshotTestJSON-1856009199 None] deleted object: volume_89470c05-4a76-41e8-b5cb-f969bb59ce72/20260703094939/az_nova_backup_f02acbcb-92f6-490b-9c9d-afe87bc4a5e0_metadata in container: tempest-volumessnapshottestjson-backup-container-489263271. {{(pid=101319) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 09:50:00.612800 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-aab4a4d6-8d60-44fc-8f02-fb815a04b671 tempest-VolumesSnapshotTestJSON-1856009199 None] deleted object: volume_89470c05-4a76-41e8-b5cb-f969bb59ce72/20260703094939/az_nova_backup_f02acbcb-92f6-490b-9c9d-afe87bc4a5e0_sha256file in container: tempest-volumessnapshottestjson-backup-container-489263271. {{(pid=101319) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 09:50:00.613100 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-aab4a4d6-8d60-44fc-8f02-fb815a04b671 tempest-VolumesSnapshotTestJSON-1856009199 None] delete f02acbcb-92f6-490b-9c9d-afe87bc4a5e0 finished. {{(pid=101319) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:848}} Jul 03 09:50:00.647015 np0000004400 cinder-backup[101319]: DEBUG oslo_db.sqlalchemy.engines [None req-aab4a4d6-8d60-44fc-8f02-fb815a04b671 tempest-VolumesSnapshotTestJSON-1856009199 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=101319) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 03 09:50:00.665128 np0000004400 cinder-backup[101319]: DEBUG cinder.quota [None req-aab4a4d6-8d60-44fc-8f02-fb815a04b671 tempest-VolumesSnapshotTestJSON-1856009199 None] Created reservations ['ceb8636d-3e75-496e-96d4-0129f1cc9654', '6cae8411-8e3c-49c3-bd53-bdb0504ee6ba'] {{(pid=101319) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 09:50:00.683598 np0000004400 cinder-backup[101319]: INFO cinder.backup.manager [None req-aab4a4d6-8d60-44fc-8f02-fb815a04b671 tempest-VolumesSnapshotTestJSON-1856009199 None] Delete backup finished, backup f02acbcb-92f6-490b-9c9d-afe87bc4a5e0 deleted. Jul 03 09:50:10.681592 np0000004400 cinder-backup[101319]: DEBUG dbcounter [-] [101319] Writing DB stats cinder:SELECT=41,cinder:UPDATE=12,cinder:INSERT=2 {{(pid=101319) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 03 09:50:21.117518 np0000004400 cinder-backup[101319]: DEBUG dbcounter [-] [101319] Writing DB stats cinder:SELECT=1,cinder:UPDATE=1 {{(pid=101319) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 03 09:50:40.375848 np0000004400 cinder-backup[101319]: DEBUG oslo_service.periodic_task [None req-ffd932d2-122c-4e68-b5ba-628aff7ae7b8 None None] Running periodic task BackupManager.publish_service_capabilities {{(pid=101319) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 03 09:50:40.376275 np0000004400 cinder-backup[101319]: DEBUG cinder.manager [None req-ffd932d2-122c-4e68-b5ba-628aff7ae7b8 None None] Notifying Schedulers of capabilities ... {{(pid=101319) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 03 09:51:40.379031 np0000004400 cinder-backup[101319]: DEBUG oslo_service.periodic_task [None req-ffd932d2-122c-4e68-b5ba-628aff7ae7b8 None None] Running periodic task BackupManager.publish_service_capabilities {{(pid=101319) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 03 09:51:40.379500 np0000004400 cinder-backup[101319]: DEBUG cinder.manager [None req-ffd932d2-122c-4e68-b5ba-628aff7ae7b8 None None] Notifying Schedulers of capabilities ... {{(pid=101319) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 03 09:52:15.907812 np0000004400 cinder-backup[101319]: INFO cinder.backup.manager [None req-5699de5f-5de3-481e-8d5c-0885569e101d tempest-CreateVolumesFromBackupTest-1420824915 None] Create backup started, backup: 612b0c88-04d4-4352-9b18-16c747e8225a volume: ed8e3f76-cf7d-4910-b52d-4dfa2049cde1. Jul 03 09:52:15.916277 np0000004400 cinder-backup[101319]: INFO cinder.backup.manager [None req-5699de5f-5de3-481e-8d5c-0885569e101d tempest-CreateVolumesFromBackupTest-1420824915 None] Call Volume Manager to get_backup_device for Backup(availability_zone='nova',container=None,created_at=2026-07-03T09:52:15Z,data_timestamp=2026-07-03T09:52:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromBackupTest-Backup-269281105',encryption_key_id=None,fail_reason=None,host='np0000004400',id=612b0c88-04d4-4352-9b18-16c747e8225a,metadata={},num_dependent_backups=0,object_count=0,parent=None,parent_id=None,project_id='6c0e2567c47942ba86cc99b6439ed30b',restore_volume_id=None,service='cinder.backup.drivers.swift.SwiftBackupDriver',service_metadata=None,size=1,snapshot_id=None,status='creating',temp_snapshot_id=None,temp_volume_id=None,updated_at=None,user_id='dd8a7b8d2e9b464b92fa4f3d5b891f00',volume_id=ed8e3f76-cf7d-4910-b52d-4dfa2049cde1) Jul 03 09:52:15.946272 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.drivers.swift [None req-5699de5f-5de3-481e-8d5c-0885569e101d tempest-CreateVolumesFromBackupTest-1420824915 None] Using swift URL https://10.4.3.95:8080/v1/AUTH_6c0e2567c47942ba86cc99b6439ed30b {{(pid=101319) initialize /opt/stack/cinder/cinder/backup/drivers/swift.py:300}} Jul 03 09:52:15.946401 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.drivers.swift [None req-5699de5f-5de3-481e-8d5c-0885569e101d tempest-CreateVolumesFromBackupTest-1420824915 None] Connect to https://10.4.3.95:8080/v1/AUTH_ in "per_user" mode {{(pid=101319) initialize /opt/stack/cinder/cinder/backup/drivers/swift.py:301}} Jul 03 09:52:15.946842 np0000004400 cinder-backup[101319]: DEBUG os_brick.utils [None req-5699de5f-5de3-481e-8d5c-0885569e101d tempest-CreateVolumesFromBackupTest-1420824915 None] ==> get_connector_properties: call "{'root_helper': 'sudo cinder-rootwrap /etc/cinder/rootwrap.conf', 'my_ip': '10.4.3.95', 'multipath': False, 'enforce_multipath': False, 'host': None, 'execute': None}" {{(pid=101319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}} Jul 03 09:52:15.956947 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.scaleio [None req-5699de5f-5de3-481e-8d5c-0885569e101d tempest-CreateVolumesFromBackupTest-1420824915 None] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=101319) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}} Jul 03 09:52:15.983507 np0000004400 cinder-backup[101319]: DEBUG oslo_concurrency.processutils [None req-5699de5f-5de3-481e-8d5c-0885569e101d tempest-CreateVolumesFromBackupTest-1420824915 None] Running cmd (subprocess): nvme version {{(pid=101319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 09:52:16.000793 np0000004400 cinder-backup[101319]: DEBUG oslo_concurrency.processutils [None req-5699de5f-5de3-481e-8d5c-0885569e101d tempest-CreateVolumesFromBackupTest-1420824915 None] 'nvme version' failed. Not Retrying. {{(pid=101319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 03 09:52:16.002950 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.nvmeof [None req-5699de5f-5de3-481e-8d5c-0885569e101d tempest-CreateVolumesFromBackupTest-1420824915 None] nvme not present on system {{(pid=101319) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}} Jul 03 09:52:16.013187 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.lightos [None req-5699de5f-5de3-481e-8d5c-0885569e101d tempest-CreateVolumesFromBackupTest-1420824915 None] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=101319) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}} Jul 03 09:52:16.014578 np0000004400 cinder-backup[101319]: INFO os_brick.initiator.connectors.lightos [None req-5699de5f-5de3-481e-8d5c-0885569e101d tempest-CreateVolumesFromBackupTest-1420824915 None] Current host hostNQN and IP(s) are ['10.4.3.95', 'fe80::f816:3eff:fe47:268c', '192.168.40.6', 'fe80::f816:3eff:febf:7be2', '192.168.50.6', 'fe80::f816:3eff:fe99:8914', '192.168.10.6', 'fe80::f816:3eff:fe2f:e696', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::bc9d:84ff:fec2:6b49', 'fe80::fc16:3eff:fe03:4d48', 'fe80::3c07:afff:fe8d:d011', 'fe80::fc16:3eff:fe6a:1a3e', 'fe80::b099:12ff:feb4:ede7'] Jul 03 09:52:16.014823 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.lightos [None req-5699de5f-5de3-481e-8d5c-0885569e101d tempest-CreateVolumesFromBackupTest-1420824915 None] LIGHTOS: did not find dsc, continuing anyway. {{(pid=101319) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}} Jul 03 09:52:16.015082 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.lightos [None req-5699de5f-5de3-481e-8d5c-0885569e101d tempest-CreateVolumesFromBackupTest-1420824915 None] LIGHTOS: no hostnqn found. {{(pid=101319) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}} Jul 03 09:52:16.015485 np0000004400 cinder-backup[101319]: DEBUG os_brick.utils [None req-5699de5f-5de3-481e-8d5c-0885569e101d tempest-CreateVolumesFromBackupTest-1420824915 None] <== get_connector_properties: return (68ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.95', 'host': 'np0000004400', 'multipath': False, 'enforce_multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:ae7e5bb0ebe6', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': '6b284368-d0ba-4d18-af6f-4998d3955c52', 'nvme_native_multipath': False} {{(pid=101319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}} Jul 03 09:52:16.519969 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connector [None req-5699de5f-5de3-481e-8d5c-0885569e101d tempest-CreateVolumesFromBackupTest-1420824915 None] Factory for iscsi on None {{(pid=101319) factory /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connector.py:243}} Jul 03 09:52:16.520307 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-5699de5f-5de3-481e-8d5c-0885569e101d tempest-CreateVolumesFromBackupTest-1420824915 None] ==> connect_volume: call "{'self': , 'connection_properties': {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-ed8e3f76-cf7d-4910-b52d-4dfa2049cde1', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'ed8e3f76-cf7d-4910-b52d-4dfa2049cde1', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': False}}" {{(pid=101319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}} Jul 03 09:52:16.520520 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.base [None req-5699de5f-5de3-481e-8d5c-0885569e101d tempest-CreateVolumesFromBackupTest-1420824915 None] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=101319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jul 03 09:52:16.520948 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.base [None req-5699de5f-5de3-481e-8d5c-0885569e101d tempest-CreateVolumesFromBackupTest-1420824915 None] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.000s {{(pid=101319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jul 03 09:52:16.521132 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.base [None req-5699de5f-5de3-481e-8d5c-0885569e101d tempest-CreateVolumesFromBackupTest-1420824915 None] Connection properties {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-ed8e3f76-cf7d-4910-b52d-4dfa2049cde1', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'ed8e3f76-cf7d-4910-b52d-4dfa2049cde1', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': False} {{(pid=101319) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}} Jul 03 09:52:16.532717 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.base [None req-5699de5f-5de3-481e-8d5c-0885569e101d tempest-CreateVolumesFromBackupTest-1420824915 None] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-ed8e3f76-cf7d-4910-b52d-4dfa2049cde1" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=101319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jul 03 09:52:16.533082 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.base [None req-5699de5f-5de3-481e-8d5c-0885569e101d tempest-CreateVolumesFromBackupTest-1420824915 None] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-ed8e3f76-cf7d-4910-b52d-4dfa2049cde1" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.000s {{(pid=101319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jul 03 09:52:16.533254 np0000004400 cinder-backup[101319]: INFO os_brick.initiator.connectors.iscsi [None req-5699de5f-5de3-481e-8d5c-0885569e101d tempest-CreateVolumesFromBackupTest-1420824915 None] Trying to connect to iSCSI portal 192.168.40.100:3260 Jul 03 09:52:16.542167 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-5699de5f-5de3-481e-8d5c-0885569e101d tempest-CreateVolumesFromBackupTest-1420824915 None] iscsiadm (): stdout= stderr=iscsiadm: No records found Jul 03 09:52:16.542167 np0000004400 cinder-backup[101319]: {{(pid=101319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 03 09:52:16.552033 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-5699de5f-5de3-481e-8d5c-0885569e101d tempest-CreateVolumesFromBackupTest-1420824915 None] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-ed8e3f76-cf7d-4910-b52d-4dfa2049cde1] added Jul 03 09:52:16.552033 np0000004400 cinder-backup[101319]: stderr=iscsiadm: Config file line 363 does not have value Jul 03 09:52:16.552033 np0000004400 cinder-backup[101319]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs' Jul 03 09:52:16.552033 np0000004400 cinder-backup[101319]: iscsiadm: Config file line 363 does not have value Jul 03 09:52:16.552033 np0000004400 cinder-backup[101319]: iscsiadm: Config file line 363 does not have value Jul 03 09:52:16.552033 np0000004400 cinder-backup[101319]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs' Jul 03 09:52:16.552033 np0000004400 cinder-backup[101319]: {{(pid=101319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 03 09:52:16.552338 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-5699de5f-5de3-481e-8d5c-0885569e101d tempest-CreateVolumesFromBackupTest-1420824915 None] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=101319) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}} Jul 03 09:52:16.552552 np0000004400 cinder-backup[101319]: DEBUG os_brick.utils [None req-5699de5f-5de3-481e-8d5c-0885569e101d tempest-CreateVolumesFromBackupTest-1420824915 None] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0192(s), this was the 1st time calling it. {{(pid=101319) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}} Jul 03 09:52:16.552728 np0000004400 cinder-backup[101319]: DEBUG os_brick.utils [None req-5699de5f-5de3-481e-8d5c-0885569e101d tempest-CreateVolumesFromBackupTest-1420824915 None] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=101319) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}} Jul 03 09:52:17.554458 np0000004400 cinder-backup[101319]: INFO os_brick.initiator.connectors.iscsi [None req-5699de5f-5de3-481e-8d5c-0885569e101d tempest-CreateVolumesFromBackupTest-1420824915 None] Trying to connect to iSCSI portal 192.168.40.100:3260 Jul 03 09:52:17.566097 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-5699de5f-5de3-481e-8d5c-0885569e101d tempest-CreateVolumesFromBackupTest-1420824915 None] iscsiadm (): stdout=# BEGIN RECORD 2.1.9 Jul 03 09:52:17.566097 np0000004400 cinder-backup[101319]: node.name = iqn.2023-03.storpool.com:os--volume-ed8e3f76-cf7d-4910-b52d-4dfa2049cde1 Jul 03 09:52:17.566097 np0000004400 cinder-backup[101319]: node.tpgt = -1 Jul 03 09:52:17.566097 np0000004400 cinder-backup[101319]: node.startup = manual Jul 03 09:52:17.566097 np0000004400 cinder-backup[101319]: node.leading_login = No Jul 03 09:52:17.566097 np0000004400 cinder-backup[101319]: iface.iscsi_ifacename = default Jul 03 09:52:17.566097 np0000004400 cinder-backup[101319]: iface.net_ifacename = Jul 03 09:52:17.566097 np0000004400 cinder-backup[101319]: iface.ipaddress = Jul 03 09:52:17.566097 np0000004400 cinder-backup[101319]: iface.prefix_len = 0 Jul 03 09:52:17.566097 np0000004400 cinder-backup[101319]: iface.hwaddress = Jul 03 09:52:17.566097 np0000004400 cinder-backup[101319]: iface.transport_name = tcp Jul 03 09:52:17.566097 np0000004400 cinder-backup[101319]: iface.initiatorname = Jul 03 09:52:17.566097 np0000004400 cinder-backup[101319]: iface.state = Jul 03 09:52:17.566097 np0000004400 cinder-backup[101319]: iface.vlan_id = 0 Jul 03 09:52:17.566097 np0000004400 cinder-backup[101319]: iface.vlan_priority = 0 Jul 03 09:52:17.566097 np0000004400 cinder-backup[101319]: iface.vlan_state = Jul 03 09:52:17.566097 np0000004400 cinder-backup[101319]: iface.iface_num = 0 Jul 03 09:52:17.566097 np0000004400 cinder-backup[101319]: iface.mtu = 0 Jul 03 09:52:17.566097 np0000004400 cinder-backup[101319]: iface.port = 0 Jul 03 09:52:17.566097 np0000004400 cinder-backup[101319]: iface.bootproto = Jul 03 09:52:17.566097 np0000004400 cinder-backup[101319]: iface.subnet_mask = Jul 03 09:52:17.566097 np0000004400 cinder-backup[101319]: iface.gateway = Jul 03 09:52:17.566097 np0000004400 cinder-backup[101319]: iface.dhcp_alt_client_id_state = Jul 03 09:52:17.566097 np0000004400 cinder-backup[101319]: iface.dhcp_alt_client_id = Jul 03 09:52:17.566097 np0000004400 cinder-backup[101319]: iface.dhcp_dns = Jul 03 09:52:17.566097 np0000004400 cinder-backup[101319]: iface.dhcp_learn_iqn = Jul 03 09:52:17.566097 np0000004400 cinder-backup[101319]: iface.dhcp_req_vendor_id_state = Jul 03 09:52:17.566097 np0000004400 cinder-backup[101319]: iface.dhcp_vendor_id_state = Jul 03 09:52:17.566097 np0000004400 cinder-backup[101319]: iface.dhcp_vendor_id = Jul 03 09:52:17.566097 np0000004400 cinder-backup[101319]: iface.dhcp_slp_da = Jul 03 09:52:17.566097 np0000004400 cinder-backup[101319]: iface.fragmentation = Jul 03 09:52:17.566097 np0000004400 cinder-backup[101319]: iface.gratuitous_arp = Jul 03 09:52:17.566097 np0000004400 cinder-backup[101319]: iface.incoming_forwarding = Jul 03 09:52:17.566097 np0000004400 cinder-backup[101319]: iface.tos_state = Jul 03 09:52:17.566097 np0000004400 cinder-backup[101319]: iface.tos = 0 Jul 03 09:52:17.566097 np0000004400 cinder-backup[101319]: iface.ttl = 0 Jul 03 09:52:17.566097 np0000004400 cinder-backup[101319]: iface.delayed_ack = Jul 03 09:52:17.566097 np0000004400 cinder-backup[101319]: iface.tcp_nagle = Jul 03 09:52:17.566097 np0000004400 cinder-backup[101319]: iface.tcp_wsf_state = Jul 03 09:52:17.566097 np0000004400 cinder-backup[101319]: iface.tcp_wsf = 0 Jul 03 09:52:17.566097 np0000004400 cinder-backup[101319]: iface.tcp_timer_scale = 0 Jul 03 09:52:17.566097 np0000004400 cinder-backup[101319]: iface.tcp_timestamp = Jul 03 09:52:17.566097 np0000004400 cinder-backup[101319]: iface.redirect = Jul 03 09:52:17.566097 np0000004400 cinder-backup[101319]: iface.def_task_mgmt_timeout = 0 Jul 03 09:52:17.566097 np0000004400 cinder-backup[101319]: iface.header_digest = Jul 03 09:52:17.566097 np0000004400 cinder-backup[101319]: iface.data_digest = Jul 03 09:52:17.566097 np0000004400 cinder-backup[101319]: iface.immediate_data = Jul 03 09:52:17.566097 np0000004400 cinder-backup[101319]: iface.initial_r2t = Jul 03 09:52:17.566097 np0000004400 cinder-backup[101319]: iface.data_seq_inorder = Jul 03 09:52:17.566097 np0000004400 cinder-backup[101319]: iface.data_pdu_inorder = Jul 03 09:52:17.566097 np0000004400 cinder-backup[101319]: iface.erl = 0 Jul 03 09:52:17.566097 np0000004400 cinder-backup[101319]: iface.max_receive_data_len = 0 Jul 03 09:52:17.566097 np0000004400 cinder-backup[101319]: iface.first_burst_len = 0 Jul 03 09:52:17.566097 np0000004400 cinder-backup[101319]: iface.max_outstanding_r2t = 0 Jul 03 09:52:17.566097 np0000004400 cinder-backup[101319]: iface.max_burst_len = 0 Jul 03 09:52:17.566097 np0000004400 cinder-backup[101319]: iface.chap_auth = Jul 03 09:52:17.566097 np0000004400 cinder-backup[101319]: iface.bidi_chap = Jul 03 09:52:17.566097 np0000004400 cinder-backup[101319]: iface.strict_login_compliance = Jul 03 09:52:17.566097 np0000004400 cinder-backup[101319]: iface.discovery_auth = Jul 03 09:52:17.566097 np0000004400 cinder-backup[101319]: iface.discovery_logout = Jul 03 09:52:17.566097 np0000004400 cinder-backup[101319]: node.discovery_address = Jul 03 09:52:17.566097 np0000004400 cinder-backup[101319]: node.discovery_port = 0 Jul 03 09:52:17.566097 np0000004400 cinder-backup[101319]: node.discovery_type = fw Jul 03 09:52:17.566097 np0000004400 cinder-backup[101319]: node.session.initial_cmdsn = 0 Jul 03 09:52:17.566097 np0000004400 cinder-backup[101319]: node.session.initial_login_retry_max = 8 Jul 03 09:52:17.566097 np0000004400 cinder-backup[101319]: node.session.xmit_thread_priority = 0 Jul 03 09:52:17.566097 np0000004400 cinder-backup[101319]: node.session.cmds_max = 128 Jul 03 09:52:17.566097 np0000004400 cinder-backup[101319]: node.session.queue_depth = 32 Jul 03 09:52:17.566097 np0000004400 cinder-backup[101319]: node.session.nr_sessions = 1 Jul 03 09:52:17.566097 np0000004400 cinder-backup[101319]: node.session.auth.authmethod = None Jul 03 09:52:17.566097 np0000004400 cinder-backup[101319]: node.session.auth.username = Jul 03 09:52:17.566097 np0000004400 cinder-backup[101319]: node.session.auth.password = *** Jul 03 09:52:17.566097 np0000004400 cinder-backup[101319]: node.session.auth.username_in = Jul 03 09:52:17.566097 np0000004400 cinder-backup[101319]: node.session.auth.password_in = Jul 03 09:52:17.566097 np0000004400 cinder-backup[101319]: node.session.auth.chap_algs = SHA256 Jul 03 09:52:17.566097 np0000004400 cinder-backup[101319]: node.session.timeo.replacement_timeout = 120 Jul 03 09:52:17.566097 np0000004400 cinder-backup[101319]: node.session.err_timeo.abort_timeout = 15 Jul 03 09:52:17.566097 np0000004400 cinder-backup[101319]: node.session.err_timeo.lu_reset_timeout = 30 Jul 03 09:52:17.566097 np0000004400 cinder-backup[101319]: node.session.err_timeo.tgt_reset_timeout = 30 Jul 03 09:52:17.566097 np0000004400 cinder-backup[101319]: node.session.err_timeo.host_reset_timeout = 60 Jul 03 09:52:17.566097 np0000004400 cinder-backup[101319]: node.session.iscsi.FastAbort = Yes Jul 03 09:52:17.566097 np0000004400 cinder-backup[101319]: node.session.iscsi.InitialR2T = No Jul 03 09:52:17.566097 np0000004400 cinder-backup[101319]: node.session.iscsi.ImmediateData = Yes Jul 03 09:52:17.566097 np0000004400 cinder-backup[101319]: node.session.iscsi.FirstBurstLength = 262144 Jul 03 09:52:17.566097 np0000004400 cinder-backup[101319]: node.session.iscsi.MaxBurstLength = 16776192 Jul 03 09:52:17.566097 np0000004400 cinder-backup[101319]: node.session.iscsi.DefaultTime2Retain = 0 Jul 03 09:52:17.566097 np0000004400 cinder-backup[101319]: node.session.iscsi.DefaultTime2Wait = 2 Jul 03 09:52:17.566097 np0000004400 cinder-backup[101319]: node.session.iscsi.MaxConnections = 1 Jul 03 09:52:17.566097 np0000004400 cinder-backup[101319]: node.session.iscsi.MaxOutstandingR2T = 1 Jul 03 09:52:17.566097 np0000004400 cinder-backup[101319]: node.session.iscsi.ERL = 0 Jul 03 09:52:17.566097 np0000004400 cinder-backup[101319]: node.session.scan = auto Jul 03 09:52:17.566097 np0000004400 cinder-backup[101319]: node.session.reopen_max = 0 Jul 03 09:52:17.566097 np0000004400 cinder-backup[101319]: node.conn[0].address = 192.168.40.100 Jul 03 09:52:17.566097 np0000004400 cinder-backup[101319]: node.conn[0].port = 3260 Jul 03 09:52:17.566097 np0000004400 cinder-backup[101319]: node.conn[0].startup = manual Jul 03 09:52:17.566097 np0000004400 cinder-backup[101319]: node.conn[0].tcp.window_size = 524288 Jul 03 09:52:17.566097 np0000004400 cinder-backup[101319]: node.conn[0].tcp.type_of_service = 0 Jul 03 09:52:17.566097 np0000004400 cinder-backup[101319]: node.conn[0].timeo.logout_timeout = 15 Jul 03 09:52:17.566097 np0000004400 cinder-backup[101319]: node.conn[0].timeo.login_timeout = 15 Jul 03 09:52:17.566097 np0000004400 cinder-backup[101319]: node.conn[0].timeo.auth_timeout = 45 Jul 03 09:52:17.566097 np0000004400 cinder-backup[101319]: node.conn[0].timeo.noop_out_interval = 5 Jul 03 09:52:17.566097 np0000004400 cinder-backup[101319]: node.conn[0].timeo.noop_out_timeout = 5 Jul 03 09:52:17.566097 np0000004400 cinder-backup[101319]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0 Jul 03 09:52:17.566097 np0000004400 cinder-backup[101319]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144 Jul 03 09:52:17.566097 np0000004400 cinder-backup[101319]: node.conn[0].iscsi.HeaderDigest = None Jul 03 09:52:17.566097 np0000004400 cinder-backup[101319]: node.conn[0].iscsi.DataDigest = None Jul 03 09:52:17.566097 np0000004400 cinder-backup[101319]: node.conn[0].iscsi.IFMarker = No Jul 03 09:52:17.566097 np0000004400 cinder-backup[101319]: node.conn[0].iscsi.OFMarker = No Jul 03 09:52:17.566097 np0000004400 cinder-backup[101319]: # END RECORD Jul 03 09:52:17.566097 np0000004400 cinder-backup[101319]: stderr= {{(pid=101319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 03 09:52:17.582428 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-5699de5f-5de3-481e-8d5c-0885569e101d tempest-CreateVolumesFromBackupTest-1420824915 None] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=101319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 03 09:52:17.592997 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-5699de5f-5de3-481e-8d5c-0885569e101d tempest-CreateVolumesFromBackupTest-1420824915 None] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions. Jul 03 09:52:17.592997 np0000004400 cinder-backup[101319]: {{(pid=101319) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jul 03 09:52:17.593146 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-5699de5f-5de3-481e-8d5c-0885569e101d tempest-CreateVolumesFromBackupTest-1420824915 None] iscsi session list stdout= stderr=iscsiadm: No active sessions. Jul 03 09:52:17.593146 np0000004400 cinder-backup[101319]: {{(pid=101319) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jul 03 09:52:17.593231 np0000004400 cinder-backup[101319]: WARNING os_brick.initiator.connectors.iscsi [None req-5699de5f-5de3-481e-8d5c-0885569e101d tempest-CreateVolumesFromBackupTest-1420824915 None] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions. Jul 03 09:52:17.593231 np0000004400 cinder-backup[101319]: Jul 03 09:52:18.623068 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-5699de5f-5de3-481e-8d5c-0885569e101d tempest-CreateVolumesFromBackupTest-1420824915 None] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-ed8e3f76-cf7d-4910-b52d-4dfa2049cde1, portal: 192.168.40.100,3260] Jul 03 09:52:18.623068 np0000004400 cinder-backup[101319]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-ed8e3f76-cf7d-4910-b52d-4dfa2049cde1, portal: 192.168.40.100,3260] successful. Jul 03 09:52:18.623068 np0000004400 cinder-backup[101319]: stderr= {{(pid=101319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 03 09:52:18.633290 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-5699de5f-5de3-481e-8d5c-0885569e101d tempest-CreateVolumesFromBackupTest-1420824915 None] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=101319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 03 09:52:18.644583 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-5699de5f-5de3-481e-8d5c-0885569e101d tempest-CreateVolumesFromBackupTest-1420824915 None] iscsiadm ('-m', 'session'): stdout=tcp: [182] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ed8e3f76-cf7d-4910-b52d-4dfa2049cde1 (non-flash) Jul 03 09:52:18.644583 np0000004400 cinder-backup[101319]: stderr= {{(pid=101319) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jul 03 09:52:18.644777 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-5699de5f-5de3-481e-8d5c-0885569e101d tempest-CreateVolumesFromBackupTest-1420824915 None] iscsi session list stdout=tcp: [182] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ed8e3f76-cf7d-4910-b52d-4dfa2049cde1 (non-flash) Jul 03 09:52:18.644777 np0000004400 cinder-backup[101319]: stderr= {{(pid=101319) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jul 03 09:52:18.645122 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.base [None req-5699de5f-5de3-481e-8d5c-0885569e101d tempest-CreateVolumesFromBackupTest-1420824915 None] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-ed8e3f76-cf7d-4910-b52d-4dfa2049cde1" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 2.112s {{(pid=101319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jul 03 09:52:18.645288 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-5699de5f-5de3-481e-8d5c-0885569e101d tempest-CreateVolumesFromBackupTest-1420824915 None] Connected to 192.168.40.100:3260 {{(pid=101319) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}} Jul 03 09:52:18.645732 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.linuxscsi [None req-5699de5f-5de3-481e-8d5c-0885569e101d tempest-CreateVolumesFromBackupTest-1420824915 None] HCTL ('7', '-', '-', 0) found on session 182 with lun 0 {{(pid=101319) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}} Jul 03 09:52:18.645908 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.linuxscsi [None req-5699de5f-5de3-481e-8d5c-0885569e101d tempest-CreateVolumesFromBackupTest-1420824915 None] Scanning host 7 c: -, t: -, l: 0) {{(pid=101319) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}} Jul 03 09:52:18.661438 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.linuxscsi [None req-5699de5f-5de3-481e-8d5c-0885569e101d tempest-CreateVolumesFromBackupTest-1420824915 None] Searching for a device in session 182 and hctl ['7', '*', '*', 0] yield: sdb {{(pid=101319) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}} Jul 03 09:52:18.661663 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-5699de5f-5de3-481e-8d5c-0885569e101d tempest-CreateVolumesFromBackupTest-1420824915 None] Connected to sdb using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-ed8e3f76-cf7d-4910-b52d-4dfa2049cde1', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'ed8e3f76-cf7d-4910-b52d-4dfa2049cde1', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': False} {{(pid=101319) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}} Jul 03 09:52:19.663552 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.base [None req-5699de5f-5de3-481e-8d5c-0885569e101d tempest-CreateVolumesFromBackupTest-1420824915 None] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 3.142s {{(pid=101319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jul 03 09:52:19.663990 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-5699de5f-5de3-481e-8d5c-0885569e101d tempest-CreateVolumesFromBackupTest-1420824915 None] <== connect_volume: return (3143ms) {'type': 'block', 'scsi_wwn': '1StorPooliSCSI_DISK_1034578903445799190', 'path': '/dev/sdb'} {{(pid=101319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}} Jul 03 09:52:19.666539 np0000004400 cinder-backup[101319]: DEBUG oslo_concurrency.processutils [None req-5699de5f-5de3-481e-8d5c-0885569e101d tempest-CreateVolumesFromBackupTest-1420824915 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chown 1002 /dev/sdb {{(pid=101319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 09:52:19.683507 np0000004400 sudo[152411]: stack : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chown 1002 /dev/sdb Jul 03 09:52:19.684099 np0000004400 sudo[152411]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1002) Jul 03 09:52:19.977577 np0000004400 sudo[152411]: pam_unix(sudo:session): session closed for user root Jul 03 09:52:19.979782 np0000004400 cinder-backup[101319]: DEBUG oslo_concurrency.processutils [None req-5699de5f-5de3-481e-8d5c-0885569e101d tempest-CreateVolumesFromBackupTest-1420824915 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chown 1002 /dev/sdb" returned: 0 in 0.315s {{(pid=101319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 09:52:20.023639 np0000004400 cinder-backup[101319]: DEBUG oslo_db.sqlalchemy.engines [None req-5699de5f-5de3-481e-8d5c-0885569e101d tempest-CreateVolumesFromBackupTest-1420824915 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=101319) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 03 09:52:20.029529 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-5699de5f-5de3-481e-8d5c-0885569e101d tempest-CreateVolumesFromBackupTest-1420824915 None] _create_container started, container: volumebackups,backup: 612b0c88-04d4-4352-9b18-16c747e8225a. {{(pid=101319) _create_container /opt/stack/cinder/cinder/backup/chunkeddriver.py:249}} Jul 03 09:52:20.107532 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.drivers.swift [None req-5699de5f-5de3-481e-8d5c-0885569e101d tempest-CreateVolumesFromBackupTest-1420824915 None] generate_object_name_prefix: volume_ed8e3f76-cf7d-4910-b52d-4dfa2049cde1/20260703095220/az_nova_backup_612b0c88-04d4-4352-9b18-16c747e8225a {{(pid=101319) _generate_object_name_prefix /opt/stack/cinder/cinder/backup/drivers/swift.py:452}} Jul 03 09:52:20.115966 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-5699de5f-5de3-481e-8d5c-0885569e101d tempest-CreateVolumesFromBackupTest-1420824915 None] starting backup of volume: ed8e3f76-cf7d-4910-b52d-4dfa2049cde1, volume size: 1073741824, object names prefix volume_ed8e3f76-cf7d-4910-b52d-4dfa2049cde1/20260703095220/az_nova_backup_612b0c88-04d4-4352-9b18-16c747e8225a, availability zone: nova {{(pid=101319) _prepare_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:359}} Jul 03 09:52:20.304449 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-5699de5f-5de3-481e-8d5c-0885569e101d tempest-CreateVolumesFromBackupTest-1420824915 None] Backing up chunk of data from volume. {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 09:52:20.560517 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-5699de5f-5de3-481e-8d5c-0885569e101d tempest-CreateVolumesFromBackupTest-1420824915 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101319) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 09:52:20.560695 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-5699de5f-5de3-481e-8d5c-0885569e101d tempest-CreateVolumesFromBackupTest-1420824915 None] About to put_object {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 09:52:20.665034 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-5699de5f-5de3-481e-8d5c-0885569e101d tempest-CreateVolumesFromBackupTest-1420824915 None] backup MD5 for volume_ed8e3f76-cf7d-4910-b52d-4dfa2049cde1/20260703095220/az_nova_backup_612b0c88-04d4-4352-9b18-16c747e8225a-00001: 25e317773f308e446cc84c503a6d1f85 {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 09:52:20.665388 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-5699de5f-5de3-481e-8d5c-0885569e101d tempest-CreateVolumesFromBackupTest-1420824915 None] Calling eventlet.sleep(0) {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 09:52:20.847366 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-5699de5f-5de3-481e-8d5c-0885569e101d tempest-CreateVolumesFromBackupTest-1420824915 None] Backing up chunk of data from volume. {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 09:52:21.089792 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-5699de5f-5de3-481e-8d5c-0885569e101d tempest-CreateVolumesFromBackupTest-1420824915 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101319) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 09:52:21.089970 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-5699de5f-5de3-481e-8d5c-0885569e101d tempest-CreateVolumesFromBackupTest-1420824915 None] About to put_object {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 09:52:21.191779 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-5699de5f-5de3-481e-8d5c-0885569e101d tempest-CreateVolumesFromBackupTest-1420824915 None] backup MD5 for volume_ed8e3f76-cf7d-4910-b52d-4dfa2049cde1/20260703095220/az_nova_backup_612b0c88-04d4-4352-9b18-16c747e8225a-00002: 25e317773f308e446cc84c503a6d1f85 {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 09:52:21.191927 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-5699de5f-5de3-481e-8d5c-0885569e101d tempest-CreateVolumesFromBackupTest-1420824915 None] Calling eventlet.sleep(0) {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 09:52:21.382770 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-5699de5f-5de3-481e-8d5c-0885569e101d tempest-CreateVolumesFromBackupTest-1420824915 None] Backing up chunk of data from volume. {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 09:52:21.627368 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-5699de5f-5de3-481e-8d5c-0885569e101d tempest-CreateVolumesFromBackupTest-1420824915 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101319) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 09:52:21.627518 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-5699de5f-5de3-481e-8d5c-0885569e101d tempest-CreateVolumesFromBackupTest-1420824915 None] About to put_object {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 09:52:21.729902 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-5699de5f-5de3-481e-8d5c-0885569e101d tempest-CreateVolumesFromBackupTest-1420824915 None] backup MD5 for volume_ed8e3f76-cf7d-4910-b52d-4dfa2049cde1/20260703095220/az_nova_backup_612b0c88-04d4-4352-9b18-16c747e8225a-00003: 25e317773f308e446cc84c503a6d1f85 {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 09:52:21.730156 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-5699de5f-5de3-481e-8d5c-0885569e101d tempest-CreateVolumesFromBackupTest-1420824915 None] Calling eventlet.sleep(0) {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 09:52:21.925808 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-5699de5f-5de3-481e-8d5c-0885569e101d tempest-CreateVolumesFromBackupTest-1420824915 None] Backing up chunk of data from volume. {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 09:52:22.175480 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-5699de5f-5de3-481e-8d5c-0885569e101d tempest-CreateVolumesFromBackupTest-1420824915 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101319) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 09:52:22.175610 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-5699de5f-5de3-481e-8d5c-0885569e101d tempest-CreateVolumesFromBackupTest-1420824915 None] About to put_object {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 09:52:22.272346 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-5699de5f-5de3-481e-8d5c-0885569e101d tempest-CreateVolumesFromBackupTest-1420824915 None] backup MD5 for volume_ed8e3f76-cf7d-4910-b52d-4dfa2049cde1/20260703095220/az_nova_backup_612b0c88-04d4-4352-9b18-16c747e8225a-00004: 25e317773f308e446cc84c503a6d1f85 {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 09:52:22.272496 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-5699de5f-5de3-481e-8d5c-0885569e101d tempest-CreateVolumesFromBackupTest-1420824915 None] Calling eventlet.sleep(0) {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 09:52:22.442035 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-5699de5f-5de3-481e-8d5c-0885569e101d tempest-CreateVolumesFromBackupTest-1420824915 None] Backing up chunk of data from volume. {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 09:52:22.689050 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-5699de5f-5de3-481e-8d5c-0885569e101d tempest-CreateVolumesFromBackupTest-1420824915 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101319) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 09:52:22.689232 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-5699de5f-5de3-481e-8d5c-0885569e101d tempest-CreateVolumesFromBackupTest-1420824915 None] About to put_object {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 09:52:22.798095 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-5699de5f-5de3-481e-8d5c-0885569e101d tempest-CreateVolumesFromBackupTest-1420824915 None] backup MD5 for volume_ed8e3f76-cf7d-4910-b52d-4dfa2049cde1/20260703095220/az_nova_backup_612b0c88-04d4-4352-9b18-16c747e8225a-00005: 25e317773f308e446cc84c503a6d1f85 {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 09:52:22.798560 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-5699de5f-5de3-481e-8d5c-0885569e101d tempest-CreateVolumesFromBackupTest-1420824915 None] Calling eventlet.sleep(0) {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 09:52:22.976616 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-5699de5f-5de3-481e-8d5c-0885569e101d tempest-CreateVolumesFromBackupTest-1420824915 None] Backing up chunk of data from volume. {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 09:52:23.218927 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-5699de5f-5de3-481e-8d5c-0885569e101d tempest-CreateVolumesFromBackupTest-1420824915 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101319) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 09:52:23.219070 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-5699de5f-5de3-481e-8d5c-0885569e101d tempest-CreateVolumesFromBackupTest-1420824915 None] About to put_object {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 09:52:23.317359 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-5699de5f-5de3-481e-8d5c-0885569e101d tempest-CreateVolumesFromBackupTest-1420824915 None] backup MD5 for volume_ed8e3f76-cf7d-4910-b52d-4dfa2049cde1/20260703095220/az_nova_backup_612b0c88-04d4-4352-9b18-16c747e8225a-00006: 25e317773f308e446cc84c503a6d1f85 {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 09:52:23.317634 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-5699de5f-5de3-481e-8d5c-0885569e101d tempest-CreateVolumesFromBackupTest-1420824915 None] Calling eventlet.sleep(0) {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 09:52:23.489755 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-5699de5f-5de3-481e-8d5c-0885569e101d tempest-CreateVolumesFromBackupTest-1420824915 None] Backing up chunk of data from volume. {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 09:52:23.736481 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-5699de5f-5de3-481e-8d5c-0885569e101d tempest-CreateVolumesFromBackupTest-1420824915 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101319) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 09:52:23.736694 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-5699de5f-5de3-481e-8d5c-0885569e101d tempest-CreateVolumesFromBackupTest-1420824915 None] About to put_object {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 09:52:23.842630 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-5699de5f-5de3-481e-8d5c-0885569e101d tempest-CreateVolumesFromBackupTest-1420824915 None] backup MD5 for volume_ed8e3f76-cf7d-4910-b52d-4dfa2049cde1/20260703095220/az_nova_backup_612b0c88-04d4-4352-9b18-16c747e8225a-00007: 25e317773f308e446cc84c503a6d1f85 {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 09:52:23.843050 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-5699de5f-5de3-481e-8d5c-0885569e101d tempest-CreateVolumesFromBackupTest-1420824915 None] Calling eventlet.sleep(0) {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 09:52:24.016796 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-5699de5f-5de3-481e-8d5c-0885569e101d tempest-CreateVolumesFromBackupTest-1420824915 None] Backing up chunk of data from volume. {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 09:52:24.239109 np0000004400 cinder-backup[101319]: INFO cinder.backup.manager [None req-e2a239c1-a5c3-4759-b610-3512241e5030 tempest-ProjectMemberTests39-542595828 None] Create backup started, backup: f0698713-73de-488e-b4bc-5345c39468df volume: 3aeb27c4-5945-48bd-8fd2-f6544f92caec. Jul 03 09:52:24.245216 np0000004400 cinder-backup[101319]: INFO cinder.backup.manager [None req-e2a239c1-a5c3-4759-b610-3512241e5030 tempest-ProjectMemberTests39-542595828 None] Call Volume Manager to get_backup_device for Backup(availability_zone='nova',container=None,created_at=2026-07-03T09:52:24Z,data_timestamp=2026-07-03T09:52:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-type-Backup-1279255939',encryption_key_id=None,fail_reason=None,host='np0000004400',id=f0698713-73de-488e-b4bc-5345c39468df,metadata={},num_dependent_backups=0,object_count=0,parent=None,parent_id=None,project_id='643865a996c9465fa68ff84007ce7ab6',restore_volume_id=None,service='cinder.backup.drivers.swift.SwiftBackupDriver',service_metadata=None,size=1,snapshot_id=None,status='creating',temp_snapshot_id=None,temp_volume_id=None,updated_at=None,user_id='b22a8ba735af450898b773bff0efd847',volume_id=3aeb27c4-5945-48bd-8fd2-f6544f92caec) Jul 03 09:52:24.254615 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-5699de5f-5de3-481e-8d5c-0885569e101d tempest-CreateVolumesFromBackupTest-1420824915 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101319) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 09:52:24.254800 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-5699de5f-5de3-481e-8d5c-0885569e101d tempest-CreateVolumesFromBackupTest-1420824915 None] About to put_object {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 09:52:24.275486 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.drivers.swift [None req-e2a239c1-a5c3-4759-b610-3512241e5030 tempest-ProjectMemberTests39-542595828 None] Using swift URL https://10.4.3.95:8080/v1/AUTH_643865a996c9465fa68ff84007ce7ab6 {{(pid=101319) initialize /opt/stack/cinder/cinder/backup/drivers/swift.py:300}} Jul 03 09:52:24.275939 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.drivers.swift [None req-e2a239c1-a5c3-4759-b610-3512241e5030 tempest-ProjectMemberTests39-542595828 None] Connect to https://10.4.3.95:8080/v1/AUTH_ in "per_user" mode {{(pid=101319) initialize /opt/stack/cinder/cinder/backup/drivers/swift.py:301}} Jul 03 09:52:24.276456 np0000004400 cinder-backup[101319]: DEBUG os_brick.utils [None req-e2a239c1-a5c3-4759-b610-3512241e5030 tempest-ProjectMemberTests39-542595828 None] ==> get_connector_properties: call "{'root_helper': 'sudo cinder-rootwrap /etc/cinder/rootwrap.conf', 'my_ip': '10.4.3.95', 'multipath': False, 'enforce_multipath': False, 'host': None, 'execute': None}" {{(pid=101319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}} Jul 03 09:52:24.289304 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.scaleio [None req-e2a239c1-a5c3-4759-b610-3512241e5030 tempest-ProjectMemberTests39-542595828 None] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=101319) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}} Jul 03 09:52:24.309433 np0000004400 cinder-backup[101319]: DEBUG oslo_concurrency.processutils [None req-e2a239c1-a5c3-4759-b610-3512241e5030 tempest-ProjectMemberTests39-542595828 None] Running cmd (subprocess): nvme version {{(pid=101319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 09:52:24.323811 np0000004400 cinder-backup[101319]: DEBUG oslo_concurrency.processutils [None req-e2a239c1-a5c3-4759-b610-3512241e5030 tempest-ProjectMemberTests39-542595828 None] 'nvme version' failed. Not Retrying. {{(pid=101319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 03 09:52:24.324000 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.nvmeof [None req-e2a239c1-a5c3-4759-b610-3512241e5030 tempest-ProjectMemberTests39-542595828 None] nvme not present on system {{(pid=101319) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}} Jul 03 09:52:24.331202 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.lightos [None req-e2a239c1-a5c3-4759-b610-3512241e5030 tempest-ProjectMemberTests39-542595828 None] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=101319) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}} Jul 03 09:52:24.332545 np0000004400 cinder-backup[101319]: INFO os_brick.initiator.connectors.lightos [None req-e2a239c1-a5c3-4759-b610-3512241e5030 tempest-ProjectMemberTests39-542595828 None] Current host hostNQN and IP(s) are ['10.4.3.95', 'fe80::f816:3eff:fe47:268c', '192.168.40.6', 'fe80::f816:3eff:febf:7be2', '192.168.50.6', 'fe80::f816:3eff:fe99:8914', '192.168.10.6', 'fe80::f816:3eff:fe2f:e696', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::bc9d:84ff:fec2:6b49', 'fe80::fc16:3eff:fe03:4d48', 'fe80::3c07:afff:fe8d:d011', 'fe80::fc16:3eff:fe6a:1a3e', 'fe80::b099:12ff:feb4:ede7', 'fe80::fc16:3eff:fe13:9420', 'fe80::8cea:42ff:fe99:b64a'] Jul 03 09:52:24.332727 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.lightos [None req-e2a239c1-a5c3-4759-b610-3512241e5030 tempest-ProjectMemberTests39-542595828 None] LIGHTOS: did not find dsc, continuing anyway. {{(pid=101319) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}} Jul 03 09:52:24.332888 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.lightos [None req-e2a239c1-a5c3-4759-b610-3512241e5030 tempest-ProjectMemberTests39-542595828 None] LIGHTOS: no hostnqn found. {{(pid=101319) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}} Jul 03 09:52:24.333202 np0000004400 cinder-backup[101319]: DEBUG os_brick.utils [None req-e2a239c1-a5c3-4759-b610-3512241e5030 tempest-ProjectMemberTests39-542595828 None] <== get_connector_properties: return (56ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.95', 'host': 'np0000004400', 'multipath': False, 'enforce_multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:ae7e5bb0ebe6', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': '6b284368-d0ba-4d18-af6f-4998d3955c52', 'nvme_native_multipath': False} {{(pid=101319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}} Jul 03 09:52:24.378304 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-5699de5f-5de3-481e-8d5c-0885569e101d tempest-CreateVolumesFromBackupTest-1420824915 None] backup MD5 for volume_ed8e3f76-cf7d-4910-b52d-4dfa2049cde1/20260703095220/az_nova_backup_612b0c88-04d4-4352-9b18-16c747e8225a-00008: 25e317773f308e446cc84c503a6d1f85 {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 09:52:24.378304 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-5699de5f-5de3-481e-8d5c-0885569e101d tempest-CreateVolumesFromBackupTest-1420824915 None] Calling eventlet.sleep(0) {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 09:52:24.415838 np0000004400 cinder-backup[101319]: DEBUG oslo_db.sqlalchemy.engines [None req-5699de5f-5de3-481e-8d5c-0885569e101d tempest-CreateVolumesFromBackupTest-1420824915 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=101319) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 03 09:52:24.613135 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-5699de5f-5de3-481e-8d5c-0885569e101d tempest-CreateVolumesFromBackupTest-1420824915 None] Backing up chunk of data from volume. {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 09:52:24.837887 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connector [None req-e2a239c1-a5c3-4759-b610-3512241e5030 tempest-ProjectMemberTests39-542595828 None] Factory for iscsi on None {{(pid=101319) factory /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connector.py:243}} Jul 03 09:52:24.838572 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-e2a239c1-a5c3-4759-b610-3512241e5030 tempest-ProjectMemberTests39-542595828 None] ==> connect_volume: call "{'self': , 'connection_properties': {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-3aeb27c4-5945-48bd-8fd2-f6544f92caec', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '3aeb27c4-5945-48bd-8fd2-f6544f92caec', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': False}}" {{(pid=101319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}} Jul 03 09:52:24.838798 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.base [None req-e2a239c1-a5c3-4759-b610-3512241e5030 tempest-ProjectMemberTests39-542595828 None] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=101319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jul 03 09:52:24.865266 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-5699de5f-5de3-481e-8d5c-0885569e101d tempest-CreateVolumesFromBackupTest-1420824915 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101319) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 09:52:24.865266 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-5699de5f-5de3-481e-8d5c-0885569e101d tempest-CreateVolumesFromBackupTest-1420824915 None] About to put_object {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 09:52:24.990620 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-5699de5f-5de3-481e-8d5c-0885569e101d tempest-CreateVolumesFromBackupTest-1420824915 None] backup MD5 for volume_ed8e3f76-cf7d-4910-b52d-4dfa2049cde1/20260703095220/az_nova_backup_612b0c88-04d4-4352-9b18-16c747e8225a-00009: 25e317773f308e446cc84c503a6d1f85 {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 09:52:24.990769 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-5699de5f-5de3-481e-8d5c-0885569e101d tempest-CreateVolumesFromBackupTest-1420824915 None] Calling eventlet.sleep(0) {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 09:52:25.213851 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-5699de5f-5de3-481e-8d5c-0885569e101d tempest-CreateVolumesFromBackupTest-1420824915 None] Backing up chunk of data from volume. {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 09:52:25.455240 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-5699de5f-5de3-481e-8d5c-0885569e101d tempest-CreateVolumesFromBackupTest-1420824915 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101319) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 09:52:25.455456 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-5699de5f-5de3-481e-8d5c-0885569e101d tempest-CreateVolumesFromBackupTest-1420824915 None] About to put_object {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 09:52:25.552960 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-5699de5f-5de3-481e-8d5c-0885569e101d tempest-CreateVolumesFromBackupTest-1420824915 None] backup MD5 for volume_ed8e3f76-cf7d-4910-b52d-4dfa2049cde1/20260703095220/az_nova_backup_612b0c88-04d4-4352-9b18-16c747e8225a-00010: 25e317773f308e446cc84c503a6d1f85 {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 09:52:25.553173 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-5699de5f-5de3-481e-8d5c-0885569e101d tempest-CreateVolumesFromBackupTest-1420824915 None] Calling eventlet.sleep(0) {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 09:52:25.727093 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-5699de5f-5de3-481e-8d5c-0885569e101d tempest-CreateVolumesFromBackupTest-1420824915 None] Backing up chunk of data from volume. {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 09:52:25.974757 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-5699de5f-5de3-481e-8d5c-0885569e101d tempest-CreateVolumesFromBackupTest-1420824915 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101319) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 09:52:25.975121 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-5699de5f-5de3-481e-8d5c-0885569e101d tempest-CreateVolumesFromBackupTest-1420824915 None] About to put_object {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 09:52:26.072711 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-5699de5f-5de3-481e-8d5c-0885569e101d tempest-CreateVolumesFromBackupTest-1420824915 None] backup MD5 for volume_ed8e3f76-cf7d-4910-b52d-4dfa2049cde1/20260703095220/az_nova_backup_612b0c88-04d4-4352-9b18-16c747e8225a-00011: 25e317773f308e446cc84c503a6d1f85 {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 09:52:26.072904 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-5699de5f-5de3-481e-8d5c-0885569e101d tempest-CreateVolumesFromBackupTest-1420824915 None] Calling eventlet.sleep(0) {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 09:52:26.256393 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-5699de5f-5de3-481e-8d5c-0885569e101d tempest-CreateVolumesFromBackupTest-1420824915 None] Backing up chunk of data from volume. {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 09:52:26.497969 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-5699de5f-5de3-481e-8d5c-0885569e101d tempest-CreateVolumesFromBackupTest-1420824915 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101319) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 09:52:26.498215 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-5699de5f-5de3-481e-8d5c-0885569e101d tempest-CreateVolumesFromBackupTest-1420824915 None] About to put_object {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 09:52:26.599283 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-5699de5f-5de3-481e-8d5c-0885569e101d tempest-CreateVolumesFromBackupTest-1420824915 None] backup MD5 for volume_ed8e3f76-cf7d-4910-b52d-4dfa2049cde1/20260703095220/az_nova_backup_612b0c88-04d4-4352-9b18-16c747e8225a-00012: 25e317773f308e446cc84c503a6d1f85 {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 09:52:26.599478 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-5699de5f-5de3-481e-8d5c-0885569e101d tempest-CreateVolumesFromBackupTest-1420824915 None] Calling eventlet.sleep(0) {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 09:52:26.778010 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-5699de5f-5de3-481e-8d5c-0885569e101d tempest-CreateVolumesFromBackupTest-1420824915 None] Backing up chunk of data from volume. {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 09:52:26.905536 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.base [None req-e2a239c1-a5c3-4759-b610-3512241e5030 tempest-ProjectMemberTests39-542595828 None] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 2.066s {{(pid=101319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jul 03 09:52:26.905536 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.base [None req-e2a239c1-a5c3-4759-b610-3512241e5030 tempest-ProjectMemberTests39-542595828 None] Connection properties {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-3aeb27c4-5945-48bd-8fd2-f6544f92caec', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '3aeb27c4-5945-48bd-8fd2-f6544f92caec', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': False} {{(pid=101319) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}} Jul 03 09:52:26.918077 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.base [None req-e2a239c1-a5c3-4759-b610-3512241e5030 tempest-ProjectMemberTests39-542595828 None] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-3aeb27c4-5945-48bd-8fd2-f6544f92caec" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=101319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jul 03 09:52:26.919211 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.base [None req-e2a239c1-a5c3-4759-b610-3512241e5030 tempest-ProjectMemberTests39-542595828 None] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-3aeb27c4-5945-48bd-8fd2-f6544f92caec" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=101319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jul 03 09:52:26.919211 np0000004400 cinder-backup[101319]: INFO os_brick.initiator.connectors.iscsi [None req-e2a239c1-a5c3-4759-b610-3512241e5030 tempest-ProjectMemberTests39-542595828 None] Trying to connect to iSCSI portal 192.168.40.100:3260 Jul 03 09:52:26.930762 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-e2a239c1-a5c3-4759-b610-3512241e5030 tempest-ProjectMemberTests39-542595828 None] iscsiadm (): stdout= stderr=iscsiadm: No records found Jul 03 09:52:26.930762 np0000004400 cinder-backup[101319]: {{(pid=101319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 03 09:52:26.943616 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-e2a239c1-a5c3-4759-b610-3512241e5030 tempest-ProjectMemberTests39-542595828 None] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-3aeb27c4-5945-48bd-8fd2-f6544f92caec] added Jul 03 09:52:26.943616 np0000004400 cinder-backup[101319]: stderr=iscsiadm: Config file line 363 does not have value Jul 03 09:52:26.943616 np0000004400 cinder-backup[101319]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs' Jul 03 09:52:26.943616 np0000004400 cinder-backup[101319]: iscsiadm: Config file line 363 does not have value Jul 03 09:52:26.943616 np0000004400 cinder-backup[101319]: iscsiadm: Config file line 363 does not have value Jul 03 09:52:26.943616 np0000004400 cinder-backup[101319]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs' Jul 03 09:52:26.943616 np0000004400 cinder-backup[101319]: {{(pid=101319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 03 09:52:26.944831 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-e2a239c1-a5c3-4759-b610-3512241e5030 tempest-ProjectMemberTests39-542595828 None] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=101319) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}} Jul 03 09:52:26.944831 np0000004400 cinder-backup[101319]: DEBUG os_brick.utils [None req-e2a239c1-a5c3-4759-b610-3512241e5030 tempest-ProjectMemberTests39-542595828 None] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0254(s), this was the 1st time calling it. {{(pid=101319) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}} Jul 03 09:52:26.944831 np0000004400 cinder-backup[101319]: DEBUG os_brick.utils [None req-e2a239c1-a5c3-4759-b610-3512241e5030 tempest-ProjectMemberTests39-542595828 None] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=101319) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}} Jul 03 09:52:27.024481 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-5699de5f-5de3-481e-8d5c-0885569e101d tempest-CreateVolumesFromBackupTest-1420824915 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101319) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 09:52:27.024481 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-5699de5f-5de3-481e-8d5c-0885569e101d tempest-CreateVolumesFromBackupTest-1420824915 None] About to put_object {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 09:52:27.124599 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-5699de5f-5de3-481e-8d5c-0885569e101d tempest-CreateVolumesFromBackupTest-1420824915 None] backup MD5 for volume_ed8e3f76-cf7d-4910-b52d-4dfa2049cde1/20260703095220/az_nova_backup_612b0c88-04d4-4352-9b18-16c747e8225a-00013: 25e317773f308e446cc84c503a6d1f85 {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 09:52:27.125764 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-5699de5f-5de3-481e-8d5c-0885569e101d tempest-CreateVolumesFromBackupTest-1420824915 None] Calling eventlet.sleep(0) {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 09:52:27.299514 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-5699de5f-5de3-481e-8d5c-0885569e101d tempest-CreateVolumesFromBackupTest-1420824915 None] Backing up chunk of data from volume. {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 09:52:27.542498 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-5699de5f-5de3-481e-8d5c-0885569e101d tempest-CreateVolumesFromBackupTest-1420824915 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101319) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 09:52:27.542620 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-5699de5f-5de3-481e-8d5c-0885569e101d tempest-CreateVolumesFromBackupTest-1420824915 None] About to put_object {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 09:52:27.643276 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-5699de5f-5de3-481e-8d5c-0885569e101d tempest-CreateVolumesFromBackupTest-1420824915 None] backup MD5 for volume_ed8e3f76-cf7d-4910-b52d-4dfa2049cde1/20260703095220/az_nova_backup_612b0c88-04d4-4352-9b18-16c747e8225a-00014: 25e317773f308e446cc84c503a6d1f85 {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 09:52:27.643463 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-5699de5f-5de3-481e-8d5c-0885569e101d tempest-CreateVolumesFromBackupTest-1420824915 None] Calling eventlet.sleep(0) {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 09:52:27.820214 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-5699de5f-5de3-481e-8d5c-0885569e101d tempest-CreateVolumesFromBackupTest-1420824915 None] Backing up chunk of data from volume. {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 09:52:27.945914 np0000004400 cinder-backup[101319]: INFO os_brick.initiator.connectors.iscsi [None req-e2a239c1-a5c3-4759-b610-3512241e5030 tempest-ProjectMemberTests39-542595828 None] Trying to connect to iSCSI portal 192.168.40.100:3260 Jul 03 09:52:27.956621 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-e2a239c1-a5c3-4759-b610-3512241e5030 tempest-ProjectMemberTests39-542595828 None] iscsiadm (): stdout=# BEGIN RECORD 2.1.9 Jul 03 09:52:27.956621 np0000004400 cinder-backup[101319]: node.name = iqn.2023-03.storpool.com:os--volume-3aeb27c4-5945-48bd-8fd2-f6544f92caec Jul 03 09:52:27.956621 np0000004400 cinder-backup[101319]: node.tpgt = -1 Jul 03 09:52:27.956621 np0000004400 cinder-backup[101319]: node.startup = manual Jul 03 09:52:27.956621 np0000004400 cinder-backup[101319]: node.leading_login = No Jul 03 09:52:27.956621 np0000004400 cinder-backup[101319]: iface.iscsi_ifacename = default Jul 03 09:52:27.956621 np0000004400 cinder-backup[101319]: iface.net_ifacename = Jul 03 09:52:27.956621 np0000004400 cinder-backup[101319]: iface.ipaddress = Jul 03 09:52:27.956621 np0000004400 cinder-backup[101319]: iface.prefix_len = 0 Jul 03 09:52:27.956621 np0000004400 cinder-backup[101319]: iface.hwaddress = Jul 03 09:52:27.956621 np0000004400 cinder-backup[101319]: iface.transport_name = tcp Jul 03 09:52:27.956621 np0000004400 cinder-backup[101319]: iface.initiatorname = Jul 03 09:52:27.956621 np0000004400 cinder-backup[101319]: iface.state = Jul 03 09:52:27.956621 np0000004400 cinder-backup[101319]: iface.vlan_id = 0 Jul 03 09:52:27.956621 np0000004400 cinder-backup[101319]: iface.vlan_priority = 0 Jul 03 09:52:27.956621 np0000004400 cinder-backup[101319]: iface.vlan_state = Jul 03 09:52:27.956621 np0000004400 cinder-backup[101319]: iface.iface_num = 0 Jul 03 09:52:27.956621 np0000004400 cinder-backup[101319]: iface.mtu = 0 Jul 03 09:52:27.956621 np0000004400 cinder-backup[101319]: iface.port = 0 Jul 03 09:52:27.956621 np0000004400 cinder-backup[101319]: iface.bootproto = Jul 03 09:52:27.956621 np0000004400 cinder-backup[101319]: iface.subnet_mask = Jul 03 09:52:27.956621 np0000004400 cinder-backup[101319]: iface.gateway = Jul 03 09:52:27.956621 np0000004400 cinder-backup[101319]: iface.dhcp_alt_client_id_state = Jul 03 09:52:27.956621 np0000004400 cinder-backup[101319]: iface.dhcp_alt_client_id = Jul 03 09:52:27.956621 np0000004400 cinder-backup[101319]: iface.dhcp_dns = Jul 03 09:52:27.956621 np0000004400 cinder-backup[101319]: iface.dhcp_learn_iqn = Jul 03 09:52:27.956621 np0000004400 cinder-backup[101319]: iface.dhcp_req_vendor_id_state = Jul 03 09:52:27.956621 np0000004400 cinder-backup[101319]: iface.dhcp_vendor_id_state = Jul 03 09:52:27.956621 np0000004400 cinder-backup[101319]: iface.dhcp_vendor_id = Jul 03 09:52:27.956621 np0000004400 cinder-backup[101319]: iface.dhcp_slp_da = Jul 03 09:52:27.956621 np0000004400 cinder-backup[101319]: iface.fragmentation = Jul 03 09:52:27.956621 np0000004400 cinder-backup[101319]: iface.gratuitous_arp = Jul 03 09:52:27.956621 np0000004400 cinder-backup[101319]: iface.incoming_forwarding = Jul 03 09:52:27.956621 np0000004400 cinder-backup[101319]: iface.tos_state = Jul 03 09:52:27.956621 np0000004400 cinder-backup[101319]: iface.tos = 0 Jul 03 09:52:27.956621 np0000004400 cinder-backup[101319]: iface.ttl = 0 Jul 03 09:52:27.956621 np0000004400 cinder-backup[101319]: iface.delayed_ack = Jul 03 09:52:27.956621 np0000004400 cinder-backup[101319]: iface.tcp_nagle = Jul 03 09:52:27.956621 np0000004400 cinder-backup[101319]: iface.tcp_wsf_state = Jul 03 09:52:27.956621 np0000004400 cinder-backup[101319]: iface.tcp_wsf = 0 Jul 03 09:52:27.956621 np0000004400 cinder-backup[101319]: iface.tcp_timer_scale = 0 Jul 03 09:52:27.956621 np0000004400 cinder-backup[101319]: iface.tcp_timestamp = Jul 03 09:52:27.956621 np0000004400 cinder-backup[101319]: iface.redirect = Jul 03 09:52:27.956621 np0000004400 cinder-backup[101319]: iface.def_task_mgmt_timeout = 0 Jul 03 09:52:27.956621 np0000004400 cinder-backup[101319]: iface.header_digest = Jul 03 09:52:27.956621 np0000004400 cinder-backup[101319]: iface.data_digest = Jul 03 09:52:27.956621 np0000004400 cinder-backup[101319]: iface.immediate_data = Jul 03 09:52:27.956621 np0000004400 cinder-backup[101319]: iface.initial_r2t = Jul 03 09:52:27.956621 np0000004400 cinder-backup[101319]: iface.data_seq_inorder = Jul 03 09:52:27.956621 np0000004400 cinder-backup[101319]: iface.data_pdu_inorder = Jul 03 09:52:27.956621 np0000004400 cinder-backup[101319]: iface.erl = 0 Jul 03 09:52:27.956621 np0000004400 cinder-backup[101319]: iface.max_receive_data_len = 0 Jul 03 09:52:27.956621 np0000004400 cinder-backup[101319]: iface.first_burst_len = 0 Jul 03 09:52:27.956621 np0000004400 cinder-backup[101319]: iface.max_outstanding_r2t = 0 Jul 03 09:52:27.956621 np0000004400 cinder-backup[101319]: iface.max_burst_len = 0 Jul 03 09:52:27.956621 np0000004400 cinder-backup[101319]: iface.chap_auth = Jul 03 09:52:27.956621 np0000004400 cinder-backup[101319]: iface.bidi_chap = Jul 03 09:52:27.956621 np0000004400 cinder-backup[101319]: iface.strict_login_compliance = Jul 03 09:52:27.956621 np0000004400 cinder-backup[101319]: iface.discovery_auth = Jul 03 09:52:27.956621 np0000004400 cinder-backup[101319]: iface.discovery_logout = Jul 03 09:52:27.956621 np0000004400 cinder-backup[101319]: node.discovery_address = Jul 03 09:52:27.956621 np0000004400 cinder-backup[101319]: node.discovery_port = 0 Jul 03 09:52:27.956621 np0000004400 cinder-backup[101319]: node.discovery_type = fw Jul 03 09:52:27.956621 np0000004400 cinder-backup[101319]: node.session.initial_cmdsn = 0 Jul 03 09:52:27.956621 np0000004400 cinder-backup[101319]: node.session.initial_login_retry_max = 8 Jul 03 09:52:27.956621 np0000004400 cinder-backup[101319]: node.session.xmit_thread_priority = 0 Jul 03 09:52:27.956621 np0000004400 cinder-backup[101319]: node.session.cmds_max = 128 Jul 03 09:52:27.956621 np0000004400 cinder-backup[101319]: node.session.queue_depth = 32 Jul 03 09:52:27.956621 np0000004400 cinder-backup[101319]: node.session.nr_sessions = 1 Jul 03 09:52:27.956621 np0000004400 cinder-backup[101319]: node.session.auth.authmethod = None Jul 03 09:52:27.956621 np0000004400 cinder-backup[101319]: node.session.auth.username = Jul 03 09:52:27.956621 np0000004400 cinder-backup[101319]: node.session.auth.password = *** Jul 03 09:52:27.956621 np0000004400 cinder-backup[101319]: node.session.auth.username_in = Jul 03 09:52:27.956621 np0000004400 cinder-backup[101319]: node.session.auth.password_in = Jul 03 09:52:27.956621 np0000004400 cinder-backup[101319]: node.session.auth.chap_algs = SHA256 Jul 03 09:52:27.956621 np0000004400 cinder-backup[101319]: node.session.timeo.replacement_timeout = 120 Jul 03 09:52:27.956621 np0000004400 cinder-backup[101319]: node.session.err_timeo.abort_timeout = 15 Jul 03 09:52:27.956621 np0000004400 cinder-backup[101319]: node.session.err_timeo.lu_reset_timeout = 30 Jul 03 09:52:27.956621 np0000004400 cinder-backup[101319]: node.session.err_timeo.tgt_reset_timeout = 30 Jul 03 09:52:27.956621 np0000004400 cinder-backup[101319]: node.session.err_timeo.host_reset_timeout = 60 Jul 03 09:52:27.956621 np0000004400 cinder-backup[101319]: node.session.iscsi.FastAbort = Yes Jul 03 09:52:27.956621 np0000004400 cinder-backup[101319]: node.session.iscsi.InitialR2T = No Jul 03 09:52:27.956621 np0000004400 cinder-backup[101319]: node.session.iscsi.ImmediateData = Yes Jul 03 09:52:27.956621 np0000004400 cinder-backup[101319]: node.session.iscsi.FirstBurstLength = 262144 Jul 03 09:52:27.956621 np0000004400 cinder-backup[101319]: node.session.iscsi.MaxBurstLength = 16776192 Jul 03 09:52:27.956621 np0000004400 cinder-backup[101319]: node.session.iscsi.DefaultTime2Retain = 0 Jul 03 09:52:27.956621 np0000004400 cinder-backup[101319]: node.session.iscsi.DefaultTime2Wait = 2 Jul 03 09:52:27.956621 np0000004400 cinder-backup[101319]: node.session.iscsi.MaxConnections = 1 Jul 03 09:52:27.956621 np0000004400 cinder-backup[101319]: node.session.iscsi.MaxOutstandingR2T = 1 Jul 03 09:52:27.956621 np0000004400 cinder-backup[101319]: node.session.iscsi.ERL = 0 Jul 03 09:52:27.956621 np0000004400 cinder-backup[101319]: node.session.scan = auto Jul 03 09:52:27.956621 np0000004400 cinder-backup[101319]: node.session.reopen_max = 0 Jul 03 09:52:27.956621 np0000004400 cinder-backup[101319]: node.conn[0].address = 192.168.40.100 Jul 03 09:52:27.956621 np0000004400 cinder-backup[101319]: node.conn[0].port = 3260 Jul 03 09:52:27.956621 np0000004400 cinder-backup[101319]: node.conn[0].startup = manual Jul 03 09:52:27.956621 np0000004400 cinder-backup[101319]: node.conn[0].tcp.window_size = 524288 Jul 03 09:52:27.956621 np0000004400 cinder-backup[101319]: node.conn[0].tcp.type_of_service = 0 Jul 03 09:52:27.956621 np0000004400 cinder-backup[101319]: node.conn[0].timeo.logout_timeout = 15 Jul 03 09:52:27.956621 np0000004400 cinder-backup[101319]: node.conn[0].timeo.login_timeout = 15 Jul 03 09:52:27.956621 np0000004400 cinder-backup[101319]: node.conn[0].timeo.auth_timeout = 45 Jul 03 09:52:27.956621 np0000004400 cinder-backup[101319]: node.conn[0].timeo.noop_out_interval = 5 Jul 03 09:52:27.956621 np0000004400 cinder-backup[101319]: node.conn[0].timeo.noop_out_timeout = 5 Jul 03 09:52:27.956621 np0000004400 cinder-backup[101319]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0 Jul 03 09:52:27.956621 np0000004400 cinder-backup[101319]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144 Jul 03 09:52:27.956621 np0000004400 cinder-backup[101319]: node.conn[0].iscsi.HeaderDigest = None Jul 03 09:52:27.956621 np0000004400 cinder-backup[101319]: node.conn[0].iscsi.DataDigest = None Jul 03 09:52:27.956621 np0000004400 cinder-backup[101319]: node.conn[0].iscsi.IFMarker = No Jul 03 09:52:27.956621 np0000004400 cinder-backup[101319]: node.conn[0].iscsi.OFMarker = No Jul 03 09:52:27.956621 np0000004400 cinder-backup[101319]: # END RECORD Jul 03 09:52:27.956621 np0000004400 cinder-backup[101319]: stderr= {{(pid=101319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 03 09:52:27.967437 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-e2a239c1-a5c3-4759-b610-3512241e5030 tempest-ProjectMemberTests39-542595828 None] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=101319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 03 09:52:27.979422 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-e2a239c1-a5c3-4759-b610-3512241e5030 tempest-ProjectMemberTests39-542595828 None] iscsiadm ('-m', 'session'): stdout=tcp: [182] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ed8e3f76-cf7d-4910-b52d-4dfa2049cde1 (non-flash) Jul 03 09:52:27.979422 np0000004400 cinder-backup[101319]: tcp: [183] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-89470c05-4a76-41e8-b5cb-f969bb59ce72 (non-flash) Jul 03 09:52:27.979422 np0000004400 cinder-backup[101319]: tcp: [184] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-89470c05-4a76-41e8-b5cb-f969bb59ce72 (non-flash) Jul 03 09:52:27.979422 np0000004400 cinder-backup[101319]: tcp: [185] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-491c39b6-d2e0-4f67-9a64-590d50f06197 (non-flash) Jul 03 09:52:27.979422 np0000004400 cinder-backup[101319]: tcp: [186] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-491c39b6-d2e0-4f67-9a64-590d50f06197 (non-flash) Jul 03 09:52:27.979422 np0000004400 cinder-backup[101319]: stderr= {{(pid=101319) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jul 03 09:52:27.979675 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-e2a239c1-a5c3-4759-b610-3512241e5030 tempest-ProjectMemberTests39-542595828 None] iscsi session list stdout=tcp: [182] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ed8e3f76-cf7d-4910-b52d-4dfa2049cde1 (non-flash) Jul 03 09:52:27.979675 np0000004400 cinder-backup[101319]: tcp: [183] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-89470c05-4a76-41e8-b5cb-f969bb59ce72 (non-flash) Jul 03 09:52:27.979675 np0000004400 cinder-backup[101319]: tcp: [184] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-89470c05-4a76-41e8-b5cb-f969bb59ce72 (non-flash) Jul 03 09:52:27.979675 np0000004400 cinder-backup[101319]: tcp: [185] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-491c39b6-d2e0-4f67-9a64-590d50f06197 (non-flash) Jul 03 09:52:27.979675 np0000004400 cinder-backup[101319]: tcp: [186] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-491c39b6-d2e0-4f67-9a64-590d50f06197 (non-flash) Jul 03 09:52:27.979675 np0000004400 cinder-backup[101319]: stderr= {{(pid=101319) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jul 03 09:52:28.013895 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-e2a239c1-a5c3-4759-b610-3512241e5030 tempest-ProjectMemberTests39-542595828 None] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-3aeb27c4-5945-48bd-8fd2-f6544f92caec, portal: 192.168.40.100,3260] Jul 03 09:52:28.013895 np0000004400 cinder-backup[101319]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-3aeb27c4-5945-48bd-8fd2-f6544f92caec, portal: 192.168.40.100,3260] successful. Jul 03 09:52:28.013895 np0000004400 cinder-backup[101319]: stderr= {{(pid=101319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 03 09:52:28.024224 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-e2a239c1-a5c3-4759-b610-3512241e5030 tempest-ProjectMemberTests39-542595828 None] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=101319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 03 09:52:28.041097 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-e2a239c1-a5c3-4759-b610-3512241e5030 tempest-ProjectMemberTests39-542595828 None] iscsiadm ('-m', 'session'): stdout=tcp: [182] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ed8e3f76-cf7d-4910-b52d-4dfa2049cde1 (non-flash) Jul 03 09:52:28.041097 np0000004400 cinder-backup[101319]: tcp: [183] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-89470c05-4a76-41e8-b5cb-f969bb59ce72 (non-flash) Jul 03 09:52:28.041097 np0000004400 cinder-backup[101319]: tcp: [184] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-89470c05-4a76-41e8-b5cb-f969bb59ce72 (non-flash) Jul 03 09:52:28.041097 np0000004400 cinder-backup[101319]: tcp: [185] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-491c39b6-d2e0-4f67-9a64-590d50f06197 (non-flash) Jul 03 09:52:28.041097 np0000004400 cinder-backup[101319]: tcp: [186] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-491c39b6-d2e0-4f67-9a64-590d50f06197 (non-flash) Jul 03 09:52:28.041097 np0000004400 cinder-backup[101319]: tcp: [187] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3aeb27c4-5945-48bd-8fd2-f6544f92caec (non-flash) Jul 03 09:52:28.041097 np0000004400 cinder-backup[101319]: stderr= {{(pid=101319) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jul 03 09:52:28.041878 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-e2a239c1-a5c3-4759-b610-3512241e5030 tempest-ProjectMemberTests39-542595828 None] iscsi session list stdout=tcp: [182] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ed8e3f76-cf7d-4910-b52d-4dfa2049cde1 (non-flash) Jul 03 09:52:28.041878 np0000004400 cinder-backup[101319]: tcp: [183] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-89470c05-4a76-41e8-b5cb-f969bb59ce72 (non-flash) Jul 03 09:52:28.041878 np0000004400 cinder-backup[101319]: tcp: [184] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-89470c05-4a76-41e8-b5cb-f969bb59ce72 (non-flash) Jul 03 09:52:28.041878 np0000004400 cinder-backup[101319]: tcp: [185] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-491c39b6-d2e0-4f67-9a64-590d50f06197 (non-flash) Jul 03 09:52:28.041878 np0000004400 cinder-backup[101319]: tcp: [186] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-491c39b6-d2e0-4f67-9a64-590d50f06197 (non-flash) Jul 03 09:52:28.041878 np0000004400 cinder-backup[101319]: tcp: [187] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3aeb27c4-5945-48bd-8fd2-f6544f92caec (non-flash) Jul 03 09:52:28.041878 np0000004400 cinder-backup[101319]: stderr= {{(pid=101319) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jul 03 09:52:28.041878 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.base [None req-e2a239c1-a5c3-4759-b610-3512241e5030 tempest-ProjectMemberTests39-542595828 None] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-3aeb27c4-5945-48bd-8fd2-f6544f92caec" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.123s {{(pid=101319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jul 03 09:52:28.042188 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-e2a239c1-a5c3-4759-b610-3512241e5030 tempest-ProjectMemberTests39-542595828 None] Connected to 192.168.40.100:3260 {{(pid=101319) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}} Jul 03 09:52:28.042870 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.linuxscsi [None req-e2a239c1-a5c3-4759-b610-3512241e5030 tempest-ProjectMemberTests39-542595828 None] HCTL ('12', '-', '-', 0) found on session 187 with lun 0 {{(pid=101319) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}} Jul 03 09:52:28.043049 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.linuxscsi [None req-e2a239c1-a5c3-4759-b610-3512241e5030 tempest-ProjectMemberTests39-542595828 None] Scanning host 12 c: -, t: -, l: 0) {{(pid=101319) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}} Jul 03 09:52:28.057776 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.linuxscsi [None req-e2a239c1-a5c3-4759-b610-3512241e5030 tempest-ProjectMemberTests39-542595828 None] Searching for a device in session 187 and hctl ['12', '*', '*', 0] yield: sdg {{(pid=101319) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}} Jul 03 09:52:28.057994 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-e2a239c1-a5c3-4759-b610-3512241e5030 tempest-ProjectMemberTests39-542595828 None] Connected to sdg using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-3aeb27c4-5945-48bd-8fd2-f6544f92caec', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '3aeb27c4-5945-48bd-8fd2-f6544f92caec', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': False} {{(pid=101319) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}} Jul 03 09:52:28.062990 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-5699de5f-5de3-481e-8d5c-0885569e101d tempest-CreateVolumesFromBackupTest-1420824915 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101319) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 09:52:28.063127 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-5699de5f-5de3-481e-8d5c-0885569e101d tempest-CreateVolumesFromBackupTest-1420824915 None] About to put_object {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 09:52:28.175610 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-5699de5f-5de3-481e-8d5c-0885569e101d tempest-CreateVolumesFromBackupTest-1420824915 None] backup MD5 for volume_ed8e3f76-cf7d-4910-b52d-4dfa2049cde1/20260703095220/az_nova_backup_612b0c88-04d4-4352-9b18-16c747e8225a-00015: 25e317773f308e446cc84c503a6d1f85 {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 09:52:28.175809 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-5699de5f-5de3-481e-8d5c-0885569e101d tempest-CreateVolumesFromBackupTest-1420824915 None] Calling eventlet.sleep(0) {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 09:52:28.401249 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-5699de5f-5de3-481e-8d5c-0885569e101d tempest-CreateVolumesFromBackupTest-1420824915 None] Backing up chunk of data from volume. {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 09:52:28.659476 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-5699de5f-5de3-481e-8d5c-0885569e101d tempest-CreateVolumesFromBackupTest-1420824915 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101319) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 09:52:28.659626 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-5699de5f-5de3-481e-8d5c-0885569e101d tempest-CreateVolumesFromBackupTest-1420824915 None] About to put_object {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 09:52:28.768577 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-5699de5f-5de3-481e-8d5c-0885569e101d tempest-CreateVolumesFromBackupTest-1420824915 None] backup MD5 for volume_ed8e3f76-cf7d-4910-b52d-4dfa2049cde1/20260703095220/az_nova_backup_612b0c88-04d4-4352-9b18-16c747e8225a-00016: 25e317773f308e446cc84c503a6d1f85 {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 09:52:28.769082 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-5699de5f-5de3-481e-8d5c-0885569e101d tempest-CreateVolumesFromBackupTest-1420824915 None] Calling eventlet.sleep(0) {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 09:52:28.954125 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-5699de5f-5de3-481e-8d5c-0885569e101d tempest-CreateVolumesFromBackupTest-1420824915 None] Backing up chunk of data from volume. {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 09:52:29.063424 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.base [None req-e2a239c1-a5c3-4759-b610-3512241e5030 tempest-ProjectMemberTests39-542595828 None] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 2.156s {{(pid=101319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jul 03 09:52:29.063424 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-e2a239c1-a5c3-4759-b610-3512241e5030 tempest-ProjectMemberTests39-542595828 None] <== connect_volume: return (4222ms) {'type': 'block', 'scsi_wwn': '1StorPooliSCSI_DISK_1034578903445799194', 'path': '/dev/sdg'} {{(pid=101319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}} Jul 03 09:52:29.063424 np0000004400 cinder-backup[101319]: DEBUG oslo_concurrency.processutils [None req-e2a239c1-a5c3-4759-b610-3512241e5030 tempest-ProjectMemberTests39-542595828 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chown 1002 /dev/sdg {{(pid=101319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 09:52:29.084826 np0000004400 sudo[152879]: stack : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chown 1002 /dev/sdg Jul 03 09:52:29.085456 np0000004400 sudo[152879]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1002) Jul 03 09:52:29.204421 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-5699de5f-5de3-481e-8d5c-0885569e101d tempest-CreateVolumesFromBackupTest-1420824915 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101319) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 09:52:29.204421 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-5699de5f-5de3-481e-8d5c-0885569e101d tempest-CreateVolumesFromBackupTest-1420824915 None] About to put_object {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 09:52:29.310576 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-5699de5f-5de3-481e-8d5c-0885569e101d tempest-CreateVolumesFromBackupTest-1420824915 None] backup MD5 for volume_ed8e3f76-cf7d-4910-b52d-4dfa2049cde1/20260703095220/az_nova_backup_612b0c88-04d4-4352-9b18-16c747e8225a-00017: 25e317773f308e446cc84c503a6d1f85 {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 09:52:29.310576 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-5699de5f-5de3-481e-8d5c-0885569e101d tempest-CreateVolumesFromBackupTest-1420824915 None] Calling eventlet.sleep(0) {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 09:52:29.406244 np0000004400 sudo[152879]: pam_unix(sudo:session): session closed for user root Jul 03 09:52:29.410225 np0000004400 cinder-backup[101319]: DEBUG oslo_concurrency.processutils [None req-e2a239c1-a5c3-4759-b610-3512241e5030 tempest-ProjectMemberTests39-542595828 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chown 1002 /dev/sdg" returned: 0 in 0.346s {{(pid=101319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 09:52:29.417529 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-e2a239c1-a5c3-4759-b610-3512241e5030 tempest-ProjectMemberTests39-542595828 None] _create_container started, container: volumebackups,backup: f0698713-73de-488e-b4bc-5345c39468df. {{(pid=101319) _create_container /opt/stack/cinder/cinder/backup/chunkeddriver.py:249}} Jul 03 09:52:29.540926 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-5699de5f-5de3-481e-8d5c-0885569e101d tempest-CreateVolumesFromBackupTest-1420824915 None] Backing up chunk of data from volume. {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 09:52:29.640279 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.drivers.swift [None req-e2a239c1-a5c3-4759-b610-3512241e5030 tempest-ProjectMemberTests39-542595828 None] generate_object_name_prefix: volume_3aeb27c4-5945-48bd-8fd2-f6544f92caec/20260703095229/az_nova_backup_f0698713-73de-488e-b4bc-5345c39468df {{(pid=101319) _generate_object_name_prefix /opt/stack/cinder/cinder/backup/drivers/swift.py:452}} Jul 03 09:52:29.647447 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-e2a239c1-a5c3-4759-b610-3512241e5030 tempest-ProjectMemberTests39-542595828 None] starting backup of volume: 3aeb27c4-5945-48bd-8fd2-f6544f92caec, volume size: 1073741824, object names prefix volume_3aeb27c4-5945-48bd-8fd2-f6544f92caec/20260703095229/az_nova_backup_f0698713-73de-488e-b4bc-5345c39468df, availability zone: nova {{(pid=101319) _prepare_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:359}} Jul 03 09:52:29.788688 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-5699de5f-5de3-481e-8d5c-0885569e101d tempest-CreateVolumesFromBackupTest-1420824915 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101319) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 09:52:29.788688 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-5699de5f-5de3-481e-8d5c-0885569e101d tempest-CreateVolumesFromBackupTest-1420824915 None] About to put_object {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 09:52:29.816799 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-e2a239c1-a5c3-4759-b610-3512241e5030 tempest-ProjectMemberTests39-542595828 None] Backing up chunk of data from volume. {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 09:52:29.901989 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-5699de5f-5de3-481e-8d5c-0885569e101d tempest-CreateVolumesFromBackupTest-1420824915 None] backup MD5 for volume_ed8e3f76-cf7d-4910-b52d-4dfa2049cde1/20260703095220/az_nova_backup_612b0c88-04d4-4352-9b18-16c747e8225a-00018: 25e317773f308e446cc84c503a6d1f85 {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 09:52:29.901989 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-5699de5f-5de3-481e-8d5c-0885569e101d tempest-CreateVolumesFromBackupTest-1420824915 None] Calling eventlet.sleep(0) {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 09:52:30.059398 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-e2a239c1-a5c3-4759-b610-3512241e5030 tempest-ProjectMemberTests39-542595828 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101319) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 09:52:30.059993 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-e2a239c1-a5c3-4759-b610-3512241e5030 tempest-ProjectMemberTests39-542595828 None] About to put_object {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 09:52:30.098915 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-5699de5f-5de3-481e-8d5c-0885569e101d tempest-CreateVolumesFromBackupTest-1420824915 None] Backing up chunk of data from volume. {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 09:52:30.175870 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-e2a239c1-a5c3-4759-b610-3512241e5030 tempest-ProjectMemberTests39-542595828 None] backup MD5 for volume_3aeb27c4-5945-48bd-8fd2-f6544f92caec/20260703095229/az_nova_backup_f0698713-73de-488e-b4bc-5345c39468df-00001: 25e317773f308e446cc84c503a6d1f85 {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 09:52:30.176238 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-e2a239c1-a5c3-4759-b610-3512241e5030 tempest-ProjectMemberTests39-542595828 None] Calling eventlet.sleep(0) {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 09:52:30.359021 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-5699de5f-5de3-481e-8d5c-0885569e101d tempest-CreateVolumesFromBackupTest-1420824915 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101319) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 09:52:30.359021 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-5699de5f-5de3-481e-8d5c-0885569e101d tempest-CreateVolumesFromBackupTest-1420824915 None] About to put_object {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 09:52:30.363018 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-e2a239c1-a5c3-4759-b610-3512241e5030 tempest-ProjectMemberTests39-542595828 None] Backing up chunk of data from volume. {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 09:52:30.488777 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-5699de5f-5de3-481e-8d5c-0885569e101d tempest-CreateVolumesFromBackupTest-1420824915 None] backup MD5 for volume_ed8e3f76-cf7d-4910-b52d-4dfa2049cde1/20260703095220/az_nova_backup_612b0c88-04d4-4352-9b18-16c747e8225a-00019: 25e317773f308e446cc84c503a6d1f85 {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 09:52:30.488777 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-5699de5f-5de3-481e-8d5c-0885569e101d tempest-CreateVolumesFromBackupTest-1420824915 None] Calling eventlet.sleep(0) {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 09:52:30.625355 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-e2a239c1-a5c3-4759-b610-3512241e5030 tempest-ProjectMemberTests39-542595828 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101319) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 09:52:30.625355 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-e2a239c1-a5c3-4759-b610-3512241e5030 tempest-ProjectMemberTests39-542595828 None] About to put_object {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 09:52:30.712283 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-5699de5f-5de3-481e-8d5c-0885569e101d tempest-CreateVolumesFromBackupTest-1420824915 None] Backing up chunk of data from volume. {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 09:52:30.747928 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-e2a239c1-a5c3-4759-b610-3512241e5030 tempest-ProjectMemberTests39-542595828 None] backup MD5 for volume_3aeb27c4-5945-48bd-8fd2-f6544f92caec/20260703095229/az_nova_backup_f0698713-73de-488e-b4bc-5345c39468df-00002: 25e317773f308e446cc84c503a6d1f85 {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 09:52:30.750877 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-e2a239c1-a5c3-4759-b610-3512241e5030 tempest-ProjectMemberTests39-542595828 None] Calling eventlet.sleep(0) {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 09:52:30.953850 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-e2a239c1-a5c3-4759-b610-3512241e5030 tempest-ProjectMemberTests39-542595828 None] Backing up chunk of data from volume. {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 09:52:30.975091 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-5699de5f-5de3-481e-8d5c-0885569e101d tempest-CreateVolumesFromBackupTest-1420824915 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101319) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 09:52:30.975091 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-5699de5f-5de3-481e-8d5c-0885569e101d tempest-CreateVolumesFromBackupTest-1420824915 None] About to put_object {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 09:52:31.078783 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-5699de5f-5de3-481e-8d5c-0885569e101d tempest-CreateVolumesFromBackupTest-1420824915 None] backup MD5 for volume_ed8e3f76-cf7d-4910-b52d-4dfa2049cde1/20260703095220/az_nova_backup_612b0c88-04d4-4352-9b18-16c747e8225a-00020: 25e317773f308e446cc84c503a6d1f85 {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 09:52:31.078783 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-5699de5f-5de3-481e-8d5c-0885569e101d tempest-CreateVolumesFromBackupTest-1420824915 None] Calling eventlet.sleep(0) {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 09:52:31.178263 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-5699de5f-5de3-481e-8d5c-0885569e101d tempest-CreateVolumesFromBackupTest-1420824915 None] Backing up chunk of data from volume. {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 09:52:31.206865 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-e2a239c1-a5c3-4759-b610-3512241e5030 tempest-ProjectMemberTests39-542595828 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101319) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 09:52:31.206865 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-e2a239c1-a5c3-4759-b610-3512241e5030 tempest-ProjectMemberTests39-542595828 None] About to put_object {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 09:52:31.297440 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-5699de5f-5de3-481e-8d5c-0885569e101d tempest-CreateVolumesFromBackupTest-1420824915 None] Compressed 25165824 bytes of data to 24470 bytes using zlib. {{(pid=101319) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 09:52:31.297440 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-5699de5f-5de3-481e-8d5c-0885569e101d tempest-CreateVolumesFromBackupTest-1420824915 None] About to put_object {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 09:52:31.313350 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-e2a239c1-a5c3-4759-b610-3512241e5030 tempest-ProjectMemberTests39-542595828 None] backup MD5 for volume_3aeb27c4-5945-48bd-8fd2-f6544f92caec/20260703095229/az_nova_backup_f0698713-73de-488e-b4bc-5345c39468df-00003: 25e317773f308e446cc84c503a6d1f85 {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 09:52:31.313652 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-e2a239c1-a5c3-4759-b610-3512241e5030 tempest-ProjectMemberTests39-542595828 None] Calling eventlet.sleep(0) {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 09:52:31.366551 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-5699de5f-5de3-481e-8d5c-0885569e101d tempest-CreateVolumesFromBackupTest-1420824915 None] backup MD5 for volume_ed8e3f76-cf7d-4910-b52d-4dfa2049cde1/20260703095220/az_nova_backup_612b0c88-04d4-4352-9b18-16c747e8225a-00021: 77377273b0a4b61febdbf7bbf52b9db9 {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 09:52:31.367286 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-5699de5f-5de3-481e-8d5c-0885569e101d tempest-CreateVolumesFromBackupTest-1420824915 None] Calling eventlet.sleep(0) {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 09:52:31.375913 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.driver [None req-5699de5f-5de3-481e-8d5c-0885569e101d tempest-CreateVolumesFromBackupTest-1420824915 None] Getting metadata type 'volume-base-metadata' {{(pid=101319) _save_vol_base_meta /opt/stack/cinder/cinder/backup/driver.py:79}} Jul 03 09:52:31.382523 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.driver [None req-5699de5f-5de3-481e-8d5c-0885569e101d tempest-CreateVolumesFromBackupTest-1420824915 None] Completed fetching metadata type 'volume-base-metadata' {{(pid=101319) _save_vol_base_meta /opt/stack/cinder/cinder/backup/driver.py:98}} Jul 03 09:52:31.382926 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.driver [None req-5699de5f-5de3-481e-8d5c-0885569e101d tempest-CreateVolumesFromBackupTest-1420824915 None] Getting metadata type 'volume-metadata' {{(pid=101319) _save_vol_meta /opt/stack/cinder/cinder/backup/driver.py:109}} Jul 03 09:52:31.387068 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.driver [None req-5699de5f-5de3-481e-8d5c-0885569e101d tempest-CreateVolumesFromBackupTest-1420824915 None] No metadata type 'volume-metadata' available {{(pid=101319) _save_vol_meta /opt/stack/cinder/cinder/backup/driver.py:123}} Jul 03 09:52:31.387331 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.driver [None req-5699de5f-5de3-481e-8d5c-0885569e101d tempest-CreateVolumesFromBackupTest-1420824915 None] Getting metadata type 'volume-glance-metadata' {{(pid=101319) _save_vol_glance_meta /opt/stack/cinder/cinder/backup/driver.py:132}} Jul 03 09:52:31.393421 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.driver [None req-5699de5f-5de3-481e-8d5c-0885569e101d tempest-CreateVolumesFromBackupTest-1420824915 None] No metadata type 'volume-glance-metadata' available {{(pid=101319) _save_vol_glance_meta /opt/stack/cinder/cinder/backup/driver.py:147}} Jul 03 09:52:31.393421 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-5699de5f-5de3-481e-8d5c-0885569e101d tempest-CreateVolumesFromBackupTest-1420824915 None] _write_sha256file started, container name: volumebackups, sha256file filename: volume_ed8e3f76-cf7d-4910-b52d-4dfa2049cde1/20260703095220/az_nova_backup_612b0c88-04d4-4352-9b18-16c747e8225a_sha256file. {{(pid=101319) _write_sha256file /opt/stack/cinder/cinder/backup/chunkeddriver.py:299}} Jul 03 09:52:31.482567 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-5699de5f-5de3-481e-8d5c-0885569e101d tempest-CreateVolumesFromBackupTest-1420824915 None] _write_sha256file finished. {{(pid=101319) _write_sha256file /opt/stack/cinder/cinder/backup/chunkeddriver.py:315}} Jul 03 09:52:31.482567 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-5699de5f-5de3-481e-8d5c-0885569e101d tempest-CreateVolumesFromBackupTest-1420824915 None] _write_metadata started, container name: volumebackups, metadata filename: volume_ed8e3f76-cf7d-4910-b52d-4dfa2049cde1/20260703095220/az_nova_backup_612b0c88-04d4-4352-9b18-16c747e8225a_metadata. {{(pid=101319) _write_metadata /opt/stack/cinder/cinder/backup/chunkeddriver.py:276}} Jul 03 09:52:31.511554 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-e2a239c1-a5c3-4759-b610-3512241e5030 tempest-ProjectMemberTests39-542595828 None] Backing up chunk of data from volume. {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 09:52:31.515113 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-5699de5f-5de3-481e-8d5c-0885569e101d tempest-CreateVolumesFromBackupTest-1420824915 None] _write_metadata finished. Metadata: b'{\n "backup_description": null,\n "backup_id": "612b0c88-04d4-4352-9b18-16c747e8225a",\n "backup_name": "tempest-CreateVolumesFromBackupTest-Backup-269281105",\n "created_at": "2026-07-03 09:52:16+00:00",\n "objects": [\n {\n "volume_ed8e3f76-cf7d-4910-b52d-4dfa2049cde1/20260703095220/az_nova_backup_612b0c88-04d4-4352-9b18-16c747e8225a-00001": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 0\n }\n },\n {\n "volume_ed8e3f76-cf7d-4910-b52d-4dfa2049cde1/20260703095220/az_nova_backup_612b0c88-04d4-4352-9b18-16c747e8225a-00002": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 52428800\n }\n },\n {\n "volume_ed8e3f76-cf7d-4910-b52d-4dfa2049cde1/20260703095220/az_nova_backup_612b0c88-04d4-4352-9b18-16c747e8225a-00003": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 104857600\n }\n },\n {\n "volume_ed8e3f76-cf7d-4910-b52d-4dfa2049cde1/20260703095220/az_nova_backup_612b0c88-04d4-4352-9b18-16c747e8225a-00004": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 157286400\n }\n },\n {\n "volume_ed8e3f76-cf7d-4910-b52d-4dfa2049cde1/20260703095220/az_nova_backup_612b0c88-04d4-4352-9b18-16c747e8225a-00005": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 209715200\n }\n },\n {\n "volume_ed8e3f76-cf7d-4910-b52d-4dfa2049cde1/20260703095220/az_nova_backup_612b0c88-04d4-4352-9b18-16c747e8225a-00006": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 262144000\n }\n },\n {\n "volume_ed8e3f76-cf7d-4910-b52d-4dfa2049cde1/20260703095220/az_nova_backup_612b0c88-04d4-4352-9b18-16c747e8225a-00007": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 314572800\n }\n },\n {\n "volume_ed8e3f76-cf7d-4910-b52d-4dfa2049cde1/20260703095220/az_nova_backup_612b0c88-04d4-4352-9b18-16c747e8225a-00008": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 367001600\n }\n },\n {\n "volume_ed8e3f76-cf7d-4910-b52d-4dfa2049cde1/20260703095220/az_nova_backup_612b0c88-04d4-4352-9b18-16c747e8225a-00009": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 419430400\n }\n },\n {\n "volume_ed8e3f76-cf7d-4910-b52d-4dfa2049cde1/20260703095220/az_nova_backup_612b0c88-04d4-4352-9b18-16c747e8225a-00010": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 471859200\n }\n },\n {\n "volume_ed8e3f76-cf7d-4910-b52d-4dfa2049cde1/20260703095220/az_nova_backup_612b0c88-04d4-4352-9b18-16c747e8225a-00011": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 524288000\n }\n },\n {\n "volume_ed8e3f76-cf7d-4910-b52d-4dfa2049cde1/20260703095220/az_nova_backup_612b0c88-04d4-4352-9b18-16c747e8225a-00012": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 576716800\n }\n },\n {\n "volume_ed8e3f76-cf7d-4910-b52d-4dfa2049cde1/20260703095220/az_nova_backup_612b0c88-04d4-4352-9b18-16c747e8225a-00013": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 629145600\n }\n },\n {\n "volume_ed8e3f76-cf7d-4910-b52d-4dfa2049cde1/20260703095220/az_nova_backup_612b0c88-04d4-4352-9b18-16c747e8225a-00014": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 681574400\n }\n },\n {\n "volume_ed8e3f76-cf7d-4910-b52d-4dfa2049cde1/20260703095220/az_nova_backup_612b0c88-04d4-4352-9b18-16c747e8225a-00015": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 734003200\n }\n },\n {\n "volume_ed8e3f76-cf7d-4910-b52d-4dfa2049cde1/20260703095220/az_nova_backup_612b0c88-04d4-4352-9b18-16c747e8225a-00016": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 786432000\n }\n },\n {\n "volume_ed8e3f76-cf7d-4910-b52d-4dfa2049cde1/20260703095220/az_nova_backup_612b0c88-04d4-4352-9b18-16c747e8225a-00017": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 838860800\n }\n },\n {\n "volume_ed8e3f76-cf7d-4910-b52d-4dfa2049cde1/20260703095220/az_nova_backup_612b0c88-04d4-4352-9b18-16c747e8225a-00018": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 891289600\n }\n },\n {\n "volume_ed8e3f76-cf7d-4910-b52d-4dfa2049cde1/20260703095220/az_nova_backup_612b0c88-04d4-4352-9b18-16c747e8225a-00019": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 943718400\n }\n },\n {\n "volume_ed8e3f76-cf7d-4910-b52d-4dfa2049cde1/20260703095220/az_nova_backup_612b0c88-04d4-4352-9b18-16c747e8225a-00020": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 996147200\n }\n },\n {\n "volume_ed8e3f76-cf7d-4910-b52d-4dfa2049cde1/20260703095220/az_nova_backup_612b0c88-04d4-4352-9b18-16c747e8225a-00021": {\n "compression": "zlib",\n "length": 25165824,\n "md5": "77377273b0a4b61febdbf7bbf52b9db9",\n "offset": 1048576000\n }\n }\n ],\n "parent_id": null,\n "version": "1.0.0",\n "volume_id": "ed8e3f76-cf7d-4910-b52d-4dfa2049cde1",\n "volume_meta": "{\\"version\\": 2, \\"volume-base-metadata\\": {\\"id\\": \\"ed8e3f76-cf7d-4910-b52d-4dfa2049cde1\\", \\"_name_id\\": null, \\"use_quota\\": true, \\"ec2_id\\": null, \\"user_id\\": \\"dd8a7b8d2e9b464b92fa4f3d5b891f00\\", \\"project_id\\": \\"6c0e2567c47942ba86cc99b6439ed30b\\", \\"snapshot_id\\": null, \\"cluster_name\\": null, \\"host\\": \\"np0000004400@storpool#default\\", \\"size\\": 1, \\"availability_zone\\": \\"nova\\", \\"status\\": \\"backing-up\\", \\"attach_status\\": \\"detached\\", \\"migration_status\\": null, \\"scheduled_at\\": \\"2026-07-03T09:52:15.000000\\", \\"launched_at\\": \\"2026-07-03T09:52:15.000000\\", \\"terminated_at\\": null, \\"display_name\\": \\"tempest-CreateVolumesFromBackupTest-Volume-2065893667\\", \\"display_description\\": null, \\"provider_location\\": null, \\"provider_auth\\": null, \\"provider_geometry\\": null, \\"provider_id\\": null, \\"volume_type_id\\": \\"03e13fe6-0e30-4803-ace0-725d38e6dc24\\", \\"source_volid\\": null, \\"encryption_key_id\\": null, \\"consistencygroup_id\\": null, \\"group_id\\": null, \\"bootable\\": false, \\"multiattach\\": false, \\"replication_status\\": null, \\"replication_extended_status\\": null, \\"replication_driver_data\\": null, \\"previous_status\\": \\"available\\", \\"service_uuid\\": \\"6d4b0e79-fefe-4744-b25f-34be05095200\\", \\"shared_targets\\": true, \\"deleted_at\\": null, \\"deleted\\": false, \\"created_at\\": \\"2026-07-03T09:52:15.000000\\", \\"updated_at\\": \\"2026-07-03T09:52:16.000000\\"}}"\n}'. {{(pid=101319) _write_metadata /opt/stack/cinder/cinder/backup/chunkeddriver.py:295}} Jul 03 09:52:31.517977 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-5699de5f-5de3-481e-8d5c-0885569e101d tempest-CreateVolumesFromBackupTest-1420824915 None] backup 612b0c88-04d4-4352-9b18-16c747e8225a finished. {{(pid=101319) _finalize_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:462}} Jul 03 09:52:31.644597 np0000004400 cinder-backup[101319]: DEBUG oslo_concurrency.processutils [None req-5699de5f-5de3-481e-8d5c-0885569e101d tempest-CreateVolumesFromBackupTest-1420824915 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chown 0 /dev/sdb {{(pid=101319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 09:52:31.664980 np0000004400 sudo[152925]: stack : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chown 0 /dev/sdb Jul 03 09:52:31.665631 np0000004400 sudo[152925]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1002) Jul 03 09:52:31.779266 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-e2a239c1-a5c3-4759-b610-3512241e5030 tempest-ProjectMemberTests39-542595828 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101319) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 09:52:31.779437 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-e2a239c1-a5c3-4759-b610-3512241e5030 tempest-ProjectMemberTests39-542595828 None] About to put_object {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 09:52:31.883527 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-e2a239c1-a5c3-4759-b610-3512241e5030 tempest-ProjectMemberTests39-542595828 None] backup MD5 for volume_3aeb27c4-5945-48bd-8fd2-f6544f92caec/20260703095229/az_nova_backup_f0698713-73de-488e-b4bc-5345c39468df-00004: 25e317773f308e446cc84c503a6d1f85 {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 09:52:31.883679 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-e2a239c1-a5c3-4759-b610-3512241e5030 tempest-ProjectMemberTests39-542595828 None] Calling eventlet.sleep(0) {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 09:52:31.947924 np0000004400 sudo[152925]: pam_unix(sudo:session): session closed for user root Jul 03 09:52:31.949517 np0000004400 cinder-backup[101319]: DEBUG oslo_concurrency.processutils [None req-5699de5f-5de3-481e-8d5c-0885569e101d tempest-CreateVolumesFromBackupTest-1420824915 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chown 0 /dev/sdb" returned: 0 in 0.305s {{(pid=101319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 09:52:31.950091 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-5699de5f-5de3-481e-8d5c-0885569e101d tempest-CreateVolumesFromBackupTest-1420824915 None] ==> disconnect_volume: call "{'args': (, {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-ed8e3f76-cf7d-4910-b52d-4dfa2049cde1', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'ed8e3f76-cf7d-4910-b52d-4dfa2049cde1', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': False}, {'type': 'block', 'scsi_wwn': '1StorPooliSCSI_DISK_1034578903445799190', 'path': '/dev/sdb'}), 'kwargs': {'force': True, 'ignore_errors': True}}" {{(pid=101319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}} Jul 03 09:52:31.950227 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.base [None req-5699de5f-5de3-481e-8d5c-0885569e101d tempest-CreateVolumesFromBackupTest-1420824915 None] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=101319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jul 03 09:52:31.950672 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.base [None req-5699de5f-5de3-481e-8d5c-0885569e101d tempest-CreateVolumesFromBackupTest-1420824915 None] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.000s {{(pid=101319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jul 03 09:52:31.951209 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-5699de5f-5de3-481e-8d5c-0885569e101d tempest-CreateVolumesFromBackupTest-1420824915 None] _get_connection_devices called with parameters: connection_properties={'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-ed8e3f76-cf7d-4910-b52d-4dfa2049cde1', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'ed8e3f76-cf7d-4910-b52d-4dfa2049cde1', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': False}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=101319) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:847}} Jul 03 09:52:31.965647 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-5699de5f-5de3-481e-8d5c-0885569e101d tempest-CreateVolumesFromBackupTest-1420824915 None] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS: Jul 03 09:52:31.965647 np0000004400 cinder-backup[101319]: No targets found. Jul 03 09:52:31.965647 np0000004400 cinder-backup[101319]: iSNS: Jul 03 09:52:31.965647 np0000004400 cinder-backup[101319]: No targets found. Jul 03 09:52:31.965647 np0000004400 cinder-backup[101319]: STATIC: Jul 03 09:52:31.965647 np0000004400 cinder-backup[101319]: Target: iqn.2023-03.storpool.com:os--volume-89470c05-4a76-41e8-b5cb-f969bb59ce72 Jul 03 09:52:31.965647 np0000004400 cinder-backup[101319]: Portal: 192.168.50.100:3260,-1 Jul 03 09:52:31.965647 np0000004400 cinder-backup[101319]: Iface Name: default Jul 03 09:52:31.965647 np0000004400 cinder-backup[101319]: Portal: 192.168.40.100:3260,-1 Jul 03 09:52:31.965647 np0000004400 cinder-backup[101319]: Iface Name: default Jul 03 09:52:31.965647 np0000004400 cinder-backup[101319]: Target: iqn.2023-03.storpool.com:os--volume-3aeb27c4-5945-48bd-8fd2-f6544f92caec Jul 03 09:52:31.965647 np0000004400 cinder-backup[101319]: Portal: 192.168.40.100:3260,-1 Jul 03 09:52:31.965647 np0000004400 cinder-backup[101319]: Iface Name: default Jul 03 09:52:31.965647 np0000004400 cinder-backup[101319]: Target: iqn.2023-03.storpool.com:os--volume-ed8e3f76-cf7d-4910-b52d-4dfa2049cde1 Jul 03 09:52:31.965647 np0000004400 cinder-backup[101319]: Portal: 192.168.40.100:3260,-1 Jul 03 09:52:31.965647 np0000004400 cinder-backup[101319]: Iface Name: default Jul 03 09:52:31.965647 np0000004400 cinder-backup[101319]: FIRMWARE: Jul 03 09:52:31.965647 np0000004400 cinder-backup[101319]: No targets found. Jul 03 09:52:31.965647 np0000004400 cinder-backup[101319]: stderr= {{(pid=101319) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jul 03 09:52:31.966260 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-5699de5f-5de3-481e-8d5c-0885569e101d tempest-CreateVolumesFromBackupTest-1420824915 None] Regex to get portals from discoverydb: ^SENDTARGETS: Jul 03 09:52:31.966260 np0000004400 cinder-backup[101319]: .*?^DiscoveryAddress: 192.168.40.100,3260.*? Jul 03 09:52:31.966260 np0000004400 cinder-backup[101319]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=101319) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:390}} Jul 03 09:52:31.966260 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-5699de5f-5de3-481e-8d5c-0885569e101d tempest-CreateVolumesFromBackupTest-1420824915 None] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-ed8e3f76-cf7d-4910-b52d-4dfa2049cde1', 0)] {{(pid=101319) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:858}} Jul 03 09:52:31.992289 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-5699de5f-5de3-481e-8d5c-0885569e101d tempest-CreateVolumesFromBackupTest-1420824915 None] iscsiadm ('-m', 'session'): stdout=tcp: [182] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ed8e3f76-cf7d-4910-b52d-4dfa2049cde1 (non-flash) Jul 03 09:52:31.992289 np0000004400 cinder-backup[101319]: tcp: [183] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-89470c05-4a76-41e8-b5cb-f969bb59ce72 (non-flash) Jul 03 09:52:31.992289 np0000004400 cinder-backup[101319]: tcp: [184] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-89470c05-4a76-41e8-b5cb-f969bb59ce72 (non-flash) Jul 03 09:52:31.992289 np0000004400 cinder-backup[101319]: tcp: [187] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3aeb27c4-5945-48bd-8fd2-f6544f92caec (non-flash) Jul 03 09:52:31.992289 np0000004400 cinder-backup[101319]: stderr= {{(pid=101319) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jul 03 09:52:31.992289 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-5699de5f-5de3-481e-8d5c-0885569e101d tempest-CreateVolumesFromBackupTest-1420824915 None] iscsi session list stdout=tcp: [182] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ed8e3f76-cf7d-4910-b52d-4dfa2049cde1 (non-flash) Jul 03 09:52:31.992289 np0000004400 cinder-backup[101319]: tcp: [183] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-89470c05-4a76-41e8-b5cb-f969bb59ce72 (non-flash) Jul 03 09:52:31.992289 np0000004400 cinder-backup[101319]: tcp: [184] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-89470c05-4a76-41e8-b5cb-f969bb59ce72 (non-flash) Jul 03 09:52:31.992289 np0000004400 cinder-backup[101319]: tcp: [187] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3aeb27c4-5945-48bd-8fd2-f6544f92caec (non-flash) Jul 03 09:52:31.992289 np0000004400 cinder-backup[101319]: stderr= {{(pid=101319) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jul 03 09:52:31.992774 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-5699de5f-5de3-481e-8d5c-0885569e101d tempest-CreateVolumesFromBackupTest-1420824915 None] Sessions list: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-ed8e3f76-cf7d-4910-b52d-4dfa2049cde1', '182'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-89470c05-4a76-41e8-b5cb-f969bb59ce72', '183'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-89470c05-4a76-41e8-b5cb-f969bb59ce72', '184'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-3aeb27c4-5945-48bd-8fd2-f6544f92caec', '187')] {{(pid=101319) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:866}} Jul 03 09:52:31.992774 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-5699de5f-5de3-481e-8d5c-0885569e101d tempest-CreateVolumesFromBackupTest-1420824915 None] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-ed8e3f76-cf7d-4910-b52d-4dfa2049cde1, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-ed8e3f76-cf7d-4910-b52d-4dfa2049cde1', '182')] {{(pid=101319) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}} Jul 03 09:52:31.993677 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-5699de5f-5de3-481e-8d5c-0885569e101d tempest-CreateVolumesFromBackupTest-1420824915 None] Resulting device map defaultdict(. at 0x7e76e753ff60>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-ed8e3f76-cf7d-4910-b52d-4dfa2049cde1'): ({'sdb'}, set())}) {{(pid=101319) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:912}} Jul 03 09:52:31.993797 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.linuxscsi [None req-5699de5f-5de3-481e-8d5c-0885569e101d tempest-CreateVolumesFromBackupTest-1420824915 None] Removing single pathed devices sdb {{(pid=101319) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}} Jul 03 09:52:32.013811 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.linuxscsi [None req-5699de5f-5de3-481e-8d5c-0885569e101d tempest-CreateVolumesFromBackupTest-1420824915 None] Flushing IO for device /dev/sdb {{(pid=101319) flush_device_io /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:461}} Jul 03 09:52:32.021648 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.linuxscsi [None req-5699de5f-5de3-481e-8d5c-0885569e101d tempest-CreateVolumesFromBackupTest-1420824915 None] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=101319) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}} Jul 03 09:52:32.074794 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-e2a239c1-a5c3-4759-b610-3512241e5030 tempest-ProjectMemberTests39-542595828 None] Backing up chunk of data from volume. {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 09:52:32.093905 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.linuxscsi [None req-5699de5f-5de3-481e-8d5c-0885569e101d tempest-CreateVolumesFromBackupTest-1420824915 None] Checking to see if SCSI volumes sdb have been removed. {{(pid=101319) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}} Jul 03 09:52:32.094078 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.linuxscsi [None req-5699de5f-5de3-481e-8d5c-0885569e101d tempest-CreateVolumesFromBackupTest-1420824915 None] SCSI volumes sdb have been removed. {{(pid=101319) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}} Jul 03 09:52:32.095021 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.linuxscsi [None req-5699de5f-5de3-481e-8d5c-0885569e101d tempest-CreateVolumesFromBackupTest-1420824915 None] Checking to see if device paths {'sdb'} are still under multipathd monitoring {{(pid=101319) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}} Jul 03 09:52:32.105166 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.linuxscsi [None req-5699de5f-5de3-481e-8d5c-0885569e101d tempest-CreateVolumesFromBackupTest-1420824915 None] Device paths {'sdb'} have been removed from multipathd monitoring. {{(pid=101319) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}} Jul 03 09:52:32.105417 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-5699de5f-5de3-481e-8d5c-0885569e101d tempest-CreateVolumesFromBackupTest-1420824915 None] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-ed8e3f76-cf7d-4910-b52d-4dfa2049cde1')] {{(pid=101319) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1225}} Jul 03 09:52:32.117471 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-5699de5f-5de3-481e-8d5c-0885569e101d tempest-CreateVolumesFromBackupTest-1420824915 None] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=101319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 03 09:52:32.149686 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-5699de5f-5de3-481e-8d5c-0885569e101d tempest-CreateVolumesFromBackupTest-1420824915 None] iscsiadm ('--logout',): stdout=Logging out of session [sid: 182, target: iqn.2023-03.storpool.com:os--volume-ed8e3f76-cf7d-4910-b52d-4dfa2049cde1, portal: 192.168.40.100,3260] Jul 03 09:52:32.149686 np0000004400 cinder-backup[101319]: Logout of [sid: 182, target: iqn.2023-03.storpool.com:os--volume-ed8e3f76-cf7d-4910-b52d-4dfa2049cde1, portal: 192.168.40.100,3260] successful. Jul 03 09:52:32.149686 np0000004400 cinder-backup[101319]: stderr= {{(pid=101319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 03 09:52:32.160420 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-5699de5f-5de3-481e-8d5c-0885569e101d tempest-CreateVolumesFromBackupTest-1420824915 None] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=101319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 03 09:52:32.160653 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.base [None req-5699de5f-5de3-481e-8d5c-0885569e101d tempest-CreateVolumesFromBackupTest-1420824915 None] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.210s {{(pid=101319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jul 03 09:52:32.160778 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-5699de5f-5de3-481e-8d5c-0885569e101d tempest-CreateVolumesFromBackupTest-1420824915 None] <== disconnect_volume: return (210ms) None {{(pid=101319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}} Jul 03 09:52:32.315690 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-e2a239c1-a5c3-4759-b610-3512241e5030 tempest-ProjectMemberTests39-542595828 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101319) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 09:52:32.316096 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-e2a239c1-a5c3-4759-b610-3512241e5030 tempest-ProjectMemberTests39-542595828 None] About to put_object {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 09:52:32.414256 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-e2a239c1-a5c3-4759-b610-3512241e5030 tempest-ProjectMemberTests39-542595828 None] backup MD5 for volume_3aeb27c4-5945-48bd-8fd2-f6544f92caec/20260703095229/az_nova_backup_f0698713-73de-488e-b4bc-5345c39468df-00005: 25e317773f308e446cc84c503a6d1f85 {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 09:52:32.414436 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-e2a239c1-a5c3-4759-b610-3512241e5030 tempest-ProjectMemberTests39-542595828 None] Calling eventlet.sleep(0) {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 09:52:32.599291 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-e2a239c1-a5c3-4759-b610-3512241e5030 tempest-ProjectMemberTests39-542595828 None] Backing up chunk of data from volume. {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 09:52:32.845140 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-e2a239c1-a5c3-4759-b610-3512241e5030 tempest-ProjectMemberTests39-542595828 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101319) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 09:52:32.845276 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-e2a239c1-a5c3-4759-b610-3512241e5030 tempest-ProjectMemberTests39-542595828 None] About to put_object {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 09:52:32.948889 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-e2a239c1-a5c3-4759-b610-3512241e5030 tempest-ProjectMemberTests39-542595828 None] backup MD5 for volume_3aeb27c4-5945-48bd-8fd2-f6544f92caec/20260703095229/az_nova_backup_f0698713-73de-488e-b4bc-5345c39468df-00006: 25e317773f308e446cc84c503a6d1f85 {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 09:52:32.949057 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-e2a239c1-a5c3-4759-b610-3512241e5030 tempest-ProjectMemberTests39-542595828 None] Calling eventlet.sleep(0) {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 09:52:33.137595 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-e2a239c1-a5c3-4759-b610-3512241e5030 tempest-ProjectMemberTests39-542595828 None] Backing up chunk of data from volume. {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 09:52:33.179487 np0000004400 cinder-backup[101319]: INFO cinder.backup.manager [None req-5699de5f-5de3-481e-8d5c-0885569e101d tempest-CreateVolumesFromBackupTest-1420824915 None] Create backup finished. backup: 612b0c88-04d4-4352-9b18-16c747e8225a. Jul 03 09:52:33.387753 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-e2a239c1-a5c3-4759-b610-3512241e5030 tempest-ProjectMemberTests39-542595828 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101319) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 09:52:33.388124 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-e2a239c1-a5c3-4759-b610-3512241e5030 tempest-ProjectMemberTests39-542595828 None] About to put_object {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 09:52:33.503725 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-e2a239c1-a5c3-4759-b610-3512241e5030 tempest-ProjectMemberTests39-542595828 None] backup MD5 for volume_3aeb27c4-5945-48bd-8fd2-f6544f92caec/20260703095229/az_nova_backup_f0698713-73de-488e-b4bc-5345c39468df-00007: 25e317773f308e446cc84c503a6d1f85 {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 09:52:33.503725 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-e2a239c1-a5c3-4759-b610-3512241e5030 tempest-ProjectMemberTests39-542595828 None] Calling eventlet.sleep(0) {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 09:52:33.697770 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-e2a239c1-a5c3-4759-b610-3512241e5030 tempest-ProjectMemberTests39-542595828 None] Backing up chunk of data from volume. {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 09:52:33.952253 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-e2a239c1-a5c3-4759-b610-3512241e5030 tempest-ProjectMemberTests39-542595828 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101319) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 09:52:33.952928 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-e2a239c1-a5c3-4759-b610-3512241e5030 tempest-ProjectMemberTests39-542595828 None] About to put_object {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 09:52:34.054196 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-e2a239c1-a5c3-4759-b610-3512241e5030 tempest-ProjectMemberTests39-542595828 None] backup MD5 for volume_3aeb27c4-5945-48bd-8fd2-f6544f92caec/20260703095229/az_nova_backup_f0698713-73de-488e-b4bc-5345c39468df-00008: 25e317773f308e446cc84c503a6d1f85 {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 09:52:34.054424 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-e2a239c1-a5c3-4759-b610-3512241e5030 tempest-ProjectMemberTests39-542595828 None] Calling eventlet.sleep(0) {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 09:52:34.272199 np0000004400 cinder-backup[101319]: INFO cinder.backup.manager [None req-a150f6b3-5698-47a4-9467-a7b1ecc3583f tempest-CreateVolumesFromBackupTest-1420824915 None] Delete backup started, backup: 612b0c88-04d4-4352-9b18-16c747e8225a. Jul 03 09:52:34.278222 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.drivers.swift [None req-a150f6b3-5698-47a4-9467-a7b1ecc3583f tempest-CreateVolumesFromBackupTest-1420824915 None] Using swift URL https://10.4.3.95:8080/v1/AUTH_6c0e2567c47942ba86cc99b6439ed30b {{(pid=101319) initialize /opt/stack/cinder/cinder/backup/drivers/swift.py:300}} Jul 03 09:52:34.278449 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.drivers.swift [None req-a150f6b3-5698-47a4-9467-a7b1ecc3583f tempest-CreateVolumesFromBackupTest-1420824915 None] Connect to https://10.4.3.95:8080/v1/AUTH_ in "per_user" mode {{(pid=101319) initialize /opt/stack/cinder/cinder/backup/drivers/swift.py:301}} Jul 03 09:52:34.278644 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-a150f6b3-5698-47a4-9467-a7b1ecc3583f tempest-CreateVolumesFromBackupTest-1420824915 None] delete started, backup: 612b0c88-04d4-4352-9b18-16c747e8225a, container: volumebackups, prefix: volume_ed8e3f76-cf7d-4910-b52d-4dfa2049cde1/20260703095220/az_nova_backup_612b0c88-04d4-4352-9b18-16c747e8225a. {{(pid=101319) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:822}} Jul 03 09:52:34.282392 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-e2a239c1-a5c3-4759-b610-3512241e5030 tempest-ProjectMemberTests39-542595828 None] Backing up chunk of data from volume. {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 09:52:34.329484 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-a150f6b3-5698-47a4-9467-a7b1ecc3583f tempest-CreateVolumesFromBackupTest-1420824915 None] generated object list: ['volume_ed8e3f76-cf7d-4910-b52d-4dfa2049cde1/20260703095220/az_nova_backup_612b0c88-04d4-4352-9b18-16c747e8225a-00001', 'volume_ed8e3f76-cf7d-4910-b52d-4dfa2049cde1/20260703095220/az_nova_backup_612b0c88-04d4-4352-9b18-16c747e8225a-00002', 'volume_ed8e3f76-cf7d-4910-b52d-4dfa2049cde1/20260703095220/az_nova_backup_612b0c88-04d4-4352-9b18-16c747e8225a-00003', 'volume_ed8e3f76-cf7d-4910-b52d-4dfa2049cde1/20260703095220/az_nova_backup_612b0c88-04d4-4352-9b18-16c747e8225a-00004', 'volume_ed8e3f76-cf7d-4910-b52d-4dfa2049cde1/20260703095220/az_nova_backup_612b0c88-04d4-4352-9b18-16c747e8225a-00005', 'volume_ed8e3f76-cf7d-4910-b52d-4dfa2049cde1/20260703095220/az_nova_backup_612b0c88-04d4-4352-9b18-16c747e8225a-00006', 'volume_ed8e3f76-cf7d-4910-b52d-4dfa2049cde1/20260703095220/az_nova_backup_612b0c88-04d4-4352-9b18-16c747e8225a-00007', 'volume_ed8e3f76-cf7d-4910-b52d-4dfa2049cde1/20260703095220/az_nova_backup_612b0c88-04d4-4352-9b18-16c747e8225a-00008', 'volume_ed8e3f76-cf7d-4910-b52d-4dfa2049cde1/20260703095220/az_nova_backup_612b0c88-04d4-4352-9b18-16c747e8225a-00009', 'volume_ed8e3f76-cf7d-4910-b52d-4dfa2049cde1/20260703095220/az_nova_backup_612b0c88-04d4-4352-9b18-16c747e8225a-00010', 'volume_ed8e3f76-cf7d-4910-b52d-4dfa2049cde1/20260703095220/az_nova_backup_612b0c88-04d4-4352-9b18-16c747e8225a-00011', 'volume_ed8e3f76-cf7d-4910-b52d-4dfa2049cde1/20260703095220/az_nova_backup_612b0c88-04d4-4352-9b18-16c747e8225a-00012', 'volume_ed8e3f76-cf7d-4910-b52d-4dfa2049cde1/20260703095220/az_nova_backup_612b0c88-04d4-4352-9b18-16c747e8225a-00013', 'volume_ed8e3f76-cf7d-4910-b52d-4dfa2049cde1/20260703095220/az_nova_backup_612b0c88-04d4-4352-9b18-16c747e8225a-00014', 'volume_ed8e3f76-cf7d-4910-b52d-4dfa2049cde1/20260703095220/az_nova_backup_612b0c88-04d4-4352-9b18-16c747e8225a-00015', 'volume_ed8e3f76-cf7d-4910-b52d-4dfa2049cde1/20260703095220/az_nova_backup_612b0c88-04d4-4352-9b18-16c747e8225a-00016', 'volume_ed8e3f76-cf7d-4910-b52d-4dfa2049cde1/20260703095220/az_nova_backup_612b0c88-04d4-4352-9b18-16c747e8225a-00017', 'volume_ed8e3f76-cf7d-4910-b52d-4dfa2049cde1/20260703095220/az_nova_backup_612b0c88-04d4-4352-9b18-16c747e8225a-00018', 'volume_ed8e3f76-cf7d-4910-b52d-4dfa2049cde1/20260703095220/az_nova_backup_612b0c88-04d4-4352-9b18-16c747e8225a-00019', 'volume_ed8e3f76-cf7d-4910-b52d-4dfa2049cde1/20260703095220/az_nova_backup_612b0c88-04d4-4352-9b18-16c747e8225a-00020', 'volume_ed8e3f76-cf7d-4910-b52d-4dfa2049cde1/20260703095220/az_nova_backup_612b0c88-04d4-4352-9b18-16c747e8225a-00021', 'volume_ed8e3f76-cf7d-4910-b52d-4dfa2049cde1/20260703095220/az_nova_backup_612b0c88-04d4-4352-9b18-16c747e8225a_metadata', 'volume_ed8e3f76-cf7d-4910-b52d-4dfa2049cde1/20260703095220/az_nova_backup_612b0c88-04d4-4352-9b18-16c747e8225a_sha256file']. {{(pid=101319) _generate_object_names /opt/stack/cinder/cinder/backup/chunkeddriver.py:260}} Jul 03 09:52:34.349347 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-a150f6b3-5698-47a4-9467-a7b1ecc3583f tempest-CreateVolumesFromBackupTest-1420824915 None] deleted object: volume_ed8e3f76-cf7d-4910-b52d-4dfa2049cde1/20260703095220/az_nova_backup_612b0c88-04d4-4352-9b18-16c747e8225a-00001 in container: volumebackups. {{(pid=101319) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 09:52:34.370860 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-a150f6b3-5698-47a4-9467-a7b1ecc3583f tempest-CreateVolumesFromBackupTest-1420824915 None] deleted object: volume_ed8e3f76-cf7d-4910-b52d-4dfa2049cde1/20260703095220/az_nova_backup_612b0c88-04d4-4352-9b18-16c747e8225a-00002 in container: volumebackups. {{(pid=101319) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 09:52:34.393984 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-a150f6b3-5698-47a4-9467-a7b1ecc3583f tempest-CreateVolumesFromBackupTest-1420824915 None] deleted object: volume_ed8e3f76-cf7d-4910-b52d-4dfa2049cde1/20260703095220/az_nova_backup_612b0c88-04d4-4352-9b18-16c747e8225a-00003 in container: volumebackups. {{(pid=101319) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 09:52:34.413264 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-a150f6b3-5698-47a4-9467-a7b1ecc3583f tempest-CreateVolumesFromBackupTest-1420824915 None] deleted object: volume_ed8e3f76-cf7d-4910-b52d-4dfa2049cde1/20260703095220/az_nova_backup_612b0c88-04d4-4352-9b18-16c747e8225a-00004 in container: volumebackups. {{(pid=101319) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 09:52:34.432749 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-a150f6b3-5698-47a4-9467-a7b1ecc3583f tempest-CreateVolumesFromBackupTest-1420824915 None] deleted object: volume_ed8e3f76-cf7d-4910-b52d-4dfa2049cde1/20260703095220/az_nova_backup_612b0c88-04d4-4352-9b18-16c747e8225a-00005 in container: volumebackups. {{(pid=101319) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 09:52:34.454192 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-a150f6b3-5698-47a4-9467-a7b1ecc3583f tempest-CreateVolumesFromBackupTest-1420824915 None] deleted object: volume_ed8e3f76-cf7d-4910-b52d-4dfa2049cde1/20260703095220/az_nova_backup_612b0c88-04d4-4352-9b18-16c747e8225a-00006 in container: volumebackups. {{(pid=101319) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 09:52:34.477795 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-a150f6b3-5698-47a4-9467-a7b1ecc3583f tempest-CreateVolumesFromBackupTest-1420824915 None] deleted object: volume_ed8e3f76-cf7d-4910-b52d-4dfa2049cde1/20260703095220/az_nova_backup_612b0c88-04d4-4352-9b18-16c747e8225a-00007 in container: volumebackups. {{(pid=101319) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 09:52:34.501680 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-a150f6b3-5698-47a4-9467-a7b1ecc3583f tempest-CreateVolumesFromBackupTest-1420824915 None] deleted object: volume_ed8e3f76-cf7d-4910-b52d-4dfa2049cde1/20260703095220/az_nova_backup_612b0c88-04d4-4352-9b18-16c747e8225a-00008 in container: volumebackups. {{(pid=101319) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 09:52:34.522219 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-a150f6b3-5698-47a4-9467-a7b1ecc3583f tempest-CreateVolumesFromBackupTest-1420824915 None] deleted object: volume_ed8e3f76-cf7d-4910-b52d-4dfa2049cde1/20260703095220/az_nova_backup_612b0c88-04d4-4352-9b18-16c747e8225a-00009 in container: volumebackups. {{(pid=101319) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 09:52:34.540940 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-a150f6b3-5698-47a4-9467-a7b1ecc3583f tempest-CreateVolumesFromBackupTest-1420824915 None] deleted object: volume_ed8e3f76-cf7d-4910-b52d-4dfa2049cde1/20260703095220/az_nova_backup_612b0c88-04d4-4352-9b18-16c747e8225a-00010 in container: volumebackups. {{(pid=101319) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 09:52:34.544019 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-e2a239c1-a5c3-4759-b610-3512241e5030 tempest-ProjectMemberTests39-542595828 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101319) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 09:52:34.544206 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-e2a239c1-a5c3-4759-b610-3512241e5030 tempest-ProjectMemberTests39-542595828 None] About to put_object {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 09:52:34.565310 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-a150f6b3-5698-47a4-9467-a7b1ecc3583f tempest-CreateVolumesFromBackupTest-1420824915 None] deleted object: volume_ed8e3f76-cf7d-4910-b52d-4dfa2049cde1/20260703095220/az_nova_backup_612b0c88-04d4-4352-9b18-16c747e8225a-00011 in container: volumebackups. {{(pid=101319) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 09:52:34.589792 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-a150f6b3-5698-47a4-9467-a7b1ecc3583f tempest-CreateVolumesFromBackupTest-1420824915 None] deleted object: volume_ed8e3f76-cf7d-4910-b52d-4dfa2049cde1/20260703095220/az_nova_backup_612b0c88-04d4-4352-9b18-16c747e8225a-00012 in container: volumebackups. {{(pid=101319) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 09:52:34.614174 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-a150f6b3-5698-47a4-9467-a7b1ecc3583f tempest-CreateVolumesFromBackupTest-1420824915 None] deleted object: volume_ed8e3f76-cf7d-4910-b52d-4dfa2049cde1/20260703095220/az_nova_backup_612b0c88-04d4-4352-9b18-16c747e8225a-00013 in container: volumebackups. {{(pid=101319) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 09:52:34.633802 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-a150f6b3-5698-47a4-9467-a7b1ecc3583f tempest-CreateVolumesFromBackupTest-1420824915 None] deleted object: volume_ed8e3f76-cf7d-4910-b52d-4dfa2049cde1/20260703095220/az_nova_backup_612b0c88-04d4-4352-9b18-16c747e8225a-00014 in container: volumebackups. {{(pid=101319) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 09:52:34.653530 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-e2a239c1-a5c3-4759-b610-3512241e5030 tempest-ProjectMemberTests39-542595828 None] backup MD5 for volume_3aeb27c4-5945-48bd-8fd2-f6544f92caec/20260703095229/az_nova_backup_f0698713-73de-488e-b4bc-5345c39468df-00009: 25e317773f308e446cc84c503a6d1f85 {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 09:52:34.653725 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-e2a239c1-a5c3-4759-b610-3512241e5030 tempest-ProjectMemberTests39-542595828 None] Calling eventlet.sleep(0) {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 09:52:34.654727 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-a150f6b3-5698-47a4-9467-a7b1ecc3583f tempest-CreateVolumesFromBackupTest-1420824915 None] deleted object: volume_ed8e3f76-cf7d-4910-b52d-4dfa2049cde1/20260703095220/az_nova_backup_612b0c88-04d4-4352-9b18-16c747e8225a-00015 in container: volumebackups. {{(pid=101319) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 09:52:34.693014 np0000004400 cinder-backup[101319]: DEBUG oslo_db.sqlalchemy.engines [None req-e2a239c1-a5c3-4759-b610-3512241e5030 tempest-ProjectMemberTests39-542595828 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=101319) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 03 09:52:34.702065 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-a150f6b3-5698-47a4-9467-a7b1ecc3583f tempest-CreateVolumesFromBackupTest-1420824915 None] deleted object: volume_ed8e3f76-cf7d-4910-b52d-4dfa2049cde1/20260703095220/az_nova_backup_612b0c88-04d4-4352-9b18-16c747e8225a-00016 in container: volumebackups. {{(pid=101319) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 09:52:34.725009 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-a150f6b3-5698-47a4-9467-a7b1ecc3583f tempest-CreateVolumesFromBackupTest-1420824915 None] deleted object: volume_ed8e3f76-cf7d-4910-b52d-4dfa2049cde1/20260703095220/az_nova_backup_612b0c88-04d4-4352-9b18-16c747e8225a-00017 in container: volumebackups. {{(pid=101319) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 09:52:34.752336 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-a150f6b3-5698-47a4-9467-a7b1ecc3583f tempest-CreateVolumesFromBackupTest-1420824915 None] deleted object: volume_ed8e3f76-cf7d-4910-b52d-4dfa2049cde1/20260703095220/az_nova_backup_612b0c88-04d4-4352-9b18-16c747e8225a-00018 in container: volumebackups. {{(pid=101319) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 09:52:34.772555 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-a150f6b3-5698-47a4-9467-a7b1ecc3583f tempest-CreateVolumesFromBackupTest-1420824915 None] deleted object: volume_ed8e3f76-cf7d-4910-b52d-4dfa2049cde1/20260703095220/az_nova_backup_612b0c88-04d4-4352-9b18-16c747e8225a-00019 in container: volumebackups. {{(pid=101319) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 09:52:34.792950 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-a150f6b3-5698-47a4-9467-a7b1ecc3583f tempest-CreateVolumesFromBackupTest-1420824915 None] deleted object: volume_ed8e3f76-cf7d-4910-b52d-4dfa2049cde1/20260703095220/az_nova_backup_612b0c88-04d4-4352-9b18-16c747e8225a-00020 in container: volumebackups. {{(pid=101319) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 09:52:34.810994 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-a150f6b3-5698-47a4-9467-a7b1ecc3583f tempest-CreateVolumesFromBackupTest-1420824915 None] deleted object: volume_ed8e3f76-cf7d-4910-b52d-4dfa2049cde1/20260703095220/az_nova_backup_612b0c88-04d4-4352-9b18-16c747e8225a-00021 in container: volumebackups. {{(pid=101319) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 09:52:34.829298 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-a150f6b3-5698-47a4-9467-a7b1ecc3583f tempest-CreateVolumesFromBackupTest-1420824915 None] deleted object: volume_ed8e3f76-cf7d-4910-b52d-4dfa2049cde1/20260703095220/az_nova_backup_612b0c88-04d4-4352-9b18-16c747e8225a_metadata in container: volumebackups. {{(pid=101319) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 09:52:34.847453 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-a150f6b3-5698-47a4-9467-a7b1ecc3583f tempest-CreateVolumesFromBackupTest-1420824915 None] deleted object: volume_ed8e3f76-cf7d-4910-b52d-4dfa2049cde1/20260703095220/az_nova_backup_612b0c88-04d4-4352-9b18-16c747e8225a_sha256file in container: volumebackups. {{(pid=101319) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 09:52:34.847761 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-a150f6b3-5698-47a4-9467-a7b1ecc3583f tempest-CreateVolumesFromBackupTest-1420824915 None] delete 612b0c88-04d4-4352-9b18-16c747e8225a finished. {{(pid=101319) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:848}} Jul 03 09:52:34.867265 np0000004400 cinder-backup[101319]: DEBUG cinder.quota [None req-a150f6b3-5698-47a4-9467-a7b1ecc3583f tempest-CreateVolumesFromBackupTest-1420824915 None] Created reservations ['bfc381b3-580d-4923-9603-d66357fcf4ce', '91a41c80-f6da-4b46-9e70-a123612dbcce'] {{(pid=101319) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 09:52:34.882261 np0000004400 cinder-backup[101319]: INFO cinder.backup.manager [None req-a150f6b3-5698-47a4-9467-a7b1ecc3583f tempest-CreateVolumesFromBackupTest-1420824915 None] Delete backup finished, backup 612b0c88-04d4-4352-9b18-16c747e8225a deleted. Jul 03 09:52:34.911246 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-e2a239c1-a5c3-4759-b610-3512241e5030 tempest-ProjectMemberTests39-542595828 None] Backing up chunk of data from volume. {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 09:52:35.148358 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-e2a239c1-a5c3-4759-b610-3512241e5030 tempest-ProjectMemberTests39-542595828 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101319) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 09:52:35.148513 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-e2a239c1-a5c3-4759-b610-3512241e5030 tempest-ProjectMemberTests39-542595828 None] About to put_object {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 09:52:35.249142 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-e2a239c1-a5c3-4759-b610-3512241e5030 tempest-ProjectMemberTests39-542595828 None] backup MD5 for volume_3aeb27c4-5945-48bd-8fd2-f6544f92caec/20260703095229/az_nova_backup_f0698713-73de-488e-b4bc-5345c39468df-00010: 25e317773f308e446cc84c503a6d1f85 {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 09:52:35.249822 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-e2a239c1-a5c3-4759-b610-3512241e5030 tempest-ProjectMemberTests39-542595828 None] Calling eventlet.sleep(0) {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 09:52:35.421096 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-e2a239c1-a5c3-4759-b610-3512241e5030 tempest-ProjectMemberTests39-542595828 None] Backing up chunk of data from volume. {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 09:52:35.665045 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-e2a239c1-a5c3-4759-b610-3512241e5030 tempest-ProjectMemberTests39-542595828 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101319) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 09:52:35.665241 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-e2a239c1-a5c3-4759-b610-3512241e5030 tempest-ProjectMemberTests39-542595828 None] About to put_object {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 09:52:35.764092 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-e2a239c1-a5c3-4759-b610-3512241e5030 tempest-ProjectMemberTests39-542595828 None] backup MD5 for volume_3aeb27c4-5945-48bd-8fd2-f6544f92caec/20260703095229/az_nova_backup_f0698713-73de-488e-b4bc-5345c39468df-00011: 25e317773f308e446cc84c503a6d1f85 {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 09:52:35.764218 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-e2a239c1-a5c3-4759-b610-3512241e5030 tempest-ProjectMemberTests39-542595828 None] Calling eventlet.sleep(0) {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 09:52:35.942791 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-e2a239c1-a5c3-4759-b610-3512241e5030 tempest-ProjectMemberTests39-542595828 None] Backing up chunk of data from volume. {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 09:52:36.189872 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-e2a239c1-a5c3-4759-b610-3512241e5030 tempest-ProjectMemberTests39-542595828 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101319) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 09:52:36.189997 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-e2a239c1-a5c3-4759-b610-3512241e5030 tempest-ProjectMemberTests39-542595828 None] About to put_object {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 09:52:36.288315 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-e2a239c1-a5c3-4759-b610-3512241e5030 tempest-ProjectMemberTests39-542595828 None] backup MD5 for volume_3aeb27c4-5945-48bd-8fd2-f6544f92caec/20260703095229/az_nova_backup_f0698713-73de-488e-b4bc-5345c39468df-00012: 25e317773f308e446cc84c503a6d1f85 {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 09:52:36.288496 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-e2a239c1-a5c3-4759-b610-3512241e5030 tempest-ProjectMemberTests39-542595828 None] Calling eventlet.sleep(0) {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 09:52:36.453436 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-e2a239c1-a5c3-4759-b610-3512241e5030 tempest-ProjectMemberTests39-542595828 None] Backing up chunk of data from volume. {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 09:52:36.697677 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-e2a239c1-a5c3-4759-b610-3512241e5030 tempest-ProjectMemberTests39-542595828 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101319) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 09:52:36.697847 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-e2a239c1-a5c3-4759-b610-3512241e5030 tempest-ProjectMemberTests39-542595828 None] About to put_object {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 09:52:36.799819 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-e2a239c1-a5c3-4759-b610-3512241e5030 tempest-ProjectMemberTests39-542595828 None] backup MD5 for volume_3aeb27c4-5945-48bd-8fd2-f6544f92caec/20260703095229/az_nova_backup_f0698713-73de-488e-b4bc-5345c39468df-00013: 25e317773f308e446cc84c503a6d1f85 {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 09:52:36.800016 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-e2a239c1-a5c3-4759-b610-3512241e5030 tempest-ProjectMemberTests39-542595828 None] Calling eventlet.sleep(0) {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 09:52:36.996865 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-e2a239c1-a5c3-4759-b610-3512241e5030 tempest-ProjectMemberTests39-542595828 None] Backing up chunk of data from volume. {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 09:52:37.245939 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-e2a239c1-a5c3-4759-b610-3512241e5030 tempest-ProjectMemberTests39-542595828 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101319) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 09:52:37.246067 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-e2a239c1-a5c3-4759-b610-3512241e5030 tempest-ProjectMemberTests39-542595828 None] About to put_object {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 09:52:37.345360 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-e2a239c1-a5c3-4759-b610-3512241e5030 tempest-ProjectMemberTests39-542595828 None] backup MD5 for volume_3aeb27c4-5945-48bd-8fd2-f6544f92caec/20260703095229/az_nova_backup_f0698713-73de-488e-b4bc-5345c39468df-00014: 25e317773f308e446cc84c503a6d1f85 {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 09:52:37.345564 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-e2a239c1-a5c3-4759-b610-3512241e5030 tempest-ProjectMemberTests39-542595828 None] Calling eventlet.sleep(0) {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 09:52:37.525696 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-e2a239c1-a5c3-4759-b610-3512241e5030 tempest-ProjectMemberTests39-542595828 None] Backing up chunk of data from volume. {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 09:52:37.764937 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-e2a239c1-a5c3-4759-b610-3512241e5030 tempest-ProjectMemberTests39-542595828 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101319) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 09:52:37.765133 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-e2a239c1-a5c3-4759-b610-3512241e5030 tempest-ProjectMemberTests39-542595828 None] About to put_object {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 09:52:37.862380 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-e2a239c1-a5c3-4759-b610-3512241e5030 tempest-ProjectMemberTests39-542595828 None] backup MD5 for volume_3aeb27c4-5945-48bd-8fd2-f6544f92caec/20260703095229/az_nova_backup_f0698713-73de-488e-b4bc-5345c39468df-00015: 25e317773f308e446cc84c503a6d1f85 {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 09:52:37.862527 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-e2a239c1-a5c3-4759-b610-3512241e5030 tempest-ProjectMemberTests39-542595828 None] Calling eventlet.sleep(0) {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 09:52:38.039226 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-e2a239c1-a5c3-4759-b610-3512241e5030 tempest-ProjectMemberTests39-542595828 None] Backing up chunk of data from volume. {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 09:52:38.279217 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-e2a239c1-a5c3-4759-b610-3512241e5030 tempest-ProjectMemberTests39-542595828 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101319) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 09:52:38.279327 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-e2a239c1-a5c3-4759-b610-3512241e5030 tempest-ProjectMemberTests39-542595828 None] About to put_object {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 09:52:38.375987 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-e2a239c1-a5c3-4759-b610-3512241e5030 tempest-ProjectMemberTests39-542595828 None] backup MD5 for volume_3aeb27c4-5945-48bd-8fd2-f6544f92caec/20260703095229/az_nova_backup_f0698713-73de-488e-b4bc-5345c39468df-00016: 25e317773f308e446cc84c503a6d1f85 {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 09:52:38.376137 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-e2a239c1-a5c3-4759-b610-3512241e5030 tempest-ProjectMemberTests39-542595828 None] Calling eventlet.sleep(0) {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 09:52:38.557330 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-e2a239c1-a5c3-4759-b610-3512241e5030 tempest-ProjectMemberTests39-542595828 None] Backing up chunk of data from volume. {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 09:52:38.800978 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-e2a239c1-a5c3-4759-b610-3512241e5030 tempest-ProjectMemberTests39-542595828 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101319) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 09:52:38.801109 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-e2a239c1-a5c3-4759-b610-3512241e5030 tempest-ProjectMemberTests39-542595828 None] About to put_object {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 09:52:38.901132 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-e2a239c1-a5c3-4759-b610-3512241e5030 tempest-ProjectMemberTests39-542595828 None] backup MD5 for volume_3aeb27c4-5945-48bd-8fd2-f6544f92caec/20260703095229/az_nova_backup_f0698713-73de-488e-b4bc-5345c39468df-00017: 25e317773f308e446cc84c503a6d1f85 {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 09:52:38.901274 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-e2a239c1-a5c3-4759-b610-3512241e5030 tempest-ProjectMemberTests39-542595828 None] Calling eventlet.sleep(0) {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 09:52:39.066967 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-e2a239c1-a5c3-4759-b610-3512241e5030 tempest-ProjectMemberTests39-542595828 None] Backing up chunk of data from volume. {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 09:52:39.304091 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-e2a239c1-a5c3-4759-b610-3512241e5030 tempest-ProjectMemberTests39-542595828 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101319) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 09:52:39.304243 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-e2a239c1-a5c3-4759-b610-3512241e5030 tempest-ProjectMemberTests39-542595828 None] About to put_object {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 09:52:39.400859 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-e2a239c1-a5c3-4759-b610-3512241e5030 tempest-ProjectMemberTests39-542595828 None] backup MD5 for volume_3aeb27c4-5945-48bd-8fd2-f6544f92caec/20260703095229/az_nova_backup_f0698713-73de-488e-b4bc-5345c39468df-00018: 25e317773f308e446cc84c503a6d1f85 {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 09:52:39.401041 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-e2a239c1-a5c3-4759-b610-3512241e5030 tempest-ProjectMemberTests39-542595828 None] Calling eventlet.sleep(0) {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 09:52:39.541237 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-e2a239c1-a5c3-4759-b610-3512241e5030 tempest-ProjectMemberTests39-542595828 None] Backing up chunk of data from volume. {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 09:52:39.776765 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-e2a239c1-a5c3-4759-b610-3512241e5030 tempest-ProjectMemberTests39-542595828 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101319) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 09:52:39.777248 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-e2a239c1-a5c3-4759-b610-3512241e5030 tempest-ProjectMemberTests39-542595828 None] About to put_object {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 09:52:39.873063 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-e2a239c1-a5c3-4759-b610-3512241e5030 tempest-ProjectMemberTests39-542595828 None] backup MD5 for volume_3aeb27c4-5945-48bd-8fd2-f6544f92caec/20260703095229/az_nova_backup_f0698713-73de-488e-b4bc-5345c39468df-00019: 25e317773f308e446cc84c503a6d1f85 {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 09:52:39.873178 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-e2a239c1-a5c3-4759-b610-3512241e5030 tempest-ProjectMemberTests39-542595828 None] Calling eventlet.sleep(0) {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 09:52:40.049251 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-e2a239c1-a5c3-4759-b610-3512241e5030 tempest-ProjectMemberTests39-542595828 None] Backing up chunk of data from volume. {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 09:52:40.295995 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-e2a239c1-a5c3-4759-b610-3512241e5030 tempest-ProjectMemberTests39-542595828 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101319) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 09:52:40.296086 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-e2a239c1-a5c3-4759-b610-3512241e5030 tempest-ProjectMemberTests39-542595828 None] About to put_object {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 09:52:40.378432 np0000004400 cinder-backup[101319]: DEBUG oslo_service.periodic_task [None req-ffd932d2-122c-4e68-b5ba-628aff7ae7b8 None None] Running periodic task BackupManager.publish_service_capabilities {{(pid=101319) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 03 09:52:40.378564 np0000004400 cinder-backup[101319]: DEBUG cinder.manager [None req-ffd932d2-122c-4e68-b5ba-628aff7ae7b8 None None] Notifying Schedulers of capabilities ... {{(pid=101319) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 03 09:52:40.399331 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-e2a239c1-a5c3-4759-b610-3512241e5030 tempest-ProjectMemberTests39-542595828 None] backup MD5 for volume_3aeb27c4-5945-48bd-8fd2-f6544f92caec/20260703095229/az_nova_backup_f0698713-73de-488e-b4bc-5345c39468df-00020: 25e317773f308e446cc84c503a6d1f85 {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 09:52:40.399498 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-e2a239c1-a5c3-4759-b610-3512241e5030 tempest-ProjectMemberTests39-542595828 None] Calling eventlet.sleep(0) {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 09:52:40.491321 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-e2a239c1-a5c3-4759-b610-3512241e5030 tempest-ProjectMemberTests39-542595828 None] Backing up chunk of data from volume. {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 09:52:40.607133 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-e2a239c1-a5c3-4759-b610-3512241e5030 tempest-ProjectMemberTests39-542595828 None] Compressed 25165824 bytes of data to 24470 bytes using zlib. {{(pid=101319) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 09:52:40.607378 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-e2a239c1-a5c3-4759-b610-3512241e5030 tempest-ProjectMemberTests39-542595828 None] About to put_object {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 09:52:40.669978 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-e2a239c1-a5c3-4759-b610-3512241e5030 tempest-ProjectMemberTests39-542595828 None] backup MD5 for volume_3aeb27c4-5945-48bd-8fd2-f6544f92caec/20260703095229/az_nova_backup_f0698713-73de-488e-b4bc-5345c39468df-00021: 77377273b0a4b61febdbf7bbf52b9db9 {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 09:52:40.670156 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-e2a239c1-a5c3-4759-b610-3512241e5030 tempest-ProjectMemberTests39-542595828 None] Calling eventlet.sleep(0) {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 09:52:40.676202 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.driver [None req-e2a239c1-a5c3-4759-b610-3512241e5030 tempest-ProjectMemberTests39-542595828 None] Getting metadata type 'volume-base-metadata' {{(pid=101319) _save_vol_base_meta /opt/stack/cinder/cinder/backup/driver.py:79}} Jul 03 09:52:40.681819 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.driver [None req-e2a239c1-a5c3-4759-b610-3512241e5030 tempest-ProjectMemberTests39-542595828 None] Completed fetching metadata type 'volume-base-metadata' {{(pid=101319) _save_vol_base_meta /opt/stack/cinder/cinder/backup/driver.py:98}} Jul 03 09:52:40.682002 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.driver [None req-e2a239c1-a5c3-4759-b610-3512241e5030 tempest-ProjectMemberTests39-542595828 None] Getting metadata type 'volume-metadata' {{(pid=101319) _save_vol_meta /opt/stack/cinder/cinder/backup/driver.py:109}} Jul 03 09:52:40.685710 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.driver [None req-e2a239c1-a5c3-4759-b610-3512241e5030 tempest-ProjectMemberTests39-542595828 None] No metadata type 'volume-metadata' available {{(pid=101319) _save_vol_meta /opt/stack/cinder/cinder/backup/driver.py:123}} Jul 03 09:52:40.685869 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.driver [None req-e2a239c1-a5c3-4759-b610-3512241e5030 tempest-ProjectMemberTests39-542595828 None] Getting metadata type 'volume-glance-metadata' {{(pid=101319) _save_vol_glance_meta /opt/stack/cinder/cinder/backup/driver.py:132}} Jul 03 09:52:40.688745 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.driver [None req-e2a239c1-a5c3-4759-b610-3512241e5030 tempest-ProjectMemberTests39-542595828 None] No metadata type 'volume-glance-metadata' available {{(pid=101319) _save_vol_glance_meta /opt/stack/cinder/cinder/backup/driver.py:147}} Jul 03 09:52:40.688987 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-e2a239c1-a5c3-4759-b610-3512241e5030 tempest-ProjectMemberTests39-542595828 None] _write_sha256file started, container name: volumebackups, sha256file filename: volume_3aeb27c4-5945-48bd-8fd2-f6544f92caec/20260703095229/az_nova_backup_f0698713-73de-488e-b4bc-5345c39468df_sha256file. {{(pid=101319) _write_sha256file /opt/stack/cinder/cinder/backup/chunkeddriver.py:299}} Jul 03 09:52:40.742593 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-e2a239c1-a5c3-4759-b610-3512241e5030 tempest-ProjectMemberTests39-542595828 None] _write_sha256file finished. {{(pid=101319) _write_sha256file /opt/stack/cinder/cinder/backup/chunkeddriver.py:315}} Jul 03 09:52:40.743253 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-e2a239c1-a5c3-4759-b610-3512241e5030 tempest-ProjectMemberTests39-542595828 None] _write_metadata started, container name: volumebackups, metadata filename: volume_3aeb27c4-5945-48bd-8fd2-f6544f92caec/20260703095229/az_nova_backup_f0698713-73de-488e-b4bc-5345c39468df_metadata. {{(pid=101319) _write_metadata /opt/stack/cinder/cinder/backup/chunkeddriver.py:276}} Jul 03 09:52:40.765082 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-e2a239c1-a5c3-4759-b610-3512241e5030 tempest-ProjectMemberTests39-542595828 None] _write_metadata finished. Metadata: b'{\n "backup_description": null,\n "backup_id": "f0698713-73de-488e-b4bc-5345c39468df",\n "backup_name": "tempest-type-Backup-1279255939",\n "created_at": "2026-07-03 09:52:24+00:00",\n "objects": [\n {\n "volume_3aeb27c4-5945-48bd-8fd2-f6544f92caec/20260703095229/az_nova_backup_f0698713-73de-488e-b4bc-5345c39468df-00001": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 0\n }\n },\n {\n "volume_3aeb27c4-5945-48bd-8fd2-f6544f92caec/20260703095229/az_nova_backup_f0698713-73de-488e-b4bc-5345c39468df-00002": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 52428800\n }\n },\n {\n "volume_3aeb27c4-5945-48bd-8fd2-f6544f92caec/20260703095229/az_nova_backup_f0698713-73de-488e-b4bc-5345c39468df-00003": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 104857600\n }\n },\n {\n "volume_3aeb27c4-5945-48bd-8fd2-f6544f92caec/20260703095229/az_nova_backup_f0698713-73de-488e-b4bc-5345c39468df-00004": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 157286400\n }\n },\n {\n "volume_3aeb27c4-5945-48bd-8fd2-f6544f92caec/20260703095229/az_nova_backup_f0698713-73de-488e-b4bc-5345c39468df-00005": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 209715200\n }\n },\n {\n "volume_3aeb27c4-5945-48bd-8fd2-f6544f92caec/20260703095229/az_nova_backup_f0698713-73de-488e-b4bc-5345c39468df-00006": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 262144000\n }\n },\n {\n "volume_3aeb27c4-5945-48bd-8fd2-f6544f92caec/20260703095229/az_nova_backup_f0698713-73de-488e-b4bc-5345c39468df-00007": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 314572800\n }\n },\n {\n "volume_3aeb27c4-5945-48bd-8fd2-f6544f92caec/20260703095229/az_nova_backup_f0698713-73de-488e-b4bc-5345c39468df-00008": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 367001600\n }\n },\n {\n "volume_3aeb27c4-5945-48bd-8fd2-f6544f92caec/20260703095229/az_nova_backup_f0698713-73de-488e-b4bc-5345c39468df-00009": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 419430400\n }\n },\n {\n "volume_3aeb27c4-5945-48bd-8fd2-f6544f92caec/20260703095229/az_nova_backup_f0698713-73de-488e-b4bc-5345c39468df-00010": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 471859200\n }\n },\n {\n "volume_3aeb27c4-5945-48bd-8fd2-f6544f92caec/20260703095229/az_nova_backup_f0698713-73de-488e-b4bc-5345c39468df-00011": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 524288000\n }\n },\n {\n "volume_3aeb27c4-5945-48bd-8fd2-f6544f92caec/20260703095229/az_nova_backup_f0698713-73de-488e-b4bc-5345c39468df-00012": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 576716800\n }\n },\n {\n "volume_3aeb27c4-5945-48bd-8fd2-f6544f92caec/20260703095229/az_nova_backup_f0698713-73de-488e-b4bc-5345c39468df-00013": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 629145600\n }\n },\n {\n "volume_3aeb27c4-5945-48bd-8fd2-f6544f92caec/20260703095229/az_nova_backup_f0698713-73de-488e-b4bc-5345c39468df-00014": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 681574400\n }\n },\n {\n "volume_3aeb27c4-5945-48bd-8fd2-f6544f92caec/20260703095229/az_nova_backup_f0698713-73de-488e-b4bc-5345c39468df-00015": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 734003200\n }\n },\n {\n "volume_3aeb27c4-5945-48bd-8fd2-f6544f92caec/20260703095229/az_nova_backup_f0698713-73de-488e-b4bc-5345c39468df-00016": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 786432000\n }\n },\n {\n "volume_3aeb27c4-5945-48bd-8fd2-f6544f92caec/20260703095229/az_nova_backup_f0698713-73de-488e-b4bc-5345c39468df-00017": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 838860800\n }\n },\n {\n "volume_3aeb27c4-5945-48bd-8fd2-f6544f92caec/20260703095229/az_nova_backup_f0698713-73de-488e-b4bc-5345c39468df-00018": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 891289600\n }\n },\n {\n "volume_3aeb27c4-5945-48bd-8fd2-f6544f92caec/20260703095229/az_nova_backup_f0698713-73de-488e-b4bc-5345c39468df-00019": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 943718400\n }\n },\n {\n "volume_3aeb27c4-5945-48bd-8fd2-f6544f92caec/20260703095229/az_nova_backup_f0698713-73de-488e-b4bc-5345c39468df-00020": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 996147200\n }\n },\n {\n "volume_3aeb27c4-5945-48bd-8fd2-f6544f92caec/20260703095229/az_nova_backup_f0698713-73de-488e-b4bc-5345c39468df-00021": {\n "compression": "zlib",\n "length": 25165824,\n "md5": "77377273b0a4b61febdbf7bbf52b9db9",\n "offset": 1048576000\n }\n }\n ],\n "parent_id": null,\n "version": "1.0.0",\n "volume_id": "3aeb27c4-5945-48bd-8fd2-f6544f92caec",\n "volume_meta": "{\\"version\\": 2, \\"volume-base-metadata\\": {\\"id\\": \\"3aeb27c4-5945-48bd-8fd2-f6544f92caec\\", \\"_name_id\\": null, \\"use_quota\\": true, \\"ec2_id\\": null, \\"user_id\\": \\"b22a8ba735af450898b773bff0efd847\\", \\"project_id\\": \\"643865a996c9465fa68ff84007ce7ab6\\", \\"snapshot_id\\": null, \\"cluster_name\\": null, \\"host\\": \\"np0000004400@storpool#default\\", \\"size\\": 1, \\"availability_zone\\": \\"nova\\", \\"status\\": \\"backing-up\\", \\"attach_status\\": \\"detached\\", \\"migration_status\\": null, \\"scheduled_at\\": \\"2026-07-03T09:52:23.000000\\", \\"launched_at\\": \\"2026-07-03T09:52:23.000000\\", \\"terminated_at\\": null, \\"display_name\\": \\"tempest-VolumeV3RbacBaseTests-Volume-1803696159\\", \\"display_description\\": null, \\"provider_location\\": null, \\"provider_auth\\": null, \\"provider_geometry\\": null, \\"provider_id\\": null, \\"volume_type_id\\": \\"03e13fe6-0e30-4803-ace0-725d38e6dc24\\", \\"source_volid\\": null, \\"encryption_key_id\\": null, \\"consistencygroup_id\\": null, \\"group_id\\": null, \\"bootable\\": false, \\"multiattach\\": false, \\"replication_status\\": null, \\"replication_extended_status\\": null, \\"replication_driver_data\\": null, \\"previous_status\\": \\"available\\", \\"service_uuid\\": \\"6d4b0e79-fefe-4744-b25f-34be05095200\\", \\"shared_targets\\": true, \\"deleted_at\\": null, \\"deleted\\": false, \\"created_at\\": \\"2026-07-03T09:52:23.000000\\", \\"updated_at\\": \\"2026-07-03T09:52:24.000000\\"}}"\n}'. {{(pid=101319) _write_metadata /opt/stack/cinder/cinder/backup/chunkeddriver.py:295}} Jul 03 09:52:40.771362 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-e2a239c1-a5c3-4759-b610-3512241e5030 tempest-ProjectMemberTests39-542595828 None] backup f0698713-73de-488e-b4bc-5345c39468df finished. {{(pid=101319) _finalize_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:462}} Jul 03 09:52:40.898504 np0000004400 cinder-backup[101319]: DEBUG oslo_concurrency.processutils [None req-e2a239c1-a5c3-4759-b610-3512241e5030 tempest-ProjectMemberTests39-542595828 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chown 0 /dev/sdg {{(pid=101319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 09:52:40.917006 np0000004400 sudo[153239]: stack : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chown 0 /dev/sdg Jul 03 09:52:40.917678 np0000004400 sudo[153239]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1002) Jul 03 09:52:41.199308 np0000004400 sudo[153239]: pam_unix(sudo:session): session closed for user root Jul 03 09:52:41.201211 np0000004400 cinder-backup[101319]: DEBUG oslo_concurrency.processutils [None req-e2a239c1-a5c3-4759-b610-3512241e5030 tempest-ProjectMemberTests39-542595828 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chown 0 /dev/sdg" returned: 0 in 0.303s {{(pid=101319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 09:52:41.201785 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-e2a239c1-a5c3-4759-b610-3512241e5030 tempest-ProjectMemberTests39-542595828 None] ==> disconnect_volume: call "{'args': (, {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-3aeb27c4-5945-48bd-8fd2-f6544f92caec', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '3aeb27c4-5945-48bd-8fd2-f6544f92caec', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': False}, {'type': 'block', 'scsi_wwn': '1StorPooliSCSI_DISK_1034578903445799194', 'path': '/dev/sdg'}), 'kwargs': {'force': True, 'ignore_errors': True}}" {{(pid=101319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}} Jul 03 09:52:41.201974 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.base [None req-e2a239c1-a5c3-4759-b610-3512241e5030 tempest-ProjectMemberTests39-542595828 None] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=101319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jul 03 09:52:42.057730 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.base [None req-e2a239c1-a5c3-4759-b610-3512241e5030 tempest-ProjectMemberTests39-542595828 None] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.855s {{(pid=101319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jul 03 09:52:42.058250 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-e2a239c1-a5c3-4759-b610-3512241e5030 tempest-ProjectMemberTests39-542595828 None] _get_connection_devices called with parameters: connection_properties={'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-3aeb27c4-5945-48bd-8fd2-f6544f92caec', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '3aeb27c4-5945-48bd-8fd2-f6544f92caec', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': False}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=101319) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:847}} Jul 03 09:52:42.068455 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-e2a239c1-a5c3-4759-b610-3512241e5030 tempest-ProjectMemberTests39-542595828 None] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS: Jul 03 09:52:42.068455 np0000004400 cinder-backup[101319]: No targets found. Jul 03 09:52:42.068455 np0000004400 cinder-backup[101319]: iSNS: Jul 03 09:52:42.068455 np0000004400 cinder-backup[101319]: No targets found. Jul 03 09:52:42.068455 np0000004400 cinder-backup[101319]: STATIC: Jul 03 09:52:42.068455 np0000004400 cinder-backup[101319]: Target: iqn.2023-03.storpool.com:os--volume-491c39b6-d2e0-4f67-9a64-590d50f06197 Jul 03 09:52:42.068455 np0000004400 cinder-backup[101319]: Portal: 192.168.50.100:3260,-1 Jul 03 09:52:42.068455 np0000004400 cinder-backup[101319]: Iface Name: default Jul 03 09:52:42.068455 np0000004400 cinder-backup[101319]: Portal: 192.168.40.100:3260,-1 Jul 03 09:52:42.068455 np0000004400 cinder-backup[101319]: Iface Name: default Jul 03 09:52:42.068455 np0000004400 cinder-backup[101319]: Target: iqn.2023-03.storpool.com:os--volume-3aeb27c4-5945-48bd-8fd2-f6544f92caec Jul 03 09:52:42.068455 np0000004400 cinder-backup[101319]: Portal: 192.168.40.100:3260,-1 Jul 03 09:52:42.068455 np0000004400 cinder-backup[101319]: Iface Name: default Jul 03 09:52:42.068455 np0000004400 cinder-backup[101319]: FIRMWARE: Jul 03 09:52:42.068455 np0000004400 cinder-backup[101319]: No targets found. Jul 03 09:52:42.068455 np0000004400 cinder-backup[101319]: stderr= {{(pid=101319) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jul 03 09:52:42.068909 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-e2a239c1-a5c3-4759-b610-3512241e5030 tempest-ProjectMemberTests39-542595828 None] Regex to get portals from discoverydb: ^SENDTARGETS: Jul 03 09:52:42.068909 np0000004400 cinder-backup[101319]: .*?^DiscoveryAddress: 192.168.40.100,3260.*? Jul 03 09:52:42.068909 np0000004400 cinder-backup[101319]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=101319) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:390}} Jul 03 09:52:42.069618 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-e2a239c1-a5c3-4759-b610-3512241e5030 tempest-ProjectMemberTests39-542595828 None] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-3aeb27c4-5945-48bd-8fd2-f6544f92caec', 0)] {{(pid=101319) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:858}} Jul 03 09:52:42.088494 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-e2a239c1-a5c3-4759-b610-3512241e5030 tempest-ProjectMemberTests39-542595828 None] iscsiadm ('-m', 'session'): stdout=tcp: [187] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3aeb27c4-5945-48bd-8fd2-f6544f92caec (non-flash) Jul 03 09:52:42.088494 np0000004400 cinder-backup[101319]: tcp: [188] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-491c39b6-d2e0-4f67-9a64-590d50f06197 (non-flash) Jul 03 09:52:42.088494 np0000004400 cinder-backup[101319]: tcp: [189] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-491c39b6-d2e0-4f67-9a64-590d50f06197 (non-flash) Jul 03 09:52:42.088494 np0000004400 cinder-backup[101319]: stderr= {{(pid=101319) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jul 03 09:52:42.088629 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-e2a239c1-a5c3-4759-b610-3512241e5030 tempest-ProjectMemberTests39-542595828 None] iscsi session list stdout=tcp: [187] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3aeb27c4-5945-48bd-8fd2-f6544f92caec (non-flash) Jul 03 09:52:42.088629 np0000004400 cinder-backup[101319]: tcp: [188] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-491c39b6-d2e0-4f67-9a64-590d50f06197 (non-flash) Jul 03 09:52:42.088629 np0000004400 cinder-backup[101319]: tcp: [189] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-491c39b6-d2e0-4f67-9a64-590d50f06197 (non-flash) Jul 03 09:52:42.088629 np0000004400 cinder-backup[101319]: stderr= {{(pid=101319) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jul 03 09:52:42.088771 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-e2a239c1-a5c3-4759-b610-3512241e5030 tempest-ProjectMemberTests39-542595828 None] Sessions list: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-3aeb27c4-5945-48bd-8fd2-f6544f92caec', '187'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-491c39b6-d2e0-4f67-9a64-590d50f06197', '188'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-491c39b6-d2e0-4f67-9a64-590d50f06197', '189')] {{(pid=101319) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:866}} Jul 03 09:52:42.088928 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-e2a239c1-a5c3-4759-b610-3512241e5030 tempest-ProjectMemberTests39-542595828 None] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-3aeb27c4-5945-48bd-8fd2-f6544f92caec, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-3aeb27c4-5945-48bd-8fd2-f6544f92caec', '187')] {{(pid=101319) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}} Jul 03 09:52:42.089823 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-e2a239c1-a5c3-4759-b610-3512241e5030 tempest-ProjectMemberTests39-542595828 None] Resulting device map defaultdict(. at 0x7e76e71f11c0>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-3aeb27c4-5945-48bd-8fd2-f6544f92caec'): ({'sdg'}, set())}) {{(pid=101319) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:912}} Jul 03 09:52:42.090052 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.linuxscsi [None req-e2a239c1-a5c3-4759-b610-3512241e5030 tempest-ProjectMemberTests39-542595828 None] Removing single pathed devices sdg {{(pid=101319) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}} Jul 03 09:52:42.099979 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.linuxscsi [None req-e2a239c1-a5c3-4759-b610-3512241e5030 tempest-ProjectMemberTests39-542595828 None] Flushing IO for device /dev/sdg {{(pid=101319) flush_device_io /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:461}} Jul 03 09:52:42.108114 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.linuxscsi [None req-e2a239c1-a5c3-4759-b610-3512241e5030 tempest-ProjectMemberTests39-542595828 None] Remove SCSI device /dev/sdg with /sys/block/sdg/device/delete {{(pid=101319) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}} Jul 03 09:52:42.154880 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.linuxscsi [None req-e2a239c1-a5c3-4759-b610-3512241e5030 tempest-ProjectMemberTests39-542595828 None] Checking to see if SCSI volumes sdg have been removed. {{(pid=101319) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}} Jul 03 09:52:42.155031 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.linuxscsi [None req-e2a239c1-a5c3-4759-b610-3512241e5030 tempest-ProjectMemberTests39-542595828 None] SCSI volumes sdg have been removed. {{(pid=101319) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}} Jul 03 09:52:42.156121 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.linuxscsi [None req-e2a239c1-a5c3-4759-b610-3512241e5030 tempest-ProjectMemberTests39-542595828 None] Checking to see if device paths {'sdg'} are still under multipathd monitoring {{(pid=101319) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}} Jul 03 09:52:42.169424 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.linuxscsi [None req-e2a239c1-a5c3-4759-b610-3512241e5030 tempest-ProjectMemberTests39-542595828 None] Device paths {'sdg'} have been removed from multipathd monitoring. {{(pid=101319) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}} Jul 03 09:52:42.169642 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-e2a239c1-a5c3-4759-b610-3512241e5030 tempest-ProjectMemberTests39-542595828 None] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-3aeb27c4-5945-48bd-8fd2-f6544f92caec')] {{(pid=101319) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1225}} Jul 03 09:52:42.187131 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-e2a239c1-a5c3-4759-b610-3512241e5030 tempest-ProjectMemberTests39-542595828 None] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=101319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 03 09:52:42.226627 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-e2a239c1-a5c3-4759-b610-3512241e5030 tempest-ProjectMemberTests39-542595828 None] iscsiadm ('--logout',): stdout=Logging out of session [sid: 187, target: iqn.2023-03.storpool.com:os--volume-3aeb27c4-5945-48bd-8fd2-f6544f92caec, portal: 192.168.40.100,3260] Jul 03 09:52:42.226627 np0000004400 cinder-backup[101319]: Logout of [sid: 187, target: iqn.2023-03.storpool.com:os--volume-3aeb27c4-5945-48bd-8fd2-f6544f92caec, portal: 192.168.40.100,3260] successful. Jul 03 09:52:42.226627 np0000004400 cinder-backup[101319]: stderr= {{(pid=101319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 03 09:52:42.242009 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-e2a239c1-a5c3-4759-b610-3512241e5030 tempest-ProjectMemberTests39-542595828 None] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=101319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 03 09:52:42.242009 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.base [None req-e2a239c1-a5c3-4759-b610-3512241e5030 tempest-ProjectMemberTests39-542595828 None] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.183s {{(pid=101319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jul 03 09:52:42.242009 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-e2a239c1-a5c3-4759-b610-3512241e5030 tempest-ProjectMemberTests39-542595828 None] <== disconnect_volume: return (1038ms) None {{(pid=101319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}} Jul 03 09:52:43.262217 np0000004400 cinder-backup[101319]: INFO cinder.backup.manager [None req-e2a239c1-a5c3-4759-b610-3512241e5030 tempest-ProjectMemberTests39-542595828 None] Create backup finished. backup: f0698713-73de-488e-b4bc-5345c39468df. Jul 03 09:52:43.798383 np0000004400 cinder-backup[101319]: INFO cinder.backup.manager [None req-6f869aef-e945-4686-aa15-11c3a32b65a4 tempest-ProjectMemberTests39-542595828 None] Delete backup started, backup: f0698713-73de-488e-b4bc-5345c39468df. Jul 03 09:52:43.804600 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.drivers.swift [None req-6f869aef-e945-4686-aa15-11c3a32b65a4 tempest-ProjectMemberTests39-542595828 None] Using swift URL https://10.4.3.95:8080/v1/AUTH_643865a996c9465fa68ff84007ce7ab6 {{(pid=101319) initialize /opt/stack/cinder/cinder/backup/drivers/swift.py:300}} Jul 03 09:52:43.805119 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.drivers.swift [None req-6f869aef-e945-4686-aa15-11c3a32b65a4 tempest-ProjectMemberTests39-542595828 None] Connect to https://10.4.3.95:8080/v1/AUTH_ in "per_user" mode {{(pid=101319) initialize /opt/stack/cinder/cinder/backup/drivers/swift.py:301}} Jul 03 09:52:43.805292 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-6f869aef-e945-4686-aa15-11c3a32b65a4 tempest-ProjectMemberTests39-542595828 None] delete started, backup: f0698713-73de-488e-b4bc-5345c39468df, container: volumebackups, prefix: volume_3aeb27c4-5945-48bd-8fd2-f6544f92caec/20260703095229/az_nova_backup_f0698713-73de-488e-b4bc-5345c39468df. {{(pid=101319) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:822}} Jul 03 09:52:43.848074 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-6f869aef-e945-4686-aa15-11c3a32b65a4 tempest-ProjectMemberTests39-542595828 None] generated object list: ['volume_3aeb27c4-5945-48bd-8fd2-f6544f92caec/20260703095229/az_nova_backup_f0698713-73de-488e-b4bc-5345c39468df-00001', 'volume_3aeb27c4-5945-48bd-8fd2-f6544f92caec/20260703095229/az_nova_backup_f0698713-73de-488e-b4bc-5345c39468df-00002', 'volume_3aeb27c4-5945-48bd-8fd2-f6544f92caec/20260703095229/az_nova_backup_f0698713-73de-488e-b4bc-5345c39468df-00003', 'volume_3aeb27c4-5945-48bd-8fd2-f6544f92caec/20260703095229/az_nova_backup_f0698713-73de-488e-b4bc-5345c39468df-00004', 'volume_3aeb27c4-5945-48bd-8fd2-f6544f92caec/20260703095229/az_nova_backup_f0698713-73de-488e-b4bc-5345c39468df-00005', 'volume_3aeb27c4-5945-48bd-8fd2-f6544f92caec/20260703095229/az_nova_backup_f0698713-73de-488e-b4bc-5345c39468df-00006', 'volume_3aeb27c4-5945-48bd-8fd2-f6544f92caec/20260703095229/az_nova_backup_f0698713-73de-488e-b4bc-5345c39468df-00007', 'volume_3aeb27c4-5945-48bd-8fd2-f6544f92caec/20260703095229/az_nova_backup_f0698713-73de-488e-b4bc-5345c39468df-00008', 'volume_3aeb27c4-5945-48bd-8fd2-f6544f92caec/20260703095229/az_nova_backup_f0698713-73de-488e-b4bc-5345c39468df-00009', 'volume_3aeb27c4-5945-48bd-8fd2-f6544f92caec/20260703095229/az_nova_backup_f0698713-73de-488e-b4bc-5345c39468df-00010', 'volume_3aeb27c4-5945-48bd-8fd2-f6544f92caec/20260703095229/az_nova_backup_f0698713-73de-488e-b4bc-5345c39468df-00011', 'volume_3aeb27c4-5945-48bd-8fd2-f6544f92caec/20260703095229/az_nova_backup_f0698713-73de-488e-b4bc-5345c39468df-00012', 'volume_3aeb27c4-5945-48bd-8fd2-f6544f92caec/20260703095229/az_nova_backup_f0698713-73de-488e-b4bc-5345c39468df-00013', 'volume_3aeb27c4-5945-48bd-8fd2-f6544f92caec/20260703095229/az_nova_backup_f0698713-73de-488e-b4bc-5345c39468df-00014', 'volume_3aeb27c4-5945-48bd-8fd2-f6544f92caec/20260703095229/az_nova_backup_f0698713-73de-488e-b4bc-5345c39468df-00015', 'volume_3aeb27c4-5945-48bd-8fd2-f6544f92caec/20260703095229/az_nova_backup_f0698713-73de-488e-b4bc-5345c39468df-00016', 'volume_3aeb27c4-5945-48bd-8fd2-f6544f92caec/20260703095229/az_nova_backup_f0698713-73de-488e-b4bc-5345c39468df-00017', 'volume_3aeb27c4-5945-48bd-8fd2-f6544f92caec/20260703095229/az_nova_backup_f0698713-73de-488e-b4bc-5345c39468df-00018', 'volume_3aeb27c4-5945-48bd-8fd2-f6544f92caec/20260703095229/az_nova_backup_f0698713-73de-488e-b4bc-5345c39468df-00019', 'volume_3aeb27c4-5945-48bd-8fd2-f6544f92caec/20260703095229/az_nova_backup_f0698713-73de-488e-b4bc-5345c39468df-00020', 'volume_3aeb27c4-5945-48bd-8fd2-f6544f92caec/20260703095229/az_nova_backup_f0698713-73de-488e-b4bc-5345c39468df-00021', 'volume_3aeb27c4-5945-48bd-8fd2-f6544f92caec/20260703095229/az_nova_backup_f0698713-73de-488e-b4bc-5345c39468df_metadata', 'volume_3aeb27c4-5945-48bd-8fd2-f6544f92caec/20260703095229/az_nova_backup_f0698713-73de-488e-b4bc-5345c39468df_sha256file']. {{(pid=101319) _generate_object_names /opt/stack/cinder/cinder/backup/chunkeddriver.py:260}} Jul 03 09:52:43.869913 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-6f869aef-e945-4686-aa15-11c3a32b65a4 tempest-ProjectMemberTests39-542595828 None] deleted object: volume_3aeb27c4-5945-48bd-8fd2-f6544f92caec/20260703095229/az_nova_backup_f0698713-73de-488e-b4bc-5345c39468df-00001 in container: volumebackups. {{(pid=101319) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 09:52:43.888241 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-6f869aef-e945-4686-aa15-11c3a32b65a4 tempest-ProjectMemberTests39-542595828 None] deleted object: volume_3aeb27c4-5945-48bd-8fd2-f6544f92caec/20260703095229/az_nova_backup_f0698713-73de-488e-b4bc-5345c39468df-00002 in container: volumebackups. {{(pid=101319) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 09:52:43.908217 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-6f869aef-e945-4686-aa15-11c3a32b65a4 tempest-ProjectMemberTests39-542595828 None] deleted object: volume_3aeb27c4-5945-48bd-8fd2-f6544f92caec/20260703095229/az_nova_backup_f0698713-73de-488e-b4bc-5345c39468df-00003 in container: volumebackups. {{(pid=101319) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 09:52:43.930253 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-6f869aef-e945-4686-aa15-11c3a32b65a4 tempest-ProjectMemberTests39-542595828 None] deleted object: volume_3aeb27c4-5945-48bd-8fd2-f6544f92caec/20260703095229/az_nova_backup_f0698713-73de-488e-b4bc-5345c39468df-00004 in container: volumebackups. {{(pid=101319) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 09:52:43.947576 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-6f869aef-e945-4686-aa15-11c3a32b65a4 tempest-ProjectMemberTests39-542595828 None] deleted object: volume_3aeb27c4-5945-48bd-8fd2-f6544f92caec/20260703095229/az_nova_backup_f0698713-73de-488e-b4bc-5345c39468df-00005 in container: volumebackups. {{(pid=101319) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 09:52:43.964490 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-6f869aef-e945-4686-aa15-11c3a32b65a4 tempest-ProjectMemberTests39-542595828 None] deleted object: volume_3aeb27c4-5945-48bd-8fd2-f6544f92caec/20260703095229/az_nova_backup_f0698713-73de-488e-b4bc-5345c39468df-00006 in container: volumebackups. {{(pid=101319) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 09:52:43.982380 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-6f869aef-e945-4686-aa15-11c3a32b65a4 tempest-ProjectMemberTests39-542595828 None] deleted object: volume_3aeb27c4-5945-48bd-8fd2-f6544f92caec/20260703095229/az_nova_backup_f0698713-73de-488e-b4bc-5345c39468df-00007 in container: volumebackups. {{(pid=101319) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 09:52:44.000057 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-6f869aef-e945-4686-aa15-11c3a32b65a4 tempest-ProjectMemberTests39-542595828 None] deleted object: volume_3aeb27c4-5945-48bd-8fd2-f6544f92caec/20260703095229/az_nova_backup_f0698713-73de-488e-b4bc-5345c39468df-00008 in container: volumebackups. {{(pid=101319) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 09:52:44.017305 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-6f869aef-e945-4686-aa15-11c3a32b65a4 tempest-ProjectMemberTests39-542595828 None] deleted object: volume_3aeb27c4-5945-48bd-8fd2-f6544f92caec/20260703095229/az_nova_backup_f0698713-73de-488e-b4bc-5345c39468df-00009 in container: volumebackups. {{(pid=101319) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 09:52:44.036988 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-6f869aef-e945-4686-aa15-11c3a32b65a4 tempest-ProjectMemberTests39-542595828 None] deleted object: volume_3aeb27c4-5945-48bd-8fd2-f6544f92caec/20260703095229/az_nova_backup_f0698713-73de-488e-b4bc-5345c39468df-00010 in container: volumebackups. {{(pid=101319) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 09:52:44.055491 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-6f869aef-e945-4686-aa15-11c3a32b65a4 tempest-ProjectMemberTests39-542595828 None] deleted object: volume_3aeb27c4-5945-48bd-8fd2-f6544f92caec/20260703095229/az_nova_backup_f0698713-73de-488e-b4bc-5345c39468df-00011 in container: volumebackups. {{(pid=101319) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 09:52:44.074067 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-6f869aef-e945-4686-aa15-11c3a32b65a4 tempest-ProjectMemberTests39-542595828 None] deleted object: volume_3aeb27c4-5945-48bd-8fd2-f6544f92caec/20260703095229/az_nova_backup_f0698713-73de-488e-b4bc-5345c39468df-00012 in container: volumebackups. {{(pid=101319) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 09:52:44.091188 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-6f869aef-e945-4686-aa15-11c3a32b65a4 tempest-ProjectMemberTests39-542595828 None] deleted object: volume_3aeb27c4-5945-48bd-8fd2-f6544f92caec/20260703095229/az_nova_backup_f0698713-73de-488e-b4bc-5345c39468df-00013 in container: volumebackups. {{(pid=101319) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 09:52:44.109453 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-6f869aef-e945-4686-aa15-11c3a32b65a4 tempest-ProjectMemberTests39-542595828 None] deleted object: volume_3aeb27c4-5945-48bd-8fd2-f6544f92caec/20260703095229/az_nova_backup_f0698713-73de-488e-b4bc-5345c39468df-00014 in container: volumebackups. {{(pid=101319) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 09:52:44.128181 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-6f869aef-e945-4686-aa15-11c3a32b65a4 tempest-ProjectMemberTests39-542595828 None] deleted object: volume_3aeb27c4-5945-48bd-8fd2-f6544f92caec/20260703095229/az_nova_backup_f0698713-73de-488e-b4bc-5345c39468df-00015 in container: volumebackups. {{(pid=101319) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 09:52:44.147094 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-6f869aef-e945-4686-aa15-11c3a32b65a4 tempest-ProjectMemberTests39-542595828 None] deleted object: volume_3aeb27c4-5945-48bd-8fd2-f6544f92caec/20260703095229/az_nova_backup_f0698713-73de-488e-b4bc-5345c39468df-00016 in container: volumebackups. {{(pid=101319) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 09:52:44.166678 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-6f869aef-e945-4686-aa15-11c3a32b65a4 tempest-ProjectMemberTests39-542595828 None] deleted object: volume_3aeb27c4-5945-48bd-8fd2-f6544f92caec/20260703095229/az_nova_backup_f0698713-73de-488e-b4bc-5345c39468df-00017 in container: volumebackups. {{(pid=101319) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 09:52:44.185189 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-6f869aef-e945-4686-aa15-11c3a32b65a4 tempest-ProjectMemberTests39-542595828 None] deleted object: volume_3aeb27c4-5945-48bd-8fd2-f6544f92caec/20260703095229/az_nova_backup_f0698713-73de-488e-b4bc-5345c39468df-00018 in container: volumebackups. {{(pid=101319) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 09:52:44.203684 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-6f869aef-e945-4686-aa15-11c3a32b65a4 tempest-ProjectMemberTests39-542595828 None] deleted object: volume_3aeb27c4-5945-48bd-8fd2-f6544f92caec/20260703095229/az_nova_backup_f0698713-73de-488e-b4bc-5345c39468df-00019 in container: volumebackups. {{(pid=101319) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 09:52:44.225771 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-6f869aef-e945-4686-aa15-11c3a32b65a4 tempest-ProjectMemberTests39-542595828 None] deleted object: volume_3aeb27c4-5945-48bd-8fd2-f6544f92caec/20260703095229/az_nova_backup_f0698713-73de-488e-b4bc-5345c39468df-00020 in container: volumebackups. {{(pid=101319) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 09:52:44.246494 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-6f869aef-e945-4686-aa15-11c3a32b65a4 tempest-ProjectMemberTests39-542595828 None] deleted object: volume_3aeb27c4-5945-48bd-8fd2-f6544f92caec/20260703095229/az_nova_backup_f0698713-73de-488e-b4bc-5345c39468df-00021 in container: volumebackups. {{(pid=101319) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 09:52:44.263164 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-6f869aef-e945-4686-aa15-11c3a32b65a4 tempest-ProjectMemberTests39-542595828 None] deleted object: volume_3aeb27c4-5945-48bd-8fd2-f6544f92caec/20260703095229/az_nova_backup_f0698713-73de-488e-b4bc-5345c39468df_metadata in container: volumebackups. {{(pid=101319) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 09:52:44.280624 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-6f869aef-e945-4686-aa15-11c3a32b65a4 tempest-ProjectMemberTests39-542595828 None] deleted object: volume_3aeb27c4-5945-48bd-8fd2-f6544f92caec/20260703095229/az_nova_backup_f0698713-73de-488e-b4bc-5345c39468df_sha256file in container: volumebackups. {{(pid=101319) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 09:52:44.280917 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-6f869aef-e945-4686-aa15-11c3a32b65a4 tempest-ProjectMemberTests39-542595828 None] delete f0698713-73de-488e-b4bc-5345c39468df finished. {{(pid=101319) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:848}} Jul 03 09:52:44.314711 np0000004400 cinder-backup[101319]: DEBUG oslo_db.sqlalchemy.engines [None req-6f869aef-e945-4686-aa15-11c3a32b65a4 tempest-ProjectMemberTests39-542595828 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=101319) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 03 09:52:44.327985 np0000004400 cinder-backup[101319]: DEBUG cinder.quota [None req-6f869aef-e945-4686-aa15-11c3a32b65a4 tempest-ProjectMemberTests39-542595828 None] Created reservations ['11322cbb-7996-47fc-871c-685b25af579c', '7bb314cd-2362-4fd2-b7f1-a6cbce1ec447'] {{(pid=101319) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 09:52:44.342674 np0000004400 cinder-backup[101319]: INFO cinder.backup.manager [None req-6f869aef-e945-4686-aa15-11c3a32b65a4 tempest-ProjectMemberTests39-542595828 None] Delete backup finished, backup f0698713-73de-488e-b4bc-5345c39468df deleted. Jul 03 09:52:48.924818 np0000004400 cinder-backup[101319]: INFO cinder.backup.manager [None req-f043e500-5f3b-4c72-b188-fc659a5e00c0 tempest-ProjectReaderTests33-761902925 None] Create backup started, backup: 6624fbb5-b72a-4c4d-bc8d-5f32665a951a volume: 44062477-adb9-4fe5-a2cb-600f263cd316. Jul 03 09:52:48.929754 np0000004400 cinder-backup[101319]: INFO cinder.backup.manager [None req-f043e500-5f3b-4c72-b188-fc659a5e00c0 tempest-ProjectReaderTests33-761902925 None] Call Volume Manager to get_backup_device for Backup(availability_zone='nova',container=None,created_at=2026-07-03T09:52:48Z,data_timestamp=2026-07-03T09:52:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-type-Backup-1542251835',encryption_key_id=None,fail_reason=None,host='np0000004400',id=6624fbb5-b72a-4c4d-bc8d-5f32665a951a,metadata={},num_dependent_backups=0,object_count=0,parent=None,parent_id=None,project_id='e331bd155b824bbb8979e9aac5023870',restore_volume_id=None,service='cinder.backup.drivers.swift.SwiftBackupDriver',service_metadata=None,size=1,snapshot_id=None,status='creating',temp_snapshot_id=None,temp_volume_id=None,updated_at=None,user_id='45a99ff133014c9a8bfd931707d31606',volume_id=44062477-adb9-4fe5-a2cb-600f263cd316) Jul 03 09:52:48.950864 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.drivers.swift [None req-f043e500-5f3b-4c72-b188-fc659a5e00c0 tempest-ProjectReaderTests33-761902925 None] Using swift URL https://10.4.3.95:8080/v1/AUTH_e331bd155b824bbb8979e9aac5023870 {{(pid=101319) initialize /opt/stack/cinder/cinder/backup/drivers/swift.py:300}} Jul 03 09:52:48.951039 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.drivers.swift [None req-f043e500-5f3b-4c72-b188-fc659a5e00c0 tempest-ProjectReaderTests33-761902925 None] Connect to https://10.4.3.95:8080/v1/AUTH_ in "per_user" mode {{(pid=101319) initialize /opt/stack/cinder/cinder/backup/drivers/swift.py:301}} Jul 03 09:52:48.951677 np0000004400 cinder-backup[101319]: DEBUG os_brick.utils [None req-f043e500-5f3b-4c72-b188-fc659a5e00c0 tempest-ProjectReaderTests33-761902925 None] ==> get_connector_properties: call "{'root_helper': 'sudo cinder-rootwrap /etc/cinder/rootwrap.conf', 'my_ip': '10.4.3.95', 'multipath': False, 'enforce_multipath': False, 'host': None, 'execute': None}" {{(pid=101319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}} Jul 03 09:52:48.964894 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.scaleio [None req-f043e500-5f3b-4c72-b188-fc659a5e00c0 tempest-ProjectReaderTests33-761902925 None] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=101319) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}} Jul 03 09:52:48.986664 np0000004400 cinder-backup[101319]: DEBUG oslo_concurrency.processutils [None req-f043e500-5f3b-4c72-b188-fc659a5e00c0 tempest-ProjectReaderTests33-761902925 None] Running cmd (subprocess): nvme version {{(pid=101319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 09:52:48.999477 np0000004400 cinder-backup[101319]: DEBUG oslo_concurrency.processutils [None req-f043e500-5f3b-4c72-b188-fc659a5e00c0 tempest-ProjectReaderTests33-761902925 None] 'nvme version' failed. Not Retrying. {{(pid=101319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 03 09:52:48.999728 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.nvmeof [None req-f043e500-5f3b-4c72-b188-fc659a5e00c0 tempest-ProjectReaderTests33-761902925 None] nvme not present on system {{(pid=101319) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}} Jul 03 09:52:49.008172 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.lightos [None req-f043e500-5f3b-4c72-b188-fc659a5e00c0 tempest-ProjectReaderTests33-761902925 None] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=101319) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}} Jul 03 09:52:49.009252 np0000004400 cinder-backup[101319]: INFO os_brick.initiator.connectors.lightos [None req-f043e500-5f3b-4c72-b188-fc659a5e00c0 tempest-ProjectReaderTests33-761902925 None] Current host hostNQN and IP(s) are ['10.4.3.95', 'fe80::f816:3eff:fe47:268c', '192.168.40.6', 'fe80::f816:3eff:febf:7be2', '192.168.50.6', 'fe80::f816:3eff:fe99:8914', '192.168.10.6', 'fe80::f816:3eff:fe2f:e696', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::bc9d:84ff:fec2:6b49', 'fe80::fc16:3eff:fe6a:1a3e', 'fe80::b099:12ff:feb4:ede7', 'fe80::fc16:3eff:fe13:9420', 'fe80::8cea:42ff:fe99:b64a', 'fe80::fc16:3eff:feaa:206b', 'fe80::74a1:e1ff:fe2f:1924'] Jul 03 09:52:49.009441 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.lightos [None req-f043e500-5f3b-4c72-b188-fc659a5e00c0 tempest-ProjectReaderTests33-761902925 None] LIGHTOS: did not find dsc, continuing anyway. {{(pid=101319) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}} Jul 03 09:52:49.009578 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.lightos [None req-f043e500-5f3b-4c72-b188-fc659a5e00c0 tempest-ProjectReaderTests33-761902925 None] LIGHTOS: no hostnqn found. {{(pid=101319) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}} Jul 03 09:52:49.009824 np0000004400 cinder-backup[101319]: DEBUG os_brick.utils [None req-f043e500-5f3b-4c72-b188-fc659a5e00c0 tempest-ProjectReaderTests33-761902925 None] <== get_connector_properties: return (58ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.95', 'host': 'np0000004400', 'multipath': False, 'enforce_multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:ae7e5bb0ebe6', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': '6b284368-d0ba-4d18-af6f-4998d3955c52', 'nvme_native_multipath': False} {{(pid=101319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}} Jul 03 09:52:49.514461 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connector [None req-f043e500-5f3b-4c72-b188-fc659a5e00c0 tempest-ProjectReaderTests33-761902925 None] Factory for iscsi on None {{(pid=101319) factory /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connector.py:243}} Jul 03 09:52:49.514829 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-f043e500-5f3b-4c72-b188-fc659a5e00c0 tempest-ProjectReaderTests33-761902925 None] ==> connect_volume: call "{'self': , 'connection_properties': {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-44062477-adb9-4fe5-a2cb-600f263cd316', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '44062477-adb9-4fe5-a2cb-600f263cd316', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': False}}" {{(pid=101319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}} Jul 03 09:52:49.514984 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.base [None req-f043e500-5f3b-4c72-b188-fc659a5e00c0 tempest-ProjectReaderTests33-761902925 None] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=101319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jul 03 09:52:49.515390 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.base [None req-f043e500-5f3b-4c72-b188-fc659a5e00c0 tempest-ProjectReaderTests33-761902925 None] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.000s {{(pid=101319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jul 03 09:52:49.515622 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.base [None req-f043e500-5f3b-4c72-b188-fc659a5e00c0 tempest-ProjectReaderTests33-761902925 None] Connection properties {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-44062477-adb9-4fe5-a2cb-600f263cd316', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '44062477-adb9-4fe5-a2cb-600f263cd316', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': False} {{(pid=101319) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}} Jul 03 09:52:49.527769 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.base [None req-f043e500-5f3b-4c72-b188-fc659a5e00c0 tempest-ProjectReaderTests33-761902925 None] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-44062477-adb9-4fe5-a2cb-600f263cd316" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=101319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jul 03 09:52:49.528165 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.base [None req-f043e500-5f3b-4c72-b188-fc659a5e00c0 tempest-ProjectReaderTests33-761902925 None] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-44062477-adb9-4fe5-a2cb-600f263cd316" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.000s {{(pid=101319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jul 03 09:52:49.528382 np0000004400 cinder-backup[101319]: INFO os_brick.initiator.connectors.iscsi [None req-f043e500-5f3b-4c72-b188-fc659a5e00c0 tempest-ProjectReaderTests33-761902925 None] Trying to connect to iSCSI portal 192.168.40.100:3260 Jul 03 09:52:49.543683 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-f043e500-5f3b-4c72-b188-fc659a5e00c0 tempest-ProjectReaderTests33-761902925 None] iscsiadm (): stdout= stderr=iscsiadm: No records found Jul 03 09:52:49.543683 np0000004400 cinder-backup[101319]: {{(pid=101319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 03 09:52:49.555920 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-f043e500-5f3b-4c72-b188-fc659a5e00c0 tempest-ProjectReaderTests33-761902925 None] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-44062477-adb9-4fe5-a2cb-600f263cd316] added Jul 03 09:52:49.555920 np0000004400 cinder-backup[101319]: stderr=iscsiadm: Config file line 363 does not have value Jul 03 09:52:49.555920 np0000004400 cinder-backup[101319]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs' Jul 03 09:52:49.555920 np0000004400 cinder-backup[101319]: iscsiadm: Config file line 363 does not have value Jul 03 09:52:49.555920 np0000004400 cinder-backup[101319]: iscsiadm: Config file line 363 does not have value Jul 03 09:52:49.555920 np0000004400 cinder-backup[101319]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs' Jul 03 09:52:49.555920 np0000004400 cinder-backup[101319]: {{(pid=101319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 03 09:52:49.556820 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-f043e500-5f3b-4c72-b188-fc659a5e00c0 tempest-ProjectReaderTests33-761902925 None] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=101319) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}} Jul 03 09:52:49.556820 np0000004400 cinder-backup[101319]: DEBUG os_brick.utils [None req-f043e500-5f3b-4c72-b188-fc659a5e00c0 tempest-ProjectReaderTests33-761902925 None] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.028(s), this was the 1st time calling it. {{(pid=101319) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}} Jul 03 09:52:49.556820 np0000004400 cinder-backup[101319]: DEBUG os_brick.utils [None req-f043e500-5f3b-4c72-b188-fc659a5e00c0 tempest-ProjectReaderTests33-761902925 None] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=101319) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}} Jul 03 09:52:50.557321 np0000004400 cinder-backup[101319]: INFO os_brick.initiator.connectors.iscsi [None req-f043e500-5f3b-4c72-b188-fc659a5e00c0 tempest-ProjectReaderTests33-761902925 None] Trying to connect to iSCSI portal 192.168.40.100:3260 Jul 03 09:52:50.567576 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-f043e500-5f3b-4c72-b188-fc659a5e00c0 tempest-ProjectReaderTests33-761902925 None] iscsiadm (): stdout=# BEGIN RECORD 2.1.9 Jul 03 09:52:50.567576 np0000004400 cinder-backup[101319]: node.name = iqn.2023-03.storpool.com:os--volume-44062477-adb9-4fe5-a2cb-600f263cd316 Jul 03 09:52:50.567576 np0000004400 cinder-backup[101319]: node.tpgt = -1 Jul 03 09:52:50.567576 np0000004400 cinder-backup[101319]: node.startup = manual Jul 03 09:52:50.567576 np0000004400 cinder-backup[101319]: node.leading_login = No Jul 03 09:52:50.567576 np0000004400 cinder-backup[101319]: iface.iscsi_ifacename = default Jul 03 09:52:50.567576 np0000004400 cinder-backup[101319]: iface.net_ifacename = Jul 03 09:52:50.567576 np0000004400 cinder-backup[101319]: iface.ipaddress = Jul 03 09:52:50.567576 np0000004400 cinder-backup[101319]: iface.prefix_len = 0 Jul 03 09:52:50.567576 np0000004400 cinder-backup[101319]: iface.hwaddress = Jul 03 09:52:50.567576 np0000004400 cinder-backup[101319]: iface.transport_name = tcp Jul 03 09:52:50.567576 np0000004400 cinder-backup[101319]: iface.initiatorname = Jul 03 09:52:50.567576 np0000004400 cinder-backup[101319]: iface.state = Jul 03 09:52:50.567576 np0000004400 cinder-backup[101319]: iface.vlan_id = 0 Jul 03 09:52:50.567576 np0000004400 cinder-backup[101319]: iface.vlan_priority = 0 Jul 03 09:52:50.567576 np0000004400 cinder-backup[101319]: iface.vlan_state = Jul 03 09:52:50.567576 np0000004400 cinder-backup[101319]: iface.iface_num = 0 Jul 03 09:52:50.567576 np0000004400 cinder-backup[101319]: iface.mtu = 0 Jul 03 09:52:50.567576 np0000004400 cinder-backup[101319]: iface.port = 0 Jul 03 09:52:50.567576 np0000004400 cinder-backup[101319]: iface.bootproto = Jul 03 09:52:50.567576 np0000004400 cinder-backup[101319]: iface.subnet_mask = Jul 03 09:52:50.567576 np0000004400 cinder-backup[101319]: iface.gateway = Jul 03 09:52:50.567576 np0000004400 cinder-backup[101319]: iface.dhcp_alt_client_id_state = Jul 03 09:52:50.567576 np0000004400 cinder-backup[101319]: iface.dhcp_alt_client_id = Jul 03 09:52:50.567576 np0000004400 cinder-backup[101319]: iface.dhcp_dns = Jul 03 09:52:50.567576 np0000004400 cinder-backup[101319]: iface.dhcp_learn_iqn = Jul 03 09:52:50.567576 np0000004400 cinder-backup[101319]: iface.dhcp_req_vendor_id_state = Jul 03 09:52:50.567576 np0000004400 cinder-backup[101319]: iface.dhcp_vendor_id_state = Jul 03 09:52:50.567576 np0000004400 cinder-backup[101319]: iface.dhcp_vendor_id = Jul 03 09:52:50.567576 np0000004400 cinder-backup[101319]: iface.dhcp_slp_da = Jul 03 09:52:50.567576 np0000004400 cinder-backup[101319]: iface.fragmentation = Jul 03 09:52:50.567576 np0000004400 cinder-backup[101319]: iface.gratuitous_arp = Jul 03 09:52:50.567576 np0000004400 cinder-backup[101319]: iface.incoming_forwarding = Jul 03 09:52:50.567576 np0000004400 cinder-backup[101319]: iface.tos_state = Jul 03 09:52:50.567576 np0000004400 cinder-backup[101319]: iface.tos = 0 Jul 03 09:52:50.567576 np0000004400 cinder-backup[101319]: iface.ttl = 0 Jul 03 09:52:50.567576 np0000004400 cinder-backup[101319]: iface.delayed_ack = Jul 03 09:52:50.567576 np0000004400 cinder-backup[101319]: iface.tcp_nagle = Jul 03 09:52:50.567576 np0000004400 cinder-backup[101319]: iface.tcp_wsf_state = Jul 03 09:52:50.567576 np0000004400 cinder-backup[101319]: iface.tcp_wsf = 0 Jul 03 09:52:50.567576 np0000004400 cinder-backup[101319]: iface.tcp_timer_scale = 0 Jul 03 09:52:50.567576 np0000004400 cinder-backup[101319]: iface.tcp_timestamp = Jul 03 09:52:50.567576 np0000004400 cinder-backup[101319]: iface.redirect = Jul 03 09:52:50.567576 np0000004400 cinder-backup[101319]: iface.def_task_mgmt_timeout = 0 Jul 03 09:52:50.567576 np0000004400 cinder-backup[101319]: iface.header_digest = Jul 03 09:52:50.567576 np0000004400 cinder-backup[101319]: iface.data_digest = Jul 03 09:52:50.567576 np0000004400 cinder-backup[101319]: iface.immediate_data = Jul 03 09:52:50.567576 np0000004400 cinder-backup[101319]: iface.initial_r2t = Jul 03 09:52:50.567576 np0000004400 cinder-backup[101319]: iface.data_seq_inorder = Jul 03 09:52:50.567576 np0000004400 cinder-backup[101319]: iface.data_pdu_inorder = Jul 03 09:52:50.567576 np0000004400 cinder-backup[101319]: iface.erl = 0 Jul 03 09:52:50.567576 np0000004400 cinder-backup[101319]: iface.max_receive_data_len = 0 Jul 03 09:52:50.567576 np0000004400 cinder-backup[101319]: iface.first_burst_len = 0 Jul 03 09:52:50.567576 np0000004400 cinder-backup[101319]: iface.max_outstanding_r2t = 0 Jul 03 09:52:50.567576 np0000004400 cinder-backup[101319]: iface.max_burst_len = 0 Jul 03 09:52:50.567576 np0000004400 cinder-backup[101319]: iface.chap_auth = Jul 03 09:52:50.567576 np0000004400 cinder-backup[101319]: iface.bidi_chap = Jul 03 09:52:50.567576 np0000004400 cinder-backup[101319]: iface.strict_login_compliance = Jul 03 09:52:50.567576 np0000004400 cinder-backup[101319]: iface.discovery_auth = Jul 03 09:52:50.567576 np0000004400 cinder-backup[101319]: iface.discovery_logout = Jul 03 09:52:50.567576 np0000004400 cinder-backup[101319]: node.discovery_address = Jul 03 09:52:50.567576 np0000004400 cinder-backup[101319]: node.discovery_port = 0 Jul 03 09:52:50.567576 np0000004400 cinder-backup[101319]: node.discovery_type = fw Jul 03 09:52:50.567576 np0000004400 cinder-backup[101319]: node.session.initial_cmdsn = 0 Jul 03 09:52:50.567576 np0000004400 cinder-backup[101319]: node.session.initial_login_retry_max = 8 Jul 03 09:52:50.567576 np0000004400 cinder-backup[101319]: node.session.xmit_thread_priority = 0 Jul 03 09:52:50.567576 np0000004400 cinder-backup[101319]: node.session.cmds_max = 128 Jul 03 09:52:50.567576 np0000004400 cinder-backup[101319]: node.session.queue_depth = 32 Jul 03 09:52:50.567576 np0000004400 cinder-backup[101319]: node.session.nr_sessions = 1 Jul 03 09:52:50.567576 np0000004400 cinder-backup[101319]: node.session.auth.authmethod = None Jul 03 09:52:50.567576 np0000004400 cinder-backup[101319]: node.session.auth.username = Jul 03 09:52:50.567576 np0000004400 cinder-backup[101319]: node.session.auth.password = *** Jul 03 09:52:50.567576 np0000004400 cinder-backup[101319]: node.session.auth.username_in = Jul 03 09:52:50.567576 np0000004400 cinder-backup[101319]: node.session.auth.password_in = Jul 03 09:52:50.567576 np0000004400 cinder-backup[101319]: node.session.auth.chap_algs = SHA256 Jul 03 09:52:50.567576 np0000004400 cinder-backup[101319]: node.session.timeo.replacement_timeout = 120 Jul 03 09:52:50.567576 np0000004400 cinder-backup[101319]: node.session.err_timeo.abort_timeout = 15 Jul 03 09:52:50.567576 np0000004400 cinder-backup[101319]: node.session.err_timeo.lu_reset_timeout = 30 Jul 03 09:52:50.567576 np0000004400 cinder-backup[101319]: node.session.err_timeo.tgt_reset_timeout = 30 Jul 03 09:52:50.567576 np0000004400 cinder-backup[101319]: node.session.err_timeo.host_reset_timeout = 60 Jul 03 09:52:50.567576 np0000004400 cinder-backup[101319]: node.session.iscsi.FastAbort = Yes Jul 03 09:52:50.567576 np0000004400 cinder-backup[101319]: node.session.iscsi.InitialR2T = No Jul 03 09:52:50.567576 np0000004400 cinder-backup[101319]: node.session.iscsi.ImmediateData = Yes Jul 03 09:52:50.567576 np0000004400 cinder-backup[101319]: node.session.iscsi.FirstBurstLength = 262144 Jul 03 09:52:50.567576 np0000004400 cinder-backup[101319]: node.session.iscsi.MaxBurstLength = 16776192 Jul 03 09:52:50.567576 np0000004400 cinder-backup[101319]: node.session.iscsi.DefaultTime2Retain = 0 Jul 03 09:52:50.567576 np0000004400 cinder-backup[101319]: node.session.iscsi.DefaultTime2Wait = 2 Jul 03 09:52:50.567576 np0000004400 cinder-backup[101319]: node.session.iscsi.MaxConnections = 1 Jul 03 09:52:50.567576 np0000004400 cinder-backup[101319]: node.session.iscsi.MaxOutstandingR2T = 1 Jul 03 09:52:50.567576 np0000004400 cinder-backup[101319]: node.session.iscsi.ERL = 0 Jul 03 09:52:50.567576 np0000004400 cinder-backup[101319]: node.session.scan = auto Jul 03 09:52:50.567576 np0000004400 cinder-backup[101319]: node.session.reopen_max = 0 Jul 03 09:52:50.567576 np0000004400 cinder-backup[101319]: node.conn[0].address = 192.168.40.100 Jul 03 09:52:50.567576 np0000004400 cinder-backup[101319]: node.conn[0].port = 3260 Jul 03 09:52:50.567576 np0000004400 cinder-backup[101319]: node.conn[0].startup = manual Jul 03 09:52:50.567576 np0000004400 cinder-backup[101319]: node.conn[0].tcp.window_size = 524288 Jul 03 09:52:50.567576 np0000004400 cinder-backup[101319]: node.conn[0].tcp.type_of_service = 0 Jul 03 09:52:50.567576 np0000004400 cinder-backup[101319]: node.conn[0].timeo.logout_timeout = 15 Jul 03 09:52:50.567576 np0000004400 cinder-backup[101319]: node.conn[0].timeo.login_timeout = 15 Jul 03 09:52:50.567576 np0000004400 cinder-backup[101319]: node.conn[0].timeo.auth_timeout = 45 Jul 03 09:52:50.567576 np0000004400 cinder-backup[101319]: node.conn[0].timeo.noop_out_interval = 5 Jul 03 09:52:50.567576 np0000004400 cinder-backup[101319]: node.conn[0].timeo.noop_out_timeout = 5 Jul 03 09:52:50.567576 np0000004400 cinder-backup[101319]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0 Jul 03 09:52:50.567576 np0000004400 cinder-backup[101319]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144 Jul 03 09:52:50.567576 np0000004400 cinder-backup[101319]: node.conn[0].iscsi.HeaderDigest = None Jul 03 09:52:50.567576 np0000004400 cinder-backup[101319]: node.conn[0].iscsi.DataDigest = None Jul 03 09:52:50.567576 np0000004400 cinder-backup[101319]: node.conn[0].iscsi.IFMarker = No Jul 03 09:52:50.567576 np0000004400 cinder-backup[101319]: node.conn[0].iscsi.OFMarker = No Jul 03 09:52:50.567576 np0000004400 cinder-backup[101319]: # END RECORD Jul 03 09:52:50.567576 np0000004400 cinder-backup[101319]: stderr= {{(pid=101319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 03 09:52:50.577975 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-f043e500-5f3b-4c72-b188-fc659a5e00c0 tempest-ProjectReaderTests33-761902925 None] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=101319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 03 09:52:50.591615 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-f043e500-5f3b-4c72-b188-fc659a5e00c0 tempest-ProjectReaderTests33-761902925 None] iscsiadm ('-m', 'session'): stdout=tcp: [188] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-491c39b6-d2e0-4f67-9a64-590d50f06197 (non-flash) Jul 03 09:52:50.591615 np0000004400 cinder-backup[101319]: tcp: [189] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-491c39b6-d2e0-4f67-9a64-590d50f06197 (non-flash) Jul 03 09:52:50.591615 np0000004400 cinder-backup[101319]: tcp: [190] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-587c7b72-43cf-42f6-934b-33e5af9e4bef (non-flash) Jul 03 09:52:50.591615 np0000004400 cinder-backup[101319]: tcp: [191] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-587c7b72-43cf-42f6-934b-33e5af9e4bef (non-flash) Jul 03 09:52:50.591615 np0000004400 cinder-backup[101319]: stderr= {{(pid=101319) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jul 03 09:52:50.591843 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-f043e500-5f3b-4c72-b188-fc659a5e00c0 tempest-ProjectReaderTests33-761902925 None] iscsi session list stdout=tcp: [188] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-491c39b6-d2e0-4f67-9a64-590d50f06197 (non-flash) Jul 03 09:52:50.591843 np0000004400 cinder-backup[101319]: tcp: [189] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-491c39b6-d2e0-4f67-9a64-590d50f06197 (non-flash) Jul 03 09:52:50.591843 np0000004400 cinder-backup[101319]: tcp: [190] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-587c7b72-43cf-42f6-934b-33e5af9e4bef (non-flash) Jul 03 09:52:50.591843 np0000004400 cinder-backup[101319]: tcp: [191] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-587c7b72-43cf-42f6-934b-33e5af9e4bef (non-flash) Jul 03 09:52:50.591843 np0000004400 cinder-backup[101319]: stderr= {{(pid=101319) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jul 03 09:52:50.623705 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-f043e500-5f3b-4c72-b188-fc659a5e00c0 tempest-ProjectReaderTests33-761902925 None] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-44062477-adb9-4fe5-a2cb-600f263cd316, portal: 192.168.40.100,3260] Jul 03 09:52:50.623705 np0000004400 cinder-backup[101319]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-44062477-adb9-4fe5-a2cb-600f263cd316, portal: 192.168.40.100,3260] successful. Jul 03 09:52:50.623705 np0000004400 cinder-backup[101319]: stderr= {{(pid=101319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 03 09:52:50.635420 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-f043e500-5f3b-4c72-b188-fc659a5e00c0 tempest-ProjectReaderTests33-761902925 None] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=101319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 03 09:52:50.647969 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-f043e500-5f3b-4c72-b188-fc659a5e00c0 tempest-ProjectReaderTests33-761902925 None] iscsiadm ('-m', 'session'): stdout=tcp: [188] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-491c39b6-d2e0-4f67-9a64-590d50f06197 (non-flash) Jul 03 09:52:50.647969 np0000004400 cinder-backup[101319]: tcp: [189] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-491c39b6-d2e0-4f67-9a64-590d50f06197 (non-flash) Jul 03 09:52:50.647969 np0000004400 cinder-backup[101319]: tcp: [190] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-587c7b72-43cf-42f6-934b-33e5af9e4bef (non-flash) Jul 03 09:52:50.647969 np0000004400 cinder-backup[101319]: tcp: [191] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-587c7b72-43cf-42f6-934b-33e5af9e4bef (non-flash) Jul 03 09:52:50.647969 np0000004400 cinder-backup[101319]: tcp: [192] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-44062477-adb9-4fe5-a2cb-600f263cd316 (non-flash) Jul 03 09:52:50.647969 np0000004400 cinder-backup[101319]: stderr= {{(pid=101319) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jul 03 09:52:50.648141 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-f043e500-5f3b-4c72-b188-fc659a5e00c0 tempest-ProjectReaderTests33-761902925 None] iscsi session list stdout=tcp: [188] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-491c39b6-d2e0-4f67-9a64-590d50f06197 (non-flash) Jul 03 09:52:50.648141 np0000004400 cinder-backup[101319]: tcp: [189] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-491c39b6-d2e0-4f67-9a64-590d50f06197 (non-flash) Jul 03 09:52:50.648141 np0000004400 cinder-backup[101319]: tcp: [190] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-587c7b72-43cf-42f6-934b-33e5af9e4bef (non-flash) Jul 03 09:52:50.648141 np0000004400 cinder-backup[101319]: tcp: [191] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-587c7b72-43cf-42f6-934b-33e5af9e4bef (non-flash) Jul 03 09:52:50.648141 np0000004400 cinder-backup[101319]: tcp: [192] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-44062477-adb9-4fe5-a2cb-600f263cd316 (non-flash) Jul 03 09:52:50.648141 np0000004400 cinder-backup[101319]: stderr= {{(pid=101319) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jul 03 09:52:50.648506 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.base [None req-f043e500-5f3b-4c72-b188-fc659a5e00c0 tempest-ProjectReaderTests33-761902925 None] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-44062477-adb9-4fe5-a2cb-600f263cd316" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.120s {{(pid=101319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jul 03 09:52:50.648672 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-f043e500-5f3b-4c72-b188-fc659a5e00c0 tempest-ProjectReaderTests33-761902925 None] Connected to 192.168.40.100:3260 {{(pid=101319) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}} Jul 03 09:52:50.649549 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.linuxscsi [None req-f043e500-5f3b-4c72-b188-fc659a5e00c0 tempest-ProjectReaderTests33-761902925 None] HCTL ('11', '-', '-', 0) found on session 192 with lun 0 {{(pid=101319) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}} Jul 03 09:52:50.649707 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.linuxscsi [None req-f043e500-5f3b-4c72-b188-fc659a5e00c0 tempest-ProjectReaderTests33-761902925 None] Scanning host 11 c: -, t: -, l: 0) {{(pid=101319) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}} Jul 03 09:52:50.663065 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.linuxscsi [None req-f043e500-5f3b-4c72-b188-fc659a5e00c0 tempest-ProjectReaderTests33-761902925 None] Searching for a device in session 192 and hctl ['11', '*', '*', 0] yield: sdf {{(pid=101319) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}} Jul 03 09:52:50.663065 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-f043e500-5f3b-4c72-b188-fc659a5e00c0 tempest-ProjectReaderTests33-761902925 None] Connected to sdf using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-44062477-adb9-4fe5-a2cb-600f263cd316', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '44062477-adb9-4fe5-a2cb-600f263cd316', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': False} {{(pid=101319) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}} Jul 03 09:52:51.665507 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.base [None req-f043e500-5f3b-4c72-b188-fc659a5e00c0 tempest-ProjectReaderTests33-761902925 None] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 2.150s {{(pid=101319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jul 03 09:52:51.665838 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-f043e500-5f3b-4c72-b188-fc659a5e00c0 tempest-ProjectReaderTests33-761902925 None] <== connect_volume: return (2151ms) {'type': 'block', 'scsi_wwn': '1StorPooliSCSI_DISK_1034578903445799212', 'path': '/dev/sdf'} {{(pid=101319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}} Jul 03 09:52:51.666254 np0000004400 cinder-backup[101319]: DEBUG oslo_concurrency.processutils [None req-f043e500-5f3b-4c72-b188-fc659a5e00c0 tempest-ProjectReaderTests33-761902925 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chown 1002 /dev/sdf {{(pid=101319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 09:52:51.688331 np0000004400 sudo[153658]: stack : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chown 1002 /dev/sdf Jul 03 09:52:51.689077 np0000004400 sudo[153658]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1002) Jul 03 09:52:51.986530 np0000004400 sudo[153658]: pam_unix(sudo:session): session closed for user root Jul 03 09:52:51.988640 np0000004400 cinder-backup[101319]: DEBUG oslo_concurrency.processutils [None req-f043e500-5f3b-4c72-b188-fc659a5e00c0 tempest-ProjectReaderTests33-761902925 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chown 1002 /dev/sdf" returned: 0 in 0.322s {{(pid=101319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 09:52:52.035930 np0000004400 cinder-backup[101319]: DEBUG oslo_db.sqlalchemy.engines [None req-f043e500-5f3b-4c72-b188-fc659a5e00c0 tempest-ProjectReaderTests33-761902925 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=101319) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 03 09:52:52.042011 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-f043e500-5f3b-4c72-b188-fc659a5e00c0 tempest-ProjectReaderTests33-761902925 None] _create_container started, container: volumebackups,backup: 6624fbb5-b72a-4c4d-bc8d-5f32665a951a. {{(pid=101319) _create_container /opt/stack/cinder/cinder/backup/chunkeddriver.py:249}} Jul 03 09:52:52.215627 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.drivers.swift [None req-f043e500-5f3b-4c72-b188-fc659a5e00c0 tempest-ProjectReaderTests33-761902925 None] generate_object_name_prefix: volume_44062477-adb9-4fe5-a2cb-600f263cd316/20260703095252/az_nova_backup_6624fbb5-b72a-4c4d-bc8d-5f32665a951a {{(pid=101319) _generate_object_name_prefix /opt/stack/cinder/cinder/backup/drivers/swift.py:452}} Jul 03 09:52:52.220103 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-f043e500-5f3b-4c72-b188-fc659a5e00c0 tempest-ProjectReaderTests33-761902925 None] starting backup of volume: 44062477-adb9-4fe5-a2cb-600f263cd316, volume size: 1073741824, object names prefix volume_44062477-adb9-4fe5-a2cb-600f263cd316/20260703095252/az_nova_backup_6624fbb5-b72a-4c4d-bc8d-5f32665a951a, availability zone: nova {{(pid=101319) _prepare_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:359}} Jul 03 09:52:52.435268 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-f043e500-5f3b-4c72-b188-fc659a5e00c0 tempest-ProjectReaderTests33-761902925 None] Backing up chunk of data from volume. {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 09:52:52.674956 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-f043e500-5f3b-4c72-b188-fc659a5e00c0 tempest-ProjectReaderTests33-761902925 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101319) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 09:52:52.675462 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-f043e500-5f3b-4c72-b188-fc659a5e00c0 tempest-ProjectReaderTests33-761902925 None] About to put_object {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 09:52:52.774651 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-f043e500-5f3b-4c72-b188-fc659a5e00c0 tempest-ProjectReaderTests33-761902925 None] backup MD5 for volume_44062477-adb9-4fe5-a2cb-600f263cd316/20260703095252/az_nova_backup_6624fbb5-b72a-4c4d-bc8d-5f32665a951a-00001: 25e317773f308e446cc84c503a6d1f85 {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 09:52:52.774823 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-f043e500-5f3b-4c72-b188-fc659a5e00c0 tempest-ProjectReaderTests33-761902925 None] Calling eventlet.sleep(0) {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 09:52:52.947026 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-f043e500-5f3b-4c72-b188-fc659a5e00c0 tempest-ProjectReaderTests33-761902925 None] Backing up chunk of data from volume. {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 09:52:53.191571 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-f043e500-5f3b-4c72-b188-fc659a5e00c0 tempest-ProjectReaderTests33-761902925 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101319) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 09:52:53.191777 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-f043e500-5f3b-4c72-b188-fc659a5e00c0 tempest-ProjectReaderTests33-761902925 None] About to put_object {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 09:52:53.300728 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-f043e500-5f3b-4c72-b188-fc659a5e00c0 tempest-ProjectReaderTests33-761902925 None] backup MD5 for volume_44062477-adb9-4fe5-a2cb-600f263cd316/20260703095252/az_nova_backup_6624fbb5-b72a-4c4d-bc8d-5f32665a951a-00002: 25e317773f308e446cc84c503a6d1f85 {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 09:52:53.300933 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-f043e500-5f3b-4c72-b188-fc659a5e00c0 tempest-ProjectReaderTests33-761902925 None] Calling eventlet.sleep(0) {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 09:52:53.512668 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-f043e500-5f3b-4c72-b188-fc659a5e00c0 tempest-ProjectReaderTests33-761902925 None] Backing up chunk of data from volume. {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 09:52:53.753830 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-f043e500-5f3b-4c72-b188-fc659a5e00c0 tempest-ProjectReaderTests33-761902925 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101319) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 09:52:53.754188 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-f043e500-5f3b-4c72-b188-fc659a5e00c0 tempest-ProjectReaderTests33-761902925 None] About to put_object {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 09:52:53.849894 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-f043e500-5f3b-4c72-b188-fc659a5e00c0 tempest-ProjectReaderTests33-761902925 None] backup MD5 for volume_44062477-adb9-4fe5-a2cb-600f263cd316/20260703095252/az_nova_backup_6624fbb5-b72a-4c4d-bc8d-5f32665a951a-00003: 25e317773f308e446cc84c503a6d1f85 {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 09:52:53.850091 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-f043e500-5f3b-4c72-b188-fc659a5e00c0 tempest-ProjectReaderTests33-761902925 None] Calling eventlet.sleep(0) {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 09:52:54.028341 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-f043e500-5f3b-4c72-b188-fc659a5e00c0 tempest-ProjectReaderTests33-761902925 None] Backing up chunk of data from volume. {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 09:52:54.268806 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-f043e500-5f3b-4c72-b188-fc659a5e00c0 tempest-ProjectReaderTests33-761902925 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101319) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 09:52:54.269004 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-f043e500-5f3b-4c72-b188-fc659a5e00c0 tempest-ProjectReaderTests33-761902925 None] About to put_object {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 09:52:54.377697 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-f043e500-5f3b-4c72-b188-fc659a5e00c0 tempest-ProjectReaderTests33-761902925 None] backup MD5 for volume_44062477-adb9-4fe5-a2cb-600f263cd316/20260703095252/az_nova_backup_6624fbb5-b72a-4c4d-bc8d-5f32665a951a-00004: 25e317773f308e446cc84c503a6d1f85 {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 09:52:54.377882 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-f043e500-5f3b-4c72-b188-fc659a5e00c0 tempest-ProjectReaderTests33-761902925 None] Calling eventlet.sleep(0) {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 09:52:54.578022 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-f043e500-5f3b-4c72-b188-fc659a5e00c0 tempest-ProjectReaderTests33-761902925 None] Backing up chunk of data from volume. {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 09:52:54.818398 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-f043e500-5f3b-4c72-b188-fc659a5e00c0 tempest-ProjectReaderTests33-761902925 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101319) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 09:52:54.818898 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-f043e500-5f3b-4c72-b188-fc659a5e00c0 tempest-ProjectReaderTests33-761902925 None] About to put_object {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 09:52:54.915028 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-f043e500-5f3b-4c72-b188-fc659a5e00c0 tempest-ProjectReaderTests33-761902925 None] backup MD5 for volume_44062477-adb9-4fe5-a2cb-600f263cd316/20260703095252/az_nova_backup_6624fbb5-b72a-4c4d-bc8d-5f32665a951a-00005: 25e317773f308e446cc84c503a6d1f85 {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 09:52:54.915192 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-f043e500-5f3b-4c72-b188-fc659a5e00c0 tempest-ProjectReaderTests33-761902925 None] Calling eventlet.sleep(0) {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 09:52:55.110032 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-f043e500-5f3b-4c72-b188-fc659a5e00c0 tempest-ProjectReaderTests33-761902925 None] Backing up chunk of data from volume. {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 09:52:55.364783 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-f043e500-5f3b-4c72-b188-fc659a5e00c0 tempest-ProjectReaderTests33-761902925 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101319) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 09:52:55.365006 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-f043e500-5f3b-4c72-b188-fc659a5e00c0 tempest-ProjectReaderTests33-761902925 None] About to put_object {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 09:52:55.463296 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-f043e500-5f3b-4c72-b188-fc659a5e00c0 tempest-ProjectReaderTests33-761902925 None] backup MD5 for volume_44062477-adb9-4fe5-a2cb-600f263cd316/20260703095252/az_nova_backup_6624fbb5-b72a-4c4d-bc8d-5f32665a951a-00006: 25e317773f308e446cc84c503a6d1f85 {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 09:52:55.463519 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-f043e500-5f3b-4c72-b188-fc659a5e00c0 tempest-ProjectReaderTests33-761902925 None] Calling eventlet.sleep(0) {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 09:52:55.632183 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-f043e500-5f3b-4c72-b188-fc659a5e00c0 tempest-ProjectReaderTests33-761902925 None] Backing up chunk of data from volume. {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 09:52:55.875752 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-f043e500-5f3b-4c72-b188-fc659a5e00c0 tempest-ProjectReaderTests33-761902925 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101319) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 09:52:55.876237 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-f043e500-5f3b-4c72-b188-fc659a5e00c0 tempest-ProjectReaderTests33-761902925 None] About to put_object {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 09:52:55.972634 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-f043e500-5f3b-4c72-b188-fc659a5e00c0 tempest-ProjectReaderTests33-761902925 None] backup MD5 for volume_44062477-adb9-4fe5-a2cb-600f263cd316/20260703095252/az_nova_backup_6624fbb5-b72a-4c4d-bc8d-5f32665a951a-00007: 25e317773f308e446cc84c503a6d1f85 {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 09:52:55.972840 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-f043e500-5f3b-4c72-b188-fc659a5e00c0 tempest-ProjectReaderTests33-761902925 None] Calling eventlet.sleep(0) {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 09:52:56.176044 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-f043e500-5f3b-4c72-b188-fc659a5e00c0 tempest-ProjectReaderTests33-761902925 None] Backing up chunk of data from volume. {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 09:52:56.432459 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-f043e500-5f3b-4c72-b188-fc659a5e00c0 tempest-ProjectReaderTests33-761902925 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101319) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 09:52:56.432613 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-f043e500-5f3b-4c72-b188-fc659a5e00c0 tempest-ProjectReaderTests33-761902925 None] About to put_object {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 09:52:56.541373 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-f043e500-5f3b-4c72-b188-fc659a5e00c0 tempest-ProjectReaderTests33-761902925 None] backup MD5 for volume_44062477-adb9-4fe5-a2cb-600f263cd316/20260703095252/az_nova_backup_6624fbb5-b72a-4c4d-bc8d-5f32665a951a-00008: 25e317773f308e446cc84c503a6d1f85 {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 09:52:56.541373 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-f043e500-5f3b-4c72-b188-fc659a5e00c0 tempest-ProjectReaderTests33-761902925 None] Calling eventlet.sleep(0) {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 09:52:56.800672 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-f043e500-5f3b-4c72-b188-fc659a5e00c0 tempest-ProjectReaderTests33-761902925 None] Backing up chunk of data from volume. {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 09:52:57.054280 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-f043e500-5f3b-4c72-b188-fc659a5e00c0 tempest-ProjectReaderTests33-761902925 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101319) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 09:52:57.054814 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-f043e500-5f3b-4c72-b188-fc659a5e00c0 tempest-ProjectReaderTests33-761902925 None] About to put_object {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 09:52:57.156468 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-f043e500-5f3b-4c72-b188-fc659a5e00c0 tempest-ProjectReaderTests33-761902925 None] backup MD5 for volume_44062477-adb9-4fe5-a2cb-600f263cd316/20260703095252/az_nova_backup_6624fbb5-b72a-4c4d-bc8d-5f32665a951a-00009: 25e317773f308e446cc84c503a6d1f85 {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 09:52:57.156606 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-f043e500-5f3b-4c72-b188-fc659a5e00c0 tempest-ProjectReaderTests33-761902925 None] Calling eventlet.sleep(0) {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 09:52:57.348143 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-f043e500-5f3b-4c72-b188-fc659a5e00c0 tempest-ProjectReaderTests33-761902925 None] Backing up chunk of data from volume. {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 09:52:57.608633 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-f043e500-5f3b-4c72-b188-fc659a5e00c0 tempest-ProjectReaderTests33-761902925 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101319) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 09:52:57.608815 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-f043e500-5f3b-4c72-b188-fc659a5e00c0 tempest-ProjectReaderTests33-761902925 None] About to put_object {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 09:52:57.712223 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-f043e500-5f3b-4c72-b188-fc659a5e00c0 tempest-ProjectReaderTests33-761902925 None] backup MD5 for volume_44062477-adb9-4fe5-a2cb-600f263cd316/20260703095252/az_nova_backup_6624fbb5-b72a-4c4d-bc8d-5f32665a951a-00010: 25e317773f308e446cc84c503a6d1f85 {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 09:52:57.712399 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-f043e500-5f3b-4c72-b188-fc659a5e00c0 tempest-ProjectReaderTests33-761902925 None] Calling eventlet.sleep(0) {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 09:52:57.900944 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-f043e500-5f3b-4c72-b188-fc659a5e00c0 tempest-ProjectReaderTests33-761902925 None] Backing up chunk of data from volume. {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 09:52:58.150854 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-f043e500-5f3b-4c72-b188-fc659a5e00c0 tempest-ProjectReaderTests33-761902925 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101319) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 09:52:58.151301 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-f043e500-5f3b-4c72-b188-fc659a5e00c0 tempest-ProjectReaderTests33-761902925 None] About to put_object {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 09:52:58.257341 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-f043e500-5f3b-4c72-b188-fc659a5e00c0 tempest-ProjectReaderTests33-761902925 None] backup MD5 for volume_44062477-adb9-4fe5-a2cb-600f263cd316/20260703095252/az_nova_backup_6624fbb5-b72a-4c4d-bc8d-5f32665a951a-00011: 25e317773f308e446cc84c503a6d1f85 {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 09:52:58.257486 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-f043e500-5f3b-4c72-b188-fc659a5e00c0 tempest-ProjectReaderTests33-761902925 None] Calling eventlet.sleep(0) {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 09:52:58.437191 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-f043e500-5f3b-4c72-b188-fc659a5e00c0 tempest-ProjectReaderTests33-761902925 None] Backing up chunk of data from volume. {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 09:52:58.678715 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-f043e500-5f3b-4c72-b188-fc659a5e00c0 tempest-ProjectReaderTests33-761902925 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101319) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 09:52:58.678885 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-f043e500-5f3b-4c72-b188-fc659a5e00c0 tempest-ProjectReaderTests33-761902925 None] About to put_object {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 09:52:58.783692 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-f043e500-5f3b-4c72-b188-fc659a5e00c0 tempest-ProjectReaderTests33-761902925 None] backup MD5 for volume_44062477-adb9-4fe5-a2cb-600f263cd316/20260703095252/az_nova_backup_6624fbb5-b72a-4c4d-bc8d-5f32665a951a-00012: 25e317773f308e446cc84c503a6d1f85 {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 09:52:58.783798 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-f043e500-5f3b-4c72-b188-fc659a5e00c0 tempest-ProjectReaderTests33-761902925 None] Calling eventlet.sleep(0) {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 09:52:59.030116 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-f043e500-5f3b-4c72-b188-fc659a5e00c0 tempest-ProjectReaderTests33-761902925 None] Backing up chunk of data from volume. {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 09:52:59.280398 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-f043e500-5f3b-4c72-b188-fc659a5e00c0 tempest-ProjectReaderTests33-761902925 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101319) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 09:52:59.280814 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-f043e500-5f3b-4c72-b188-fc659a5e00c0 tempest-ProjectReaderTests33-761902925 None] About to put_object {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 09:52:59.393453 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-f043e500-5f3b-4c72-b188-fc659a5e00c0 tempest-ProjectReaderTests33-761902925 None] backup MD5 for volume_44062477-adb9-4fe5-a2cb-600f263cd316/20260703095252/az_nova_backup_6624fbb5-b72a-4c4d-bc8d-5f32665a951a-00013: 25e317773f308e446cc84c503a6d1f85 {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 09:52:59.394124 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-f043e500-5f3b-4c72-b188-fc659a5e00c0 tempest-ProjectReaderTests33-761902925 None] Calling eventlet.sleep(0) {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 09:52:59.582909 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-f043e500-5f3b-4c72-b188-fc659a5e00c0 tempest-ProjectReaderTests33-761902925 None] Backing up chunk of data from volume. {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 09:52:59.835245 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-f043e500-5f3b-4c72-b188-fc659a5e00c0 tempest-ProjectReaderTests33-761902925 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101319) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 09:52:59.835364 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-f043e500-5f3b-4c72-b188-fc659a5e00c0 tempest-ProjectReaderTests33-761902925 None] About to put_object {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 09:52:59.982495 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-f043e500-5f3b-4c72-b188-fc659a5e00c0 tempest-ProjectReaderTests33-761902925 None] backup MD5 for volume_44062477-adb9-4fe5-a2cb-600f263cd316/20260703095252/az_nova_backup_6624fbb5-b72a-4c4d-bc8d-5f32665a951a-00014: 25e317773f308e446cc84c503a6d1f85 {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 09:52:59.982495 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-f043e500-5f3b-4c72-b188-fc659a5e00c0 tempest-ProjectReaderTests33-761902925 None] Calling eventlet.sleep(0) {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 09:53:00.157246 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-f043e500-5f3b-4c72-b188-fc659a5e00c0 tempest-ProjectReaderTests33-761902925 None] Backing up chunk of data from volume. {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 09:53:00.410340 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-f043e500-5f3b-4c72-b188-fc659a5e00c0 tempest-ProjectReaderTests33-761902925 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101319) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 09:53:00.410340 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-f043e500-5f3b-4c72-b188-fc659a5e00c0 tempest-ProjectReaderTests33-761902925 None] About to put_object {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 09:53:00.529823 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-f043e500-5f3b-4c72-b188-fc659a5e00c0 tempest-ProjectReaderTests33-761902925 None] backup MD5 for volume_44062477-adb9-4fe5-a2cb-600f263cd316/20260703095252/az_nova_backup_6624fbb5-b72a-4c4d-bc8d-5f32665a951a-00015: 25e317773f308e446cc84c503a6d1f85 {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 09:53:00.530005 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-f043e500-5f3b-4c72-b188-fc659a5e00c0 tempest-ProjectReaderTests33-761902925 None] Calling eventlet.sleep(0) {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 09:53:00.729965 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-f043e500-5f3b-4c72-b188-fc659a5e00c0 tempest-ProjectReaderTests33-761902925 None] Backing up chunk of data from volume. {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 09:53:00.978683 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-f043e500-5f3b-4c72-b188-fc659a5e00c0 tempest-ProjectReaderTests33-761902925 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101319) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 09:53:00.978683 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-f043e500-5f3b-4c72-b188-fc659a5e00c0 tempest-ProjectReaderTests33-761902925 None] About to put_object {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 09:53:01.082020 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-f043e500-5f3b-4c72-b188-fc659a5e00c0 tempest-ProjectReaderTests33-761902925 None] backup MD5 for volume_44062477-adb9-4fe5-a2cb-600f263cd316/20260703095252/az_nova_backup_6624fbb5-b72a-4c4d-bc8d-5f32665a951a-00016: 25e317773f308e446cc84c503a6d1f85 {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 09:53:01.082020 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-f043e500-5f3b-4c72-b188-fc659a5e00c0 tempest-ProjectReaderTests33-761902925 None] Calling eventlet.sleep(0) {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 09:53:01.278440 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-f043e500-5f3b-4c72-b188-fc659a5e00c0 tempest-ProjectReaderTests33-761902925 None] Backing up chunk of data from volume. {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 09:53:01.529997 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-f043e500-5f3b-4c72-b188-fc659a5e00c0 tempest-ProjectReaderTests33-761902925 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101319) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 09:53:01.530586 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-f043e500-5f3b-4c72-b188-fc659a5e00c0 tempest-ProjectReaderTests33-761902925 None] About to put_object {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 09:53:01.632694 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-f043e500-5f3b-4c72-b188-fc659a5e00c0 tempest-ProjectReaderTests33-761902925 None] backup MD5 for volume_44062477-adb9-4fe5-a2cb-600f263cd316/20260703095252/az_nova_backup_6624fbb5-b72a-4c4d-bc8d-5f32665a951a-00017: 25e317773f308e446cc84c503a6d1f85 {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 09:53:01.632694 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-f043e500-5f3b-4c72-b188-fc659a5e00c0 tempest-ProjectReaderTests33-761902925 None] Calling eventlet.sleep(0) {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 09:53:01.633889 np0000004400 cinder-backup[101319]: DEBUG dbcounter [-] [101319] Writing DB stats cinder:SELECT=98,cinder:UPDATE=28,cinder:INSERT=4 {{(pid=101319) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 03 09:53:01.803625 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-f043e500-5f3b-4c72-b188-fc659a5e00c0 tempest-ProjectReaderTests33-761902925 None] Backing up chunk of data from volume. {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 09:53:02.044476 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-f043e500-5f3b-4c72-b188-fc659a5e00c0 tempest-ProjectReaderTests33-761902925 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101319) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 09:53:02.044586 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-f043e500-5f3b-4c72-b188-fc659a5e00c0 tempest-ProjectReaderTests33-761902925 None] About to put_object {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 09:53:02.143244 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-f043e500-5f3b-4c72-b188-fc659a5e00c0 tempest-ProjectReaderTests33-761902925 None] backup MD5 for volume_44062477-adb9-4fe5-a2cb-600f263cd316/20260703095252/az_nova_backup_6624fbb5-b72a-4c4d-bc8d-5f32665a951a-00018: 25e317773f308e446cc84c503a6d1f85 {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 09:53:02.143439 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-f043e500-5f3b-4c72-b188-fc659a5e00c0 tempest-ProjectReaderTests33-761902925 None] Calling eventlet.sleep(0) {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 09:53:02.200425 np0000004400 cinder-backup[101319]: INFO cinder.backup.manager [None req-86249081-dcdf-44d7-a2b2-6285d268a4bd tempest-VolumesBackupsTest-1484886458 None] Create backup started, backup: dddedc88-ea25-4f5d-b989-944d0094b292 volume: bb206076-56d3-4255-8607-10b3ef732cbb. Jul 03 09:53:02.206050 np0000004400 cinder-backup[101319]: INFO cinder.backup.manager [None req-86249081-dcdf-44d7-a2b2-6285d268a4bd tempest-VolumesBackupsTest-1484886458 None] Call Volume Manager to get_backup_device for Backup(availability_zone='nova',container=None,created_at=2026-07-03T09:53:02Z,data_timestamp=2026-07-03T09:53:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesBackupsTest-Backup-1752604285',encryption_key_id=None,fail_reason=None,host='np0000004400',id=dddedc88-ea25-4f5d-b989-944d0094b292,metadata={},num_dependent_backups=0,object_count=0,parent=None,parent_id=None,project_id='c36863fd49104594b80b419fafd78f5c',restore_volume_id=None,service='cinder.backup.drivers.swift.SwiftBackupDriver',service_metadata=None,size=1,snapshot_id=None,status='creating',temp_snapshot_id=None,temp_volume_id=None,updated_at=None,user_id='e3b8ecc8212649f489f39b74eac8ff8f',volume_id=bb206076-56d3-4255-8607-10b3ef732cbb) Jul 03 09:53:02.234081 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.drivers.swift [None req-86249081-dcdf-44d7-a2b2-6285d268a4bd tempest-VolumesBackupsTest-1484886458 None] Using swift URL https://10.4.3.95:8080/v1/AUTH_c36863fd49104594b80b419fafd78f5c {{(pid=101319) initialize /opt/stack/cinder/cinder/backup/drivers/swift.py:300}} Jul 03 09:53:02.234605 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.drivers.swift [None req-86249081-dcdf-44d7-a2b2-6285d268a4bd tempest-VolumesBackupsTest-1484886458 None] Connect to https://10.4.3.95:8080/v1/AUTH_ in "per_user" mode {{(pid=101319) initialize /opt/stack/cinder/cinder/backup/drivers/swift.py:301}} Jul 03 09:53:02.234986 np0000004400 cinder-backup[101319]: DEBUG os_brick.utils [None req-86249081-dcdf-44d7-a2b2-6285d268a4bd tempest-VolumesBackupsTest-1484886458 None] ==> get_connector_properties: call "{'root_helper': 'sudo cinder-rootwrap /etc/cinder/rootwrap.conf', 'my_ip': '10.4.3.95', 'multipath': False, 'enforce_multipath': False, 'host': None, 'execute': None}" {{(pid=101319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}} Jul 03 09:53:02.246337 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.scaleio [None req-86249081-dcdf-44d7-a2b2-6285d268a4bd tempest-VolumesBackupsTest-1484886458 None] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=101319) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}} Jul 03 09:53:02.265233 np0000004400 cinder-backup[101319]: DEBUG oslo_concurrency.processutils [None req-86249081-dcdf-44d7-a2b2-6285d268a4bd tempest-VolumesBackupsTest-1484886458 None] Running cmd (subprocess): nvme version {{(pid=101319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 09:53:02.281551 np0000004400 cinder-backup[101319]: DEBUG oslo_concurrency.processutils [None req-86249081-dcdf-44d7-a2b2-6285d268a4bd tempest-VolumesBackupsTest-1484886458 None] 'nvme version' failed. Not Retrying. {{(pid=101319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 03 09:53:02.281840 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.nvmeof [None req-86249081-dcdf-44d7-a2b2-6285d268a4bd tempest-VolumesBackupsTest-1484886458 None] nvme not present on system {{(pid=101319) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}} Jul 03 09:53:02.288833 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.lightos [None req-86249081-dcdf-44d7-a2b2-6285d268a4bd tempest-VolumesBackupsTest-1484886458 None] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=101319) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}} Jul 03 09:53:02.289813 np0000004400 cinder-backup[101319]: INFO os_brick.initiator.connectors.lightos [None req-86249081-dcdf-44d7-a2b2-6285d268a4bd tempest-VolumesBackupsTest-1484886458 None] Current host hostNQN and IP(s) are ['10.4.3.95', 'fe80::f816:3eff:fe47:268c', '192.168.40.6', 'fe80::f816:3eff:febf:7be2', '192.168.50.6', 'fe80::f816:3eff:fe99:8914', '192.168.10.6', 'fe80::f816:3eff:fe2f:e696', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::bc9d:84ff:fec2:6b49', 'fe80::fc16:3eff:fe13:9420', 'fe80::8cea:42ff:fe99:b64a', 'fe80::fc16:3eff:feaa:206b', 'fe80::74a1:e1ff:fe2f:1924'] Jul 03 09:53:02.289950 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.lightos [None req-86249081-dcdf-44d7-a2b2-6285d268a4bd tempest-VolumesBackupsTest-1484886458 None] LIGHTOS: did not find dsc, continuing anyway. {{(pid=101319) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}} Jul 03 09:53:02.290073 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.lightos [None req-86249081-dcdf-44d7-a2b2-6285d268a4bd tempest-VolumesBackupsTest-1484886458 None] LIGHTOS: no hostnqn found. {{(pid=101319) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}} Jul 03 09:53:02.290302 np0000004400 cinder-backup[101319]: DEBUG os_brick.utils [None req-86249081-dcdf-44d7-a2b2-6285d268a4bd tempest-VolumesBackupsTest-1484886458 None] <== get_connector_properties: return (55ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.95', 'host': 'np0000004400', 'multipath': False, 'enforce_multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:ae7e5bb0ebe6', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': '6b284368-d0ba-4d18-af6f-4998d3955c52', 'nvme_native_multipath': False} {{(pid=101319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}} Jul 03 09:53:02.367058 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-f043e500-5f3b-4c72-b188-fc659a5e00c0 tempest-ProjectReaderTests33-761902925 None] Backing up chunk of data from volume. {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 09:53:02.605262 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-f043e500-5f3b-4c72-b188-fc659a5e00c0 tempest-ProjectReaderTests33-761902925 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101319) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 09:53:02.605814 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-f043e500-5f3b-4c72-b188-fc659a5e00c0 tempest-ProjectReaderTests33-761902925 None] About to put_object {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 09:53:02.706986 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-f043e500-5f3b-4c72-b188-fc659a5e00c0 tempest-ProjectReaderTests33-761902925 None] backup MD5 for volume_44062477-adb9-4fe5-a2cb-600f263cd316/20260703095252/az_nova_backup_6624fbb5-b72a-4c4d-bc8d-5f32665a951a-00019: 25e317773f308e446cc84c503a6d1f85 {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 09:53:02.707110 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-f043e500-5f3b-4c72-b188-fc659a5e00c0 tempest-ProjectReaderTests33-761902925 None] Calling eventlet.sleep(0) {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 09:53:02.741491 np0000004400 cinder-backup[101319]: DEBUG oslo_db.sqlalchemy.engines [None req-f043e500-5f3b-4c72-b188-fc659a5e00c0 tempest-ProjectReaderTests33-761902925 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=101319) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 03 09:53:02.797885 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connector [None req-86249081-dcdf-44d7-a2b2-6285d268a4bd tempest-VolumesBackupsTest-1484886458 None] Factory for iscsi on None {{(pid=101319) factory /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connector.py:243}} Jul 03 09:53:02.798552 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-86249081-dcdf-44d7-a2b2-6285d268a4bd tempest-VolumesBackupsTest-1484886458 None] ==> connect_volume: call "{'self': , 'connection_properties': {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-bb206076-56d3-4255-8607-10b3ef732cbb', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'bb206076-56d3-4255-8607-10b3ef732cbb', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': False}}" {{(pid=101319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}} Jul 03 09:53:02.799204 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.base [None req-86249081-dcdf-44d7-a2b2-6285d268a4bd tempest-VolumesBackupsTest-1484886458 None] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=101319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jul 03 09:53:02.927426 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-f043e500-5f3b-4c72-b188-fc659a5e00c0 tempest-ProjectReaderTests33-761902925 None] Backing up chunk of data from volume. {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 09:53:03.162229 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-f043e500-5f3b-4c72-b188-fc659a5e00c0 tempest-ProjectReaderTests33-761902925 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101319) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 09:53:03.162370 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-f043e500-5f3b-4c72-b188-fc659a5e00c0 tempest-ProjectReaderTests33-761902925 None] About to put_object {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 09:53:03.272756 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-f043e500-5f3b-4c72-b188-fc659a5e00c0 tempest-ProjectReaderTests33-761902925 None] backup MD5 for volume_44062477-adb9-4fe5-a2cb-600f263cd316/20260703095252/az_nova_backup_6624fbb5-b72a-4c4d-bc8d-5f32665a951a-00020: 25e317773f308e446cc84c503a6d1f85 {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 09:53:03.273012 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-f043e500-5f3b-4c72-b188-fc659a5e00c0 tempest-ProjectReaderTests33-761902925 None] Calling eventlet.sleep(0) {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 09:53:03.362804 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-f043e500-5f3b-4c72-b188-fc659a5e00c0 tempest-ProjectReaderTests33-761902925 None] Backing up chunk of data from volume. {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 09:53:03.457395 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.base [None req-86249081-dcdf-44d7-a2b2-6285d268a4bd tempest-VolumesBackupsTest-1484886458 None] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.659s {{(pid=101319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jul 03 09:53:03.457660 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.base [None req-86249081-dcdf-44d7-a2b2-6285d268a4bd tempest-VolumesBackupsTest-1484886458 None] Connection properties {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-bb206076-56d3-4255-8607-10b3ef732cbb', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'bb206076-56d3-4255-8607-10b3ef732cbb', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': False} {{(pid=101319) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}} Jul 03 09:53:03.469081 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.base [None req-86249081-dcdf-44d7-a2b2-6285d268a4bd tempest-VolumesBackupsTest-1484886458 None] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-bb206076-56d3-4255-8607-10b3ef732cbb" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=101319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jul 03 09:53:03.469466 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.base [None req-86249081-dcdf-44d7-a2b2-6285d268a4bd tempest-VolumesBackupsTest-1484886458 None] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-bb206076-56d3-4255-8607-10b3ef732cbb" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.000s {{(pid=101319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jul 03 09:53:03.469651 np0000004400 cinder-backup[101319]: INFO os_brick.initiator.connectors.iscsi [None req-86249081-dcdf-44d7-a2b2-6285d268a4bd tempest-VolumesBackupsTest-1484886458 None] Trying to connect to iSCSI portal 192.168.40.100:3260 Jul 03 09:53:03.479591 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-86249081-dcdf-44d7-a2b2-6285d268a4bd tempest-VolumesBackupsTest-1484886458 None] iscsiadm (): stdout= stderr=iscsiadm: No records found Jul 03 09:53:03.479591 np0000004400 cinder-backup[101319]: {{(pid=101319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 03 09:53:03.488494 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-f043e500-5f3b-4c72-b188-fc659a5e00c0 tempest-ProjectReaderTests33-761902925 None] Compressed 25165824 bytes of data to 24470 bytes using zlib. {{(pid=101319) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 09:53:03.488637 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-f043e500-5f3b-4c72-b188-fc659a5e00c0 tempest-ProjectReaderTests33-761902925 None] About to put_object {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 09:53:03.491556 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-86249081-dcdf-44d7-a2b2-6285d268a4bd tempest-VolumesBackupsTest-1484886458 None] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-bb206076-56d3-4255-8607-10b3ef732cbb] added Jul 03 09:53:03.491556 np0000004400 cinder-backup[101319]: stderr=iscsiadm: Config file line 363 does not have value Jul 03 09:53:03.491556 np0000004400 cinder-backup[101319]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs' Jul 03 09:53:03.491556 np0000004400 cinder-backup[101319]: iscsiadm: Config file line 363 does not have value Jul 03 09:53:03.491556 np0000004400 cinder-backup[101319]: iscsiadm: Config file line 363 does not have value Jul 03 09:53:03.491556 np0000004400 cinder-backup[101319]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs' Jul 03 09:53:03.491556 np0000004400 cinder-backup[101319]: {{(pid=101319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 03 09:53:03.491779 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-86249081-dcdf-44d7-a2b2-6285d268a4bd tempest-VolumesBackupsTest-1484886458 None] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=101319) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}} Jul 03 09:53:03.492175 np0000004400 cinder-backup[101319]: DEBUG os_brick.utils [None req-86249081-dcdf-44d7-a2b2-6285d268a4bd tempest-VolumesBackupsTest-1484886458 None] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0224(s), this was the 1st time calling it. {{(pid=101319) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}} Jul 03 09:53:03.492371 np0000004400 cinder-backup[101319]: DEBUG os_brick.utils [None req-86249081-dcdf-44d7-a2b2-6285d268a4bd tempest-VolumesBackupsTest-1484886458 None] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=101319) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}} Jul 03 09:53:03.552924 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-f043e500-5f3b-4c72-b188-fc659a5e00c0 tempest-ProjectReaderTests33-761902925 None] backup MD5 for volume_44062477-adb9-4fe5-a2cb-600f263cd316/20260703095252/az_nova_backup_6624fbb5-b72a-4c4d-bc8d-5f32665a951a-00021: 77377273b0a4b61febdbf7bbf52b9db9 {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 09:53:03.552924 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-f043e500-5f3b-4c72-b188-fc659a5e00c0 tempest-ProjectReaderTests33-761902925 None] Calling eventlet.sleep(0) {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 09:53:03.562709 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.driver [None req-f043e500-5f3b-4c72-b188-fc659a5e00c0 tempest-ProjectReaderTests33-761902925 None] Getting metadata type 'volume-base-metadata' {{(pid=101319) _save_vol_base_meta /opt/stack/cinder/cinder/backup/driver.py:79}} Jul 03 09:53:03.571723 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.driver [None req-f043e500-5f3b-4c72-b188-fc659a5e00c0 tempest-ProjectReaderTests33-761902925 None] Completed fetching metadata type 'volume-base-metadata' {{(pid=101319) _save_vol_base_meta /opt/stack/cinder/cinder/backup/driver.py:98}} Jul 03 09:53:03.571928 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.driver [None req-f043e500-5f3b-4c72-b188-fc659a5e00c0 tempest-ProjectReaderTests33-761902925 None] Getting metadata type 'volume-metadata' {{(pid=101319) _save_vol_meta /opt/stack/cinder/cinder/backup/driver.py:109}} Jul 03 09:53:03.575735 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.driver [None req-f043e500-5f3b-4c72-b188-fc659a5e00c0 tempest-ProjectReaderTests33-761902925 None] No metadata type 'volume-metadata' available {{(pid=101319) _save_vol_meta /opt/stack/cinder/cinder/backup/driver.py:123}} Jul 03 09:53:03.575907 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.driver [None req-f043e500-5f3b-4c72-b188-fc659a5e00c0 tempest-ProjectReaderTests33-761902925 None] Getting metadata type 'volume-glance-metadata' {{(pid=101319) _save_vol_glance_meta /opt/stack/cinder/cinder/backup/driver.py:132}} Jul 03 09:53:03.578613 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.driver [None req-f043e500-5f3b-4c72-b188-fc659a5e00c0 tempest-ProjectReaderTests33-761902925 None] No metadata type 'volume-glance-metadata' available {{(pid=101319) _save_vol_glance_meta /opt/stack/cinder/cinder/backup/driver.py:147}} Jul 03 09:53:03.578868 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-f043e500-5f3b-4c72-b188-fc659a5e00c0 tempest-ProjectReaderTests33-761902925 None] _write_sha256file started, container name: volumebackups, sha256file filename: volume_44062477-adb9-4fe5-a2cb-600f263cd316/20260703095252/az_nova_backup_6624fbb5-b72a-4c4d-bc8d-5f32665a951a_sha256file. {{(pid=101319) _write_sha256file /opt/stack/cinder/cinder/backup/chunkeddriver.py:299}} Jul 03 09:53:03.635283 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-f043e500-5f3b-4c72-b188-fc659a5e00c0 tempest-ProjectReaderTests33-761902925 None] _write_sha256file finished. {{(pid=101319) _write_sha256file /opt/stack/cinder/cinder/backup/chunkeddriver.py:315}} Jul 03 09:53:03.635979 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-f043e500-5f3b-4c72-b188-fc659a5e00c0 tempest-ProjectReaderTests33-761902925 None] _write_metadata started, container name: volumebackups, metadata filename: volume_44062477-adb9-4fe5-a2cb-600f263cd316/20260703095252/az_nova_backup_6624fbb5-b72a-4c4d-bc8d-5f32665a951a_metadata. {{(pid=101319) _write_metadata /opt/stack/cinder/cinder/backup/chunkeddriver.py:276}} Jul 03 09:53:03.658100 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-f043e500-5f3b-4c72-b188-fc659a5e00c0 tempest-ProjectReaderTests33-761902925 None] _write_metadata finished. Metadata: b'{\n "backup_description": null,\n "backup_id": "6624fbb5-b72a-4c4d-bc8d-5f32665a951a",\n "backup_name": "tempest-type-Backup-1542251835",\n "created_at": "2026-07-03 09:52:49+00:00",\n "objects": [\n {\n "volume_44062477-adb9-4fe5-a2cb-600f263cd316/20260703095252/az_nova_backup_6624fbb5-b72a-4c4d-bc8d-5f32665a951a-00001": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 0\n }\n },\n {\n "volume_44062477-adb9-4fe5-a2cb-600f263cd316/20260703095252/az_nova_backup_6624fbb5-b72a-4c4d-bc8d-5f32665a951a-00002": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 52428800\n }\n },\n {\n "volume_44062477-adb9-4fe5-a2cb-600f263cd316/20260703095252/az_nova_backup_6624fbb5-b72a-4c4d-bc8d-5f32665a951a-00003": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 104857600\n }\n },\n {\n "volume_44062477-adb9-4fe5-a2cb-600f263cd316/20260703095252/az_nova_backup_6624fbb5-b72a-4c4d-bc8d-5f32665a951a-00004": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 157286400\n }\n },\n {\n "volume_44062477-adb9-4fe5-a2cb-600f263cd316/20260703095252/az_nova_backup_6624fbb5-b72a-4c4d-bc8d-5f32665a951a-00005": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 209715200\n }\n },\n {\n "volume_44062477-adb9-4fe5-a2cb-600f263cd316/20260703095252/az_nova_backup_6624fbb5-b72a-4c4d-bc8d-5f32665a951a-00006": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 262144000\n }\n },\n {\n "volume_44062477-adb9-4fe5-a2cb-600f263cd316/20260703095252/az_nova_backup_6624fbb5-b72a-4c4d-bc8d-5f32665a951a-00007": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 314572800\n }\n },\n {\n "volume_44062477-adb9-4fe5-a2cb-600f263cd316/20260703095252/az_nova_backup_6624fbb5-b72a-4c4d-bc8d-5f32665a951a-00008": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 367001600\n }\n },\n {\n "volume_44062477-adb9-4fe5-a2cb-600f263cd316/20260703095252/az_nova_backup_6624fbb5-b72a-4c4d-bc8d-5f32665a951a-00009": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 419430400\n }\n },\n {\n "volume_44062477-adb9-4fe5-a2cb-600f263cd316/20260703095252/az_nova_backup_6624fbb5-b72a-4c4d-bc8d-5f32665a951a-00010": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 471859200\n }\n },\n {\n "volume_44062477-adb9-4fe5-a2cb-600f263cd316/20260703095252/az_nova_backup_6624fbb5-b72a-4c4d-bc8d-5f32665a951a-00011": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 524288000\n }\n },\n {\n "volume_44062477-adb9-4fe5-a2cb-600f263cd316/20260703095252/az_nova_backup_6624fbb5-b72a-4c4d-bc8d-5f32665a951a-00012": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 576716800\n }\n },\n {\n "volume_44062477-adb9-4fe5-a2cb-600f263cd316/20260703095252/az_nova_backup_6624fbb5-b72a-4c4d-bc8d-5f32665a951a-00013": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 629145600\n }\n },\n {\n "volume_44062477-adb9-4fe5-a2cb-600f263cd316/20260703095252/az_nova_backup_6624fbb5-b72a-4c4d-bc8d-5f32665a951a-00014": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 681574400\n }\n },\n {\n "volume_44062477-adb9-4fe5-a2cb-600f263cd316/20260703095252/az_nova_backup_6624fbb5-b72a-4c4d-bc8d-5f32665a951a-00015": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 734003200\n }\n },\n {\n "volume_44062477-adb9-4fe5-a2cb-600f263cd316/20260703095252/az_nova_backup_6624fbb5-b72a-4c4d-bc8d-5f32665a951a-00016": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 786432000\n }\n },\n {\n "volume_44062477-adb9-4fe5-a2cb-600f263cd316/20260703095252/az_nova_backup_6624fbb5-b72a-4c4d-bc8d-5f32665a951a-00017": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 838860800\n }\n },\n {\n "volume_44062477-adb9-4fe5-a2cb-600f263cd316/20260703095252/az_nova_backup_6624fbb5-b72a-4c4d-bc8d-5f32665a951a-00018": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 891289600\n }\n },\n {\n "volume_44062477-adb9-4fe5-a2cb-600f263cd316/20260703095252/az_nova_backup_6624fbb5-b72a-4c4d-bc8d-5f32665a951a-00019": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 943718400\n }\n },\n {\n "volume_44062477-adb9-4fe5-a2cb-600f263cd316/20260703095252/az_nova_backup_6624fbb5-b72a-4c4d-bc8d-5f32665a951a-00020": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 996147200\n }\n },\n {\n "volume_44062477-adb9-4fe5-a2cb-600f263cd316/20260703095252/az_nova_backup_6624fbb5-b72a-4c4d-bc8d-5f32665a951a-00021": {\n "compression": "zlib",\n "length": 25165824,\n "md5": "77377273b0a4b61febdbf7bbf52b9db9",\n "offset": 1048576000\n }\n }\n ],\n "parent_id": null,\n "version": "1.0.0",\n "volume_id": "44062477-adb9-4fe5-a2cb-600f263cd316",\n "volume_meta": "{\\"version\\": 2, \\"volume-base-metadata\\": {\\"id\\": \\"44062477-adb9-4fe5-a2cb-600f263cd316\\", \\"_name_id\\": null, \\"use_quota\\": true, \\"ec2_id\\": null, \\"user_id\\": \\"45a99ff133014c9a8bfd931707d31606\\", \\"project_id\\": \\"e331bd155b824bbb8979e9aac5023870\\", \\"snapshot_id\\": null, \\"cluster_name\\": null, \\"host\\": \\"np0000004400@storpool#template_virtual\\", \\"size\\": 1, \\"availability_zone\\": \\"nova\\", \\"status\\": \\"backing-up\\", \\"attach_status\\": \\"detached\\", \\"migration_status\\": null, \\"scheduled_at\\": \\"2026-07-03T09:52:48.000000\\", \\"launched_at\\": \\"2026-07-03T09:52:48.000000\\", \\"terminated_at\\": null, \\"display_name\\": \\"tempest-VolumeV3RbacBaseTests-Volume-1184626621\\", \\"display_description\\": null, \\"provider_location\\": null, \\"provider_auth\\": null, \\"provider_geometry\\": null, \\"provider_id\\": null, \\"volume_type_id\\": \\"03e13fe6-0e30-4803-ace0-725d38e6dc24\\", \\"source_volid\\": null, \\"encryption_key_id\\": null, \\"consistencygroup_id\\": null, \\"group_id\\": null, \\"bootable\\": false, \\"multiattach\\": false, \\"replication_status\\": null, \\"replication_extended_status\\": null, \\"replication_driver_data\\": null, \\"previous_status\\": \\"available\\", \\"service_uuid\\": \\"6d4b0e79-fefe-4744-b25f-34be05095200\\", \\"shared_targets\\": true, \\"deleted_at\\": null, \\"deleted\\": false, \\"created_at\\": \\"2026-07-03T09:52:48.000000\\", \\"updated_at\\": \\"2026-07-03T09:52:49.000000\\"}}"\n}'. {{(pid=101319) _write_metadata /opt/stack/cinder/cinder/backup/chunkeddriver.py:295}} Jul 03 09:53:03.662797 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-f043e500-5f3b-4c72-b188-fc659a5e00c0 tempest-ProjectReaderTests33-761902925 None] backup 6624fbb5-b72a-4c4d-bc8d-5f32665a951a finished. {{(pid=101319) _finalize_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:462}} Jul 03 09:53:03.784697 np0000004400 cinder-backup[101319]: DEBUG oslo_concurrency.processutils [None req-f043e500-5f3b-4c72-b188-fc659a5e00c0 tempest-ProjectReaderTests33-761902925 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chown 0 /dev/sdf {{(pid=101319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 09:53:03.803039 np0000004400 sudo[153913]: stack : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chown 0 /dev/sdf Jul 03 09:53:03.803617 np0000004400 sudo[153913]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1002) Jul 03 09:53:04.099347 np0000004400 sudo[153913]: pam_unix(sudo:session): session closed for user root Jul 03 09:53:04.101563 np0000004400 cinder-backup[101319]: DEBUG oslo_concurrency.processutils [None req-f043e500-5f3b-4c72-b188-fc659a5e00c0 tempest-ProjectReaderTests33-761902925 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chown 0 /dev/sdf" returned: 0 in 0.317s {{(pid=101319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 09:53:04.102223 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-f043e500-5f3b-4c72-b188-fc659a5e00c0 tempest-ProjectReaderTests33-761902925 None] ==> disconnect_volume: call "{'args': (, {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-44062477-adb9-4fe5-a2cb-600f263cd316', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '44062477-adb9-4fe5-a2cb-600f263cd316', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': False}, {'type': 'block', 'scsi_wwn': '1StorPooliSCSI_DISK_1034578903445799212', 'path': '/dev/sdf'}), 'kwargs': {'force': True, 'ignore_errors': True}}" {{(pid=101319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}} Jul 03 09:53:04.102552 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.base [None req-f043e500-5f3b-4c72-b188-fc659a5e00c0 tempest-ProjectReaderTests33-761902925 None] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=101319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jul 03 09:53:04.493972 np0000004400 cinder-backup[101319]: INFO os_brick.initiator.connectors.iscsi [None req-86249081-dcdf-44d7-a2b2-6285d268a4bd tempest-VolumesBackupsTest-1484886458 None] Trying to connect to iSCSI portal 192.168.40.100:3260 Jul 03 09:53:04.505626 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-86249081-dcdf-44d7-a2b2-6285d268a4bd tempest-VolumesBackupsTest-1484886458 None] iscsiadm (): stdout=# BEGIN RECORD 2.1.9 Jul 03 09:53:04.505626 np0000004400 cinder-backup[101319]: node.name = iqn.2023-03.storpool.com:os--volume-bb206076-56d3-4255-8607-10b3ef732cbb Jul 03 09:53:04.505626 np0000004400 cinder-backup[101319]: node.tpgt = -1 Jul 03 09:53:04.505626 np0000004400 cinder-backup[101319]: node.startup = manual Jul 03 09:53:04.505626 np0000004400 cinder-backup[101319]: node.leading_login = No Jul 03 09:53:04.505626 np0000004400 cinder-backup[101319]: iface.iscsi_ifacename = default Jul 03 09:53:04.505626 np0000004400 cinder-backup[101319]: iface.net_ifacename = Jul 03 09:53:04.505626 np0000004400 cinder-backup[101319]: iface.ipaddress = Jul 03 09:53:04.505626 np0000004400 cinder-backup[101319]: iface.prefix_len = 0 Jul 03 09:53:04.505626 np0000004400 cinder-backup[101319]: iface.hwaddress = Jul 03 09:53:04.505626 np0000004400 cinder-backup[101319]: iface.transport_name = tcp Jul 03 09:53:04.505626 np0000004400 cinder-backup[101319]: iface.initiatorname = Jul 03 09:53:04.505626 np0000004400 cinder-backup[101319]: iface.state = Jul 03 09:53:04.505626 np0000004400 cinder-backup[101319]: iface.vlan_id = 0 Jul 03 09:53:04.505626 np0000004400 cinder-backup[101319]: iface.vlan_priority = 0 Jul 03 09:53:04.505626 np0000004400 cinder-backup[101319]: iface.vlan_state = Jul 03 09:53:04.505626 np0000004400 cinder-backup[101319]: iface.iface_num = 0 Jul 03 09:53:04.505626 np0000004400 cinder-backup[101319]: iface.mtu = 0 Jul 03 09:53:04.505626 np0000004400 cinder-backup[101319]: iface.port = 0 Jul 03 09:53:04.505626 np0000004400 cinder-backup[101319]: iface.bootproto = Jul 03 09:53:04.505626 np0000004400 cinder-backup[101319]: iface.subnet_mask = Jul 03 09:53:04.505626 np0000004400 cinder-backup[101319]: iface.gateway = Jul 03 09:53:04.505626 np0000004400 cinder-backup[101319]: iface.dhcp_alt_client_id_state = Jul 03 09:53:04.505626 np0000004400 cinder-backup[101319]: iface.dhcp_alt_client_id = Jul 03 09:53:04.505626 np0000004400 cinder-backup[101319]: iface.dhcp_dns = Jul 03 09:53:04.505626 np0000004400 cinder-backup[101319]: iface.dhcp_learn_iqn = Jul 03 09:53:04.505626 np0000004400 cinder-backup[101319]: iface.dhcp_req_vendor_id_state = Jul 03 09:53:04.505626 np0000004400 cinder-backup[101319]: iface.dhcp_vendor_id_state = Jul 03 09:53:04.505626 np0000004400 cinder-backup[101319]: iface.dhcp_vendor_id = Jul 03 09:53:04.505626 np0000004400 cinder-backup[101319]: iface.dhcp_slp_da = Jul 03 09:53:04.505626 np0000004400 cinder-backup[101319]: iface.fragmentation = Jul 03 09:53:04.505626 np0000004400 cinder-backup[101319]: iface.gratuitous_arp = Jul 03 09:53:04.505626 np0000004400 cinder-backup[101319]: iface.incoming_forwarding = Jul 03 09:53:04.505626 np0000004400 cinder-backup[101319]: iface.tos_state = Jul 03 09:53:04.505626 np0000004400 cinder-backup[101319]: iface.tos = 0 Jul 03 09:53:04.505626 np0000004400 cinder-backup[101319]: iface.ttl = 0 Jul 03 09:53:04.505626 np0000004400 cinder-backup[101319]: iface.delayed_ack = Jul 03 09:53:04.505626 np0000004400 cinder-backup[101319]: iface.tcp_nagle = Jul 03 09:53:04.505626 np0000004400 cinder-backup[101319]: iface.tcp_wsf_state = Jul 03 09:53:04.505626 np0000004400 cinder-backup[101319]: iface.tcp_wsf = 0 Jul 03 09:53:04.505626 np0000004400 cinder-backup[101319]: iface.tcp_timer_scale = 0 Jul 03 09:53:04.505626 np0000004400 cinder-backup[101319]: iface.tcp_timestamp = Jul 03 09:53:04.505626 np0000004400 cinder-backup[101319]: iface.redirect = Jul 03 09:53:04.505626 np0000004400 cinder-backup[101319]: iface.def_task_mgmt_timeout = 0 Jul 03 09:53:04.505626 np0000004400 cinder-backup[101319]: iface.header_digest = Jul 03 09:53:04.505626 np0000004400 cinder-backup[101319]: iface.data_digest = Jul 03 09:53:04.505626 np0000004400 cinder-backup[101319]: iface.immediate_data = Jul 03 09:53:04.505626 np0000004400 cinder-backup[101319]: iface.initial_r2t = Jul 03 09:53:04.505626 np0000004400 cinder-backup[101319]: iface.data_seq_inorder = Jul 03 09:53:04.505626 np0000004400 cinder-backup[101319]: iface.data_pdu_inorder = Jul 03 09:53:04.505626 np0000004400 cinder-backup[101319]: iface.erl = 0 Jul 03 09:53:04.505626 np0000004400 cinder-backup[101319]: iface.max_receive_data_len = 0 Jul 03 09:53:04.505626 np0000004400 cinder-backup[101319]: iface.first_burst_len = 0 Jul 03 09:53:04.505626 np0000004400 cinder-backup[101319]: iface.max_outstanding_r2t = 0 Jul 03 09:53:04.505626 np0000004400 cinder-backup[101319]: iface.max_burst_len = 0 Jul 03 09:53:04.505626 np0000004400 cinder-backup[101319]: iface.chap_auth = Jul 03 09:53:04.505626 np0000004400 cinder-backup[101319]: iface.bidi_chap = Jul 03 09:53:04.505626 np0000004400 cinder-backup[101319]: iface.strict_login_compliance = Jul 03 09:53:04.505626 np0000004400 cinder-backup[101319]: iface.discovery_auth = Jul 03 09:53:04.505626 np0000004400 cinder-backup[101319]: iface.discovery_logout = Jul 03 09:53:04.505626 np0000004400 cinder-backup[101319]: node.discovery_address = Jul 03 09:53:04.505626 np0000004400 cinder-backup[101319]: node.discovery_port = 0 Jul 03 09:53:04.505626 np0000004400 cinder-backup[101319]: node.discovery_type = fw Jul 03 09:53:04.505626 np0000004400 cinder-backup[101319]: node.session.initial_cmdsn = 0 Jul 03 09:53:04.505626 np0000004400 cinder-backup[101319]: node.session.initial_login_retry_max = 8 Jul 03 09:53:04.505626 np0000004400 cinder-backup[101319]: node.session.xmit_thread_priority = 0 Jul 03 09:53:04.505626 np0000004400 cinder-backup[101319]: node.session.cmds_max = 128 Jul 03 09:53:04.505626 np0000004400 cinder-backup[101319]: node.session.queue_depth = 32 Jul 03 09:53:04.505626 np0000004400 cinder-backup[101319]: node.session.nr_sessions = 1 Jul 03 09:53:04.505626 np0000004400 cinder-backup[101319]: node.session.auth.authmethod = None Jul 03 09:53:04.505626 np0000004400 cinder-backup[101319]: node.session.auth.username = Jul 03 09:53:04.505626 np0000004400 cinder-backup[101319]: node.session.auth.password = *** Jul 03 09:53:04.505626 np0000004400 cinder-backup[101319]: node.session.auth.username_in = Jul 03 09:53:04.505626 np0000004400 cinder-backup[101319]: node.session.auth.password_in = Jul 03 09:53:04.505626 np0000004400 cinder-backup[101319]: node.session.auth.chap_algs = SHA256 Jul 03 09:53:04.505626 np0000004400 cinder-backup[101319]: node.session.timeo.replacement_timeout = 120 Jul 03 09:53:04.505626 np0000004400 cinder-backup[101319]: node.session.err_timeo.abort_timeout = 15 Jul 03 09:53:04.505626 np0000004400 cinder-backup[101319]: node.session.err_timeo.lu_reset_timeout = 30 Jul 03 09:53:04.505626 np0000004400 cinder-backup[101319]: node.session.err_timeo.tgt_reset_timeout = 30 Jul 03 09:53:04.505626 np0000004400 cinder-backup[101319]: node.session.err_timeo.host_reset_timeout = 60 Jul 03 09:53:04.505626 np0000004400 cinder-backup[101319]: node.session.iscsi.FastAbort = Yes Jul 03 09:53:04.505626 np0000004400 cinder-backup[101319]: node.session.iscsi.InitialR2T = No Jul 03 09:53:04.505626 np0000004400 cinder-backup[101319]: node.session.iscsi.ImmediateData = Yes Jul 03 09:53:04.505626 np0000004400 cinder-backup[101319]: node.session.iscsi.FirstBurstLength = 262144 Jul 03 09:53:04.505626 np0000004400 cinder-backup[101319]: node.session.iscsi.MaxBurstLength = 16776192 Jul 03 09:53:04.505626 np0000004400 cinder-backup[101319]: node.session.iscsi.DefaultTime2Retain = 0 Jul 03 09:53:04.505626 np0000004400 cinder-backup[101319]: node.session.iscsi.DefaultTime2Wait = 2 Jul 03 09:53:04.505626 np0000004400 cinder-backup[101319]: node.session.iscsi.MaxConnections = 1 Jul 03 09:53:04.505626 np0000004400 cinder-backup[101319]: node.session.iscsi.MaxOutstandingR2T = 1 Jul 03 09:53:04.505626 np0000004400 cinder-backup[101319]: node.session.iscsi.ERL = 0 Jul 03 09:53:04.505626 np0000004400 cinder-backup[101319]: node.session.scan = auto Jul 03 09:53:04.505626 np0000004400 cinder-backup[101319]: node.session.reopen_max = 0 Jul 03 09:53:04.505626 np0000004400 cinder-backup[101319]: node.conn[0].address = 192.168.40.100 Jul 03 09:53:04.505626 np0000004400 cinder-backup[101319]: node.conn[0].port = 3260 Jul 03 09:53:04.505626 np0000004400 cinder-backup[101319]: node.conn[0].startup = manual Jul 03 09:53:04.505626 np0000004400 cinder-backup[101319]: node.conn[0].tcp.window_size = 524288 Jul 03 09:53:04.505626 np0000004400 cinder-backup[101319]: node.conn[0].tcp.type_of_service = 0 Jul 03 09:53:04.505626 np0000004400 cinder-backup[101319]: node.conn[0].timeo.logout_timeout = 15 Jul 03 09:53:04.505626 np0000004400 cinder-backup[101319]: node.conn[0].timeo.login_timeout = 15 Jul 03 09:53:04.505626 np0000004400 cinder-backup[101319]: node.conn[0].timeo.auth_timeout = 45 Jul 03 09:53:04.505626 np0000004400 cinder-backup[101319]: node.conn[0].timeo.noop_out_interval = 5 Jul 03 09:53:04.505626 np0000004400 cinder-backup[101319]: node.conn[0].timeo.noop_out_timeout = 5 Jul 03 09:53:04.505626 np0000004400 cinder-backup[101319]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0 Jul 03 09:53:04.505626 np0000004400 cinder-backup[101319]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144 Jul 03 09:53:04.505626 np0000004400 cinder-backup[101319]: node.conn[0].iscsi.HeaderDigest = None Jul 03 09:53:04.505626 np0000004400 cinder-backup[101319]: node.conn[0].iscsi.DataDigest = None Jul 03 09:53:04.505626 np0000004400 cinder-backup[101319]: node.conn[0].iscsi.IFMarker = No Jul 03 09:53:04.505626 np0000004400 cinder-backup[101319]: node.conn[0].iscsi.OFMarker = No Jul 03 09:53:04.505626 np0000004400 cinder-backup[101319]: # END RECORD Jul 03 09:53:04.505626 np0000004400 cinder-backup[101319]: stderr= {{(pid=101319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 03 09:53:04.516329 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-86249081-dcdf-44d7-a2b2-6285d268a4bd tempest-VolumesBackupsTest-1484886458 None] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=101319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 03 09:53:04.532557 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-86249081-dcdf-44d7-a2b2-6285d268a4bd tempest-VolumesBackupsTest-1484886458 None] iscsiadm ('-m', 'session'): stdout=tcp: [188] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-491c39b6-d2e0-4f67-9a64-590d50f06197 (non-flash) Jul 03 09:53:04.532557 np0000004400 cinder-backup[101319]: tcp: [189] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-491c39b6-d2e0-4f67-9a64-590d50f06197 (non-flash) Jul 03 09:53:04.532557 np0000004400 cinder-backup[101319]: tcp: [192] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-44062477-adb9-4fe5-a2cb-600f263cd316 (non-flash) Jul 03 09:53:04.532557 np0000004400 cinder-backup[101319]: tcp: [193] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-148b330f-fb7d-42d3-bf2f-98c1eeab9e3c (non-flash) Jul 03 09:53:04.532557 np0000004400 cinder-backup[101319]: tcp: [194] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-148b330f-fb7d-42d3-bf2f-98c1eeab9e3c (non-flash) Jul 03 09:53:04.532557 np0000004400 cinder-backup[101319]: stderr= {{(pid=101319) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jul 03 09:53:04.532842 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-86249081-dcdf-44d7-a2b2-6285d268a4bd tempest-VolumesBackupsTest-1484886458 None] iscsi session list stdout=tcp: [188] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-491c39b6-d2e0-4f67-9a64-590d50f06197 (non-flash) Jul 03 09:53:04.532842 np0000004400 cinder-backup[101319]: tcp: [189] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-491c39b6-d2e0-4f67-9a64-590d50f06197 (non-flash) Jul 03 09:53:04.532842 np0000004400 cinder-backup[101319]: tcp: [192] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-44062477-adb9-4fe5-a2cb-600f263cd316 (non-flash) Jul 03 09:53:04.532842 np0000004400 cinder-backup[101319]: tcp: [193] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-148b330f-fb7d-42d3-bf2f-98c1eeab9e3c (non-flash) Jul 03 09:53:04.532842 np0000004400 cinder-backup[101319]: tcp: [194] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-148b330f-fb7d-42d3-bf2f-98c1eeab9e3c (non-flash) Jul 03 09:53:04.532842 np0000004400 cinder-backup[101319]: stderr= {{(pid=101319) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jul 03 09:53:04.567730 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-86249081-dcdf-44d7-a2b2-6285d268a4bd tempest-VolumesBackupsTest-1484886458 None] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-bb206076-56d3-4255-8607-10b3ef732cbb, portal: 192.168.40.100,3260] Jul 03 09:53:04.567730 np0000004400 cinder-backup[101319]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-bb206076-56d3-4255-8607-10b3ef732cbb, portal: 192.168.40.100,3260] successful. Jul 03 09:53:04.567730 np0000004400 cinder-backup[101319]: stderr= {{(pid=101319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 03 09:53:04.579246 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-86249081-dcdf-44d7-a2b2-6285d268a4bd tempest-VolumesBackupsTest-1484886458 None] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=101319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 03 09:53:04.591861 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-86249081-dcdf-44d7-a2b2-6285d268a4bd tempest-VolumesBackupsTest-1484886458 None] iscsiadm ('-m', 'session'): stdout=tcp: [188] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-491c39b6-d2e0-4f67-9a64-590d50f06197 (non-flash) Jul 03 09:53:04.591861 np0000004400 cinder-backup[101319]: tcp: [189] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-491c39b6-d2e0-4f67-9a64-590d50f06197 (non-flash) Jul 03 09:53:04.591861 np0000004400 cinder-backup[101319]: tcp: [192] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-44062477-adb9-4fe5-a2cb-600f263cd316 (non-flash) Jul 03 09:53:04.591861 np0000004400 cinder-backup[101319]: tcp: [193] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-148b330f-fb7d-42d3-bf2f-98c1eeab9e3c (non-flash) Jul 03 09:53:04.591861 np0000004400 cinder-backup[101319]: tcp: [194] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-148b330f-fb7d-42d3-bf2f-98c1eeab9e3c (non-flash) Jul 03 09:53:04.591861 np0000004400 cinder-backup[101319]: tcp: [195] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-bb206076-56d3-4255-8607-10b3ef732cbb (non-flash) Jul 03 09:53:04.591861 np0000004400 cinder-backup[101319]: stderr= {{(pid=101319) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jul 03 09:53:04.592090 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-86249081-dcdf-44d7-a2b2-6285d268a4bd tempest-VolumesBackupsTest-1484886458 None] iscsi session list stdout=tcp: [188] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-491c39b6-d2e0-4f67-9a64-590d50f06197 (non-flash) Jul 03 09:53:04.592090 np0000004400 cinder-backup[101319]: tcp: [189] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-491c39b6-d2e0-4f67-9a64-590d50f06197 (non-flash) Jul 03 09:53:04.592090 np0000004400 cinder-backup[101319]: tcp: [192] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-44062477-adb9-4fe5-a2cb-600f263cd316 (non-flash) Jul 03 09:53:04.592090 np0000004400 cinder-backup[101319]: tcp: [193] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-148b330f-fb7d-42d3-bf2f-98c1eeab9e3c (non-flash) Jul 03 09:53:04.592090 np0000004400 cinder-backup[101319]: tcp: [194] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-148b330f-fb7d-42d3-bf2f-98c1eeab9e3c (non-flash) Jul 03 09:53:04.592090 np0000004400 cinder-backup[101319]: tcp: [195] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-bb206076-56d3-4255-8607-10b3ef732cbb (non-flash) Jul 03 09:53:04.592090 np0000004400 cinder-backup[101319]: stderr= {{(pid=101319) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jul 03 09:53:04.592497 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.base [None req-86249081-dcdf-44d7-a2b2-6285d268a4bd tempest-VolumesBackupsTest-1484886458 None] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-bb206076-56d3-4255-8607-10b3ef732cbb" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.123s {{(pid=101319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jul 03 09:53:04.592636 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-86249081-dcdf-44d7-a2b2-6285d268a4bd tempest-VolumesBackupsTest-1484886458 None] Connected to 192.168.40.100:3260 {{(pid=101319) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}} Jul 03 09:53:04.593453 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.linuxscsi [None req-86249081-dcdf-44d7-a2b2-6285d268a4bd tempest-VolumesBackupsTest-1484886458 None] HCTL ('12', '-', '-', 0) found on session 195 with lun 0 {{(pid=101319) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}} Jul 03 09:53:04.593586 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.linuxscsi [None req-86249081-dcdf-44d7-a2b2-6285d268a4bd tempest-VolumesBackupsTest-1484886458 None] Scanning host 12 c: -, t: -, l: 0) {{(pid=101319) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}} Jul 03 09:53:04.607500 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.linuxscsi [None req-86249081-dcdf-44d7-a2b2-6285d268a4bd tempest-VolumesBackupsTest-1484886458 None] Searching for a device in session 195 and hctl ['12', '*', '*', 0] yield: sdg {{(pid=101319) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}} Jul 03 09:53:04.607500 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-86249081-dcdf-44d7-a2b2-6285d268a4bd tempest-VolumesBackupsTest-1484886458 None] Connected to sdg using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-bb206076-56d3-4255-8607-10b3ef732cbb', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'bb206076-56d3-4255-8607-10b3ef732cbb', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': False} {{(pid=101319) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}} Jul 03 09:53:05.609470 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.base [None req-86249081-dcdf-44d7-a2b2-6285d268a4bd tempest-VolumesBackupsTest-1484886458 None] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 2.152s {{(pid=101319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jul 03 09:53:05.609878 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-86249081-dcdf-44d7-a2b2-6285d268a4bd tempest-VolumesBackupsTest-1484886458 None] <== connect_volume: return (2810ms) {'type': 'block', 'scsi_wwn': 'SStorPool_iSCSI_DISK_1034578903445799223', 'path': '/dev/sdg'} {{(pid=101319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}} Jul 03 09:53:05.610212 np0000004400 cinder-backup[101319]: DEBUG oslo_concurrency.processutils [None req-86249081-dcdf-44d7-a2b2-6285d268a4bd tempest-VolumesBackupsTest-1484886458 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chown 1002 /dev/sdg {{(pid=101319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 09:53:05.619207 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.base [None req-f043e500-5f3b-4c72-b188-fc659a5e00c0 tempest-ProjectReaderTests33-761902925 None] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 1.516s {{(pid=101319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jul 03 09:53:05.620267 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-f043e500-5f3b-4c72-b188-fc659a5e00c0 tempest-ProjectReaderTests33-761902925 None] _get_connection_devices called with parameters: connection_properties={'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-44062477-adb9-4fe5-a2cb-600f263cd316', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '44062477-adb9-4fe5-a2cb-600f263cd316', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': False}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=101319) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:847}} Jul 03 09:53:05.631593 np0000004400 sudo[153963]: stack : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chown 1002 /dev/sdg Jul 03 09:53:05.632264 np0000004400 sudo[153963]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1002) Jul 03 09:53:05.633077 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-f043e500-5f3b-4c72-b188-fc659a5e00c0 tempest-ProjectReaderTests33-761902925 None] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS: Jul 03 09:53:05.633077 np0000004400 cinder-backup[101319]: No targets found. Jul 03 09:53:05.633077 np0000004400 cinder-backup[101319]: iSNS: Jul 03 09:53:05.633077 np0000004400 cinder-backup[101319]: No targets found. Jul 03 09:53:05.633077 np0000004400 cinder-backup[101319]: STATIC: Jul 03 09:53:05.633077 np0000004400 cinder-backup[101319]: Target: iqn.2023-03.storpool.com:os--volume-44062477-adb9-4fe5-a2cb-600f263cd316 Jul 03 09:53:05.633077 np0000004400 cinder-backup[101319]: Portal: 192.168.40.100:3260,-1 Jul 03 09:53:05.633077 np0000004400 cinder-backup[101319]: Iface Name: default Jul 03 09:53:05.633077 np0000004400 cinder-backup[101319]: Target: iqn.2023-03.storpool.com:os--volume-491c39b6-d2e0-4f67-9a64-590d50f06197 Jul 03 09:53:05.633077 np0000004400 cinder-backup[101319]: Portal: 192.168.50.100:3260,-1 Jul 03 09:53:05.633077 np0000004400 cinder-backup[101319]: Iface Name: default Jul 03 09:53:05.633077 np0000004400 cinder-backup[101319]: Portal: 192.168.40.100:3260,-1 Jul 03 09:53:05.633077 np0000004400 cinder-backup[101319]: Iface Name: default Jul 03 09:53:05.633077 np0000004400 cinder-backup[101319]: Target: iqn.2023-03.storpool.com:os--volume-148b330f-fb7d-42d3-bf2f-98c1eeab9e3c Jul 03 09:53:05.633077 np0000004400 cinder-backup[101319]: Portal: 192.168.50.100:3260,-1 Jul 03 09:53:05.633077 np0000004400 cinder-backup[101319]: Iface Name: default Jul 03 09:53:05.633077 np0000004400 cinder-backup[101319]: Portal: 192.168.40.100:3260,-1 Jul 03 09:53:05.633077 np0000004400 cinder-backup[101319]: Iface Name: default Jul 03 09:53:05.633077 np0000004400 cinder-backup[101319]: Target: iqn.2023-03.storpool.com:os--volume-bb206076-56d3-4255-8607-10b3ef732cbb Jul 03 09:53:05.633077 np0000004400 cinder-backup[101319]: Portal: 192.168.40.100:3260,-1 Jul 03 09:53:05.633077 np0000004400 cinder-backup[101319]: Iface Name: default Jul 03 09:53:05.633077 np0000004400 cinder-backup[101319]: FIRMWARE: Jul 03 09:53:05.633077 np0000004400 cinder-backup[101319]: No targets found. Jul 03 09:53:05.633077 np0000004400 cinder-backup[101319]: stderr= {{(pid=101319) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jul 03 09:53:05.633779 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-f043e500-5f3b-4c72-b188-fc659a5e00c0 tempest-ProjectReaderTests33-761902925 None] Regex to get portals from discoverydb: ^SENDTARGETS: Jul 03 09:53:05.633779 np0000004400 cinder-backup[101319]: .*?^DiscoveryAddress: 192.168.40.100,3260.*? Jul 03 09:53:05.633779 np0000004400 cinder-backup[101319]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=101319) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:390}} Jul 03 09:53:05.633779 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-f043e500-5f3b-4c72-b188-fc659a5e00c0 tempest-ProjectReaderTests33-761902925 None] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-44062477-adb9-4fe5-a2cb-600f263cd316', 0)] {{(pid=101319) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:858}} Jul 03 09:53:05.656858 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-f043e500-5f3b-4c72-b188-fc659a5e00c0 tempest-ProjectReaderTests33-761902925 None] iscsiadm ('-m', 'session'): stdout=tcp: [188] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-491c39b6-d2e0-4f67-9a64-590d50f06197 (non-flash) Jul 03 09:53:05.656858 np0000004400 cinder-backup[101319]: tcp: [189] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-491c39b6-d2e0-4f67-9a64-590d50f06197 (non-flash) Jul 03 09:53:05.656858 np0000004400 cinder-backup[101319]: tcp: [192] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-44062477-adb9-4fe5-a2cb-600f263cd316 (non-flash) Jul 03 09:53:05.656858 np0000004400 cinder-backup[101319]: tcp: [193] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-148b330f-fb7d-42d3-bf2f-98c1eeab9e3c (non-flash) Jul 03 09:53:05.656858 np0000004400 cinder-backup[101319]: tcp: [194] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-148b330f-fb7d-42d3-bf2f-98c1eeab9e3c (non-flash) Jul 03 09:53:05.656858 np0000004400 cinder-backup[101319]: tcp: [195] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-bb206076-56d3-4255-8607-10b3ef732cbb (non-flash) Jul 03 09:53:05.656858 np0000004400 cinder-backup[101319]: stderr= {{(pid=101319) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jul 03 09:53:05.657166 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-f043e500-5f3b-4c72-b188-fc659a5e00c0 tempest-ProjectReaderTests33-761902925 None] iscsi session list stdout=tcp: [188] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-491c39b6-d2e0-4f67-9a64-590d50f06197 (non-flash) Jul 03 09:53:05.657166 np0000004400 cinder-backup[101319]: tcp: [189] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-491c39b6-d2e0-4f67-9a64-590d50f06197 (non-flash) Jul 03 09:53:05.657166 np0000004400 cinder-backup[101319]: tcp: [192] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-44062477-adb9-4fe5-a2cb-600f263cd316 (non-flash) Jul 03 09:53:05.657166 np0000004400 cinder-backup[101319]: tcp: [193] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-148b330f-fb7d-42d3-bf2f-98c1eeab9e3c (non-flash) Jul 03 09:53:05.657166 np0000004400 cinder-backup[101319]: tcp: [194] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-148b330f-fb7d-42d3-bf2f-98c1eeab9e3c (non-flash) Jul 03 09:53:05.657166 np0000004400 cinder-backup[101319]: tcp: [195] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-bb206076-56d3-4255-8607-10b3ef732cbb (non-flash) Jul 03 09:53:05.657166 np0000004400 cinder-backup[101319]: stderr= {{(pid=101319) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jul 03 09:53:05.657325 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-f043e500-5f3b-4c72-b188-fc659a5e00c0 tempest-ProjectReaderTests33-761902925 None] Sessions list: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-491c39b6-d2e0-4f67-9a64-590d50f06197', '188'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-491c39b6-d2e0-4f67-9a64-590d50f06197', '189'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-44062477-adb9-4fe5-a2cb-600f263cd316', '192'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-148b330f-fb7d-42d3-bf2f-98c1eeab9e3c', '193'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-148b330f-fb7d-42d3-bf2f-98c1eeab9e3c', '194'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-bb206076-56d3-4255-8607-10b3ef732cbb', '195')] {{(pid=101319) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:866}} Jul 03 09:53:05.657564 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-f043e500-5f3b-4c72-b188-fc659a5e00c0 tempest-ProjectReaderTests33-761902925 None] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-44062477-adb9-4fe5-a2cb-600f263cd316, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-44062477-adb9-4fe5-a2cb-600f263cd316', '192')] {{(pid=101319) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}} Jul 03 09:53:05.658870 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-f043e500-5f3b-4c72-b188-fc659a5e00c0 tempest-ProjectReaderTests33-761902925 None] Resulting device map defaultdict(. at 0x7e76e7528fe0>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-44062477-adb9-4fe5-a2cb-600f263cd316'): ({'sdf'}, set())}) {{(pid=101319) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:912}} Jul 03 09:53:05.659160 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.linuxscsi [None req-f043e500-5f3b-4c72-b188-fc659a5e00c0 tempest-ProjectReaderTests33-761902925 None] Removing single pathed devices sdf {{(pid=101319) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}} Jul 03 09:53:05.670786 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.linuxscsi [None req-f043e500-5f3b-4c72-b188-fc659a5e00c0 tempest-ProjectReaderTests33-761902925 None] Flushing IO for device /dev/sdf {{(pid=101319) flush_device_io /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:461}} Jul 03 09:53:05.678956 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.linuxscsi [None req-f043e500-5f3b-4c72-b188-fc659a5e00c0 tempest-ProjectReaderTests33-761902925 None] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=101319) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}} Jul 03 09:53:05.718134 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.linuxscsi [None req-f043e500-5f3b-4c72-b188-fc659a5e00c0 tempest-ProjectReaderTests33-761902925 None] Checking to see if SCSI volumes sdf have been removed. {{(pid=101319) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}} Jul 03 09:53:05.718326 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.linuxscsi [None req-f043e500-5f3b-4c72-b188-fc659a5e00c0 tempest-ProjectReaderTests33-761902925 None] SCSI volumes sdf have been removed. {{(pid=101319) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}} Jul 03 09:53:05.719506 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.linuxscsi [None req-f043e500-5f3b-4c72-b188-fc659a5e00c0 tempest-ProjectReaderTests33-761902925 None] Checking to see if device paths {'sdf'} are still under multipathd monitoring {{(pid=101319) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}} Jul 03 09:53:05.731216 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.linuxscsi [None req-f043e500-5f3b-4c72-b188-fc659a5e00c0 tempest-ProjectReaderTests33-761902925 None] Device paths {'sdf'} have been removed from multipathd monitoring. {{(pid=101319) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}} Jul 03 09:53:05.731474 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-f043e500-5f3b-4c72-b188-fc659a5e00c0 tempest-ProjectReaderTests33-761902925 None] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-44062477-adb9-4fe5-a2cb-600f263cd316')] {{(pid=101319) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1225}} Jul 03 09:53:05.742162 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-f043e500-5f3b-4c72-b188-fc659a5e00c0 tempest-ProjectReaderTests33-761902925 None] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=101319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 03 09:53:05.771650 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-f043e500-5f3b-4c72-b188-fc659a5e00c0 tempest-ProjectReaderTests33-761902925 None] iscsiadm ('--logout',): stdout=Logging out of session [sid: 192, target: iqn.2023-03.storpool.com:os--volume-44062477-adb9-4fe5-a2cb-600f263cd316, portal: 192.168.40.100,3260] Jul 03 09:53:05.771650 np0000004400 cinder-backup[101319]: Logout of [sid: 192, target: iqn.2023-03.storpool.com:os--volume-44062477-adb9-4fe5-a2cb-600f263cd316, portal: 192.168.40.100,3260] successful. Jul 03 09:53:05.771650 np0000004400 cinder-backup[101319]: stderr= {{(pid=101319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 03 09:53:05.787760 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-f043e500-5f3b-4c72-b188-fc659a5e00c0 tempest-ProjectReaderTests33-761902925 None] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=101319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 03 09:53:05.788226 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.base [None req-f043e500-5f3b-4c72-b188-fc659a5e00c0 tempest-ProjectReaderTests33-761902925 None] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.170s {{(pid=101319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jul 03 09:53:05.788525 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-f043e500-5f3b-4c72-b188-fc659a5e00c0 tempest-ProjectReaderTests33-761902925 None] <== disconnect_volume: return (1685ms) None {{(pid=101319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}} Jul 03 09:53:05.933529 np0000004400 sudo[153963]: pam_unix(sudo:session): session closed for user root Jul 03 09:53:05.935229 np0000004400 cinder-backup[101319]: DEBUG oslo_concurrency.processutils [None req-86249081-dcdf-44d7-a2b2-6285d268a4bd tempest-VolumesBackupsTest-1484886458 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chown 1002 /dev/sdg" returned: 0 in 0.325s {{(pid=101319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 09:53:05.945203 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-86249081-dcdf-44d7-a2b2-6285d268a4bd tempest-VolumesBackupsTest-1484886458 None] _create_container started, container: volumebackups,backup: dddedc88-ea25-4f5d-b989-944d0094b292. {{(pid=101319) _create_container /opt/stack/cinder/cinder/backup/chunkeddriver.py:249}} Jul 03 09:53:06.087312 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.drivers.swift [None req-86249081-dcdf-44d7-a2b2-6285d268a4bd tempest-VolumesBackupsTest-1484886458 None] generate_object_name_prefix: volume_bb206076-56d3-4255-8607-10b3ef732cbb/20260703095306/az_nova_backup_dddedc88-ea25-4f5d-b989-944d0094b292 {{(pid=101319) _generate_object_name_prefix /opt/stack/cinder/cinder/backup/drivers/swift.py:452}} Jul 03 09:53:06.092045 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-86249081-dcdf-44d7-a2b2-6285d268a4bd tempest-VolumesBackupsTest-1484886458 None] starting backup of volume: bb206076-56d3-4255-8607-10b3ef732cbb, volume size: 1073741824, object names prefix volume_bb206076-56d3-4255-8607-10b3ef732cbb/20260703095306/az_nova_backup_dddedc88-ea25-4f5d-b989-944d0094b292, availability zone: nova {{(pid=101319) _prepare_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:359}} Jul 03 09:53:06.267417 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-86249081-dcdf-44d7-a2b2-6285d268a4bd tempest-VolumesBackupsTest-1484886458 None] Backing up chunk of data from volume. {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 09:53:06.512010 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-86249081-dcdf-44d7-a2b2-6285d268a4bd tempest-VolumesBackupsTest-1484886458 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101319) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 09:53:06.512145 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-86249081-dcdf-44d7-a2b2-6285d268a4bd tempest-VolumesBackupsTest-1484886458 None] About to put_object {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 09:53:06.616068 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-86249081-dcdf-44d7-a2b2-6285d268a4bd tempest-VolumesBackupsTest-1484886458 None] backup MD5 for volume_bb206076-56d3-4255-8607-10b3ef732cbb/20260703095306/az_nova_backup_dddedc88-ea25-4f5d-b989-944d0094b292-00001: 25e317773f308e446cc84c503a6d1f85 {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 09:53:06.616445 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-86249081-dcdf-44d7-a2b2-6285d268a4bd tempest-VolumesBackupsTest-1484886458 None] Calling eventlet.sleep(0) {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 09:53:06.783867 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-86249081-dcdf-44d7-a2b2-6285d268a4bd tempest-VolumesBackupsTest-1484886458 None] Backing up chunk of data from volume. {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 09:53:06.811878 np0000004400 cinder-backup[101319]: INFO cinder.backup.manager [None req-f043e500-5f3b-4c72-b188-fc659a5e00c0 tempest-ProjectReaderTests33-761902925 None] Create backup finished. backup: 6624fbb5-b72a-4c4d-bc8d-5f32665a951a. Jul 03 09:53:07.032493 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-86249081-dcdf-44d7-a2b2-6285d268a4bd tempest-VolumesBackupsTest-1484886458 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101319) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 09:53:07.032648 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-86249081-dcdf-44d7-a2b2-6285d268a4bd tempest-VolumesBackupsTest-1484886458 None] About to put_object {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 09:53:07.130693 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-86249081-dcdf-44d7-a2b2-6285d268a4bd tempest-VolumesBackupsTest-1484886458 None] backup MD5 for volume_bb206076-56d3-4255-8607-10b3ef732cbb/20260703095306/az_nova_backup_dddedc88-ea25-4f5d-b989-944d0094b292-00002: 25e317773f308e446cc84c503a6d1f85 {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 09:53:07.130887 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-86249081-dcdf-44d7-a2b2-6285d268a4bd tempest-VolumesBackupsTest-1484886458 None] Calling eventlet.sleep(0) {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 09:53:07.353390 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-86249081-dcdf-44d7-a2b2-6285d268a4bd tempest-VolumesBackupsTest-1484886458 None] Backing up chunk of data from volume. {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 09:53:07.597448 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-86249081-dcdf-44d7-a2b2-6285d268a4bd tempest-VolumesBackupsTest-1484886458 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101319) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 09:53:07.597575 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-86249081-dcdf-44d7-a2b2-6285d268a4bd tempest-VolumesBackupsTest-1484886458 None] About to put_object {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 09:53:07.697707 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-86249081-dcdf-44d7-a2b2-6285d268a4bd tempest-VolumesBackupsTest-1484886458 None] backup MD5 for volume_bb206076-56d3-4255-8607-10b3ef732cbb/20260703095306/az_nova_backup_dddedc88-ea25-4f5d-b989-944d0094b292-00003: 25e317773f308e446cc84c503a6d1f85 {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 09:53:07.698038 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-86249081-dcdf-44d7-a2b2-6285d268a4bd tempest-VolumesBackupsTest-1484886458 None] Calling eventlet.sleep(0) {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 09:53:07.872389 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-86249081-dcdf-44d7-a2b2-6285d268a4bd tempest-VolumesBackupsTest-1484886458 None] Backing up chunk of data from volume. {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 09:53:08.130586 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-86249081-dcdf-44d7-a2b2-6285d268a4bd tempest-VolumesBackupsTest-1484886458 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101319) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 09:53:08.130941 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-86249081-dcdf-44d7-a2b2-6285d268a4bd tempest-VolumesBackupsTest-1484886458 None] About to put_object {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 09:53:08.231877 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-86249081-dcdf-44d7-a2b2-6285d268a4bd tempest-VolumesBackupsTest-1484886458 None] backup MD5 for volume_bb206076-56d3-4255-8607-10b3ef732cbb/20260703095306/az_nova_backup_dddedc88-ea25-4f5d-b989-944d0094b292-00004: 25e317773f308e446cc84c503a6d1f85 {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 09:53:08.232055 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-86249081-dcdf-44d7-a2b2-6285d268a4bd tempest-VolumesBackupsTest-1484886458 None] Calling eventlet.sleep(0) {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 09:53:08.408019 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-86249081-dcdf-44d7-a2b2-6285d268a4bd tempest-VolumesBackupsTest-1484886458 None] Backing up chunk of data from volume. {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 09:53:08.631317 np0000004400 cinder-backup[101319]: INFO cinder.backup.manager [None req-904329c4-9ef6-4056-95e0-4524f15f09c7 tempest-ProjectReaderTests33-761902925 None] Create backup started, backup: 995de3de-d18a-4f2d-9b86-30dcb8a7d527 volume: 91385958-bc9a-4b5d-ac21-22d57700a0e4. Jul 03 09:53:08.635840 np0000004400 cinder-backup[101319]: INFO cinder.backup.manager [None req-904329c4-9ef6-4056-95e0-4524f15f09c7 tempest-ProjectReaderTests33-761902925 None] Call Volume Manager to get_backup_device for Backup(availability_zone='nova',container=None,created_at=2026-07-03T09:53:08Z,data_timestamp=2026-07-03T09:53:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-type-Backup-256641667',encryption_key_id=None,fail_reason=None,host='np0000004400',id=995de3de-d18a-4f2d-9b86-30dcb8a7d527,metadata={},num_dependent_backups=0,object_count=0,parent=None,parent_id=None,project_id='e331bd155b824bbb8979e9aac5023870',restore_volume_id=None,service='cinder.backup.drivers.swift.SwiftBackupDriver',service_metadata=None,size=1,snapshot_id=None,status='creating',temp_snapshot_id=None,temp_volume_id=None,updated_at=None,user_id='45a99ff133014c9a8bfd931707d31606',volume_id=91385958-bc9a-4b5d-ac21-22d57700a0e4) Jul 03 09:53:08.659062 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.drivers.swift [None req-904329c4-9ef6-4056-95e0-4524f15f09c7 tempest-ProjectReaderTests33-761902925 None] Using swift URL https://10.4.3.95:8080/v1/AUTH_e331bd155b824bbb8979e9aac5023870 {{(pid=101319) initialize /opt/stack/cinder/cinder/backup/drivers/swift.py:300}} Jul 03 09:53:08.659443 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.drivers.swift [None req-904329c4-9ef6-4056-95e0-4524f15f09c7 tempest-ProjectReaderTests33-761902925 None] Connect to https://10.4.3.95:8080/v1/AUTH_ in "per_user" mode {{(pid=101319) initialize /opt/stack/cinder/cinder/backup/drivers/swift.py:301}} Jul 03 09:53:08.659776 np0000004400 cinder-backup[101319]: DEBUG os_brick.utils [None req-904329c4-9ef6-4056-95e0-4524f15f09c7 tempest-ProjectReaderTests33-761902925 None] ==> get_connector_properties: call "{'root_helper': 'sudo cinder-rootwrap /etc/cinder/rootwrap.conf', 'my_ip': '10.4.3.95', 'multipath': False, 'enforce_multipath': False, 'host': None, 'execute': None}" {{(pid=101319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}} Jul 03 09:53:08.660380 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-86249081-dcdf-44d7-a2b2-6285d268a4bd tempest-VolumesBackupsTest-1484886458 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101319) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 09:53:08.660515 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-86249081-dcdf-44d7-a2b2-6285d268a4bd tempest-VolumesBackupsTest-1484886458 None] About to put_object {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 09:53:08.669515 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.scaleio [None req-904329c4-9ef6-4056-95e0-4524f15f09c7 tempest-ProjectReaderTests33-761902925 None] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=101319) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}} Jul 03 09:53:08.688874 np0000004400 cinder-backup[101319]: DEBUG oslo_concurrency.processutils [None req-904329c4-9ef6-4056-95e0-4524f15f09c7 tempest-ProjectReaderTests33-761902925 None] Running cmd (subprocess): nvme version {{(pid=101319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 09:53:08.706194 np0000004400 cinder-backup[101319]: DEBUG oslo_concurrency.processutils [None req-904329c4-9ef6-4056-95e0-4524f15f09c7 tempest-ProjectReaderTests33-761902925 None] 'nvme version' failed. Not Retrying. {{(pid=101319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 03 09:53:08.706650 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.nvmeof [None req-904329c4-9ef6-4056-95e0-4524f15f09c7 tempest-ProjectReaderTests33-761902925 None] nvme not present on system {{(pid=101319) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}} Jul 03 09:53:08.714363 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.lightos [None req-904329c4-9ef6-4056-95e0-4524f15f09c7 tempest-ProjectReaderTests33-761902925 None] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=101319) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}} Jul 03 09:53:08.715442 np0000004400 cinder-backup[101319]: INFO os_brick.initiator.connectors.lightos [None req-904329c4-9ef6-4056-95e0-4524f15f09c7 tempest-ProjectReaderTests33-761902925 None] Current host hostNQN and IP(s) are ['10.4.3.95', 'fe80::f816:3eff:fe47:268c', '192.168.40.6', 'fe80::f816:3eff:febf:7be2', '192.168.50.6', 'fe80::f816:3eff:fe99:8914', '192.168.10.6', 'fe80::f816:3eff:fe2f:e696', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::bc9d:84ff:fec2:6b49', 'fe80::fc16:3eff:fe13:9420', 'fe80::8cea:42ff:fe99:b64a', 'fe80::fc16:3eff:feaa:206b', 'fe80::74a1:e1ff:fe2f:1924'] Jul 03 09:53:08.715624 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.lightos [None req-904329c4-9ef6-4056-95e0-4524f15f09c7 tempest-ProjectReaderTests33-761902925 None] LIGHTOS: did not find dsc, continuing anyway. {{(pid=101319) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}} Jul 03 09:53:08.715790 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.lightos [None req-904329c4-9ef6-4056-95e0-4524f15f09c7 tempest-ProjectReaderTests33-761902925 None] LIGHTOS: no hostnqn found. {{(pid=101319) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}} Jul 03 09:53:08.716066 np0000004400 cinder-backup[101319]: DEBUG os_brick.utils [None req-904329c4-9ef6-4056-95e0-4524f15f09c7 tempest-ProjectReaderTests33-761902925 None] <== get_connector_properties: return (56ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.95', 'host': 'np0000004400', 'multipath': False, 'enforce_multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:ae7e5bb0ebe6', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': '6b284368-d0ba-4d18-af6f-4998d3955c52', 'nvme_native_multipath': False} {{(pid=101319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}} Jul 03 09:53:08.757917 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-86249081-dcdf-44d7-a2b2-6285d268a4bd tempest-VolumesBackupsTest-1484886458 None] backup MD5 for volume_bb206076-56d3-4255-8607-10b3ef732cbb/20260703095306/az_nova_backup_dddedc88-ea25-4f5d-b989-944d0094b292-00005: 25e317773f308e446cc84c503a6d1f85 {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 09:53:08.758086 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-86249081-dcdf-44d7-a2b2-6285d268a4bd tempest-VolumesBackupsTest-1484886458 None] Calling eventlet.sleep(0) {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 09:53:08.792502 np0000004400 cinder-backup[101319]: DEBUG oslo_db.sqlalchemy.engines [None req-86249081-dcdf-44d7-a2b2-6285d268a4bd tempest-VolumesBackupsTest-1484886458 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=101319) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 03 09:53:08.968148 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-86249081-dcdf-44d7-a2b2-6285d268a4bd tempest-VolumesBackupsTest-1484886458 None] Backing up chunk of data from volume. {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 09:53:09.212098 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-86249081-dcdf-44d7-a2b2-6285d268a4bd tempest-VolumesBackupsTest-1484886458 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101319) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 09:53:09.212264 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-86249081-dcdf-44d7-a2b2-6285d268a4bd tempest-VolumesBackupsTest-1484886458 None] About to put_object {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 09:53:09.220361 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connector [None req-904329c4-9ef6-4056-95e0-4524f15f09c7 tempest-ProjectReaderTests33-761902925 None] Factory for iscsi on None {{(pid=101319) factory /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connector.py:243}} Jul 03 09:53:09.220629 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-904329c4-9ef6-4056-95e0-4524f15f09c7 tempest-ProjectReaderTests33-761902925 None] ==> connect_volume: call "{'self': , 'connection_properties': {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-91385958-bc9a-4b5d-ac21-22d57700a0e4', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '91385958-bc9a-4b5d-ac21-22d57700a0e4', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': False}}" {{(pid=101319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}} Jul 03 09:53:09.220765 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.base [None req-904329c4-9ef6-4056-95e0-4524f15f09c7 tempest-ProjectReaderTests33-761902925 None] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=101319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jul 03 09:53:09.221146 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.base [None req-904329c4-9ef6-4056-95e0-4524f15f09c7 tempest-ProjectReaderTests33-761902925 None] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.000s {{(pid=101319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jul 03 09:53:09.221349 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.base [None req-904329c4-9ef6-4056-95e0-4524f15f09c7 tempest-ProjectReaderTests33-761902925 None] Connection properties {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-91385958-bc9a-4b5d-ac21-22d57700a0e4', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '91385958-bc9a-4b5d-ac21-22d57700a0e4', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': False} {{(pid=101319) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}} Jul 03 09:53:09.233535 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.base [None req-904329c4-9ef6-4056-95e0-4524f15f09c7 tempest-ProjectReaderTests33-761902925 None] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-91385958-bc9a-4b5d-ac21-22d57700a0e4" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=101319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jul 03 09:53:09.233948 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.base [None req-904329c4-9ef6-4056-95e0-4524f15f09c7 tempest-ProjectReaderTests33-761902925 None] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-91385958-bc9a-4b5d-ac21-22d57700a0e4" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.000s {{(pid=101319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jul 03 09:53:09.234229 np0000004400 cinder-backup[101319]: INFO os_brick.initiator.connectors.iscsi [None req-904329c4-9ef6-4056-95e0-4524f15f09c7 tempest-ProjectReaderTests33-761902925 None] Trying to connect to iSCSI portal 192.168.40.100:3260 Jul 03 09:53:09.245820 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-904329c4-9ef6-4056-95e0-4524f15f09c7 tempest-ProjectReaderTests33-761902925 None] iscsiadm (): stdout= stderr=iscsiadm: No records found Jul 03 09:53:09.245820 np0000004400 cinder-backup[101319]: {{(pid=101319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 03 09:53:09.256965 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-904329c4-9ef6-4056-95e0-4524f15f09c7 tempest-ProjectReaderTests33-761902925 None] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-91385958-bc9a-4b5d-ac21-22d57700a0e4] added Jul 03 09:53:09.256965 np0000004400 cinder-backup[101319]: stderr=iscsiadm: Config file line 363 does not have value Jul 03 09:53:09.256965 np0000004400 cinder-backup[101319]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs' Jul 03 09:53:09.256965 np0000004400 cinder-backup[101319]: iscsiadm: Config file line 363 does not have value Jul 03 09:53:09.256965 np0000004400 cinder-backup[101319]: iscsiadm: Config file line 363 does not have value Jul 03 09:53:09.256965 np0000004400 cinder-backup[101319]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs' Jul 03 09:53:09.256965 np0000004400 cinder-backup[101319]: {{(pid=101319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 03 09:53:09.257164 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-904329c4-9ef6-4056-95e0-4524f15f09c7 tempest-ProjectReaderTests33-761902925 None] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=101319) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}} Jul 03 09:53:09.257605 np0000004400 cinder-backup[101319]: DEBUG os_brick.utils [None req-904329c4-9ef6-4056-95e0-4524f15f09c7 tempest-ProjectReaderTests33-761902925 None] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0233(s), this was the 1st time calling it. {{(pid=101319) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}} Jul 03 09:53:09.257867 np0000004400 cinder-backup[101319]: DEBUG os_brick.utils [None req-904329c4-9ef6-4056-95e0-4524f15f09c7 tempest-ProjectReaderTests33-761902925 None] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=101319) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}} Jul 03 09:53:09.311067 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-86249081-dcdf-44d7-a2b2-6285d268a4bd tempest-VolumesBackupsTest-1484886458 None] backup MD5 for volume_bb206076-56d3-4255-8607-10b3ef732cbb/20260703095306/az_nova_backup_dddedc88-ea25-4f5d-b989-944d0094b292-00006: 25e317773f308e446cc84c503a6d1f85 {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 09:53:09.311243 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-86249081-dcdf-44d7-a2b2-6285d268a4bd tempest-VolumesBackupsTest-1484886458 None] Calling eventlet.sleep(0) {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 09:53:09.488544 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-86249081-dcdf-44d7-a2b2-6285d268a4bd tempest-VolumesBackupsTest-1484886458 None] Backing up chunk of data from volume. {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 09:53:09.726966 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-86249081-dcdf-44d7-a2b2-6285d268a4bd tempest-VolumesBackupsTest-1484886458 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101319) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 09:53:09.727496 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-86249081-dcdf-44d7-a2b2-6285d268a4bd tempest-VolumesBackupsTest-1484886458 None] About to put_object {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 09:53:09.821556 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-86249081-dcdf-44d7-a2b2-6285d268a4bd tempest-VolumesBackupsTest-1484886458 None] backup MD5 for volume_bb206076-56d3-4255-8607-10b3ef732cbb/20260703095306/az_nova_backup_dddedc88-ea25-4f5d-b989-944d0094b292-00007: 25e317773f308e446cc84c503a6d1f85 {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 09:53:09.821782 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-86249081-dcdf-44d7-a2b2-6285d268a4bd tempest-VolumesBackupsTest-1484886458 None] Calling eventlet.sleep(0) {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 09:53:09.996043 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-86249081-dcdf-44d7-a2b2-6285d268a4bd tempest-VolumesBackupsTest-1484886458 None] Backing up chunk of data from volume. {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 09:53:10.238943 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-86249081-dcdf-44d7-a2b2-6285d268a4bd tempest-VolumesBackupsTest-1484886458 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101319) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 09:53:10.239168 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-86249081-dcdf-44d7-a2b2-6285d268a4bd tempest-VolumesBackupsTest-1484886458 None] About to put_object {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 09:53:10.259033 np0000004400 cinder-backup[101319]: INFO os_brick.initiator.connectors.iscsi [None req-904329c4-9ef6-4056-95e0-4524f15f09c7 tempest-ProjectReaderTests33-761902925 None] Trying to connect to iSCSI portal 192.168.40.100:3260 Jul 03 09:53:10.270625 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-904329c4-9ef6-4056-95e0-4524f15f09c7 tempest-ProjectReaderTests33-761902925 None] iscsiadm (): stdout=# BEGIN RECORD 2.1.9 Jul 03 09:53:10.270625 np0000004400 cinder-backup[101319]: node.name = iqn.2023-03.storpool.com:os--volume-91385958-bc9a-4b5d-ac21-22d57700a0e4 Jul 03 09:53:10.270625 np0000004400 cinder-backup[101319]: node.tpgt = -1 Jul 03 09:53:10.270625 np0000004400 cinder-backup[101319]: node.startup = manual Jul 03 09:53:10.270625 np0000004400 cinder-backup[101319]: node.leading_login = No Jul 03 09:53:10.270625 np0000004400 cinder-backup[101319]: iface.iscsi_ifacename = default Jul 03 09:53:10.270625 np0000004400 cinder-backup[101319]: iface.net_ifacename = Jul 03 09:53:10.270625 np0000004400 cinder-backup[101319]: iface.ipaddress = Jul 03 09:53:10.270625 np0000004400 cinder-backup[101319]: iface.prefix_len = 0 Jul 03 09:53:10.270625 np0000004400 cinder-backup[101319]: iface.hwaddress = Jul 03 09:53:10.270625 np0000004400 cinder-backup[101319]: iface.transport_name = tcp Jul 03 09:53:10.270625 np0000004400 cinder-backup[101319]: iface.initiatorname = Jul 03 09:53:10.270625 np0000004400 cinder-backup[101319]: iface.state = Jul 03 09:53:10.270625 np0000004400 cinder-backup[101319]: iface.vlan_id = 0 Jul 03 09:53:10.270625 np0000004400 cinder-backup[101319]: iface.vlan_priority = 0 Jul 03 09:53:10.270625 np0000004400 cinder-backup[101319]: iface.vlan_state = Jul 03 09:53:10.270625 np0000004400 cinder-backup[101319]: iface.iface_num = 0 Jul 03 09:53:10.270625 np0000004400 cinder-backup[101319]: iface.mtu = 0 Jul 03 09:53:10.270625 np0000004400 cinder-backup[101319]: iface.port = 0 Jul 03 09:53:10.270625 np0000004400 cinder-backup[101319]: iface.bootproto = Jul 03 09:53:10.270625 np0000004400 cinder-backup[101319]: iface.subnet_mask = Jul 03 09:53:10.270625 np0000004400 cinder-backup[101319]: iface.gateway = Jul 03 09:53:10.270625 np0000004400 cinder-backup[101319]: iface.dhcp_alt_client_id_state = Jul 03 09:53:10.270625 np0000004400 cinder-backup[101319]: iface.dhcp_alt_client_id = Jul 03 09:53:10.270625 np0000004400 cinder-backup[101319]: iface.dhcp_dns = Jul 03 09:53:10.270625 np0000004400 cinder-backup[101319]: iface.dhcp_learn_iqn = Jul 03 09:53:10.270625 np0000004400 cinder-backup[101319]: iface.dhcp_req_vendor_id_state = Jul 03 09:53:10.270625 np0000004400 cinder-backup[101319]: iface.dhcp_vendor_id_state = Jul 03 09:53:10.270625 np0000004400 cinder-backup[101319]: iface.dhcp_vendor_id = Jul 03 09:53:10.270625 np0000004400 cinder-backup[101319]: iface.dhcp_slp_da = Jul 03 09:53:10.270625 np0000004400 cinder-backup[101319]: iface.fragmentation = Jul 03 09:53:10.270625 np0000004400 cinder-backup[101319]: iface.gratuitous_arp = Jul 03 09:53:10.270625 np0000004400 cinder-backup[101319]: iface.incoming_forwarding = Jul 03 09:53:10.270625 np0000004400 cinder-backup[101319]: iface.tos_state = Jul 03 09:53:10.270625 np0000004400 cinder-backup[101319]: iface.tos = 0 Jul 03 09:53:10.270625 np0000004400 cinder-backup[101319]: iface.ttl = 0 Jul 03 09:53:10.270625 np0000004400 cinder-backup[101319]: iface.delayed_ack = Jul 03 09:53:10.270625 np0000004400 cinder-backup[101319]: iface.tcp_nagle = Jul 03 09:53:10.270625 np0000004400 cinder-backup[101319]: iface.tcp_wsf_state = Jul 03 09:53:10.270625 np0000004400 cinder-backup[101319]: iface.tcp_wsf = 0 Jul 03 09:53:10.270625 np0000004400 cinder-backup[101319]: iface.tcp_timer_scale = 0 Jul 03 09:53:10.270625 np0000004400 cinder-backup[101319]: iface.tcp_timestamp = Jul 03 09:53:10.270625 np0000004400 cinder-backup[101319]: iface.redirect = Jul 03 09:53:10.270625 np0000004400 cinder-backup[101319]: iface.def_task_mgmt_timeout = 0 Jul 03 09:53:10.270625 np0000004400 cinder-backup[101319]: iface.header_digest = Jul 03 09:53:10.270625 np0000004400 cinder-backup[101319]: iface.data_digest = Jul 03 09:53:10.270625 np0000004400 cinder-backup[101319]: iface.immediate_data = Jul 03 09:53:10.270625 np0000004400 cinder-backup[101319]: iface.initial_r2t = Jul 03 09:53:10.270625 np0000004400 cinder-backup[101319]: iface.data_seq_inorder = Jul 03 09:53:10.270625 np0000004400 cinder-backup[101319]: iface.data_pdu_inorder = Jul 03 09:53:10.270625 np0000004400 cinder-backup[101319]: iface.erl = 0 Jul 03 09:53:10.270625 np0000004400 cinder-backup[101319]: iface.max_receive_data_len = 0 Jul 03 09:53:10.270625 np0000004400 cinder-backup[101319]: iface.first_burst_len = 0 Jul 03 09:53:10.270625 np0000004400 cinder-backup[101319]: iface.max_outstanding_r2t = 0 Jul 03 09:53:10.270625 np0000004400 cinder-backup[101319]: iface.max_burst_len = 0 Jul 03 09:53:10.270625 np0000004400 cinder-backup[101319]: iface.chap_auth = Jul 03 09:53:10.270625 np0000004400 cinder-backup[101319]: iface.bidi_chap = Jul 03 09:53:10.270625 np0000004400 cinder-backup[101319]: iface.strict_login_compliance = Jul 03 09:53:10.270625 np0000004400 cinder-backup[101319]: iface.discovery_auth = Jul 03 09:53:10.270625 np0000004400 cinder-backup[101319]: iface.discovery_logout = Jul 03 09:53:10.270625 np0000004400 cinder-backup[101319]: node.discovery_address = Jul 03 09:53:10.270625 np0000004400 cinder-backup[101319]: node.discovery_port = 0 Jul 03 09:53:10.270625 np0000004400 cinder-backup[101319]: node.discovery_type = fw Jul 03 09:53:10.270625 np0000004400 cinder-backup[101319]: node.session.initial_cmdsn = 0 Jul 03 09:53:10.270625 np0000004400 cinder-backup[101319]: node.session.initial_login_retry_max = 8 Jul 03 09:53:10.270625 np0000004400 cinder-backup[101319]: node.session.xmit_thread_priority = 0 Jul 03 09:53:10.270625 np0000004400 cinder-backup[101319]: node.session.cmds_max = 128 Jul 03 09:53:10.270625 np0000004400 cinder-backup[101319]: node.session.queue_depth = 32 Jul 03 09:53:10.270625 np0000004400 cinder-backup[101319]: node.session.nr_sessions = 1 Jul 03 09:53:10.270625 np0000004400 cinder-backup[101319]: node.session.auth.authmethod = None Jul 03 09:53:10.270625 np0000004400 cinder-backup[101319]: node.session.auth.username = Jul 03 09:53:10.270625 np0000004400 cinder-backup[101319]: node.session.auth.password = *** Jul 03 09:53:10.270625 np0000004400 cinder-backup[101319]: node.session.auth.username_in = Jul 03 09:53:10.270625 np0000004400 cinder-backup[101319]: node.session.auth.password_in = Jul 03 09:53:10.270625 np0000004400 cinder-backup[101319]: node.session.auth.chap_algs = SHA256 Jul 03 09:53:10.270625 np0000004400 cinder-backup[101319]: node.session.timeo.replacement_timeout = 120 Jul 03 09:53:10.270625 np0000004400 cinder-backup[101319]: node.session.err_timeo.abort_timeout = 15 Jul 03 09:53:10.270625 np0000004400 cinder-backup[101319]: node.session.err_timeo.lu_reset_timeout = 30 Jul 03 09:53:10.270625 np0000004400 cinder-backup[101319]: node.session.err_timeo.tgt_reset_timeout = 30 Jul 03 09:53:10.270625 np0000004400 cinder-backup[101319]: node.session.err_timeo.host_reset_timeout = 60 Jul 03 09:53:10.270625 np0000004400 cinder-backup[101319]: node.session.iscsi.FastAbort = Yes Jul 03 09:53:10.270625 np0000004400 cinder-backup[101319]: node.session.iscsi.InitialR2T = No Jul 03 09:53:10.270625 np0000004400 cinder-backup[101319]: node.session.iscsi.ImmediateData = Yes Jul 03 09:53:10.270625 np0000004400 cinder-backup[101319]: node.session.iscsi.FirstBurstLength = 262144 Jul 03 09:53:10.270625 np0000004400 cinder-backup[101319]: node.session.iscsi.MaxBurstLength = 16776192 Jul 03 09:53:10.270625 np0000004400 cinder-backup[101319]: node.session.iscsi.DefaultTime2Retain = 0 Jul 03 09:53:10.270625 np0000004400 cinder-backup[101319]: node.session.iscsi.DefaultTime2Wait = 2 Jul 03 09:53:10.270625 np0000004400 cinder-backup[101319]: node.session.iscsi.MaxConnections = 1 Jul 03 09:53:10.270625 np0000004400 cinder-backup[101319]: node.session.iscsi.MaxOutstandingR2T = 1 Jul 03 09:53:10.270625 np0000004400 cinder-backup[101319]: node.session.iscsi.ERL = 0 Jul 03 09:53:10.270625 np0000004400 cinder-backup[101319]: node.session.scan = auto Jul 03 09:53:10.270625 np0000004400 cinder-backup[101319]: node.session.reopen_max = 0 Jul 03 09:53:10.270625 np0000004400 cinder-backup[101319]: node.conn[0].address = 192.168.40.100 Jul 03 09:53:10.270625 np0000004400 cinder-backup[101319]: node.conn[0].port = 3260 Jul 03 09:53:10.270625 np0000004400 cinder-backup[101319]: node.conn[0].startup = manual Jul 03 09:53:10.270625 np0000004400 cinder-backup[101319]: node.conn[0].tcp.window_size = 524288 Jul 03 09:53:10.270625 np0000004400 cinder-backup[101319]: node.conn[0].tcp.type_of_service = 0 Jul 03 09:53:10.270625 np0000004400 cinder-backup[101319]: node.conn[0].timeo.logout_timeout = 15 Jul 03 09:53:10.270625 np0000004400 cinder-backup[101319]: node.conn[0].timeo.login_timeout = 15 Jul 03 09:53:10.270625 np0000004400 cinder-backup[101319]: node.conn[0].timeo.auth_timeout = 45 Jul 03 09:53:10.270625 np0000004400 cinder-backup[101319]: node.conn[0].timeo.noop_out_interval = 5 Jul 03 09:53:10.270625 np0000004400 cinder-backup[101319]: node.conn[0].timeo.noop_out_timeout = 5 Jul 03 09:53:10.270625 np0000004400 cinder-backup[101319]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0 Jul 03 09:53:10.270625 np0000004400 cinder-backup[101319]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144 Jul 03 09:53:10.270625 np0000004400 cinder-backup[101319]: node.conn[0].iscsi.HeaderDigest = None Jul 03 09:53:10.270625 np0000004400 cinder-backup[101319]: node.conn[0].iscsi.DataDigest = None Jul 03 09:53:10.270625 np0000004400 cinder-backup[101319]: node.conn[0].iscsi.IFMarker = No Jul 03 09:53:10.270625 np0000004400 cinder-backup[101319]: node.conn[0].iscsi.OFMarker = No Jul 03 09:53:10.270625 np0000004400 cinder-backup[101319]: # END RECORD Jul 03 09:53:10.270625 np0000004400 cinder-backup[101319]: stderr= {{(pid=101319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 03 09:53:10.281094 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-904329c4-9ef6-4056-95e0-4524f15f09c7 tempest-ProjectReaderTests33-761902925 None] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=101319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 03 09:53:10.293426 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-904329c4-9ef6-4056-95e0-4524f15f09c7 tempest-ProjectReaderTests33-761902925 None] iscsiadm ('-m', 'session'): stdout=tcp: [188] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-491c39b6-d2e0-4f67-9a64-590d50f06197 (non-flash) Jul 03 09:53:10.293426 np0000004400 cinder-backup[101319]: tcp: [189] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-491c39b6-d2e0-4f67-9a64-590d50f06197 (non-flash) Jul 03 09:53:10.293426 np0000004400 cinder-backup[101319]: tcp: [193] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-148b330f-fb7d-42d3-bf2f-98c1eeab9e3c (non-flash) Jul 03 09:53:10.293426 np0000004400 cinder-backup[101319]: tcp: [194] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-148b330f-fb7d-42d3-bf2f-98c1eeab9e3c (non-flash) Jul 03 09:53:10.293426 np0000004400 cinder-backup[101319]: tcp: [195] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-bb206076-56d3-4255-8607-10b3ef732cbb (non-flash) Jul 03 09:53:10.293426 np0000004400 cinder-backup[101319]: stderr= {{(pid=101319) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jul 03 09:53:10.293734 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-904329c4-9ef6-4056-95e0-4524f15f09c7 tempest-ProjectReaderTests33-761902925 None] iscsi session list stdout=tcp: [188] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-491c39b6-d2e0-4f67-9a64-590d50f06197 (non-flash) Jul 03 09:53:10.293734 np0000004400 cinder-backup[101319]: tcp: [189] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-491c39b6-d2e0-4f67-9a64-590d50f06197 (non-flash) Jul 03 09:53:10.293734 np0000004400 cinder-backup[101319]: tcp: [193] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-148b330f-fb7d-42d3-bf2f-98c1eeab9e3c (non-flash) Jul 03 09:53:10.293734 np0000004400 cinder-backup[101319]: tcp: [194] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-148b330f-fb7d-42d3-bf2f-98c1eeab9e3c (non-flash) Jul 03 09:53:10.293734 np0000004400 cinder-backup[101319]: tcp: [195] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-bb206076-56d3-4255-8607-10b3ef732cbb (non-flash) Jul 03 09:53:10.293734 np0000004400 cinder-backup[101319]: stderr= {{(pid=101319) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jul 03 09:53:10.325812 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-904329c4-9ef6-4056-95e0-4524f15f09c7 tempest-ProjectReaderTests33-761902925 None] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-91385958-bc9a-4b5d-ac21-22d57700a0e4, portal: 192.168.40.100,3260] Jul 03 09:53:10.325812 np0000004400 cinder-backup[101319]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-91385958-bc9a-4b5d-ac21-22d57700a0e4, portal: 192.168.40.100,3260] successful. Jul 03 09:53:10.325812 np0000004400 cinder-backup[101319]: stderr= {{(pid=101319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 03 09:53:10.336618 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-86249081-dcdf-44d7-a2b2-6285d268a4bd tempest-VolumesBackupsTest-1484886458 None] backup MD5 for volume_bb206076-56d3-4255-8607-10b3ef732cbb/20260703095306/az_nova_backup_dddedc88-ea25-4f5d-b989-944d0094b292-00008: 25e317773f308e446cc84c503a6d1f85 {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 09:53:10.336792 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-86249081-dcdf-44d7-a2b2-6285d268a4bd tempest-VolumesBackupsTest-1484886458 None] Calling eventlet.sleep(0) {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 09:53:10.338162 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-904329c4-9ef6-4056-95e0-4524f15f09c7 tempest-ProjectReaderTests33-761902925 None] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=101319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 03 09:53:10.352820 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-904329c4-9ef6-4056-95e0-4524f15f09c7 tempest-ProjectReaderTests33-761902925 None] iscsiadm ('-m', 'session'): stdout=tcp: [188] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-491c39b6-d2e0-4f67-9a64-590d50f06197 (non-flash) Jul 03 09:53:10.352820 np0000004400 cinder-backup[101319]: tcp: [189] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-491c39b6-d2e0-4f67-9a64-590d50f06197 (non-flash) Jul 03 09:53:10.352820 np0000004400 cinder-backup[101319]: tcp: [193] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-148b330f-fb7d-42d3-bf2f-98c1eeab9e3c (non-flash) Jul 03 09:53:10.352820 np0000004400 cinder-backup[101319]: tcp: [194] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-148b330f-fb7d-42d3-bf2f-98c1eeab9e3c (non-flash) Jul 03 09:53:10.352820 np0000004400 cinder-backup[101319]: tcp: [195] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-bb206076-56d3-4255-8607-10b3ef732cbb (non-flash) Jul 03 09:53:10.352820 np0000004400 cinder-backup[101319]: tcp: [196] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-91385958-bc9a-4b5d-ac21-22d57700a0e4 (non-flash) Jul 03 09:53:10.352820 np0000004400 cinder-backup[101319]: stderr= {{(pid=101319) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jul 03 09:53:10.353025 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-904329c4-9ef6-4056-95e0-4524f15f09c7 tempest-ProjectReaderTests33-761902925 None] iscsi session list stdout=tcp: [188] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-491c39b6-d2e0-4f67-9a64-590d50f06197 (non-flash) Jul 03 09:53:10.353025 np0000004400 cinder-backup[101319]: tcp: [189] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-491c39b6-d2e0-4f67-9a64-590d50f06197 (non-flash) Jul 03 09:53:10.353025 np0000004400 cinder-backup[101319]: tcp: [193] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-148b330f-fb7d-42d3-bf2f-98c1eeab9e3c (non-flash) Jul 03 09:53:10.353025 np0000004400 cinder-backup[101319]: tcp: [194] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-148b330f-fb7d-42d3-bf2f-98c1eeab9e3c (non-flash) Jul 03 09:53:10.353025 np0000004400 cinder-backup[101319]: tcp: [195] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-bb206076-56d3-4255-8607-10b3ef732cbb (non-flash) Jul 03 09:53:10.353025 np0000004400 cinder-backup[101319]: tcp: [196] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-91385958-bc9a-4b5d-ac21-22d57700a0e4 (non-flash) Jul 03 09:53:10.353025 np0000004400 cinder-backup[101319]: stderr= {{(pid=101319) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jul 03 09:53:10.353371 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.base [None req-904329c4-9ef6-4056-95e0-4524f15f09c7 tempest-ProjectReaderTests33-761902925 None] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-91385958-bc9a-4b5d-ac21-22d57700a0e4" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.119s {{(pid=101319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jul 03 09:53:10.353559 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-904329c4-9ef6-4056-95e0-4524f15f09c7 tempest-ProjectReaderTests33-761902925 None] Connected to 192.168.40.100:3260 {{(pid=101319) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}} Jul 03 09:53:10.354342 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.linuxscsi [None req-904329c4-9ef6-4056-95e0-4524f15f09c7 tempest-ProjectReaderTests33-761902925 None] HCTL ('11', '-', '-', 0) found on session 196 with lun 0 {{(pid=101319) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}} Jul 03 09:53:10.354530 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.linuxscsi [None req-904329c4-9ef6-4056-95e0-4524f15f09c7 tempest-ProjectReaderTests33-761902925 None] Scanning host 11 c: -, t: -, l: 0) {{(pid=101319) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}} Jul 03 09:53:10.387680 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.linuxscsi [None req-904329c4-9ef6-4056-95e0-4524f15f09c7 tempest-ProjectReaderTests33-761902925 None] Searching for a device in session 196 and hctl ['11', '*', '*', 0] yield: sdf {{(pid=101319) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}} Jul 03 09:53:10.387930 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-904329c4-9ef6-4056-95e0-4524f15f09c7 tempest-ProjectReaderTests33-761902925 None] Connected to sdf using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-91385958-bc9a-4b5d-ac21-22d57700a0e4', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '91385958-bc9a-4b5d-ac21-22d57700a0e4', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': False} {{(pid=101319) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}} Jul 03 09:53:10.528567 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-86249081-dcdf-44d7-a2b2-6285d268a4bd tempest-VolumesBackupsTest-1484886458 None] Backing up chunk of data from volume. {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 09:53:10.769765 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-86249081-dcdf-44d7-a2b2-6285d268a4bd tempest-VolumesBackupsTest-1484886458 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101319) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 09:53:10.770117 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-86249081-dcdf-44d7-a2b2-6285d268a4bd tempest-VolumesBackupsTest-1484886458 None] About to put_object {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 09:53:10.871360 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-86249081-dcdf-44d7-a2b2-6285d268a4bd tempest-VolumesBackupsTest-1484886458 None] backup MD5 for volume_bb206076-56d3-4255-8607-10b3ef732cbb/20260703095306/az_nova_backup_dddedc88-ea25-4f5d-b989-944d0094b292-00009: 25e317773f308e446cc84c503a6d1f85 {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 09:53:10.871584 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-86249081-dcdf-44d7-a2b2-6285d268a4bd tempest-VolumesBackupsTest-1484886458 None] Calling eventlet.sleep(0) {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 09:53:11.041064 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-86249081-dcdf-44d7-a2b2-6285d268a4bd tempest-VolumesBackupsTest-1484886458 None] Backing up chunk of data from volume. {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 09:53:11.280925 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-86249081-dcdf-44d7-a2b2-6285d268a4bd tempest-VolumesBackupsTest-1484886458 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101319) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 09:53:11.281115 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-86249081-dcdf-44d7-a2b2-6285d268a4bd tempest-VolumesBackupsTest-1484886458 None] About to put_object {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 09:53:11.384951 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-86249081-dcdf-44d7-a2b2-6285d268a4bd tempest-VolumesBackupsTest-1484886458 None] backup MD5 for volume_bb206076-56d3-4255-8607-10b3ef732cbb/20260703095306/az_nova_backup_dddedc88-ea25-4f5d-b989-944d0094b292-00010: 25e317773f308e446cc84c503a6d1f85 {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 09:53:11.385162 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-86249081-dcdf-44d7-a2b2-6285d268a4bd tempest-VolumesBackupsTest-1484886458 None] Calling eventlet.sleep(0) {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 09:53:11.392188 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.base [None req-904329c4-9ef6-4056-95e0-4524f15f09c7 tempest-ProjectReaderTests33-761902925 None] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 2.171s {{(pid=101319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jul 03 09:53:11.392418 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-904329c4-9ef6-4056-95e0-4524f15f09c7 tempest-ProjectReaderTests33-761902925 None] <== connect_volume: return (2171ms) {'type': 'block', 'scsi_wwn': '1StorPooliSCSI_DISK_1034578903445799225', 'path': '/dev/sdf'} {{(pid=101319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}} Jul 03 09:53:11.392857 np0000004400 cinder-backup[101319]: DEBUG oslo_concurrency.processutils [None req-904329c4-9ef6-4056-95e0-4524f15f09c7 tempest-ProjectReaderTests33-761902925 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chown 1002 /dev/sdf {{(pid=101319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 09:53:11.451913 np0000004400 sudo[154060]: stack : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chown 1002 /dev/sdf Jul 03 09:53:11.454269 np0000004400 sudo[154060]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1002) Jul 03 09:53:11.575686 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-86249081-dcdf-44d7-a2b2-6285d268a4bd tempest-VolumesBackupsTest-1484886458 None] Backing up chunk of data from volume. {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 09:53:11.756204 np0000004400 sudo[154060]: pam_unix(sudo:session): session closed for user root Jul 03 09:53:11.758399 np0000004400 cinder-backup[101319]: DEBUG oslo_concurrency.processutils [None req-904329c4-9ef6-4056-95e0-4524f15f09c7 tempest-ProjectReaderTests33-761902925 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chown 1002 /dev/sdf" returned: 0 in 0.365s {{(pid=101319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 09:53:11.774965 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-904329c4-9ef6-4056-95e0-4524f15f09c7 tempest-ProjectReaderTests33-761902925 None] _create_container started, container: volumebackups,backup: 995de3de-d18a-4f2d-9b86-30dcb8a7d527. {{(pid=101319) _create_container /opt/stack/cinder/cinder/backup/chunkeddriver.py:249}} Jul 03 09:53:11.816386 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.drivers.swift [None req-904329c4-9ef6-4056-95e0-4524f15f09c7 tempest-ProjectReaderTests33-761902925 None] generate_object_name_prefix: volume_91385958-bc9a-4b5d-ac21-22d57700a0e4/20260703095311/az_nova_backup_995de3de-d18a-4f2d-9b86-30dcb8a7d527 {{(pid=101319) _generate_object_name_prefix /opt/stack/cinder/cinder/backup/drivers/swift.py:452}} Jul 03 09:53:11.823043 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-904329c4-9ef6-4056-95e0-4524f15f09c7 tempest-ProjectReaderTests33-761902925 None] starting backup of volume: 91385958-bc9a-4b5d-ac21-22d57700a0e4, volume size: 1073741824, object names prefix volume_91385958-bc9a-4b5d-ac21-22d57700a0e4/20260703095311/az_nova_backup_995de3de-d18a-4f2d-9b86-30dcb8a7d527, availability zone: nova {{(pid=101319) _prepare_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:359}} Jul 03 09:53:11.829039 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-86249081-dcdf-44d7-a2b2-6285d268a4bd tempest-VolumesBackupsTest-1484886458 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101319) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 09:53:11.829154 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-86249081-dcdf-44d7-a2b2-6285d268a4bd tempest-VolumesBackupsTest-1484886458 None] About to put_object {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 09:53:11.934985 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-86249081-dcdf-44d7-a2b2-6285d268a4bd tempest-VolumesBackupsTest-1484886458 None] backup MD5 for volume_bb206076-56d3-4255-8607-10b3ef732cbb/20260703095306/az_nova_backup_dddedc88-ea25-4f5d-b989-944d0094b292-00011: 25e317773f308e446cc84c503a6d1f85 {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 09:53:11.935147 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-86249081-dcdf-44d7-a2b2-6285d268a4bd tempest-VolumesBackupsTest-1484886458 None] Calling eventlet.sleep(0) {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 09:53:12.016250 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-904329c4-9ef6-4056-95e0-4524f15f09c7 tempest-ProjectReaderTests33-761902925 None] Backing up chunk of data from volume. {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 09:53:12.143320 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-86249081-dcdf-44d7-a2b2-6285d268a4bd tempest-VolumesBackupsTest-1484886458 None] Backing up chunk of data from volume. {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 09:53:12.254243 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-904329c4-9ef6-4056-95e0-4524f15f09c7 tempest-ProjectReaderTests33-761902925 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101319) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 09:53:12.254401 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-904329c4-9ef6-4056-95e0-4524f15f09c7 tempest-ProjectReaderTests33-761902925 None] About to put_object {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 09:53:12.353382 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-904329c4-9ef6-4056-95e0-4524f15f09c7 tempest-ProjectReaderTests33-761902925 None] backup MD5 for volume_91385958-bc9a-4b5d-ac21-22d57700a0e4/20260703095311/az_nova_backup_995de3de-d18a-4f2d-9b86-30dcb8a7d527-00001: 25e317773f308e446cc84c503a6d1f85 {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 09:53:12.353519 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-904329c4-9ef6-4056-95e0-4524f15f09c7 tempest-ProjectReaderTests33-761902925 None] Calling eventlet.sleep(0) {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 09:53:12.384867 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-86249081-dcdf-44d7-a2b2-6285d268a4bd tempest-VolumesBackupsTest-1484886458 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101319) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 09:53:12.385006 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-86249081-dcdf-44d7-a2b2-6285d268a4bd tempest-VolumesBackupsTest-1484886458 None] About to put_object {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 09:53:12.487034 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-86249081-dcdf-44d7-a2b2-6285d268a4bd tempest-VolumesBackupsTest-1484886458 None] backup MD5 for volume_bb206076-56d3-4255-8607-10b3ef732cbb/20260703095306/az_nova_backup_dddedc88-ea25-4f5d-b989-944d0094b292-00012: 25e317773f308e446cc84c503a6d1f85 {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 09:53:12.487248 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-86249081-dcdf-44d7-a2b2-6285d268a4bd tempest-VolumesBackupsTest-1484886458 None] Calling eventlet.sleep(0) {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 09:53:12.545309 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-904329c4-9ef6-4056-95e0-4524f15f09c7 tempest-ProjectReaderTests33-761902925 None] Backing up chunk of data from volume. {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 09:53:12.670086 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-86249081-dcdf-44d7-a2b2-6285d268a4bd tempest-VolumesBackupsTest-1484886458 None] Backing up chunk of data from volume. {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 09:53:12.802342 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-904329c4-9ef6-4056-95e0-4524f15f09c7 tempest-ProjectReaderTests33-761902925 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101319) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 09:53:12.802781 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-904329c4-9ef6-4056-95e0-4524f15f09c7 tempest-ProjectReaderTests33-761902925 None] About to put_object {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 09:53:12.904997 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-904329c4-9ef6-4056-95e0-4524f15f09c7 tempest-ProjectReaderTests33-761902925 None] backup MD5 for volume_91385958-bc9a-4b5d-ac21-22d57700a0e4/20260703095311/az_nova_backup_995de3de-d18a-4f2d-9b86-30dcb8a7d527-00002: 25e317773f308e446cc84c503a6d1f85 {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 09:53:12.905179 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-904329c4-9ef6-4056-95e0-4524f15f09c7 tempest-ProjectReaderTests33-761902925 None] Calling eventlet.sleep(0) {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 09:53:12.912484 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-86249081-dcdf-44d7-a2b2-6285d268a4bd tempest-VolumesBackupsTest-1484886458 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101319) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 09:53:12.912635 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-86249081-dcdf-44d7-a2b2-6285d268a4bd tempest-VolumesBackupsTest-1484886458 None] About to put_object {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 09:53:13.012911 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-86249081-dcdf-44d7-a2b2-6285d268a4bd tempest-VolumesBackupsTest-1484886458 None] backup MD5 for volume_bb206076-56d3-4255-8607-10b3ef732cbb/20260703095306/az_nova_backup_dddedc88-ea25-4f5d-b989-944d0094b292-00013: 25e317773f308e446cc84c503a6d1f85 {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 09:53:13.013361 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-86249081-dcdf-44d7-a2b2-6285d268a4bd tempest-VolumesBackupsTest-1484886458 None] Calling eventlet.sleep(0) {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 09:53:13.103570 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-904329c4-9ef6-4056-95e0-4524f15f09c7 tempest-ProjectReaderTests33-761902925 None] Backing up chunk of data from volume. {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 09:53:13.221092 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-86249081-dcdf-44d7-a2b2-6285d268a4bd tempest-VolumesBackupsTest-1484886458 None] Backing up chunk of data from volume. {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 09:53:13.350921 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-904329c4-9ef6-4056-95e0-4524f15f09c7 tempest-ProjectReaderTests33-761902925 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101319) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 09:53:13.351130 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-904329c4-9ef6-4056-95e0-4524f15f09c7 tempest-ProjectReaderTests33-761902925 None] About to put_object {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 09:53:13.456047 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-904329c4-9ef6-4056-95e0-4524f15f09c7 tempest-ProjectReaderTests33-761902925 None] backup MD5 for volume_91385958-bc9a-4b5d-ac21-22d57700a0e4/20260703095311/az_nova_backup_995de3de-d18a-4f2d-9b86-30dcb8a7d527-00003: 25e317773f308e446cc84c503a6d1f85 {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 09:53:13.456269 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-904329c4-9ef6-4056-95e0-4524f15f09c7 tempest-ProjectReaderTests33-761902925 None] Calling eventlet.sleep(0) {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 09:53:13.464514 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-86249081-dcdf-44d7-a2b2-6285d268a4bd tempest-VolumesBackupsTest-1484886458 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101319) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 09:53:13.464698 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-86249081-dcdf-44d7-a2b2-6285d268a4bd tempest-VolumesBackupsTest-1484886458 None] About to put_object {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 09:53:13.577122 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-86249081-dcdf-44d7-a2b2-6285d268a4bd tempest-VolumesBackupsTest-1484886458 None] backup MD5 for volume_bb206076-56d3-4255-8607-10b3ef732cbb/20260703095306/az_nova_backup_dddedc88-ea25-4f5d-b989-944d0094b292-00014: 25e317773f308e446cc84c503a6d1f85 {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 09:53:13.577314 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-86249081-dcdf-44d7-a2b2-6285d268a4bd tempest-VolumesBackupsTest-1484886458 None] Calling eventlet.sleep(0) {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 09:53:13.649580 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-904329c4-9ef6-4056-95e0-4524f15f09c7 tempest-ProjectReaderTests33-761902925 None] Backing up chunk of data from volume. {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 09:53:13.771449 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-86249081-dcdf-44d7-a2b2-6285d268a4bd tempest-VolumesBackupsTest-1484886458 None] Backing up chunk of data from volume. {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 09:53:13.890137 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-904329c4-9ef6-4056-95e0-4524f15f09c7 tempest-ProjectReaderTests33-761902925 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101319) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 09:53:13.890582 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-904329c4-9ef6-4056-95e0-4524f15f09c7 tempest-ProjectReaderTests33-761902925 None] About to put_object {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 09:53:14.010873 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-86249081-dcdf-44d7-a2b2-6285d268a4bd tempest-VolumesBackupsTest-1484886458 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101319) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 09:53:14.011052 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-86249081-dcdf-44d7-a2b2-6285d268a4bd tempest-VolumesBackupsTest-1484886458 None] About to put_object {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 09:53:14.094780 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-904329c4-9ef6-4056-95e0-4524f15f09c7 tempest-ProjectReaderTests33-761902925 None] backup MD5 for volume_91385958-bc9a-4b5d-ac21-22d57700a0e4/20260703095311/az_nova_backup_995de3de-d18a-4f2d-9b86-30dcb8a7d527-00004: 25e317773f308e446cc84c503a6d1f85 {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 09:53:14.094981 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-904329c4-9ef6-4056-95e0-4524f15f09c7 tempest-ProjectReaderTests33-761902925 None] Calling eventlet.sleep(0) {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 09:53:14.116449 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-86249081-dcdf-44d7-a2b2-6285d268a4bd tempest-VolumesBackupsTest-1484886458 None] backup MD5 for volume_bb206076-56d3-4255-8607-10b3ef732cbb/20260703095306/az_nova_backup_dddedc88-ea25-4f5d-b989-944d0094b292-00015: 25e317773f308e446cc84c503a6d1f85 {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 09:53:14.116652 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-86249081-dcdf-44d7-a2b2-6285d268a4bd tempest-VolumesBackupsTest-1484886458 None] Calling eventlet.sleep(0) {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 09:53:14.401021 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-904329c4-9ef6-4056-95e0-4524f15f09c7 tempest-ProjectReaderTests33-761902925 None] Backing up chunk of data from volume. {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 09:53:14.422160 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-86249081-dcdf-44d7-a2b2-6285d268a4bd tempest-VolumesBackupsTest-1484886458 None] Backing up chunk of data from volume. {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 09:53:14.665087 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-904329c4-9ef6-4056-95e0-4524f15f09c7 tempest-ProjectReaderTests33-761902925 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101319) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 09:53:14.665267 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-904329c4-9ef6-4056-95e0-4524f15f09c7 tempest-ProjectReaderTests33-761902925 None] About to put_object {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 09:53:14.694522 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-86249081-dcdf-44d7-a2b2-6285d268a4bd tempest-VolumesBackupsTest-1484886458 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101319) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 09:53:14.694680 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-86249081-dcdf-44d7-a2b2-6285d268a4bd tempest-VolumesBackupsTest-1484886458 None] About to put_object {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 09:53:14.763242 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-904329c4-9ef6-4056-95e0-4524f15f09c7 tempest-ProjectReaderTests33-761902925 None] backup MD5 for volume_91385958-bc9a-4b5d-ac21-22d57700a0e4/20260703095311/az_nova_backup_995de3de-d18a-4f2d-9b86-30dcb8a7d527-00005: 25e317773f308e446cc84c503a6d1f85 {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 09:53:14.763455 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-904329c4-9ef6-4056-95e0-4524f15f09c7 tempest-ProjectReaderTests33-761902925 None] Calling eventlet.sleep(0) {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 09:53:14.798660 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-86249081-dcdf-44d7-a2b2-6285d268a4bd tempest-VolumesBackupsTest-1484886458 None] backup MD5 for volume_bb206076-56d3-4255-8607-10b3ef732cbb/20260703095306/az_nova_backup_dddedc88-ea25-4f5d-b989-944d0094b292-00016: 25e317773f308e446cc84c503a6d1f85 {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 09:53:14.798820 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-86249081-dcdf-44d7-a2b2-6285d268a4bd tempest-VolumesBackupsTest-1484886458 None] Calling eventlet.sleep(0) {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 09:53:15.006979 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-904329c4-9ef6-4056-95e0-4524f15f09c7 tempest-ProjectReaderTests33-761902925 None] Backing up chunk of data from volume. {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 09:53:15.049652 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-86249081-dcdf-44d7-a2b2-6285d268a4bd tempest-VolumesBackupsTest-1484886458 None] Backing up chunk of data from volume. {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 09:53:15.258489 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-904329c4-9ef6-4056-95e0-4524f15f09c7 tempest-ProjectReaderTests33-761902925 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101319) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 09:53:15.258683 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-904329c4-9ef6-4056-95e0-4524f15f09c7 tempest-ProjectReaderTests33-761902925 None] About to put_object {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 09:53:15.303551 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-86249081-dcdf-44d7-a2b2-6285d268a4bd tempest-VolumesBackupsTest-1484886458 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101319) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 09:53:15.303754 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-86249081-dcdf-44d7-a2b2-6285d268a4bd tempest-VolumesBackupsTest-1484886458 None] About to put_object {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 09:53:15.363221 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-904329c4-9ef6-4056-95e0-4524f15f09c7 tempest-ProjectReaderTests33-761902925 None] backup MD5 for volume_91385958-bc9a-4b5d-ac21-22d57700a0e4/20260703095311/az_nova_backup_995de3de-d18a-4f2d-9b86-30dcb8a7d527-00006: 25e317773f308e446cc84c503a6d1f85 {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 09:53:15.363360 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-904329c4-9ef6-4056-95e0-4524f15f09c7 tempest-ProjectReaderTests33-761902925 None] Calling eventlet.sleep(0) {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 09:53:15.412995 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-86249081-dcdf-44d7-a2b2-6285d268a4bd tempest-VolumesBackupsTest-1484886458 None] backup MD5 for volume_bb206076-56d3-4255-8607-10b3ef732cbb/20260703095306/az_nova_backup_dddedc88-ea25-4f5d-b989-944d0094b292-00017: 25e317773f308e446cc84c503a6d1f85 {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 09:53:15.413247 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-86249081-dcdf-44d7-a2b2-6285d268a4bd tempest-VolumesBackupsTest-1484886458 None] Calling eventlet.sleep(0) {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 09:53:15.603966 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-904329c4-9ef6-4056-95e0-4524f15f09c7 tempest-ProjectReaderTests33-761902925 None] Backing up chunk of data from volume. {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 09:53:15.664789 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-86249081-dcdf-44d7-a2b2-6285d268a4bd tempest-VolumesBackupsTest-1484886458 None] Backing up chunk of data from volume. {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 09:53:15.846847 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-904329c4-9ef6-4056-95e0-4524f15f09c7 tempest-ProjectReaderTests33-761902925 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101319) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 09:53:15.847085 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-904329c4-9ef6-4056-95e0-4524f15f09c7 tempest-ProjectReaderTests33-761902925 None] About to put_object {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 09:53:15.917289 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-86249081-dcdf-44d7-a2b2-6285d268a4bd tempest-VolumesBackupsTest-1484886458 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101319) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 09:53:15.917474 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-86249081-dcdf-44d7-a2b2-6285d268a4bd tempest-VolumesBackupsTest-1484886458 None] About to put_object {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 09:53:15.953630 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-904329c4-9ef6-4056-95e0-4524f15f09c7 tempest-ProjectReaderTests33-761902925 None] backup MD5 for volume_91385958-bc9a-4b5d-ac21-22d57700a0e4/20260703095311/az_nova_backup_995de3de-d18a-4f2d-9b86-30dcb8a7d527-00007: 25e317773f308e446cc84c503a6d1f85 {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 09:53:15.953805 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-904329c4-9ef6-4056-95e0-4524f15f09c7 tempest-ProjectReaderTests33-761902925 None] Calling eventlet.sleep(0) {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 09:53:16.021814 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-86249081-dcdf-44d7-a2b2-6285d268a4bd tempest-VolumesBackupsTest-1484886458 None] backup MD5 for volume_bb206076-56d3-4255-8607-10b3ef732cbb/20260703095306/az_nova_backup_dddedc88-ea25-4f5d-b989-944d0094b292-00018: 25e317773f308e446cc84c503a6d1f85 {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 09:53:16.022215 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-86249081-dcdf-44d7-a2b2-6285d268a4bd tempest-VolumesBackupsTest-1484886458 None] Calling eventlet.sleep(0) {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 09:53:16.166513 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-904329c4-9ef6-4056-95e0-4524f15f09c7 tempest-ProjectReaderTests33-761902925 None] Backing up chunk of data from volume. {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 09:53:16.253223 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-86249081-dcdf-44d7-a2b2-6285d268a4bd tempest-VolumesBackupsTest-1484886458 None] Backing up chunk of data from volume. {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 09:53:16.411097 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-904329c4-9ef6-4056-95e0-4524f15f09c7 tempest-ProjectReaderTests33-761902925 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101319) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 09:53:16.411164 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-904329c4-9ef6-4056-95e0-4524f15f09c7 tempest-ProjectReaderTests33-761902925 None] About to put_object {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 09:53:16.509162 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-86249081-dcdf-44d7-a2b2-6285d268a4bd tempest-VolumesBackupsTest-1484886458 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101319) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 09:53:16.509383 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-86249081-dcdf-44d7-a2b2-6285d268a4bd tempest-VolumesBackupsTest-1484886458 None] About to put_object {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 09:53:16.522793 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-904329c4-9ef6-4056-95e0-4524f15f09c7 tempest-ProjectReaderTests33-761902925 None] backup MD5 for volume_91385958-bc9a-4b5d-ac21-22d57700a0e4/20260703095311/az_nova_backup_995de3de-d18a-4f2d-9b86-30dcb8a7d527-00008: 25e317773f308e446cc84c503a6d1f85 {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 09:53:16.522970 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-904329c4-9ef6-4056-95e0-4524f15f09c7 tempest-ProjectReaderTests33-761902925 None] Calling eventlet.sleep(0) {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 09:53:16.618854 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-86249081-dcdf-44d7-a2b2-6285d268a4bd tempest-VolumesBackupsTest-1484886458 None] backup MD5 for volume_bb206076-56d3-4255-8607-10b3ef732cbb/20260703095306/az_nova_backup_dddedc88-ea25-4f5d-b989-944d0094b292-00019: 25e317773f308e446cc84c503a6d1f85 {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 09:53:16.618975 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-86249081-dcdf-44d7-a2b2-6285d268a4bd tempest-VolumesBackupsTest-1484886458 None] Calling eventlet.sleep(0) {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 09:53:16.755045 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-904329c4-9ef6-4056-95e0-4524f15f09c7 tempest-ProjectReaderTests33-761902925 None] Backing up chunk of data from volume. {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 09:53:16.838977 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-86249081-dcdf-44d7-a2b2-6285d268a4bd tempest-VolumesBackupsTest-1484886458 None] Backing up chunk of data from volume. {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 09:53:17.008232 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-904329c4-9ef6-4056-95e0-4524f15f09c7 tempest-ProjectReaderTests33-761902925 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101319) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 09:53:17.008366 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-904329c4-9ef6-4056-95e0-4524f15f09c7 tempest-ProjectReaderTests33-761902925 None] About to put_object {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 09:53:17.092925 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-86249081-dcdf-44d7-a2b2-6285d268a4bd tempest-VolumesBackupsTest-1484886458 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101319) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 09:53:17.093335 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-86249081-dcdf-44d7-a2b2-6285d268a4bd tempest-VolumesBackupsTest-1484886458 None] About to put_object {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 09:53:17.110873 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-904329c4-9ef6-4056-95e0-4524f15f09c7 tempest-ProjectReaderTests33-761902925 None] backup MD5 for volume_91385958-bc9a-4b5d-ac21-22d57700a0e4/20260703095311/az_nova_backup_995de3de-d18a-4f2d-9b86-30dcb8a7d527-00009: 25e317773f308e446cc84c503a6d1f85 {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 09:53:17.111046 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-904329c4-9ef6-4056-95e0-4524f15f09c7 tempest-ProjectReaderTests33-761902925 None] Calling eventlet.sleep(0) {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 09:53:17.205139 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-86249081-dcdf-44d7-a2b2-6285d268a4bd tempest-VolumesBackupsTest-1484886458 None] backup MD5 for volume_bb206076-56d3-4255-8607-10b3ef732cbb/20260703095306/az_nova_backup_dddedc88-ea25-4f5d-b989-944d0094b292-00020: 25e317773f308e446cc84c503a6d1f85 {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 09:53:17.205306 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-86249081-dcdf-44d7-a2b2-6285d268a4bd tempest-VolumesBackupsTest-1484886458 None] Calling eventlet.sleep(0) {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 09:53:17.333834 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-86249081-dcdf-44d7-a2b2-6285d268a4bd tempest-VolumesBackupsTest-1484886458 None] Backing up chunk of data from volume. {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 09:53:17.342827 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-904329c4-9ef6-4056-95e0-4524f15f09c7 tempest-ProjectReaderTests33-761902925 None] Backing up chunk of data from volume. {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 09:53:17.449531 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-86249081-dcdf-44d7-a2b2-6285d268a4bd tempest-VolumesBackupsTest-1484886458 None] Compressed 25165824 bytes of data to 24470 bytes using zlib. {{(pid=101319) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 09:53:17.449670 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-86249081-dcdf-44d7-a2b2-6285d268a4bd tempest-VolumesBackupsTest-1484886458 None] About to put_object {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 09:53:17.512916 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-86249081-dcdf-44d7-a2b2-6285d268a4bd tempest-VolumesBackupsTest-1484886458 None] backup MD5 for volume_bb206076-56d3-4255-8607-10b3ef732cbb/20260703095306/az_nova_backup_dddedc88-ea25-4f5d-b989-944d0094b292-00021: 77377273b0a4b61febdbf7bbf52b9db9 {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 09:53:17.513194 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-86249081-dcdf-44d7-a2b2-6285d268a4bd tempest-VolumesBackupsTest-1484886458 None] Calling eventlet.sleep(0) {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 09:53:17.525429 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.driver [None req-86249081-dcdf-44d7-a2b2-6285d268a4bd tempest-VolumesBackupsTest-1484886458 None] Getting metadata type 'volume-base-metadata' {{(pid=101319) _save_vol_base_meta /opt/stack/cinder/cinder/backup/driver.py:79}} Jul 03 09:53:17.538472 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.driver [None req-86249081-dcdf-44d7-a2b2-6285d268a4bd tempest-VolumesBackupsTest-1484886458 None] Completed fetching metadata type 'volume-base-metadata' {{(pid=101319) _save_vol_base_meta /opt/stack/cinder/cinder/backup/driver.py:98}} Jul 03 09:53:17.538654 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.driver [None req-86249081-dcdf-44d7-a2b2-6285d268a4bd tempest-VolumesBackupsTest-1484886458 None] Getting metadata type 'volume-metadata' {{(pid=101319) _save_vol_meta /opt/stack/cinder/cinder/backup/driver.py:109}} Jul 03 09:53:17.543839 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.driver [None req-86249081-dcdf-44d7-a2b2-6285d268a4bd tempest-VolumesBackupsTest-1484886458 None] No metadata type 'volume-metadata' available {{(pid=101319) _save_vol_meta /opt/stack/cinder/cinder/backup/driver.py:123}} Jul 03 09:53:17.544002 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.driver [None req-86249081-dcdf-44d7-a2b2-6285d268a4bd tempest-VolumesBackupsTest-1484886458 None] Getting metadata type 'volume-glance-metadata' {{(pid=101319) _save_vol_glance_meta /opt/stack/cinder/cinder/backup/driver.py:132}} Jul 03 09:53:17.547094 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.driver [None req-86249081-dcdf-44d7-a2b2-6285d268a4bd tempest-VolumesBackupsTest-1484886458 None] No metadata type 'volume-glance-metadata' available {{(pid=101319) _save_vol_glance_meta /opt/stack/cinder/cinder/backup/driver.py:147}} Jul 03 09:53:17.547340 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-86249081-dcdf-44d7-a2b2-6285d268a4bd tempest-VolumesBackupsTest-1484886458 None] _write_sha256file started, container name: volumebackups, sha256file filename: volume_bb206076-56d3-4255-8607-10b3ef732cbb/20260703095306/az_nova_backup_dddedc88-ea25-4f5d-b989-944d0094b292_sha256file. {{(pid=101319) _write_sha256file /opt/stack/cinder/cinder/backup/chunkeddriver.py:299}} Jul 03 09:53:17.594381 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-904329c4-9ef6-4056-95e0-4524f15f09c7 tempest-ProjectReaderTests33-761902925 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101319) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 09:53:17.594568 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-904329c4-9ef6-4056-95e0-4524f15f09c7 tempest-ProjectReaderTests33-761902925 None] About to put_object {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 09:53:17.605671 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-86249081-dcdf-44d7-a2b2-6285d268a4bd tempest-VolumesBackupsTest-1484886458 None] _write_sha256file finished. {{(pid=101319) _write_sha256file /opt/stack/cinder/cinder/backup/chunkeddriver.py:315}} Jul 03 09:53:17.606244 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-86249081-dcdf-44d7-a2b2-6285d268a4bd tempest-VolumesBackupsTest-1484886458 None] _write_metadata started, container name: volumebackups, metadata filename: volume_bb206076-56d3-4255-8607-10b3ef732cbb/20260703095306/az_nova_backup_dddedc88-ea25-4f5d-b989-944d0094b292_metadata. {{(pid=101319) _write_metadata /opt/stack/cinder/cinder/backup/chunkeddriver.py:276}} Jul 03 09:53:17.627343 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-86249081-dcdf-44d7-a2b2-6285d268a4bd tempest-VolumesBackupsTest-1484886458 None] _write_metadata finished. Metadata: b'{\n "backup_description": null,\n "backup_id": "dddedc88-ea25-4f5d-b989-944d0094b292",\n "backup_name": "tempest-VolumesBackupsTest-Backup-1752604285",\n "created_at": "2026-07-03 09:53:02+00:00",\n "objects": [\n {\n "volume_bb206076-56d3-4255-8607-10b3ef732cbb/20260703095306/az_nova_backup_dddedc88-ea25-4f5d-b989-944d0094b292-00001": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 0\n }\n },\n {\n "volume_bb206076-56d3-4255-8607-10b3ef732cbb/20260703095306/az_nova_backup_dddedc88-ea25-4f5d-b989-944d0094b292-00002": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 52428800\n }\n },\n {\n "volume_bb206076-56d3-4255-8607-10b3ef732cbb/20260703095306/az_nova_backup_dddedc88-ea25-4f5d-b989-944d0094b292-00003": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 104857600\n }\n },\n {\n "volume_bb206076-56d3-4255-8607-10b3ef732cbb/20260703095306/az_nova_backup_dddedc88-ea25-4f5d-b989-944d0094b292-00004": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 157286400\n }\n },\n {\n "volume_bb206076-56d3-4255-8607-10b3ef732cbb/20260703095306/az_nova_backup_dddedc88-ea25-4f5d-b989-944d0094b292-00005": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 209715200\n }\n },\n {\n "volume_bb206076-56d3-4255-8607-10b3ef732cbb/20260703095306/az_nova_backup_dddedc88-ea25-4f5d-b989-944d0094b292-00006": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 262144000\n }\n },\n {\n "volume_bb206076-56d3-4255-8607-10b3ef732cbb/20260703095306/az_nova_backup_dddedc88-ea25-4f5d-b989-944d0094b292-00007": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 314572800\n }\n },\n {\n "volume_bb206076-56d3-4255-8607-10b3ef732cbb/20260703095306/az_nova_backup_dddedc88-ea25-4f5d-b989-944d0094b292-00008": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 367001600\n }\n },\n {\n "volume_bb206076-56d3-4255-8607-10b3ef732cbb/20260703095306/az_nova_backup_dddedc88-ea25-4f5d-b989-944d0094b292-00009": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 419430400\n }\n },\n {\n "volume_bb206076-56d3-4255-8607-10b3ef732cbb/20260703095306/az_nova_backup_dddedc88-ea25-4f5d-b989-944d0094b292-00010": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 471859200\n }\n },\n {\n "volume_bb206076-56d3-4255-8607-10b3ef732cbb/20260703095306/az_nova_backup_dddedc88-ea25-4f5d-b989-944d0094b292-00011": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 524288000\n }\n },\n {\n "volume_bb206076-56d3-4255-8607-10b3ef732cbb/20260703095306/az_nova_backup_dddedc88-ea25-4f5d-b989-944d0094b292-00012": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 576716800\n }\n },\n {\n "volume_bb206076-56d3-4255-8607-10b3ef732cbb/20260703095306/az_nova_backup_dddedc88-ea25-4f5d-b989-944d0094b292-00013": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 629145600\n }\n },\n {\n "volume_bb206076-56d3-4255-8607-10b3ef732cbb/20260703095306/az_nova_backup_dddedc88-ea25-4f5d-b989-944d0094b292-00014": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 681574400\n }\n },\n {\n "volume_bb206076-56d3-4255-8607-10b3ef732cbb/20260703095306/az_nova_backup_dddedc88-ea25-4f5d-b989-944d0094b292-00015": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 734003200\n }\n },\n {\n "volume_bb206076-56d3-4255-8607-10b3ef732cbb/20260703095306/az_nova_backup_dddedc88-ea25-4f5d-b989-944d0094b292-00016": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 786432000\n }\n },\n {\n "volume_bb206076-56d3-4255-8607-10b3ef732cbb/20260703095306/az_nova_backup_dddedc88-ea25-4f5d-b989-944d0094b292-00017": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 838860800\n }\n },\n {\n "volume_bb206076-56d3-4255-8607-10b3ef732cbb/20260703095306/az_nova_backup_dddedc88-ea25-4f5d-b989-944d0094b292-00018": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 891289600\n }\n },\n {\n "volume_bb206076-56d3-4255-8607-10b3ef732cbb/20260703095306/az_nova_backup_dddedc88-ea25-4f5d-b989-944d0094b292-00019": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 943718400\n }\n },\n {\n "volume_bb206076-56d3-4255-8607-10b3ef732cbb/20260703095306/az_nova_backup_dddedc88-ea25-4f5d-b989-944d0094b292-00020": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 996147200\n }\n },\n {\n "volume_bb206076-56d3-4255-8607-10b3ef732cbb/20260703095306/az_nova_backup_dddedc88-ea25-4f5d-b989-944d0094b292-00021": {\n "compression": "zlib",\n "length": 25165824,\n "md5": "77377273b0a4b61febdbf7bbf52b9db9",\n "offset": 1048576000\n }\n }\n ],\n "parent_id": null,\n "version": "1.0.0",\n "volume_id": "bb206076-56d3-4255-8607-10b3ef732cbb",\n "volume_meta": "{\\"version\\": 2, \\"volume-base-metadata\\": {\\"id\\": \\"bb206076-56d3-4255-8607-10b3ef732cbb\\", \\"_name_id\\": null, \\"use_quota\\": true, \\"ec2_id\\": null, \\"user_id\\": \\"e3b8ecc8212649f489f39b74eac8ff8f\\", \\"project_id\\": \\"c36863fd49104594b80b419fafd78f5c\\", \\"snapshot_id\\": null, \\"cluster_name\\": null, \\"host\\": \\"np0000004400@storpool#default\\", \\"size\\": 1, \\"availability_zone\\": \\"nova\\", \\"status\\": \\"backing-up\\", \\"attach_status\\": \\"detached\\", \\"migration_status\\": null, \\"scheduled_at\\": \\"2026-07-03T09:53:01.000000\\", \\"launched_at\\": \\"2026-07-03T09:53:01.000000\\", \\"terminated_at\\": null, \\"display_name\\": \\"tempest-VolumesBackupsTest-Volume-1341072656\\", \\"display_description\\": null, \\"provider_location\\": null, \\"provider_auth\\": null, \\"provider_geometry\\": null, \\"provider_id\\": null, \\"volume_type_id\\": \\"03e13fe6-0e30-4803-ace0-725d38e6dc24\\", \\"source_volid\\": null, \\"encryption_key_id\\": null, \\"consistencygroup_id\\": null, \\"group_id\\": null, \\"bootable\\": false, \\"multiattach\\": false, \\"replication_status\\": null, \\"replication_extended_status\\": null, \\"replication_driver_data\\": null, \\"previous_status\\": \\"available\\", \\"service_uuid\\": \\"6d4b0e79-fefe-4744-b25f-34be05095200\\", \\"shared_targets\\": true, \\"deleted_at\\": null, \\"deleted\\": false, \\"created_at\\": \\"2026-07-03T09:53:01.000000\\", \\"updated_at\\": \\"2026-07-03T09:53:02.000000\\"}}"\n}'. {{(pid=101319) _write_metadata /opt/stack/cinder/cinder/backup/chunkeddriver.py:295}} Jul 03 09:53:17.632242 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-86249081-dcdf-44d7-a2b2-6285d268a4bd tempest-VolumesBackupsTest-1484886458 None] backup dddedc88-ea25-4f5d-b989-944d0094b292 finished. {{(pid=101319) _finalize_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:462}} Jul 03 09:53:17.755817 np0000004400 cinder-backup[101319]: DEBUG oslo_concurrency.processutils [None req-86249081-dcdf-44d7-a2b2-6285d268a4bd tempest-VolumesBackupsTest-1484886458 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chown 0 /dev/sdg {{(pid=101319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 09:53:17.763506 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-904329c4-9ef6-4056-95e0-4524f15f09c7 tempest-ProjectReaderTests33-761902925 None] backup MD5 for volume_91385958-bc9a-4b5d-ac21-22d57700a0e4/20260703095311/az_nova_backup_995de3de-d18a-4f2d-9b86-30dcb8a7d527-00010: 25e317773f308e446cc84c503a6d1f85 {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 09:53:17.763765 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-904329c4-9ef6-4056-95e0-4524f15f09c7 tempest-ProjectReaderTests33-761902925 None] Calling eventlet.sleep(0) {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 09:53:17.774576 np0000004400 sudo[154146]: stack : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chown 0 /dev/sdg Jul 03 09:53:17.775182 np0000004400 sudo[154146]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1002) Jul 03 09:53:17.952318 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-904329c4-9ef6-4056-95e0-4524f15f09c7 tempest-ProjectReaderTests33-761902925 None] Backing up chunk of data from volume. {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 09:53:18.075535 np0000004400 sudo[154146]: pam_unix(sudo:session): session closed for user root Jul 03 09:53:18.077339 np0000004400 cinder-backup[101319]: DEBUG oslo_concurrency.processutils [None req-86249081-dcdf-44d7-a2b2-6285d268a4bd tempest-VolumesBackupsTest-1484886458 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chown 0 /dev/sdg" returned: 0 in 0.322s {{(pid=101319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 09:53:18.077945 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-86249081-dcdf-44d7-a2b2-6285d268a4bd tempest-VolumesBackupsTest-1484886458 None] ==> disconnect_volume: call "{'args': (, {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-bb206076-56d3-4255-8607-10b3ef732cbb', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'bb206076-56d3-4255-8607-10b3ef732cbb', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': False}, {'type': 'block', 'scsi_wwn': 'SStorPool_iSCSI_DISK_1034578903445799223', 'path': '/dev/sdg'}), 'kwargs': {'force': True, 'ignore_errors': True}}" {{(pid=101319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}} Jul 03 09:53:18.078166 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.base [None req-86249081-dcdf-44d7-a2b2-6285d268a4bd tempest-VolumesBackupsTest-1484886458 None] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=101319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jul 03 09:53:18.078661 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.base [None req-86249081-dcdf-44d7-a2b2-6285d268a4bd tempest-VolumesBackupsTest-1484886458 None] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=101319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jul 03 09:53:18.079074 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-86249081-dcdf-44d7-a2b2-6285d268a4bd tempest-VolumesBackupsTest-1484886458 None] _get_connection_devices called with parameters: connection_properties={'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-bb206076-56d3-4255-8607-10b3ef732cbb', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'bb206076-56d3-4255-8607-10b3ef732cbb', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': False}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=101319) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:847}} Jul 03 09:53:18.088212 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-86249081-dcdf-44d7-a2b2-6285d268a4bd tempest-VolumesBackupsTest-1484886458 None] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS: Jul 03 09:53:18.088212 np0000004400 cinder-backup[101319]: No targets found. Jul 03 09:53:18.088212 np0000004400 cinder-backup[101319]: iSNS: Jul 03 09:53:18.088212 np0000004400 cinder-backup[101319]: No targets found. Jul 03 09:53:18.088212 np0000004400 cinder-backup[101319]: STATIC: Jul 03 09:53:18.088212 np0000004400 cinder-backup[101319]: Target: iqn.2023-03.storpool.com:os--volume-491c39b6-d2e0-4f67-9a64-590d50f06197 Jul 03 09:53:18.088212 np0000004400 cinder-backup[101319]: Portal: 192.168.50.100:3260,-1 Jul 03 09:53:18.088212 np0000004400 cinder-backup[101319]: Iface Name: default Jul 03 09:53:18.088212 np0000004400 cinder-backup[101319]: Portal: 192.168.40.100:3260,-1 Jul 03 09:53:18.088212 np0000004400 cinder-backup[101319]: Iface Name: default Jul 03 09:53:18.088212 np0000004400 cinder-backup[101319]: Target: iqn.2023-03.storpool.com:os--volume-91385958-bc9a-4b5d-ac21-22d57700a0e4 Jul 03 09:53:18.088212 np0000004400 cinder-backup[101319]: Portal: 192.168.40.100:3260,-1 Jul 03 09:53:18.088212 np0000004400 cinder-backup[101319]: Iface Name: default Jul 03 09:53:18.088212 np0000004400 cinder-backup[101319]: Target: iqn.2023-03.storpool.com:os--volume-bb206076-56d3-4255-8607-10b3ef732cbb Jul 03 09:53:18.088212 np0000004400 cinder-backup[101319]: Portal: 192.168.40.100:3260,-1 Jul 03 09:53:18.088212 np0000004400 cinder-backup[101319]: Iface Name: default Jul 03 09:53:18.088212 np0000004400 cinder-backup[101319]: FIRMWARE: Jul 03 09:53:18.088212 np0000004400 cinder-backup[101319]: No targets found. Jul 03 09:53:18.088212 np0000004400 cinder-backup[101319]: stderr= {{(pid=101319) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jul 03 09:53:18.088649 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-86249081-dcdf-44d7-a2b2-6285d268a4bd tempest-VolumesBackupsTest-1484886458 None] Regex to get portals from discoverydb: ^SENDTARGETS: Jul 03 09:53:18.088649 np0000004400 cinder-backup[101319]: .*?^DiscoveryAddress: 192.168.40.100,3260.*? Jul 03 09:53:18.088649 np0000004400 cinder-backup[101319]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=101319) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:390}} Jul 03 09:53:18.088912 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-86249081-dcdf-44d7-a2b2-6285d268a4bd tempest-VolumesBackupsTest-1484886458 None] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-bb206076-56d3-4255-8607-10b3ef732cbb', 0)] {{(pid=101319) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:858}} Jul 03 09:53:18.112762 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-86249081-dcdf-44d7-a2b2-6285d268a4bd tempest-VolumesBackupsTest-1484886458 None] iscsiadm ('-m', 'session'): stdout=tcp: [188] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-491c39b6-d2e0-4f67-9a64-590d50f06197 (non-flash) Jul 03 09:53:18.112762 np0000004400 cinder-backup[101319]: tcp: [189] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-491c39b6-d2e0-4f67-9a64-590d50f06197 (non-flash) Jul 03 09:53:18.112762 np0000004400 cinder-backup[101319]: tcp: [195] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-bb206076-56d3-4255-8607-10b3ef732cbb (non-flash) Jul 03 09:53:18.112762 np0000004400 cinder-backup[101319]: tcp: [196] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-91385958-bc9a-4b5d-ac21-22d57700a0e4 (non-flash) Jul 03 09:53:18.112762 np0000004400 cinder-backup[101319]: stderr= {{(pid=101319) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jul 03 09:53:18.113332 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-86249081-dcdf-44d7-a2b2-6285d268a4bd tempest-VolumesBackupsTest-1484886458 None] iscsi session list stdout=tcp: [188] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-491c39b6-d2e0-4f67-9a64-590d50f06197 (non-flash) Jul 03 09:53:18.113332 np0000004400 cinder-backup[101319]: tcp: [189] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-491c39b6-d2e0-4f67-9a64-590d50f06197 (non-flash) Jul 03 09:53:18.113332 np0000004400 cinder-backup[101319]: tcp: [195] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-bb206076-56d3-4255-8607-10b3ef732cbb (non-flash) Jul 03 09:53:18.113332 np0000004400 cinder-backup[101319]: tcp: [196] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-91385958-bc9a-4b5d-ac21-22d57700a0e4 (non-flash) Jul 03 09:53:18.113332 np0000004400 cinder-backup[101319]: stderr= {{(pid=101319) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jul 03 09:53:18.113332 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-86249081-dcdf-44d7-a2b2-6285d268a4bd tempest-VolumesBackupsTest-1484886458 None] Sessions list: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-491c39b6-d2e0-4f67-9a64-590d50f06197', '188'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-491c39b6-d2e0-4f67-9a64-590d50f06197', '189'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-bb206076-56d3-4255-8607-10b3ef732cbb', '195'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-91385958-bc9a-4b5d-ac21-22d57700a0e4', '196')] {{(pid=101319) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:866}} Jul 03 09:53:18.113332 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-86249081-dcdf-44d7-a2b2-6285d268a4bd tempest-VolumesBackupsTest-1484886458 None] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-bb206076-56d3-4255-8607-10b3ef732cbb, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-bb206076-56d3-4255-8607-10b3ef732cbb', '195')] {{(pid=101319) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}} Jul 03 09:53:18.114000 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-86249081-dcdf-44d7-a2b2-6285d268a4bd tempest-VolumesBackupsTest-1484886458 None] Resulting device map defaultdict(. at 0x7e76e71f1800>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-bb206076-56d3-4255-8607-10b3ef732cbb'): ({'sdg'}, set())}) {{(pid=101319) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:912}} Jul 03 09:53:18.114202 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.linuxscsi [None req-86249081-dcdf-44d7-a2b2-6285d268a4bd tempest-VolumesBackupsTest-1484886458 None] Removing single pathed devices sdg {{(pid=101319) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}} Jul 03 09:53:18.126658 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.linuxscsi [None req-86249081-dcdf-44d7-a2b2-6285d268a4bd tempest-VolumesBackupsTest-1484886458 None] Flushing IO for device /dev/sdg {{(pid=101319) flush_device_io /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:461}} Jul 03 09:53:18.135362 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.linuxscsi [None req-86249081-dcdf-44d7-a2b2-6285d268a4bd tempest-VolumesBackupsTest-1484886458 None] Remove SCSI device /dev/sdg with /sys/block/sdg/device/delete {{(pid=101319) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}} Jul 03 09:53:18.188788 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.linuxscsi [None req-86249081-dcdf-44d7-a2b2-6285d268a4bd tempest-VolumesBackupsTest-1484886458 None] Checking to see if SCSI volumes sdg have been removed. {{(pid=101319) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}} Jul 03 09:53:18.188997 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.linuxscsi [None req-86249081-dcdf-44d7-a2b2-6285d268a4bd tempest-VolumesBackupsTest-1484886458 None] SCSI volumes sdg have been removed. {{(pid=101319) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}} Jul 03 09:53:18.190092 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.linuxscsi [None req-86249081-dcdf-44d7-a2b2-6285d268a4bd tempest-VolumesBackupsTest-1484886458 None] Checking to see if device paths {'sdg'} are still under multipathd monitoring {{(pid=101319) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}} Jul 03 09:53:18.197472 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-904329c4-9ef6-4056-95e0-4524f15f09c7 tempest-ProjectReaderTests33-761902925 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101319) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 09:53:18.197649 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-904329c4-9ef6-4056-95e0-4524f15f09c7 tempest-ProjectReaderTests33-761902925 None] About to put_object {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 09:53:18.199926 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.linuxscsi [None req-86249081-dcdf-44d7-a2b2-6285d268a4bd tempest-VolumesBackupsTest-1484886458 None] Device paths {'sdg'} have been removed from multipathd monitoring. {{(pid=101319) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}} Jul 03 09:53:18.200102 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-86249081-dcdf-44d7-a2b2-6285d268a4bd tempest-VolumesBackupsTest-1484886458 None] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-bb206076-56d3-4255-8607-10b3ef732cbb')] {{(pid=101319) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1225}} Jul 03 09:53:18.212289 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-86249081-dcdf-44d7-a2b2-6285d268a4bd tempest-VolumesBackupsTest-1484886458 None] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=101319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 03 09:53:18.234473 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-86249081-dcdf-44d7-a2b2-6285d268a4bd tempest-VolumesBackupsTest-1484886458 None] iscsiadm ('--logout',): stdout=Logging out of session [sid: 195, target: iqn.2023-03.storpool.com:os--volume-bb206076-56d3-4255-8607-10b3ef732cbb, portal: 192.168.40.100,3260] Jul 03 09:53:18.234473 np0000004400 cinder-backup[101319]: Logout of [sid: 195, target: iqn.2023-03.storpool.com:os--volume-bb206076-56d3-4255-8607-10b3ef732cbb, portal: 192.168.40.100,3260] successful. Jul 03 09:53:18.234473 np0000004400 cinder-backup[101319]: stderr= {{(pid=101319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 03 09:53:18.249306 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-86249081-dcdf-44d7-a2b2-6285d268a4bd tempest-VolumesBackupsTest-1484886458 None] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=101319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 03 09:53:18.249531 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.base [None req-86249081-dcdf-44d7-a2b2-6285d268a4bd tempest-VolumesBackupsTest-1484886458 None] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.171s {{(pid=101319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jul 03 09:53:18.249680 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-86249081-dcdf-44d7-a2b2-6285d268a4bd tempest-VolumesBackupsTest-1484886458 None] <== disconnect_volume: return (172ms) None {{(pid=101319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}} Jul 03 09:53:18.306579 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-904329c4-9ef6-4056-95e0-4524f15f09c7 tempest-ProjectReaderTests33-761902925 None] backup MD5 for volume_91385958-bc9a-4b5d-ac21-22d57700a0e4/20260703095311/az_nova_backup_995de3de-d18a-4f2d-9b86-30dcb8a7d527-00011: 25e317773f308e446cc84c503a6d1f85 {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 09:53:18.306759 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-904329c4-9ef6-4056-95e0-4524f15f09c7 tempest-ProjectReaderTests33-761902925 None] Calling eventlet.sleep(0) {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 09:53:18.492430 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-904329c4-9ef6-4056-95e0-4524f15f09c7 tempest-ProjectReaderTests33-761902925 None] Backing up chunk of data from volume. {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 09:53:18.743792 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-904329c4-9ef6-4056-95e0-4524f15f09c7 tempest-ProjectReaderTests33-761902925 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101319) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 09:53:18.743913 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-904329c4-9ef6-4056-95e0-4524f15f09c7 tempest-ProjectReaderTests33-761902925 None] About to put_object {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 09:53:18.855900 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-904329c4-9ef6-4056-95e0-4524f15f09c7 tempest-ProjectReaderTests33-761902925 None] backup MD5 for volume_91385958-bc9a-4b5d-ac21-22d57700a0e4/20260703095311/az_nova_backup_995de3de-d18a-4f2d-9b86-30dcb8a7d527-00012: 25e317773f308e446cc84c503a6d1f85 {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 09:53:18.856063 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-904329c4-9ef6-4056-95e0-4524f15f09c7 tempest-ProjectReaderTests33-761902925 None] Calling eventlet.sleep(0) {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 09:53:19.035484 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-904329c4-9ef6-4056-95e0-4524f15f09c7 tempest-ProjectReaderTests33-761902925 None] Backing up chunk of data from volume. {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 09:53:19.267726 np0000004400 cinder-backup[101319]: INFO cinder.backup.manager [None req-86249081-dcdf-44d7-a2b2-6285d268a4bd tempest-VolumesBackupsTest-1484886458 None] Create backup finished. backup: dddedc88-ea25-4f5d-b989-944d0094b292. Jul 03 09:53:19.275560 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-904329c4-9ef6-4056-95e0-4524f15f09c7 tempest-ProjectReaderTests33-761902925 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101319) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 09:53:19.275750 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-904329c4-9ef6-4056-95e0-4524f15f09c7 tempest-ProjectReaderTests33-761902925 None] About to put_object {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 09:53:19.372824 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-904329c4-9ef6-4056-95e0-4524f15f09c7 tempest-ProjectReaderTests33-761902925 None] backup MD5 for volume_91385958-bc9a-4b5d-ac21-22d57700a0e4/20260703095311/az_nova_backup_995de3de-d18a-4f2d-9b86-30dcb8a7d527-00013: 25e317773f308e446cc84c503a6d1f85 {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 09:53:19.372954 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-904329c4-9ef6-4056-95e0-4524f15f09c7 tempest-ProjectReaderTests33-761902925 None] Calling eventlet.sleep(0) {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 09:53:19.549117 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-904329c4-9ef6-4056-95e0-4524f15f09c7 tempest-ProjectReaderTests33-761902925 None] Backing up chunk of data from volume. {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 09:53:19.781342 np0000004400 cinder-backup[101319]: INFO cinder.backup.manager [None req-0df38cff-6786-427c-9fed-7fb16a4d02b6 tempest-VolumesBackupsTest-1484886458 None] Delete backup started, backup: dddedc88-ea25-4f5d-b989-944d0094b292. Jul 03 09:53:19.788581 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.drivers.swift [None req-0df38cff-6786-427c-9fed-7fb16a4d02b6 tempest-VolumesBackupsTest-1484886458 None] Using swift URL https://10.4.3.95:8080/v1/AUTH_c36863fd49104594b80b419fafd78f5c {{(pid=101319) initialize /opt/stack/cinder/cinder/backup/drivers/swift.py:300}} Jul 03 09:53:19.788837 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.drivers.swift [None req-0df38cff-6786-427c-9fed-7fb16a4d02b6 tempest-VolumesBackupsTest-1484886458 None] Connect to https://10.4.3.95:8080/v1/AUTH_ in "per_user" mode {{(pid=101319) initialize /opt/stack/cinder/cinder/backup/drivers/swift.py:301}} Jul 03 09:53:19.789091 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-0df38cff-6786-427c-9fed-7fb16a4d02b6 tempest-VolumesBackupsTest-1484886458 None] delete started, backup: dddedc88-ea25-4f5d-b989-944d0094b292, container: volumebackups, prefix: volume_bb206076-56d3-4255-8607-10b3ef732cbb/20260703095306/az_nova_backup_dddedc88-ea25-4f5d-b989-944d0094b292. {{(pid=101319) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:822}} Jul 03 09:53:19.808111 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-904329c4-9ef6-4056-95e0-4524f15f09c7 tempest-ProjectReaderTests33-761902925 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101319) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 09:53:19.808291 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-904329c4-9ef6-4056-95e0-4524f15f09c7 tempest-ProjectReaderTests33-761902925 None] About to put_object {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 09:53:19.837317 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-0df38cff-6786-427c-9fed-7fb16a4d02b6 tempest-VolumesBackupsTest-1484886458 None] generated object list: ['volume_bb206076-56d3-4255-8607-10b3ef732cbb/20260703095306/az_nova_backup_dddedc88-ea25-4f5d-b989-944d0094b292-00001', 'volume_bb206076-56d3-4255-8607-10b3ef732cbb/20260703095306/az_nova_backup_dddedc88-ea25-4f5d-b989-944d0094b292-00002', 'volume_bb206076-56d3-4255-8607-10b3ef732cbb/20260703095306/az_nova_backup_dddedc88-ea25-4f5d-b989-944d0094b292-00003', 'volume_bb206076-56d3-4255-8607-10b3ef732cbb/20260703095306/az_nova_backup_dddedc88-ea25-4f5d-b989-944d0094b292-00004', 'volume_bb206076-56d3-4255-8607-10b3ef732cbb/20260703095306/az_nova_backup_dddedc88-ea25-4f5d-b989-944d0094b292-00005', 'volume_bb206076-56d3-4255-8607-10b3ef732cbb/20260703095306/az_nova_backup_dddedc88-ea25-4f5d-b989-944d0094b292-00006', 'volume_bb206076-56d3-4255-8607-10b3ef732cbb/20260703095306/az_nova_backup_dddedc88-ea25-4f5d-b989-944d0094b292-00007', 'volume_bb206076-56d3-4255-8607-10b3ef732cbb/20260703095306/az_nova_backup_dddedc88-ea25-4f5d-b989-944d0094b292-00008', 'volume_bb206076-56d3-4255-8607-10b3ef732cbb/20260703095306/az_nova_backup_dddedc88-ea25-4f5d-b989-944d0094b292-00009', 'volume_bb206076-56d3-4255-8607-10b3ef732cbb/20260703095306/az_nova_backup_dddedc88-ea25-4f5d-b989-944d0094b292-00010', 'volume_bb206076-56d3-4255-8607-10b3ef732cbb/20260703095306/az_nova_backup_dddedc88-ea25-4f5d-b989-944d0094b292-00011', 'volume_bb206076-56d3-4255-8607-10b3ef732cbb/20260703095306/az_nova_backup_dddedc88-ea25-4f5d-b989-944d0094b292-00012', 'volume_bb206076-56d3-4255-8607-10b3ef732cbb/20260703095306/az_nova_backup_dddedc88-ea25-4f5d-b989-944d0094b292-00013', 'volume_bb206076-56d3-4255-8607-10b3ef732cbb/20260703095306/az_nova_backup_dddedc88-ea25-4f5d-b989-944d0094b292-00014', 'volume_bb206076-56d3-4255-8607-10b3ef732cbb/20260703095306/az_nova_backup_dddedc88-ea25-4f5d-b989-944d0094b292-00015', 'volume_bb206076-56d3-4255-8607-10b3ef732cbb/20260703095306/az_nova_backup_dddedc88-ea25-4f5d-b989-944d0094b292-00016', 'volume_bb206076-56d3-4255-8607-10b3ef732cbb/20260703095306/az_nova_backup_dddedc88-ea25-4f5d-b989-944d0094b292-00017', 'volume_bb206076-56d3-4255-8607-10b3ef732cbb/20260703095306/az_nova_backup_dddedc88-ea25-4f5d-b989-944d0094b292-00018', 'volume_bb206076-56d3-4255-8607-10b3ef732cbb/20260703095306/az_nova_backup_dddedc88-ea25-4f5d-b989-944d0094b292-00019', 'volume_bb206076-56d3-4255-8607-10b3ef732cbb/20260703095306/az_nova_backup_dddedc88-ea25-4f5d-b989-944d0094b292-00020', 'volume_bb206076-56d3-4255-8607-10b3ef732cbb/20260703095306/az_nova_backup_dddedc88-ea25-4f5d-b989-944d0094b292-00021', 'volume_bb206076-56d3-4255-8607-10b3ef732cbb/20260703095306/az_nova_backup_dddedc88-ea25-4f5d-b989-944d0094b292_metadata', 'volume_bb206076-56d3-4255-8607-10b3ef732cbb/20260703095306/az_nova_backup_dddedc88-ea25-4f5d-b989-944d0094b292_sha256file']. {{(pid=101319) _generate_object_names /opt/stack/cinder/cinder/backup/chunkeddriver.py:260}} Jul 03 09:53:19.860887 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-0df38cff-6786-427c-9fed-7fb16a4d02b6 tempest-VolumesBackupsTest-1484886458 None] deleted object: volume_bb206076-56d3-4255-8607-10b3ef732cbb/20260703095306/az_nova_backup_dddedc88-ea25-4f5d-b989-944d0094b292-00001 in container: volumebackups. {{(pid=101319) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 09:53:19.879374 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-0df38cff-6786-427c-9fed-7fb16a4d02b6 tempest-VolumesBackupsTest-1484886458 None] deleted object: volume_bb206076-56d3-4255-8607-10b3ef732cbb/20260703095306/az_nova_backup_dddedc88-ea25-4f5d-b989-944d0094b292-00002 in container: volumebackups. {{(pid=101319) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 09:53:19.900134 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-0df38cff-6786-427c-9fed-7fb16a4d02b6 tempest-VolumesBackupsTest-1484886458 None] deleted object: volume_bb206076-56d3-4255-8607-10b3ef732cbb/20260703095306/az_nova_backup_dddedc88-ea25-4f5d-b989-944d0094b292-00003 in container: volumebackups. {{(pid=101319) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 09:53:19.917812 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-0df38cff-6786-427c-9fed-7fb16a4d02b6 tempest-VolumesBackupsTest-1484886458 None] deleted object: volume_bb206076-56d3-4255-8607-10b3ef732cbb/20260703095306/az_nova_backup_dddedc88-ea25-4f5d-b989-944d0094b292-00004 in container: volumebackups. {{(pid=101319) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 09:53:19.926285 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-904329c4-9ef6-4056-95e0-4524f15f09c7 tempest-ProjectReaderTests33-761902925 None] backup MD5 for volume_91385958-bc9a-4b5d-ac21-22d57700a0e4/20260703095311/az_nova_backup_995de3de-d18a-4f2d-9b86-30dcb8a7d527-00014: 25e317773f308e446cc84c503a6d1f85 {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 09:53:19.926489 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-904329c4-9ef6-4056-95e0-4524f15f09c7 tempest-ProjectReaderTests33-761902925 None] Calling eventlet.sleep(0) {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 09:53:19.955356 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-0df38cff-6786-427c-9fed-7fb16a4d02b6 tempest-VolumesBackupsTest-1484886458 None] deleted object: volume_bb206076-56d3-4255-8607-10b3ef732cbb/20260703095306/az_nova_backup_dddedc88-ea25-4f5d-b989-944d0094b292-00005 in container: volumebackups. {{(pid=101319) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 09:53:19.964634 np0000004400 cinder-backup[101319]: DEBUG oslo_db.sqlalchemy.engines [None req-904329c4-9ef6-4056-95e0-4524f15f09c7 tempest-ProjectReaderTests33-761902925 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=101319) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 03 09:53:19.986925 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-0df38cff-6786-427c-9fed-7fb16a4d02b6 tempest-VolumesBackupsTest-1484886458 None] deleted object: volume_bb206076-56d3-4255-8607-10b3ef732cbb/20260703095306/az_nova_backup_dddedc88-ea25-4f5d-b989-944d0094b292-00006 in container: volumebackups. {{(pid=101319) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 09:53:20.036316 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-0df38cff-6786-427c-9fed-7fb16a4d02b6 tempest-VolumesBackupsTest-1484886458 None] deleted object: volume_bb206076-56d3-4255-8607-10b3ef732cbb/20260703095306/az_nova_backup_dddedc88-ea25-4f5d-b989-944d0094b292-00007 in container: volumebackups. {{(pid=101319) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 09:53:20.080225 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-0df38cff-6786-427c-9fed-7fb16a4d02b6 tempest-VolumesBackupsTest-1484886458 None] deleted object: volume_bb206076-56d3-4255-8607-10b3ef732cbb/20260703095306/az_nova_backup_dddedc88-ea25-4f5d-b989-944d0094b292-00008 in container: volumebackups. {{(pid=101319) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 09:53:20.115780 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-0df38cff-6786-427c-9fed-7fb16a4d02b6 tempest-VolumesBackupsTest-1484886458 None] deleted object: volume_bb206076-56d3-4255-8607-10b3ef732cbb/20260703095306/az_nova_backup_dddedc88-ea25-4f5d-b989-944d0094b292-00009 in container: volumebackups. {{(pid=101319) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 09:53:20.133451 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-0df38cff-6786-427c-9fed-7fb16a4d02b6 tempest-VolumesBackupsTest-1484886458 None] deleted object: volume_bb206076-56d3-4255-8607-10b3ef732cbb/20260703095306/az_nova_backup_dddedc88-ea25-4f5d-b989-944d0094b292-00010 in container: volumebackups. {{(pid=101319) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 09:53:20.155276 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-904329c4-9ef6-4056-95e0-4524f15f09c7 tempest-ProjectReaderTests33-761902925 None] Backing up chunk of data from volume. {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 09:53:20.156335 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-0df38cff-6786-427c-9fed-7fb16a4d02b6 tempest-VolumesBackupsTest-1484886458 None] deleted object: volume_bb206076-56d3-4255-8607-10b3ef732cbb/20260703095306/az_nova_backup_dddedc88-ea25-4f5d-b989-944d0094b292-00011 in container: volumebackups. {{(pid=101319) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 09:53:20.177386 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-0df38cff-6786-427c-9fed-7fb16a4d02b6 tempest-VolumesBackupsTest-1484886458 None] deleted object: volume_bb206076-56d3-4255-8607-10b3ef732cbb/20260703095306/az_nova_backup_dddedc88-ea25-4f5d-b989-944d0094b292-00012 in container: volumebackups. {{(pid=101319) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 09:53:20.196571 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-0df38cff-6786-427c-9fed-7fb16a4d02b6 tempest-VolumesBackupsTest-1484886458 None] deleted object: volume_bb206076-56d3-4255-8607-10b3ef732cbb/20260703095306/az_nova_backup_dddedc88-ea25-4f5d-b989-944d0094b292-00013 in container: volumebackups. {{(pid=101319) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 09:53:20.215243 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-0df38cff-6786-427c-9fed-7fb16a4d02b6 tempest-VolumesBackupsTest-1484886458 None] deleted object: volume_bb206076-56d3-4255-8607-10b3ef732cbb/20260703095306/az_nova_backup_dddedc88-ea25-4f5d-b989-944d0094b292-00014 in container: volumebackups. {{(pid=101319) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 09:53:20.234913 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-0df38cff-6786-427c-9fed-7fb16a4d02b6 tempest-VolumesBackupsTest-1484886458 None] deleted object: volume_bb206076-56d3-4255-8607-10b3ef732cbb/20260703095306/az_nova_backup_dddedc88-ea25-4f5d-b989-944d0094b292-00015 in container: volumebackups. {{(pid=101319) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 09:53:20.253654 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-0df38cff-6786-427c-9fed-7fb16a4d02b6 tempest-VolumesBackupsTest-1484886458 None] deleted object: volume_bb206076-56d3-4255-8607-10b3ef732cbb/20260703095306/az_nova_backup_dddedc88-ea25-4f5d-b989-944d0094b292-00016 in container: volumebackups. {{(pid=101319) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 09:53:20.272780 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-0df38cff-6786-427c-9fed-7fb16a4d02b6 tempest-VolumesBackupsTest-1484886458 None] deleted object: volume_bb206076-56d3-4255-8607-10b3ef732cbb/20260703095306/az_nova_backup_dddedc88-ea25-4f5d-b989-944d0094b292-00017 in container: volumebackups. {{(pid=101319) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 09:53:20.292161 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-0df38cff-6786-427c-9fed-7fb16a4d02b6 tempest-VolumesBackupsTest-1484886458 None] deleted object: volume_bb206076-56d3-4255-8607-10b3ef732cbb/20260703095306/az_nova_backup_dddedc88-ea25-4f5d-b989-944d0094b292-00018 in container: volumebackups. {{(pid=101319) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 09:53:20.311962 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-0df38cff-6786-427c-9fed-7fb16a4d02b6 tempest-VolumesBackupsTest-1484886458 None] deleted object: volume_bb206076-56d3-4255-8607-10b3ef732cbb/20260703095306/az_nova_backup_dddedc88-ea25-4f5d-b989-944d0094b292-00019 in container: volumebackups. {{(pid=101319) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 09:53:20.346879 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-0df38cff-6786-427c-9fed-7fb16a4d02b6 tempest-VolumesBackupsTest-1484886458 None] deleted object: volume_bb206076-56d3-4255-8607-10b3ef732cbb/20260703095306/az_nova_backup_dddedc88-ea25-4f5d-b989-944d0094b292-00020 in container: volumebackups. {{(pid=101319) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 09:53:20.369042 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-0df38cff-6786-427c-9fed-7fb16a4d02b6 tempest-VolumesBackupsTest-1484886458 None] deleted object: volume_bb206076-56d3-4255-8607-10b3ef732cbb/20260703095306/az_nova_backup_dddedc88-ea25-4f5d-b989-944d0094b292-00021 in container: volumebackups. {{(pid=101319) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 09:53:20.389174 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-0df38cff-6786-427c-9fed-7fb16a4d02b6 tempest-VolumesBackupsTest-1484886458 None] deleted object: volume_bb206076-56d3-4255-8607-10b3ef732cbb/20260703095306/az_nova_backup_dddedc88-ea25-4f5d-b989-944d0094b292_metadata in container: volumebackups. {{(pid=101319) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 09:53:20.395448 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-904329c4-9ef6-4056-95e0-4524f15f09c7 tempest-ProjectReaderTests33-761902925 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101319) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 09:53:20.395588 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-904329c4-9ef6-4056-95e0-4524f15f09c7 tempest-ProjectReaderTests33-761902925 None] About to put_object {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 09:53:20.410978 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-0df38cff-6786-427c-9fed-7fb16a4d02b6 tempest-VolumesBackupsTest-1484886458 None] deleted object: volume_bb206076-56d3-4255-8607-10b3ef732cbb/20260703095306/az_nova_backup_dddedc88-ea25-4f5d-b989-944d0094b292_sha256file in container: volumebackups. {{(pid=101319) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 09:53:20.411264 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-0df38cff-6786-427c-9fed-7fb16a4d02b6 tempest-VolumesBackupsTest-1484886458 None] delete dddedc88-ea25-4f5d-b989-944d0094b292 finished. {{(pid=101319) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:848}} Jul 03 09:53:20.441301 np0000004400 cinder-backup[101319]: DEBUG cinder.quota [None req-0df38cff-6786-427c-9fed-7fb16a4d02b6 tempest-VolumesBackupsTest-1484886458 None] Created reservations ['92c2ccda-9a0b-4b1c-a2bd-98f79169a640', 'd06ca0d4-f6c2-4b7b-a63d-2504da67e45c'] {{(pid=101319) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 09:53:20.456827 np0000004400 cinder-backup[101319]: INFO cinder.backup.manager [None req-0df38cff-6786-427c-9fed-7fb16a4d02b6 tempest-VolumesBackupsTest-1484886458 None] Delete backup finished, backup dddedc88-ea25-4f5d-b989-944d0094b292 deleted. Jul 03 09:53:20.496522 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-904329c4-9ef6-4056-95e0-4524f15f09c7 tempest-ProjectReaderTests33-761902925 None] backup MD5 for volume_91385958-bc9a-4b5d-ac21-22d57700a0e4/20260703095311/az_nova_backup_995de3de-d18a-4f2d-9b86-30dcb8a7d527-00015: 25e317773f308e446cc84c503a6d1f85 {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 09:53:20.496684 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-904329c4-9ef6-4056-95e0-4524f15f09c7 tempest-ProjectReaderTests33-761902925 None] Calling eventlet.sleep(0) {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 09:53:20.697910 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-904329c4-9ef6-4056-95e0-4524f15f09c7 tempest-ProjectReaderTests33-761902925 None] Backing up chunk of data from volume. {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 09:53:20.940517 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-904329c4-9ef6-4056-95e0-4524f15f09c7 tempest-ProjectReaderTests33-761902925 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101319) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 09:53:20.940736 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-904329c4-9ef6-4056-95e0-4524f15f09c7 tempest-ProjectReaderTests33-761902925 None] About to put_object {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 09:53:21.040214 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-904329c4-9ef6-4056-95e0-4524f15f09c7 tempest-ProjectReaderTests33-761902925 None] backup MD5 for volume_91385958-bc9a-4b5d-ac21-22d57700a0e4/20260703095311/az_nova_backup_995de3de-d18a-4f2d-9b86-30dcb8a7d527-00016: 25e317773f308e446cc84c503a6d1f85 {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 09:53:21.040378 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-904329c4-9ef6-4056-95e0-4524f15f09c7 tempest-ProjectReaderTests33-761902925 None] Calling eventlet.sleep(0) {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 09:53:21.236046 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-904329c4-9ef6-4056-95e0-4524f15f09c7 tempest-ProjectReaderTests33-761902925 None] Backing up chunk of data from volume. {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 09:53:21.477216 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-904329c4-9ef6-4056-95e0-4524f15f09c7 tempest-ProjectReaderTests33-761902925 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101319) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 09:53:21.477570 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-904329c4-9ef6-4056-95e0-4524f15f09c7 tempest-ProjectReaderTests33-761902925 None] About to put_object {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 09:53:21.574216 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-904329c4-9ef6-4056-95e0-4524f15f09c7 tempest-ProjectReaderTests33-761902925 None] backup MD5 for volume_91385958-bc9a-4b5d-ac21-22d57700a0e4/20260703095311/az_nova_backup_995de3de-d18a-4f2d-9b86-30dcb8a7d527-00017: 25e317773f308e446cc84c503a6d1f85 {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 09:53:21.574350 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-904329c4-9ef6-4056-95e0-4524f15f09c7 tempest-ProjectReaderTests33-761902925 None] Calling eventlet.sleep(0) {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 09:53:21.749340 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-904329c4-9ef6-4056-95e0-4524f15f09c7 tempest-ProjectReaderTests33-761902925 None] Backing up chunk of data from volume. {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 09:53:21.994669 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-904329c4-9ef6-4056-95e0-4524f15f09c7 tempest-ProjectReaderTests33-761902925 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101319) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 09:53:21.994814 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-904329c4-9ef6-4056-95e0-4524f15f09c7 tempest-ProjectReaderTests33-761902925 None] About to put_object {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 09:53:22.094953 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-904329c4-9ef6-4056-95e0-4524f15f09c7 tempest-ProjectReaderTests33-761902925 None] backup MD5 for volume_91385958-bc9a-4b5d-ac21-22d57700a0e4/20260703095311/az_nova_backup_995de3de-d18a-4f2d-9b86-30dcb8a7d527-00018: 25e317773f308e446cc84c503a6d1f85 {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 09:53:22.094953 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-904329c4-9ef6-4056-95e0-4524f15f09c7 tempest-ProjectReaderTests33-761902925 None] Calling eventlet.sleep(0) {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 09:53:22.125082 np0000004400 cinder-backup[101319]: INFO cinder.backup.manager [None req-7a3f2202-7cda-4e09-9563-4547508d8589 tempest-VolumesBackupsTest-807180270 None] Create backup started, backup: 84105c14-606c-4395-a247-fddb67f6e548 volume: 5a775425-df51-44ce-b820-7c6d483d6c42. Jul 03 09:53:22.131341 np0000004400 cinder-backup[101319]: INFO cinder.backup.manager [None req-7a3f2202-7cda-4e09-9563-4547508d8589 tempest-VolumesBackupsTest-807180270 None] Call Volume Manager to get_backup_device for Backup(availability_zone='nova',container=None,created_at=2026-07-03T09:53:22Z,data_timestamp=2026-07-03T09:53:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesBackupsTest-Backup-997194919',encryption_key_id=None,fail_reason=None,host='np0000004400',id=84105c14-606c-4395-a247-fddb67f6e548,metadata={},num_dependent_backups=0,object_count=0,parent=None,parent_id=None,project_id='298e794341b64951b3fb757bfbffa698',restore_volume_id=None,service='cinder.backup.drivers.swift.SwiftBackupDriver',service_metadata=None,size=1,snapshot_id=None,status='creating',temp_snapshot_id=None,temp_volume_id=None,updated_at=None,user_id='64183001da094a09a87a9669ab4f899d',volume_id=5a775425-df51-44ce-b820-7c6d483d6c42) Jul 03 09:53:22.158575 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.drivers.swift [None req-7a3f2202-7cda-4e09-9563-4547508d8589 tempest-VolumesBackupsTest-807180270 None] Using swift URL https://10.4.3.95:8080/v1/AUTH_298e794341b64951b3fb757bfbffa698 {{(pid=101319) initialize /opt/stack/cinder/cinder/backup/drivers/swift.py:300}} Jul 03 09:53:22.158808 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.drivers.swift [None req-7a3f2202-7cda-4e09-9563-4547508d8589 tempest-VolumesBackupsTest-807180270 None] Connect to https://10.4.3.95:8080/v1/AUTH_ in "per_user" mode {{(pid=101319) initialize /opt/stack/cinder/cinder/backup/drivers/swift.py:301}} Jul 03 09:53:22.159164 np0000004400 cinder-backup[101319]: DEBUG os_brick.utils [None req-7a3f2202-7cda-4e09-9563-4547508d8589 tempest-VolumesBackupsTest-807180270 None] ==> get_connector_properties: call "{'root_helper': 'sudo cinder-rootwrap /etc/cinder/rootwrap.conf', 'my_ip': '10.4.3.95', 'multipath': False, 'enforce_multipath': False, 'host': None, 'execute': None}" {{(pid=101319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}} Jul 03 09:53:22.169869 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.scaleio [None req-7a3f2202-7cda-4e09-9563-4547508d8589 tempest-VolumesBackupsTest-807180270 None] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=101319) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}} Jul 03 09:53:22.190480 np0000004400 cinder-backup[101319]: DEBUG oslo_concurrency.processutils [None req-7a3f2202-7cda-4e09-9563-4547508d8589 tempest-VolumesBackupsTest-807180270 None] Running cmd (subprocess): nvme version {{(pid=101319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 09:53:22.205896 np0000004400 cinder-backup[101319]: DEBUG oslo_concurrency.processutils [None req-7a3f2202-7cda-4e09-9563-4547508d8589 tempest-VolumesBackupsTest-807180270 None] 'nvme version' failed. Not Retrying. {{(pid=101319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 03 09:53:22.206201 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.nvmeof [None req-7a3f2202-7cda-4e09-9563-4547508d8589 tempest-VolumesBackupsTest-807180270 None] nvme not present on system {{(pid=101319) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}} Jul 03 09:53:22.214662 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.lightos [None req-7a3f2202-7cda-4e09-9563-4547508d8589 tempest-VolumesBackupsTest-807180270 None] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=101319) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}} Jul 03 09:53:22.215562 np0000004400 cinder-backup[101319]: INFO os_brick.initiator.connectors.lightos [None req-7a3f2202-7cda-4e09-9563-4547508d8589 tempest-VolumesBackupsTest-807180270 None] Current host hostNQN and IP(s) are ['10.4.3.95', 'fe80::f816:3eff:fe47:268c', '192.168.40.6', 'fe80::f816:3eff:febf:7be2', '192.168.50.6', 'fe80::f816:3eff:fe99:8914', '192.168.10.6', 'fe80::f816:3eff:fe2f:e696', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::bc9d:84ff:fec2:6b49', 'fe80::fc16:3eff:feaa:206b', 'fe80::74a1:e1ff:fe2f:1924'] Jul 03 09:53:22.215703 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.lightos [None req-7a3f2202-7cda-4e09-9563-4547508d8589 tempest-VolumesBackupsTest-807180270 None] LIGHTOS: did not find dsc, continuing anyway. {{(pid=101319) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}} Jul 03 09:53:22.215865 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.lightos [None req-7a3f2202-7cda-4e09-9563-4547508d8589 tempest-VolumesBackupsTest-807180270 None] LIGHTOS: no hostnqn found. {{(pid=101319) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}} Jul 03 09:53:22.216056 np0000004400 cinder-backup[101319]: DEBUG os_brick.utils [None req-7a3f2202-7cda-4e09-9563-4547508d8589 tempest-VolumesBackupsTest-807180270 None] <== get_connector_properties: return (56ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.95', 'host': 'np0000004400', 'multipath': False, 'enforce_multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:ae7e5bb0ebe6', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': '6b284368-d0ba-4d18-af6f-4998d3955c52', 'nvme_native_multipath': False} {{(pid=101319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}} Jul 03 09:53:22.322084 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-904329c4-9ef6-4056-95e0-4524f15f09c7 tempest-ProjectReaderTests33-761902925 None] Backing up chunk of data from volume. {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 09:53:22.560903 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-904329c4-9ef6-4056-95e0-4524f15f09c7 tempest-ProjectReaderTests33-761902925 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101319) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 09:53:22.561271 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-904329c4-9ef6-4056-95e0-4524f15f09c7 tempest-ProjectReaderTests33-761902925 None] About to put_object {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 09:53:22.659636 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-904329c4-9ef6-4056-95e0-4524f15f09c7 tempest-ProjectReaderTests33-761902925 None] backup MD5 for volume_91385958-bc9a-4b5d-ac21-22d57700a0e4/20260703095311/az_nova_backup_995de3de-d18a-4f2d-9b86-30dcb8a7d527-00019: 25e317773f308e446cc84c503a6d1f85 {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 09:53:22.659792 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-904329c4-9ef6-4056-95e0-4524f15f09c7 tempest-ProjectReaderTests33-761902925 None] Calling eventlet.sleep(0) {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 09:53:22.692840 np0000004400 cinder-backup[101319]: DEBUG oslo_db.sqlalchemy.engines [None req-904329c4-9ef6-4056-95e0-4524f15f09c7 tempest-ProjectReaderTests33-761902925 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=101319) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 03 09:53:22.719935 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connector [None req-7a3f2202-7cda-4e09-9563-4547508d8589 tempest-VolumesBackupsTest-807180270 None] Factory for iscsi on None {{(pid=101319) factory /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connector.py:243}} Jul 03 09:53:22.720320 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-7a3f2202-7cda-4e09-9563-4547508d8589 tempest-VolumesBackupsTest-807180270 None] ==> connect_volume: call "{'self': , 'connection_properties': {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-5a775425-df51-44ce-b820-7c6d483d6c42', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '5a775425-df51-44ce-b820-7c6d483d6c42', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': False}}" {{(pid=101319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}} Jul 03 09:53:22.720522 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.base [None req-7a3f2202-7cda-4e09-9563-4547508d8589 tempest-VolumesBackupsTest-807180270 None] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=101319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jul 03 09:53:22.869839 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-904329c4-9ef6-4056-95e0-4524f15f09c7 tempest-ProjectReaderTests33-761902925 None] Backing up chunk of data from volume. {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 09:53:23.042266 np0000004400 cinder-backup[101319]: INFO cinder.backup.manager [None req-1678b3a2-6ecc-4dce-a535-6e8837304678 tempest-ProjectMemberTests33-2105464604 None] Create backup started, backup: 0871942a-e198-4230-a099-29a52a21849b volume: 5f57fed7-aa36-44c5-af90-863bd3d3af9d. Jul 03 09:53:23.049670 np0000004400 cinder-backup[101319]: INFO cinder.backup.manager [None req-1678b3a2-6ecc-4dce-a535-6e8837304678 tempest-ProjectMemberTests33-2105464604 None] Call Volume Manager to get_backup_device for Backup(availability_zone='nova',container=None,created_at=2026-07-03T09:53:22Z,data_timestamp=2026-07-03T09:53:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-type-Backup-859092992',encryption_key_id=None,fail_reason=None,host='np0000004400',id=0871942a-e198-4230-a099-29a52a21849b,metadata={},num_dependent_backups=0,object_count=0,parent=None,parent_id=None,project_id='e0b6e59b911e40b3acac38afb1f81e3a',restore_volume_id=None,service='cinder.backup.drivers.swift.SwiftBackupDriver',service_metadata=None,size=1,snapshot_id=None,status='creating',temp_snapshot_id=None,temp_volume_id=None,updated_at=None,user_id='87abbb474f8a4baf840fcfdf286ff94e',volume_id=5f57fed7-aa36-44c5-af90-863bd3d3af9d) Jul 03 09:53:23.077761 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.drivers.swift [None req-1678b3a2-6ecc-4dce-a535-6e8837304678 tempest-ProjectMemberTests33-2105464604 None] Using swift URL https://10.4.3.95:8080/v1/AUTH_e0b6e59b911e40b3acac38afb1f81e3a {{(pid=101319) initialize /opt/stack/cinder/cinder/backup/drivers/swift.py:300}} Jul 03 09:53:23.077761 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.drivers.swift [None req-1678b3a2-6ecc-4dce-a535-6e8837304678 tempest-ProjectMemberTests33-2105464604 None] Connect to https://10.4.3.95:8080/v1/AUTH_ in "per_user" mode {{(pid=101319) initialize /opt/stack/cinder/cinder/backup/drivers/swift.py:301}} Jul 03 09:53:23.078190 np0000004400 cinder-backup[101319]: DEBUG os_brick.utils [None req-1678b3a2-6ecc-4dce-a535-6e8837304678 tempest-ProjectMemberTests33-2105464604 None] ==> get_connector_properties: call "{'root_helper': 'sudo cinder-rootwrap /etc/cinder/rootwrap.conf', 'my_ip': '10.4.3.95', 'multipath': False, 'enforce_multipath': False, 'host': None, 'execute': None}" {{(pid=101319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}} Jul 03 09:53:23.090291 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.scaleio [None req-1678b3a2-6ecc-4dce-a535-6e8837304678 tempest-ProjectMemberTests33-2105464604 None] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=101319) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}} Jul 03 09:53:23.112985 np0000004400 cinder-backup[101319]: DEBUG oslo_concurrency.processutils [None req-1678b3a2-6ecc-4dce-a535-6e8837304678 tempest-ProjectMemberTests33-2105464604 None] Running cmd (subprocess): nvme version {{(pid=101319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 09:53:23.126760 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-904329c4-9ef6-4056-95e0-4524f15f09c7 tempest-ProjectReaderTests33-761902925 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101319) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 09:53:23.127002 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-904329c4-9ef6-4056-95e0-4524f15f09c7 tempest-ProjectReaderTests33-761902925 None] About to put_object {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 09:53:23.132816 np0000004400 cinder-backup[101319]: DEBUG oslo_concurrency.processutils [None req-1678b3a2-6ecc-4dce-a535-6e8837304678 tempest-ProjectMemberTests33-2105464604 None] 'nvme version' failed. Not Retrying. {{(pid=101319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 03 09:53:23.133029 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.nvmeof [None req-1678b3a2-6ecc-4dce-a535-6e8837304678 tempest-ProjectMemberTests33-2105464604 None] nvme not present on system {{(pid=101319) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}} Jul 03 09:53:23.141983 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.lightos [None req-1678b3a2-6ecc-4dce-a535-6e8837304678 tempest-ProjectMemberTests33-2105464604 None] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=101319) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}} Jul 03 09:53:23.142993 np0000004400 cinder-backup[101319]: INFO os_brick.initiator.connectors.lightos [None req-1678b3a2-6ecc-4dce-a535-6e8837304678 tempest-ProjectMemberTests33-2105464604 None] Current host hostNQN and IP(s) are ['10.4.3.95', 'fe80::f816:3eff:fe47:268c', '192.168.40.6', 'fe80::f816:3eff:febf:7be2', '192.168.50.6', 'fe80::f816:3eff:fe99:8914', '192.168.10.6', 'fe80::f816:3eff:fe2f:e696', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::bc9d:84ff:fec2:6b49', 'fe80::fc16:3eff:feaa:206b', 'fe80::74a1:e1ff:fe2f:1924'] Jul 03 09:53:23.143163 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.lightos [None req-1678b3a2-6ecc-4dce-a535-6e8837304678 tempest-ProjectMemberTests33-2105464604 None] LIGHTOS: did not find dsc, continuing anyway. {{(pid=101319) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}} Jul 03 09:53:23.143364 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.lightos [None req-1678b3a2-6ecc-4dce-a535-6e8837304678 tempest-ProjectMemberTests33-2105464604 None] LIGHTOS: no hostnqn found. {{(pid=101319) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}} Jul 03 09:53:23.144279 np0000004400 cinder-backup[101319]: DEBUG os_brick.utils [None req-1678b3a2-6ecc-4dce-a535-6e8837304678 tempest-ProjectMemberTests33-2105464604 None] <== get_connector_properties: return (64ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.95', 'host': 'np0000004400', 'multipath': False, 'enforce_multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:ae7e5bb0ebe6', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': '6b284368-d0ba-4d18-af6f-4998d3955c52', 'nvme_native_multipath': False} {{(pid=101319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}} Jul 03 09:53:23.249064 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-904329c4-9ef6-4056-95e0-4524f15f09c7 tempest-ProjectReaderTests33-761902925 None] backup MD5 for volume_91385958-bc9a-4b5d-ac21-22d57700a0e4/20260703095311/az_nova_backup_995de3de-d18a-4f2d-9b86-30dcb8a7d527-00020: 25e317773f308e446cc84c503a6d1f85 {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 09:53:23.249171 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-904329c4-9ef6-4056-95e0-4524f15f09c7 tempest-ProjectReaderTests33-761902925 None] Calling eventlet.sleep(0) {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 09:53:23.290901 np0000004400 cinder-backup[101319]: DEBUG oslo_db.sqlalchemy.engines [None req-904329c4-9ef6-4056-95e0-4524f15f09c7 tempest-ProjectReaderTests33-761902925 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=101319) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 03 09:53:23.388637 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-904329c4-9ef6-4056-95e0-4524f15f09c7 tempest-ProjectReaderTests33-761902925 None] Backing up chunk of data from volume. {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 09:53:23.506811 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-904329c4-9ef6-4056-95e0-4524f15f09c7 tempest-ProjectReaderTests33-761902925 None] Compressed 25165824 bytes of data to 24470 bytes using zlib. {{(pid=101319) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 09:53:23.506954 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-904329c4-9ef6-4056-95e0-4524f15f09c7 tempest-ProjectReaderTests33-761902925 None] About to put_object {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 09:53:23.578388 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-904329c4-9ef6-4056-95e0-4524f15f09c7 tempest-ProjectReaderTests33-761902925 None] backup MD5 for volume_91385958-bc9a-4b5d-ac21-22d57700a0e4/20260703095311/az_nova_backup_995de3de-d18a-4f2d-9b86-30dcb8a7d527-00021: 77377273b0a4b61febdbf7bbf52b9db9 {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 09:53:23.578780 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-904329c4-9ef6-4056-95e0-4524f15f09c7 tempest-ProjectReaderTests33-761902925 None] Calling eventlet.sleep(0) {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 09:53:23.585697 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.driver [None req-904329c4-9ef6-4056-95e0-4524f15f09c7 tempest-ProjectReaderTests33-761902925 None] Getting metadata type 'volume-base-metadata' {{(pid=101319) _save_vol_base_meta /opt/stack/cinder/cinder/backup/driver.py:79}} Jul 03 09:53:23.591036 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.driver [None req-904329c4-9ef6-4056-95e0-4524f15f09c7 tempest-ProjectReaderTests33-761902925 None] Completed fetching metadata type 'volume-base-metadata' {{(pid=101319) _save_vol_base_meta /opt/stack/cinder/cinder/backup/driver.py:98}} Jul 03 09:53:23.591036 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.driver [None req-904329c4-9ef6-4056-95e0-4524f15f09c7 tempest-ProjectReaderTests33-761902925 None] Getting metadata type 'volume-metadata' {{(pid=101319) _save_vol_meta /opt/stack/cinder/cinder/backup/driver.py:109}} Jul 03 09:53:23.594969 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.driver [None req-904329c4-9ef6-4056-95e0-4524f15f09c7 tempest-ProjectReaderTests33-761902925 None] No metadata type 'volume-metadata' available {{(pid=101319) _save_vol_meta /opt/stack/cinder/cinder/backup/driver.py:123}} Jul 03 09:53:23.594969 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.driver [None req-904329c4-9ef6-4056-95e0-4524f15f09c7 tempest-ProjectReaderTests33-761902925 None] Getting metadata type 'volume-glance-metadata' {{(pid=101319) _save_vol_glance_meta /opt/stack/cinder/cinder/backup/driver.py:132}} Jul 03 09:53:23.597105 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.driver [None req-904329c4-9ef6-4056-95e0-4524f15f09c7 tempest-ProjectReaderTests33-761902925 None] No metadata type 'volume-glance-metadata' available {{(pid=101319) _save_vol_glance_meta /opt/stack/cinder/cinder/backup/driver.py:147}} Jul 03 09:53:23.597355 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-904329c4-9ef6-4056-95e0-4524f15f09c7 tempest-ProjectReaderTests33-761902925 None] _write_sha256file started, container name: volumebackups, sha256file filename: volume_91385958-bc9a-4b5d-ac21-22d57700a0e4/20260703095311/az_nova_backup_995de3de-d18a-4f2d-9b86-30dcb8a7d527_sha256file. {{(pid=101319) _write_sha256file /opt/stack/cinder/cinder/backup/chunkeddriver.py:299}} Jul 03 09:53:23.647938 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connector [None req-1678b3a2-6ecc-4dce-a535-6e8837304678 tempest-ProjectMemberTests33-2105464604 None] Factory for iscsi on None {{(pid=101319) factory /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connector.py:243}} Jul 03 09:53:23.648354 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-1678b3a2-6ecc-4dce-a535-6e8837304678 tempest-ProjectMemberTests33-2105464604 None] ==> connect_volume: call "{'self': , 'connection_properties': {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-5f57fed7-aa36-44c5-af90-863bd3d3af9d', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '5f57fed7-aa36-44c5-af90-863bd3d3af9d', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': False}}" {{(pid=101319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}} Jul 03 09:53:23.648562 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.base [None req-1678b3a2-6ecc-4dce-a535-6e8837304678 tempest-ProjectMemberTests33-2105464604 None] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=101319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jul 03 09:53:23.672275 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-904329c4-9ef6-4056-95e0-4524f15f09c7 tempest-ProjectReaderTests33-761902925 None] _write_sha256file finished. {{(pid=101319) _write_sha256file /opt/stack/cinder/cinder/backup/chunkeddriver.py:315}} Jul 03 09:53:23.673222 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-904329c4-9ef6-4056-95e0-4524f15f09c7 tempest-ProjectReaderTests33-761902925 None] _write_metadata started, container name: volumebackups, metadata filename: volume_91385958-bc9a-4b5d-ac21-22d57700a0e4/20260703095311/az_nova_backup_995de3de-d18a-4f2d-9b86-30dcb8a7d527_metadata. {{(pid=101319) _write_metadata /opt/stack/cinder/cinder/backup/chunkeddriver.py:276}} Jul 03 09:53:23.705237 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-904329c4-9ef6-4056-95e0-4524f15f09c7 tempest-ProjectReaderTests33-761902925 None] _write_metadata finished. Metadata: b'{\n "backup_description": null,\n "backup_id": "995de3de-d18a-4f2d-9b86-30dcb8a7d527",\n "backup_name": "tempest-type-Backup-256641667",\n "created_at": "2026-07-03 09:53:09+00:00",\n "objects": [\n {\n "volume_91385958-bc9a-4b5d-ac21-22d57700a0e4/20260703095311/az_nova_backup_995de3de-d18a-4f2d-9b86-30dcb8a7d527-00001": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 0\n }\n },\n {\n "volume_91385958-bc9a-4b5d-ac21-22d57700a0e4/20260703095311/az_nova_backup_995de3de-d18a-4f2d-9b86-30dcb8a7d527-00002": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 52428800\n }\n },\n {\n "volume_91385958-bc9a-4b5d-ac21-22d57700a0e4/20260703095311/az_nova_backup_995de3de-d18a-4f2d-9b86-30dcb8a7d527-00003": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 104857600\n }\n },\n {\n "volume_91385958-bc9a-4b5d-ac21-22d57700a0e4/20260703095311/az_nova_backup_995de3de-d18a-4f2d-9b86-30dcb8a7d527-00004": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 157286400\n }\n },\n {\n "volume_91385958-bc9a-4b5d-ac21-22d57700a0e4/20260703095311/az_nova_backup_995de3de-d18a-4f2d-9b86-30dcb8a7d527-00005": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 209715200\n }\n },\n {\n "volume_91385958-bc9a-4b5d-ac21-22d57700a0e4/20260703095311/az_nova_backup_995de3de-d18a-4f2d-9b86-30dcb8a7d527-00006": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 262144000\n }\n },\n {\n "volume_91385958-bc9a-4b5d-ac21-22d57700a0e4/20260703095311/az_nova_backup_995de3de-d18a-4f2d-9b86-30dcb8a7d527-00007": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 314572800\n }\n },\n {\n "volume_91385958-bc9a-4b5d-ac21-22d57700a0e4/20260703095311/az_nova_backup_995de3de-d18a-4f2d-9b86-30dcb8a7d527-00008": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 367001600\n }\n },\n {\n "volume_91385958-bc9a-4b5d-ac21-22d57700a0e4/20260703095311/az_nova_backup_995de3de-d18a-4f2d-9b86-30dcb8a7d527-00009": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 419430400\n }\n },\n {\n "volume_91385958-bc9a-4b5d-ac21-22d57700a0e4/20260703095311/az_nova_backup_995de3de-d18a-4f2d-9b86-30dcb8a7d527-00010": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 471859200\n }\n },\n {\n "volume_91385958-bc9a-4b5d-ac21-22d57700a0e4/20260703095311/az_nova_backup_995de3de-d18a-4f2d-9b86-30dcb8a7d527-00011": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 524288000\n }\n },\n {\n "volume_91385958-bc9a-4b5d-ac21-22d57700a0e4/20260703095311/az_nova_backup_995de3de-d18a-4f2d-9b86-30dcb8a7d527-00012": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 576716800\n }\n },\n {\n "volume_91385958-bc9a-4b5d-ac21-22d57700a0e4/20260703095311/az_nova_backup_995de3de-d18a-4f2d-9b86-30dcb8a7d527-00013": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 629145600\n }\n },\n {\n "volume_91385958-bc9a-4b5d-ac21-22d57700a0e4/20260703095311/az_nova_backup_995de3de-d18a-4f2d-9b86-30dcb8a7d527-00014": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 681574400\n }\n },\n {\n "volume_91385958-bc9a-4b5d-ac21-22d57700a0e4/20260703095311/az_nova_backup_995de3de-d18a-4f2d-9b86-30dcb8a7d527-00015": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 734003200\n }\n },\n {\n "volume_91385958-bc9a-4b5d-ac21-22d57700a0e4/20260703095311/az_nova_backup_995de3de-d18a-4f2d-9b86-30dcb8a7d527-00016": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 786432000\n }\n },\n {\n "volume_91385958-bc9a-4b5d-ac21-22d57700a0e4/20260703095311/az_nova_backup_995de3de-d18a-4f2d-9b86-30dcb8a7d527-00017": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 838860800\n }\n },\n {\n "volume_91385958-bc9a-4b5d-ac21-22d57700a0e4/20260703095311/az_nova_backup_995de3de-d18a-4f2d-9b86-30dcb8a7d527-00018": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 891289600\n }\n },\n {\n "volume_91385958-bc9a-4b5d-ac21-22d57700a0e4/20260703095311/az_nova_backup_995de3de-d18a-4f2d-9b86-30dcb8a7d527-00019": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 943718400\n }\n },\n {\n "volume_91385958-bc9a-4b5d-ac21-22d57700a0e4/20260703095311/az_nova_backup_995de3de-d18a-4f2d-9b86-30dcb8a7d527-00020": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 996147200\n }\n },\n {\n "volume_91385958-bc9a-4b5d-ac21-22d57700a0e4/20260703095311/az_nova_backup_995de3de-d18a-4f2d-9b86-30dcb8a7d527-00021": {\n "compression": "zlib",\n "length": 25165824,\n "md5": "77377273b0a4b61febdbf7bbf52b9db9",\n "offset": 1048576000\n }\n }\n ],\n "parent_id": null,\n "version": "1.0.0",\n "volume_id": "91385958-bc9a-4b5d-ac21-22d57700a0e4",\n "volume_meta": "{\\"version\\": 2, \\"volume-base-metadata\\": {\\"id\\": \\"91385958-bc9a-4b5d-ac21-22d57700a0e4\\", \\"_name_id\\": null, \\"use_quota\\": true, \\"ec2_id\\": null, \\"user_id\\": \\"45a99ff133014c9a8bfd931707d31606\\", \\"project_id\\": \\"e331bd155b824bbb8979e9aac5023870\\", \\"snapshot_id\\": null, \\"cluster_name\\": null, \\"host\\": \\"np0000004400@storpool#default\\", \\"size\\": 1, \\"availability_zone\\": \\"nova\\", \\"status\\": \\"backing-up\\", \\"attach_status\\": \\"detached\\", \\"migration_status\\": null, \\"scheduled_at\\": \\"2026-07-03T09:53:08.000000\\", \\"launched_at\\": \\"2026-07-03T09:53:08.000000\\", \\"terminated_at\\": null, \\"display_name\\": \\"tempest-VolumeV3RbacBaseTests-Volume-1945860006\\", \\"display_description\\": null, \\"provider_location\\": null, \\"provider_auth\\": null, \\"provider_geometry\\": null, \\"provider_id\\": null, \\"volume_type_id\\": \\"03e13fe6-0e30-4803-ace0-725d38e6dc24\\", \\"source_volid\\": null, \\"encryption_key_id\\": null, \\"consistencygroup_id\\": null, \\"group_id\\": null, \\"bootable\\": false, \\"multiattach\\": false, \\"replication_status\\": null, \\"replication_extended_status\\": null, \\"replication_driver_data\\": null, \\"previous_status\\": \\"available\\", \\"service_uuid\\": \\"6d4b0e79-fefe-4744-b25f-34be05095200\\", \\"shared_targets\\": true, \\"deleted_at\\": null, \\"deleted\\": false, \\"created_at\\": \\"2026-07-03T09:53:07.000000\\", \\"updated_at\\": \\"2026-07-03T09:53:09.000000\\"}}"\n}'. {{(pid=101319) _write_metadata /opt/stack/cinder/cinder/backup/chunkeddriver.py:295}} Jul 03 09:53:23.714086 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-904329c4-9ef6-4056-95e0-4524f15f09c7 tempest-ProjectReaderTests33-761902925 None] backup 995de3de-d18a-4f2d-9b86-30dcb8a7d527 finished. {{(pid=101319) _finalize_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:462}} Jul 03 09:53:23.834047 np0000004400 cinder-backup[101319]: DEBUG oslo_concurrency.processutils [None req-904329c4-9ef6-4056-95e0-4524f15f09c7 tempest-ProjectReaderTests33-761902925 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chown 0 /dev/sdf {{(pid=101319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 09:53:23.854337 np0000004400 sudo[154347]: stack : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chown 0 /dev/sdf Jul 03 09:53:23.854992 np0000004400 sudo[154347]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1002) Jul 03 09:53:23.941850 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.base [None req-7a3f2202-7cda-4e09-9563-4547508d8589 tempest-VolumesBackupsTest-807180270 None] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 1.221s {{(pid=101319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jul 03 09:53:23.942271 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.base [None req-7a3f2202-7cda-4e09-9563-4547508d8589 tempest-VolumesBackupsTest-807180270 None] Connection properties {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-5a775425-df51-44ce-b820-7c6d483d6c42', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '5a775425-df51-44ce-b820-7c6d483d6c42', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': False} {{(pid=101319) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}} Jul 03 09:53:23.952639 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.base [None req-7a3f2202-7cda-4e09-9563-4547508d8589 tempest-VolumesBackupsTest-807180270 None] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-5a775425-df51-44ce-b820-7c6d483d6c42" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=101319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jul 03 09:53:23.953285 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.base [None req-7a3f2202-7cda-4e09-9563-4547508d8589 tempest-VolumesBackupsTest-807180270 None] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-5a775425-df51-44ce-b820-7c6d483d6c42" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=101319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jul 03 09:53:23.953568 np0000004400 cinder-backup[101319]: INFO os_brick.initiator.connectors.iscsi [None req-7a3f2202-7cda-4e09-9563-4547508d8589 tempest-VolumesBackupsTest-807180270 None] Trying to connect to iSCSI portal 192.168.40.100:3260 Jul 03 09:53:23.963449 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-7a3f2202-7cda-4e09-9563-4547508d8589 tempest-VolumesBackupsTest-807180270 None] iscsiadm (): stdout= stderr=iscsiadm: No records found Jul 03 09:53:23.963449 np0000004400 cinder-backup[101319]: {{(pid=101319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 03 09:53:23.973641 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-7a3f2202-7cda-4e09-9563-4547508d8589 tempest-VolumesBackupsTest-807180270 None] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-5a775425-df51-44ce-b820-7c6d483d6c42] added Jul 03 09:53:23.973641 np0000004400 cinder-backup[101319]: stderr=iscsiadm: Config file line 363 does not have value Jul 03 09:53:23.973641 np0000004400 cinder-backup[101319]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs' Jul 03 09:53:23.973641 np0000004400 cinder-backup[101319]: iscsiadm: Config file line 363 does not have value Jul 03 09:53:23.973641 np0000004400 cinder-backup[101319]: iscsiadm: Config file line 363 does not have value Jul 03 09:53:23.973641 np0000004400 cinder-backup[101319]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs' Jul 03 09:53:23.973641 np0000004400 cinder-backup[101319]: {{(pid=101319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 03 09:53:23.973954 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-7a3f2202-7cda-4e09-9563-4547508d8589 tempest-VolumesBackupsTest-807180270 None] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=101319) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}} Jul 03 09:53:23.974249 np0000004400 cinder-backup[101319]: DEBUG os_brick.utils [None req-7a3f2202-7cda-4e09-9563-4547508d8589 tempest-VolumesBackupsTest-807180270 None] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0207(s), this was the 1st time calling it. {{(pid=101319) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}} Jul 03 09:53:23.974456 np0000004400 cinder-backup[101319]: DEBUG os_brick.utils [None req-7a3f2202-7cda-4e09-9563-4547508d8589 tempest-VolumesBackupsTest-807180270 None] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=101319) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}} Jul 03 09:53:24.149221 np0000004400 sudo[154347]: pam_unix(sudo:session): session closed for user root Jul 03 09:53:24.151223 np0000004400 cinder-backup[101319]: DEBUG oslo_concurrency.processutils [None req-904329c4-9ef6-4056-95e0-4524f15f09c7 tempest-ProjectReaderTests33-761902925 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chown 0 /dev/sdf" returned: 0 in 0.317s {{(pid=101319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 09:53:24.151823 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-904329c4-9ef6-4056-95e0-4524f15f09c7 tempest-ProjectReaderTests33-761902925 None] ==> disconnect_volume: call "{'args': (, {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-91385958-bc9a-4b5d-ac21-22d57700a0e4', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '91385958-bc9a-4b5d-ac21-22d57700a0e4', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': False}, {'type': 'block', 'scsi_wwn': '1StorPooliSCSI_DISK_1034578903445799225', 'path': '/dev/sdf'}), 'kwargs': {'force': True, 'ignore_errors': True}}" {{(pid=101319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}} Jul 03 09:53:24.152011 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.base [None req-904329c4-9ef6-4056-95e0-4524f15f09c7 tempest-ProjectReaderTests33-761902925 None] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=101319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jul 03 09:53:24.975219 np0000004400 cinder-backup[101319]: INFO os_brick.initiator.connectors.iscsi [None req-7a3f2202-7cda-4e09-9563-4547508d8589 tempest-VolumesBackupsTest-807180270 None] Trying to connect to iSCSI portal 192.168.40.100:3260 Jul 03 09:53:24.985936 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-7a3f2202-7cda-4e09-9563-4547508d8589 tempest-VolumesBackupsTest-807180270 None] iscsiadm (): stdout=# BEGIN RECORD 2.1.9 Jul 03 09:53:24.985936 np0000004400 cinder-backup[101319]: node.name = iqn.2023-03.storpool.com:os--volume-5a775425-df51-44ce-b820-7c6d483d6c42 Jul 03 09:53:24.985936 np0000004400 cinder-backup[101319]: node.tpgt = -1 Jul 03 09:53:24.985936 np0000004400 cinder-backup[101319]: node.startup = manual Jul 03 09:53:24.985936 np0000004400 cinder-backup[101319]: node.leading_login = No Jul 03 09:53:24.985936 np0000004400 cinder-backup[101319]: iface.iscsi_ifacename = default Jul 03 09:53:24.985936 np0000004400 cinder-backup[101319]: iface.net_ifacename = Jul 03 09:53:24.985936 np0000004400 cinder-backup[101319]: iface.ipaddress = Jul 03 09:53:24.985936 np0000004400 cinder-backup[101319]: iface.prefix_len = 0 Jul 03 09:53:24.985936 np0000004400 cinder-backup[101319]: iface.hwaddress = Jul 03 09:53:24.985936 np0000004400 cinder-backup[101319]: iface.transport_name = tcp Jul 03 09:53:24.985936 np0000004400 cinder-backup[101319]: iface.initiatorname = Jul 03 09:53:24.985936 np0000004400 cinder-backup[101319]: iface.state = Jul 03 09:53:24.985936 np0000004400 cinder-backup[101319]: iface.vlan_id = 0 Jul 03 09:53:24.985936 np0000004400 cinder-backup[101319]: iface.vlan_priority = 0 Jul 03 09:53:24.985936 np0000004400 cinder-backup[101319]: iface.vlan_state = Jul 03 09:53:24.985936 np0000004400 cinder-backup[101319]: iface.iface_num = 0 Jul 03 09:53:24.985936 np0000004400 cinder-backup[101319]: iface.mtu = 0 Jul 03 09:53:24.985936 np0000004400 cinder-backup[101319]: iface.port = 0 Jul 03 09:53:24.985936 np0000004400 cinder-backup[101319]: iface.bootproto = Jul 03 09:53:24.985936 np0000004400 cinder-backup[101319]: iface.subnet_mask = Jul 03 09:53:24.985936 np0000004400 cinder-backup[101319]: iface.gateway = Jul 03 09:53:24.985936 np0000004400 cinder-backup[101319]: iface.dhcp_alt_client_id_state = Jul 03 09:53:24.985936 np0000004400 cinder-backup[101319]: iface.dhcp_alt_client_id = Jul 03 09:53:24.985936 np0000004400 cinder-backup[101319]: iface.dhcp_dns = Jul 03 09:53:24.985936 np0000004400 cinder-backup[101319]: iface.dhcp_learn_iqn = Jul 03 09:53:24.985936 np0000004400 cinder-backup[101319]: iface.dhcp_req_vendor_id_state = Jul 03 09:53:24.985936 np0000004400 cinder-backup[101319]: iface.dhcp_vendor_id_state = Jul 03 09:53:24.985936 np0000004400 cinder-backup[101319]: iface.dhcp_vendor_id = Jul 03 09:53:24.985936 np0000004400 cinder-backup[101319]: iface.dhcp_slp_da = Jul 03 09:53:24.985936 np0000004400 cinder-backup[101319]: iface.fragmentation = Jul 03 09:53:24.985936 np0000004400 cinder-backup[101319]: iface.gratuitous_arp = Jul 03 09:53:24.985936 np0000004400 cinder-backup[101319]: iface.incoming_forwarding = Jul 03 09:53:24.985936 np0000004400 cinder-backup[101319]: iface.tos_state = Jul 03 09:53:24.985936 np0000004400 cinder-backup[101319]: iface.tos = 0 Jul 03 09:53:24.985936 np0000004400 cinder-backup[101319]: iface.ttl = 0 Jul 03 09:53:24.985936 np0000004400 cinder-backup[101319]: iface.delayed_ack = Jul 03 09:53:24.985936 np0000004400 cinder-backup[101319]: iface.tcp_nagle = Jul 03 09:53:24.985936 np0000004400 cinder-backup[101319]: iface.tcp_wsf_state = Jul 03 09:53:24.985936 np0000004400 cinder-backup[101319]: iface.tcp_wsf = 0 Jul 03 09:53:24.985936 np0000004400 cinder-backup[101319]: iface.tcp_timer_scale = 0 Jul 03 09:53:24.985936 np0000004400 cinder-backup[101319]: iface.tcp_timestamp = Jul 03 09:53:24.985936 np0000004400 cinder-backup[101319]: iface.redirect = Jul 03 09:53:24.985936 np0000004400 cinder-backup[101319]: iface.def_task_mgmt_timeout = 0 Jul 03 09:53:24.985936 np0000004400 cinder-backup[101319]: iface.header_digest = Jul 03 09:53:24.985936 np0000004400 cinder-backup[101319]: iface.data_digest = Jul 03 09:53:24.985936 np0000004400 cinder-backup[101319]: iface.immediate_data = Jul 03 09:53:24.985936 np0000004400 cinder-backup[101319]: iface.initial_r2t = Jul 03 09:53:24.985936 np0000004400 cinder-backup[101319]: iface.data_seq_inorder = Jul 03 09:53:24.985936 np0000004400 cinder-backup[101319]: iface.data_pdu_inorder = Jul 03 09:53:24.985936 np0000004400 cinder-backup[101319]: iface.erl = 0 Jul 03 09:53:24.985936 np0000004400 cinder-backup[101319]: iface.max_receive_data_len = 0 Jul 03 09:53:24.985936 np0000004400 cinder-backup[101319]: iface.first_burst_len = 0 Jul 03 09:53:24.985936 np0000004400 cinder-backup[101319]: iface.max_outstanding_r2t = 0 Jul 03 09:53:24.985936 np0000004400 cinder-backup[101319]: iface.max_burst_len = 0 Jul 03 09:53:24.985936 np0000004400 cinder-backup[101319]: iface.chap_auth = Jul 03 09:53:24.985936 np0000004400 cinder-backup[101319]: iface.bidi_chap = Jul 03 09:53:24.985936 np0000004400 cinder-backup[101319]: iface.strict_login_compliance = Jul 03 09:53:24.985936 np0000004400 cinder-backup[101319]: iface.discovery_auth = Jul 03 09:53:24.985936 np0000004400 cinder-backup[101319]: iface.discovery_logout = Jul 03 09:53:24.985936 np0000004400 cinder-backup[101319]: node.discovery_address = Jul 03 09:53:24.985936 np0000004400 cinder-backup[101319]: node.discovery_port = 0 Jul 03 09:53:24.985936 np0000004400 cinder-backup[101319]: node.discovery_type = fw Jul 03 09:53:24.985936 np0000004400 cinder-backup[101319]: node.session.initial_cmdsn = 0 Jul 03 09:53:24.985936 np0000004400 cinder-backup[101319]: node.session.initial_login_retry_max = 8 Jul 03 09:53:24.985936 np0000004400 cinder-backup[101319]: node.session.xmit_thread_priority = 0 Jul 03 09:53:24.985936 np0000004400 cinder-backup[101319]: node.session.cmds_max = 128 Jul 03 09:53:24.985936 np0000004400 cinder-backup[101319]: node.session.queue_depth = 32 Jul 03 09:53:24.985936 np0000004400 cinder-backup[101319]: node.session.nr_sessions = 1 Jul 03 09:53:24.985936 np0000004400 cinder-backup[101319]: node.session.auth.authmethod = None Jul 03 09:53:24.985936 np0000004400 cinder-backup[101319]: node.session.auth.username = Jul 03 09:53:24.985936 np0000004400 cinder-backup[101319]: node.session.auth.password = *** Jul 03 09:53:24.985936 np0000004400 cinder-backup[101319]: node.session.auth.username_in = Jul 03 09:53:24.985936 np0000004400 cinder-backup[101319]: node.session.auth.password_in = Jul 03 09:53:24.985936 np0000004400 cinder-backup[101319]: node.session.auth.chap_algs = SHA256 Jul 03 09:53:24.985936 np0000004400 cinder-backup[101319]: node.session.timeo.replacement_timeout = 120 Jul 03 09:53:24.985936 np0000004400 cinder-backup[101319]: node.session.err_timeo.abort_timeout = 15 Jul 03 09:53:24.985936 np0000004400 cinder-backup[101319]: node.session.err_timeo.lu_reset_timeout = 30 Jul 03 09:53:24.985936 np0000004400 cinder-backup[101319]: node.session.err_timeo.tgt_reset_timeout = 30 Jul 03 09:53:24.985936 np0000004400 cinder-backup[101319]: node.session.err_timeo.host_reset_timeout = 60 Jul 03 09:53:24.985936 np0000004400 cinder-backup[101319]: node.session.iscsi.FastAbort = Yes Jul 03 09:53:24.985936 np0000004400 cinder-backup[101319]: node.session.iscsi.InitialR2T = No Jul 03 09:53:24.985936 np0000004400 cinder-backup[101319]: node.session.iscsi.ImmediateData = Yes Jul 03 09:53:24.985936 np0000004400 cinder-backup[101319]: node.session.iscsi.FirstBurstLength = 262144 Jul 03 09:53:24.985936 np0000004400 cinder-backup[101319]: node.session.iscsi.MaxBurstLength = 16776192 Jul 03 09:53:24.985936 np0000004400 cinder-backup[101319]: node.session.iscsi.DefaultTime2Retain = 0 Jul 03 09:53:24.985936 np0000004400 cinder-backup[101319]: node.session.iscsi.DefaultTime2Wait = 2 Jul 03 09:53:24.985936 np0000004400 cinder-backup[101319]: node.session.iscsi.MaxConnections = 1 Jul 03 09:53:24.985936 np0000004400 cinder-backup[101319]: node.session.iscsi.MaxOutstandingR2T = 1 Jul 03 09:53:24.985936 np0000004400 cinder-backup[101319]: node.session.iscsi.ERL = 0 Jul 03 09:53:24.985936 np0000004400 cinder-backup[101319]: node.session.scan = auto Jul 03 09:53:24.985936 np0000004400 cinder-backup[101319]: node.session.reopen_max = 0 Jul 03 09:53:24.985936 np0000004400 cinder-backup[101319]: node.conn[0].address = 192.168.40.100 Jul 03 09:53:24.985936 np0000004400 cinder-backup[101319]: node.conn[0].port = 3260 Jul 03 09:53:24.985936 np0000004400 cinder-backup[101319]: node.conn[0].startup = manual Jul 03 09:53:24.985936 np0000004400 cinder-backup[101319]: node.conn[0].tcp.window_size = 524288 Jul 03 09:53:24.985936 np0000004400 cinder-backup[101319]: node.conn[0].tcp.type_of_service = 0 Jul 03 09:53:24.985936 np0000004400 cinder-backup[101319]: node.conn[0].timeo.logout_timeout = 15 Jul 03 09:53:24.985936 np0000004400 cinder-backup[101319]: node.conn[0].timeo.login_timeout = 15 Jul 03 09:53:24.985936 np0000004400 cinder-backup[101319]: node.conn[0].timeo.auth_timeout = 45 Jul 03 09:53:24.985936 np0000004400 cinder-backup[101319]: node.conn[0].timeo.noop_out_interval = 5 Jul 03 09:53:24.985936 np0000004400 cinder-backup[101319]: node.conn[0].timeo.noop_out_timeout = 5 Jul 03 09:53:24.985936 np0000004400 cinder-backup[101319]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0 Jul 03 09:53:24.985936 np0000004400 cinder-backup[101319]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144 Jul 03 09:53:24.985936 np0000004400 cinder-backup[101319]: node.conn[0].iscsi.HeaderDigest = None Jul 03 09:53:24.985936 np0000004400 cinder-backup[101319]: node.conn[0].iscsi.DataDigest = None Jul 03 09:53:24.985936 np0000004400 cinder-backup[101319]: node.conn[0].iscsi.IFMarker = No Jul 03 09:53:24.985936 np0000004400 cinder-backup[101319]: node.conn[0].iscsi.OFMarker = No Jul 03 09:53:24.985936 np0000004400 cinder-backup[101319]: # END RECORD Jul 03 09:53:24.985936 np0000004400 cinder-backup[101319]: stderr= {{(pid=101319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 03 09:53:24.996769 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-7a3f2202-7cda-4e09-9563-4547508d8589 tempest-VolumesBackupsTest-807180270 None] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=101319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 03 09:53:25.010819 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-7a3f2202-7cda-4e09-9563-4547508d8589 tempest-VolumesBackupsTest-807180270 None] iscsiadm ('-m', 'session'): stdout=tcp: [188] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-491c39b6-d2e0-4f67-9a64-590d50f06197 (non-flash) Jul 03 09:53:25.010819 np0000004400 cinder-backup[101319]: tcp: [189] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-491c39b6-d2e0-4f67-9a64-590d50f06197 (non-flash) Jul 03 09:53:25.010819 np0000004400 cinder-backup[101319]: tcp: [196] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-91385958-bc9a-4b5d-ac21-22d57700a0e4 (non-flash) Jul 03 09:53:25.010819 np0000004400 cinder-backup[101319]: tcp: [197] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-87fba7de-22c7-4769-ad28-2ca1aa2a1458 (non-flash) Jul 03 09:53:25.010819 np0000004400 cinder-backup[101319]: tcp: [198] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-87fba7de-22c7-4769-ad28-2ca1aa2a1458 (non-flash) Jul 03 09:53:25.010819 np0000004400 cinder-backup[101319]: stderr= {{(pid=101319) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jul 03 09:53:25.011068 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-7a3f2202-7cda-4e09-9563-4547508d8589 tempest-VolumesBackupsTest-807180270 None] iscsi session list stdout=tcp: [188] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-491c39b6-d2e0-4f67-9a64-590d50f06197 (non-flash) Jul 03 09:53:25.011068 np0000004400 cinder-backup[101319]: tcp: [189] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-491c39b6-d2e0-4f67-9a64-590d50f06197 (non-flash) Jul 03 09:53:25.011068 np0000004400 cinder-backup[101319]: tcp: [196] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-91385958-bc9a-4b5d-ac21-22d57700a0e4 (non-flash) Jul 03 09:53:25.011068 np0000004400 cinder-backup[101319]: tcp: [197] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-87fba7de-22c7-4769-ad28-2ca1aa2a1458 (non-flash) Jul 03 09:53:25.011068 np0000004400 cinder-backup[101319]: tcp: [198] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-87fba7de-22c7-4769-ad28-2ca1aa2a1458 (non-flash) Jul 03 09:53:25.011068 np0000004400 cinder-backup[101319]: stderr= {{(pid=101319) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jul 03 09:53:25.049586 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-7a3f2202-7cda-4e09-9563-4547508d8589 tempest-VolumesBackupsTest-807180270 None] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-5a775425-df51-44ce-b820-7c6d483d6c42, portal: 192.168.40.100,3260] Jul 03 09:53:25.049586 np0000004400 cinder-backup[101319]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-5a775425-df51-44ce-b820-7c6d483d6c42, portal: 192.168.40.100,3260] successful. Jul 03 09:53:25.049586 np0000004400 cinder-backup[101319]: stderr= {{(pid=101319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 03 09:53:25.062686 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-7a3f2202-7cda-4e09-9563-4547508d8589 tempest-VolumesBackupsTest-807180270 None] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=101319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 03 09:53:25.076658 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-7a3f2202-7cda-4e09-9563-4547508d8589 tempest-VolumesBackupsTest-807180270 None] iscsiadm ('-m', 'session'): stdout=tcp: [188] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-491c39b6-d2e0-4f67-9a64-590d50f06197 (non-flash) Jul 03 09:53:25.076658 np0000004400 cinder-backup[101319]: tcp: [189] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-491c39b6-d2e0-4f67-9a64-590d50f06197 (non-flash) Jul 03 09:53:25.076658 np0000004400 cinder-backup[101319]: tcp: [196] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-91385958-bc9a-4b5d-ac21-22d57700a0e4 (non-flash) Jul 03 09:53:25.076658 np0000004400 cinder-backup[101319]: tcp: [197] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-87fba7de-22c7-4769-ad28-2ca1aa2a1458 (non-flash) Jul 03 09:53:25.076658 np0000004400 cinder-backup[101319]: tcp: [198] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-87fba7de-22c7-4769-ad28-2ca1aa2a1458 (non-flash) Jul 03 09:53:25.076658 np0000004400 cinder-backup[101319]: tcp: [199] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5a775425-df51-44ce-b820-7c6d483d6c42 (non-flash) Jul 03 09:53:25.076658 np0000004400 cinder-backup[101319]: stderr= {{(pid=101319) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jul 03 09:53:25.076962 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-7a3f2202-7cda-4e09-9563-4547508d8589 tempest-VolumesBackupsTest-807180270 None] iscsi session list stdout=tcp: [188] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-491c39b6-d2e0-4f67-9a64-590d50f06197 (non-flash) Jul 03 09:53:25.076962 np0000004400 cinder-backup[101319]: tcp: [189] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-491c39b6-d2e0-4f67-9a64-590d50f06197 (non-flash) Jul 03 09:53:25.076962 np0000004400 cinder-backup[101319]: tcp: [196] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-91385958-bc9a-4b5d-ac21-22d57700a0e4 (non-flash) Jul 03 09:53:25.076962 np0000004400 cinder-backup[101319]: tcp: [197] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-87fba7de-22c7-4769-ad28-2ca1aa2a1458 (non-flash) Jul 03 09:53:25.076962 np0000004400 cinder-backup[101319]: tcp: [198] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-87fba7de-22c7-4769-ad28-2ca1aa2a1458 (non-flash) Jul 03 09:53:25.076962 np0000004400 cinder-backup[101319]: tcp: [199] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5a775425-df51-44ce-b820-7c6d483d6c42 (non-flash) Jul 03 09:53:25.076962 np0000004400 cinder-backup[101319]: stderr= {{(pid=101319) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jul 03 09:53:25.077142 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.base [None req-7a3f2202-7cda-4e09-9563-4547508d8589 tempest-VolumesBackupsTest-807180270 None] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-5a775425-df51-44ce-b820-7c6d483d6c42" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.124s {{(pid=101319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jul 03 09:53:25.077272 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-7a3f2202-7cda-4e09-9563-4547508d8589 tempest-VolumesBackupsTest-807180270 None] Connected to 192.168.40.100:3260 {{(pid=101319) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}} Jul 03 09:53:25.077988 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.linuxscsi [None req-7a3f2202-7cda-4e09-9563-4547508d8589 tempest-VolumesBackupsTest-807180270 None] HCTL ('12', '-', '-', 0) found on session 199 with lun 0 {{(pid=101319) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}} Jul 03 09:53:25.078108 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.linuxscsi [None req-7a3f2202-7cda-4e09-9563-4547508d8589 tempest-VolumesBackupsTest-807180270 None] Scanning host 12 c: -, t: -, l: 0) {{(pid=101319) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}} Jul 03 09:53:25.091792 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.linuxscsi [None req-7a3f2202-7cda-4e09-9563-4547508d8589 tempest-VolumesBackupsTest-807180270 None] Searching for a device in session 199 and hctl ['12', '*', '*', 0] yield: None {{(pid=101319) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}} Jul 03 09:53:26.092657 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.linuxscsi [None req-7a3f2202-7cda-4e09-9563-4547508d8589 tempest-VolumesBackupsTest-807180270 None] Searching for a device in session 199 and hctl ['12', '*', '*', 0] yield: sdg {{(pid=101319) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}} Jul 03 09:53:26.093001 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-7a3f2202-7cda-4e09-9563-4547508d8589 tempest-VolumesBackupsTest-807180270 None] Connected to sdg using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-5a775425-df51-44ce-b820-7c6d483d6c42', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '5a775425-df51-44ce-b820-7c6d483d6c42', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': False} {{(pid=101319) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}} Jul 03 09:53:26.093443 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.base [None req-7a3f2202-7cda-4e09-9563-4547508d8589 tempest-VolumesBackupsTest-807180270 None] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 2.152s {{(pid=101319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jul 03 09:53:26.093610 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-7a3f2202-7cda-4e09-9563-4547508d8589 tempest-VolumesBackupsTest-807180270 None] <== connect_volume: return (3372ms) {'type': 'block', 'scsi_wwn': '3300000006cdc4cb8', 'path': '/dev/sdg'} {{(pid=101319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}} Jul 03 09:53:26.093930 np0000004400 cinder-backup[101319]: DEBUG oslo_concurrency.processutils [None req-7a3f2202-7cda-4e09-9563-4547508d8589 tempest-VolumesBackupsTest-807180270 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chown 1002 /dev/sdg {{(pid=101319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 09:53:26.099918 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.base [None req-1678b3a2-6ecc-4dce-a535-6e8837304678 tempest-ProjectMemberTests33-2105464604 None] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 2.450s {{(pid=101319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jul 03 09:53:26.100311 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.base [None req-1678b3a2-6ecc-4dce-a535-6e8837304678 tempest-ProjectMemberTests33-2105464604 None] Connection properties {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-5f57fed7-aa36-44c5-af90-863bd3d3af9d', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '5f57fed7-aa36-44c5-af90-863bd3d3af9d', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': False} {{(pid=101319) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}} Jul 03 09:53:26.109884 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.base [None req-1678b3a2-6ecc-4dce-a535-6e8837304678 tempest-ProjectMemberTests33-2105464604 None] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-5f57fed7-aa36-44c5-af90-863bd3d3af9d" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=101319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jul 03 09:53:26.110271 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.base [None req-1678b3a2-6ecc-4dce-a535-6e8837304678 tempest-ProjectMemberTests33-2105464604 None] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-5f57fed7-aa36-44c5-af90-863bd3d3af9d" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.000s {{(pid=101319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jul 03 09:53:26.110517 np0000004400 cinder-backup[101319]: INFO os_brick.initiator.connectors.iscsi [None req-1678b3a2-6ecc-4dce-a535-6e8837304678 tempest-ProjectMemberTests33-2105464604 None] Trying to connect to iSCSI portal 192.168.40.100:3260 Jul 03 09:53:26.110816 np0000004400 sudo[154423]: stack : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chown 1002 /dev/sdg Jul 03 09:53:26.111454 np0000004400 sudo[154423]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1002) Jul 03 09:53:26.120219 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-1678b3a2-6ecc-4dce-a535-6e8837304678 tempest-ProjectMemberTests33-2105464604 None] iscsiadm (): stdout= stderr=iscsiadm: No records found Jul 03 09:53:26.120219 np0000004400 cinder-backup[101319]: {{(pid=101319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 03 09:53:26.130203 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-1678b3a2-6ecc-4dce-a535-6e8837304678 tempest-ProjectMemberTests33-2105464604 None] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-5f57fed7-aa36-44c5-af90-863bd3d3af9d] added Jul 03 09:53:26.130203 np0000004400 cinder-backup[101319]: stderr=iscsiadm: Config file line 363 does not have value Jul 03 09:53:26.130203 np0000004400 cinder-backup[101319]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs' Jul 03 09:53:26.130203 np0000004400 cinder-backup[101319]: iscsiadm: Config file line 363 does not have value Jul 03 09:53:26.130203 np0000004400 cinder-backup[101319]: iscsiadm: Config file line 363 does not have value Jul 03 09:53:26.130203 np0000004400 cinder-backup[101319]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs' Jul 03 09:53:26.130203 np0000004400 cinder-backup[101319]: {{(pid=101319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 03 09:53:26.130513 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-1678b3a2-6ecc-4dce-a535-6e8837304678 tempest-ProjectMemberTests33-2105464604 None] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=101319) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}} Jul 03 09:53:26.131119 np0000004400 cinder-backup[101319]: DEBUG os_brick.utils [None req-1678b3a2-6ecc-4dce-a535-6e8837304678 tempest-ProjectMemberTests33-2105464604 None] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0204(s), this was the 1st time calling it. {{(pid=101319) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}} Jul 03 09:53:26.131366 np0000004400 cinder-backup[101319]: DEBUG os_brick.utils [None req-1678b3a2-6ecc-4dce-a535-6e8837304678 tempest-ProjectMemberTests33-2105464604 None] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=101319) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}} Jul 03 09:53:26.394073 np0000004400 sudo[154423]: pam_unix(sudo:session): session closed for user root Jul 03 09:53:26.395599 np0000004400 cinder-backup[101319]: DEBUG oslo_concurrency.processutils [None req-7a3f2202-7cda-4e09-9563-4547508d8589 tempest-VolumesBackupsTest-807180270 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chown 1002 /dev/sdg" returned: 0 in 0.301s {{(pid=101319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 09:53:26.403212 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-7a3f2202-7cda-4e09-9563-4547508d8589 tempest-VolumesBackupsTest-807180270 None] _create_container started, container: volumebackups,backup: 84105c14-606c-4395-a247-fddb67f6e548. {{(pid=101319) _create_container /opt/stack/cinder/cinder/backup/chunkeddriver.py:249}} Jul 03 09:53:26.549871 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.drivers.swift [None req-7a3f2202-7cda-4e09-9563-4547508d8589 tempest-VolumesBackupsTest-807180270 None] generate_object_name_prefix: volume_5a775425-df51-44ce-b820-7c6d483d6c42/20260703095326/az_nova_backup_84105c14-606c-4395-a247-fddb67f6e548 {{(pid=101319) _generate_object_name_prefix /opt/stack/cinder/cinder/backup/drivers/swift.py:452}} Jul 03 09:53:26.554465 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-7a3f2202-7cda-4e09-9563-4547508d8589 tempest-VolumesBackupsTest-807180270 None] starting backup of volume: 5a775425-df51-44ce-b820-7c6d483d6c42, volume size: 1073741824, object names prefix volume_5a775425-df51-44ce-b820-7c6d483d6c42/20260703095326/az_nova_backup_84105c14-606c-4395-a247-fddb67f6e548, availability zone: nova {{(pid=101319) _prepare_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:359}} Jul 03 09:53:26.732609 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-7a3f2202-7cda-4e09-9563-4547508d8589 tempest-VolumesBackupsTest-807180270 None] Backing up chunk of data from volume. {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 09:53:26.969283 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-7a3f2202-7cda-4e09-9563-4547508d8589 tempest-VolumesBackupsTest-807180270 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101319) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 09:53:26.969442 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-7a3f2202-7cda-4e09-9563-4547508d8589 tempest-VolumesBackupsTest-807180270 None] About to put_object {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 09:53:27.075961 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-7a3f2202-7cda-4e09-9563-4547508d8589 tempest-VolumesBackupsTest-807180270 None] backup MD5 for volume_5a775425-df51-44ce-b820-7c6d483d6c42/20260703095326/az_nova_backup_84105c14-606c-4395-a247-fddb67f6e548-00001: 25e317773f308e446cc84c503a6d1f85 {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 09:53:27.076119 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-7a3f2202-7cda-4e09-9563-4547508d8589 tempest-VolumesBackupsTest-807180270 None] Calling eventlet.sleep(0) {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 09:53:27.132101 np0000004400 cinder-backup[101319]: INFO os_brick.initiator.connectors.iscsi [None req-1678b3a2-6ecc-4dce-a535-6e8837304678 tempest-ProjectMemberTests33-2105464604 None] Trying to connect to iSCSI portal 192.168.40.100:3260 Jul 03 09:53:27.143962 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-1678b3a2-6ecc-4dce-a535-6e8837304678 tempest-ProjectMemberTests33-2105464604 None] iscsiadm (): stdout=# BEGIN RECORD 2.1.9 Jul 03 09:53:27.143962 np0000004400 cinder-backup[101319]: node.name = iqn.2023-03.storpool.com:os--volume-5f57fed7-aa36-44c5-af90-863bd3d3af9d Jul 03 09:53:27.143962 np0000004400 cinder-backup[101319]: node.tpgt = -1 Jul 03 09:53:27.143962 np0000004400 cinder-backup[101319]: node.startup = manual Jul 03 09:53:27.143962 np0000004400 cinder-backup[101319]: node.leading_login = No Jul 03 09:53:27.143962 np0000004400 cinder-backup[101319]: iface.iscsi_ifacename = default Jul 03 09:53:27.143962 np0000004400 cinder-backup[101319]: iface.net_ifacename = Jul 03 09:53:27.143962 np0000004400 cinder-backup[101319]: iface.ipaddress = Jul 03 09:53:27.143962 np0000004400 cinder-backup[101319]: iface.prefix_len = 0 Jul 03 09:53:27.143962 np0000004400 cinder-backup[101319]: iface.hwaddress = Jul 03 09:53:27.143962 np0000004400 cinder-backup[101319]: iface.transport_name = tcp Jul 03 09:53:27.143962 np0000004400 cinder-backup[101319]: iface.initiatorname = Jul 03 09:53:27.143962 np0000004400 cinder-backup[101319]: iface.state = Jul 03 09:53:27.143962 np0000004400 cinder-backup[101319]: iface.vlan_id = 0 Jul 03 09:53:27.143962 np0000004400 cinder-backup[101319]: iface.vlan_priority = 0 Jul 03 09:53:27.143962 np0000004400 cinder-backup[101319]: iface.vlan_state = Jul 03 09:53:27.143962 np0000004400 cinder-backup[101319]: iface.iface_num = 0 Jul 03 09:53:27.143962 np0000004400 cinder-backup[101319]: iface.mtu = 0 Jul 03 09:53:27.143962 np0000004400 cinder-backup[101319]: iface.port = 0 Jul 03 09:53:27.143962 np0000004400 cinder-backup[101319]: iface.bootproto = Jul 03 09:53:27.143962 np0000004400 cinder-backup[101319]: iface.subnet_mask = Jul 03 09:53:27.143962 np0000004400 cinder-backup[101319]: iface.gateway = Jul 03 09:53:27.143962 np0000004400 cinder-backup[101319]: iface.dhcp_alt_client_id_state = Jul 03 09:53:27.143962 np0000004400 cinder-backup[101319]: iface.dhcp_alt_client_id = Jul 03 09:53:27.143962 np0000004400 cinder-backup[101319]: iface.dhcp_dns = Jul 03 09:53:27.143962 np0000004400 cinder-backup[101319]: iface.dhcp_learn_iqn = Jul 03 09:53:27.143962 np0000004400 cinder-backup[101319]: iface.dhcp_req_vendor_id_state = Jul 03 09:53:27.143962 np0000004400 cinder-backup[101319]: iface.dhcp_vendor_id_state = Jul 03 09:53:27.143962 np0000004400 cinder-backup[101319]: iface.dhcp_vendor_id = Jul 03 09:53:27.143962 np0000004400 cinder-backup[101319]: iface.dhcp_slp_da = Jul 03 09:53:27.143962 np0000004400 cinder-backup[101319]: iface.fragmentation = Jul 03 09:53:27.143962 np0000004400 cinder-backup[101319]: iface.gratuitous_arp = Jul 03 09:53:27.143962 np0000004400 cinder-backup[101319]: iface.incoming_forwarding = Jul 03 09:53:27.143962 np0000004400 cinder-backup[101319]: iface.tos_state = Jul 03 09:53:27.143962 np0000004400 cinder-backup[101319]: iface.tos = 0 Jul 03 09:53:27.143962 np0000004400 cinder-backup[101319]: iface.ttl = 0 Jul 03 09:53:27.143962 np0000004400 cinder-backup[101319]: iface.delayed_ack = Jul 03 09:53:27.143962 np0000004400 cinder-backup[101319]: iface.tcp_nagle = Jul 03 09:53:27.143962 np0000004400 cinder-backup[101319]: iface.tcp_wsf_state = Jul 03 09:53:27.143962 np0000004400 cinder-backup[101319]: iface.tcp_wsf = 0 Jul 03 09:53:27.143962 np0000004400 cinder-backup[101319]: iface.tcp_timer_scale = 0 Jul 03 09:53:27.143962 np0000004400 cinder-backup[101319]: iface.tcp_timestamp = Jul 03 09:53:27.143962 np0000004400 cinder-backup[101319]: iface.redirect = Jul 03 09:53:27.143962 np0000004400 cinder-backup[101319]: iface.def_task_mgmt_timeout = 0 Jul 03 09:53:27.143962 np0000004400 cinder-backup[101319]: iface.header_digest = Jul 03 09:53:27.143962 np0000004400 cinder-backup[101319]: iface.data_digest = Jul 03 09:53:27.143962 np0000004400 cinder-backup[101319]: iface.immediate_data = Jul 03 09:53:27.143962 np0000004400 cinder-backup[101319]: iface.initial_r2t = Jul 03 09:53:27.143962 np0000004400 cinder-backup[101319]: iface.data_seq_inorder = Jul 03 09:53:27.143962 np0000004400 cinder-backup[101319]: iface.data_pdu_inorder = Jul 03 09:53:27.143962 np0000004400 cinder-backup[101319]: iface.erl = 0 Jul 03 09:53:27.143962 np0000004400 cinder-backup[101319]: iface.max_receive_data_len = 0 Jul 03 09:53:27.143962 np0000004400 cinder-backup[101319]: iface.first_burst_len = 0 Jul 03 09:53:27.143962 np0000004400 cinder-backup[101319]: iface.max_outstanding_r2t = 0 Jul 03 09:53:27.143962 np0000004400 cinder-backup[101319]: iface.max_burst_len = 0 Jul 03 09:53:27.143962 np0000004400 cinder-backup[101319]: iface.chap_auth = Jul 03 09:53:27.143962 np0000004400 cinder-backup[101319]: iface.bidi_chap = Jul 03 09:53:27.143962 np0000004400 cinder-backup[101319]: iface.strict_login_compliance = Jul 03 09:53:27.143962 np0000004400 cinder-backup[101319]: iface.discovery_auth = Jul 03 09:53:27.143962 np0000004400 cinder-backup[101319]: iface.discovery_logout = Jul 03 09:53:27.143962 np0000004400 cinder-backup[101319]: node.discovery_address = Jul 03 09:53:27.143962 np0000004400 cinder-backup[101319]: node.discovery_port = 0 Jul 03 09:53:27.143962 np0000004400 cinder-backup[101319]: node.discovery_type = fw Jul 03 09:53:27.143962 np0000004400 cinder-backup[101319]: node.session.initial_cmdsn = 0 Jul 03 09:53:27.143962 np0000004400 cinder-backup[101319]: node.session.initial_login_retry_max = 8 Jul 03 09:53:27.143962 np0000004400 cinder-backup[101319]: node.session.xmit_thread_priority = 0 Jul 03 09:53:27.143962 np0000004400 cinder-backup[101319]: node.session.cmds_max = 128 Jul 03 09:53:27.143962 np0000004400 cinder-backup[101319]: node.session.queue_depth = 32 Jul 03 09:53:27.143962 np0000004400 cinder-backup[101319]: node.session.nr_sessions = 1 Jul 03 09:53:27.143962 np0000004400 cinder-backup[101319]: node.session.auth.authmethod = None Jul 03 09:53:27.143962 np0000004400 cinder-backup[101319]: node.session.auth.username = Jul 03 09:53:27.143962 np0000004400 cinder-backup[101319]: node.session.auth.password = *** Jul 03 09:53:27.143962 np0000004400 cinder-backup[101319]: node.session.auth.username_in = Jul 03 09:53:27.143962 np0000004400 cinder-backup[101319]: node.session.auth.password_in = Jul 03 09:53:27.143962 np0000004400 cinder-backup[101319]: node.session.auth.chap_algs = SHA256 Jul 03 09:53:27.143962 np0000004400 cinder-backup[101319]: node.session.timeo.replacement_timeout = 120 Jul 03 09:53:27.143962 np0000004400 cinder-backup[101319]: node.session.err_timeo.abort_timeout = 15 Jul 03 09:53:27.143962 np0000004400 cinder-backup[101319]: node.session.err_timeo.lu_reset_timeout = 30 Jul 03 09:53:27.143962 np0000004400 cinder-backup[101319]: node.session.err_timeo.tgt_reset_timeout = 30 Jul 03 09:53:27.143962 np0000004400 cinder-backup[101319]: node.session.err_timeo.host_reset_timeout = 60 Jul 03 09:53:27.143962 np0000004400 cinder-backup[101319]: node.session.iscsi.FastAbort = Yes Jul 03 09:53:27.143962 np0000004400 cinder-backup[101319]: node.session.iscsi.InitialR2T = No Jul 03 09:53:27.143962 np0000004400 cinder-backup[101319]: node.session.iscsi.ImmediateData = Yes Jul 03 09:53:27.143962 np0000004400 cinder-backup[101319]: node.session.iscsi.FirstBurstLength = 262144 Jul 03 09:53:27.143962 np0000004400 cinder-backup[101319]: node.session.iscsi.MaxBurstLength = 16776192 Jul 03 09:53:27.143962 np0000004400 cinder-backup[101319]: node.session.iscsi.DefaultTime2Retain = 0 Jul 03 09:53:27.143962 np0000004400 cinder-backup[101319]: node.session.iscsi.DefaultTime2Wait = 2 Jul 03 09:53:27.143962 np0000004400 cinder-backup[101319]: node.session.iscsi.MaxConnections = 1 Jul 03 09:53:27.143962 np0000004400 cinder-backup[101319]: node.session.iscsi.MaxOutstandingR2T = 1 Jul 03 09:53:27.143962 np0000004400 cinder-backup[101319]: node.session.iscsi.ERL = 0 Jul 03 09:53:27.143962 np0000004400 cinder-backup[101319]: node.session.scan = auto Jul 03 09:53:27.143962 np0000004400 cinder-backup[101319]: node.session.reopen_max = 0 Jul 03 09:53:27.143962 np0000004400 cinder-backup[101319]: node.conn[0].address = 192.168.40.100 Jul 03 09:53:27.143962 np0000004400 cinder-backup[101319]: node.conn[0].port = 3260 Jul 03 09:53:27.143962 np0000004400 cinder-backup[101319]: node.conn[0].startup = manual Jul 03 09:53:27.143962 np0000004400 cinder-backup[101319]: node.conn[0].tcp.window_size = 524288 Jul 03 09:53:27.143962 np0000004400 cinder-backup[101319]: node.conn[0].tcp.type_of_service = 0 Jul 03 09:53:27.143962 np0000004400 cinder-backup[101319]: node.conn[0].timeo.logout_timeout = 15 Jul 03 09:53:27.143962 np0000004400 cinder-backup[101319]: node.conn[0].timeo.login_timeout = 15 Jul 03 09:53:27.143962 np0000004400 cinder-backup[101319]: node.conn[0].timeo.auth_timeout = 45 Jul 03 09:53:27.143962 np0000004400 cinder-backup[101319]: node.conn[0].timeo.noop_out_interval = 5 Jul 03 09:53:27.143962 np0000004400 cinder-backup[101319]: node.conn[0].timeo.noop_out_timeout = 5 Jul 03 09:53:27.143962 np0000004400 cinder-backup[101319]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0 Jul 03 09:53:27.143962 np0000004400 cinder-backup[101319]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144 Jul 03 09:53:27.143962 np0000004400 cinder-backup[101319]: node.conn[0].iscsi.HeaderDigest = None Jul 03 09:53:27.143962 np0000004400 cinder-backup[101319]: node.conn[0].iscsi.DataDigest = None Jul 03 09:53:27.143962 np0000004400 cinder-backup[101319]: node.conn[0].iscsi.IFMarker = No Jul 03 09:53:27.143962 np0000004400 cinder-backup[101319]: node.conn[0].iscsi.OFMarker = No Jul 03 09:53:27.143962 np0000004400 cinder-backup[101319]: # END RECORD Jul 03 09:53:27.143962 np0000004400 cinder-backup[101319]: stderr= {{(pid=101319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 03 09:53:27.155079 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-1678b3a2-6ecc-4dce-a535-6e8837304678 tempest-ProjectMemberTests33-2105464604 None] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=101319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 03 09:53:27.168504 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-1678b3a2-6ecc-4dce-a535-6e8837304678 tempest-ProjectMemberTests33-2105464604 None] iscsiadm ('-m', 'session'): stdout=tcp: [188] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-491c39b6-d2e0-4f67-9a64-590d50f06197 (non-flash) Jul 03 09:53:27.168504 np0000004400 cinder-backup[101319]: tcp: [189] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-491c39b6-d2e0-4f67-9a64-590d50f06197 (non-flash) Jul 03 09:53:27.168504 np0000004400 cinder-backup[101319]: tcp: [196] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-91385958-bc9a-4b5d-ac21-22d57700a0e4 (non-flash) Jul 03 09:53:27.168504 np0000004400 cinder-backup[101319]: tcp: [197] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-87fba7de-22c7-4769-ad28-2ca1aa2a1458 (non-flash) Jul 03 09:53:27.168504 np0000004400 cinder-backup[101319]: tcp: [198] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-87fba7de-22c7-4769-ad28-2ca1aa2a1458 (non-flash) Jul 03 09:53:27.168504 np0000004400 cinder-backup[101319]: tcp: [199] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5a775425-df51-44ce-b820-7c6d483d6c42 (non-flash) Jul 03 09:53:27.168504 np0000004400 cinder-backup[101319]: stderr= {{(pid=101319) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jul 03 09:53:27.168776 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-1678b3a2-6ecc-4dce-a535-6e8837304678 tempest-ProjectMemberTests33-2105464604 None] iscsi session list stdout=tcp: [188] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-491c39b6-d2e0-4f67-9a64-590d50f06197 (non-flash) Jul 03 09:53:27.168776 np0000004400 cinder-backup[101319]: tcp: [189] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-491c39b6-d2e0-4f67-9a64-590d50f06197 (non-flash) Jul 03 09:53:27.168776 np0000004400 cinder-backup[101319]: tcp: [196] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-91385958-bc9a-4b5d-ac21-22d57700a0e4 (non-flash) Jul 03 09:53:27.168776 np0000004400 cinder-backup[101319]: tcp: [197] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-87fba7de-22c7-4769-ad28-2ca1aa2a1458 (non-flash) Jul 03 09:53:27.168776 np0000004400 cinder-backup[101319]: tcp: [198] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-87fba7de-22c7-4769-ad28-2ca1aa2a1458 (non-flash) Jul 03 09:53:27.168776 np0000004400 cinder-backup[101319]: tcp: [199] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5a775425-df51-44ce-b820-7c6d483d6c42 (non-flash) Jul 03 09:53:27.168776 np0000004400 cinder-backup[101319]: stderr= {{(pid=101319) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jul 03 09:53:27.211524 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-1678b3a2-6ecc-4dce-a535-6e8837304678 tempest-ProjectMemberTests33-2105464604 None] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-5f57fed7-aa36-44c5-af90-863bd3d3af9d, portal: 192.168.40.100,3260] Jul 03 09:53:27.211524 np0000004400 cinder-backup[101319]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-5f57fed7-aa36-44c5-af90-863bd3d3af9d, portal: 192.168.40.100,3260] successful. Jul 03 09:53:27.211524 np0000004400 cinder-backup[101319]: stderr= {{(pid=101319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 03 09:53:27.223613 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-1678b3a2-6ecc-4dce-a535-6e8837304678 tempest-ProjectMemberTests33-2105464604 None] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=101319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 03 09:53:27.236374 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-1678b3a2-6ecc-4dce-a535-6e8837304678 tempest-ProjectMemberTests33-2105464604 None] iscsiadm ('-m', 'session'): stdout=tcp: [188] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-491c39b6-d2e0-4f67-9a64-590d50f06197 (non-flash) Jul 03 09:53:27.236374 np0000004400 cinder-backup[101319]: tcp: [189] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-491c39b6-d2e0-4f67-9a64-590d50f06197 (non-flash) Jul 03 09:53:27.236374 np0000004400 cinder-backup[101319]: tcp: [196] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-91385958-bc9a-4b5d-ac21-22d57700a0e4 (non-flash) Jul 03 09:53:27.236374 np0000004400 cinder-backup[101319]: tcp: [197] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-87fba7de-22c7-4769-ad28-2ca1aa2a1458 (non-flash) Jul 03 09:53:27.236374 np0000004400 cinder-backup[101319]: tcp: [198] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-87fba7de-22c7-4769-ad28-2ca1aa2a1458 (non-flash) Jul 03 09:53:27.236374 np0000004400 cinder-backup[101319]: tcp: [199] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5a775425-df51-44ce-b820-7c6d483d6c42 (non-flash) Jul 03 09:53:27.236374 np0000004400 cinder-backup[101319]: tcp: [200] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5f57fed7-aa36-44c5-af90-863bd3d3af9d (non-flash) Jul 03 09:53:27.236374 np0000004400 cinder-backup[101319]: stderr= {{(pid=101319) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jul 03 09:53:27.236642 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-1678b3a2-6ecc-4dce-a535-6e8837304678 tempest-ProjectMemberTests33-2105464604 None] iscsi session list stdout=tcp: [188] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-491c39b6-d2e0-4f67-9a64-590d50f06197 (non-flash) Jul 03 09:53:27.236642 np0000004400 cinder-backup[101319]: tcp: [189] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-491c39b6-d2e0-4f67-9a64-590d50f06197 (non-flash) Jul 03 09:53:27.236642 np0000004400 cinder-backup[101319]: tcp: [196] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-91385958-bc9a-4b5d-ac21-22d57700a0e4 (non-flash) Jul 03 09:53:27.236642 np0000004400 cinder-backup[101319]: tcp: [197] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-87fba7de-22c7-4769-ad28-2ca1aa2a1458 (non-flash) Jul 03 09:53:27.236642 np0000004400 cinder-backup[101319]: tcp: [198] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-87fba7de-22c7-4769-ad28-2ca1aa2a1458 (non-flash) Jul 03 09:53:27.236642 np0000004400 cinder-backup[101319]: tcp: [199] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5a775425-df51-44ce-b820-7c6d483d6c42 (non-flash) Jul 03 09:53:27.236642 np0000004400 cinder-backup[101319]: tcp: [200] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5f57fed7-aa36-44c5-af90-863bd3d3af9d (non-flash) Jul 03 09:53:27.236642 np0000004400 cinder-backup[101319]: stderr= {{(pid=101319) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jul 03 09:53:27.236886 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.base [None req-1678b3a2-6ecc-4dce-a535-6e8837304678 tempest-ProjectMemberTests33-2105464604 None] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-5f57fed7-aa36-44c5-af90-863bd3d3af9d" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.127s {{(pid=101319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jul 03 09:53:27.237039 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-1678b3a2-6ecc-4dce-a535-6e8837304678 tempest-ProjectMemberTests33-2105464604 None] Connected to 192.168.40.100:3260 {{(pid=101319) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}} Jul 03 09:53:27.238173 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.linuxscsi [None req-1678b3a2-6ecc-4dce-a535-6e8837304678 tempest-ProjectMemberTests33-2105464604 None] HCTL ('13', '-', '-', 0) found on session 200 with lun 0 {{(pid=101319) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}} Jul 03 09:53:27.238309 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.linuxscsi [None req-1678b3a2-6ecc-4dce-a535-6e8837304678 tempest-ProjectMemberTests33-2105464604 None] Scanning host 13 c: -, t: -, l: 0) {{(pid=101319) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}} Jul 03 09:53:27.250387 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.linuxscsi [None req-1678b3a2-6ecc-4dce-a535-6e8837304678 tempest-ProjectMemberTests33-2105464604 None] Searching for a device in session 200 and hctl ['13', '*', '*', 0] yield: sdh {{(pid=101319) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}} Jul 03 09:53:27.250387 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-1678b3a2-6ecc-4dce-a535-6e8837304678 tempest-ProjectMemberTests33-2105464604 None] Connected to sdh using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-5f57fed7-aa36-44c5-af90-863bd3d3af9d', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '5f57fed7-aa36-44c5-af90-863bd3d3af9d', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': False} {{(pid=101319) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}} Jul 03 09:53:27.270075 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-7a3f2202-7cda-4e09-9563-4547508d8589 tempest-VolumesBackupsTest-807180270 None] Backing up chunk of data from volume. {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 09:53:27.517380 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-7a3f2202-7cda-4e09-9563-4547508d8589 tempest-VolumesBackupsTest-807180270 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101319) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 09:53:27.517538 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-7a3f2202-7cda-4e09-9563-4547508d8589 tempest-VolumesBackupsTest-807180270 None] About to put_object {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 09:53:27.617512 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-7a3f2202-7cda-4e09-9563-4547508d8589 tempest-VolumesBackupsTest-807180270 None] backup MD5 for volume_5a775425-df51-44ce-b820-7c6d483d6c42/20260703095326/az_nova_backup_84105c14-606c-4395-a247-fddb67f6e548-00002: 25e317773f308e446cc84c503a6d1f85 {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 09:53:27.617512 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-7a3f2202-7cda-4e09-9563-4547508d8589 tempest-VolumesBackupsTest-807180270 None] Calling eventlet.sleep(0) {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 09:53:27.785729 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-7a3f2202-7cda-4e09-9563-4547508d8589 tempest-VolumesBackupsTest-807180270 None] Backing up chunk of data from volume. {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 09:53:28.025191 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-7a3f2202-7cda-4e09-9563-4547508d8589 tempest-VolumesBackupsTest-807180270 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101319) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 09:53:28.025341 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-7a3f2202-7cda-4e09-9563-4547508d8589 tempest-VolumesBackupsTest-807180270 None] About to put_object {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 09:53:28.121736 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-7a3f2202-7cda-4e09-9563-4547508d8589 tempest-VolumesBackupsTest-807180270 None] backup MD5 for volume_5a775425-df51-44ce-b820-7c6d483d6c42/20260703095326/az_nova_backup_84105c14-606c-4395-a247-fddb67f6e548-00003: 25e317773f308e446cc84c503a6d1f85 {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 09:53:28.121863 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-7a3f2202-7cda-4e09-9563-4547508d8589 tempest-VolumesBackupsTest-807180270 None] Calling eventlet.sleep(0) {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 09:53:28.253490 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.base [None req-1678b3a2-6ecc-4dce-a535-6e8837304678 tempest-ProjectMemberTests33-2105464604 None] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 2.154s {{(pid=101319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jul 03 09:53:28.253958 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-1678b3a2-6ecc-4dce-a535-6e8837304678 tempest-ProjectMemberTests33-2105464604 None] <== connect_volume: return (4604ms) {'type': 'block', 'scsi_wwn': '330000000b7bd94a0', 'path': '/dev/sdh'} {{(pid=101319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}} Jul 03 09:53:28.254174 np0000004400 cinder-backup[101319]: DEBUG oslo_concurrency.processutils [None req-1678b3a2-6ecc-4dce-a535-6e8837304678 tempest-ProjectMemberTests33-2105464604 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chown 1002 /dev/sdh {{(pid=101319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 09:53:28.263632 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.base [None req-904329c4-9ef6-4056-95e0-4524f15f09c7 tempest-ProjectReaderTests33-761902925 None] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 4.111s {{(pid=101319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jul 03 09:53:28.264482 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-904329c4-9ef6-4056-95e0-4524f15f09c7 tempest-ProjectReaderTests33-761902925 None] _get_connection_devices called with parameters: connection_properties={'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-91385958-bc9a-4b5d-ac21-22d57700a0e4', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '91385958-bc9a-4b5d-ac21-22d57700a0e4', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': False}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=101319) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:847}} Jul 03 09:53:28.276038 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-904329c4-9ef6-4056-95e0-4524f15f09c7 tempest-ProjectReaderTests33-761902925 None] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS: Jul 03 09:53:28.276038 np0000004400 cinder-backup[101319]: No targets found. Jul 03 09:53:28.276038 np0000004400 cinder-backup[101319]: iSNS: Jul 03 09:53:28.276038 np0000004400 cinder-backup[101319]: No targets found. Jul 03 09:53:28.276038 np0000004400 cinder-backup[101319]: STATIC: Jul 03 09:53:28.276038 np0000004400 cinder-backup[101319]: Target: iqn.2023-03.storpool.com:os--volume-87fba7de-22c7-4769-ad28-2ca1aa2a1458 Jul 03 09:53:28.276038 np0000004400 cinder-backup[101319]: Portal: 192.168.50.100:3260,-1 Jul 03 09:53:28.276038 np0000004400 cinder-backup[101319]: Iface Name: default Jul 03 09:53:28.276038 np0000004400 cinder-backup[101319]: Portal: 192.168.40.100:3260,-1 Jul 03 09:53:28.276038 np0000004400 cinder-backup[101319]: Iface Name: default Jul 03 09:53:28.276038 np0000004400 cinder-backup[101319]: Target: iqn.2023-03.storpool.com:os--volume-491c39b6-d2e0-4f67-9a64-590d50f06197 Jul 03 09:53:28.276038 np0000004400 cinder-backup[101319]: Portal: 192.168.50.100:3260,-1 Jul 03 09:53:28.276038 np0000004400 cinder-backup[101319]: Iface Name: default Jul 03 09:53:28.276038 np0000004400 cinder-backup[101319]: Portal: 192.168.40.100:3260,-1 Jul 03 09:53:28.276038 np0000004400 cinder-backup[101319]: Iface Name: default Jul 03 09:53:28.276038 np0000004400 cinder-backup[101319]: Target: iqn.2023-03.storpool.com:os--volume-5f57fed7-aa36-44c5-af90-863bd3d3af9d Jul 03 09:53:28.276038 np0000004400 cinder-backup[101319]: Portal: 192.168.40.100:3260,-1 Jul 03 09:53:28.276038 np0000004400 cinder-backup[101319]: Iface Name: default Jul 03 09:53:28.276038 np0000004400 cinder-backup[101319]: Target: iqn.2023-03.storpool.com:os--volume-5a775425-df51-44ce-b820-7c6d483d6c42 Jul 03 09:53:28.276038 np0000004400 cinder-backup[101319]: Portal: 192.168.40.100:3260,-1 Jul 03 09:53:28.276038 np0000004400 cinder-backup[101319]: Iface Name: default Jul 03 09:53:28.276038 np0000004400 cinder-backup[101319]: Target: iqn.2023-03.storpool.com:os--volume-91385958-bc9a-4b5d-ac21-22d57700a0e4 Jul 03 09:53:28.276038 np0000004400 cinder-backup[101319]: Portal: 192.168.40.100:3260,-1 Jul 03 09:53:28.276038 np0000004400 cinder-backup[101319]: Iface Name: default Jul 03 09:53:28.276038 np0000004400 cinder-backup[101319]: FIRMWARE: Jul 03 09:53:28.276038 np0000004400 cinder-backup[101319]: No targets found. Jul 03 09:53:28.276038 np0000004400 cinder-backup[101319]: stderr= {{(pid=101319) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jul 03 09:53:28.276947 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-904329c4-9ef6-4056-95e0-4524f15f09c7 tempest-ProjectReaderTests33-761902925 None] Regex to get portals from discoverydb: ^SENDTARGETS: Jul 03 09:53:28.276947 np0000004400 cinder-backup[101319]: .*?^DiscoveryAddress: 192.168.40.100,3260.*? Jul 03 09:53:28.276947 np0000004400 cinder-backup[101319]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=101319) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:390}} Jul 03 09:53:28.276947 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-904329c4-9ef6-4056-95e0-4524f15f09c7 tempest-ProjectReaderTests33-761902925 None] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-91385958-bc9a-4b5d-ac21-22d57700a0e4', 0)] {{(pid=101319) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:858}} Jul 03 09:53:28.278629 np0000004400 sudo[154484]: stack : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chown 1002 /dev/sdh Jul 03 09:53:28.279236 np0000004400 sudo[154484]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1002) Jul 03 09:53:28.300166 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-904329c4-9ef6-4056-95e0-4524f15f09c7 tempest-ProjectReaderTests33-761902925 None] iscsiadm ('-m', 'session'): stdout=tcp: [188] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-491c39b6-d2e0-4f67-9a64-590d50f06197 (non-flash) Jul 03 09:53:28.300166 np0000004400 cinder-backup[101319]: tcp: [189] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-491c39b6-d2e0-4f67-9a64-590d50f06197 (non-flash) Jul 03 09:53:28.300166 np0000004400 cinder-backup[101319]: tcp: [196] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-91385958-bc9a-4b5d-ac21-22d57700a0e4 (non-flash) Jul 03 09:53:28.300166 np0000004400 cinder-backup[101319]: tcp: [197] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-87fba7de-22c7-4769-ad28-2ca1aa2a1458 (non-flash) Jul 03 09:53:28.300166 np0000004400 cinder-backup[101319]: tcp: [198] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-87fba7de-22c7-4769-ad28-2ca1aa2a1458 (non-flash) Jul 03 09:53:28.300166 np0000004400 cinder-backup[101319]: tcp: [199] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5a775425-df51-44ce-b820-7c6d483d6c42 (non-flash) Jul 03 09:53:28.300166 np0000004400 cinder-backup[101319]: tcp: [200] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5f57fed7-aa36-44c5-af90-863bd3d3af9d (non-flash) Jul 03 09:53:28.300166 np0000004400 cinder-backup[101319]: stderr= {{(pid=101319) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jul 03 09:53:28.300424 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-904329c4-9ef6-4056-95e0-4524f15f09c7 tempest-ProjectReaderTests33-761902925 None] iscsi session list stdout=tcp: [188] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-491c39b6-d2e0-4f67-9a64-590d50f06197 (non-flash) Jul 03 09:53:28.300424 np0000004400 cinder-backup[101319]: tcp: [189] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-491c39b6-d2e0-4f67-9a64-590d50f06197 (non-flash) Jul 03 09:53:28.300424 np0000004400 cinder-backup[101319]: tcp: [196] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-91385958-bc9a-4b5d-ac21-22d57700a0e4 (non-flash) Jul 03 09:53:28.300424 np0000004400 cinder-backup[101319]: tcp: [197] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-87fba7de-22c7-4769-ad28-2ca1aa2a1458 (non-flash) Jul 03 09:53:28.300424 np0000004400 cinder-backup[101319]: tcp: [198] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-87fba7de-22c7-4769-ad28-2ca1aa2a1458 (non-flash) Jul 03 09:53:28.300424 np0000004400 cinder-backup[101319]: tcp: [199] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5a775425-df51-44ce-b820-7c6d483d6c42 (non-flash) Jul 03 09:53:28.300424 np0000004400 cinder-backup[101319]: tcp: [200] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5f57fed7-aa36-44c5-af90-863bd3d3af9d (non-flash) Jul 03 09:53:28.300424 np0000004400 cinder-backup[101319]: stderr= {{(pid=101319) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jul 03 09:53:28.300567 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-904329c4-9ef6-4056-95e0-4524f15f09c7 tempest-ProjectReaderTests33-761902925 None] Sessions list: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-491c39b6-d2e0-4f67-9a64-590d50f06197', '188'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-491c39b6-d2e0-4f67-9a64-590d50f06197', '189'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-91385958-bc9a-4b5d-ac21-22d57700a0e4', '196'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-87fba7de-22c7-4769-ad28-2ca1aa2a1458', '197'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-87fba7de-22c7-4769-ad28-2ca1aa2a1458', '198'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-5a775425-df51-44ce-b820-7c6d483d6c42', '199'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-5f57fed7-aa36-44c5-af90-863bd3d3af9d', '200')] {{(pid=101319) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:866}} Jul 03 09:53:28.300668 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-904329c4-9ef6-4056-95e0-4524f15f09c7 tempest-ProjectReaderTests33-761902925 None] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-91385958-bc9a-4b5d-ac21-22d57700a0e4, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-91385958-bc9a-4b5d-ac21-22d57700a0e4', '196')] {{(pid=101319) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}} Jul 03 09:53:28.301687 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-904329c4-9ef6-4056-95e0-4524f15f09c7 tempest-ProjectReaderTests33-761902925 None] Resulting device map defaultdict(. at 0x7e76e6da13a0>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-91385958-bc9a-4b5d-ac21-22d57700a0e4'): ({'sdf'}, set())}) {{(pid=101319) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:912}} Jul 03 09:53:28.301908 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.linuxscsi [None req-904329c4-9ef6-4056-95e0-4524f15f09c7 tempest-ProjectReaderTests33-761902925 None] Removing single pathed devices sdf {{(pid=101319) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}} Jul 03 09:53:28.306116 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-7a3f2202-7cda-4e09-9563-4547508d8589 tempest-VolumesBackupsTest-807180270 None] Backing up chunk of data from volume. {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 09:53:28.312276 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.linuxscsi [None req-904329c4-9ef6-4056-95e0-4524f15f09c7 tempest-ProjectReaderTests33-761902925 None] Flushing IO for device /dev/sdf {{(pid=101319) flush_device_io /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:461}} Jul 03 09:53:28.319463 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.linuxscsi [None req-904329c4-9ef6-4056-95e0-4524f15f09c7 tempest-ProjectReaderTests33-761902925 None] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=101319) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}} Jul 03 09:53:28.363816 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.linuxscsi [None req-904329c4-9ef6-4056-95e0-4524f15f09c7 tempest-ProjectReaderTests33-761902925 None] Checking to see if SCSI volumes sdf have been removed. {{(pid=101319) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}} Jul 03 09:53:28.364037 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.linuxscsi [None req-904329c4-9ef6-4056-95e0-4524f15f09c7 tempest-ProjectReaderTests33-761902925 None] SCSI volumes sdf have been removed. {{(pid=101319) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}} Jul 03 09:53:28.365237 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.linuxscsi [None req-904329c4-9ef6-4056-95e0-4524f15f09c7 tempest-ProjectReaderTests33-761902925 None] Checking to see if device paths {'sdf'} are still under multipathd monitoring {{(pid=101319) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}} Jul 03 09:53:28.375694 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.linuxscsi [None req-904329c4-9ef6-4056-95e0-4524f15f09c7 tempest-ProjectReaderTests33-761902925 None] Device paths {'sdf'} have been removed from multipathd monitoring. {{(pid=101319) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}} Jul 03 09:53:28.375963 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-904329c4-9ef6-4056-95e0-4524f15f09c7 tempest-ProjectReaderTests33-761902925 None] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-91385958-bc9a-4b5d-ac21-22d57700a0e4')] {{(pid=101319) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1225}} Jul 03 09:53:28.386266 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-904329c4-9ef6-4056-95e0-4524f15f09c7 tempest-ProjectReaderTests33-761902925 None] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=101319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 03 09:53:28.414795 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-904329c4-9ef6-4056-95e0-4524f15f09c7 tempest-ProjectReaderTests33-761902925 None] iscsiadm ('--logout',): stdout=Logging out of session [sid: 196, target: iqn.2023-03.storpool.com:os--volume-91385958-bc9a-4b5d-ac21-22d57700a0e4, portal: 192.168.40.100,3260] Jul 03 09:53:28.414795 np0000004400 cinder-backup[101319]: Logout of [sid: 196, target: iqn.2023-03.storpool.com:os--volume-91385958-bc9a-4b5d-ac21-22d57700a0e4, portal: 192.168.40.100,3260] successful. Jul 03 09:53:28.414795 np0000004400 cinder-backup[101319]: stderr= {{(pid=101319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 03 09:53:28.428969 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-904329c4-9ef6-4056-95e0-4524f15f09c7 tempest-ProjectReaderTests33-761902925 None] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=101319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 03 09:53:28.429235 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.base [None req-904329c4-9ef6-4056-95e0-4524f15f09c7 tempest-ProjectReaderTests33-761902925 None] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.167s {{(pid=101319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jul 03 09:53:28.429382 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-904329c4-9ef6-4056-95e0-4524f15f09c7 tempest-ProjectReaderTests33-761902925 None] <== disconnect_volume: return (4277ms) None {{(pid=101319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}} Jul 03 09:53:28.560173 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-7a3f2202-7cda-4e09-9563-4547508d8589 tempest-VolumesBackupsTest-807180270 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101319) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 09:53:28.560276 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-7a3f2202-7cda-4e09-9563-4547508d8589 tempest-VolumesBackupsTest-807180270 None] About to put_object {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 09:53:28.567590 np0000004400 sudo[154484]: pam_unix(sudo:session): session closed for user root Jul 03 09:53:28.569275 np0000004400 cinder-backup[101319]: DEBUG oslo_concurrency.processutils [None req-1678b3a2-6ecc-4dce-a535-6e8837304678 tempest-ProjectMemberTests33-2105464604 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chown 1002 /dev/sdh" returned: 0 in 0.315s {{(pid=101319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 09:53:28.576320 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-1678b3a2-6ecc-4dce-a535-6e8837304678 tempest-ProjectMemberTests33-2105464604 None] _create_container started, container: volumebackups,backup: 0871942a-e198-4230-a099-29a52a21849b. {{(pid=101319) _create_container /opt/stack/cinder/cinder/backup/chunkeddriver.py:249}} Jul 03 09:53:28.649979 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.drivers.swift [None req-1678b3a2-6ecc-4dce-a535-6e8837304678 tempest-ProjectMemberTests33-2105464604 None] generate_object_name_prefix: volume_5f57fed7-aa36-44c5-af90-863bd3d3af9d/20260703095328/az_nova_backup_0871942a-e198-4230-a099-29a52a21849b {{(pid=101319) _generate_object_name_prefix /opt/stack/cinder/cinder/backup/drivers/swift.py:452}} Jul 03 09:53:28.654385 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-1678b3a2-6ecc-4dce-a535-6e8837304678 tempest-ProjectMemberTests33-2105464604 None] starting backup of volume: 5f57fed7-aa36-44c5-af90-863bd3d3af9d, volume size: 1073741824, object names prefix volume_5f57fed7-aa36-44c5-af90-863bd3d3af9d/20260703095328/az_nova_backup_0871942a-e198-4230-a099-29a52a21849b, availability zone: nova {{(pid=101319) _prepare_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:359}} Jul 03 09:53:28.662879 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-7a3f2202-7cda-4e09-9563-4547508d8589 tempest-VolumesBackupsTest-807180270 None] backup MD5 for volume_5a775425-df51-44ce-b820-7c6d483d6c42/20260703095326/az_nova_backup_84105c14-606c-4395-a247-fddb67f6e548-00004: 25e317773f308e446cc84c503a6d1f85 {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 09:53:28.663238 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-7a3f2202-7cda-4e09-9563-4547508d8589 tempest-VolumesBackupsTest-807180270 None] Calling eventlet.sleep(0) {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 09:53:28.912369 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-1678b3a2-6ecc-4dce-a535-6e8837304678 tempest-ProjectMemberTests33-2105464604 None] Backing up chunk of data from volume. {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 09:53:28.919776 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-7a3f2202-7cda-4e09-9563-4547508d8589 tempest-VolumesBackupsTest-807180270 None] Backing up chunk of data from volume. {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 09:53:29.150929 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-1678b3a2-6ecc-4dce-a535-6e8837304678 tempest-ProjectMemberTests33-2105464604 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101319) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 09:53:29.151108 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-1678b3a2-6ecc-4dce-a535-6e8837304678 tempest-ProjectMemberTests33-2105464604 None] About to put_object {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 09:53:29.155206 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-7a3f2202-7cda-4e09-9563-4547508d8589 tempest-VolumesBackupsTest-807180270 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101319) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 09:53:29.155385 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-7a3f2202-7cda-4e09-9563-4547508d8589 tempest-VolumesBackupsTest-807180270 None] About to put_object {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 09:53:29.255677 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-1678b3a2-6ecc-4dce-a535-6e8837304678 tempest-ProjectMemberTests33-2105464604 None] backup MD5 for volume_5f57fed7-aa36-44c5-af90-863bd3d3af9d/20260703095328/az_nova_backup_0871942a-e198-4230-a099-29a52a21849b-00001: 25e317773f308e446cc84c503a6d1f85 {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 09:53:29.255944 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-1678b3a2-6ecc-4dce-a535-6e8837304678 tempest-ProjectMemberTests33-2105464604 None] Calling eventlet.sleep(0) {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 09:53:29.257020 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-7a3f2202-7cda-4e09-9563-4547508d8589 tempest-VolumesBackupsTest-807180270 None] backup MD5 for volume_5a775425-df51-44ce-b820-7c6d483d6c42/20260703095326/az_nova_backup_84105c14-606c-4395-a247-fddb67f6e548-00005: 25e317773f308e446cc84c503a6d1f85 {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 09:53:29.257145 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-7a3f2202-7cda-4e09-9563-4547508d8589 tempest-VolumesBackupsTest-807180270 None] Calling eventlet.sleep(0) {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 09:53:29.446885 np0000004400 cinder-backup[101319]: INFO cinder.backup.manager [None req-904329c4-9ef6-4056-95e0-4524f15f09c7 tempest-ProjectReaderTests33-761902925 None] Create backup finished. backup: 995de3de-d18a-4f2d-9b86-30dcb8a7d527. Jul 03 09:53:29.562930 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-7a3f2202-7cda-4e09-9563-4547508d8589 tempest-VolumesBackupsTest-807180270 None] Backing up chunk of data from volume. {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 09:53:29.564964 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-1678b3a2-6ecc-4dce-a535-6e8837304678 tempest-ProjectMemberTests33-2105464604 None] Backing up chunk of data from volume. {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 09:53:29.810428 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-1678b3a2-6ecc-4dce-a535-6e8837304678 tempest-ProjectMemberTests33-2105464604 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101319) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 09:53:29.810546 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-1678b3a2-6ecc-4dce-a535-6e8837304678 tempest-ProjectMemberTests33-2105464604 None] About to put_object {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 09:53:29.814983 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-7a3f2202-7cda-4e09-9563-4547508d8589 tempest-VolumesBackupsTest-807180270 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101319) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 09:53:29.815234 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-7a3f2202-7cda-4e09-9563-4547508d8589 tempest-VolumesBackupsTest-807180270 None] About to put_object {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 09:53:29.915332 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-7a3f2202-7cda-4e09-9563-4547508d8589 tempest-VolumesBackupsTest-807180270 None] backup MD5 for volume_5a775425-df51-44ce-b820-7c6d483d6c42/20260703095326/az_nova_backup_84105c14-606c-4395-a247-fddb67f6e548-00006: 25e317773f308e446cc84c503a6d1f85 {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 09:53:29.915582 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-7a3f2202-7cda-4e09-9563-4547508d8589 tempest-VolumesBackupsTest-807180270 None] Calling eventlet.sleep(0) {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 09:53:29.916758 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-1678b3a2-6ecc-4dce-a535-6e8837304678 tempest-ProjectMemberTests33-2105464604 None] backup MD5 for volume_5f57fed7-aa36-44c5-af90-863bd3d3af9d/20260703095328/az_nova_backup_0871942a-e198-4230-a099-29a52a21849b-00002: 25e317773f308e446cc84c503a6d1f85 {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 09:53:29.916884 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-1678b3a2-6ecc-4dce-a535-6e8837304678 tempest-ProjectMemberTests33-2105464604 None] Calling eventlet.sleep(0) {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 09:53:30.071080 np0000004400 cinder-backup[101319]: INFO cinder.backup.manager [None req-03859778-03a7-48b6-8fdb-770d85f193d7 tempest-ProjectReaderTests33-761902925 None] Export record started, backup: 995de3de-d18a-4f2d-9b86-30dcb8a7d527. Jul 03 09:53:30.078160 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.drivers.swift [None req-03859778-03a7-48b6-8fdb-770d85f193d7 tempest-ProjectReaderTests33-761902925 None] Using swift URL https://10.4.3.95:8080/v1/AUTH_e331bd155b824bbb8979e9aac5023870 {{(pid=101319) initialize /opt/stack/cinder/cinder/backup/drivers/swift.py:300}} Jul 03 09:53:30.078812 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.drivers.swift [None req-03859778-03a7-48b6-8fdb-770d85f193d7 tempest-ProjectReaderTests33-761902925 None] Connect to https://10.4.3.95:8080/v1/AUTH_ in "per_user" mode {{(pid=101319) initialize /opt/stack/cinder/cinder/backup/drivers/swift.py:301}} Jul 03 09:53:30.079250 np0000004400 cinder-backup[101319]: INFO cinder.backup.manager [None req-03859778-03a7-48b6-8fdb-770d85f193d7 tempest-ProjectReaderTests33-761902925 None] Export record finished, backup 995de3de-d18a-4f2d-9b86-30dcb8a7d527 exported. Jul 03 09:53:30.194557 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-7a3f2202-7cda-4e09-9563-4547508d8589 tempest-VolumesBackupsTest-807180270 None] Backing up chunk of data from volume. {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 09:53:30.194557 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-1678b3a2-6ecc-4dce-a535-6e8837304678 tempest-ProjectMemberTests33-2105464604 None] Backing up chunk of data from volume. {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 09:53:30.430061 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-1678b3a2-6ecc-4dce-a535-6e8837304678 tempest-ProjectMemberTests33-2105464604 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101319) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 09:53:30.430488 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-1678b3a2-6ecc-4dce-a535-6e8837304678 tempest-ProjectMemberTests33-2105464604 None] About to put_object {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 09:53:30.432568 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-7a3f2202-7cda-4e09-9563-4547508d8589 tempest-VolumesBackupsTest-807180270 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101319) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 09:53:30.432766 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-7a3f2202-7cda-4e09-9563-4547508d8589 tempest-VolumesBackupsTest-807180270 None] About to put_object {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 09:53:30.536466 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-1678b3a2-6ecc-4dce-a535-6e8837304678 tempest-ProjectMemberTests33-2105464604 None] backup MD5 for volume_5f57fed7-aa36-44c5-af90-863bd3d3af9d/20260703095328/az_nova_backup_0871942a-e198-4230-a099-29a52a21849b-00003: 25e317773f308e446cc84c503a6d1f85 {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 09:53:30.536594 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-1678b3a2-6ecc-4dce-a535-6e8837304678 tempest-ProjectMemberTests33-2105464604 None] Calling eventlet.sleep(0) {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 09:53:30.536760 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-7a3f2202-7cda-4e09-9563-4547508d8589 tempest-VolumesBackupsTest-807180270 None] backup MD5 for volume_5a775425-df51-44ce-b820-7c6d483d6c42/20260703095326/az_nova_backup_84105c14-606c-4395-a247-fddb67f6e548-00007: 25e317773f308e446cc84c503a6d1f85 {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 09:53:30.536909 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-7a3f2202-7cda-4e09-9563-4547508d8589 tempest-VolumesBackupsTest-807180270 None] Calling eventlet.sleep(0) {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 09:53:30.596454 np0000004400 cinder-backup[101319]: DEBUG oslo_db.sqlalchemy.engines [None req-1678b3a2-6ecc-4dce-a535-6e8837304678 tempest-ProjectMemberTests33-2105464604 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=101319) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 03 09:53:30.900518 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-1678b3a2-6ecc-4dce-a535-6e8837304678 tempest-ProjectMemberTests33-2105464604 None] Backing up chunk of data from volume. {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 09:53:30.901434 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-7a3f2202-7cda-4e09-9563-4547508d8589 tempest-VolumesBackupsTest-807180270 None] Backing up chunk of data from volume. {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 09:53:31.140938 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-1678b3a2-6ecc-4dce-a535-6e8837304678 tempest-ProjectMemberTests33-2105464604 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101319) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 09:53:31.141126 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-1678b3a2-6ecc-4dce-a535-6e8837304678 tempest-ProjectMemberTests33-2105464604 None] About to put_object {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 09:53:31.143476 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-7a3f2202-7cda-4e09-9563-4547508d8589 tempest-VolumesBackupsTest-807180270 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101319) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 09:53:31.143686 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-7a3f2202-7cda-4e09-9563-4547508d8589 tempest-VolumesBackupsTest-807180270 None] About to put_object {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 09:53:31.246835 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-1678b3a2-6ecc-4dce-a535-6e8837304678 tempest-ProjectMemberTests33-2105464604 None] backup MD5 for volume_5f57fed7-aa36-44c5-af90-863bd3d3af9d/20260703095328/az_nova_backup_0871942a-e198-4230-a099-29a52a21849b-00004: 25e317773f308e446cc84c503a6d1f85 {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 09:53:31.246977 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-1678b3a2-6ecc-4dce-a535-6e8837304678 tempest-ProjectMemberTests33-2105464604 None] Calling eventlet.sleep(0) {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 09:53:31.248875 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-7a3f2202-7cda-4e09-9563-4547508d8589 tempest-VolumesBackupsTest-807180270 None] backup MD5 for volume_5a775425-df51-44ce-b820-7c6d483d6c42/20260703095326/az_nova_backup_84105c14-606c-4395-a247-fddb67f6e548-00008: 25e317773f308e446cc84c503a6d1f85 {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 09:53:31.248875 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-7a3f2202-7cda-4e09-9563-4547508d8589 tempest-VolumesBackupsTest-807180270 None] Calling eventlet.sleep(0) {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 09:53:31.544500 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-1678b3a2-6ecc-4dce-a535-6e8837304678 tempest-ProjectMemberTests33-2105464604 None] Backing up chunk of data from volume. {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 09:53:31.545197 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-7a3f2202-7cda-4e09-9563-4547508d8589 tempest-VolumesBackupsTest-807180270 None] Backing up chunk of data from volume. {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 09:53:31.783960 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-7a3f2202-7cda-4e09-9563-4547508d8589 tempest-VolumesBackupsTest-807180270 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101319) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 09:53:31.784116 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-7a3f2202-7cda-4e09-9563-4547508d8589 tempest-VolumesBackupsTest-807180270 None] About to put_object {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 09:53:31.792473 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-1678b3a2-6ecc-4dce-a535-6e8837304678 tempest-ProjectMemberTests33-2105464604 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101319) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 09:53:31.792668 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-1678b3a2-6ecc-4dce-a535-6e8837304678 tempest-ProjectMemberTests33-2105464604 None] About to put_object {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 09:53:31.885155 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-7a3f2202-7cda-4e09-9563-4547508d8589 tempest-VolumesBackupsTest-807180270 None] backup MD5 for volume_5a775425-df51-44ce-b820-7c6d483d6c42/20260703095326/az_nova_backup_84105c14-606c-4395-a247-fddb67f6e548-00009: 25e317773f308e446cc84c503a6d1f85 {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 09:53:31.885335 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-7a3f2202-7cda-4e09-9563-4547508d8589 tempest-VolumesBackupsTest-807180270 None] Calling eventlet.sleep(0) {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 09:53:31.896695 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-1678b3a2-6ecc-4dce-a535-6e8837304678 tempest-ProjectMemberTests33-2105464604 None] backup MD5 for volume_5f57fed7-aa36-44c5-af90-863bd3d3af9d/20260703095328/az_nova_backup_0871942a-e198-4230-a099-29a52a21849b-00005: 25e317773f308e446cc84c503a6d1f85 {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 09:53:31.896876 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-1678b3a2-6ecc-4dce-a535-6e8837304678 tempest-ProjectMemberTests33-2105464604 None] Calling eventlet.sleep(0) {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 09:53:32.181538 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-7a3f2202-7cda-4e09-9563-4547508d8589 tempest-VolumesBackupsTest-807180270 None] Backing up chunk of data from volume. {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 09:53:32.192501 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-1678b3a2-6ecc-4dce-a535-6e8837304678 tempest-ProjectMemberTests33-2105464604 None] Backing up chunk of data from volume. {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 09:53:32.426493 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-7a3f2202-7cda-4e09-9563-4547508d8589 tempest-VolumesBackupsTest-807180270 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101319) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 09:53:32.426668 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-7a3f2202-7cda-4e09-9563-4547508d8589 tempest-VolumesBackupsTest-807180270 None] About to put_object {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 09:53:32.437055 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-1678b3a2-6ecc-4dce-a535-6e8837304678 tempest-ProjectMemberTests33-2105464604 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101319) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 09:53:32.437181 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-1678b3a2-6ecc-4dce-a535-6e8837304678 tempest-ProjectMemberTests33-2105464604 None] About to put_object {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 09:53:32.529187 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-7a3f2202-7cda-4e09-9563-4547508d8589 tempest-VolumesBackupsTest-807180270 None] backup MD5 for volume_5a775425-df51-44ce-b820-7c6d483d6c42/20260703095326/az_nova_backup_84105c14-606c-4395-a247-fddb67f6e548-00010: 25e317773f308e446cc84c503a6d1f85 {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 09:53:32.529343 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-7a3f2202-7cda-4e09-9563-4547508d8589 tempest-VolumesBackupsTest-807180270 None] Calling eventlet.sleep(0) {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 09:53:32.536037 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-1678b3a2-6ecc-4dce-a535-6e8837304678 tempest-ProjectMemberTests33-2105464604 None] backup MD5 for volume_5f57fed7-aa36-44c5-af90-863bd3d3af9d/20260703095328/az_nova_backup_0871942a-e198-4230-a099-29a52a21849b-00006: 25e317773f308e446cc84c503a6d1f85 {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 09:53:32.536211 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-1678b3a2-6ecc-4dce-a535-6e8837304678 tempest-ProjectMemberTests33-2105464604 None] Calling eventlet.sleep(0) {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 09:53:32.814588 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-7a3f2202-7cda-4e09-9563-4547508d8589 tempest-VolumesBackupsTest-807180270 None] Backing up chunk of data from volume. {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 09:53:32.815794 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-1678b3a2-6ecc-4dce-a535-6e8837304678 tempest-ProjectMemberTests33-2105464604 None] Backing up chunk of data from volume. {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 09:53:33.027836 np0000004400 cinder-backup[101319]: INFO cinder.backup.manager [None req-0348256d-c334-445a-abfb-8501d08ca9f1 tempest-ProjectReaderTests33-761902925 None] Create backup started, backup: 3905268c-9301-4198-bac6-c3c450e69ce2 volume: 61c7989b-d6b3-4a39-80a6-9fc519424447. Jul 03 09:53:33.032992 np0000004400 cinder-backup[101319]: INFO cinder.backup.manager [None req-0348256d-c334-445a-abfb-8501d08ca9f1 tempest-ProjectReaderTests33-761902925 None] Call Volume Manager to get_backup_device for Backup(availability_zone='nova',container=None,created_at=2026-07-03T09:53:32Z,data_timestamp=2026-07-03T09:53:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-type-Backup-1749993939',encryption_key_id=None,fail_reason=None,host='np0000004400',id=3905268c-9301-4198-bac6-c3c450e69ce2,metadata={},num_dependent_backups=0,object_count=0,parent=None,parent_id=None,project_id='e331bd155b824bbb8979e9aac5023870',restore_volume_id=None,service='cinder.backup.drivers.swift.SwiftBackupDriver',service_metadata=None,size=1,snapshot_id=None,status='creating',temp_snapshot_id=None,temp_volume_id=None,updated_at=None,user_id='45a99ff133014c9a8bfd931707d31606',volume_id=61c7989b-d6b3-4a39-80a6-9fc519424447) Jul 03 09:53:33.054968 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.drivers.swift [None req-0348256d-c334-445a-abfb-8501d08ca9f1 tempest-ProjectReaderTests33-761902925 None] Using swift URL https://10.4.3.95:8080/v1/AUTH_e331bd155b824bbb8979e9aac5023870 {{(pid=101319) initialize /opt/stack/cinder/cinder/backup/drivers/swift.py:300}} Jul 03 09:53:33.055240 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.drivers.swift [None req-0348256d-c334-445a-abfb-8501d08ca9f1 tempest-ProjectReaderTests33-761902925 None] Connect to https://10.4.3.95:8080/v1/AUTH_ in "per_user" mode {{(pid=101319) initialize /opt/stack/cinder/cinder/backup/drivers/swift.py:301}} Jul 03 09:53:33.055557 np0000004400 cinder-backup[101319]: DEBUG os_brick.utils [None req-0348256d-c334-445a-abfb-8501d08ca9f1 tempest-ProjectReaderTests33-761902925 None] ==> get_connector_properties: call "{'root_helper': 'sudo cinder-rootwrap /etc/cinder/rootwrap.conf', 'my_ip': '10.4.3.95', 'multipath': False, 'enforce_multipath': False, 'host': None, 'execute': None}" {{(pid=101319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}} Jul 03 09:53:33.065274 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-7a3f2202-7cda-4e09-9563-4547508d8589 tempest-VolumesBackupsTest-807180270 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101319) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 09:53:33.065418 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-7a3f2202-7cda-4e09-9563-4547508d8589 tempest-VolumesBackupsTest-807180270 None] About to put_object {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 09:53:33.068420 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.scaleio [None req-0348256d-c334-445a-abfb-8501d08ca9f1 tempest-ProjectReaderTests33-761902925 None] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=101319) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}} Jul 03 09:53:33.074860 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-1678b3a2-6ecc-4dce-a535-6e8837304678 tempest-ProjectMemberTests33-2105464604 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101319) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 09:53:33.074991 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-1678b3a2-6ecc-4dce-a535-6e8837304678 tempest-ProjectMemberTests33-2105464604 None] About to put_object {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 09:53:33.089738 np0000004400 cinder-backup[101319]: DEBUG oslo_concurrency.processutils [None req-0348256d-c334-445a-abfb-8501d08ca9f1 tempest-ProjectReaderTests33-761902925 None] Running cmd (subprocess): nvme version {{(pid=101319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 09:53:33.108589 np0000004400 cinder-backup[101319]: DEBUG oslo_concurrency.processutils [None req-0348256d-c334-445a-abfb-8501d08ca9f1 tempest-ProjectReaderTests33-761902925 None] 'nvme version' failed. Not Retrying. {{(pid=101319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 03 09:53:33.111414 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.nvmeof [None req-0348256d-c334-445a-abfb-8501d08ca9f1 tempest-ProjectReaderTests33-761902925 None] nvme not present on system {{(pid=101319) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}} Jul 03 09:53:33.116834 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.lightos [None req-0348256d-c334-445a-abfb-8501d08ca9f1 tempest-ProjectReaderTests33-761902925 None] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=101319) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}} Jul 03 09:53:33.117656 np0000004400 cinder-backup[101319]: INFO os_brick.initiator.connectors.lightos [None req-0348256d-c334-445a-abfb-8501d08ca9f1 tempest-ProjectReaderTests33-761902925 None] Current host hostNQN and IP(s) are ['10.4.3.95', 'fe80::f816:3eff:fe47:268c', '192.168.40.6', 'fe80::f816:3eff:febf:7be2', '192.168.50.6', 'fe80::f816:3eff:fe99:8914', '192.168.10.6', 'fe80::f816:3eff:fe2f:e696', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::bc9d:84ff:fec2:6b49', 'fe80::fc16:3eff:feaa:206b', 'fe80::74a1:e1ff:fe2f:1924'] Jul 03 09:53:33.117801 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.lightos [None req-0348256d-c334-445a-abfb-8501d08ca9f1 tempest-ProjectReaderTests33-761902925 None] LIGHTOS: did not find dsc, continuing anyway. {{(pid=101319) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}} Jul 03 09:53:33.117914 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.lightos [None req-0348256d-c334-445a-abfb-8501d08ca9f1 tempest-ProjectReaderTests33-761902925 None] LIGHTOS: no hostnqn found. {{(pid=101319) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}} Jul 03 09:53:33.118144 np0000004400 cinder-backup[101319]: DEBUG os_brick.utils [None req-0348256d-c334-445a-abfb-8501d08ca9f1 tempest-ProjectReaderTests33-761902925 None] <== get_connector_properties: return (62ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.95', 'host': 'np0000004400', 'multipath': False, 'enforce_multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:ae7e5bb0ebe6', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': '6b284368-d0ba-4d18-af6f-4998d3955c52', 'nvme_native_multipath': False} {{(pid=101319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}} Jul 03 09:53:33.183852 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-1678b3a2-6ecc-4dce-a535-6e8837304678 tempest-ProjectMemberTests33-2105464604 None] backup MD5 for volume_5f57fed7-aa36-44c5-af90-863bd3d3af9d/20260703095328/az_nova_backup_0871942a-e198-4230-a099-29a52a21849b-00007: 25e317773f308e446cc84c503a6d1f85 {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 09:53:33.183988 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-1678b3a2-6ecc-4dce-a535-6e8837304678 tempest-ProjectMemberTests33-2105464604 None] Calling eventlet.sleep(0) {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 09:53:33.215246 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-7a3f2202-7cda-4e09-9563-4547508d8589 tempest-VolumesBackupsTest-807180270 None] backup MD5 for volume_5a775425-df51-44ce-b820-7c6d483d6c42/20260703095326/az_nova_backup_84105c14-606c-4395-a247-fddb67f6e548-00011: 25e317773f308e446cc84c503a6d1f85 {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 09:53:33.215396 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-7a3f2202-7cda-4e09-9563-4547508d8589 tempest-VolumesBackupsTest-807180270 None] Calling eventlet.sleep(0) {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 09:53:33.248115 np0000004400 cinder-backup[101319]: DEBUG oslo_db.sqlalchemy.engines [None req-1678b3a2-6ecc-4dce-a535-6e8837304678 tempest-ProjectMemberTests33-2105464604 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=101319) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 03 09:53:33.541524 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-7a3f2202-7cda-4e09-9563-4547508d8589 tempest-VolumesBackupsTest-807180270 None] Backing up chunk of data from volume. {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 09:53:33.544024 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-1678b3a2-6ecc-4dce-a535-6e8837304678 tempest-ProjectMemberTests33-2105464604 None] Backing up chunk of data from volume. {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 09:53:33.623979 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connector [None req-0348256d-c334-445a-abfb-8501d08ca9f1 tempest-ProjectReaderTests33-761902925 None] Factory for iscsi on None {{(pid=101319) factory /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connector.py:243}} Jul 03 09:53:33.624679 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-0348256d-c334-445a-abfb-8501d08ca9f1 tempest-ProjectReaderTests33-761902925 None] ==> connect_volume: call "{'self': , 'connection_properties': {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-61c7989b-d6b3-4a39-80a6-9fc519424447', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '61c7989b-d6b3-4a39-80a6-9fc519424447', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': False}}" {{(pid=101319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}} Jul 03 09:53:33.625075 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.base [None req-0348256d-c334-445a-abfb-8501d08ca9f1 tempest-ProjectReaderTests33-761902925 None] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=101319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jul 03 09:53:33.780359 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-1678b3a2-6ecc-4dce-a535-6e8837304678 tempest-ProjectMemberTests33-2105464604 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101319) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 09:53:33.780526 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-1678b3a2-6ecc-4dce-a535-6e8837304678 tempest-ProjectMemberTests33-2105464604 None] About to put_object {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 09:53:33.783031 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-7a3f2202-7cda-4e09-9563-4547508d8589 tempest-VolumesBackupsTest-807180270 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101319) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 09:53:33.783148 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-7a3f2202-7cda-4e09-9563-4547508d8589 tempest-VolumesBackupsTest-807180270 None] About to put_object {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 09:53:33.883959 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-7a3f2202-7cda-4e09-9563-4547508d8589 tempest-VolumesBackupsTest-807180270 None] backup MD5 for volume_5a775425-df51-44ce-b820-7c6d483d6c42/20260703095326/az_nova_backup_84105c14-606c-4395-a247-fddb67f6e548-00012: 25e317773f308e446cc84c503a6d1f85 {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 09:53:33.884323 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-7a3f2202-7cda-4e09-9563-4547508d8589 tempest-VolumesBackupsTest-807180270 None] Calling eventlet.sleep(0) {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 09:53:33.885354 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-1678b3a2-6ecc-4dce-a535-6e8837304678 tempest-ProjectMemberTests33-2105464604 None] backup MD5 for volume_5f57fed7-aa36-44c5-af90-863bd3d3af9d/20260703095328/az_nova_backup_0871942a-e198-4230-a099-29a52a21849b-00008: 25e317773f308e446cc84c503a6d1f85 {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 09:53:33.885505 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-1678b3a2-6ecc-4dce-a535-6e8837304678 tempest-ProjectMemberTests33-2105464604 None] Calling eventlet.sleep(0) {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 09:53:34.219472 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-1678b3a2-6ecc-4dce-a535-6e8837304678 tempest-ProjectMemberTests33-2105464604 None] Backing up chunk of data from volume. {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 09:53:34.219996 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-7a3f2202-7cda-4e09-9563-4547508d8589 tempest-VolumesBackupsTest-807180270 None] Backing up chunk of data from volume. {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 09:53:34.457116 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-7a3f2202-7cda-4e09-9563-4547508d8589 tempest-VolumesBackupsTest-807180270 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101319) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 09:53:34.457294 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-7a3f2202-7cda-4e09-9563-4547508d8589 tempest-VolumesBackupsTest-807180270 None] About to put_object {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 09:53:34.460486 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-1678b3a2-6ecc-4dce-a535-6e8837304678 tempest-ProjectMemberTests33-2105464604 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101319) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 09:53:34.460616 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-1678b3a2-6ecc-4dce-a535-6e8837304678 tempest-ProjectMemberTests33-2105464604 None] About to put_object {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 09:53:34.560908 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-7a3f2202-7cda-4e09-9563-4547508d8589 tempest-VolumesBackupsTest-807180270 None] backup MD5 for volume_5a775425-df51-44ce-b820-7c6d483d6c42/20260703095326/az_nova_backup_84105c14-606c-4395-a247-fddb67f6e548-00013: 25e317773f308e446cc84c503a6d1f85 {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 09:53:34.561080 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-7a3f2202-7cda-4e09-9563-4547508d8589 tempest-VolumesBackupsTest-807180270 None] Calling eventlet.sleep(0) {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 09:53:34.565621 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-1678b3a2-6ecc-4dce-a535-6e8837304678 tempest-ProjectMemberTests33-2105464604 None] backup MD5 for volume_5f57fed7-aa36-44c5-af90-863bd3d3af9d/20260703095328/az_nova_backup_0871942a-e198-4230-a099-29a52a21849b-00009: 25e317773f308e446cc84c503a6d1f85 {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 09:53:34.565829 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-1678b3a2-6ecc-4dce-a535-6e8837304678 tempest-ProjectMemberTests33-2105464604 None] Calling eventlet.sleep(0) {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 09:53:34.683647 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.base [None req-0348256d-c334-445a-abfb-8501d08ca9f1 tempest-ProjectReaderTests33-761902925 None] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 1.058s {{(pid=101319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jul 03 09:53:34.683784 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.base [None req-0348256d-c334-445a-abfb-8501d08ca9f1 tempest-ProjectReaderTests33-761902925 None] Connection properties {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-61c7989b-d6b3-4a39-80a6-9fc519424447', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '61c7989b-d6b3-4a39-80a6-9fc519424447', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': False} {{(pid=101319) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}} Jul 03 09:53:34.694199 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.base [None req-0348256d-c334-445a-abfb-8501d08ca9f1 tempest-ProjectReaderTests33-761902925 None] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-61c7989b-d6b3-4a39-80a6-9fc519424447" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=101319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jul 03 09:53:34.694595 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.base [None req-0348256d-c334-445a-abfb-8501d08ca9f1 tempest-ProjectReaderTests33-761902925 None] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-61c7989b-d6b3-4a39-80a6-9fc519424447" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.000s {{(pid=101319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jul 03 09:53:34.694797 np0000004400 cinder-backup[101319]: INFO os_brick.initiator.connectors.iscsi [None req-0348256d-c334-445a-abfb-8501d08ca9f1 tempest-ProjectReaderTests33-761902925 None] Trying to connect to iSCSI portal 192.168.40.100:3260 Jul 03 09:53:34.707631 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-0348256d-c334-445a-abfb-8501d08ca9f1 tempest-ProjectReaderTests33-761902925 None] iscsiadm (): stdout= stderr=iscsiadm: No records found Jul 03 09:53:34.707631 np0000004400 cinder-backup[101319]: {{(pid=101319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 03 09:53:34.720357 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-0348256d-c334-445a-abfb-8501d08ca9f1 tempest-ProjectReaderTests33-761902925 None] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-61c7989b-d6b3-4a39-80a6-9fc519424447] added Jul 03 09:53:34.720357 np0000004400 cinder-backup[101319]: stderr=iscsiadm: Config file line 363 does not have value Jul 03 09:53:34.720357 np0000004400 cinder-backup[101319]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs' Jul 03 09:53:34.720357 np0000004400 cinder-backup[101319]: iscsiadm: Config file line 363 does not have value Jul 03 09:53:34.720357 np0000004400 cinder-backup[101319]: iscsiadm: Config file line 363 does not have value Jul 03 09:53:34.720357 np0000004400 cinder-backup[101319]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs' Jul 03 09:53:34.720357 np0000004400 cinder-backup[101319]: {{(pid=101319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 03 09:53:34.720666 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-0348256d-c334-445a-abfb-8501d08ca9f1 tempest-ProjectReaderTests33-761902925 None] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=101319) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}} Jul 03 09:53:34.720986 np0000004400 cinder-backup[101319]: DEBUG os_brick.utils [None req-0348256d-c334-445a-abfb-8501d08ca9f1 tempest-ProjectReaderTests33-761902925 None] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0261(s), this was the 1st time calling it. {{(pid=101319) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}} Jul 03 09:53:34.721179 np0000004400 cinder-backup[101319]: DEBUG os_brick.utils [None req-0348256d-c334-445a-abfb-8501d08ca9f1 tempest-ProjectReaderTests33-761902925 None] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=101319) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}} Jul 03 09:53:34.845385 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-7a3f2202-7cda-4e09-9563-4547508d8589 tempest-VolumesBackupsTest-807180270 None] Backing up chunk of data from volume. {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 09:53:34.848766 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-1678b3a2-6ecc-4dce-a535-6e8837304678 tempest-ProjectMemberTests33-2105464604 None] Backing up chunk of data from volume. {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 09:53:35.084423 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-7a3f2202-7cda-4e09-9563-4547508d8589 tempest-VolumesBackupsTest-807180270 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101319) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 09:53:35.084949 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-7a3f2202-7cda-4e09-9563-4547508d8589 tempest-VolumesBackupsTest-807180270 None] About to put_object {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 09:53:35.096319 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-1678b3a2-6ecc-4dce-a535-6e8837304678 tempest-ProjectMemberTests33-2105464604 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101319) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 09:53:35.096486 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-1678b3a2-6ecc-4dce-a535-6e8837304678 tempest-ProjectMemberTests33-2105464604 None] About to put_object {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 09:53:35.189185 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-7a3f2202-7cda-4e09-9563-4547508d8589 tempest-VolumesBackupsTest-807180270 None] backup MD5 for volume_5a775425-df51-44ce-b820-7c6d483d6c42/20260703095326/az_nova_backup_84105c14-606c-4395-a247-fddb67f6e548-00014: 25e317773f308e446cc84c503a6d1f85 {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 09:53:35.189363 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-7a3f2202-7cda-4e09-9563-4547508d8589 tempest-VolumesBackupsTest-807180270 None] Calling eventlet.sleep(0) {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 09:53:35.198060 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-1678b3a2-6ecc-4dce-a535-6e8837304678 tempest-ProjectMemberTests33-2105464604 None] backup MD5 for volume_5f57fed7-aa36-44c5-af90-863bd3d3af9d/20260703095328/az_nova_backup_0871942a-e198-4230-a099-29a52a21849b-00010: 25e317773f308e446cc84c503a6d1f85 {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 09:53:35.198210 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-1678b3a2-6ecc-4dce-a535-6e8837304678 tempest-ProjectMemberTests33-2105464604 None] Calling eventlet.sleep(0) {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 09:53:35.462128 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-7a3f2202-7cda-4e09-9563-4547508d8589 tempest-VolumesBackupsTest-807180270 None] Backing up chunk of data from volume. {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 09:53:35.469194 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-1678b3a2-6ecc-4dce-a535-6e8837304678 tempest-ProjectMemberTests33-2105464604 None] Backing up chunk of data from volume. {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 09:53:35.712360 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-1678b3a2-6ecc-4dce-a535-6e8837304678 tempest-ProjectMemberTests33-2105464604 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101319) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 09:53:35.712609 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-1678b3a2-6ecc-4dce-a535-6e8837304678 tempest-ProjectMemberTests33-2105464604 None] About to put_object {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 09:53:35.712833 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-7a3f2202-7cda-4e09-9563-4547508d8589 tempest-VolumesBackupsTest-807180270 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101319) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 09:53:35.713055 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-7a3f2202-7cda-4e09-9563-4547508d8589 tempest-VolumesBackupsTest-807180270 None] About to put_object {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 09:53:35.721774 np0000004400 cinder-backup[101319]: INFO os_brick.initiator.connectors.iscsi [None req-0348256d-c334-445a-abfb-8501d08ca9f1 tempest-ProjectReaderTests33-761902925 None] Trying to connect to iSCSI portal 192.168.40.100:3260 Jul 03 09:53:35.735545 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-0348256d-c334-445a-abfb-8501d08ca9f1 tempest-ProjectReaderTests33-761902925 None] iscsiadm (): stdout=# BEGIN RECORD 2.1.9 Jul 03 09:53:35.735545 np0000004400 cinder-backup[101319]: node.name = iqn.2023-03.storpool.com:os--volume-61c7989b-d6b3-4a39-80a6-9fc519424447 Jul 03 09:53:35.735545 np0000004400 cinder-backup[101319]: node.tpgt = -1 Jul 03 09:53:35.735545 np0000004400 cinder-backup[101319]: node.startup = manual Jul 03 09:53:35.735545 np0000004400 cinder-backup[101319]: node.leading_login = No Jul 03 09:53:35.735545 np0000004400 cinder-backup[101319]: iface.iscsi_ifacename = default Jul 03 09:53:35.735545 np0000004400 cinder-backup[101319]: iface.net_ifacename = Jul 03 09:53:35.735545 np0000004400 cinder-backup[101319]: iface.ipaddress = Jul 03 09:53:35.735545 np0000004400 cinder-backup[101319]: iface.prefix_len = 0 Jul 03 09:53:35.735545 np0000004400 cinder-backup[101319]: iface.hwaddress = Jul 03 09:53:35.735545 np0000004400 cinder-backup[101319]: iface.transport_name = tcp Jul 03 09:53:35.735545 np0000004400 cinder-backup[101319]: iface.initiatorname = Jul 03 09:53:35.735545 np0000004400 cinder-backup[101319]: iface.state = Jul 03 09:53:35.735545 np0000004400 cinder-backup[101319]: iface.vlan_id = 0 Jul 03 09:53:35.735545 np0000004400 cinder-backup[101319]: iface.vlan_priority = 0 Jul 03 09:53:35.735545 np0000004400 cinder-backup[101319]: iface.vlan_state = Jul 03 09:53:35.735545 np0000004400 cinder-backup[101319]: iface.iface_num = 0 Jul 03 09:53:35.735545 np0000004400 cinder-backup[101319]: iface.mtu = 0 Jul 03 09:53:35.735545 np0000004400 cinder-backup[101319]: iface.port = 0 Jul 03 09:53:35.735545 np0000004400 cinder-backup[101319]: iface.bootproto = Jul 03 09:53:35.735545 np0000004400 cinder-backup[101319]: iface.subnet_mask = Jul 03 09:53:35.735545 np0000004400 cinder-backup[101319]: iface.gateway = Jul 03 09:53:35.735545 np0000004400 cinder-backup[101319]: iface.dhcp_alt_client_id_state = Jul 03 09:53:35.735545 np0000004400 cinder-backup[101319]: iface.dhcp_alt_client_id = Jul 03 09:53:35.735545 np0000004400 cinder-backup[101319]: iface.dhcp_dns = Jul 03 09:53:35.735545 np0000004400 cinder-backup[101319]: iface.dhcp_learn_iqn = Jul 03 09:53:35.735545 np0000004400 cinder-backup[101319]: iface.dhcp_req_vendor_id_state = Jul 03 09:53:35.735545 np0000004400 cinder-backup[101319]: iface.dhcp_vendor_id_state = Jul 03 09:53:35.735545 np0000004400 cinder-backup[101319]: iface.dhcp_vendor_id = Jul 03 09:53:35.735545 np0000004400 cinder-backup[101319]: iface.dhcp_slp_da = Jul 03 09:53:35.735545 np0000004400 cinder-backup[101319]: iface.fragmentation = Jul 03 09:53:35.735545 np0000004400 cinder-backup[101319]: iface.gratuitous_arp = Jul 03 09:53:35.735545 np0000004400 cinder-backup[101319]: iface.incoming_forwarding = Jul 03 09:53:35.735545 np0000004400 cinder-backup[101319]: iface.tos_state = Jul 03 09:53:35.735545 np0000004400 cinder-backup[101319]: iface.tos = 0 Jul 03 09:53:35.735545 np0000004400 cinder-backup[101319]: iface.ttl = 0 Jul 03 09:53:35.735545 np0000004400 cinder-backup[101319]: iface.delayed_ack = Jul 03 09:53:35.735545 np0000004400 cinder-backup[101319]: iface.tcp_nagle = Jul 03 09:53:35.735545 np0000004400 cinder-backup[101319]: iface.tcp_wsf_state = Jul 03 09:53:35.735545 np0000004400 cinder-backup[101319]: iface.tcp_wsf = 0 Jul 03 09:53:35.735545 np0000004400 cinder-backup[101319]: iface.tcp_timer_scale = 0 Jul 03 09:53:35.735545 np0000004400 cinder-backup[101319]: iface.tcp_timestamp = Jul 03 09:53:35.735545 np0000004400 cinder-backup[101319]: iface.redirect = Jul 03 09:53:35.735545 np0000004400 cinder-backup[101319]: iface.def_task_mgmt_timeout = 0 Jul 03 09:53:35.735545 np0000004400 cinder-backup[101319]: iface.header_digest = Jul 03 09:53:35.735545 np0000004400 cinder-backup[101319]: iface.data_digest = Jul 03 09:53:35.735545 np0000004400 cinder-backup[101319]: iface.immediate_data = Jul 03 09:53:35.735545 np0000004400 cinder-backup[101319]: iface.initial_r2t = Jul 03 09:53:35.735545 np0000004400 cinder-backup[101319]: iface.data_seq_inorder = Jul 03 09:53:35.735545 np0000004400 cinder-backup[101319]: iface.data_pdu_inorder = Jul 03 09:53:35.735545 np0000004400 cinder-backup[101319]: iface.erl = 0 Jul 03 09:53:35.735545 np0000004400 cinder-backup[101319]: iface.max_receive_data_len = 0 Jul 03 09:53:35.735545 np0000004400 cinder-backup[101319]: iface.first_burst_len = 0 Jul 03 09:53:35.735545 np0000004400 cinder-backup[101319]: iface.max_outstanding_r2t = 0 Jul 03 09:53:35.735545 np0000004400 cinder-backup[101319]: iface.max_burst_len = 0 Jul 03 09:53:35.735545 np0000004400 cinder-backup[101319]: iface.chap_auth = Jul 03 09:53:35.735545 np0000004400 cinder-backup[101319]: iface.bidi_chap = Jul 03 09:53:35.735545 np0000004400 cinder-backup[101319]: iface.strict_login_compliance = Jul 03 09:53:35.735545 np0000004400 cinder-backup[101319]: iface.discovery_auth = Jul 03 09:53:35.735545 np0000004400 cinder-backup[101319]: iface.discovery_logout = Jul 03 09:53:35.735545 np0000004400 cinder-backup[101319]: node.discovery_address = Jul 03 09:53:35.735545 np0000004400 cinder-backup[101319]: node.discovery_port = 0 Jul 03 09:53:35.735545 np0000004400 cinder-backup[101319]: node.discovery_type = fw Jul 03 09:53:35.735545 np0000004400 cinder-backup[101319]: node.session.initial_cmdsn = 0 Jul 03 09:53:35.735545 np0000004400 cinder-backup[101319]: node.session.initial_login_retry_max = 8 Jul 03 09:53:35.735545 np0000004400 cinder-backup[101319]: node.session.xmit_thread_priority = 0 Jul 03 09:53:35.735545 np0000004400 cinder-backup[101319]: node.session.cmds_max = 128 Jul 03 09:53:35.735545 np0000004400 cinder-backup[101319]: node.session.queue_depth = 32 Jul 03 09:53:35.735545 np0000004400 cinder-backup[101319]: node.session.nr_sessions = 1 Jul 03 09:53:35.735545 np0000004400 cinder-backup[101319]: node.session.auth.authmethod = None Jul 03 09:53:35.735545 np0000004400 cinder-backup[101319]: node.session.auth.username = Jul 03 09:53:35.735545 np0000004400 cinder-backup[101319]: node.session.auth.password = *** Jul 03 09:53:35.735545 np0000004400 cinder-backup[101319]: node.session.auth.username_in = Jul 03 09:53:35.735545 np0000004400 cinder-backup[101319]: node.session.auth.password_in = Jul 03 09:53:35.735545 np0000004400 cinder-backup[101319]: node.session.auth.chap_algs = SHA256 Jul 03 09:53:35.735545 np0000004400 cinder-backup[101319]: node.session.timeo.replacement_timeout = 120 Jul 03 09:53:35.735545 np0000004400 cinder-backup[101319]: node.session.err_timeo.abort_timeout = 15 Jul 03 09:53:35.735545 np0000004400 cinder-backup[101319]: node.session.err_timeo.lu_reset_timeout = 30 Jul 03 09:53:35.735545 np0000004400 cinder-backup[101319]: node.session.err_timeo.tgt_reset_timeout = 30 Jul 03 09:53:35.735545 np0000004400 cinder-backup[101319]: node.session.err_timeo.host_reset_timeout = 60 Jul 03 09:53:35.735545 np0000004400 cinder-backup[101319]: node.session.iscsi.FastAbort = Yes Jul 03 09:53:35.735545 np0000004400 cinder-backup[101319]: node.session.iscsi.InitialR2T = No Jul 03 09:53:35.735545 np0000004400 cinder-backup[101319]: node.session.iscsi.ImmediateData = Yes Jul 03 09:53:35.735545 np0000004400 cinder-backup[101319]: node.session.iscsi.FirstBurstLength = 262144 Jul 03 09:53:35.735545 np0000004400 cinder-backup[101319]: node.session.iscsi.MaxBurstLength = 16776192 Jul 03 09:53:35.735545 np0000004400 cinder-backup[101319]: node.session.iscsi.DefaultTime2Retain = 0 Jul 03 09:53:35.735545 np0000004400 cinder-backup[101319]: node.session.iscsi.DefaultTime2Wait = 2 Jul 03 09:53:35.735545 np0000004400 cinder-backup[101319]: node.session.iscsi.MaxConnections = 1 Jul 03 09:53:35.735545 np0000004400 cinder-backup[101319]: node.session.iscsi.MaxOutstandingR2T = 1 Jul 03 09:53:35.735545 np0000004400 cinder-backup[101319]: node.session.iscsi.ERL = 0 Jul 03 09:53:35.735545 np0000004400 cinder-backup[101319]: node.session.scan = auto Jul 03 09:53:35.735545 np0000004400 cinder-backup[101319]: node.session.reopen_max = 0 Jul 03 09:53:35.735545 np0000004400 cinder-backup[101319]: node.conn[0].address = 192.168.40.100 Jul 03 09:53:35.735545 np0000004400 cinder-backup[101319]: node.conn[0].port = 3260 Jul 03 09:53:35.735545 np0000004400 cinder-backup[101319]: node.conn[0].startup = manual Jul 03 09:53:35.735545 np0000004400 cinder-backup[101319]: node.conn[0].tcp.window_size = 524288 Jul 03 09:53:35.735545 np0000004400 cinder-backup[101319]: node.conn[0].tcp.type_of_service = 0 Jul 03 09:53:35.735545 np0000004400 cinder-backup[101319]: node.conn[0].timeo.logout_timeout = 15 Jul 03 09:53:35.735545 np0000004400 cinder-backup[101319]: node.conn[0].timeo.login_timeout = 15 Jul 03 09:53:35.735545 np0000004400 cinder-backup[101319]: node.conn[0].timeo.auth_timeout = 45 Jul 03 09:53:35.735545 np0000004400 cinder-backup[101319]: node.conn[0].timeo.noop_out_interval = 5 Jul 03 09:53:35.735545 np0000004400 cinder-backup[101319]: node.conn[0].timeo.noop_out_timeout = 5 Jul 03 09:53:35.735545 np0000004400 cinder-backup[101319]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0 Jul 03 09:53:35.735545 np0000004400 cinder-backup[101319]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144 Jul 03 09:53:35.735545 np0000004400 cinder-backup[101319]: node.conn[0].iscsi.HeaderDigest = None Jul 03 09:53:35.735545 np0000004400 cinder-backup[101319]: node.conn[0].iscsi.DataDigest = None Jul 03 09:53:35.735545 np0000004400 cinder-backup[101319]: node.conn[0].iscsi.IFMarker = No Jul 03 09:53:35.735545 np0000004400 cinder-backup[101319]: node.conn[0].iscsi.OFMarker = No Jul 03 09:53:35.735545 np0000004400 cinder-backup[101319]: # END RECORD Jul 03 09:53:35.735545 np0000004400 cinder-backup[101319]: stderr= {{(pid=101319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 03 09:53:35.745369 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-0348256d-c334-445a-abfb-8501d08ca9f1 tempest-ProjectReaderTests33-761902925 None] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=101319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 03 09:53:35.759868 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-0348256d-c334-445a-abfb-8501d08ca9f1 tempest-ProjectReaderTests33-761902925 None] iscsiadm ('-m', 'session'): stdout=tcp: [188] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-491c39b6-d2e0-4f67-9a64-590d50f06197 (non-flash) Jul 03 09:53:35.759868 np0000004400 cinder-backup[101319]: tcp: [189] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-491c39b6-d2e0-4f67-9a64-590d50f06197 (non-flash) Jul 03 09:53:35.759868 np0000004400 cinder-backup[101319]: tcp: [197] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-87fba7de-22c7-4769-ad28-2ca1aa2a1458 (non-flash) Jul 03 09:53:35.759868 np0000004400 cinder-backup[101319]: tcp: [198] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-87fba7de-22c7-4769-ad28-2ca1aa2a1458 (non-flash) Jul 03 09:53:35.759868 np0000004400 cinder-backup[101319]: tcp: [199] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5a775425-df51-44ce-b820-7c6d483d6c42 (non-flash) Jul 03 09:53:35.759868 np0000004400 cinder-backup[101319]: tcp: [200] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5f57fed7-aa36-44c5-af90-863bd3d3af9d (non-flash) Jul 03 09:53:35.759868 np0000004400 cinder-backup[101319]: tcp: [201] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-789ec59e-ea87-4784-8990-156a35276b5f (non-flash) Jul 03 09:53:35.759868 np0000004400 cinder-backup[101319]: tcp: [202] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-789ec59e-ea87-4784-8990-156a35276b5f (non-flash) Jul 03 09:53:35.759868 np0000004400 cinder-backup[101319]: tcp: [203] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-79c374d0-f293-429e-9f7e-a6ac9afa4c99 (non-flash) Jul 03 09:53:35.759868 np0000004400 cinder-backup[101319]: tcp: [204] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-79c374d0-f293-429e-9f7e-a6ac9afa4c99 (non-flash) Jul 03 09:53:35.759868 np0000004400 cinder-backup[101319]: stderr= {{(pid=101319) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jul 03 09:53:35.760267 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-0348256d-c334-445a-abfb-8501d08ca9f1 tempest-ProjectReaderTests33-761902925 None] iscsi session list stdout=tcp: [188] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-491c39b6-d2e0-4f67-9a64-590d50f06197 (non-flash) Jul 03 09:53:35.760267 np0000004400 cinder-backup[101319]: tcp: [189] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-491c39b6-d2e0-4f67-9a64-590d50f06197 (non-flash) Jul 03 09:53:35.760267 np0000004400 cinder-backup[101319]: tcp: [197] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-87fba7de-22c7-4769-ad28-2ca1aa2a1458 (non-flash) Jul 03 09:53:35.760267 np0000004400 cinder-backup[101319]: tcp: [198] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-87fba7de-22c7-4769-ad28-2ca1aa2a1458 (non-flash) Jul 03 09:53:35.760267 np0000004400 cinder-backup[101319]: tcp: [199] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5a775425-df51-44ce-b820-7c6d483d6c42 (non-flash) Jul 03 09:53:35.760267 np0000004400 cinder-backup[101319]: tcp: [200] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5f57fed7-aa36-44c5-af90-863bd3d3af9d (non-flash) Jul 03 09:53:35.760267 np0000004400 cinder-backup[101319]: tcp: [201] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-789ec59e-ea87-4784-8990-156a35276b5f (non-flash) Jul 03 09:53:35.760267 np0000004400 cinder-backup[101319]: tcp: [202] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-789ec59e-ea87-4784-8990-156a35276b5f (non-flash) Jul 03 09:53:35.760267 np0000004400 cinder-backup[101319]: tcp: [203] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-79c374d0-f293-429e-9f7e-a6ac9afa4c99 (non-flash) Jul 03 09:53:35.760267 np0000004400 cinder-backup[101319]: tcp: [204] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-79c374d0-f293-429e-9f7e-a6ac9afa4c99 (non-flash) Jul 03 09:53:35.760267 np0000004400 cinder-backup[101319]: stderr= {{(pid=101319) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jul 03 09:53:35.798920 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-0348256d-c334-445a-abfb-8501d08ca9f1 tempest-ProjectReaderTests33-761902925 None] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-61c7989b-d6b3-4a39-80a6-9fc519424447, portal: 192.168.40.100,3260] Jul 03 09:53:35.798920 np0000004400 cinder-backup[101319]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-61c7989b-d6b3-4a39-80a6-9fc519424447, portal: 192.168.40.100,3260] successful. Jul 03 09:53:35.798920 np0000004400 cinder-backup[101319]: stderr= {{(pid=101319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 03 09:53:35.810966 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-0348256d-c334-445a-abfb-8501d08ca9f1 tempest-ProjectReaderTests33-761902925 None] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=101319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 03 09:53:35.816929 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-7a3f2202-7cda-4e09-9563-4547508d8589 tempest-VolumesBackupsTest-807180270 None] backup MD5 for volume_5a775425-df51-44ce-b820-7c6d483d6c42/20260703095326/az_nova_backup_84105c14-606c-4395-a247-fddb67f6e548-00015: 25e317773f308e446cc84c503a6d1f85 {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 09:53:35.817089 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-7a3f2202-7cda-4e09-9563-4547508d8589 tempest-VolumesBackupsTest-807180270 None] Calling eventlet.sleep(0) {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 09:53:35.822003 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-1678b3a2-6ecc-4dce-a535-6e8837304678 tempest-ProjectMemberTests33-2105464604 None] backup MD5 for volume_5f57fed7-aa36-44c5-af90-863bd3d3af9d/20260703095328/az_nova_backup_0871942a-e198-4230-a099-29a52a21849b-00011: 25e317773f308e446cc84c503a6d1f85 {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 09:53:35.822177 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-1678b3a2-6ecc-4dce-a535-6e8837304678 tempest-ProjectMemberTests33-2105464604 None] Calling eventlet.sleep(0) {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 09:53:35.826754 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-0348256d-c334-445a-abfb-8501d08ca9f1 tempest-ProjectReaderTests33-761902925 None] iscsiadm ('-m', 'session'): stdout=tcp: [188] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-491c39b6-d2e0-4f67-9a64-590d50f06197 (non-flash) Jul 03 09:53:35.826754 np0000004400 cinder-backup[101319]: tcp: [189] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-491c39b6-d2e0-4f67-9a64-590d50f06197 (non-flash) Jul 03 09:53:35.826754 np0000004400 cinder-backup[101319]: tcp: [197] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-87fba7de-22c7-4769-ad28-2ca1aa2a1458 (non-flash) Jul 03 09:53:35.826754 np0000004400 cinder-backup[101319]: tcp: [198] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-87fba7de-22c7-4769-ad28-2ca1aa2a1458 (non-flash) Jul 03 09:53:35.826754 np0000004400 cinder-backup[101319]: tcp: [199] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5a775425-df51-44ce-b820-7c6d483d6c42 (non-flash) Jul 03 09:53:35.826754 np0000004400 cinder-backup[101319]: tcp: [200] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5f57fed7-aa36-44c5-af90-863bd3d3af9d (non-flash) Jul 03 09:53:35.826754 np0000004400 cinder-backup[101319]: tcp: [201] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-789ec59e-ea87-4784-8990-156a35276b5f (non-flash) Jul 03 09:53:35.826754 np0000004400 cinder-backup[101319]: tcp: [202] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-789ec59e-ea87-4784-8990-156a35276b5f (non-flash) Jul 03 09:53:35.826754 np0000004400 cinder-backup[101319]: tcp: [203] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-79c374d0-f293-429e-9f7e-a6ac9afa4c99 (non-flash) Jul 03 09:53:35.826754 np0000004400 cinder-backup[101319]: tcp: [204] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-79c374d0-f293-429e-9f7e-a6ac9afa4c99 (non-flash) Jul 03 09:53:35.826754 np0000004400 cinder-backup[101319]: tcp: [205] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-61c7989b-d6b3-4a39-80a6-9fc519424447 (non-flash) Jul 03 09:53:35.826754 np0000004400 cinder-backup[101319]: stderr= {{(pid=101319) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jul 03 09:53:35.827232 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-0348256d-c334-445a-abfb-8501d08ca9f1 tempest-ProjectReaderTests33-761902925 None] iscsi session list stdout=tcp: [188] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-491c39b6-d2e0-4f67-9a64-590d50f06197 (non-flash) Jul 03 09:53:35.827232 np0000004400 cinder-backup[101319]: tcp: [189] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-491c39b6-d2e0-4f67-9a64-590d50f06197 (non-flash) Jul 03 09:53:35.827232 np0000004400 cinder-backup[101319]: tcp: [197] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-87fba7de-22c7-4769-ad28-2ca1aa2a1458 (non-flash) Jul 03 09:53:35.827232 np0000004400 cinder-backup[101319]: tcp: [198] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-87fba7de-22c7-4769-ad28-2ca1aa2a1458 (non-flash) Jul 03 09:53:35.827232 np0000004400 cinder-backup[101319]: tcp: [199] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5a775425-df51-44ce-b820-7c6d483d6c42 (non-flash) Jul 03 09:53:35.827232 np0000004400 cinder-backup[101319]: tcp: [200] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5f57fed7-aa36-44c5-af90-863bd3d3af9d (non-flash) Jul 03 09:53:35.827232 np0000004400 cinder-backup[101319]: tcp: [201] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-789ec59e-ea87-4784-8990-156a35276b5f (non-flash) Jul 03 09:53:35.827232 np0000004400 cinder-backup[101319]: tcp: [202] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-789ec59e-ea87-4784-8990-156a35276b5f (non-flash) Jul 03 09:53:35.827232 np0000004400 cinder-backup[101319]: tcp: [203] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-79c374d0-f293-429e-9f7e-a6ac9afa4c99 (non-flash) Jul 03 09:53:35.827232 np0000004400 cinder-backup[101319]: tcp: [204] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-79c374d0-f293-429e-9f7e-a6ac9afa4c99 (non-flash) Jul 03 09:53:35.827232 np0000004400 cinder-backup[101319]: tcp: [205] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-61c7989b-d6b3-4a39-80a6-9fc519424447 (non-flash) Jul 03 09:53:35.827232 np0000004400 cinder-backup[101319]: stderr= {{(pid=101319) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jul 03 09:53:35.827634 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.base [None req-0348256d-c334-445a-abfb-8501d08ca9f1 tempest-ProjectReaderTests33-761902925 None] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-61c7989b-d6b3-4a39-80a6-9fc519424447" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.133s {{(pid=101319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jul 03 09:53:35.827634 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-0348256d-c334-445a-abfb-8501d08ca9f1 tempest-ProjectReaderTests33-761902925 None] Connected to 192.168.40.100:3260 {{(pid=101319) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}} Jul 03 09:53:35.828670 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.linuxscsi [None req-0348256d-c334-445a-abfb-8501d08ca9f1 tempest-ProjectReaderTests33-761902925 None] HCTL ('17', '-', '-', 0) found on session 205 with lun 0 {{(pid=101319) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}} Jul 03 09:53:35.828840 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.linuxscsi [None req-0348256d-c334-445a-abfb-8501d08ca9f1 tempest-ProjectReaderTests33-761902925 None] Scanning host 17 c: -, t: -, l: 0) {{(pid=101319) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}} Jul 03 09:53:35.855732 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.linuxscsi [None req-0348256d-c334-445a-abfb-8501d08ca9f1 tempest-ProjectReaderTests33-761902925 None] Searching for a device in session 205 and hctl ['17', '*', '*', 0] yield: None {{(pid=101319) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}} Jul 03 09:53:36.083991 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-7a3f2202-7cda-4e09-9563-4547508d8589 tempest-VolumesBackupsTest-807180270 None] Backing up chunk of data from volume. {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 09:53:36.092279 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-1678b3a2-6ecc-4dce-a535-6e8837304678 tempest-ProjectMemberTests33-2105464604 None] Backing up chunk of data from volume. {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 09:53:36.337591 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-1678b3a2-6ecc-4dce-a535-6e8837304678 tempest-ProjectMemberTests33-2105464604 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101319) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 09:53:36.337740 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-1678b3a2-6ecc-4dce-a535-6e8837304678 tempest-ProjectMemberTests33-2105464604 None] About to put_object {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 09:53:36.339154 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-7a3f2202-7cda-4e09-9563-4547508d8589 tempest-VolumesBackupsTest-807180270 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101319) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 09:53:36.339413 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-7a3f2202-7cda-4e09-9563-4547508d8589 tempest-VolumesBackupsTest-807180270 None] About to put_object {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 09:53:36.443777 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-7a3f2202-7cda-4e09-9563-4547508d8589 tempest-VolumesBackupsTest-807180270 None] backup MD5 for volume_5a775425-df51-44ce-b820-7c6d483d6c42/20260703095326/az_nova_backup_84105c14-606c-4395-a247-fddb67f6e548-00016: 25e317773f308e446cc84c503a6d1f85 {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 09:53:36.443949 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-7a3f2202-7cda-4e09-9563-4547508d8589 tempest-VolumesBackupsTest-807180270 None] Calling eventlet.sleep(0) {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 09:53:36.450307 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-1678b3a2-6ecc-4dce-a535-6e8837304678 tempest-ProjectMemberTests33-2105464604 None] backup MD5 for volume_5f57fed7-aa36-44c5-af90-863bd3d3af9d/20260703095328/az_nova_backup_0871942a-e198-4230-a099-29a52a21849b-00012: 25e317773f308e446cc84c503a6d1f85 {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 09:53:36.450447 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-1678b3a2-6ecc-4dce-a535-6e8837304678 tempest-ProjectMemberTests33-2105464604 None] Calling eventlet.sleep(0) {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 09:53:36.680375 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-1678b3a2-6ecc-4dce-a535-6e8837304678 tempest-ProjectMemberTests33-2105464604 None] Backing up chunk of data from volume. {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 09:53:36.731228 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-7a3f2202-7cda-4e09-9563-4547508d8589 tempest-VolumesBackupsTest-807180270 None] Backing up chunk of data from volume. {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 09:53:36.857126 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.linuxscsi [None req-0348256d-c334-445a-abfb-8501d08ca9f1 tempest-ProjectReaderTests33-761902925 None] Searching for a device in session 205 and hctl ['17', '*', '*', 0] yield: sdl {{(pid=101319) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}} Jul 03 09:53:36.857288 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-0348256d-c334-445a-abfb-8501d08ca9f1 tempest-ProjectReaderTests33-761902925 None] Connected to sdl using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-61c7989b-d6b3-4a39-80a6-9fc519424447', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '61c7989b-d6b3-4a39-80a6-9fc519424447', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': False} {{(pid=101319) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}} Jul 03 09:53:36.857955 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.base [None req-0348256d-c334-445a-abfb-8501d08ca9f1 tempest-ProjectReaderTests33-761902925 None] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 2.175s {{(pid=101319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jul 03 09:53:36.858129 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-0348256d-c334-445a-abfb-8501d08ca9f1 tempest-ProjectReaderTests33-761902925 None] <== connect_volume: return (3233ms) {'type': 'block', 'scsi_wwn': '1StorPooliSCSI_DISK_1034578903445799235', 'path': '/dev/sdl'} {{(pid=101319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}} Jul 03 09:53:36.858477 np0000004400 cinder-backup[101319]: DEBUG oslo_concurrency.processutils [None req-0348256d-c334-445a-abfb-8501d08ca9f1 tempest-ProjectReaderTests33-761902925 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chown 1002 /dev/sdl {{(pid=101319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 09:53:36.882755 np0000004400 sudo[154897]: stack : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chown 1002 /dev/sdl Jul 03 09:53:36.883501 np0000004400 sudo[154897]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1002) Jul 03 09:53:36.932990 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-1678b3a2-6ecc-4dce-a535-6e8837304678 tempest-ProjectMemberTests33-2105464604 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101319) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 09:53:36.933149 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-1678b3a2-6ecc-4dce-a535-6e8837304678 tempest-ProjectMemberTests33-2105464604 None] About to put_object {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 09:53:36.981831 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-7a3f2202-7cda-4e09-9563-4547508d8589 tempest-VolumesBackupsTest-807180270 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101319) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 09:53:36.982015 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-7a3f2202-7cda-4e09-9563-4547508d8589 tempest-VolumesBackupsTest-807180270 None] About to put_object {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 09:53:37.037943 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-1678b3a2-6ecc-4dce-a535-6e8837304678 tempest-ProjectMemberTests33-2105464604 None] backup MD5 for volume_5f57fed7-aa36-44c5-af90-863bd3d3af9d/20260703095328/az_nova_backup_0871942a-e198-4230-a099-29a52a21849b-00013: 25e317773f308e446cc84c503a6d1f85 {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 09:53:37.038141 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-1678b3a2-6ecc-4dce-a535-6e8837304678 tempest-ProjectMemberTests33-2105464604 None] Calling eventlet.sleep(0) {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 09:53:37.082697 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-7a3f2202-7cda-4e09-9563-4547508d8589 tempest-VolumesBackupsTest-807180270 None] backup MD5 for volume_5a775425-df51-44ce-b820-7c6d483d6c42/20260703095326/az_nova_backup_84105c14-606c-4395-a247-fddb67f6e548-00017: 25e317773f308e446cc84c503a6d1f85 {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 09:53:37.082896 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-7a3f2202-7cda-4e09-9563-4547508d8589 tempest-VolumesBackupsTest-807180270 None] Calling eventlet.sleep(0) {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 09:53:37.279631 np0000004400 sudo[154897]: pam_unix(sudo:session): session closed for user root Jul 03 09:53:37.283676 np0000004400 cinder-backup[101319]: DEBUG oslo_concurrency.processutils [None req-0348256d-c334-445a-abfb-8501d08ca9f1 tempest-ProjectReaderTests33-761902925 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chown 1002 /dev/sdl" returned: 0 in 0.425s {{(pid=101319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 09:53:37.290885 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-0348256d-c334-445a-abfb-8501d08ca9f1 tempest-ProjectReaderTests33-761902925 None] _create_container started, container: volumebackups,backup: 3905268c-9301-4198-bac6-c3c450e69ce2. {{(pid=101319) _create_container /opt/stack/cinder/cinder/backup/chunkeddriver.py:249}} Jul 03 09:53:37.320075 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.drivers.swift [None req-0348256d-c334-445a-abfb-8501d08ca9f1 tempest-ProjectReaderTests33-761902925 None] generate_object_name_prefix: volume_61c7989b-d6b3-4a39-80a6-9fc519424447/20260703095337/az_nova_backup_3905268c-9301-4198-bac6-c3c450e69ce2 {{(pid=101319) _generate_object_name_prefix /opt/stack/cinder/cinder/backup/drivers/swift.py:452}} Jul 03 09:53:37.329006 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-0348256d-c334-445a-abfb-8501d08ca9f1 tempest-ProjectReaderTests33-761902925 None] starting backup of volume: 61c7989b-d6b3-4a39-80a6-9fc519424447, volume size: 1073741824, object names prefix volume_61c7989b-d6b3-4a39-80a6-9fc519424447/20260703095337/az_nova_backup_3905268c-9301-4198-bac6-c3c450e69ce2, availability zone: nova {{(pid=101319) _prepare_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:359}} Jul 03 09:53:37.335397 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-1678b3a2-6ecc-4dce-a535-6e8837304678 tempest-ProjectMemberTests33-2105464604 None] Backing up chunk of data from volume. {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 09:53:37.379303 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-7a3f2202-7cda-4e09-9563-4547508d8589 tempest-VolumesBackupsTest-807180270 None] Backing up chunk of data from volume. {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 09:53:37.510840 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-0348256d-c334-445a-abfb-8501d08ca9f1 tempest-ProjectReaderTests33-761902925 None] Backing up chunk of data from volume. {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 09:53:37.592920 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-1678b3a2-6ecc-4dce-a535-6e8837304678 tempest-ProjectMemberTests33-2105464604 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101319) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 09:53:37.593049 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-1678b3a2-6ecc-4dce-a535-6e8837304678 tempest-ProjectMemberTests33-2105464604 None] About to put_object {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 09:53:37.626832 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-7a3f2202-7cda-4e09-9563-4547508d8589 tempest-VolumesBackupsTest-807180270 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101319) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 09:53:37.626992 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-7a3f2202-7cda-4e09-9563-4547508d8589 tempest-VolumesBackupsTest-807180270 None] About to put_object {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 09:53:37.706006 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-1678b3a2-6ecc-4dce-a535-6e8837304678 tempest-ProjectMemberTests33-2105464604 None] backup MD5 for volume_5f57fed7-aa36-44c5-af90-863bd3d3af9d/20260703095328/az_nova_backup_0871942a-e198-4230-a099-29a52a21849b-00014: 25e317773f308e446cc84c503a6d1f85 {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 09:53:37.706176 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-1678b3a2-6ecc-4dce-a535-6e8837304678 tempest-ProjectMemberTests33-2105464604 None] Calling eventlet.sleep(0) {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 09:53:37.737717 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-7a3f2202-7cda-4e09-9563-4547508d8589 tempest-VolumesBackupsTest-807180270 None] backup MD5 for volume_5a775425-df51-44ce-b820-7c6d483d6c42/20260703095326/az_nova_backup_84105c14-606c-4395-a247-fddb67f6e548-00018: 25e317773f308e446cc84c503a6d1f85 {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 09:53:37.737915 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-7a3f2202-7cda-4e09-9563-4547508d8589 tempest-VolumesBackupsTest-807180270 None] Calling eventlet.sleep(0) {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 09:53:37.765109 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-0348256d-c334-445a-abfb-8501d08ca9f1 tempest-ProjectReaderTests33-761902925 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101319) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 09:53:37.765365 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-0348256d-c334-445a-abfb-8501d08ca9f1 tempest-ProjectReaderTests33-761902925 None] About to put_object {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 09:53:37.866223 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-0348256d-c334-445a-abfb-8501d08ca9f1 tempest-ProjectReaderTests33-761902925 None] backup MD5 for volume_61c7989b-d6b3-4a39-80a6-9fc519424447/20260703095337/az_nova_backup_3905268c-9301-4198-bac6-c3c450e69ce2-00001: 25e317773f308e446cc84c503a6d1f85 {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 09:53:37.866361 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-0348256d-c334-445a-abfb-8501d08ca9f1 tempest-ProjectReaderTests33-761902925 None] Calling eventlet.sleep(0) {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 09:53:38.032216 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-1678b3a2-6ecc-4dce-a535-6e8837304678 tempest-ProjectMemberTests33-2105464604 None] Backing up chunk of data from volume. {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 09:53:38.047457 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-7a3f2202-7cda-4e09-9563-4547508d8589 tempest-VolumesBackupsTest-807180270 None] Backing up chunk of data from volume. {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 09:53:38.126382 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-0348256d-c334-445a-abfb-8501d08ca9f1 tempest-ProjectReaderTests33-761902925 None] Backing up chunk of data from volume. {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 09:53:38.278977 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-1678b3a2-6ecc-4dce-a535-6e8837304678 tempest-ProjectMemberTests33-2105464604 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101319) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 09:53:38.279152 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-1678b3a2-6ecc-4dce-a535-6e8837304678 tempest-ProjectMemberTests33-2105464604 None] About to put_object {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 09:53:38.328124 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-7a3f2202-7cda-4e09-9563-4547508d8589 tempest-VolumesBackupsTest-807180270 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101319) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 09:53:38.328631 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-7a3f2202-7cda-4e09-9563-4547508d8589 tempest-VolumesBackupsTest-807180270 None] About to put_object {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 09:53:38.370435 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-0348256d-c334-445a-abfb-8501d08ca9f1 tempest-ProjectReaderTests33-761902925 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101319) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 09:53:38.370435 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-0348256d-c334-445a-abfb-8501d08ca9f1 tempest-ProjectReaderTests33-761902925 None] About to put_object {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 09:53:38.385450 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-1678b3a2-6ecc-4dce-a535-6e8837304678 tempest-ProjectMemberTests33-2105464604 None] backup MD5 for volume_5f57fed7-aa36-44c5-af90-863bd3d3af9d/20260703095328/az_nova_backup_0871942a-e198-4230-a099-29a52a21849b-00015: 25e317773f308e446cc84c503a6d1f85 {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 09:53:38.385589 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-1678b3a2-6ecc-4dce-a535-6e8837304678 tempest-ProjectMemberTests33-2105464604 None] Calling eventlet.sleep(0) {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 09:53:38.430706 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-7a3f2202-7cda-4e09-9563-4547508d8589 tempest-VolumesBackupsTest-807180270 None] backup MD5 for volume_5a775425-df51-44ce-b820-7c6d483d6c42/20260703095326/az_nova_backup_84105c14-606c-4395-a247-fddb67f6e548-00019: 25e317773f308e446cc84c503a6d1f85 {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 09:53:38.430925 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-7a3f2202-7cda-4e09-9563-4547508d8589 tempest-VolumesBackupsTest-807180270 None] Calling eventlet.sleep(0) {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 09:53:38.470631 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-0348256d-c334-445a-abfb-8501d08ca9f1 tempest-ProjectReaderTests33-761902925 None] backup MD5 for volume_61c7989b-d6b3-4a39-80a6-9fc519424447/20260703095337/az_nova_backup_3905268c-9301-4198-bac6-c3c450e69ce2-00002: 25e317773f308e446cc84c503a6d1f85 {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 09:53:38.470939 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-0348256d-c334-445a-abfb-8501d08ca9f1 tempest-ProjectReaderTests33-761902925 None] Calling eventlet.sleep(0) {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 09:53:38.671514 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-1678b3a2-6ecc-4dce-a535-6e8837304678 tempest-ProjectMemberTests33-2105464604 None] Backing up chunk of data from volume. {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 09:53:38.773263 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-7a3f2202-7cda-4e09-9563-4547508d8589 tempest-VolumesBackupsTest-807180270 None] Backing up chunk of data from volume. {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 09:53:38.803862 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-0348256d-c334-445a-abfb-8501d08ca9f1 tempest-ProjectReaderTests33-761902925 None] Backing up chunk of data from volume. {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 09:53:38.913238 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-1678b3a2-6ecc-4dce-a535-6e8837304678 tempest-ProjectMemberTests33-2105464604 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101319) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 09:53:38.913430 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-1678b3a2-6ecc-4dce-a535-6e8837304678 tempest-ProjectMemberTests33-2105464604 None] About to put_object {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 09:53:39.017302 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-1678b3a2-6ecc-4dce-a535-6e8837304678 tempest-ProjectMemberTests33-2105464604 None] backup MD5 for volume_5f57fed7-aa36-44c5-af90-863bd3d3af9d/20260703095328/az_nova_backup_0871942a-e198-4230-a099-29a52a21849b-00016: 25e317773f308e446cc84c503a6d1f85 {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 09:53:39.017505 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-1678b3a2-6ecc-4dce-a535-6e8837304678 tempest-ProjectMemberTests33-2105464604 None] Calling eventlet.sleep(0) {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 09:53:39.019226 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-7a3f2202-7cda-4e09-9563-4547508d8589 tempest-VolumesBackupsTest-807180270 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101319) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 09:53:39.019361 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-7a3f2202-7cda-4e09-9563-4547508d8589 tempest-VolumesBackupsTest-807180270 None] About to put_object {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 09:53:39.045088 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-0348256d-c334-445a-abfb-8501d08ca9f1 tempest-ProjectReaderTests33-761902925 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101319) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 09:53:39.045088 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-0348256d-c334-445a-abfb-8501d08ca9f1 tempest-ProjectReaderTests33-761902925 None] About to put_object {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 09:53:39.148511 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-7a3f2202-7cda-4e09-9563-4547508d8589 tempest-VolumesBackupsTest-807180270 None] backup MD5 for volume_5a775425-df51-44ce-b820-7c6d483d6c42/20260703095326/az_nova_backup_84105c14-606c-4395-a247-fddb67f6e548-00020: 25e317773f308e446cc84c503a6d1f85 {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 09:53:39.148713 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-7a3f2202-7cda-4e09-9563-4547508d8589 tempest-VolumesBackupsTest-807180270 None] Calling eventlet.sleep(0) {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 09:53:39.155678 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-0348256d-c334-445a-abfb-8501d08ca9f1 tempest-ProjectReaderTests33-761902925 None] backup MD5 for volume_61c7989b-d6b3-4a39-80a6-9fc519424447/20260703095337/az_nova_backup_3905268c-9301-4198-bac6-c3c450e69ce2-00003: 25e317773f308e446cc84c503a6d1f85 {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 09:53:39.155887 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-0348256d-c334-445a-abfb-8501d08ca9f1 tempest-ProjectReaderTests33-761902925 None] Calling eventlet.sleep(0) {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 09:53:39.273636 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-1678b3a2-6ecc-4dce-a535-6e8837304678 tempest-ProjectMemberTests33-2105464604 None] Backing up chunk of data from volume. {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 09:53:39.331715 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-7a3f2202-7cda-4e09-9563-4547508d8589 tempest-VolumesBackupsTest-807180270 None] Backing up chunk of data from volume. {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 09:53:39.431204 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-0348256d-c334-445a-abfb-8501d08ca9f1 tempest-ProjectReaderTests33-761902925 None] Backing up chunk of data from volume. {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 09:53:39.455932 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-7a3f2202-7cda-4e09-9563-4547508d8589 tempest-VolumesBackupsTest-807180270 None] Compressed 25165824 bytes of data to 24470 bytes using zlib. {{(pid=101319) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 09:53:39.456072 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-7a3f2202-7cda-4e09-9563-4547508d8589 tempest-VolumesBackupsTest-807180270 None] About to put_object {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 09:53:39.515102 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-7a3f2202-7cda-4e09-9563-4547508d8589 tempest-VolumesBackupsTest-807180270 None] backup MD5 for volume_5a775425-df51-44ce-b820-7c6d483d6c42/20260703095326/az_nova_backup_84105c14-606c-4395-a247-fddb67f6e548-00021: 77377273b0a4b61febdbf7bbf52b9db9 {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 09:53:39.515291 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-7a3f2202-7cda-4e09-9563-4547508d8589 tempest-VolumesBackupsTest-807180270 None] Calling eventlet.sleep(0) {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 09:53:39.525507 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.driver [None req-7a3f2202-7cda-4e09-9563-4547508d8589 tempest-VolumesBackupsTest-807180270 None] Getting metadata type 'volume-base-metadata' {{(pid=101319) _save_vol_base_meta /opt/stack/cinder/cinder/backup/driver.py:79}} Jul 03 09:53:39.531810 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.driver [None req-7a3f2202-7cda-4e09-9563-4547508d8589 tempest-VolumesBackupsTest-807180270 None] Completed fetching metadata type 'volume-base-metadata' {{(pid=101319) _save_vol_base_meta /opt/stack/cinder/cinder/backup/driver.py:98}} Jul 03 09:53:39.532044 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.driver [None req-7a3f2202-7cda-4e09-9563-4547508d8589 tempest-VolumesBackupsTest-807180270 None] Getting metadata type 'volume-metadata' {{(pid=101319) _save_vol_meta /opt/stack/cinder/cinder/backup/driver.py:109}} Jul 03 09:53:39.536249 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.driver [None req-7a3f2202-7cda-4e09-9563-4547508d8589 tempest-VolumesBackupsTest-807180270 None] No metadata type 'volume-metadata' available {{(pid=101319) _save_vol_meta /opt/stack/cinder/cinder/backup/driver.py:123}} Jul 03 09:53:39.536480 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.driver [None req-7a3f2202-7cda-4e09-9563-4547508d8589 tempest-VolumesBackupsTest-807180270 None] Getting metadata type 'volume-glance-metadata' {{(pid=101319) _save_vol_glance_meta /opt/stack/cinder/cinder/backup/driver.py:132}} Jul 03 09:53:39.539597 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-1678b3a2-6ecc-4dce-a535-6e8837304678 tempest-ProjectMemberTests33-2105464604 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101319) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 09:53:39.539699 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-1678b3a2-6ecc-4dce-a535-6e8837304678 tempest-ProjectMemberTests33-2105464604 None] About to put_object {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 09:53:39.540345 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.driver [None req-7a3f2202-7cda-4e09-9563-4547508d8589 tempest-VolumesBackupsTest-807180270 None] No metadata type 'volume-glance-metadata' available {{(pid=101319) _save_vol_glance_meta /opt/stack/cinder/cinder/backup/driver.py:147}} Jul 03 09:53:39.540612 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-7a3f2202-7cda-4e09-9563-4547508d8589 tempest-VolumesBackupsTest-807180270 None] _write_sha256file started, container name: volumebackups, sha256file filename: volume_5a775425-df51-44ce-b820-7c6d483d6c42/20260703095326/az_nova_backup_84105c14-606c-4395-a247-fddb67f6e548_sha256file. {{(pid=101319) _write_sha256file /opt/stack/cinder/cinder/backup/chunkeddriver.py:299}} Jul 03 09:53:39.601980 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-7a3f2202-7cda-4e09-9563-4547508d8589 tempest-VolumesBackupsTest-807180270 None] _write_sha256file finished. {{(pid=101319) _write_sha256file /opt/stack/cinder/cinder/backup/chunkeddriver.py:315}} Jul 03 09:53:39.602891 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-7a3f2202-7cda-4e09-9563-4547508d8589 tempest-VolumesBackupsTest-807180270 None] _write_metadata started, container name: volumebackups, metadata filename: volume_5a775425-df51-44ce-b820-7c6d483d6c42/20260703095326/az_nova_backup_84105c14-606c-4395-a247-fddb67f6e548_metadata. {{(pid=101319) _write_metadata /opt/stack/cinder/cinder/backup/chunkeddriver.py:276}} Jul 03 09:53:39.635925 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-7a3f2202-7cda-4e09-9563-4547508d8589 tempest-VolumesBackupsTest-807180270 None] _write_metadata finished. Metadata: b'{\n "backup_description": null,\n "backup_id": "84105c14-606c-4395-a247-fddb67f6e548",\n "backup_name": "tempest-VolumesBackupsTest-Backup-997194919",\n "created_at": "2026-07-03 09:53:22+00:00",\n "objects": [\n {\n "volume_5a775425-df51-44ce-b820-7c6d483d6c42/20260703095326/az_nova_backup_84105c14-606c-4395-a247-fddb67f6e548-00001": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 0\n }\n },\n {\n "volume_5a775425-df51-44ce-b820-7c6d483d6c42/20260703095326/az_nova_backup_84105c14-606c-4395-a247-fddb67f6e548-00002": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 52428800\n }\n },\n {\n "volume_5a775425-df51-44ce-b820-7c6d483d6c42/20260703095326/az_nova_backup_84105c14-606c-4395-a247-fddb67f6e548-00003": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 104857600\n }\n },\n {\n "volume_5a775425-df51-44ce-b820-7c6d483d6c42/20260703095326/az_nova_backup_84105c14-606c-4395-a247-fddb67f6e548-00004": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 157286400\n }\n },\n {\n "volume_5a775425-df51-44ce-b820-7c6d483d6c42/20260703095326/az_nova_backup_84105c14-606c-4395-a247-fddb67f6e548-00005": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 209715200\n }\n },\n {\n "volume_5a775425-df51-44ce-b820-7c6d483d6c42/20260703095326/az_nova_backup_84105c14-606c-4395-a247-fddb67f6e548-00006": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 262144000\n }\n },\n {\n "volume_5a775425-df51-44ce-b820-7c6d483d6c42/20260703095326/az_nova_backup_84105c14-606c-4395-a247-fddb67f6e548-00007": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 314572800\n }\n },\n {\n "volume_5a775425-df51-44ce-b820-7c6d483d6c42/20260703095326/az_nova_backup_84105c14-606c-4395-a247-fddb67f6e548-00008": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 367001600\n }\n },\n {\n "volume_5a775425-df51-44ce-b820-7c6d483d6c42/20260703095326/az_nova_backup_84105c14-606c-4395-a247-fddb67f6e548-00009": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 419430400\n }\n },\n {\n "volume_5a775425-df51-44ce-b820-7c6d483d6c42/20260703095326/az_nova_backup_84105c14-606c-4395-a247-fddb67f6e548-00010": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 471859200\n }\n },\n {\n "volume_5a775425-df51-44ce-b820-7c6d483d6c42/20260703095326/az_nova_backup_84105c14-606c-4395-a247-fddb67f6e548-00011": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 524288000\n }\n },\n {\n "volume_5a775425-df51-44ce-b820-7c6d483d6c42/20260703095326/az_nova_backup_84105c14-606c-4395-a247-fddb67f6e548-00012": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 576716800\n }\n },\n {\n "volume_5a775425-df51-44ce-b820-7c6d483d6c42/20260703095326/az_nova_backup_84105c14-606c-4395-a247-fddb67f6e548-00013": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 629145600\n }\n },\n {\n "volume_5a775425-df51-44ce-b820-7c6d483d6c42/20260703095326/az_nova_backup_84105c14-606c-4395-a247-fddb67f6e548-00014": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 681574400\n }\n },\n {\n "volume_5a775425-df51-44ce-b820-7c6d483d6c42/20260703095326/az_nova_backup_84105c14-606c-4395-a247-fddb67f6e548-00015": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 734003200\n }\n },\n {\n "volume_5a775425-df51-44ce-b820-7c6d483d6c42/20260703095326/az_nova_backup_84105c14-606c-4395-a247-fddb67f6e548-00016": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 786432000\n }\n },\n {\n "volume_5a775425-df51-44ce-b820-7c6d483d6c42/20260703095326/az_nova_backup_84105c14-606c-4395-a247-fddb67f6e548-00017": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 838860800\n }\n },\n {\n "volume_5a775425-df51-44ce-b820-7c6d483d6c42/20260703095326/az_nova_backup_84105c14-606c-4395-a247-fddb67f6e548-00018": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 891289600\n }\n },\n {\n "volume_5a775425-df51-44ce-b820-7c6d483d6c42/20260703095326/az_nova_backup_84105c14-606c-4395-a247-fddb67f6e548-00019": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 943718400\n }\n },\n {\n "volume_5a775425-df51-44ce-b820-7c6d483d6c42/20260703095326/az_nova_backup_84105c14-606c-4395-a247-fddb67f6e548-00020": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 996147200\n }\n },\n {\n "volume_5a775425-df51-44ce-b820-7c6d483d6c42/20260703095326/az_nova_backup_84105c14-606c-4395-a247-fddb67f6e548-00021": {\n "compression": "zlib",\n "length": 25165824,\n "md5": "77377273b0a4b61febdbf7bbf52b9db9",\n "offset": 1048576000\n }\n }\n ],\n "parent_id": null,\n "version": "1.0.0",\n "volume_id": "5a775425-df51-44ce-b820-7c6d483d6c42",\n "volume_meta": "{\\"version\\": 2, \\"volume-base-metadata\\": {\\"id\\": \\"5a775425-df51-44ce-b820-7c6d483d6c42\\", \\"_name_id\\": null, \\"use_quota\\": true, \\"ec2_id\\": null, \\"user_id\\": \\"e3b8ecc8212649f489f39b74eac8ff8f\\", \\"project_id\\": \\"c36863fd49104594b80b419fafd78f5c\\", \\"snapshot_id\\": null, \\"cluster_name\\": null, \\"host\\": \\"np0000004400@storpool#default\\", \\"size\\": 1, \\"availability_zone\\": \\"nova\\", \\"status\\": \\"backing-up\\", \\"attach_status\\": \\"detached\\", \\"migration_status\\": null, \\"scheduled_at\\": \\"2026-07-03T09:53:21.000000\\", \\"launched_at\\": \\"2026-07-03T09:53:21.000000\\", \\"terminated_at\\": null, \\"display_name\\": \\"tempest-VolumesBackupsTest-Volume-246018990\\", \\"display_description\\": null, \\"provider_location\\": null, \\"provider_auth\\": null, \\"provider_geometry\\": null, \\"provider_id\\": null, \\"volume_type_id\\": \\"03e13fe6-0e30-4803-ace0-725d38e6dc24\\", \\"source_volid\\": null, \\"encryption_key_id\\": null, \\"consistencygroup_id\\": null, \\"group_id\\": null, \\"bootable\\": false, \\"multiattach\\": false, \\"replication_status\\": null, \\"replication_extended_status\\": null, \\"replication_driver_data\\": null, \\"previous_status\\": \\"available\\", \\"service_uuid\\": \\"6d4b0e79-fefe-4744-b25f-34be05095200\\", \\"shared_targets\\": true, \\"deleted_at\\": null, \\"deleted\\": false, \\"created_at\\": \\"2026-07-03T09:53:21.000000\\", \\"updated_at\\": \\"2026-07-03T09:53:22.000000\\"}}"\n}'. {{(pid=101319) _write_metadata /opt/stack/cinder/cinder/backup/chunkeddriver.py:295}} Jul 03 09:53:39.642929 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-7a3f2202-7cda-4e09-9563-4547508d8589 tempest-VolumesBackupsTest-807180270 None] backup 84105c14-606c-4395-a247-fddb67f6e548 finished. {{(pid=101319) _finalize_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:462}} Jul 03 09:53:39.766923 np0000004400 cinder-backup[101319]: DEBUG oslo_concurrency.processutils [None req-7a3f2202-7cda-4e09-9563-4547508d8589 tempest-VolumesBackupsTest-807180270 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chown 0 /dev/sdg {{(pid=101319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 09:53:39.776422 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-0348256d-c334-445a-abfb-8501d08ca9f1 tempest-ProjectReaderTests33-761902925 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101319) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 09:53:39.776704 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-0348256d-c334-445a-abfb-8501d08ca9f1 tempest-ProjectReaderTests33-761902925 None] About to put_object {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 09:53:39.777356 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-1678b3a2-6ecc-4dce-a535-6e8837304678 tempest-ProjectMemberTests33-2105464604 None] backup MD5 for volume_5f57fed7-aa36-44c5-af90-863bd3d3af9d/20260703095328/az_nova_backup_0871942a-e198-4230-a099-29a52a21849b-00017: 25e317773f308e446cc84c503a6d1f85 {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 09:53:39.777616 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-1678b3a2-6ecc-4dce-a535-6e8837304678 tempest-ProjectMemberTests33-2105464604 None] Calling eventlet.sleep(0) {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 09:53:39.791346 np0000004400 sudo[154969]: stack : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chown 0 /dev/sdg Jul 03 09:53:39.792138 np0000004400 sudo[154969]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1002) Jul 03 09:53:39.889734 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-0348256d-c334-445a-abfb-8501d08ca9f1 tempest-ProjectReaderTests33-761902925 None] backup MD5 for volume_61c7989b-d6b3-4a39-80a6-9fc519424447/20260703095337/az_nova_backup_3905268c-9301-4198-bac6-c3c450e69ce2-00004: 25e317773f308e446cc84c503a6d1f85 {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 09:53:39.889929 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-0348256d-c334-445a-abfb-8501d08ca9f1 tempest-ProjectReaderTests33-761902925 None] Calling eventlet.sleep(0) {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 09:53:40.036320 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-1678b3a2-6ecc-4dce-a535-6e8837304678 tempest-ProjectMemberTests33-2105464604 None] Backing up chunk of data from volume. {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 09:53:40.112724 np0000004400 sudo[154969]: pam_unix(sudo:session): session closed for user root Jul 03 09:53:40.114582 np0000004400 cinder-backup[101319]: DEBUG oslo_concurrency.processutils [None req-7a3f2202-7cda-4e09-9563-4547508d8589 tempest-VolumesBackupsTest-807180270 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chown 0 /dev/sdg" returned: 0 in 0.348s {{(pid=101319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 09:53:40.115236 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-7a3f2202-7cda-4e09-9563-4547508d8589 tempest-VolumesBackupsTest-807180270 None] ==> disconnect_volume: call "{'args': (, {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-5a775425-df51-44ce-b820-7c6d483d6c42', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '5a775425-df51-44ce-b820-7c6d483d6c42', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': False}, {'type': 'block', 'scsi_wwn': '3300000006cdc4cb8', 'path': '/dev/sdg'}), 'kwargs': {'force': True, 'ignore_errors': True}}" {{(pid=101319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}} Jul 03 09:53:40.115491 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.base [None req-7a3f2202-7cda-4e09-9563-4547508d8589 tempest-VolumesBackupsTest-807180270 None] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=101319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jul 03 09:53:40.115962 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.base [None req-7a3f2202-7cda-4e09-9563-4547508d8589 tempest-VolumesBackupsTest-807180270 None] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=101319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jul 03 09:53:40.116340 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-7a3f2202-7cda-4e09-9563-4547508d8589 tempest-VolumesBackupsTest-807180270 None] _get_connection_devices called with parameters: connection_properties={'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-5a775425-df51-44ce-b820-7c6d483d6c42', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '5a775425-df51-44ce-b820-7c6d483d6c42', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': False}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=101319) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:847}} Jul 03 09:53:40.130717 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-7a3f2202-7cda-4e09-9563-4547508d8589 tempest-VolumesBackupsTest-807180270 None] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS: Jul 03 09:53:40.130717 np0000004400 cinder-backup[101319]: No targets found. Jul 03 09:53:40.130717 np0000004400 cinder-backup[101319]: iSNS: Jul 03 09:53:40.130717 np0000004400 cinder-backup[101319]: No targets found. Jul 03 09:53:40.130717 np0000004400 cinder-backup[101319]: STATIC: Jul 03 09:53:40.130717 np0000004400 cinder-backup[101319]: Target: iqn.2023-03.storpool.com:os--volume-87fba7de-22c7-4769-ad28-2ca1aa2a1458 Jul 03 09:53:40.130717 np0000004400 cinder-backup[101319]: Portal: 192.168.50.100:3260,-1 Jul 03 09:53:40.130717 np0000004400 cinder-backup[101319]: Iface Name: default Jul 03 09:53:40.130717 np0000004400 cinder-backup[101319]: Portal: 192.168.40.100:3260,-1 Jul 03 09:53:40.130717 np0000004400 cinder-backup[101319]: Iface Name: default Jul 03 09:53:40.130717 np0000004400 cinder-backup[101319]: Target: iqn.2023-03.storpool.com:os--volume-491c39b6-d2e0-4f67-9a64-590d50f06197 Jul 03 09:53:40.130717 np0000004400 cinder-backup[101319]: Portal: 192.168.50.100:3260,-1 Jul 03 09:53:40.130717 np0000004400 cinder-backup[101319]: Iface Name: default Jul 03 09:53:40.130717 np0000004400 cinder-backup[101319]: Portal: 192.168.40.100:3260,-1 Jul 03 09:53:40.130717 np0000004400 cinder-backup[101319]: Iface Name: default Jul 03 09:53:40.130717 np0000004400 cinder-backup[101319]: Target: iqn.2023-03.storpool.com:os--volume-5f57fed7-aa36-44c5-af90-863bd3d3af9d Jul 03 09:53:40.130717 np0000004400 cinder-backup[101319]: Portal: 192.168.40.100:3260,-1 Jul 03 09:53:40.130717 np0000004400 cinder-backup[101319]: Iface Name: default Jul 03 09:53:40.130717 np0000004400 cinder-backup[101319]: Target: iqn.2023-03.storpool.com:os--volume-5a775425-df51-44ce-b820-7c6d483d6c42 Jul 03 09:53:40.130717 np0000004400 cinder-backup[101319]: Portal: 192.168.40.100:3260,-1 Jul 03 09:53:40.130717 np0000004400 cinder-backup[101319]: Iface Name: default Jul 03 09:53:40.130717 np0000004400 cinder-backup[101319]: Target: iqn.2023-03.storpool.com:os--volume-789ec59e-ea87-4784-8990-156a35276b5f Jul 03 09:53:40.130717 np0000004400 cinder-backup[101319]: Portal: 192.168.50.100:3260,-1 Jul 03 09:53:40.130717 np0000004400 cinder-backup[101319]: Iface Name: default Jul 03 09:53:40.130717 np0000004400 cinder-backup[101319]: Portal: 192.168.40.100:3260,-1 Jul 03 09:53:40.130717 np0000004400 cinder-backup[101319]: Iface Name: default Jul 03 09:53:40.130717 np0000004400 cinder-backup[101319]: Target: iqn.2023-03.storpool.com:os--volume-61c7989b-d6b3-4a39-80a6-9fc519424447 Jul 03 09:53:40.130717 np0000004400 cinder-backup[101319]: Portal: 192.168.40.100:3260,-1 Jul 03 09:53:40.130717 np0000004400 cinder-backup[101319]: Iface Name: default Jul 03 09:53:40.130717 np0000004400 cinder-backup[101319]: Target: iqn.2023-03.storpool.com:os--volume-79c374d0-f293-429e-9f7e-a6ac9afa4c99 Jul 03 09:53:40.130717 np0000004400 cinder-backup[101319]: Portal: 192.168.50.100:3260,-1 Jul 03 09:53:40.130717 np0000004400 cinder-backup[101319]: Iface Name: default Jul 03 09:53:40.130717 np0000004400 cinder-backup[101319]: Portal: 192.168.40.100:3260,-1 Jul 03 09:53:40.130717 np0000004400 cinder-backup[101319]: Iface Name: default Jul 03 09:53:40.130717 np0000004400 cinder-backup[101319]: FIRMWARE: Jul 03 09:53:40.130717 np0000004400 cinder-backup[101319]: No targets found. Jul 03 09:53:40.130717 np0000004400 cinder-backup[101319]: stderr= {{(pid=101319) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jul 03 09:53:40.131339 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-7a3f2202-7cda-4e09-9563-4547508d8589 tempest-VolumesBackupsTest-807180270 None] Regex to get portals from discoverydb: ^SENDTARGETS: Jul 03 09:53:40.131339 np0000004400 cinder-backup[101319]: .*?^DiscoveryAddress: 192.168.40.100,3260.*? Jul 03 09:53:40.131339 np0000004400 cinder-backup[101319]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=101319) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:390}} Jul 03 09:53:40.131339 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-7a3f2202-7cda-4e09-9563-4547508d8589 tempest-VolumesBackupsTest-807180270 None] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-5a775425-df51-44ce-b820-7c6d483d6c42', 0)] {{(pid=101319) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:858}} Jul 03 09:53:40.149306 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-0348256d-c334-445a-abfb-8501d08ca9f1 tempest-ProjectReaderTests33-761902925 None] Backing up chunk of data from volume. {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 09:53:40.163891 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-7a3f2202-7cda-4e09-9563-4547508d8589 tempest-VolumesBackupsTest-807180270 None] iscsiadm ('-m', 'session'): stdout=tcp: [188] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-491c39b6-d2e0-4f67-9a64-590d50f06197 (non-flash) Jul 03 09:53:40.163891 np0000004400 cinder-backup[101319]: tcp: [189] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-491c39b6-d2e0-4f67-9a64-590d50f06197 (non-flash) Jul 03 09:53:40.163891 np0000004400 cinder-backup[101319]: tcp: [197] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-87fba7de-22c7-4769-ad28-2ca1aa2a1458 (non-flash) Jul 03 09:53:40.163891 np0000004400 cinder-backup[101319]: tcp: [198] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-87fba7de-22c7-4769-ad28-2ca1aa2a1458 (non-flash) Jul 03 09:53:40.163891 np0000004400 cinder-backup[101319]: tcp: [199] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5a775425-df51-44ce-b820-7c6d483d6c42 (non-flash) Jul 03 09:53:40.163891 np0000004400 cinder-backup[101319]: tcp: [200] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5f57fed7-aa36-44c5-af90-863bd3d3af9d (non-flash) Jul 03 09:53:40.163891 np0000004400 cinder-backup[101319]: tcp: [201] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-789ec59e-ea87-4784-8990-156a35276b5f (non-flash) Jul 03 09:53:40.163891 np0000004400 cinder-backup[101319]: tcp: [202] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-789ec59e-ea87-4784-8990-156a35276b5f (non-flash) Jul 03 09:53:40.163891 np0000004400 cinder-backup[101319]: tcp: [203] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-79c374d0-f293-429e-9f7e-a6ac9afa4c99 (non-flash) Jul 03 09:53:40.163891 np0000004400 cinder-backup[101319]: tcp: [204] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-79c374d0-f293-429e-9f7e-a6ac9afa4c99 (non-flash) Jul 03 09:53:40.163891 np0000004400 cinder-backup[101319]: tcp: [205] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-61c7989b-d6b3-4a39-80a6-9fc519424447 (non-flash) Jul 03 09:53:40.163891 np0000004400 cinder-backup[101319]: stderr= {{(pid=101319) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jul 03 09:53:40.164467 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-7a3f2202-7cda-4e09-9563-4547508d8589 tempest-VolumesBackupsTest-807180270 None] iscsi session list stdout=tcp: [188] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-491c39b6-d2e0-4f67-9a64-590d50f06197 (non-flash) Jul 03 09:53:40.164467 np0000004400 cinder-backup[101319]: tcp: [189] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-491c39b6-d2e0-4f67-9a64-590d50f06197 (non-flash) Jul 03 09:53:40.164467 np0000004400 cinder-backup[101319]: tcp: [197] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-87fba7de-22c7-4769-ad28-2ca1aa2a1458 (non-flash) Jul 03 09:53:40.164467 np0000004400 cinder-backup[101319]: tcp: [198] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-87fba7de-22c7-4769-ad28-2ca1aa2a1458 (non-flash) Jul 03 09:53:40.164467 np0000004400 cinder-backup[101319]: tcp: [199] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5a775425-df51-44ce-b820-7c6d483d6c42 (non-flash) Jul 03 09:53:40.164467 np0000004400 cinder-backup[101319]: tcp: [200] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5f57fed7-aa36-44c5-af90-863bd3d3af9d (non-flash) Jul 03 09:53:40.164467 np0000004400 cinder-backup[101319]: tcp: [201] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-789ec59e-ea87-4784-8990-156a35276b5f (non-flash) Jul 03 09:53:40.164467 np0000004400 cinder-backup[101319]: tcp: [202] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-789ec59e-ea87-4784-8990-156a35276b5f (non-flash) Jul 03 09:53:40.164467 np0000004400 cinder-backup[101319]: tcp: [203] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-79c374d0-f293-429e-9f7e-a6ac9afa4c99 (non-flash) Jul 03 09:53:40.164467 np0000004400 cinder-backup[101319]: tcp: [204] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-79c374d0-f293-429e-9f7e-a6ac9afa4c99 (non-flash) Jul 03 09:53:40.164467 np0000004400 cinder-backup[101319]: tcp: [205] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-61c7989b-d6b3-4a39-80a6-9fc519424447 (non-flash) Jul 03 09:53:40.164467 np0000004400 cinder-backup[101319]: stderr= {{(pid=101319) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jul 03 09:53:40.164914 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-7a3f2202-7cda-4e09-9563-4547508d8589 tempest-VolumesBackupsTest-807180270 None] Sessions list: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-491c39b6-d2e0-4f67-9a64-590d50f06197', '188'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-491c39b6-d2e0-4f67-9a64-590d50f06197', '189'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-87fba7de-22c7-4769-ad28-2ca1aa2a1458', '197'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-87fba7de-22c7-4769-ad28-2ca1aa2a1458', '198'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-5a775425-df51-44ce-b820-7c6d483d6c42', '199'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-5f57fed7-aa36-44c5-af90-863bd3d3af9d', '200'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-789ec59e-ea87-4784-8990-156a35276b5f', '201'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-789ec59e-ea87-4784-8990-156a35276b5f', '202'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-79c374d0-f293-429e-9f7e-a6ac9afa4c99', '203'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-79c374d0-f293-429e-9f7e-a6ac9afa4c99', '204'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-61c7989b-d6b3-4a39-80a6-9fc519424447', '205')] {{(pid=101319) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:866}} Jul 03 09:53:40.165148 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-7a3f2202-7cda-4e09-9563-4547508d8589 tempest-VolumesBackupsTest-807180270 None] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-5a775425-df51-44ce-b820-7c6d483d6c42, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-5a775425-df51-44ce-b820-7c6d483d6c42', '199')] {{(pid=101319) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}} Jul 03 09:53:40.166481 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-7a3f2202-7cda-4e09-9563-4547508d8589 tempest-VolumesBackupsTest-807180270 None] Resulting device map defaultdict(. at 0x7e76e71305e0>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-5a775425-df51-44ce-b820-7c6d483d6c42'): ({'sdg'}, set())}) {{(pid=101319) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:912}} Jul 03 09:53:40.166843 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.linuxscsi [None req-7a3f2202-7cda-4e09-9563-4547508d8589 tempest-VolumesBackupsTest-807180270 None] Removing single pathed devices sdg {{(pid=101319) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}} Jul 03 09:53:40.179429 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.linuxscsi [None req-7a3f2202-7cda-4e09-9563-4547508d8589 tempest-VolumesBackupsTest-807180270 None] Flushing IO for device /dev/sdg {{(pid=101319) flush_device_io /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:461}} Jul 03 09:53:40.190149 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.linuxscsi [None req-7a3f2202-7cda-4e09-9563-4547508d8589 tempest-VolumesBackupsTest-807180270 None] Remove SCSI device /dev/sdg with /sys/block/sdg/device/delete {{(pid=101319) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}} Jul 03 09:53:40.241933 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.linuxscsi [None req-7a3f2202-7cda-4e09-9563-4547508d8589 tempest-VolumesBackupsTest-807180270 None] Checking to see if SCSI volumes sdg have been removed. {{(pid=101319) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}} Jul 03 09:53:40.242155 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.linuxscsi [None req-7a3f2202-7cda-4e09-9563-4547508d8589 tempest-VolumesBackupsTest-807180270 None] SCSI volumes sdg have been removed. {{(pid=101319) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}} Jul 03 09:53:40.243475 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.linuxscsi [None req-7a3f2202-7cda-4e09-9563-4547508d8589 tempest-VolumesBackupsTest-807180270 None] Checking to see if device paths {'sdg'} are still under multipathd monitoring {{(pid=101319) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}} Jul 03 09:53:40.256463 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.linuxscsi [None req-7a3f2202-7cda-4e09-9563-4547508d8589 tempest-VolumesBackupsTest-807180270 None] Device paths {'sdg'} have been removed from multipathd monitoring. {{(pid=101319) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}} Jul 03 09:53:40.256687 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-7a3f2202-7cda-4e09-9563-4547508d8589 tempest-VolumesBackupsTest-807180270 None] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-5a775425-df51-44ce-b820-7c6d483d6c42')] {{(pid=101319) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1225}} Jul 03 09:53:40.268149 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-7a3f2202-7cda-4e09-9563-4547508d8589 tempest-VolumesBackupsTest-807180270 None] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=101319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 03 09:53:40.298625 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-1678b3a2-6ecc-4dce-a535-6e8837304678 tempest-ProjectMemberTests33-2105464604 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101319) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 09:53:40.298754 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-1678b3a2-6ecc-4dce-a535-6e8837304678 tempest-ProjectMemberTests33-2105464604 None] About to put_object {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 09:53:40.303203 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-7a3f2202-7cda-4e09-9563-4547508d8589 tempest-VolumesBackupsTest-807180270 None] iscsiadm ('--logout',): stdout=Logging out of session [sid: 199, target: iqn.2023-03.storpool.com:os--volume-5a775425-df51-44ce-b820-7c6d483d6c42, portal: 192.168.40.100,3260] Jul 03 09:53:40.303203 np0000004400 cinder-backup[101319]: Logout of [sid: 199, target: iqn.2023-03.storpool.com:os--volume-5a775425-df51-44ce-b820-7c6d483d6c42, portal: 192.168.40.100,3260] successful. Jul 03 09:53:40.303203 np0000004400 cinder-backup[101319]: stderr= {{(pid=101319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 03 09:53:40.329058 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-7a3f2202-7cda-4e09-9563-4547508d8589 tempest-VolumesBackupsTest-807180270 None] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=101319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 03 09:53:40.329058 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.base [None req-7a3f2202-7cda-4e09-9563-4547508d8589 tempest-VolumesBackupsTest-807180270 None] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.211s {{(pid=101319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jul 03 09:53:40.329058 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-7a3f2202-7cda-4e09-9563-4547508d8589 tempest-VolumesBackupsTest-807180270 None] <== disconnect_volume: return (211ms) None {{(pid=101319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}} Jul 03 09:53:40.381663 np0000004400 cinder-backup[101319]: DEBUG oslo_service.periodic_task [None req-ffd932d2-122c-4e68-b5ba-628aff7ae7b8 None None] Running periodic task BackupManager.publish_service_capabilities {{(pid=101319) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 03 09:53:40.383467 np0000004400 cinder-backup[101319]: DEBUG cinder.manager [None req-ffd932d2-122c-4e68-b5ba-628aff7ae7b8 None None] Notifying Schedulers of capabilities ... {{(pid=101319) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 03 09:53:40.403203 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-0348256d-c334-445a-abfb-8501d08ca9f1 tempest-ProjectReaderTests33-761902925 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101319) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 09:53:40.403739 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-0348256d-c334-445a-abfb-8501d08ca9f1 tempest-ProjectReaderTests33-761902925 None] About to put_object {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 09:53:40.425272 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-1678b3a2-6ecc-4dce-a535-6e8837304678 tempest-ProjectMemberTests33-2105464604 None] backup MD5 for volume_5f57fed7-aa36-44c5-af90-863bd3d3af9d/20260703095328/az_nova_backup_0871942a-e198-4230-a099-29a52a21849b-00018: 25e317773f308e446cc84c503a6d1f85 {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 09:53:40.425272 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-1678b3a2-6ecc-4dce-a535-6e8837304678 tempest-ProjectMemberTests33-2105464604 None] Calling eventlet.sleep(0) {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 09:53:40.507696 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-0348256d-c334-445a-abfb-8501d08ca9f1 tempest-ProjectReaderTests33-761902925 None] backup MD5 for volume_61c7989b-d6b3-4a39-80a6-9fc519424447/20260703095337/az_nova_backup_3905268c-9301-4198-bac6-c3c450e69ce2-00005: 25e317773f308e446cc84c503a6d1f85 {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 09:53:40.507867 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-0348256d-c334-445a-abfb-8501d08ca9f1 tempest-ProjectReaderTests33-761902925 None] Calling eventlet.sleep(0) {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 09:53:40.711981 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-1678b3a2-6ecc-4dce-a535-6e8837304678 tempest-ProjectMemberTests33-2105464604 None] Backing up chunk of data from volume. {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 09:53:40.768452 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-0348256d-c334-445a-abfb-8501d08ca9f1 tempest-ProjectReaderTests33-761902925 None] Backing up chunk of data from volume. {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 09:53:40.956654 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-1678b3a2-6ecc-4dce-a535-6e8837304678 tempest-ProjectMemberTests33-2105464604 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101319) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 09:53:40.956654 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-1678b3a2-6ecc-4dce-a535-6e8837304678 tempest-ProjectMemberTests33-2105464604 None] About to put_object {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 09:53:41.013909 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-0348256d-c334-445a-abfb-8501d08ca9f1 tempest-ProjectReaderTests33-761902925 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101319) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 09:53:41.014311 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-0348256d-c334-445a-abfb-8501d08ca9f1 tempest-ProjectReaderTests33-761902925 None] About to put_object {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 09:53:41.055026 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-1678b3a2-6ecc-4dce-a535-6e8837304678 tempest-ProjectMemberTests33-2105464604 None] backup MD5 for volume_5f57fed7-aa36-44c5-af90-863bd3d3af9d/20260703095328/az_nova_backup_0871942a-e198-4230-a099-29a52a21849b-00019: 25e317773f308e446cc84c503a6d1f85 {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 09:53:41.055208 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-1678b3a2-6ecc-4dce-a535-6e8837304678 tempest-ProjectMemberTests33-2105464604 None] Calling eventlet.sleep(0) {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 09:53:41.111612 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-0348256d-c334-445a-abfb-8501d08ca9f1 tempest-ProjectReaderTests33-761902925 None] backup MD5 for volume_61c7989b-d6b3-4a39-80a6-9fc519424447/20260703095337/az_nova_backup_3905268c-9301-4198-bac6-c3c450e69ce2-00006: 25e317773f308e446cc84c503a6d1f85 {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 09:53:41.111779 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-0348256d-c334-445a-abfb-8501d08ca9f1 tempest-ProjectReaderTests33-761902925 None] Calling eventlet.sleep(0) {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 09:53:41.313587 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-1678b3a2-6ecc-4dce-a535-6e8837304678 tempest-ProjectMemberTests33-2105464604 None] Backing up chunk of data from volume. {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 09:53:41.349247 np0000004400 cinder-backup[101319]: INFO cinder.backup.manager [None req-7a3f2202-7cda-4e09-9563-4547508d8589 tempest-VolumesBackupsTest-807180270 None] Create backup finished. backup: 84105c14-606c-4395-a247-fddb67f6e548. Jul 03 09:53:41.380349 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-0348256d-c334-445a-abfb-8501d08ca9f1 tempest-ProjectReaderTests33-761902925 None] Backing up chunk of data from volume. {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 09:53:41.557532 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-1678b3a2-6ecc-4dce-a535-6e8837304678 tempest-ProjectMemberTests33-2105464604 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101319) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 09:53:41.557929 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-1678b3a2-6ecc-4dce-a535-6e8837304678 tempest-ProjectMemberTests33-2105464604 None] About to put_object {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 09:53:41.590905 np0000004400 cinder-backup[101319]: INFO cinder.backup.manager [None req-a9111138-3213-412c-a50c-183b74db0d68 tempest-VolumesBackupsTest-807180270 None] Delete backup started, backup: 84105c14-606c-4395-a247-fddb67f6e548. Jul 03 09:53:41.606595 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.drivers.swift [None req-a9111138-3213-412c-a50c-183b74db0d68 tempest-VolumesBackupsTest-807180270 None] Using swift URL https://10.4.3.95:8080/v1/AUTH_298e794341b64951b3fb757bfbffa698 {{(pid=101319) initialize /opt/stack/cinder/cinder/backup/drivers/swift.py:300}} Jul 03 09:53:41.606935 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.drivers.swift [None req-a9111138-3213-412c-a50c-183b74db0d68 tempest-VolumesBackupsTest-807180270 None] Connect to https://10.4.3.95:8080/v1/AUTH_ in "per_user" mode {{(pid=101319) initialize /opt/stack/cinder/cinder/backup/drivers/swift.py:301}} Jul 03 09:53:41.607198 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-a9111138-3213-412c-a50c-183b74db0d68 tempest-VolumesBackupsTest-807180270 None] delete started, backup: 84105c14-606c-4395-a247-fddb67f6e548, container: volumebackups, prefix: volume_5a775425-df51-44ce-b820-7c6d483d6c42/20260703095326/az_nova_backup_84105c14-606c-4395-a247-fddb67f6e548. {{(pid=101319) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:822}} Jul 03 09:53:41.621553 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-0348256d-c334-445a-abfb-8501d08ca9f1 tempest-ProjectReaderTests33-761902925 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101319) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 09:53:41.621702 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-0348256d-c334-445a-abfb-8501d08ca9f1 tempest-ProjectReaderTests33-761902925 None] About to put_object {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 09:53:41.655032 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-a9111138-3213-412c-a50c-183b74db0d68 tempest-VolumesBackupsTest-807180270 None] generated object list: ['volume_5a775425-df51-44ce-b820-7c6d483d6c42/20260703095326/az_nova_backup_84105c14-606c-4395-a247-fddb67f6e548-00001', 'volume_5a775425-df51-44ce-b820-7c6d483d6c42/20260703095326/az_nova_backup_84105c14-606c-4395-a247-fddb67f6e548-00002', 'volume_5a775425-df51-44ce-b820-7c6d483d6c42/20260703095326/az_nova_backup_84105c14-606c-4395-a247-fddb67f6e548-00003', 'volume_5a775425-df51-44ce-b820-7c6d483d6c42/20260703095326/az_nova_backup_84105c14-606c-4395-a247-fddb67f6e548-00004', 'volume_5a775425-df51-44ce-b820-7c6d483d6c42/20260703095326/az_nova_backup_84105c14-606c-4395-a247-fddb67f6e548-00005', 'volume_5a775425-df51-44ce-b820-7c6d483d6c42/20260703095326/az_nova_backup_84105c14-606c-4395-a247-fddb67f6e548-00006', 'volume_5a775425-df51-44ce-b820-7c6d483d6c42/20260703095326/az_nova_backup_84105c14-606c-4395-a247-fddb67f6e548-00007', 'volume_5a775425-df51-44ce-b820-7c6d483d6c42/20260703095326/az_nova_backup_84105c14-606c-4395-a247-fddb67f6e548-00008', 'volume_5a775425-df51-44ce-b820-7c6d483d6c42/20260703095326/az_nova_backup_84105c14-606c-4395-a247-fddb67f6e548-00009', 'volume_5a775425-df51-44ce-b820-7c6d483d6c42/20260703095326/az_nova_backup_84105c14-606c-4395-a247-fddb67f6e548-00010', 'volume_5a775425-df51-44ce-b820-7c6d483d6c42/20260703095326/az_nova_backup_84105c14-606c-4395-a247-fddb67f6e548-00011', 'volume_5a775425-df51-44ce-b820-7c6d483d6c42/20260703095326/az_nova_backup_84105c14-606c-4395-a247-fddb67f6e548-00012', 'volume_5a775425-df51-44ce-b820-7c6d483d6c42/20260703095326/az_nova_backup_84105c14-606c-4395-a247-fddb67f6e548-00013', 'volume_5a775425-df51-44ce-b820-7c6d483d6c42/20260703095326/az_nova_backup_84105c14-606c-4395-a247-fddb67f6e548-00014', 'volume_5a775425-df51-44ce-b820-7c6d483d6c42/20260703095326/az_nova_backup_84105c14-606c-4395-a247-fddb67f6e548-00015', 'volume_5a775425-df51-44ce-b820-7c6d483d6c42/20260703095326/az_nova_backup_84105c14-606c-4395-a247-fddb67f6e548-00016', 'volume_5a775425-df51-44ce-b820-7c6d483d6c42/20260703095326/az_nova_backup_84105c14-606c-4395-a247-fddb67f6e548-00017', 'volume_5a775425-df51-44ce-b820-7c6d483d6c42/20260703095326/az_nova_backup_84105c14-606c-4395-a247-fddb67f6e548-00018', 'volume_5a775425-df51-44ce-b820-7c6d483d6c42/20260703095326/az_nova_backup_84105c14-606c-4395-a247-fddb67f6e548-00019', 'volume_5a775425-df51-44ce-b820-7c6d483d6c42/20260703095326/az_nova_backup_84105c14-606c-4395-a247-fddb67f6e548-00020', 'volume_5a775425-df51-44ce-b820-7c6d483d6c42/20260703095326/az_nova_backup_84105c14-606c-4395-a247-fddb67f6e548-00021', 'volume_5a775425-df51-44ce-b820-7c6d483d6c42/20260703095326/az_nova_backup_84105c14-606c-4395-a247-fddb67f6e548_metadata', 'volume_5a775425-df51-44ce-b820-7c6d483d6c42/20260703095326/az_nova_backup_84105c14-606c-4395-a247-fddb67f6e548_sha256file']. {{(pid=101319) _generate_object_names /opt/stack/cinder/cinder/backup/chunkeddriver.py:260}} Jul 03 09:53:41.679827 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-1678b3a2-6ecc-4dce-a535-6e8837304678 tempest-ProjectMemberTests33-2105464604 None] backup MD5 for volume_5f57fed7-aa36-44c5-af90-863bd3d3af9d/20260703095328/az_nova_backup_0871942a-e198-4230-a099-29a52a21849b-00020: 25e317773f308e446cc84c503a6d1f85 {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 09:53:41.679998 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-1678b3a2-6ecc-4dce-a535-6e8837304678 tempest-ProjectMemberTests33-2105464604 None] Calling eventlet.sleep(0) {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 09:53:41.706558 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-a9111138-3213-412c-a50c-183b74db0d68 tempest-VolumesBackupsTest-807180270 None] deleted object: volume_5a775425-df51-44ce-b820-7c6d483d6c42/20260703095326/az_nova_backup_84105c14-606c-4395-a247-fddb67f6e548-00001 in container: volumebackups. {{(pid=101319) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 09:53:41.715895 np0000004400 cinder-backup[101319]: DEBUG oslo_db.sqlalchemy.engines [None req-1678b3a2-6ecc-4dce-a535-6e8837304678 tempest-ProjectMemberTests33-2105464604 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=101319) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 03 09:53:41.726209 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-a9111138-3213-412c-a50c-183b74db0d68 tempest-VolumesBackupsTest-807180270 None] deleted object: volume_5a775425-df51-44ce-b820-7c6d483d6c42/20260703095326/az_nova_backup_84105c14-606c-4395-a247-fddb67f6e548-00002 in container: volumebackups. {{(pid=101319) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 09:53:41.732501 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-0348256d-c334-445a-abfb-8501d08ca9f1 tempest-ProjectReaderTests33-761902925 None] backup MD5 for volume_61c7989b-d6b3-4a39-80a6-9fc519424447/20260703095337/az_nova_backup_3905268c-9301-4198-bac6-c3c450e69ce2-00007: 25e317773f308e446cc84c503a6d1f85 {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 09:53:41.732690 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-0348256d-c334-445a-abfb-8501d08ca9f1 tempest-ProjectReaderTests33-761902925 None] Calling eventlet.sleep(0) {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 09:53:41.748913 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-a9111138-3213-412c-a50c-183b74db0d68 tempest-VolumesBackupsTest-807180270 None] deleted object: volume_5a775425-df51-44ce-b820-7c6d483d6c42/20260703095326/az_nova_backup_84105c14-606c-4395-a247-fddb67f6e548-00003 in container: volumebackups. {{(pid=101319) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 09:53:41.766424 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-a9111138-3213-412c-a50c-183b74db0d68 tempest-VolumesBackupsTest-807180270 None] deleted object: volume_5a775425-df51-44ce-b820-7c6d483d6c42/20260703095326/az_nova_backup_84105c14-606c-4395-a247-fddb67f6e548-00004 in container: volumebackups. {{(pid=101319) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 09:53:41.786297 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-a9111138-3213-412c-a50c-183b74db0d68 tempest-VolumesBackupsTest-807180270 None] deleted object: volume_5a775425-df51-44ce-b820-7c6d483d6c42/20260703095326/az_nova_backup_84105c14-606c-4395-a247-fddb67f6e548-00005 in container: volumebackups. {{(pid=101319) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 09:53:41.807788 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-a9111138-3213-412c-a50c-183b74db0d68 tempest-VolumesBackupsTest-807180270 None] deleted object: volume_5a775425-df51-44ce-b820-7c6d483d6c42/20260703095326/az_nova_backup_84105c14-606c-4395-a247-fddb67f6e548-00006 in container: volumebackups. {{(pid=101319) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 09:53:41.827427 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-a9111138-3213-412c-a50c-183b74db0d68 tempest-VolumesBackupsTest-807180270 None] deleted object: volume_5a775425-df51-44ce-b820-7c6d483d6c42/20260703095326/az_nova_backup_84105c14-606c-4395-a247-fddb67f6e548-00007 in container: volumebackups. {{(pid=101319) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 09:53:41.847727 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-a9111138-3213-412c-a50c-183b74db0d68 tempest-VolumesBackupsTest-807180270 None] deleted object: volume_5a775425-df51-44ce-b820-7c6d483d6c42/20260703095326/az_nova_backup_84105c14-606c-4395-a247-fddb67f6e548-00008 in container: volumebackups. {{(pid=101319) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 09:53:41.861717 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-1678b3a2-6ecc-4dce-a535-6e8837304678 tempest-ProjectMemberTests33-2105464604 None] Backing up chunk of data from volume. {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 09:53:41.867576 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-a9111138-3213-412c-a50c-183b74db0d68 tempest-VolumesBackupsTest-807180270 None] deleted object: volume_5a775425-df51-44ce-b820-7c6d483d6c42/20260703095326/az_nova_backup_84105c14-606c-4395-a247-fddb67f6e548-00009 in container: volumebackups. {{(pid=101319) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 09:53:41.896181 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-a9111138-3213-412c-a50c-183b74db0d68 tempest-VolumesBackupsTest-807180270 None] deleted object: volume_5a775425-df51-44ce-b820-7c6d483d6c42/20260703095326/az_nova_backup_84105c14-606c-4395-a247-fddb67f6e548-00010 in container: volumebackups. {{(pid=101319) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 09:53:41.918100 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-a9111138-3213-412c-a50c-183b74db0d68 tempest-VolumesBackupsTest-807180270 None] deleted object: volume_5a775425-df51-44ce-b820-7c6d483d6c42/20260703095326/az_nova_backup_84105c14-606c-4395-a247-fddb67f6e548-00011 in container: volumebackups. {{(pid=101319) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 09:53:41.939417 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-a9111138-3213-412c-a50c-183b74db0d68 tempest-VolumesBackupsTest-807180270 None] deleted object: volume_5a775425-df51-44ce-b820-7c6d483d6c42/20260703095326/az_nova_backup_84105c14-606c-4395-a247-fddb67f6e548-00012 in container: volumebackups. {{(pid=101319) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 09:53:41.964705 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-a9111138-3213-412c-a50c-183b74db0d68 tempest-VolumesBackupsTest-807180270 None] deleted object: volume_5a775425-df51-44ce-b820-7c6d483d6c42/20260703095326/az_nova_backup_84105c14-606c-4395-a247-fddb67f6e548-00013 in container: volumebackups. {{(pid=101319) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 09:53:41.989512 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-a9111138-3213-412c-a50c-183b74db0d68 tempest-VolumesBackupsTest-807180270 None] deleted object: volume_5a775425-df51-44ce-b820-7c6d483d6c42/20260703095326/az_nova_backup_84105c14-606c-4395-a247-fddb67f6e548-00014 in container: volumebackups. {{(pid=101319) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 09:53:41.991469 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-1678b3a2-6ecc-4dce-a535-6e8837304678 tempest-ProjectMemberTests33-2105464604 None] Compressed 25165824 bytes of data to 24470 bytes using zlib. {{(pid=101319) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 09:53:41.991663 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-1678b3a2-6ecc-4dce-a535-6e8837304678 tempest-ProjectMemberTests33-2105464604 None] About to put_object {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 09:53:41.991947 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-0348256d-c334-445a-abfb-8501d08ca9f1 tempest-ProjectReaderTests33-761902925 None] Backing up chunk of data from volume. {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 09:53:42.013593 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-a9111138-3213-412c-a50c-183b74db0d68 tempest-VolumesBackupsTest-807180270 None] deleted object: volume_5a775425-df51-44ce-b820-7c6d483d6c42/20260703095326/az_nova_backup_84105c14-606c-4395-a247-fddb67f6e548-00015 in container: volumebackups. {{(pid=101319) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 09:53:42.034392 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-a9111138-3213-412c-a50c-183b74db0d68 tempest-VolumesBackupsTest-807180270 None] deleted object: volume_5a775425-df51-44ce-b820-7c6d483d6c42/20260703095326/az_nova_backup_84105c14-606c-4395-a247-fddb67f6e548-00016 in container: volumebackups. {{(pid=101319) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 09:53:42.054752 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-a9111138-3213-412c-a50c-183b74db0d68 tempest-VolumesBackupsTest-807180270 None] deleted object: volume_5a775425-df51-44ce-b820-7c6d483d6c42/20260703095326/az_nova_backup_84105c14-606c-4395-a247-fddb67f6e548-00017 in container: volumebackups. {{(pid=101319) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 09:53:42.057362 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-1678b3a2-6ecc-4dce-a535-6e8837304678 tempest-ProjectMemberTests33-2105464604 None] backup MD5 for volume_5f57fed7-aa36-44c5-af90-863bd3d3af9d/20260703095328/az_nova_backup_0871942a-e198-4230-a099-29a52a21849b-00021: 77377273b0a4b61febdbf7bbf52b9db9 {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 09:53:42.057522 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-1678b3a2-6ecc-4dce-a535-6e8837304678 tempest-ProjectMemberTests33-2105464604 None] Calling eventlet.sleep(0) {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 09:53:42.069729 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.driver [None req-1678b3a2-6ecc-4dce-a535-6e8837304678 tempest-ProjectMemberTests33-2105464604 None] Getting metadata type 'volume-base-metadata' {{(pid=101319) _save_vol_base_meta /opt/stack/cinder/cinder/backup/driver.py:79}} Jul 03 09:53:42.077716 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-a9111138-3213-412c-a50c-183b74db0d68 tempest-VolumesBackupsTest-807180270 None] deleted object: volume_5a775425-df51-44ce-b820-7c6d483d6c42/20260703095326/az_nova_backup_84105c14-606c-4395-a247-fddb67f6e548-00018 in container: volumebackups. {{(pid=101319) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 09:53:42.080279 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.driver [None req-1678b3a2-6ecc-4dce-a535-6e8837304678 tempest-ProjectMemberTests33-2105464604 None] Completed fetching metadata type 'volume-base-metadata' {{(pid=101319) _save_vol_base_meta /opt/stack/cinder/cinder/backup/driver.py:98}} Jul 03 09:53:42.080428 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.driver [None req-1678b3a2-6ecc-4dce-a535-6e8837304678 tempest-ProjectMemberTests33-2105464604 None] Getting metadata type 'volume-metadata' {{(pid=101319) _save_vol_meta /opt/stack/cinder/cinder/backup/driver.py:109}} Jul 03 09:53:42.091358 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.driver [None req-1678b3a2-6ecc-4dce-a535-6e8837304678 tempest-ProjectMemberTests33-2105464604 None] No metadata type 'volume-metadata' available {{(pid=101319) _save_vol_meta /opt/stack/cinder/cinder/backup/driver.py:123}} Jul 03 09:53:42.091358 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.driver [None req-1678b3a2-6ecc-4dce-a535-6e8837304678 tempest-ProjectMemberTests33-2105464604 None] Getting metadata type 'volume-glance-metadata' {{(pid=101319) _save_vol_glance_meta /opt/stack/cinder/cinder/backup/driver.py:132}} Jul 03 09:53:42.094611 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-a9111138-3213-412c-a50c-183b74db0d68 tempest-VolumesBackupsTest-807180270 None] deleted object: volume_5a775425-df51-44ce-b820-7c6d483d6c42/20260703095326/az_nova_backup_84105c14-606c-4395-a247-fddb67f6e548-00019 in container: volumebackups. {{(pid=101319) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 09:53:42.097519 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.driver [None req-1678b3a2-6ecc-4dce-a535-6e8837304678 tempest-ProjectMemberTests33-2105464604 None] No metadata type 'volume-glance-metadata' available {{(pid=101319) _save_vol_glance_meta /opt/stack/cinder/cinder/backup/driver.py:147}} Jul 03 09:53:42.097788 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-1678b3a2-6ecc-4dce-a535-6e8837304678 tempest-ProjectMemberTests33-2105464604 None] _write_sha256file started, container name: volumebackups, sha256file filename: volume_5f57fed7-aa36-44c5-af90-863bd3d3af9d/20260703095328/az_nova_backup_0871942a-e198-4230-a099-29a52a21849b_sha256file. {{(pid=101319) _write_sha256file /opt/stack/cinder/cinder/backup/chunkeddriver.py:299}} Jul 03 09:53:42.133853 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-a9111138-3213-412c-a50c-183b74db0d68 tempest-VolumesBackupsTest-807180270 None] deleted object: volume_5a775425-df51-44ce-b820-7c6d483d6c42/20260703095326/az_nova_backup_84105c14-606c-4395-a247-fddb67f6e548-00020 in container: volumebackups. {{(pid=101319) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 09:53:42.153704 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-a9111138-3213-412c-a50c-183b74db0d68 tempest-VolumesBackupsTest-807180270 None] deleted object: volume_5a775425-df51-44ce-b820-7c6d483d6c42/20260703095326/az_nova_backup_84105c14-606c-4395-a247-fddb67f6e548-00021 in container: volumebackups. {{(pid=101319) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 09:53:42.160733 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-1678b3a2-6ecc-4dce-a535-6e8837304678 tempest-ProjectMemberTests33-2105464604 None] _write_sha256file finished. {{(pid=101319) _write_sha256file /opt/stack/cinder/cinder/backup/chunkeddriver.py:315}} Jul 03 09:53:42.161303 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-1678b3a2-6ecc-4dce-a535-6e8837304678 tempest-ProjectMemberTests33-2105464604 None] _write_metadata started, container name: volumebackups, metadata filename: volume_5f57fed7-aa36-44c5-af90-863bd3d3af9d/20260703095328/az_nova_backup_0871942a-e198-4230-a099-29a52a21849b_metadata. {{(pid=101319) _write_metadata /opt/stack/cinder/cinder/backup/chunkeddriver.py:276}} Jul 03 09:53:42.172399 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-a9111138-3213-412c-a50c-183b74db0d68 tempest-VolumesBackupsTest-807180270 None] deleted object: volume_5a775425-df51-44ce-b820-7c6d483d6c42/20260703095326/az_nova_backup_84105c14-606c-4395-a247-fddb67f6e548_metadata in container: volumebackups. {{(pid=101319) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 09:53:42.184455 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-1678b3a2-6ecc-4dce-a535-6e8837304678 tempest-ProjectMemberTests33-2105464604 None] _write_metadata finished. Metadata: b'{\n "backup_description": null,\n "backup_id": "0871942a-e198-4230-a099-29a52a21849b",\n "backup_name": "tempest-type-Backup-859092992",\n "created_at": "2026-07-03 09:53:23+00:00",\n "objects": [\n {\n "volume_5f57fed7-aa36-44c5-af90-863bd3d3af9d/20260703095328/az_nova_backup_0871942a-e198-4230-a099-29a52a21849b-00001": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 0\n }\n },\n {\n "volume_5f57fed7-aa36-44c5-af90-863bd3d3af9d/20260703095328/az_nova_backup_0871942a-e198-4230-a099-29a52a21849b-00002": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 52428800\n }\n },\n {\n "volume_5f57fed7-aa36-44c5-af90-863bd3d3af9d/20260703095328/az_nova_backup_0871942a-e198-4230-a099-29a52a21849b-00003": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 104857600\n }\n },\n {\n "volume_5f57fed7-aa36-44c5-af90-863bd3d3af9d/20260703095328/az_nova_backup_0871942a-e198-4230-a099-29a52a21849b-00004": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 157286400\n }\n },\n {\n "volume_5f57fed7-aa36-44c5-af90-863bd3d3af9d/20260703095328/az_nova_backup_0871942a-e198-4230-a099-29a52a21849b-00005": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 209715200\n }\n },\n {\n "volume_5f57fed7-aa36-44c5-af90-863bd3d3af9d/20260703095328/az_nova_backup_0871942a-e198-4230-a099-29a52a21849b-00006": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 262144000\n }\n },\n {\n "volume_5f57fed7-aa36-44c5-af90-863bd3d3af9d/20260703095328/az_nova_backup_0871942a-e198-4230-a099-29a52a21849b-00007": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 314572800\n }\n },\n {\n "volume_5f57fed7-aa36-44c5-af90-863bd3d3af9d/20260703095328/az_nova_backup_0871942a-e198-4230-a099-29a52a21849b-00008": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 367001600\n }\n },\n {\n "volume_5f57fed7-aa36-44c5-af90-863bd3d3af9d/20260703095328/az_nova_backup_0871942a-e198-4230-a099-29a52a21849b-00009": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 419430400\n }\n },\n {\n "volume_5f57fed7-aa36-44c5-af90-863bd3d3af9d/20260703095328/az_nova_backup_0871942a-e198-4230-a099-29a52a21849b-00010": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 471859200\n }\n },\n {\n "volume_5f57fed7-aa36-44c5-af90-863bd3d3af9d/20260703095328/az_nova_backup_0871942a-e198-4230-a099-29a52a21849b-00011": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 524288000\n }\n },\n {\n "volume_5f57fed7-aa36-44c5-af90-863bd3d3af9d/20260703095328/az_nova_backup_0871942a-e198-4230-a099-29a52a21849b-00012": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 576716800\n }\n },\n {\n "volume_5f57fed7-aa36-44c5-af90-863bd3d3af9d/20260703095328/az_nova_backup_0871942a-e198-4230-a099-29a52a21849b-00013": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 629145600\n }\n },\n {\n "volume_5f57fed7-aa36-44c5-af90-863bd3d3af9d/20260703095328/az_nova_backup_0871942a-e198-4230-a099-29a52a21849b-00014": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 681574400\n }\n },\n {\n "volume_5f57fed7-aa36-44c5-af90-863bd3d3af9d/20260703095328/az_nova_backup_0871942a-e198-4230-a099-29a52a21849b-00015": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 734003200\n }\n },\n {\n "volume_5f57fed7-aa36-44c5-af90-863bd3d3af9d/20260703095328/az_nova_backup_0871942a-e198-4230-a099-29a52a21849b-00016": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 786432000\n }\n },\n {\n "volume_5f57fed7-aa36-44c5-af90-863bd3d3af9d/20260703095328/az_nova_backup_0871942a-e198-4230-a099-29a52a21849b-00017": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 838860800\n }\n },\n {\n "volume_5f57fed7-aa36-44c5-af90-863bd3d3af9d/20260703095328/az_nova_backup_0871942a-e198-4230-a099-29a52a21849b-00018": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 891289600\n }\n },\n {\n "volume_5f57fed7-aa36-44c5-af90-863bd3d3af9d/20260703095328/az_nova_backup_0871942a-e198-4230-a099-29a52a21849b-00019": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 943718400\n }\n },\n {\n "volume_5f57fed7-aa36-44c5-af90-863bd3d3af9d/20260703095328/az_nova_backup_0871942a-e198-4230-a099-29a52a21849b-00020": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 996147200\n }\n },\n {\n "volume_5f57fed7-aa36-44c5-af90-863bd3d3af9d/20260703095328/az_nova_backup_0871942a-e198-4230-a099-29a52a21849b-00021": {\n "compression": "zlib",\n "length": 25165824,\n "md5": "77377273b0a4b61febdbf7bbf52b9db9",\n "offset": 1048576000\n }\n }\n ],\n "parent_id": null,\n "version": "1.0.0",\n "volume_id": "5f57fed7-aa36-44c5-af90-863bd3d3af9d",\n "volume_meta": "{\\"version\\": 2, \\"volume-base-metadata\\": {\\"id\\": \\"5f57fed7-aa36-44c5-af90-863bd3d3af9d\\", \\"_name_id\\": null, \\"use_quota\\": true, \\"ec2_id\\": null, \\"user_id\\": \\"87abbb474f8a4baf840fcfdf286ff94e\\", \\"project_id\\": \\"e0b6e59b911e40b3acac38afb1f81e3a\\", \\"snapshot_id\\": null, \\"cluster_name\\": null, \\"host\\": \\"np0000004400@storpool#default\\", \\"size\\": 1, \\"availability_zone\\": \\"nova\\", \\"status\\": \\"backing-up\\", \\"attach_status\\": \\"detached\\", \\"migration_status\\": null, \\"scheduled_at\\": \\"2026-07-03T09:53:22.000000\\", \\"launched_at\\": \\"2026-07-03T09:53:22.000000\\", \\"terminated_at\\": null, \\"display_name\\": \\"tempest-VolumeV3RbacBaseTests-Volume-1340187584\\", \\"display_description\\": null, \\"provider_location\\": null, \\"provider_auth\\": null, \\"provider_geometry\\": null, \\"provider_id\\": null, \\"volume_type_id\\": \\"03e13fe6-0e30-4803-ace0-725d38e6dc24\\", \\"source_volid\\": null, \\"encryption_key_id\\": null, \\"consistencygroup_id\\": null, \\"group_id\\": null, \\"bootable\\": false, \\"multiattach\\": false, \\"replication_status\\": null, \\"replication_extended_status\\": null, \\"replication_driver_data\\": null, \\"previous_status\\": \\"available\\", \\"service_uuid\\": \\"6d4b0e79-fefe-4744-b25f-34be05095200\\", \\"shared_targets\\": true, \\"deleted_at\\": null, \\"deleted\\": false, \\"created_at\\": \\"2026-07-03T09:53:22.000000\\", \\"updated_at\\": \\"2026-07-03T09:53:23.000000\\"}}"\n}'. {{(pid=101319) _write_metadata /opt/stack/cinder/cinder/backup/chunkeddriver.py:295}} Jul 03 09:53:42.191721 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-a9111138-3213-412c-a50c-183b74db0d68 tempest-VolumesBackupsTest-807180270 None] deleted object: volume_5a775425-df51-44ce-b820-7c6d483d6c42/20260703095326/az_nova_backup_84105c14-606c-4395-a247-fddb67f6e548_sha256file in container: volumebackups. {{(pid=101319) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 09:53:42.191894 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-a9111138-3213-412c-a50c-183b74db0d68 tempest-VolumesBackupsTest-807180270 None] delete 84105c14-606c-4395-a247-fddb67f6e548 finished. {{(pid=101319) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:848}} Jul 03 09:53:42.220716 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-1678b3a2-6ecc-4dce-a535-6e8837304678 tempest-ProjectMemberTests33-2105464604 None] backup 0871942a-e198-4230-a099-29a52a21849b finished. {{(pid=101319) _finalize_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:462}} Jul 03 09:53:42.341805 np0000004400 cinder-backup[101319]: DEBUG oslo_concurrency.processutils [None req-1678b3a2-6ecc-4dce-a535-6e8837304678 tempest-ProjectMemberTests33-2105464604 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chown 0 /dev/sdh {{(pid=101319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 09:53:42.351003 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-0348256d-c334-445a-abfb-8501d08ca9f1 tempest-ProjectReaderTests33-761902925 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101319) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 09:53:42.351003 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-0348256d-c334-445a-abfb-8501d08ca9f1 tempest-ProjectReaderTests33-761902925 None] About to put_object {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 09:53:42.364230 np0000004400 sudo[155063]: stack : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chown 0 /dev/sdh Jul 03 09:53:42.365043 np0000004400 sudo[155063]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1002) Jul 03 09:53:42.373988 np0000004400 cinder-backup[101319]: DEBUG cinder.quota [None req-a9111138-3213-412c-a50c-183b74db0d68 tempest-VolumesBackupsTest-807180270 None] Created reservations ['60b18533-1eb4-4ca1-bf47-028346dd791a', 'd9ad4902-70ab-46d1-8350-ed40d6bcb61f'] {{(pid=101319) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 09:53:42.391753 np0000004400 cinder-backup[101319]: INFO cinder.backup.manager [None req-a9111138-3213-412c-a50c-183b74db0d68 tempest-VolumesBackupsTest-807180270 None] Delete backup finished, backup 84105c14-606c-4395-a247-fddb67f6e548 deleted. Jul 03 09:53:42.460077 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-0348256d-c334-445a-abfb-8501d08ca9f1 tempest-ProjectReaderTests33-761902925 None] backup MD5 for volume_61c7989b-d6b3-4a39-80a6-9fc519424447/20260703095337/az_nova_backup_3905268c-9301-4198-bac6-c3c450e69ce2-00008: 25e317773f308e446cc84c503a6d1f85 {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 09:53:42.460245 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-0348256d-c334-445a-abfb-8501d08ca9f1 tempest-ProjectReaderTests33-761902925 None] Calling eventlet.sleep(0) {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 09:53:42.656931 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-0348256d-c334-445a-abfb-8501d08ca9f1 tempest-ProjectReaderTests33-761902925 None] Backing up chunk of data from volume. {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 09:53:42.780277 np0000004400 sudo[155063]: pam_unix(sudo:session): session closed for user root Jul 03 09:53:42.783518 np0000004400 cinder-backup[101319]: DEBUG oslo_concurrency.processutils [None req-1678b3a2-6ecc-4dce-a535-6e8837304678 tempest-ProjectMemberTests33-2105464604 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chown 0 /dev/sdh" returned: 0 in 0.440s {{(pid=101319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 09:53:42.783518 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-1678b3a2-6ecc-4dce-a535-6e8837304678 tempest-ProjectMemberTests33-2105464604 None] ==> disconnect_volume: call "{'args': (, {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-5f57fed7-aa36-44c5-af90-863bd3d3af9d', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '5f57fed7-aa36-44c5-af90-863bd3d3af9d', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': False}, {'type': 'block', 'scsi_wwn': '330000000b7bd94a0', 'path': '/dev/sdh'}), 'kwargs': {'force': True, 'ignore_errors': True}}" {{(pid=101319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}} Jul 03 09:53:42.783518 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.base [None req-1678b3a2-6ecc-4dce-a535-6e8837304678 tempest-ProjectMemberTests33-2105464604 None] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=101319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jul 03 09:53:42.783518 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.base [None req-1678b3a2-6ecc-4dce-a535-6e8837304678 tempest-ProjectMemberTests33-2105464604 None] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.000s {{(pid=101319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jul 03 09:53:42.783518 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-1678b3a2-6ecc-4dce-a535-6e8837304678 tempest-ProjectMemberTests33-2105464604 None] _get_connection_devices called with parameters: connection_properties={'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-5f57fed7-aa36-44c5-af90-863bd3d3af9d', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '5f57fed7-aa36-44c5-af90-863bd3d3af9d', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': False}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=101319) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:847}} Jul 03 09:53:42.800109 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-1678b3a2-6ecc-4dce-a535-6e8837304678 tempest-ProjectMemberTests33-2105464604 None] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS: Jul 03 09:53:42.800109 np0000004400 cinder-backup[101319]: No targets found. Jul 03 09:53:42.800109 np0000004400 cinder-backup[101319]: iSNS: Jul 03 09:53:42.800109 np0000004400 cinder-backup[101319]: No targets found. Jul 03 09:53:42.800109 np0000004400 cinder-backup[101319]: STATIC: Jul 03 09:53:42.800109 np0000004400 cinder-backup[101319]: Target: iqn.2023-03.storpool.com:os--volume-87fba7de-22c7-4769-ad28-2ca1aa2a1458 Jul 03 09:53:42.800109 np0000004400 cinder-backup[101319]: Portal: 192.168.50.100:3260,-1 Jul 03 09:53:42.800109 np0000004400 cinder-backup[101319]: Iface Name: default Jul 03 09:53:42.800109 np0000004400 cinder-backup[101319]: Portal: 192.168.40.100:3260,-1 Jul 03 09:53:42.800109 np0000004400 cinder-backup[101319]: Iface Name: default Jul 03 09:53:42.800109 np0000004400 cinder-backup[101319]: Target: iqn.2023-03.storpool.com:os--volume-491c39b6-d2e0-4f67-9a64-590d50f06197 Jul 03 09:53:42.800109 np0000004400 cinder-backup[101319]: Portal: 192.168.50.100:3260,-1 Jul 03 09:53:42.800109 np0000004400 cinder-backup[101319]: Iface Name: default Jul 03 09:53:42.800109 np0000004400 cinder-backup[101319]: Portal: 192.168.40.100:3260,-1 Jul 03 09:53:42.800109 np0000004400 cinder-backup[101319]: Iface Name: default Jul 03 09:53:42.800109 np0000004400 cinder-backup[101319]: Target: iqn.2023-03.storpool.com:os--volume-5f57fed7-aa36-44c5-af90-863bd3d3af9d Jul 03 09:53:42.800109 np0000004400 cinder-backup[101319]: Portal: 192.168.40.100:3260,-1 Jul 03 09:53:42.800109 np0000004400 cinder-backup[101319]: Iface Name: default Jul 03 09:53:42.800109 np0000004400 cinder-backup[101319]: Target: iqn.2023-03.storpool.com:os--volume-61c7989b-d6b3-4a39-80a6-9fc519424447 Jul 03 09:53:42.800109 np0000004400 cinder-backup[101319]: Portal: 192.168.40.100:3260,-1 Jul 03 09:53:42.800109 np0000004400 cinder-backup[101319]: Iface Name: default Jul 03 09:53:42.800109 np0000004400 cinder-backup[101319]: Target: iqn.2023-03.storpool.com:os--volume-79c374d0-f293-429e-9f7e-a6ac9afa4c99 Jul 03 09:53:42.800109 np0000004400 cinder-backup[101319]: Portal: 192.168.50.100:3260,-1 Jul 03 09:53:42.800109 np0000004400 cinder-backup[101319]: Iface Name: default Jul 03 09:53:42.800109 np0000004400 cinder-backup[101319]: Portal: 192.168.40.100:3260,-1 Jul 03 09:53:42.800109 np0000004400 cinder-backup[101319]: Iface Name: default Jul 03 09:53:42.800109 np0000004400 cinder-backup[101319]: FIRMWARE: Jul 03 09:53:42.800109 np0000004400 cinder-backup[101319]: No targets found. Jul 03 09:53:42.800109 np0000004400 cinder-backup[101319]: stderr= {{(pid=101319) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jul 03 09:53:42.800998 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-1678b3a2-6ecc-4dce-a535-6e8837304678 tempest-ProjectMemberTests33-2105464604 None] Regex to get portals from discoverydb: ^SENDTARGETS: Jul 03 09:53:42.800998 np0000004400 cinder-backup[101319]: .*?^DiscoveryAddress: 192.168.40.100,3260.*? Jul 03 09:53:42.800998 np0000004400 cinder-backup[101319]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=101319) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:390}} Jul 03 09:53:42.800998 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-1678b3a2-6ecc-4dce-a535-6e8837304678 tempest-ProjectMemberTests33-2105464604 None] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-5f57fed7-aa36-44c5-af90-863bd3d3af9d', 0)] {{(pid=101319) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:858}} Jul 03 09:53:42.827784 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-1678b3a2-6ecc-4dce-a535-6e8837304678 tempest-ProjectMemberTests33-2105464604 None] iscsiadm ('-m', 'session'): stdout=tcp: [188] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-491c39b6-d2e0-4f67-9a64-590d50f06197 (non-flash) Jul 03 09:53:42.827784 np0000004400 cinder-backup[101319]: tcp: [189] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-491c39b6-d2e0-4f67-9a64-590d50f06197 (non-flash) Jul 03 09:53:42.827784 np0000004400 cinder-backup[101319]: tcp: [197] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-87fba7de-22c7-4769-ad28-2ca1aa2a1458 (non-flash) Jul 03 09:53:42.827784 np0000004400 cinder-backup[101319]: tcp: [198] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-87fba7de-22c7-4769-ad28-2ca1aa2a1458 (non-flash) Jul 03 09:53:42.827784 np0000004400 cinder-backup[101319]: tcp: [200] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5f57fed7-aa36-44c5-af90-863bd3d3af9d (non-flash) Jul 03 09:53:42.827784 np0000004400 cinder-backup[101319]: tcp: [203] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-79c374d0-f293-429e-9f7e-a6ac9afa4c99 (non-flash) Jul 03 09:53:42.827784 np0000004400 cinder-backup[101319]: tcp: [204] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-79c374d0-f293-429e-9f7e-a6ac9afa4c99 (non-flash) Jul 03 09:53:42.827784 np0000004400 cinder-backup[101319]: tcp: [205] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-61c7989b-d6b3-4a39-80a6-9fc519424447 (non-flash) Jul 03 09:53:42.827784 np0000004400 cinder-backup[101319]: stderr= {{(pid=101319) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jul 03 09:53:42.827784 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-1678b3a2-6ecc-4dce-a535-6e8837304678 tempest-ProjectMemberTests33-2105464604 None] iscsi session list stdout=tcp: [188] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-491c39b6-d2e0-4f67-9a64-590d50f06197 (non-flash) Jul 03 09:53:42.827784 np0000004400 cinder-backup[101319]: tcp: [189] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-491c39b6-d2e0-4f67-9a64-590d50f06197 (non-flash) Jul 03 09:53:42.827784 np0000004400 cinder-backup[101319]: tcp: [197] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-87fba7de-22c7-4769-ad28-2ca1aa2a1458 (non-flash) Jul 03 09:53:42.827784 np0000004400 cinder-backup[101319]: tcp: [198] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-87fba7de-22c7-4769-ad28-2ca1aa2a1458 (non-flash) Jul 03 09:53:42.827784 np0000004400 cinder-backup[101319]: tcp: [200] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5f57fed7-aa36-44c5-af90-863bd3d3af9d (non-flash) Jul 03 09:53:42.827784 np0000004400 cinder-backup[101319]: tcp: [203] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-79c374d0-f293-429e-9f7e-a6ac9afa4c99 (non-flash) Jul 03 09:53:42.827784 np0000004400 cinder-backup[101319]: tcp: [204] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-79c374d0-f293-429e-9f7e-a6ac9afa4c99 (non-flash) Jul 03 09:53:42.827784 np0000004400 cinder-backup[101319]: tcp: [205] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-61c7989b-d6b3-4a39-80a6-9fc519424447 (non-flash) Jul 03 09:53:42.827784 np0000004400 cinder-backup[101319]: stderr= {{(pid=101319) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jul 03 09:53:42.828495 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-1678b3a2-6ecc-4dce-a535-6e8837304678 tempest-ProjectMemberTests33-2105464604 None] Sessions list: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-491c39b6-d2e0-4f67-9a64-590d50f06197', '188'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-491c39b6-d2e0-4f67-9a64-590d50f06197', '189'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-87fba7de-22c7-4769-ad28-2ca1aa2a1458', '197'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-87fba7de-22c7-4769-ad28-2ca1aa2a1458', '198'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-5f57fed7-aa36-44c5-af90-863bd3d3af9d', '200'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-79c374d0-f293-429e-9f7e-a6ac9afa4c99', '203'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-79c374d0-f293-429e-9f7e-a6ac9afa4c99', '204'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-61c7989b-d6b3-4a39-80a6-9fc519424447', '205')] {{(pid=101319) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:866}} Jul 03 09:53:42.828495 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-1678b3a2-6ecc-4dce-a535-6e8837304678 tempest-ProjectMemberTests33-2105464604 None] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-5f57fed7-aa36-44c5-af90-863bd3d3af9d, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-5f57fed7-aa36-44c5-af90-863bd3d3af9d', '200')] {{(pid=101319) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}} Jul 03 09:53:42.829928 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-1678b3a2-6ecc-4dce-a535-6e8837304678 tempest-ProjectMemberTests33-2105464604 None] Resulting device map defaultdict(. at 0x7e76e6da1620>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-5f57fed7-aa36-44c5-af90-863bd3d3af9d'): ({'sdh'}, set())}) {{(pid=101319) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:912}} Jul 03 09:53:42.829928 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.linuxscsi [None req-1678b3a2-6ecc-4dce-a535-6e8837304678 tempest-ProjectMemberTests33-2105464604 None] Removing single pathed devices sdh {{(pid=101319) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}} Jul 03 09:53:42.841561 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.linuxscsi [None req-1678b3a2-6ecc-4dce-a535-6e8837304678 tempest-ProjectMemberTests33-2105464604 None] Flushing IO for device /dev/sdh {{(pid=101319) flush_device_io /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:461}} Jul 03 09:53:42.850084 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.linuxscsi [None req-1678b3a2-6ecc-4dce-a535-6e8837304678 tempest-ProjectMemberTests33-2105464604 None] Remove SCSI device /dev/sdh with /sys/block/sdh/device/delete {{(pid=101319) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}} Jul 03 09:53:42.907732 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.linuxscsi [None req-1678b3a2-6ecc-4dce-a535-6e8837304678 tempest-ProjectMemberTests33-2105464604 None] Checking to see if SCSI volumes sdh have been removed. {{(pid=101319) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}} Jul 03 09:53:42.907892 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.linuxscsi [None req-1678b3a2-6ecc-4dce-a535-6e8837304678 tempest-ProjectMemberTests33-2105464604 None] SCSI volumes sdh have been removed. {{(pid=101319) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}} Jul 03 09:53:42.909042 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.linuxscsi [None req-1678b3a2-6ecc-4dce-a535-6e8837304678 tempest-ProjectMemberTests33-2105464604 None] Checking to see if device paths {'sdh'} are still under multipathd monitoring {{(pid=101319) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}} Jul 03 09:53:42.910255 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-0348256d-c334-445a-abfb-8501d08ca9f1 tempest-ProjectReaderTests33-761902925 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101319) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 09:53:42.910384 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-0348256d-c334-445a-abfb-8501d08ca9f1 tempest-ProjectReaderTests33-761902925 None] About to put_object {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 09:53:42.920694 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.linuxscsi [None req-1678b3a2-6ecc-4dce-a535-6e8837304678 tempest-ProjectMemberTests33-2105464604 None] Device paths {'sdh'} have been removed from multipathd monitoring. {{(pid=101319) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}} Jul 03 09:53:42.920912 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-1678b3a2-6ecc-4dce-a535-6e8837304678 tempest-ProjectMemberTests33-2105464604 None] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-5f57fed7-aa36-44c5-af90-863bd3d3af9d')] {{(pid=101319) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1225}} Jul 03 09:53:42.931514 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-1678b3a2-6ecc-4dce-a535-6e8837304678 tempest-ProjectMemberTests33-2105464604 None] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=101319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 03 09:53:42.966347 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-1678b3a2-6ecc-4dce-a535-6e8837304678 tempest-ProjectMemberTests33-2105464604 None] iscsiadm ('--logout',): stdout=Logging out of session [sid: 200, target: iqn.2023-03.storpool.com:os--volume-5f57fed7-aa36-44c5-af90-863bd3d3af9d, portal: 192.168.40.100,3260] Jul 03 09:53:42.966347 np0000004400 cinder-backup[101319]: Logout of [sid: 200, target: iqn.2023-03.storpool.com:os--volume-5f57fed7-aa36-44c5-af90-863bd3d3af9d, portal: 192.168.40.100,3260] successful. Jul 03 09:53:42.966347 np0000004400 cinder-backup[101319]: stderr= {{(pid=101319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 03 09:53:42.980688 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-1678b3a2-6ecc-4dce-a535-6e8837304678 tempest-ProjectMemberTests33-2105464604 None] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=101319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 03 09:53:42.980984 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.base [None req-1678b3a2-6ecc-4dce-a535-6e8837304678 tempest-ProjectMemberTests33-2105464604 None] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.198s {{(pid=101319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jul 03 09:53:42.981145 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-1678b3a2-6ecc-4dce-a535-6e8837304678 tempest-ProjectMemberTests33-2105464604 None] <== disconnect_volume: return (198ms) None {{(pid=101319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}} Jul 03 09:53:43.010172 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-0348256d-c334-445a-abfb-8501d08ca9f1 tempest-ProjectReaderTests33-761902925 None] backup MD5 for volume_61c7989b-d6b3-4a39-80a6-9fc519424447/20260703095337/az_nova_backup_3905268c-9301-4198-bac6-c3c450e69ce2-00009: 25e317773f308e446cc84c503a6d1f85 {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 09:53:43.010318 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-0348256d-c334-445a-abfb-8501d08ca9f1 tempest-ProjectReaderTests33-761902925 None] Calling eventlet.sleep(0) {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 09:53:43.178989 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-0348256d-c334-445a-abfb-8501d08ca9f1 tempest-ProjectReaderTests33-761902925 None] Backing up chunk of data from volume. {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 09:53:43.421288 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-0348256d-c334-445a-abfb-8501d08ca9f1 tempest-ProjectReaderTests33-761902925 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101319) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 09:53:43.421483 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-0348256d-c334-445a-abfb-8501d08ca9f1 tempest-ProjectReaderTests33-761902925 None] About to put_object {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 09:53:43.518886 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-0348256d-c334-445a-abfb-8501d08ca9f1 tempest-ProjectReaderTests33-761902925 None] backup MD5 for volume_61c7989b-d6b3-4a39-80a6-9fc519424447/20260703095337/az_nova_backup_3905268c-9301-4198-bac6-c3c450e69ce2-00010: 25e317773f308e446cc84c503a6d1f85 {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 09:53:43.519016 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-0348256d-c334-445a-abfb-8501d08ca9f1 tempest-ProjectReaderTests33-761902925 None] Calling eventlet.sleep(0) {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 09:53:43.696617 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-0348256d-c334-445a-abfb-8501d08ca9f1 tempest-ProjectReaderTests33-761902925 None] Backing up chunk of data from volume. {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 09:53:43.937683 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-0348256d-c334-445a-abfb-8501d08ca9f1 tempest-ProjectReaderTests33-761902925 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101319) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 09:53:43.938103 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-0348256d-c334-445a-abfb-8501d08ca9f1 tempest-ProjectReaderTests33-761902925 None] About to put_object {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 09:53:43.964625 np0000004400 cinder-backup[101319]: INFO cinder.backup.manager [None req-e785f663-f83e-414e-8ac2-4ca69114ccec tempest-VolumesBackupsTest-807180270 None] Create backup started, backup: c52fbc4a-f7d8-49e2-bd92-5bbf2f7f98ba volume: b578d41f-4c6a-49b3-b5ec-bcd6556e2e68. Jul 03 09:53:43.972288 np0000004400 cinder-backup[101319]: INFO cinder.backup.manager [None req-e785f663-f83e-414e-8ac2-4ca69114ccec tempest-VolumesBackupsTest-807180270 None] Call Volume Manager to get_backup_device for Backup(availability_zone='nova',container=None,created_at=2026-07-03T09:53:43Z,data_timestamp=2026-07-03T09:53:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesBackupsTest-Backup-550290701',encryption_key_id=None,fail_reason=None,host='np0000004400',id=c52fbc4a-f7d8-49e2-bd92-5bbf2f7f98ba,metadata={},num_dependent_backups=0,object_count=0,parent=None,parent_id=None,project_id='298e794341b64951b3fb757bfbffa698',restore_volume_id=None,service='cinder.backup.drivers.swift.SwiftBackupDriver',service_metadata=None,size=1,snapshot_id=None,status='creating',temp_snapshot_id=None,temp_volume_id=None,updated_at=None,user_id='64183001da094a09a87a9669ab4f899d',volume_id=b578d41f-4c6a-49b3-b5ec-bcd6556e2e68) Jul 03 09:53:43.995882 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.drivers.swift [None req-e785f663-f83e-414e-8ac2-4ca69114ccec tempest-VolumesBackupsTest-807180270 None] Using swift URL https://10.4.3.95:8080/v1/AUTH_298e794341b64951b3fb757bfbffa698 {{(pid=101319) initialize /opt/stack/cinder/cinder/backup/drivers/swift.py:300}} Jul 03 09:53:43.998429 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.drivers.swift [None req-e785f663-f83e-414e-8ac2-4ca69114ccec tempest-VolumesBackupsTest-807180270 None] Connect to https://10.4.3.95:8080/v1/AUTH_ in "per_user" mode {{(pid=101319) initialize /opt/stack/cinder/cinder/backup/drivers/swift.py:301}} Jul 03 09:53:43.998429 np0000004400 cinder-backup[101319]: DEBUG os_brick.utils [None req-e785f663-f83e-414e-8ac2-4ca69114ccec tempest-VolumesBackupsTest-807180270 None] ==> get_connector_properties: call "{'root_helper': 'sudo cinder-rootwrap /etc/cinder/rootwrap.conf', 'my_ip': '10.4.3.95', 'multipath': False, 'enforce_multipath': False, 'host': None, 'execute': None}" {{(pid=101319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}} Jul 03 09:53:44.026642 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.scaleio [None req-e785f663-f83e-414e-8ac2-4ca69114ccec tempest-VolumesBackupsTest-807180270 None] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=101319) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}} Jul 03 09:53:44.029163 np0000004400 cinder-backup[101319]: DEBUG oslo_db.sqlalchemy.engines [None req-1678b3a2-6ecc-4dce-a535-6e8837304678 tempest-ProjectMemberTests33-2105464604 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=101319) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 03 09:53:44.039948 np0000004400 cinder-backup[101319]: INFO cinder.backup.manager [None req-1678b3a2-6ecc-4dce-a535-6e8837304678 tempest-ProjectMemberTests33-2105464604 None] Create backup finished. backup: 0871942a-e198-4230-a099-29a52a21849b. Jul 03 09:53:44.045723 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-0348256d-c334-445a-abfb-8501d08ca9f1 tempest-ProjectReaderTests33-761902925 None] backup MD5 for volume_61c7989b-d6b3-4a39-80a6-9fc519424447/20260703095337/az_nova_backup_3905268c-9301-4198-bac6-c3c450e69ce2-00011: 25e317773f308e446cc84c503a6d1f85 {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 09:53:44.045943 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-0348256d-c334-445a-abfb-8501d08ca9f1 tempest-ProjectReaderTests33-761902925 None] Calling eventlet.sleep(0) {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 09:53:44.047614 np0000004400 cinder-backup[101319]: DEBUG oslo_concurrency.processutils [None req-e785f663-f83e-414e-8ac2-4ca69114ccec tempest-VolumesBackupsTest-807180270 None] Running cmd (subprocess): nvme version {{(pid=101319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 09:53:44.083979 np0000004400 cinder-backup[101319]: DEBUG oslo_concurrency.processutils [None req-e785f663-f83e-414e-8ac2-4ca69114ccec tempest-VolumesBackupsTest-807180270 None] 'nvme version' failed. Not Retrying. {{(pid=101319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 03 09:53:44.084314 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.nvmeof [None req-e785f663-f83e-414e-8ac2-4ca69114ccec tempest-VolumesBackupsTest-807180270 None] nvme not present on system {{(pid=101319) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}} Jul 03 09:53:44.107942 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.lightos [None req-e785f663-f83e-414e-8ac2-4ca69114ccec tempest-VolumesBackupsTest-807180270 None] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=101319) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}} Jul 03 09:53:44.108839 np0000004400 cinder-backup[101319]: INFO os_brick.initiator.connectors.lightos [None req-e785f663-f83e-414e-8ac2-4ca69114ccec tempest-VolumesBackupsTest-807180270 None] Current host hostNQN and IP(s) are ['10.4.3.95', 'fe80::f816:3eff:fe47:268c', '192.168.40.6', 'fe80::f816:3eff:febf:7be2', '192.168.50.6', 'fe80::f816:3eff:fe99:8914', '192.168.10.6', 'fe80::f816:3eff:fe2f:e696', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::bc9d:84ff:fec2:6b49', 'fe80::fc16:3eff:feaa:206b', 'fe80::74a1:e1ff:fe2f:1924'] Jul 03 09:53:44.109077 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.lightos [None req-e785f663-f83e-414e-8ac2-4ca69114ccec tempest-VolumesBackupsTest-807180270 None] LIGHTOS: did not find dsc, continuing anyway. {{(pid=101319) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}} Jul 03 09:53:44.109312 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.lightos [None req-e785f663-f83e-414e-8ac2-4ca69114ccec tempest-VolumesBackupsTest-807180270 None] LIGHTOS: no hostnqn found. {{(pid=101319) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}} Jul 03 09:53:44.109652 np0000004400 cinder-backup[101319]: DEBUG os_brick.utils [None req-e785f663-f83e-414e-8ac2-4ca69114ccec tempest-VolumesBackupsTest-807180270 None] <== get_connector_properties: return (112ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.95', 'host': 'np0000004400', 'multipath': False, 'enforce_multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:ae7e5bb0ebe6', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': '6b284368-d0ba-4d18-af6f-4998d3955c52', 'nvme_native_multipath': False} {{(pid=101319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}} Jul 03 09:53:44.258834 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-0348256d-c334-445a-abfb-8501d08ca9f1 tempest-ProjectReaderTests33-761902925 None] Backing up chunk of data from volume. {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 09:53:44.506126 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-0348256d-c334-445a-abfb-8501d08ca9f1 tempest-ProjectReaderTests33-761902925 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101319) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 09:53:44.506126 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-0348256d-c334-445a-abfb-8501d08ca9f1 tempest-ProjectReaderTests33-761902925 None] About to put_object {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 09:53:44.573067 np0000004400 cinder-backup[101319]: INFO cinder.backup.manager [None req-0c8f0b9c-3469-46f6-ba0e-fba74e3be6db tempest-ProjectMemberTests33-2105464604 None] Create backup started, backup: 885775bd-f91a-424f-bc10-7913c6a90400 volume: 5f57fed7-aa36-44c5-af90-863bd3d3af9d. Jul 03 09:53:44.578401 np0000004400 cinder-backup[101319]: INFO cinder.backup.manager [None req-0c8f0b9c-3469-46f6-ba0e-fba74e3be6db tempest-ProjectMemberTests33-2105464604 None] Call Volume Manager to get_backup_device for Backup(availability_zone='nova',container=None,created_at=2026-07-03T09:53:44Z,data_timestamp=2026-07-03T09:53:44Z,deleted=False,deleted_at=None,display_description=None,display_name=None,encryption_key_id=None,fail_reason=None,host='np0000004400',id=885775bd-f91a-424f-bc10-7913c6a90400,metadata={},num_dependent_backups=0,object_count=0,parent=None,parent_id=None,project_id='e0b6e59b911e40b3acac38afb1f81e3a',restore_volume_id=None,service='cinder.backup.drivers.swift.SwiftBackupDriver',service_metadata=None,size=1,snapshot_id=None,status='creating',temp_snapshot_id=None,temp_volume_id=None,updated_at=None,user_id='1ab49607b4134f2db25a3f996af374bc',volume_id=5f57fed7-aa36-44c5-af90-863bd3d3af9d) Jul 03 09:53:44.606013 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.drivers.swift [None req-0c8f0b9c-3469-46f6-ba0e-fba74e3be6db tempest-ProjectMemberTests33-2105464604 None] Using swift URL https://10.4.3.95:8080/v1/AUTH_e0b6e59b911e40b3acac38afb1f81e3a {{(pid=101319) initialize /opt/stack/cinder/cinder/backup/drivers/swift.py:300}} Jul 03 09:53:44.606715 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.drivers.swift [None req-0c8f0b9c-3469-46f6-ba0e-fba74e3be6db tempest-ProjectMemberTests33-2105464604 None] Connect to https://10.4.3.95:8080/v1/AUTH_ in "per_user" mode {{(pid=101319) initialize /opt/stack/cinder/cinder/backup/drivers/swift.py:301}} Jul 03 09:53:44.607186 np0000004400 cinder-backup[101319]: DEBUG os_brick.utils [None req-0c8f0b9c-3469-46f6-ba0e-fba74e3be6db tempest-ProjectMemberTests33-2105464604 None] ==> get_connector_properties: call "{'root_helper': 'sudo cinder-rootwrap /etc/cinder/rootwrap.conf', 'my_ip': '10.4.3.95', 'multipath': False, 'enforce_multipath': False, 'host': None, 'execute': None}" {{(pid=101319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}} Jul 03 09:53:44.607922 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-0348256d-c334-445a-abfb-8501d08ca9f1 tempest-ProjectReaderTests33-761902925 None] backup MD5 for volume_61c7989b-d6b3-4a39-80a6-9fc519424447/20260703095337/az_nova_backup_3905268c-9301-4198-bac6-c3c450e69ce2-00012: 25e317773f308e446cc84c503a6d1f85 {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 09:53:44.608081 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-0348256d-c334-445a-abfb-8501d08ca9f1 tempest-ProjectReaderTests33-761902925 None] Calling eventlet.sleep(0) {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 09:53:44.634288 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connector [None req-e785f663-f83e-414e-8ac2-4ca69114ccec tempest-VolumesBackupsTest-807180270 None] Factory for iscsi on None {{(pid=101319) factory /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connector.py:243}} Jul 03 09:53:44.634621 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-e785f663-f83e-414e-8ac2-4ca69114ccec tempest-VolumesBackupsTest-807180270 None] ==> connect_volume: call "{'self': , 'connection_properties': {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-b578d41f-4c6a-49b3-b5ec-bcd6556e2e68', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'b578d41f-4c6a-49b3-b5ec-bcd6556e2e68', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': False}}" {{(pid=101319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}} Jul 03 09:53:44.634790 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.base [None req-e785f663-f83e-414e-8ac2-4ca69114ccec tempest-VolumesBackupsTest-807180270 None] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=101319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jul 03 09:53:44.635163 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.base [None req-e785f663-f83e-414e-8ac2-4ca69114ccec tempest-VolumesBackupsTest-807180270 None] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.000s {{(pid=101319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jul 03 09:53:44.635363 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.base [None req-e785f663-f83e-414e-8ac2-4ca69114ccec tempest-VolumesBackupsTest-807180270 None] Connection properties {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-b578d41f-4c6a-49b3-b5ec-bcd6556e2e68', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'b578d41f-4c6a-49b3-b5ec-bcd6556e2e68', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': False} {{(pid=101319) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}} Jul 03 09:53:44.641197 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.scaleio [None req-0c8f0b9c-3469-46f6-ba0e-fba74e3be6db tempest-ProjectMemberTests33-2105464604 None] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=101319) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}} Jul 03 09:53:44.643020 np0000004400 cinder-backup[101319]: DEBUG oslo_db.sqlalchemy.engines [None req-0348256d-c334-445a-abfb-8501d08ca9f1 tempest-ProjectReaderTests33-761902925 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=101319) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 03 09:53:44.646227 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.base [None req-e785f663-f83e-414e-8ac2-4ca69114ccec tempest-VolumesBackupsTest-807180270 None] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-b578d41f-4c6a-49b3-b5ec-bcd6556e2e68" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=101319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jul 03 09:53:44.646903 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.base [None req-e785f663-f83e-414e-8ac2-4ca69114ccec tempest-VolumesBackupsTest-807180270 None] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-b578d41f-4c6a-49b3-b5ec-bcd6556e2e68" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.000s {{(pid=101319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jul 03 09:53:44.646903 np0000004400 cinder-backup[101319]: INFO os_brick.initiator.connectors.iscsi [None req-e785f663-f83e-414e-8ac2-4ca69114ccec tempest-VolumesBackupsTest-807180270 None] Trying to connect to iSCSI portal 192.168.40.100:3260 Jul 03 09:53:44.657734 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-e785f663-f83e-414e-8ac2-4ca69114ccec tempest-VolumesBackupsTest-807180270 None] iscsiadm (): stdout= stderr=iscsiadm: No records found Jul 03 09:53:44.657734 np0000004400 cinder-backup[101319]: {{(pid=101319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 03 09:53:44.663422 np0000004400 cinder-backup[101319]: DEBUG oslo_concurrency.processutils [None req-0c8f0b9c-3469-46f6-ba0e-fba74e3be6db tempest-ProjectMemberTests33-2105464604 None] Running cmd (subprocess): nvme version {{(pid=101319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 09:53:44.671516 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-e785f663-f83e-414e-8ac2-4ca69114ccec tempest-VolumesBackupsTest-807180270 None] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-b578d41f-4c6a-49b3-b5ec-bcd6556e2e68] added Jul 03 09:53:44.671516 np0000004400 cinder-backup[101319]: stderr=iscsiadm: Config file line 363 does not have value Jul 03 09:53:44.671516 np0000004400 cinder-backup[101319]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs' Jul 03 09:53:44.671516 np0000004400 cinder-backup[101319]: iscsiadm: Config file line 363 does not have value Jul 03 09:53:44.671516 np0000004400 cinder-backup[101319]: iscsiadm: Config file line 363 does not have value Jul 03 09:53:44.671516 np0000004400 cinder-backup[101319]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs' Jul 03 09:53:44.671516 np0000004400 cinder-backup[101319]: {{(pid=101319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 03 09:53:44.671784 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-e785f663-f83e-414e-8ac2-4ca69114ccec tempest-VolumesBackupsTest-807180270 None] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=101319) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}} Jul 03 09:53:44.672590 np0000004400 cinder-backup[101319]: DEBUG os_brick.utils [None req-e785f663-f83e-414e-8ac2-4ca69114ccec tempest-VolumesBackupsTest-807180270 None] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0255(s), this was the 1st time calling it. {{(pid=101319) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}} Jul 03 09:53:44.672865 np0000004400 cinder-backup[101319]: DEBUG os_brick.utils [None req-e785f663-f83e-414e-8ac2-4ca69114ccec tempest-VolumesBackupsTest-807180270 None] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=101319) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}} Jul 03 09:53:44.678659 np0000004400 cinder-backup[101319]: DEBUG oslo_concurrency.processutils [None req-0c8f0b9c-3469-46f6-ba0e-fba74e3be6db tempest-ProjectMemberTests33-2105464604 None] 'nvme version' failed. Not Retrying. {{(pid=101319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 03 09:53:44.678884 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.nvmeof [None req-0c8f0b9c-3469-46f6-ba0e-fba74e3be6db tempest-ProjectMemberTests33-2105464604 None] nvme not present on system {{(pid=101319) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}} Jul 03 09:53:44.687675 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.lightos [None req-0c8f0b9c-3469-46f6-ba0e-fba74e3be6db tempest-ProjectMemberTests33-2105464604 None] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=101319) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}} Jul 03 09:53:44.688558 np0000004400 cinder-backup[101319]: INFO os_brick.initiator.connectors.lightos [None req-0c8f0b9c-3469-46f6-ba0e-fba74e3be6db tempest-ProjectMemberTests33-2105464604 None] Current host hostNQN and IP(s) are ['10.4.3.95', 'fe80::f816:3eff:fe47:268c', '192.168.40.6', 'fe80::f816:3eff:febf:7be2', '192.168.50.6', 'fe80::f816:3eff:fe99:8914', '192.168.10.6', 'fe80::f816:3eff:fe2f:e696', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::bc9d:84ff:fec2:6b49', 'fe80::fc16:3eff:feaa:206b', 'fe80::74a1:e1ff:fe2f:1924'] Jul 03 09:53:44.688721 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.lightos [None req-0c8f0b9c-3469-46f6-ba0e-fba74e3be6db tempest-ProjectMemberTests33-2105464604 None] LIGHTOS: did not find dsc, continuing anyway. {{(pid=101319) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}} Jul 03 09:53:44.688833 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.lightos [None req-0c8f0b9c-3469-46f6-ba0e-fba74e3be6db tempest-ProjectMemberTests33-2105464604 None] LIGHTOS: no hostnqn found. {{(pid=101319) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}} Jul 03 09:53:44.689080 np0000004400 cinder-backup[101319]: DEBUG os_brick.utils [None req-0c8f0b9c-3469-46f6-ba0e-fba74e3be6db tempest-ProjectMemberTests33-2105464604 None] <== get_connector_properties: return (81ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.95', 'host': 'np0000004400', 'multipath': False, 'enforce_multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:ae7e5bb0ebe6', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': '6b284368-d0ba-4d18-af6f-4998d3955c52', 'nvme_native_multipath': False} {{(pid=101319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}} Jul 03 09:53:44.857631 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-0348256d-c334-445a-abfb-8501d08ca9f1 tempest-ProjectReaderTests33-761902925 None] Backing up chunk of data from volume. {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 09:53:45.099801 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-0348256d-c334-445a-abfb-8501d08ca9f1 tempest-ProjectReaderTests33-761902925 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101319) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 09:53:45.099978 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-0348256d-c334-445a-abfb-8501d08ca9f1 tempest-ProjectReaderTests33-761902925 None] About to put_object {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 09:53:45.193078 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connector [None req-0c8f0b9c-3469-46f6-ba0e-fba74e3be6db tempest-ProjectMemberTests33-2105464604 None] Factory for iscsi on None {{(pid=101319) factory /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connector.py:243}} Jul 03 09:53:45.193447 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c8f0b9c-3469-46f6-ba0e-fba74e3be6db tempest-ProjectMemberTests33-2105464604 None] ==> connect_volume: call "{'self': , 'connection_properties': {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-5f57fed7-aa36-44c5-af90-863bd3d3af9d', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '5f57fed7-aa36-44c5-af90-863bd3d3af9d', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': False}}" {{(pid=101319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}} Jul 03 09:53:45.193600 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.base [None req-0c8f0b9c-3469-46f6-ba0e-fba74e3be6db tempest-ProjectMemberTests33-2105464604 None] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=101319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jul 03 09:53:45.200721 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-0348256d-c334-445a-abfb-8501d08ca9f1 tempest-ProjectReaderTests33-761902925 None] backup MD5 for volume_61c7989b-d6b3-4a39-80a6-9fc519424447/20260703095337/az_nova_backup_3905268c-9301-4198-bac6-c3c450e69ce2-00013: 25e317773f308e446cc84c503a6d1f85 {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 09:53:45.200844 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-0348256d-c334-445a-abfb-8501d08ca9f1 tempest-ProjectReaderTests33-761902925 None] Calling eventlet.sleep(0) {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 09:53:45.380255 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-0348256d-c334-445a-abfb-8501d08ca9f1 tempest-ProjectReaderTests33-761902925 None] Backing up chunk of data from volume. {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 09:53:45.623148 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-0348256d-c334-445a-abfb-8501d08ca9f1 tempest-ProjectReaderTests33-761902925 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101319) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 09:53:45.623330 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-0348256d-c334-445a-abfb-8501d08ca9f1 tempest-ProjectReaderTests33-761902925 None] About to put_object {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 09:53:45.673847 np0000004400 cinder-backup[101319]: INFO os_brick.initiator.connectors.iscsi [None req-e785f663-f83e-414e-8ac2-4ca69114ccec tempest-VolumesBackupsTest-807180270 None] Trying to connect to iSCSI portal 192.168.40.100:3260 Jul 03 09:53:45.684800 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-e785f663-f83e-414e-8ac2-4ca69114ccec tempest-VolumesBackupsTest-807180270 None] iscsiadm (): stdout=# BEGIN RECORD 2.1.9 Jul 03 09:53:45.684800 np0000004400 cinder-backup[101319]: node.name = iqn.2023-03.storpool.com:os--volume-b578d41f-4c6a-49b3-b5ec-bcd6556e2e68 Jul 03 09:53:45.684800 np0000004400 cinder-backup[101319]: node.tpgt = -1 Jul 03 09:53:45.684800 np0000004400 cinder-backup[101319]: node.startup = manual Jul 03 09:53:45.684800 np0000004400 cinder-backup[101319]: node.leading_login = No Jul 03 09:53:45.684800 np0000004400 cinder-backup[101319]: iface.iscsi_ifacename = default Jul 03 09:53:45.684800 np0000004400 cinder-backup[101319]: iface.net_ifacename = Jul 03 09:53:45.684800 np0000004400 cinder-backup[101319]: iface.ipaddress = Jul 03 09:53:45.684800 np0000004400 cinder-backup[101319]: iface.prefix_len = 0 Jul 03 09:53:45.684800 np0000004400 cinder-backup[101319]: iface.hwaddress = Jul 03 09:53:45.684800 np0000004400 cinder-backup[101319]: iface.transport_name = tcp Jul 03 09:53:45.684800 np0000004400 cinder-backup[101319]: iface.initiatorname = Jul 03 09:53:45.684800 np0000004400 cinder-backup[101319]: iface.state = Jul 03 09:53:45.684800 np0000004400 cinder-backup[101319]: iface.vlan_id = 0 Jul 03 09:53:45.684800 np0000004400 cinder-backup[101319]: iface.vlan_priority = 0 Jul 03 09:53:45.684800 np0000004400 cinder-backup[101319]: iface.vlan_state = Jul 03 09:53:45.684800 np0000004400 cinder-backup[101319]: iface.iface_num = 0 Jul 03 09:53:45.684800 np0000004400 cinder-backup[101319]: iface.mtu = 0 Jul 03 09:53:45.684800 np0000004400 cinder-backup[101319]: iface.port = 0 Jul 03 09:53:45.684800 np0000004400 cinder-backup[101319]: iface.bootproto = Jul 03 09:53:45.684800 np0000004400 cinder-backup[101319]: iface.subnet_mask = Jul 03 09:53:45.684800 np0000004400 cinder-backup[101319]: iface.gateway = Jul 03 09:53:45.684800 np0000004400 cinder-backup[101319]: iface.dhcp_alt_client_id_state = Jul 03 09:53:45.684800 np0000004400 cinder-backup[101319]: iface.dhcp_alt_client_id = Jul 03 09:53:45.684800 np0000004400 cinder-backup[101319]: iface.dhcp_dns = Jul 03 09:53:45.684800 np0000004400 cinder-backup[101319]: iface.dhcp_learn_iqn = Jul 03 09:53:45.684800 np0000004400 cinder-backup[101319]: iface.dhcp_req_vendor_id_state = Jul 03 09:53:45.684800 np0000004400 cinder-backup[101319]: iface.dhcp_vendor_id_state = Jul 03 09:53:45.684800 np0000004400 cinder-backup[101319]: iface.dhcp_vendor_id = Jul 03 09:53:45.684800 np0000004400 cinder-backup[101319]: iface.dhcp_slp_da = Jul 03 09:53:45.684800 np0000004400 cinder-backup[101319]: iface.fragmentation = Jul 03 09:53:45.684800 np0000004400 cinder-backup[101319]: iface.gratuitous_arp = Jul 03 09:53:45.684800 np0000004400 cinder-backup[101319]: iface.incoming_forwarding = Jul 03 09:53:45.684800 np0000004400 cinder-backup[101319]: iface.tos_state = Jul 03 09:53:45.684800 np0000004400 cinder-backup[101319]: iface.tos = 0 Jul 03 09:53:45.684800 np0000004400 cinder-backup[101319]: iface.ttl = 0 Jul 03 09:53:45.684800 np0000004400 cinder-backup[101319]: iface.delayed_ack = Jul 03 09:53:45.684800 np0000004400 cinder-backup[101319]: iface.tcp_nagle = Jul 03 09:53:45.684800 np0000004400 cinder-backup[101319]: iface.tcp_wsf_state = Jul 03 09:53:45.684800 np0000004400 cinder-backup[101319]: iface.tcp_wsf = 0 Jul 03 09:53:45.684800 np0000004400 cinder-backup[101319]: iface.tcp_timer_scale = 0 Jul 03 09:53:45.684800 np0000004400 cinder-backup[101319]: iface.tcp_timestamp = Jul 03 09:53:45.684800 np0000004400 cinder-backup[101319]: iface.redirect = Jul 03 09:53:45.684800 np0000004400 cinder-backup[101319]: iface.def_task_mgmt_timeout = 0 Jul 03 09:53:45.684800 np0000004400 cinder-backup[101319]: iface.header_digest = Jul 03 09:53:45.684800 np0000004400 cinder-backup[101319]: iface.data_digest = Jul 03 09:53:45.684800 np0000004400 cinder-backup[101319]: iface.immediate_data = Jul 03 09:53:45.684800 np0000004400 cinder-backup[101319]: iface.initial_r2t = Jul 03 09:53:45.684800 np0000004400 cinder-backup[101319]: iface.data_seq_inorder = Jul 03 09:53:45.684800 np0000004400 cinder-backup[101319]: iface.data_pdu_inorder = Jul 03 09:53:45.684800 np0000004400 cinder-backup[101319]: iface.erl = 0 Jul 03 09:53:45.684800 np0000004400 cinder-backup[101319]: iface.max_receive_data_len = 0 Jul 03 09:53:45.684800 np0000004400 cinder-backup[101319]: iface.first_burst_len = 0 Jul 03 09:53:45.684800 np0000004400 cinder-backup[101319]: iface.max_outstanding_r2t = 0 Jul 03 09:53:45.684800 np0000004400 cinder-backup[101319]: iface.max_burst_len = 0 Jul 03 09:53:45.684800 np0000004400 cinder-backup[101319]: iface.chap_auth = Jul 03 09:53:45.684800 np0000004400 cinder-backup[101319]: iface.bidi_chap = Jul 03 09:53:45.684800 np0000004400 cinder-backup[101319]: iface.strict_login_compliance = Jul 03 09:53:45.684800 np0000004400 cinder-backup[101319]: iface.discovery_auth = Jul 03 09:53:45.684800 np0000004400 cinder-backup[101319]: iface.discovery_logout = Jul 03 09:53:45.684800 np0000004400 cinder-backup[101319]: node.discovery_address = Jul 03 09:53:45.684800 np0000004400 cinder-backup[101319]: node.discovery_port = 0 Jul 03 09:53:45.684800 np0000004400 cinder-backup[101319]: node.discovery_type = fw Jul 03 09:53:45.684800 np0000004400 cinder-backup[101319]: node.session.initial_cmdsn = 0 Jul 03 09:53:45.684800 np0000004400 cinder-backup[101319]: node.session.initial_login_retry_max = 8 Jul 03 09:53:45.684800 np0000004400 cinder-backup[101319]: node.session.xmit_thread_priority = 0 Jul 03 09:53:45.684800 np0000004400 cinder-backup[101319]: node.session.cmds_max = 128 Jul 03 09:53:45.684800 np0000004400 cinder-backup[101319]: node.session.queue_depth = 32 Jul 03 09:53:45.684800 np0000004400 cinder-backup[101319]: node.session.nr_sessions = 1 Jul 03 09:53:45.684800 np0000004400 cinder-backup[101319]: node.session.auth.authmethod = None Jul 03 09:53:45.684800 np0000004400 cinder-backup[101319]: node.session.auth.username = Jul 03 09:53:45.684800 np0000004400 cinder-backup[101319]: node.session.auth.password = *** Jul 03 09:53:45.684800 np0000004400 cinder-backup[101319]: node.session.auth.username_in = Jul 03 09:53:45.684800 np0000004400 cinder-backup[101319]: node.session.auth.password_in = Jul 03 09:53:45.684800 np0000004400 cinder-backup[101319]: node.session.auth.chap_algs = SHA256 Jul 03 09:53:45.684800 np0000004400 cinder-backup[101319]: node.session.timeo.replacement_timeout = 120 Jul 03 09:53:45.684800 np0000004400 cinder-backup[101319]: node.session.err_timeo.abort_timeout = 15 Jul 03 09:53:45.684800 np0000004400 cinder-backup[101319]: node.session.err_timeo.lu_reset_timeout = 30 Jul 03 09:53:45.684800 np0000004400 cinder-backup[101319]: node.session.err_timeo.tgt_reset_timeout = 30 Jul 03 09:53:45.684800 np0000004400 cinder-backup[101319]: node.session.err_timeo.host_reset_timeout = 60 Jul 03 09:53:45.684800 np0000004400 cinder-backup[101319]: node.session.iscsi.FastAbort = Yes Jul 03 09:53:45.684800 np0000004400 cinder-backup[101319]: node.session.iscsi.InitialR2T = No Jul 03 09:53:45.684800 np0000004400 cinder-backup[101319]: node.session.iscsi.ImmediateData = Yes Jul 03 09:53:45.684800 np0000004400 cinder-backup[101319]: node.session.iscsi.FirstBurstLength = 262144 Jul 03 09:53:45.684800 np0000004400 cinder-backup[101319]: node.session.iscsi.MaxBurstLength = 16776192 Jul 03 09:53:45.684800 np0000004400 cinder-backup[101319]: node.session.iscsi.DefaultTime2Retain = 0 Jul 03 09:53:45.684800 np0000004400 cinder-backup[101319]: node.session.iscsi.DefaultTime2Wait = 2 Jul 03 09:53:45.684800 np0000004400 cinder-backup[101319]: node.session.iscsi.MaxConnections = 1 Jul 03 09:53:45.684800 np0000004400 cinder-backup[101319]: node.session.iscsi.MaxOutstandingR2T = 1 Jul 03 09:53:45.684800 np0000004400 cinder-backup[101319]: node.session.iscsi.ERL = 0 Jul 03 09:53:45.684800 np0000004400 cinder-backup[101319]: node.session.scan = auto Jul 03 09:53:45.684800 np0000004400 cinder-backup[101319]: node.session.reopen_max = 0 Jul 03 09:53:45.684800 np0000004400 cinder-backup[101319]: node.conn[0].address = 192.168.40.100 Jul 03 09:53:45.684800 np0000004400 cinder-backup[101319]: node.conn[0].port = 3260 Jul 03 09:53:45.684800 np0000004400 cinder-backup[101319]: node.conn[0].startup = manual Jul 03 09:53:45.684800 np0000004400 cinder-backup[101319]: node.conn[0].tcp.window_size = 524288 Jul 03 09:53:45.684800 np0000004400 cinder-backup[101319]: node.conn[0].tcp.type_of_service = 0 Jul 03 09:53:45.684800 np0000004400 cinder-backup[101319]: node.conn[0].timeo.logout_timeout = 15 Jul 03 09:53:45.684800 np0000004400 cinder-backup[101319]: node.conn[0].timeo.login_timeout = 15 Jul 03 09:53:45.684800 np0000004400 cinder-backup[101319]: node.conn[0].timeo.auth_timeout = 45 Jul 03 09:53:45.684800 np0000004400 cinder-backup[101319]: node.conn[0].timeo.noop_out_interval = 5 Jul 03 09:53:45.684800 np0000004400 cinder-backup[101319]: node.conn[0].timeo.noop_out_timeout = 5 Jul 03 09:53:45.684800 np0000004400 cinder-backup[101319]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0 Jul 03 09:53:45.684800 np0000004400 cinder-backup[101319]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144 Jul 03 09:53:45.684800 np0000004400 cinder-backup[101319]: node.conn[0].iscsi.HeaderDigest = None Jul 03 09:53:45.684800 np0000004400 cinder-backup[101319]: node.conn[0].iscsi.DataDigest = None Jul 03 09:53:45.684800 np0000004400 cinder-backup[101319]: node.conn[0].iscsi.IFMarker = No Jul 03 09:53:45.684800 np0000004400 cinder-backup[101319]: node.conn[0].iscsi.OFMarker = No Jul 03 09:53:45.684800 np0000004400 cinder-backup[101319]: # END RECORD Jul 03 09:53:45.684800 np0000004400 cinder-backup[101319]: stderr= {{(pid=101319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 03 09:53:45.695662 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-e785f663-f83e-414e-8ac2-4ca69114ccec tempest-VolumesBackupsTest-807180270 None] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=101319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 03 09:53:45.710005 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-e785f663-f83e-414e-8ac2-4ca69114ccec tempest-VolumesBackupsTest-807180270 None] iscsiadm ('-m', 'session'): stdout=tcp: [188] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-491c39b6-d2e0-4f67-9a64-590d50f06197 (non-flash) Jul 03 09:53:45.710005 np0000004400 cinder-backup[101319]: tcp: [189] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-491c39b6-d2e0-4f67-9a64-590d50f06197 (non-flash) Jul 03 09:53:45.710005 np0000004400 cinder-backup[101319]: tcp: [203] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-79c374d0-f293-429e-9f7e-a6ac9afa4c99 (non-flash) Jul 03 09:53:45.710005 np0000004400 cinder-backup[101319]: tcp: [204] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-79c374d0-f293-429e-9f7e-a6ac9afa4c99 (non-flash) Jul 03 09:53:45.710005 np0000004400 cinder-backup[101319]: tcp: [205] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-61c7989b-d6b3-4a39-80a6-9fc519424447 (non-flash) Jul 03 09:53:45.710005 np0000004400 cinder-backup[101319]: stderr= {{(pid=101319) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jul 03 09:53:45.710210 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-e785f663-f83e-414e-8ac2-4ca69114ccec tempest-VolumesBackupsTest-807180270 None] iscsi session list stdout=tcp: [188] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-491c39b6-d2e0-4f67-9a64-590d50f06197 (non-flash) Jul 03 09:53:45.710210 np0000004400 cinder-backup[101319]: tcp: [189] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-491c39b6-d2e0-4f67-9a64-590d50f06197 (non-flash) Jul 03 09:53:45.710210 np0000004400 cinder-backup[101319]: tcp: [203] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-79c374d0-f293-429e-9f7e-a6ac9afa4c99 (non-flash) Jul 03 09:53:45.710210 np0000004400 cinder-backup[101319]: tcp: [204] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-79c374d0-f293-429e-9f7e-a6ac9afa4c99 (non-flash) Jul 03 09:53:45.710210 np0000004400 cinder-backup[101319]: tcp: [205] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-61c7989b-d6b3-4a39-80a6-9fc519424447 (non-flash) Jul 03 09:53:45.710210 np0000004400 cinder-backup[101319]: stderr= {{(pid=101319) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jul 03 09:53:45.721089 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-0348256d-c334-445a-abfb-8501d08ca9f1 tempest-ProjectReaderTests33-761902925 None] backup MD5 for volume_61c7989b-d6b3-4a39-80a6-9fc519424447/20260703095337/az_nova_backup_3905268c-9301-4198-bac6-c3c450e69ce2-00014: 25e317773f308e446cc84c503a6d1f85 {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 09:53:45.721244 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-0348256d-c334-445a-abfb-8501d08ca9f1 tempest-ProjectReaderTests33-761902925 None] Calling eventlet.sleep(0) {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 09:53:45.738788 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-e785f663-f83e-414e-8ac2-4ca69114ccec tempest-VolumesBackupsTest-807180270 None] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-b578d41f-4c6a-49b3-b5ec-bcd6556e2e68, portal: 192.168.40.100,3260] Jul 03 09:53:45.738788 np0000004400 cinder-backup[101319]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-b578d41f-4c6a-49b3-b5ec-bcd6556e2e68, portal: 192.168.40.100,3260] successful. Jul 03 09:53:45.738788 np0000004400 cinder-backup[101319]: stderr= {{(pid=101319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 03 09:53:45.750115 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-e785f663-f83e-414e-8ac2-4ca69114ccec tempest-VolumesBackupsTest-807180270 None] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=101319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 03 09:53:45.764938 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-e785f663-f83e-414e-8ac2-4ca69114ccec tempest-VolumesBackupsTest-807180270 None] iscsiadm ('-m', 'session'): stdout=tcp: [188] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-491c39b6-d2e0-4f67-9a64-590d50f06197 (non-flash) Jul 03 09:53:45.764938 np0000004400 cinder-backup[101319]: tcp: [189] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-491c39b6-d2e0-4f67-9a64-590d50f06197 (non-flash) Jul 03 09:53:45.764938 np0000004400 cinder-backup[101319]: tcp: [203] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-79c374d0-f293-429e-9f7e-a6ac9afa4c99 (non-flash) Jul 03 09:53:45.764938 np0000004400 cinder-backup[101319]: tcp: [204] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-79c374d0-f293-429e-9f7e-a6ac9afa4c99 (non-flash) Jul 03 09:53:45.764938 np0000004400 cinder-backup[101319]: tcp: [205] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-61c7989b-d6b3-4a39-80a6-9fc519424447 (non-flash) Jul 03 09:53:45.764938 np0000004400 cinder-backup[101319]: tcp: [206] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b578d41f-4c6a-49b3-b5ec-bcd6556e2e68 (non-flash) Jul 03 09:53:45.764938 np0000004400 cinder-backup[101319]: stderr= {{(pid=101319) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jul 03 09:53:45.765257 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-e785f663-f83e-414e-8ac2-4ca69114ccec tempest-VolumesBackupsTest-807180270 None] iscsi session list stdout=tcp: [188] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-491c39b6-d2e0-4f67-9a64-590d50f06197 (non-flash) Jul 03 09:53:45.765257 np0000004400 cinder-backup[101319]: tcp: [189] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-491c39b6-d2e0-4f67-9a64-590d50f06197 (non-flash) Jul 03 09:53:45.765257 np0000004400 cinder-backup[101319]: tcp: [203] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-79c374d0-f293-429e-9f7e-a6ac9afa4c99 (non-flash) Jul 03 09:53:45.765257 np0000004400 cinder-backup[101319]: tcp: [204] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-79c374d0-f293-429e-9f7e-a6ac9afa4c99 (non-flash) Jul 03 09:53:45.765257 np0000004400 cinder-backup[101319]: tcp: [205] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-61c7989b-d6b3-4a39-80a6-9fc519424447 (non-flash) Jul 03 09:53:45.765257 np0000004400 cinder-backup[101319]: tcp: [206] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b578d41f-4c6a-49b3-b5ec-bcd6556e2e68 (non-flash) Jul 03 09:53:45.765257 np0000004400 cinder-backup[101319]: stderr= {{(pid=101319) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jul 03 09:53:45.765556 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.base [None req-e785f663-f83e-414e-8ac2-4ca69114ccec tempest-VolumesBackupsTest-807180270 None] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-b578d41f-4c6a-49b3-b5ec-bcd6556e2e68" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.119s {{(pid=101319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jul 03 09:53:45.765659 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-e785f663-f83e-414e-8ac2-4ca69114ccec tempest-VolumesBackupsTest-807180270 None] Connected to 192.168.40.100:3260 {{(pid=101319) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}} Jul 03 09:53:45.766539 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.linuxscsi [None req-e785f663-f83e-414e-8ac2-4ca69114ccec tempest-VolumesBackupsTest-807180270 None] HCTL ('9', '-', '-', 0) found on session 206 with lun 0 {{(pid=101319) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}} Jul 03 09:53:45.766695 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.linuxscsi [None req-e785f663-f83e-414e-8ac2-4ca69114ccec tempest-VolumesBackupsTest-807180270 None] Scanning host 9 c: -, t: -, l: 0) {{(pid=101319) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}} Jul 03 09:53:45.782177 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.linuxscsi [None req-e785f663-f83e-414e-8ac2-4ca69114ccec tempest-VolumesBackupsTest-807180270 None] Searching for a device in session 206 and hctl ['9', '*', '*', 0] yield: None {{(pid=101319) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}} Jul 03 09:53:45.898527 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-0348256d-c334-445a-abfb-8501d08ca9f1 tempest-ProjectReaderTests33-761902925 None] Backing up chunk of data from volume. {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 09:53:46.138450 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-0348256d-c334-445a-abfb-8501d08ca9f1 tempest-ProjectReaderTests33-761902925 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101319) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 09:53:46.138583 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-0348256d-c334-445a-abfb-8501d08ca9f1 tempest-ProjectReaderTests33-761902925 None] About to put_object {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 09:53:46.235522 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-0348256d-c334-445a-abfb-8501d08ca9f1 tempest-ProjectReaderTests33-761902925 None] backup MD5 for volume_61c7989b-d6b3-4a39-80a6-9fc519424447/20260703095337/az_nova_backup_3905268c-9301-4198-bac6-c3c450e69ce2-00015: 25e317773f308e446cc84c503a6d1f85 {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 09:53:46.235635 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-0348256d-c334-445a-abfb-8501d08ca9f1 tempest-ProjectReaderTests33-761902925 None] Calling eventlet.sleep(0) {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 09:53:46.409385 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-0348256d-c334-445a-abfb-8501d08ca9f1 tempest-ProjectReaderTests33-761902925 None] Backing up chunk of data from volume. {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 09:53:46.652959 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-0348256d-c334-445a-abfb-8501d08ca9f1 tempest-ProjectReaderTests33-761902925 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101319) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 09:53:46.653214 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-0348256d-c334-445a-abfb-8501d08ca9f1 tempest-ProjectReaderTests33-761902925 None] About to put_object {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 09:53:46.751547 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-0348256d-c334-445a-abfb-8501d08ca9f1 tempest-ProjectReaderTests33-761902925 None] backup MD5 for volume_61c7989b-d6b3-4a39-80a6-9fc519424447/20260703095337/az_nova_backup_3905268c-9301-4198-bac6-c3c450e69ce2-00016: 25e317773f308e446cc84c503a6d1f85 {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 09:53:46.751776 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-0348256d-c334-445a-abfb-8501d08ca9f1 tempest-ProjectReaderTests33-761902925 None] Calling eventlet.sleep(0) {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 09:53:46.782885 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.linuxscsi [None req-e785f663-f83e-414e-8ac2-4ca69114ccec tempest-VolumesBackupsTest-807180270 None] Searching for a device in session 206 and hctl ['9', '*', '*', 0] yield: sdd {{(pid=101319) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}} Jul 03 09:53:46.783083 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-e785f663-f83e-414e-8ac2-4ca69114ccec tempest-VolumesBackupsTest-807180270 None] Connected to sdd using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-b578d41f-4c6a-49b3-b5ec-bcd6556e2e68', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'b578d41f-4c6a-49b3-b5ec-bcd6556e2e68', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': False} {{(pid=101319) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}} Jul 03 09:53:46.783717 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.base [None req-e785f663-f83e-414e-8ac2-4ca69114ccec tempest-VolumesBackupsTest-807180270 None] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 2.149s {{(pid=101319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jul 03 09:53:46.783874 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-e785f663-f83e-414e-8ac2-4ca69114ccec tempest-VolumesBackupsTest-807180270 None] <== connect_volume: return (2149ms) {'type': 'block', 'scsi_wwn': 'SStorPool_iSCSI_DISK_1034578903445799236', 'path': '/dev/sdd'} {{(pid=101319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}} Jul 03 09:53:46.784184 np0000004400 cinder-backup[101319]: DEBUG oslo_concurrency.processutils [None req-e785f663-f83e-414e-8ac2-4ca69114ccec tempest-VolumesBackupsTest-807180270 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chown 1002 /dev/sdd {{(pid=101319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 09:53:46.794704 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.base [None req-0c8f0b9c-3469-46f6-ba0e-fba74e3be6db tempest-ProjectMemberTests33-2105464604 None] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 1.599s {{(pid=101319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jul 03 09:53:46.795183 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.base [None req-0c8f0b9c-3469-46f6-ba0e-fba74e3be6db tempest-ProjectMemberTests33-2105464604 None] Connection properties {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-5f57fed7-aa36-44c5-af90-863bd3d3af9d', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '5f57fed7-aa36-44c5-af90-863bd3d3af9d', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': False} {{(pid=101319) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}} Jul 03 09:53:46.806180 np0000004400 sudo[155195]: stack : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chown 1002 /dev/sdd Jul 03 09:53:46.806848 np0000004400 sudo[155195]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1002) Jul 03 09:53:46.836797 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.base [None req-0c8f0b9c-3469-46f6-ba0e-fba74e3be6db tempest-ProjectMemberTests33-2105464604 None] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-5f57fed7-aa36-44c5-af90-863bd3d3af9d" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=101319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jul 03 09:53:46.837215 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.base [None req-0c8f0b9c-3469-46f6-ba0e-fba74e3be6db tempest-ProjectMemberTests33-2105464604 None] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-5f57fed7-aa36-44c5-af90-863bd3d3af9d" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=101319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jul 03 09:53:46.837471 np0000004400 cinder-backup[101319]: INFO os_brick.initiator.connectors.iscsi [None req-0c8f0b9c-3469-46f6-ba0e-fba74e3be6db tempest-ProjectMemberTests33-2105464604 None] Trying to connect to iSCSI portal 192.168.40.100:3260 Jul 03 09:53:46.875845 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c8f0b9c-3469-46f6-ba0e-fba74e3be6db tempest-ProjectMemberTests33-2105464604 None] iscsiadm (): stdout= stderr=iscsiadm: No records found Jul 03 09:53:46.875845 np0000004400 cinder-backup[101319]: {{(pid=101319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 03 09:53:46.887061 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c8f0b9c-3469-46f6-ba0e-fba74e3be6db tempest-ProjectMemberTests33-2105464604 None] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-5f57fed7-aa36-44c5-af90-863bd3d3af9d] added Jul 03 09:53:46.887061 np0000004400 cinder-backup[101319]: stderr=iscsiadm: Config file line 363 does not have value Jul 03 09:53:46.887061 np0000004400 cinder-backup[101319]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs' Jul 03 09:53:46.887061 np0000004400 cinder-backup[101319]: iscsiadm: Config file line 363 does not have value Jul 03 09:53:46.887061 np0000004400 cinder-backup[101319]: iscsiadm: Config file line 363 does not have value Jul 03 09:53:46.887061 np0000004400 cinder-backup[101319]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs' Jul 03 09:53:46.887061 np0000004400 cinder-backup[101319]: {{(pid=101319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 03 09:53:46.887325 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c8f0b9c-3469-46f6-ba0e-fba74e3be6db tempest-ProjectMemberTests33-2105464604 None] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=101319) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}} Jul 03 09:53:46.887716 np0000004400 cinder-backup[101319]: DEBUG os_brick.utils [None req-0c8f0b9c-3469-46f6-ba0e-fba74e3be6db tempest-ProjectMemberTests33-2105464604 None] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0501(s), this was the 1st time calling it. {{(pid=101319) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}} Jul 03 09:53:46.887890 np0000004400 cinder-backup[101319]: DEBUG os_brick.utils [None req-0c8f0b9c-3469-46f6-ba0e-fba74e3be6db tempest-ProjectMemberTests33-2105464604 None] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=101319) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}} Jul 03 09:53:46.942883 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-0348256d-c334-445a-abfb-8501d08ca9f1 tempest-ProjectReaderTests33-761902925 None] Backing up chunk of data from volume. {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 09:53:47.096978 np0000004400 sudo[155195]: pam_unix(sudo:session): session closed for user root Jul 03 09:53:47.098550 np0000004400 cinder-backup[101319]: DEBUG oslo_concurrency.processutils [None req-e785f663-f83e-414e-8ac2-4ca69114ccec tempest-VolumesBackupsTest-807180270 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chown 1002 /dev/sdd" returned: 0 in 0.314s {{(pid=101319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 09:53:47.106268 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-e785f663-f83e-414e-8ac2-4ca69114ccec tempest-VolumesBackupsTest-807180270 None] _create_container started, container: volumebackups,backup: c52fbc4a-f7d8-49e2-bd92-5bbf2f7f98ba. {{(pid=101319) _create_container /opt/stack/cinder/cinder/backup/chunkeddriver.py:249}} Jul 03 09:53:47.150181 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.drivers.swift [None req-e785f663-f83e-414e-8ac2-4ca69114ccec tempest-VolumesBackupsTest-807180270 None] generate_object_name_prefix: volume_b578d41f-4c6a-49b3-b5ec-bcd6556e2e68/20260703095347/az_nova_backup_c52fbc4a-f7d8-49e2-bd92-5bbf2f7f98ba {{(pid=101319) _generate_object_name_prefix /opt/stack/cinder/cinder/backup/drivers/swift.py:452}} Jul 03 09:53:47.181794 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-e785f663-f83e-414e-8ac2-4ca69114ccec tempest-VolumesBackupsTest-807180270 None] starting backup of volume: b578d41f-4c6a-49b3-b5ec-bcd6556e2e68, volume size: 1073741824, object names prefix volume_b578d41f-4c6a-49b3-b5ec-bcd6556e2e68/20260703095347/az_nova_backup_c52fbc4a-f7d8-49e2-bd92-5bbf2f7f98ba, availability zone: nova {{(pid=101319) _prepare_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:359}} Jul 03 09:53:47.190826 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-0348256d-c334-445a-abfb-8501d08ca9f1 tempest-ProjectReaderTests33-761902925 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101319) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 09:53:47.190960 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-0348256d-c334-445a-abfb-8501d08ca9f1 tempest-ProjectReaderTests33-761902925 None] About to put_object {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 09:53:47.326204 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-0348256d-c334-445a-abfb-8501d08ca9f1 tempest-ProjectReaderTests33-761902925 None] backup MD5 for volume_61c7989b-d6b3-4a39-80a6-9fc519424447/20260703095337/az_nova_backup_3905268c-9301-4198-bac6-c3c450e69ce2-00017: 25e317773f308e446cc84c503a6d1f85 {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 09:53:47.326456 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-0348256d-c334-445a-abfb-8501d08ca9f1 tempest-ProjectReaderTests33-761902925 None] Calling eventlet.sleep(0) {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 09:53:47.359712 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-e785f663-f83e-414e-8ac2-4ca69114ccec tempest-VolumesBackupsTest-807180270 None] Backing up chunk of data from volume. {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 09:53:47.491515 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-0348256d-c334-445a-abfb-8501d08ca9f1 tempest-ProjectReaderTests33-761902925 None] Backing up chunk of data from volume. {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 09:53:47.624069 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-e785f663-f83e-414e-8ac2-4ca69114ccec tempest-VolumesBackupsTest-807180270 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101319) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 09:53:47.624069 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-e785f663-f83e-414e-8ac2-4ca69114ccec tempest-VolumesBackupsTest-807180270 None] About to put_object {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 09:53:47.749092 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-0348256d-c334-445a-abfb-8501d08ca9f1 tempest-ProjectReaderTests33-761902925 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101319) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 09:53:47.749231 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-0348256d-c334-445a-abfb-8501d08ca9f1 tempest-ProjectReaderTests33-761902925 None] About to put_object {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 09:53:47.763765 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-e785f663-f83e-414e-8ac2-4ca69114ccec tempest-VolumesBackupsTest-807180270 None] backup MD5 for volume_b578d41f-4c6a-49b3-b5ec-bcd6556e2e68/20260703095347/az_nova_backup_c52fbc4a-f7d8-49e2-bd92-5bbf2f7f98ba-00001: 25e317773f308e446cc84c503a6d1f85 {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 09:53:47.763906 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-e785f663-f83e-414e-8ac2-4ca69114ccec tempest-VolumesBackupsTest-807180270 None] Calling eventlet.sleep(0) {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 09:53:47.863324 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-0348256d-c334-445a-abfb-8501d08ca9f1 tempest-ProjectReaderTests33-761902925 None] backup MD5 for volume_61c7989b-d6b3-4a39-80a6-9fc519424447/20260703095337/az_nova_backup_3905268c-9301-4198-bac6-c3c450e69ce2-00018: 25e317773f308e446cc84c503a6d1f85 {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 09:53:47.864603 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-0348256d-c334-445a-abfb-8501d08ca9f1 tempest-ProjectReaderTests33-761902925 None] Calling eventlet.sleep(0) {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 09:53:47.894530 np0000004400 cinder-backup[101319]: INFO os_brick.initiator.connectors.iscsi [None req-0c8f0b9c-3469-46f6-ba0e-fba74e3be6db tempest-ProjectMemberTests33-2105464604 None] Trying to connect to iSCSI portal 192.168.40.100:3260 Jul 03 09:53:47.913187 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c8f0b9c-3469-46f6-ba0e-fba74e3be6db tempest-ProjectMemberTests33-2105464604 None] iscsiadm (): stdout=# BEGIN RECORD 2.1.9 Jul 03 09:53:47.913187 np0000004400 cinder-backup[101319]: node.name = iqn.2023-03.storpool.com:os--volume-5f57fed7-aa36-44c5-af90-863bd3d3af9d Jul 03 09:53:47.913187 np0000004400 cinder-backup[101319]: node.tpgt = -1 Jul 03 09:53:47.913187 np0000004400 cinder-backup[101319]: node.startup = manual Jul 03 09:53:47.913187 np0000004400 cinder-backup[101319]: node.leading_login = No Jul 03 09:53:47.913187 np0000004400 cinder-backup[101319]: iface.iscsi_ifacename = default Jul 03 09:53:47.913187 np0000004400 cinder-backup[101319]: iface.net_ifacename = Jul 03 09:53:47.913187 np0000004400 cinder-backup[101319]: iface.ipaddress = Jul 03 09:53:47.913187 np0000004400 cinder-backup[101319]: iface.prefix_len = 0 Jul 03 09:53:47.913187 np0000004400 cinder-backup[101319]: iface.hwaddress = Jul 03 09:53:47.913187 np0000004400 cinder-backup[101319]: iface.transport_name = tcp Jul 03 09:53:47.913187 np0000004400 cinder-backup[101319]: iface.initiatorname = Jul 03 09:53:47.913187 np0000004400 cinder-backup[101319]: iface.state = Jul 03 09:53:47.913187 np0000004400 cinder-backup[101319]: iface.vlan_id = 0 Jul 03 09:53:47.913187 np0000004400 cinder-backup[101319]: iface.vlan_priority = 0 Jul 03 09:53:47.913187 np0000004400 cinder-backup[101319]: iface.vlan_state = Jul 03 09:53:47.913187 np0000004400 cinder-backup[101319]: iface.iface_num = 0 Jul 03 09:53:47.913187 np0000004400 cinder-backup[101319]: iface.mtu = 0 Jul 03 09:53:47.913187 np0000004400 cinder-backup[101319]: iface.port = 0 Jul 03 09:53:47.913187 np0000004400 cinder-backup[101319]: iface.bootproto = Jul 03 09:53:47.913187 np0000004400 cinder-backup[101319]: iface.subnet_mask = Jul 03 09:53:47.913187 np0000004400 cinder-backup[101319]: iface.gateway = Jul 03 09:53:47.913187 np0000004400 cinder-backup[101319]: iface.dhcp_alt_client_id_state = Jul 03 09:53:47.913187 np0000004400 cinder-backup[101319]: iface.dhcp_alt_client_id = Jul 03 09:53:47.913187 np0000004400 cinder-backup[101319]: iface.dhcp_dns = Jul 03 09:53:47.913187 np0000004400 cinder-backup[101319]: iface.dhcp_learn_iqn = Jul 03 09:53:47.913187 np0000004400 cinder-backup[101319]: iface.dhcp_req_vendor_id_state = Jul 03 09:53:47.913187 np0000004400 cinder-backup[101319]: iface.dhcp_vendor_id_state = Jul 03 09:53:47.913187 np0000004400 cinder-backup[101319]: iface.dhcp_vendor_id = Jul 03 09:53:47.913187 np0000004400 cinder-backup[101319]: iface.dhcp_slp_da = Jul 03 09:53:47.913187 np0000004400 cinder-backup[101319]: iface.fragmentation = Jul 03 09:53:47.913187 np0000004400 cinder-backup[101319]: iface.gratuitous_arp = Jul 03 09:53:47.913187 np0000004400 cinder-backup[101319]: iface.incoming_forwarding = Jul 03 09:53:47.913187 np0000004400 cinder-backup[101319]: iface.tos_state = Jul 03 09:53:47.913187 np0000004400 cinder-backup[101319]: iface.tos = 0 Jul 03 09:53:47.913187 np0000004400 cinder-backup[101319]: iface.ttl = 0 Jul 03 09:53:47.913187 np0000004400 cinder-backup[101319]: iface.delayed_ack = Jul 03 09:53:47.913187 np0000004400 cinder-backup[101319]: iface.tcp_nagle = Jul 03 09:53:47.913187 np0000004400 cinder-backup[101319]: iface.tcp_wsf_state = Jul 03 09:53:47.913187 np0000004400 cinder-backup[101319]: iface.tcp_wsf = 0 Jul 03 09:53:47.913187 np0000004400 cinder-backup[101319]: iface.tcp_timer_scale = 0 Jul 03 09:53:47.913187 np0000004400 cinder-backup[101319]: iface.tcp_timestamp = Jul 03 09:53:47.913187 np0000004400 cinder-backup[101319]: iface.redirect = Jul 03 09:53:47.913187 np0000004400 cinder-backup[101319]: iface.def_task_mgmt_timeout = 0 Jul 03 09:53:47.913187 np0000004400 cinder-backup[101319]: iface.header_digest = Jul 03 09:53:47.913187 np0000004400 cinder-backup[101319]: iface.data_digest = Jul 03 09:53:47.913187 np0000004400 cinder-backup[101319]: iface.immediate_data = Jul 03 09:53:47.913187 np0000004400 cinder-backup[101319]: iface.initial_r2t = Jul 03 09:53:47.913187 np0000004400 cinder-backup[101319]: iface.data_seq_inorder = Jul 03 09:53:47.913187 np0000004400 cinder-backup[101319]: iface.data_pdu_inorder = Jul 03 09:53:47.913187 np0000004400 cinder-backup[101319]: iface.erl = 0 Jul 03 09:53:47.913187 np0000004400 cinder-backup[101319]: iface.max_receive_data_len = 0 Jul 03 09:53:47.913187 np0000004400 cinder-backup[101319]: iface.first_burst_len = 0 Jul 03 09:53:47.913187 np0000004400 cinder-backup[101319]: iface.max_outstanding_r2t = 0 Jul 03 09:53:47.913187 np0000004400 cinder-backup[101319]: iface.max_burst_len = 0 Jul 03 09:53:47.913187 np0000004400 cinder-backup[101319]: iface.chap_auth = Jul 03 09:53:47.913187 np0000004400 cinder-backup[101319]: iface.bidi_chap = Jul 03 09:53:47.913187 np0000004400 cinder-backup[101319]: iface.strict_login_compliance = Jul 03 09:53:47.913187 np0000004400 cinder-backup[101319]: iface.discovery_auth = Jul 03 09:53:47.913187 np0000004400 cinder-backup[101319]: iface.discovery_logout = Jul 03 09:53:47.913187 np0000004400 cinder-backup[101319]: node.discovery_address = Jul 03 09:53:47.913187 np0000004400 cinder-backup[101319]: node.discovery_port = 0 Jul 03 09:53:47.913187 np0000004400 cinder-backup[101319]: node.discovery_type = fw Jul 03 09:53:47.913187 np0000004400 cinder-backup[101319]: node.session.initial_cmdsn = 0 Jul 03 09:53:47.913187 np0000004400 cinder-backup[101319]: node.session.initial_login_retry_max = 8 Jul 03 09:53:47.913187 np0000004400 cinder-backup[101319]: node.session.xmit_thread_priority = 0 Jul 03 09:53:47.913187 np0000004400 cinder-backup[101319]: node.session.cmds_max = 128 Jul 03 09:53:47.913187 np0000004400 cinder-backup[101319]: node.session.queue_depth = 32 Jul 03 09:53:47.913187 np0000004400 cinder-backup[101319]: node.session.nr_sessions = 1 Jul 03 09:53:47.913187 np0000004400 cinder-backup[101319]: node.session.auth.authmethod = None Jul 03 09:53:47.913187 np0000004400 cinder-backup[101319]: node.session.auth.username = Jul 03 09:53:47.913187 np0000004400 cinder-backup[101319]: node.session.auth.password = *** Jul 03 09:53:47.913187 np0000004400 cinder-backup[101319]: node.session.auth.username_in = Jul 03 09:53:47.913187 np0000004400 cinder-backup[101319]: node.session.auth.password_in = Jul 03 09:53:47.913187 np0000004400 cinder-backup[101319]: node.session.auth.chap_algs = SHA256 Jul 03 09:53:47.913187 np0000004400 cinder-backup[101319]: node.session.timeo.replacement_timeout = 120 Jul 03 09:53:47.913187 np0000004400 cinder-backup[101319]: node.session.err_timeo.abort_timeout = 15 Jul 03 09:53:47.913187 np0000004400 cinder-backup[101319]: node.session.err_timeo.lu_reset_timeout = 30 Jul 03 09:53:47.913187 np0000004400 cinder-backup[101319]: node.session.err_timeo.tgt_reset_timeout = 30 Jul 03 09:53:47.913187 np0000004400 cinder-backup[101319]: node.session.err_timeo.host_reset_timeout = 60 Jul 03 09:53:47.913187 np0000004400 cinder-backup[101319]: node.session.iscsi.FastAbort = Yes Jul 03 09:53:47.913187 np0000004400 cinder-backup[101319]: node.session.iscsi.InitialR2T = No Jul 03 09:53:47.913187 np0000004400 cinder-backup[101319]: node.session.iscsi.ImmediateData = Yes Jul 03 09:53:47.913187 np0000004400 cinder-backup[101319]: node.session.iscsi.FirstBurstLength = 262144 Jul 03 09:53:47.913187 np0000004400 cinder-backup[101319]: node.session.iscsi.MaxBurstLength = 16776192 Jul 03 09:53:47.913187 np0000004400 cinder-backup[101319]: node.session.iscsi.DefaultTime2Retain = 0 Jul 03 09:53:47.913187 np0000004400 cinder-backup[101319]: node.session.iscsi.DefaultTime2Wait = 2 Jul 03 09:53:47.913187 np0000004400 cinder-backup[101319]: node.session.iscsi.MaxConnections = 1 Jul 03 09:53:47.913187 np0000004400 cinder-backup[101319]: node.session.iscsi.MaxOutstandingR2T = 1 Jul 03 09:53:47.913187 np0000004400 cinder-backup[101319]: node.session.iscsi.ERL = 0 Jul 03 09:53:47.913187 np0000004400 cinder-backup[101319]: node.session.scan = auto Jul 03 09:53:47.913187 np0000004400 cinder-backup[101319]: node.session.reopen_max = 0 Jul 03 09:53:47.913187 np0000004400 cinder-backup[101319]: node.conn[0].address = 192.168.40.100 Jul 03 09:53:47.913187 np0000004400 cinder-backup[101319]: node.conn[0].port = 3260 Jul 03 09:53:47.913187 np0000004400 cinder-backup[101319]: node.conn[0].startup = manual Jul 03 09:53:47.913187 np0000004400 cinder-backup[101319]: node.conn[0].tcp.window_size = 524288 Jul 03 09:53:47.913187 np0000004400 cinder-backup[101319]: node.conn[0].tcp.type_of_service = 0 Jul 03 09:53:47.913187 np0000004400 cinder-backup[101319]: node.conn[0].timeo.logout_timeout = 15 Jul 03 09:53:47.913187 np0000004400 cinder-backup[101319]: node.conn[0].timeo.login_timeout = 15 Jul 03 09:53:47.913187 np0000004400 cinder-backup[101319]: node.conn[0].timeo.auth_timeout = 45 Jul 03 09:53:47.913187 np0000004400 cinder-backup[101319]: node.conn[0].timeo.noop_out_interval = 5 Jul 03 09:53:47.913187 np0000004400 cinder-backup[101319]: node.conn[0].timeo.noop_out_timeout = 5 Jul 03 09:53:47.913187 np0000004400 cinder-backup[101319]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0 Jul 03 09:53:47.913187 np0000004400 cinder-backup[101319]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144 Jul 03 09:53:47.913187 np0000004400 cinder-backup[101319]: node.conn[0].iscsi.HeaderDigest = None Jul 03 09:53:47.913187 np0000004400 cinder-backup[101319]: node.conn[0].iscsi.DataDigest = None Jul 03 09:53:47.913187 np0000004400 cinder-backup[101319]: node.conn[0].iscsi.IFMarker = No Jul 03 09:53:47.913187 np0000004400 cinder-backup[101319]: node.conn[0].iscsi.OFMarker = No Jul 03 09:53:47.913187 np0000004400 cinder-backup[101319]: # END RECORD Jul 03 09:53:47.913187 np0000004400 cinder-backup[101319]: stderr= {{(pid=101319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 03 09:53:47.937016 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c8f0b9c-3469-46f6-ba0e-fba74e3be6db tempest-ProjectMemberTests33-2105464604 None] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=101319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 03 09:53:47.958922 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c8f0b9c-3469-46f6-ba0e-fba74e3be6db tempest-ProjectMemberTests33-2105464604 None] iscsiadm ('-m', 'session'): stdout=tcp: [188] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-491c39b6-d2e0-4f67-9a64-590d50f06197 (non-flash) Jul 03 09:53:47.958922 np0000004400 cinder-backup[101319]: tcp: [189] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-491c39b6-d2e0-4f67-9a64-590d50f06197 (non-flash) Jul 03 09:53:47.958922 np0000004400 cinder-backup[101319]: tcp: [203] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-79c374d0-f293-429e-9f7e-a6ac9afa4c99 (non-flash) Jul 03 09:53:47.958922 np0000004400 cinder-backup[101319]: tcp: [204] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-79c374d0-f293-429e-9f7e-a6ac9afa4c99 (non-flash) Jul 03 09:53:47.958922 np0000004400 cinder-backup[101319]: tcp: [205] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-61c7989b-d6b3-4a39-80a6-9fc519424447 (non-flash) Jul 03 09:53:47.958922 np0000004400 cinder-backup[101319]: tcp: [206] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b578d41f-4c6a-49b3-b5ec-bcd6556e2e68 (non-flash) Jul 03 09:53:47.958922 np0000004400 cinder-backup[101319]: stderr= {{(pid=101319) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jul 03 09:53:47.959768 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c8f0b9c-3469-46f6-ba0e-fba74e3be6db tempest-ProjectMemberTests33-2105464604 None] iscsi session list stdout=tcp: [188] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-491c39b6-d2e0-4f67-9a64-590d50f06197 (non-flash) Jul 03 09:53:47.959768 np0000004400 cinder-backup[101319]: tcp: [189] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-491c39b6-d2e0-4f67-9a64-590d50f06197 (non-flash) Jul 03 09:53:47.959768 np0000004400 cinder-backup[101319]: tcp: [203] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-79c374d0-f293-429e-9f7e-a6ac9afa4c99 (non-flash) Jul 03 09:53:47.959768 np0000004400 cinder-backup[101319]: tcp: [204] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-79c374d0-f293-429e-9f7e-a6ac9afa4c99 (non-flash) Jul 03 09:53:47.959768 np0000004400 cinder-backup[101319]: tcp: [205] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-61c7989b-d6b3-4a39-80a6-9fc519424447 (non-flash) Jul 03 09:53:47.959768 np0000004400 cinder-backup[101319]: tcp: [206] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b578d41f-4c6a-49b3-b5ec-bcd6556e2e68 (non-flash) Jul 03 09:53:47.959768 np0000004400 cinder-backup[101319]: stderr= {{(pid=101319) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jul 03 09:53:47.985877 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-e785f663-f83e-414e-8ac2-4ca69114ccec tempest-VolumesBackupsTest-807180270 None] Backing up chunk of data from volume. {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 09:53:48.006823 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c8f0b9c-3469-46f6-ba0e-fba74e3be6db tempest-ProjectMemberTests33-2105464604 None] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-5f57fed7-aa36-44c5-af90-863bd3d3af9d, portal: 192.168.40.100,3260] Jul 03 09:53:48.006823 np0000004400 cinder-backup[101319]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-5f57fed7-aa36-44c5-af90-863bd3d3af9d, portal: 192.168.40.100,3260] successful. Jul 03 09:53:48.006823 np0000004400 cinder-backup[101319]: stderr= {{(pid=101319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 03 09:53:48.019687 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c8f0b9c-3469-46f6-ba0e-fba74e3be6db tempest-ProjectMemberTests33-2105464604 None] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=101319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 03 09:53:48.037738 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c8f0b9c-3469-46f6-ba0e-fba74e3be6db tempest-ProjectMemberTests33-2105464604 None] iscsiadm ('-m', 'session'): stdout=tcp: [188] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-491c39b6-d2e0-4f67-9a64-590d50f06197 (non-flash) Jul 03 09:53:48.037738 np0000004400 cinder-backup[101319]: tcp: [189] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-491c39b6-d2e0-4f67-9a64-590d50f06197 (non-flash) Jul 03 09:53:48.037738 np0000004400 cinder-backup[101319]: tcp: [203] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-79c374d0-f293-429e-9f7e-a6ac9afa4c99 (non-flash) Jul 03 09:53:48.037738 np0000004400 cinder-backup[101319]: tcp: [204] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-79c374d0-f293-429e-9f7e-a6ac9afa4c99 (non-flash) Jul 03 09:53:48.037738 np0000004400 cinder-backup[101319]: tcp: [205] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-61c7989b-d6b3-4a39-80a6-9fc519424447 (non-flash) Jul 03 09:53:48.037738 np0000004400 cinder-backup[101319]: tcp: [206] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b578d41f-4c6a-49b3-b5ec-bcd6556e2e68 (non-flash) Jul 03 09:53:48.037738 np0000004400 cinder-backup[101319]: tcp: [207] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5f57fed7-aa36-44c5-af90-863bd3d3af9d (non-flash) Jul 03 09:53:48.037738 np0000004400 cinder-backup[101319]: stderr= {{(pid=101319) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jul 03 09:53:48.038823 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c8f0b9c-3469-46f6-ba0e-fba74e3be6db tempest-ProjectMemberTests33-2105464604 None] iscsi session list stdout=tcp: [188] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-491c39b6-d2e0-4f67-9a64-590d50f06197 (non-flash) Jul 03 09:53:48.038823 np0000004400 cinder-backup[101319]: tcp: [189] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-491c39b6-d2e0-4f67-9a64-590d50f06197 (non-flash) Jul 03 09:53:48.038823 np0000004400 cinder-backup[101319]: tcp: [203] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-79c374d0-f293-429e-9f7e-a6ac9afa4c99 (non-flash) Jul 03 09:53:48.038823 np0000004400 cinder-backup[101319]: tcp: [204] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-79c374d0-f293-429e-9f7e-a6ac9afa4c99 (non-flash) Jul 03 09:53:48.038823 np0000004400 cinder-backup[101319]: tcp: [205] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-61c7989b-d6b3-4a39-80a6-9fc519424447 (non-flash) Jul 03 09:53:48.038823 np0000004400 cinder-backup[101319]: tcp: [206] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b578d41f-4c6a-49b3-b5ec-bcd6556e2e68 (non-flash) Jul 03 09:53:48.038823 np0000004400 cinder-backup[101319]: tcp: [207] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5f57fed7-aa36-44c5-af90-863bd3d3af9d (non-flash) Jul 03 09:53:48.038823 np0000004400 cinder-backup[101319]: stderr= {{(pid=101319) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jul 03 09:53:48.040075 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.base [None req-0c8f0b9c-3469-46f6-ba0e-fba74e3be6db tempest-ProjectMemberTests33-2105464604 None] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-5f57fed7-aa36-44c5-af90-863bd3d3af9d" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.202s {{(pid=101319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jul 03 09:53:48.040895 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c8f0b9c-3469-46f6-ba0e-fba74e3be6db tempest-ProjectMemberTests33-2105464604 None] Connected to 192.168.40.100:3260 {{(pid=101319) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}} Jul 03 09:53:48.043518 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.linuxscsi [None req-0c8f0b9c-3469-46f6-ba0e-fba74e3be6db tempest-ProjectMemberTests33-2105464604 None] HCTL ('10', '-', '-', 0) found on session 207 with lun 0 {{(pid=101319) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}} Jul 03 09:53:48.043863 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.linuxscsi [None req-0c8f0b9c-3469-46f6-ba0e-fba74e3be6db tempest-ProjectMemberTests33-2105464604 None] Scanning host 10 c: -, t: -, l: 0) {{(pid=101319) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}} Jul 03 09:53:48.056569 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.linuxscsi [None req-0c8f0b9c-3469-46f6-ba0e-fba74e3be6db tempest-ProjectMemberTests33-2105464604 None] Searching for a device in session 207 and hctl ['10', '*', '*', 0] yield: sde {{(pid=101319) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}} Jul 03 09:53:48.056734 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c8f0b9c-3469-46f6-ba0e-fba74e3be6db tempest-ProjectMemberTests33-2105464604 None] Connected to sde using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-5f57fed7-aa36-44c5-af90-863bd3d3af9d', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '5f57fed7-aa36-44c5-af90-863bd3d3af9d', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': False} {{(pid=101319) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}} Jul 03 09:53:48.091629 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-0348256d-c334-445a-abfb-8501d08ca9f1 tempest-ProjectReaderTests33-761902925 None] Backing up chunk of data from volume. {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 09:53:48.241936 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-e785f663-f83e-414e-8ac2-4ca69114ccec tempest-VolumesBackupsTest-807180270 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101319) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 09:53:48.242105 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-e785f663-f83e-414e-8ac2-4ca69114ccec tempest-VolumesBackupsTest-807180270 None] About to put_object {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 09:53:48.343245 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-e785f663-f83e-414e-8ac2-4ca69114ccec tempest-VolumesBackupsTest-807180270 None] backup MD5 for volume_b578d41f-4c6a-49b3-b5ec-bcd6556e2e68/20260703095347/az_nova_backup_c52fbc4a-f7d8-49e2-bd92-5bbf2f7f98ba-00002: 25e317773f308e446cc84c503a6d1f85 {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 09:53:48.343401 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-e785f663-f83e-414e-8ac2-4ca69114ccec tempest-VolumesBackupsTest-807180270 None] Calling eventlet.sleep(0) {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 09:53:48.345101 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-0348256d-c334-445a-abfb-8501d08ca9f1 tempest-ProjectReaderTests33-761902925 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101319) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 09:53:48.345230 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-0348256d-c334-445a-abfb-8501d08ca9f1 tempest-ProjectReaderTests33-761902925 None] About to put_object {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 09:53:48.455558 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-0348256d-c334-445a-abfb-8501d08ca9f1 tempest-ProjectReaderTests33-761902925 None] backup MD5 for volume_61c7989b-d6b3-4a39-80a6-9fc519424447/20260703095337/az_nova_backup_3905268c-9301-4198-bac6-c3c450e69ce2-00019: 25e317773f308e446cc84c503a6d1f85 {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 09:53:48.456306 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-0348256d-c334-445a-abfb-8501d08ca9f1 tempest-ProjectReaderTests33-761902925 None] Calling eventlet.sleep(0) {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 09:53:48.556643 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-e785f663-f83e-414e-8ac2-4ca69114ccec tempest-VolumesBackupsTest-807180270 None] Backing up chunk of data from volume. {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 09:53:48.680800 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-0348256d-c334-445a-abfb-8501d08ca9f1 tempest-ProjectReaderTests33-761902925 None] Backing up chunk of data from volume. {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 09:53:48.868833 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-e785f663-f83e-414e-8ac2-4ca69114ccec tempest-VolumesBackupsTest-807180270 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101319) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 09:53:48.869027 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-e785f663-f83e-414e-8ac2-4ca69114ccec tempest-VolumesBackupsTest-807180270 None] About to put_object {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 09:53:48.920285 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-0348256d-c334-445a-abfb-8501d08ca9f1 tempest-ProjectReaderTests33-761902925 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101319) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 09:53:48.920476 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-0348256d-c334-445a-abfb-8501d08ca9f1 tempest-ProjectReaderTests33-761902925 None] About to put_object {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 09:53:48.969622 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-e785f663-f83e-414e-8ac2-4ca69114ccec tempest-VolumesBackupsTest-807180270 None] backup MD5 for volume_b578d41f-4c6a-49b3-b5ec-bcd6556e2e68/20260703095347/az_nova_backup_c52fbc4a-f7d8-49e2-bd92-5bbf2f7f98ba-00003: 25e317773f308e446cc84c503a6d1f85 {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 09:53:48.969622 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-e785f663-f83e-414e-8ac2-4ca69114ccec tempest-VolumesBackupsTest-807180270 None] Calling eventlet.sleep(0) {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 09:53:49.025390 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-0348256d-c334-445a-abfb-8501d08ca9f1 tempest-ProjectReaderTests33-761902925 None] backup MD5 for volume_61c7989b-d6b3-4a39-80a6-9fc519424447/20260703095337/az_nova_backup_3905268c-9301-4198-bac6-c3c450e69ce2-00020: 25e317773f308e446cc84c503a6d1f85 {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 09:53:49.026115 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-0348256d-c334-445a-abfb-8501d08ca9f1 tempest-ProjectReaderTests33-761902925 None] Calling eventlet.sleep(0) {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 09:53:49.071268 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.base [None req-0c8f0b9c-3469-46f6-ba0e-fba74e3be6db tempest-ProjectMemberTests33-2105464604 None] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 2.275s {{(pid=101319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jul 03 09:53:49.075079 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c8f0b9c-3469-46f6-ba0e-fba74e3be6db tempest-ProjectMemberTests33-2105464604 None] <== connect_volume: return (3878ms) {'type': 'block', 'scsi_wwn': 'SStorPool_iSCSI_DISK_1034578903445799233', 'path': '/dev/sde'} {{(pid=101319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}} Jul 03 09:53:49.077003 np0000004400 cinder-backup[101319]: DEBUG oslo_concurrency.processutils [None req-0c8f0b9c-3469-46f6-ba0e-fba74e3be6db tempest-ProjectMemberTests33-2105464604 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chown 1002 /dev/sde {{(pid=101319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 09:53:49.104442 np0000004400 sudo[155326]: stack : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chown 1002 /dev/sde Jul 03 09:53:49.105194 np0000004400 sudo[155326]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1002) Jul 03 09:53:49.201310 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-0348256d-c334-445a-abfb-8501d08ca9f1 tempest-ProjectReaderTests33-761902925 None] Backing up chunk of data from volume. {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 09:53:49.219482 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-e785f663-f83e-414e-8ac2-4ca69114ccec tempest-VolumesBackupsTest-807180270 None] Backing up chunk of data from volume. {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 09:53:49.319351 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-0348256d-c334-445a-abfb-8501d08ca9f1 tempest-ProjectReaderTests33-761902925 None] Compressed 25165824 bytes of data to 24470 bytes using zlib. {{(pid=101319) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 09:53:49.319549 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-0348256d-c334-445a-abfb-8501d08ca9f1 tempest-ProjectReaderTests33-761902925 None] About to put_object {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 09:53:49.393381 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-0348256d-c334-445a-abfb-8501d08ca9f1 tempest-ProjectReaderTests33-761902925 None] backup MD5 for volume_61c7989b-d6b3-4a39-80a6-9fc519424447/20260703095337/az_nova_backup_3905268c-9301-4198-bac6-c3c450e69ce2-00021: 77377273b0a4b61febdbf7bbf52b9db9 {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 09:53:49.393534 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-0348256d-c334-445a-abfb-8501d08ca9f1 tempest-ProjectReaderTests33-761902925 None] Calling eventlet.sleep(0) {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 09:53:49.400031 np0000004400 sudo[155326]: pam_unix(sudo:session): session closed for user root Jul 03 09:53:49.402002 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.driver [None req-0348256d-c334-445a-abfb-8501d08ca9f1 tempest-ProjectReaderTests33-761902925 None] Getting metadata type 'volume-base-metadata' {{(pid=101319) _save_vol_base_meta /opt/stack/cinder/cinder/backup/driver.py:79}} Jul 03 09:53:49.404280 np0000004400 cinder-backup[101319]: DEBUG oslo_concurrency.processutils [None req-0c8f0b9c-3469-46f6-ba0e-fba74e3be6db tempest-ProjectMemberTests33-2105464604 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chown 1002 /dev/sde" returned: 0 in 0.328s {{(pid=101319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 09:53:49.433292 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.driver [None req-0348256d-c334-445a-abfb-8501d08ca9f1 tempest-ProjectReaderTests33-761902925 None] Completed fetching metadata type 'volume-base-metadata' {{(pid=101319) _save_vol_base_meta /opt/stack/cinder/cinder/backup/driver.py:98}} Jul 03 09:53:49.433292 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.driver [None req-0348256d-c334-445a-abfb-8501d08ca9f1 tempest-ProjectReaderTests33-761902925 None] Getting metadata type 'volume-metadata' {{(pid=101319) _save_vol_meta /opt/stack/cinder/cinder/backup/driver.py:109}} Jul 03 09:53:49.439863 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.driver [None req-0348256d-c334-445a-abfb-8501d08ca9f1 tempest-ProjectReaderTests33-761902925 None] No metadata type 'volume-metadata' available {{(pid=101319) _save_vol_meta /opt/stack/cinder/cinder/backup/driver.py:123}} Jul 03 09:53:49.440045 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.driver [None req-0348256d-c334-445a-abfb-8501d08ca9f1 tempest-ProjectReaderTests33-761902925 None] Getting metadata type 'volume-glance-metadata' {{(pid=101319) _save_vol_glance_meta /opt/stack/cinder/cinder/backup/driver.py:132}} Jul 03 09:53:49.445463 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.driver [None req-0348256d-c334-445a-abfb-8501d08ca9f1 tempest-ProjectReaderTests33-761902925 None] No metadata type 'volume-glance-metadata' available {{(pid=101319) _save_vol_glance_meta /opt/stack/cinder/cinder/backup/driver.py:147}} Jul 03 09:53:49.445705 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-0348256d-c334-445a-abfb-8501d08ca9f1 tempest-ProjectReaderTests33-761902925 None] _write_sha256file started, container name: volumebackups, sha256file filename: volume_61c7989b-d6b3-4a39-80a6-9fc519424447/20260703095337/az_nova_backup_3905268c-9301-4198-bac6-c3c450e69ce2_sha256file. {{(pid=101319) _write_sha256file /opt/stack/cinder/cinder/backup/chunkeddriver.py:299}} Jul 03 09:53:49.460035 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-0c8f0b9c-3469-46f6-ba0e-fba74e3be6db tempest-ProjectMemberTests33-2105464604 None] _create_container started, container: volumebackups,backup: 885775bd-f91a-424f-bc10-7913c6a90400. {{(pid=101319) _create_container /opt/stack/cinder/cinder/backup/chunkeddriver.py:249}} Jul 03 09:53:49.465920 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-e785f663-f83e-414e-8ac2-4ca69114ccec tempest-VolumesBackupsTest-807180270 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101319) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 09:53:49.466359 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-e785f663-f83e-414e-8ac2-4ca69114ccec tempest-VolumesBackupsTest-807180270 None] About to put_object {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 09:53:49.516185 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-0348256d-c334-445a-abfb-8501d08ca9f1 tempest-ProjectReaderTests33-761902925 None] _write_sha256file finished. {{(pid=101319) _write_sha256file /opt/stack/cinder/cinder/backup/chunkeddriver.py:315}} Jul 03 09:53:49.517016 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-0348256d-c334-445a-abfb-8501d08ca9f1 tempest-ProjectReaderTests33-761902925 None] _write_metadata started, container name: volumebackups, metadata filename: volume_61c7989b-d6b3-4a39-80a6-9fc519424447/20260703095337/az_nova_backup_3905268c-9301-4198-bac6-c3c450e69ce2_metadata. {{(pid=101319) _write_metadata /opt/stack/cinder/cinder/backup/chunkeddriver.py:276}} Jul 03 09:53:49.528149 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.drivers.swift [None req-0c8f0b9c-3469-46f6-ba0e-fba74e3be6db tempest-ProjectMemberTests33-2105464604 None] generate_object_name_prefix: volume_5f57fed7-aa36-44c5-af90-863bd3d3af9d/20260703095349/az_nova_backup_885775bd-f91a-424f-bc10-7913c6a90400 {{(pid=101319) _generate_object_name_prefix /opt/stack/cinder/cinder/backup/drivers/swift.py:452}} Jul 03 09:53:49.536165 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-0c8f0b9c-3469-46f6-ba0e-fba74e3be6db tempest-ProjectMemberTests33-2105464604 None] starting backup of volume: 5f57fed7-aa36-44c5-af90-863bd3d3af9d, volume size: 1073741824, object names prefix volume_5f57fed7-aa36-44c5-af90-863bd3d3af9d/20260703095349/az_nova_backup_885775bd-f91a-424f-bc10-7913c6a90400, availability zone: nova {{(pid=101319) _prepare_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:359}} Jul 03 09:53:49.540768 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-0348256d-c334-445a-abfb-8501d08ca9f1 tempest-ProjectReaderTests33-761902925 None] _write_metadata finished. Metadata: b'{\n "backup_description": null,\n "backup_id": "3905268c-9301-4198-bac6-c3c450e69ce2",\n "backup_name": "tempest-type-Backup-1749993939",\n "created_at": "2026-07-03 09:53:33+00:00",\n "objects": [\n {\n "volume_61c7989b-d6b3-4a39-80a6-9fc519424447/20260703095337/az_nova_backup_3905268c-9301-4198-bac6-c3c450e69ce2-00001": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 0\n }\n },\n {\n "volume_61c7989b-d6b3-4a39-80a6-9fc519424447/20260703095337/az_nova_backup_3905268c-9301-4198-bac6-c3c450e69ce2-00002": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 52428800\n }\n },\n {\n "volume_61c7989b-d6b3-4a39-80a6-9fc519424447/20260703095337/az_nova_backup_3905268c-9301-4198-bac6-c3c450e69ce2-00003": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 104857600\n }\n },\n {\n "volume_61c7989b-d6b3-4a39-80a6-9fc519424447/20260703095337/az_nova_backup_3905268c-9301-4198-bac6-c3c450e69ce2-00004": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 157286400\n }\n },\n {\n "volume_61c7989b-d6b3-4a39-80a6-9fc519424447/20260703095337/az_nova_backup_3905268c-9301-4198-bac6-c3c450e69ce2-00005": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 209715200\n }\n },\n {\n "volume_61c7989b-d6b3-4a39-80a6-9fc519424447/20260703095337/az_nova_backup_3905268c-9301-4198-bac6-c3c450e69ce2-00006": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 262144000\n }\n },\n {\n "volume_61c7989b-d6b3-4a39-80a6-9fc519424447/20260703095337/az_nova_backup_3905268c-9301-4198-bac6-c3c450e69ce2-00007": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 314572800\n }\n },\n {\n "volume_61c7989b-d6b3-4a39-80a6-9fc519424447/20260703095337/az_nova_backup_3905268c-9301-4198-bac6-c3c450e69ce2-00008": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 367001600\n }\n },\n {\n "volume_61c7989b-d6b3-4a39-80a6-9fc519424447/20260703095337/az_nova_backup_3905268c-9301-4198-bac6-c3c450e69ce2-00009": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 419430400\n }\n },\n {\n "volume_61c7989b-d6b3-4a39-80a6-9fc519424447/20260703095337/az_nova_backup_3905268c-9301-4198-bac6-c3c450e69ce2-00010": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 471859200\n }\n },\n {\n "volume_61c7989b-d6b3-4a39-80a6-9fc519424447/20260703095337/az_nova_backup_3905268c-9301-4198-bac6-c3c450e69ce2-00011": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 524288000\n }\n },\n {\n "volume_61c7989b-d6b3-4a39-80a6-9fc519424447/20260703095337/az_nova_backup_3905268c-9301-4198-bac6-c3c450e69ce2-00012": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 576716800\n }\n },\n {\n "volume_61c7989b-d6b3-4a39-80a6-9fc519424447/20260703095337/az_nova_backup_3905268c-9301-4198-bac6-c3c450e69ce2-00013": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 629145600\n }\n },\n {\n "volume_61c7989b-d6b3-4a39-80a6-9fc519424447/20260703095337/az_nova_backup_3905268c-9301-4198-bac6-c3c450e69ce2-00014": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 681574400\n }\n },\n {\n "volume_61c7989b-d6b3-4a39-80a6-9fc519424447/20260703095337/az_nova_backup_3905268c-9301-4198-bac6-c3c450e69ce2-00015": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 734003200\n }\n },\n {\n "volume_61c7989b-d6b3-4a39-80a6-9fc519424447/20260703095337/az_nova_backup_3905268c-9301-4198-bac6-c3c450e69ce2-00016": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 786432000\n }\n },\n {\n "volume_61c7989b-d6b3-4a39-80a6-9fc519424447/20260703095337/az_nova_backup_3905268c-9301-4198-bac6-c3c450e69ce2-00017": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 838860800\n }\n },\n {\n "volume_61c7989b-d6b3-4a39-80a6-9fc519424447/20260703095337/az_nova_backup_3905268c-9301-4198-bac6-c3c450e69ce2-00018": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 891289600\n }\n },\n {\n "volume_61c7989b-d6b3-4a39-80a6-9fc519424447/20260703095337/az_nova_backup_3905268c-9301-4198-bac6-c3c450e69ce2-00019": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 943718400\n }\n },\n {\n "volume_61c7989b-d6b3-4a39-80a6-9fc519424447/20260703095337/az_nova_backup_3905268c-9301-4198-bac6-c3c450e69ce2-00020": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 996147200\n }\n },\n {\n "volume_61c7989b-d6b3-4a39-80a6-9fc519424447/20260703095337/az_nova_backup_3905268c-9301-4198-bac6-c3c450e69ce2-00021": {\n "compression": "zlib",\n "length": 25165824,\n "md5": "77377273b0a4b61febdbf7bbf52b9db9",\n "offset": 1048576000\n }\n }\n ],\n "parent_id": null,\n "version": "1.0.0",\n "volume_id": "61c7989b-d6b3-4a39-80a6-9fc519424447",\n "volume_meta": "{\\"version\\": 2, \\"volume-base-metadata\\": {\\"id\\": \\"61c7989b-d6b3-4a39-80a6-9fc519424447\\", \\"_name_id\\": null, \\"use_quota\\": true, \\"ec2_id\\": null, \\"user_id\\": \\"45a99ff133014c9a8bfd931707d31606\\", \\"project_id\\": \\"e331bd155b824bbb8979e9aac5023870\\", \\"snapshot_id\\": null, \\"cluster_name\\": null, \\"host\\": \\"np0000004400@storpool#default\\", \\"size\\": 1, \\"availability_zone\\": \\"nova\\", \\"status\\": \\"backing-up\\", \\"attach_status\\": \\"detached\\", \\"migration_status\\": null, \\"scheduled_at\\": \\"2026-07-03T09:53:32.000000\\", \\"launched_at\\": \\"2026-07-03T09:53:32.000000\\", \\"terminated_at\\": null, \\"display_name\\": \\"tempest-VolumeV3RbacBaseTests-Volume-34589180\\", \\"display_description\\": null, \\"provider_location\\": null, \\"provider_auth\\": null, \\"provider_geometry\\": null, \\"provider_id\\": null, \\"volume_type_id\\": \\"03e13fe6-0e30-4803-ace0-725d38e6dc24\\", \\"source_volid\\": null, \\"encryption_key_id\\": null, \\"consistencygroup_id\\": null, \\"group_id\\": null, \\"bootable\\": false, \\"multiattach\\": false, \\"replication_status\\": null, \\"replication_extended_status\\": null, \\"replication_driver_data\\": null, \\"previous_status\\": \\"available\\", \\"service_uuid\\": \\"6d4b0e79-fefe-4744-b25f-34be05095200\\", \\"shared_targets\\": true, \\"deleted_at\\": null, \\"deleted\\": false, \\"created_at\\": \\"2026-07-03T09:53:32.000000\\", \\"updated_at\\": \\"2026-07-03T09:53:33.000000\\"}}"\n}'. {{(pid=101319) _write_metadata /opt/stack/cinder/cinder/backup/chunkeddriver.py:295}} Jul 03 09:53:49.546257 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-0348256d-c334-445a-abfb-8501d08ca9f1 tempest-ProjectReaderTests33-761902925 None] backup 3905268c-9301-4198-bac6-c3c450e69ce2 finished. {{(pid=101319) _finalize_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:462}} Jul 03 09:53:49.689680 np0000004400 cinder-backup[101319]: DEBUG oslo_concurrency.processutils [None req-0348256d-c334-445a-abfb-8501d08ca9f1 tempest-ProjectReaderTests33-761902925 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chown 0 /dev/sdl {{(pid=101319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 09:53:49.700937 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-e785f663-f83e-414e-8ac2-4ca69114ccec tempest-VolumesBackupsTest-807180270 None] backup MD5 for volume_b578d41f-4c6a-49b3-b5ec-bcd6556e2e68/20260703095347/az_nova_backup_c52fbc4a-f7d8-49e2-bd92-5bbf2f7f98ba-00004: 25e317773f308e446cc84c503a6d1f85 {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 09:53:49.701314 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-e785f663-f83e-414e-8ac2-4ca69114ccec tempest-VolumesBackupsTest-807180270 None] Calling eventlet.sleep(0) {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 09:53:49.712982 np0000004400 sudo[155334]: stack : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chown 0 /dev/sdl Jul 03 09:53:49.713645 np0000004400 sudo[155334]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1002) Jul 03 09:53:49.757090 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-0c8f0b9c-3469-46f6-ba0e-fba74e3be6db tempest-ProjectMemberTests33-2105464604 None] Backing up chunk of data from volume. {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 09:53:49.892830 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-e785f663-f83e-414e-8ac2-4ca69114ccec tempest-VolumesBackupsTest-807180270 None] Backing up chunk of data from volume. {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 09:53:49.999581 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-0c8f0b9c-3469-46f6-ba0e-fba74e3be6db tempest-ProjectMemberTests33-2105464604 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101319) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 09:53:50.000041 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-0c8f0b9c-3469-46f6-ba0e-fba74e3be6db tempest-ProjectMemberTests33-2105464604 None] About to put_object {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 09:53:50.017042 np0000004400 sudo[155334]: pam_unix(sudo:session): session closed for user root Jul 03 09:53:50.021255 np0000004400 cinder-backup[101319]: DEBUG oslo_concurrency.processutils [None req-0348256d-c334-445a-abfb-8501d08ca9f1 tempest-ProjectReaderTests33-761902925 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chown 0 /dev/sdl" returned: 0 in 0.332s {{(pid=101319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 09:53:50.021958 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-0348256d-c334-445a-abfb-8501d08ca9f1 tempest-ProjectReaderTests33-761902925 None] ==> disconnect_volume: call "{'args': (, {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-61c7989b-d6b3-4a39-80a6-9fc519424447', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '61c7989b-d6b3-4a39-80a6-9fc519424447', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': False}, {'type': 'block', 'scsi_wwn': '1StorPooliSCSI_DISK_1034578903445799235', 'path': '/dev/sdl'}), 'kwargs': {'force': True, 'ignore_errors': True}}" {{(pid=101319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}} Jul 03 09:53:50.022165 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.base [None req-0348256d-c334-445a-abfb-8501d08ca9f1 tempest-ProjectReaderTests33-761902925 None] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=101319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jul 03 09:53:50.022685 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.base [None req-0348256d-c334-445a-abfb-8501d08ca9f1 tempest-ProjectReaderTests33-761902925 None] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=101319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jul 03 09:53:50.023117 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-0348256d-c334-445a-abfb-8501d08ca9f1 tempest-ProjectReaderTests33-761902925 None] _get_connection_devices called with parameters: connection_properties={'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-61c7989b-d6b3-4a39-80a6-9fc519424447', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '61c7989b-d6b3-4a39-80a6-9fc519424447', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': False}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=101319) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:847}} Jul 03 09:53:50.038163 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-0348256d-c334-445a-abfb-8501d08ca9f1 tempest-ProjectReaderTests33-761902925 None] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS: Jul 03 09:53:50.038163 np0000004400 cinder-backup[101319]: No targets found. Jul 03 09:53:50.038163 np0000004400 cinder-backup[101319]: iSNS: Jul 03 09:53:50.038163 np0000004400 cinder-backup[101319]: No targets found. Jul 03 09:53:50.038163 np0000004400 cinder-backup[101319]: STATIC: Jul 03 09:53:50.038163 np0000004400 cinder-backup[101319]: Target: iqn.2023-03.storpool.com:os--volume-491c39b6-d2e0-4f67-9a64-590d50f06197 Jul 03 09:53:50.038163 np0000004400 cinder-backup[101319]: Portal: 192.168.50.100:3260,-1 Jul 03 09:53:50.038163 np0000004400 cinder-backup[101319]: Iface Name: default Jul 03 09:53:50.038163 np0000004400 cinder-backup[101319]: Portal: 192.168.40.100:3260,-1 Jul 03 09:53:50.038163 np0000004400 cinder-backup[101319]: Iface Name: default Jul 03 09:53:50.038163 np0000004400 cinder-backup[101319]: Target: iqn.2023-03.storpool.com:os--volume-b578d41f-4c6a-49b3-b5ec-bcd6556e2e68 Jul 03 09:53:50.038163 np0000004400 cinder-backup[101319]: Portal: 192.168.40.100:3260,-1 Jul 03 09:53:50.038163 np0000004400 cinder-backup[101319]: Iface Name: default Jul 03 09:53:50.038163 np0000004400 cinder-backup[101319]: Target: iqn.2023-03.storpool.com:os--volume-5f57fed7-aa36-44c5-af90-863bd3d3af9d Jul 03 09:53:50.038163 np0000004400 cinder-backup[101319]: Portal: 192.168.40.100:3260,-1 Jul 03 09:53:50.038163 np0000004400 cinder-backup[101319]: Iface Name: default Jul 03 09:53:50.038163 np0000004400 cinder-backup[101319]: Target: iqn.2023-03.storpool.com:os--volume-61c7989b-d6b3-4a39-80a6-9fc519424447 Jul 03 09:53:50.038163 np0000004400 cinder-backup[101319]: Portal: 192.168.40.100:3260,-1 Jul 03 09:53:50.038163 np0000004400 cinder-backup[101319]: Iface Name: default Jul 03 09:53:50.038163 np0000004400 cinder-backup[101319]: Target: iqn.2023-03.storpool.com:os--volume-79c374d0-f293-429e-9f7e-a6ac9afa4c99 Jul 03 09:53:50.038163 np0000004400 cinder-backup[101319]: Portal: 192.168.50.100:3260,-1 Jul 03 09:53:50.038163 np0000004400 cinder-backup[101319]: Iface Name: default Jul 03 09:53:50.038163 np0000004400 cinder-backup[101319]: Portal: 192.168.40.100:3260,-1 Jul 03 09:53:50.038163 np0000004400 cinder-backup[101319]: Iface Name: default Jul 03 09:53:50.038163 np0000004400 cinder-backup[101319]: FIRMWARE: Jul 03 09:53:50.038163 np0000004400 cinder-backup[101319]: No targets found. Jul 03 09:53:50.038163 np0000004400 cinder-backup[101319]: stderr= {{(pid=101319) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jul 03 09:53:50.039638 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-0348256d-c334-445a-abfb-8501d08ca9f1 tempest-ProjectReaderTests33-761902925 None] Regex to get portals from discoverydb: ^SENDTARGETS: Jul 03 09:53:50.039638 np0000004400 cinder-backup[101319]: .*?^DiscoveryAddress: 192.168.40.100,3260.*? Jul 03 09:53:50.039638 np0000004400 cinder-backup[101319]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=101319) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:390}} Jul 03 09:53:50.039638 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-0348256d-c334-445a-abfb-8501d08ca9f1 tempest-ProjectReaderTests33-761902925 None] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-61c7989b-d6b3-4a39-80a6-9fc519424447', 0)] {{(pid=101319) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:858}} Jul 03 09:53:50.067203 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-0348256d-c334-445a-abfb-8501d08ca9f1 tempest-ProjectReaderTests33-761902925 None] iscsiadm ('-m', 'session'): stdout=tcp: [188] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-491c39b6-d2e0-4f67-9a64-590d50f06197 (non-flash) Jul 03 09:53:50.067203 np0000004400 cinder-backup[101319]: tcp: [189] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-491c39b6-d2e0-4f67-9a64-590d50f06197 (non-flash) Jul 03 09:53:50.067203 np0000004400 cinder-backup[101319]: tcp: [203] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-79c374d0-f293-429e-9f7e-a6ac9afa4c99 (non-flash) Jul 03 09:53:50.067203 np0000004400 cinder-backup[101319]: tcp: [204] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-79c374d0-f293-429e-9f7e-a6ac9afa4c99 (non-flash) Jul 03 09:53:50.067203 np0000004400 cinder-backup[101319]: tcp: [205] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-61c7989b-d6b3-4a39-80a6-9fc519424447 (non-flash) Jul 03 09:53:50.067203 np0000004400 cinder-backup[101319]: tcp: [206] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b578d41f-4c6a-49b3-b5ec-bcd6556e2e68 (non-flash) Jul 03 09:53:50.067203 np0000004400 cinder-backup[101319]: tcp: [207] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5f57fed7-aa36-44c5-af90-863bd3d3af9d (non-flash) Jul 03 09:53:50.067203 np0000004400 cinder-backup[101319]: stderr= {{(pid=101319) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jul 03 09:53:50.067546 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-0348256d-c334-445a-abfb-8501d08ca9f1 tempest-ProjectReaderTests33-761902925 None] iscsi session list stdout=tcp: [188] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-491c39b6-d2e0-4f67-9a64-590d50f06197 (non-flash) Jul 03 09:53:50.067546 np0000004400 cinder-backup[101319]: tcp: [189] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-491c39b6-d2e0-4f67-9a64-590d50f06197 (non-flash) Jul 03 09:53:50.067546 np0000004400 cinder-backup[101319]: tcp: [203] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-79c374d0-f293-429e-9f7e-a6ac9afa4c99 (non-flash) Jul 03 09:53:50.067546 np0000004400 cinder-backup[101319]: tcp: [204] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-79c374d0-f293-429e-9f7e-a6ac9afa4c99 (non-flash) Jul 03 09:53:50.067546 np0000004400 cinder-backup[101319]: tcp: [205] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-61c7989b-d6b3-4a39-80a6-9fc519424447 (non-flash) Jul 03 09:53:50.067546 np0000004400 cinder-backup[101319]: tcp: [206] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b578d41f-4c6a-49b3-b5ec-bcd6556e2e68 (non-flash) Jul 03 09:53:50.067546 np0000004400 cinder-backup[101319]: tcp: [207] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5f57fed7-aa36-44c5-af90-863bd3d3af9d (non-flash) Jul 03 09:53:50.067546 np0000004400 cinder-backup[101319]: stderr= {{(pid=101319) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jul 03 09:53:50.067546 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-0348256d-c334-445a-abfb-8501d08ca9f1 tempest-ProjectReaderTests33-761902925 None] Sessions list: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-491c39b6-d2e0-4f67-9a64-590d50f06197', '188'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-491c39b6-d2e0-4f67-9a64-590d50f06197', '189'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-79c374d0-f293-429e-9f7e-a6ac9afa4c99', '203'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-79c374d0-f293-429e-9f7e-a6ac9afa4c99', '204'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-61c7989b-d6b3-4a39-80a6-9fc519424447', '205'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-b578d41f-4c6a-49b3-b5ec-bcd6556e2e68', '206'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-5f57fed7-aa36-44c5-af90-863bd3d3af9d', '207')] {{(pid=101319) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:866}} Jul 03 09:53:50.067884 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-0348256d-c334-445a-abfb-8501d08ca9f1 tempest-ProjectReaderTests33-761902925 None] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-61c7989b-d6b3-4a39-80a6-9fc519424447, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-61c7989b-d6b3-4a39-80a6-9fc519424447', '205')] {{(pid=101319) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}} Jul 03 09:53:50.068529 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-0348256d-c334-445a-abfb-8501d08ca9f1 tempest-ProjectReaderTests33-761902925 None] Resulting device map defaultdict(. at 0x7e76e71311c0>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-61c7989b-d6b3-4a39-80a6-9fc519424447'): ({'sdl'}, set())}) {{(pid=101319) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:912}} Jul 03 09:53:50.068740 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.linuxscsi [None req-0348256d-c334-445a-abfb-8501d08ca9f1 tempest-ProjectReaderTests33-761902925 None] Removing single pathed devices sdl {{(pid=101319) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}} Jul 03 09:53:50.081413 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.linuxscsi [None req-0348256d-c334-445a-abfb-8501d08ca9f1 tempest-ProjectReaderTests33-761902925 None] Flushing IO for device /dev/sdl {{(pid=101319) flush_device_io /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:461}} Jul 03 09:53:50.092817 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.linuxscsi [None req-0348256d-c334-445a-abfb-8501d08ca9f1 tempest-ProjectReaderTests33-761902925 None] Remove SCSI device /dev/sdl with /sys/block/sdl/device/delete {{(pid=101319) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}} Jul 03 09:53:50.100738 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-0c8f0b9c-3469-46f6-ba0e-fba74e3be6db tempest-ProjectMemberTests33-2105464604 None] backup MD5 for volume_5f57fed7-aa36-44c5-af90-863bd3d3af9d/20260703095349/az_nova_backup_885775bd-f91a-424f-bc10-7913c6a90400-00001: 25e317773f308e446cc84c503a6d1f85 {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 09:53:50.100899 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-0c8f0b9c-3469-46f6-ba0e-fba74e3be6db tempest-ProjectMemberTests33-2105464604 None] Calling eventlet.sleep(0) {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 09:53:50.135272 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-e785f663-f83e-414e-8ac2-4ca69114ccec tempest-VolumesBackupsTest-807180270 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101319) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 09:53:50.135503 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-e785f663-f83e-414e-8ac2-4ca69114ccec tempest-VolumesBackupsTest-807180270 None] About to put_object {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 09:53:50.169761 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.linuxscsi [None req-0348256d-c334-445a-abfb-8501d08ca9f1 tempest-ProjectReaderTests33-761902925 None] Checking to see if SCSI volumes sdl have been removed. {{(pid=101319) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}} Jul 03 09:53:50.169910 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.linuxscsi [None req-0348256d-c334-445a-abfb-8501d08ca9f1 tempest-ProjectReaderTests33-761902925 None] SCSI volumes sdl have been removed. {{(pid=101319) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}} Jul 03 09:53:50.171058 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.linuxscsi [None req-0348256d-c334-445a-abfb-8501d08ca9f1 tempest-ProjectReaderTests33-761902925 None] Checking to see if device paths {'sdl'} are still under multipathd monitoring {{(pid=101319) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}} Jul 03 09:53:50.202481 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.linuxscsi [None req-0348256d-c334-445a-abfb-8501d08ca9f1 tempest-ProjectReaderTests33-761902925 None] Device paths {'sdl'} have been removed from multipathd monitoring. {{(pid=101319) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}} Jul 03 09:53:50.202778 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-0348256d-c334-445a-abfb-8501d08ca9f1 tempest-ProjectReaderTests33-761902925 None] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-61c7989b-d6b3-4a39-80a6-9fc519424447')] {{(pid=101319) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1225}} Jul 03 09:53:50.214227 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-0348256d-c334-445a-abfb-8501d08ca9f1 tempest-ProjectReaderTests33-761902925 None] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=101319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 03 09:53:50.234641 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-e785f663-f83e-414e-8ac2-4ca69114ccec tempest-VolumesBackupsTest-807180270 None] backup MD5 for volume_b578d41f-4c6a-49b3-b5ec-bcd6556e2e68/20260703095347/az_nova_backup_c52fbc4a-f7d8-49e2-bd92-5bbf2f7f98ba-00005: 25e317773f308e446cc84c503a6d1f85 {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 09:53:50.234777 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-e785f663-f83e-414e-8ac2-4ca69114ccec tempest-VolumesBackupsTest-807180270 None] Calling eventlet.sleep(0) {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 09:53:50.256808 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-0348256d-c334-445a-abfb-8501d08ca9f1 tempest-ProjectReaderTests33-761902925 None] iscsiadm ('--logout',): stdout=Logging out of session [sid: 205, target: iqn.2023-03.storpool.com:os--volume-61c7989b-d6b3-4a39-80a6-9fc519424447, portal: 192.168.40.100,3260] Jul 03 09:53:50.256808 np0000004400 cinder-backup[101319]: Logout of [sid: 205, target: iqn.2023-03.storpool.com:os--volume-61c7989b-d6b3-4a39-80a6-9fc519424447, portal: 192.168.40.100,3260] successful. Jul 03 09:53:50.256808 np0000004400 cinder-backup[101319]: stderr= {{(pid=101319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 03 09:53:50.284080 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-0c8f0b9c-3469-46f6-ba0e-fba74e3be6db tempest-ProjectMemberTests33-2105464604 None] Backing up chunk of data from volume. {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 09:53:50.313371 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-0348256d-c334-445a-abfb-8501d08ca9f1 tempest-ProjectReaderTests33-761902925 None] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=101319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 03 09:53:50.313371 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.base [None req-0348256d-c334-445a-abfb-8501d08ca9f1 tempest-ProjectReaderTests33-761902925 None] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.289s {{(pid=101319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jul 03 09:53:50.313371 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-0348256d-c334-445a-abfb-8501d08ca9f1 tempest-ProjectReaderTests33-761902925 None] <== disconnect_volume: return (290ms) None {{(pid=101319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}} Jul 03 09:53:50.464685 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-e785f663-f83e-414e-8ac2-4ca69114ccec tempest-VolumesBackupsTest-807180270 None] Backing up chunk of data from volume. {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 09:53:50.552543 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-0c8f0b9c-3469-46f6-ba0e-fba74e3be6db tempest-ProjectMemberTests33-2105464604 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101319) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 09:53:50.552682 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-0c8f0b9c-3469-46f6-ba0e-fba74e3be6db tempest-ProjectMemberTests33-2105464604 None] About to put_object {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 09:53:50.649341 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-0c8f0b9c-3469-46f6-ba0e-fba74e3be6db tempest-ProjectMemberTests33-2105464604 None] backup MD5 for volume_5f57fed7-aa36-44c5-af90-863bd3d3af9d/20260703095349/az_nova_backup_885775bd-f91a-424f-bc10-7913c6a90400-00002: 25e317773f308e446cc84c503a6d1f85 {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 09:53:50.649560 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-0c8f0b9c-3469-46f6-ba0e-fba74e3be6db tempest-ProjectMemberTests33-2105464604 None] Calling eventlet.sleep(0) {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 09:53:50.801280 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-e785f663-f83e-414e-8ac2-4ca69114ccec tempest-VolumesBackupsTest-807180270 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101319) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 09:53:50.801280 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-e785f663-f83e-414e-8ac2-4ca69114ccec tempest-VolumesBackupsTest-807180270 None] About to put_object {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 09:53:50.831216 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-0c8f0b9c-3469-46f6-ba0e-fba74e3be6db tempest-ProjectMemberTests33-2105464604 None] Backing up chunk of data from volume. {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 09:53:50.903615 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-e785f663-f83e-414e-8ac2-4ca69114ccec tempest-VolumesBackupsTest-807180270 None] backup MD5 for volume_b578d41f-4c6a-49b3-b5ec-bcd6556e2e68/20260703095347/az_nova_backup_c52fbc4a-f7d8-49e2-bd92-5bbf2f7f98ba-00006: 25e317773f308e446cc84c503a6d1f85 {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 09:53:50.903807 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-e785f663-f83e-414e-8ac2-4ca69114ccec tempest-VolumesBackupsTest-807180270 None] Calling eventlet.sleep(0) {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 09:53:51.082959 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-0c8f0b9c-3469-46f6-ba0e-fba74e3be6db tempest-ProjectMemberTests33-2105464604 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101319) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 09:53:51.083452 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-0c8f0b9c-3469-46f6-ba0e-fba74e3be6db tempest-ProjectMemberTests33-2105464604 None] About to put_object {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 09:53:51.094903 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-e785f663-f83e-414e-8ac2-4ca69114ccec tempest-VolumesBackupsTest-807180270 None] Backing up chunk of data from volume. {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 09:53:51.180474 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-0c8f0b9c-3469-46f6-ba0e-fba74e3be6db tempest-ProjectMemberTests33-2105464604 None] backup MD5 for volume_5f57fed7-aa36-44c5-af90-863bd3d3af9d/20260703095349/az_nova_backup_885775bd-f91a-424f-bc10-7913c6a90400-00003: 25e317773f308e446cc84c503a6d1f85 {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 09:53:51.180693 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-0c8f0b9c-3469-46f6-ba0e-fba74e3be6db tempest-ProjectMemberTests33-2105464604 None] Calling eventlet.sleep(0) {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 09:53:51.338173 np0000004400 cinder-backup[101319]: INFO cinder.backup.manager [None req-0348256d-c334-445a-abfb-8501d08ca9f1 tempest-ProjectReaderTests33-761902925 None] Create backup finished. backup: 3905268c-9301-4198-bac6-c3c450e69ce2. Jul 03 09:53:51.343325 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-e785f663-f83e-414e-8ac2-4ca69114ccec tempest-VolumesBackupsTest-807180270 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101319) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 09:53:51.343917 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-e785f663-f83e-414e-8ac2-4ca69114ccec tempest-VolumesBackupsTest-807180270 None] About to put_object {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 09:53:51.376647 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-0c8f0b9c-3469-46f6-ba0e-fba74e3be6db tempest-ProjectMemberTests33-2105464604 None] Backing up chunk of data from volume. {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 09:53:51.449514 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-e785f663-f83e-414e-8ac2-4ca69114ccec tempest-VolumesBackupsTest-807180270 None] backup MD5 for volume_b578d41f-4c6a-49b3-b5ec-bcd6556e2e68/20260703095347/az_nova_backup_c52fbc4a-f7d8-49e2-bd92-5bbf2f7f98ba-00007: 25e317773f308e446cc84c503a6d1f85 {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 09:53:51.449835 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-e785f663-f83e-414e-8ac2-4ca69114ccec tempest-VolumesBackupsTest-807180270 None] Calling eventlet.sleep(0) {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 09:53:51.628888 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-0c8f0b9c-3469-46f6-ba0e-fba74e3be6db tempest-ProjectMemberTests33-2105464604 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101319) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 09:53:51.629158 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-0c8f0b9c-3469-46f6-ba0e-fba74e3be6db tempest-ProjectMemberTests33-2105464604 None] About to put_object {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 09:53:51.677557 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-e785f663-f83e-414e-8ac2-4ca69114ccec tempest-VolumesBackupsTest-807180270 None] Backing up chunk of data from volume. {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 09:53:51.737585 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-0c8f0b9c-3469-46f6-ba0e-fba74e3be6db tempest-ProjectMemberTests33-2105464604 None] backup MD5 for volume_5f57fed7-aa36-44c5-af90-863bd3d3af9d/20260703095349/az_nova_backup_885775bd-f91a-424f-bc10-7913c6a90400-00004: 25e317773f308e446cc84c503a6d1f85 {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 09:53:51.737585 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-0c8f0b9c-3469-46f6-ba0e-fba74e3be6db tempest-ProjectMemberTests33-2105464604 None] Calling eventlet.sleep(0) {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 09:53:51.933254 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-0c8f0b9c-3469-46f6-ba0e-fba74e3be6db tempest-ProjectMemberTests33-2105464604 None] Backing up chunk of data from volume. {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 09:53:51.934329 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-e785f663-f83e-414e-8ac2-4ca69114ccec tempest-VolumesBackupsTest-807180270 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101319) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 09:53:51.934489 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-e785f663-f83e-414e-8ac2-4ca69114ccec tempest-VolumesBackupsTest-807180270 None] About to put_object {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 09:53:52.077314 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-e785f663-f83e-414e-8ac2-4ca69114ccec tempest-VolumesBackupsTest-807180270 None] backup MD5 for volume_b578d41f-4c6a-49b3-b5ec-bcd6556e2e68/20260703095347/az_nova_backup_c52fbc4a-f7d8-49e2-bd92-5bbf2f7f98ba-00008: 25e317773f308e446cc84c503a6d1f85 {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 09:53:52.077314 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-e785f663-f83e-414e-8ac2-4ca69114ccec tempest-VolumesBackupsTest-807180270 None] Calling eventlet.sleep(0) {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 09:53:52.190191 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-0c8f0b9c-3469-46f6-ba0e-fba74e3be6db tempest-ProjectMemberTests33-2105464604 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101319) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 09:53:52.190653 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-0c8f0b9c-3469-46f6-ba0e-fba74e3be6db tempest-ProjectMemberTests33-2105464604 None] About to put_object {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 09:53:52.281015 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-e785f663-f83e-414e-8ac2-4ca69114ccec tempest-VolumesBackupsTest-807180270 None] Backing up chunk of data from volume. {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 09:53:52.301041 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-0c8f0b9c-3469-46f6-ba0e-fba74e3be6db tempest-ProjectMemberTests33-2105464604 None] backup MD5 for volume_5f57fed7-aa36-44c5-af90-863bd3d3af9d/20260703095349/az_nova_backup_885775bd-f91a-424f-bc10-7913c6a90400-00005: 25e317773f308e446cc84c503a6d1f85 {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 09:53:52.301184 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-0c8f0b9c-3469-46f6-ba0e-fba74e3be6db tempest-ProjectMemberTests33-2105464604 None] Calling eventlet.sleep(0) {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 09:53:52.469161 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-0c8f0b9c-3469-46f6-ba0e-fba74e3be6db tempest-ProjectMemberTests33-2105464604 None] Backing up chunk of data from volume. {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 09:53:52.537059 np0000004400 cinder-backup[101319]: INFO cinder.backup.manager [None req-3d5d467c-8520-4dae-9897-5f750f65c4d5 tempest-ProjectReaderTests33-761902925 None] Delete backup started, backup: 3905268c-9301-4198-bac6-c3c450e69ce2. Jul 03 09:53:52.543820 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.drivers.swift [None req-3d5d467c-8520-4dae-9897-5f750f65c4d5 tempest-ProjectReaderTests33-761902925 None] Using swift URL https://10.4.3.95:8080/v1/AUTH_e331bd155b824bbb8979e9aac5023870 {{(pid=101319) initialize /opt/stack/cinder/cinder/backup/drivers/swift.py:300}} Jul 03 09:53:52.544051 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.drivers.swift [None req-3d5d467c-8520-4dae-9897-5f750f65c4d5 tempest-ProjectReaderTests33-761902925 None] Connect to https://10.4.3.95:8080/v1/AUTH_ in "per_user" mode {{(pid=101319) initialize /opt/stack/cinder/cinder/backup/drivers/swift.py:301}} Jul 03 09:53:52.544201 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-3d5d467c-8520-4dae-9897-5f750f65c4d5 tempest-ProjectReaderTests33-761902925 None] delete started, backup: 3905268c-9301-4198-bac6-c3c450e69ce2, container: volumebackups, prefix: volume_61c7989b-d6b3-4a39-80a6-9fc519424447/20260703095337/az_nova_backup_3905268c-9301-4198-bac6-c3c450e69ce2. {{(pid=101319) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:822}} Jul 03 09:53:52.547390 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-e785f663-f83e-414e-8ac2-4ca69114ccec tempest-VolumesBackupsTest-807180270 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101319) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 09:53:52.547623 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-e785f663-f83e-414e-8ac2-4ca69114ccec tempest-VolumesBackupsTest-807180270 None] About to put_object {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 09:53:52.597531 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-3d5d467c-8520-4dae-9897-5f750f65c4d5 tempest-ProjectReaderTests33-761902925 None] generated object list: ['volume_61c7989b-d6b3-4a39-80a6-9fc519424447/20260703095337/az_nova_backup_3905268c-9301-4198-bac6-c3c450e69ce2-00001', 'volume_61c7989b-d6b3-4a39-80a6-9fc519424447/20260703095337/az_nova_backup_3905268c-9301-4198-bac6-c3c450e69ce2-00002', 'volume_61c7989b-d6b3-4a39-80a6-9fc519424447/20260703095337/az_nova_backup_3905268c-9301-4198-bac6-c3c450e69ce2-00003', 'volume_61c7989b-d6b3-4a39-80a6-9fc519424447/20260703095337/az_nova_backup_3905268c-9301-4198-bac6-c3c450e69ce2-00004', 'volume_61c7989b-d6b3-4a39-80a6-9fc519424447/20260703095337/az_nova_backup_3905268c-9301-4198-bac6-c3c450e69ce2-00005', 'volume_61c7989b-d6b3-4a39-80a6-9fc519424447/20260703095337/az_nova_backup_3905268c-9301-4198-bac6-c3c450e69ce2-00006', 'volume_61c7989b-d6b3-4a39-80a6-9fc519424447/20260703095337/az_nova_backup_3905268c-9301-4198-bac6-c3c450e69ce2-00007', 'volume_61c7989b-d6b3-4a39-80a6-9fc519424447/20260703095337/az_nova_backup_3905268c-9301-4198-bac6-c3c450e69ce2-00008', 'volume_61c7989b-d6b3-4a39-80a6-9fc519424447/20260703095337/az_nova_backup_3905268c-9301-4198-bac6-c3c450e69ce2-00009', 'volume_61c7989b-d6b3-4a39-80a6-9fc519424447/20260703095337/az_nova_backup_3905268c-9301-4198-bac6-c3c450e69ce2-00010', 'volume_61c7989b-d6b3-4a39-80a6-9fc519424447/20260703095337/az_nova_backup_3905268c-9301-4198-bac6-c3c450e69ce2-00011', 'volume_61c7989b-d6b3-4a39-80a6-9fc519424447/20260703095337/az_nova_backup_3905268c-9301-4198-bac6-c3c450e69ce2-00012', 'volume_61c7989b-d6b3-4a39-80a6-9fc519424447/20260703095337/az_nova_backup_3905268c-9301-4198-bac6-c3c450e69ce2-00013', 'volume_61c7989b-d6b3-4a39-80a6-9fc519424447/20260703095337/az_nova_backup_3905268c-9301-4198-bac6-c3c450e69ce2-00014', 'volume_61c7989b-d6b3-4a39-80a6-9fc519424447/20260703095337/az_nova_backup_3905268c-9301-4198-bac6-c3c450e69ce2-00015', 'volume_61c7989b-d6b3-4a39-80a6-9fc519424447/20260703095337/az_nova_backup_3905268c-9301-4198-bac6-c3c450e69ce2-00016', 'volume_61c7989b-d6b3-4a39-80a6-9fc519424447/20260703095337/az_nova_backup_3905268c-9301-4198-bac6-c3c450e69ce2-00017', 'volume_61c7989b-d6b3-4a39-80a6-9fc519424447/20260703095337/az_nova_backup_3905268c-9301-4198-bac6-c3c450e69ce2-00018', 'volume_61c7989b-d6b3-4a39-80a6-9fc519424447/20260703095337/az_nova_backup_3905268c-9301-4198-bac6-c3c450e69ce2-00019', 'volume_61c7989b-d6b3-4a39-80a6-9fc519424447/20260703095337/az_nova_backup_3905268c-9301-4198-bac6-c3c450e69ce2-00020', 'volume_61c7989b-d6b3-4a39-80a6-9fc519424447/20260703095337/az_nova_backup_3905268c-9301-4198-bac6-c3c450e69ce2-00021', 'volume_61c7989b-d6b3-4a39-80a6-9fc519424447/20260703095337/az_nova_backup_3905268c-9301-4198-bac6-c3c450e69ce2_metadata', 'volume_61c7989b-d6b3-4a39-80a6-9fc519424447/20260703095337/az_nova_backup_3905268c-9301-4198-bac6-c3c450e69ce2_sha256file']. {{(pid=101319) _generate_object_names /opt/stack/cinder/cinder/backup/chunkeddriver.py:260}} Jul 03 09:53:52.614614 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-3d5d467c-8520-4dae-9897-5f750f65c4d5 tempest-ProjectReaderTests33-761902925 None] deleted object: volume_61c7989b-d6b3-4a39-80a6-9fc519424447/20260703095337/az_nova_backup_3905268c-9301-4198-bac6-c3c450e69ce2-00001 in container: volumebackups. {{(pid=101319) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 09:53:52.633831 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-3d5d467c-8520-4dae-9897-5f750f65c4d5 tempest-ProjectReaderTests33-761902925 None] deleted object: volume_61c7989b-d6b3-4a39-80a6-9fc519424447/20260703095337/az_nova_backup_3905268c-9301-4198-bac6-c3c450e69ce2-00002 in container: volumebackups. {{(pid=101319) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 09:53:52.651700 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-3d5d467c-8520-4dae-9897-5f750f65c4d5 tempest-ProjectReaderTests33-761902925 None] deleted object: volume_61c7989b-d6b3-4a39-80a6-9fc519424447/20260703095337/az_nova_backup_3905268c-9301-4198-bac6-c3c450e69ce2-00003 in container: volumebackups. {{(pid=101319) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 09:53:52.654347 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-e785f663-f83e-414e-8ac2-4ca69114ccec tempest-VolumesBackupsTest-807180270 None] backup MD5 for volume_b578d41f-4c6a-49b3-b5ec-bcd6556e2e68/20260703095347/az_nova_backup_c52fbc4a-f7d8-49e2-bd92-5bbf2f7f98ba-00009: 25e317773f308e446cc84c503a6d1f85 {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 09:53:52.654543 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-e785f663-f83e-414e-8ac2-4ca69114ccec tempest-VolumesBackupsTest-807180270 None] Calling eventlet.sleep(0) {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 09:53:52.690300 np0000004400 cinder-backup[101319]: DEBUG oslo_db.sqlalchemy.engines [None req-e785f663-f83e-414e-8ac2-4ca69114ccec tempest-VolumesBackupsTest-807180270 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=101319) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 03 09:53:52.697697 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-3d5d467c-8520-4dae-9897-5f750f65c4d5 tempest-ProjectReaderTests33-761902925 None] deleted object: volume_61c7989b-d6b3-4a39-80a6-9fc519424447/20260703095337/az_nova_backup_3905268c-9301-4198-bac6-c3c450e69ce2-00004 in container: volumebackups. {{(pid=101319) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 09:53:52.710358 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-0c8f0b9c-3469-46f6-ba0e-fba74e3be6db tempest-ProjectMemberTests33-2105464604 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101319) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 09:53:52.710559 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-0c8f0b9c-3469-46f6-ba0e-fba74e3be6db tempest-ProjectMemberTests33-2105464604 None] About to put_object {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 09:53:52.715990 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-3d5d467c-8520-4dae-9897-5f750f65c4d5 tempest-ProjectReaderTests33-761902925 None] deleted object: volume_61c7989b-d6b3-4a39-80a6-9fc519424447/20260703095337/az_nova_backup_3905268c-9301-4198-bac6-c3c450e69ce2-00005 in container: volumebackups. {{(pid=101319) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 09:53:52.737733 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-3d5d467c-8520-4dae-9897-5f750f65c4d5 tempest-ProjectReaderTests33-761902925 None] deleted object: volume_61c7989b-d6b3-4a39-80a6-9fc519424447/20260703095337/az_nova_backup_3905268c-9301-4198-bac6-c3c450e69ce2-00006 in container: volumebackups. {{(pid=101319) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 09:53:52.765684 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-3d5d467c-8520-4dae-9897-5f750f65c4d5 tempest-ProjectReaderTests33-761902925 None] deleted object: volume_61c7989b-d6b3-4a39-80a6-9fc519424447/20260703095337/az_nova_backup_3905268c-9301-4198-bac6-c3c450e69ce2-00007 in container: volumebackups. {{(pid=101319) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 09:53:52.788029 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-3d5d467c-8520-4dae-9897-5f750f65c4d5 tempest-ProjectReaderTests33-761902925 None] deleted object: volume_61c7989b-d6b3-4a39-80a6-9fc519424447/20260703095337/az_nova_backup_3905268c-9301-4198-bac6-c3c450e69ce2-00008 in container: volumebackups. {{(pid=101319) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 09:53:52.805220 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-3d5d467c-8520-4dae-9897-5f750f65c4d5 tempest-ProjectReaderTests33-761902925 None] deleted object: volume_61c7989b-d6b3-4a39-80a6-9fc519424447/20260703095337/az_nova_backup_3905268c-9301-4198-bac6-c3c450e69ce2-00009 in container: volumebackups. {{(pid=101319) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 09:53:52.815993 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-0c8f0b9c-3469-46f6-ba0e-fba74e3be6db tempest-ProjectMemberTests33-2105464604 None] backup MD5 for volume_5f57fed7-aa36-44c5-af90-863bd3d3af9d/20260703095349/az_nova_backup_885775bd-f91a-424f-bc10-7913c6a90400-00006: 25e317773f308e446cc84c503a6d1f85 {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 09:53:52.816198 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-0c8f0b9c-3469-46f6-ba0e-fba74e3be6db tempest-ProjectMemberTests33-2105464604 None] Calling eventlet.sleep(0) {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 09:53:52.823424 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-3d5d467c-8520-4dae-9897-5f750f65c4d5 tempest-ProjectReaderTests33-761902925 None] deleted object: volume_61c7989b-d6b3-4a39-80a6-9fc519424447/20260703095337/az_nova_backup_3905268c-9301-4198-bac6-c3c450e69ce2-00010 in container: volumebackups. {{(pid=101319) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 09:53:52.843026 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-3d5d467c-8520-4dae-9897-5f750f65c4d5 tempest-ProjectReaderTests33-761902925 None] deleted object: volume_61c7989b-d6b3-4a39-80a6-9fc519424447/20260703095337/az_nova_backup_3905268c-9301-4198-bac6-c3c450e69ce2-00011 in container: volumebackups. {{(pid=101319) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 09:53:52.866134 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-3d5d467c-8520-4dae-9897-5f750f65c4d5 tempest-ProjectReaderTests33-761902925 None] deleted object: volume_61c7989b-d6b3-4a39-80a6-9fc519424447/20260703095337/az_nova_backup_3905268c-9301-4198-bac6-c3c450e69ce2-00012 in container: volumebackups. {{(pid=101319) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 09:53:52.888673 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-3d5d467c-8520-4dae-9897-5f750f65c4d5 tempest-ProjectReaderTests33-761902925 None] deleted object: volume_61c7989b-d6b3-4a39-80a6-9fc519424447/20260703095337/az_nova_backup_3905268c-9301-4198-bac6-c3c450e69ce2-00013 in container: volumebackups. {{(pid=101319) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 09:53:52.906573 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-e785f663-f83e-414e-8ac2-4ca69114ccec tempest-VolumesBackupsTest-807180270 None] Backing up chunk of data from volume. {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 09:53:52.910126 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-3d5d467c-8520-4dae-9897-5f750f65c4d5 tempest-ProjectReaderTests33-761902925 None] deleted object: volume_61c7989b-d6b3-4a39-80a6-9fc519424447/20260703095337/az_nova_backup_3905268c-9301-4198-bac6-c3c450e69ce2-00014 in container: volumebackups. {{(pid=101319) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 09:53:52.930325 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-3d5d467c-8520-4dae-9897-5f750f65c4d5 tempest-ProjectReaderTests33-761902925 None] deleted object: volume_61c7989b-d6b3-4a39-80a6-9fc519424447/20260703095337/az_nova_backup_3905268c-9301-4198-bac6-c3c450e69ce2-00015 in container: volumebackups. {{(pid=101319) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 09:53:52.949220 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-3d5d467c-8520-4dae-9897-5f750f65c4d5 tempest-ProjectReaderTests33-761902925 None] deleted object: volume_61c7989b-d6b3-4a39-80a6-9fc519424447/20260703095337/az_nova_backup_3905268c-9301-4198-bac6-c3c450e69ce2-00016 in container: volumebackups. {{(pid=101319) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 09:53:52.967824 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-3d5d467c-8520-4dae-9897-5f750f65c4d5 tempest-ProjectReaderTests33-761902925 None] deleted object: volume_61c7989b-d6b3-4a39-80a6-9fc519424447/20260703095337/az_nova_backup_3905268c-9301-4198-bac6-c3c450e69ce2-00017 in container: volumebackups. {{(pid=101319) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 09:53:52.985090 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-3d5d467c-8520-4dae-9897-5f750f65c4d5 tempest-ProjectReaderTests33-761902925 None] deleted object: volume_61c7989b-d6b3-4a39-80a6-9fc519424447/20260703095337/az_nova_backup_3905268c-9301-4198-bac6-c3c450e69ce2-00018 in container: volumebackups. {{(pid=101319) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 09:53:53.002567 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-3d5d467c-8520-4dae-9897-5f750f65c4d5 tempest-ProjectReaderTests33-761902925 None] deleted object: volume_61c7989b-d6b3-4a39-80a6-9fc519424447/20260703095337/az_nova_backup_3905268c-9301-4198-bac6-c3c450e69ce2-00019 in container: volumebackups. {{(pid=101319) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 09:53:53.009012 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-0c8f0b9c-3469-46f6-ba0e-fba74e3be6db tempest-ProjectMemberTests33-2105464604 None] Backing up chunk of data from volume. {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 09:53:53.018865 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-3d5d467c-8520-4dae-9897-5f750f65c4d5 tempest-ProjectReaderTests33-761902925 None] deleted object: volume_61c7989b-d6b3-4a39-80a6-9fc519424447/20260703095337/az_nova_backup_3905268c-9301-4198-bac6-c3c450e69ce2-00020 in container: volumebackups. {{(pid=101319) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 09:53:53.035138 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-3d5d467c-8520-4dae-9897-5f750f65c4d5 tempest-ProjectReaderTests33-761902925 None] deleted object: volume_61c7989b-d6b3-4a39-80a6-9fc519424447/20260703095337/az_nova_backup_3905268c-9301-4198-bac6-c3c450e69ce2-00021 in container: volumebackups. {{(pid=101319) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 09:53:53.051014 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-3d5d467c-8520-4dae-9897-5f750f65c4d5 tempest-ProjectReaderTests33-761902925 None] deleted object: volume_61c7989b-d6b3-4a39-80a6-9fc519424447/20260703095337/az_nova_backup_3905268c-9301-4198-bac6-c3c450e69ce2_metadata in container: volumebackups. {{(pid=101319) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 09:53:53.065888 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-3d5d467c-8520-4dae-9897-5f750f65c4d5 tempest-ProjectReaderTests33-761902925 None] deleted object: volume_61c7989b-d6b3-4a39-80a6-9fc519424447/20260703095337/az_nova_backup_3905268c-9301-4198-bac6-c3c450e69ce2_sha256file in container: volumebackups. {{(pid=101319) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 09:53:53.066363 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-3d5d467c-8520-4dae-9897-5f750f65c4d5 tempest-ProjectReaderTests33-761902925 None] delete 3905268c-9301-4198-bac6-c3c450e69ce2 finished. {{(pid=101319) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:848}} Jul 03 09:53:53.080363 np0000004400 cinder-backup[101319]: DEBUG cinder.quota [None req-3d5d467c-8520-4dae-9897-5f750f65c4d5 tempest-ProjectReaderTests33-761902925 None] Created reservations ['2554c4f0-e31b-4459-8ecf-166c9acf4788', 'd39e14a7-1bac-4eb9-b08a-cbb2b180c7ed'] {{(pid=101319) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 09:53:53.093865 np0000004400 cinder-backup[101319]: INFO cinder.backup.manager [None req-3d5d467c-8520-4dae-9897-5f750f65c4d5 tempest-ProjectReaderTests33-761902925 None] Delete backup finished, backup 3905268c-9301-4198-bac6-c3c450e69ce2 deleted. Jul 03 09:53:53.156906 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-e785f663-f83e-414e-8ac2-4ca69114ccec tempest-VolumesBackupsTest-807180270 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101319) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 09:53:53.157063 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-e785f663-f83e-414e-8ac2-4ca69114ccec tempest-VolumesBackupsTest-807180270 None] About to put_object {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 09:53:53.253752 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-0c8f0b9c-3469-46f6-ba0e-fba74e3be6db tempest-ProjectMemberTests33-2105464604 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101319) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 09:53:53.254149 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-0c8f0b9c-3469-46f6-ba0e-fba74e3be6db tempest-ProjectMemberTests33-2105464604 None] About to put_object {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 09:53:53.263938 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-e785f663-f83e-414e-8ac2-4ca69114ccec tempest-VolumesBackupsTest-807180270 None] backup MD5 for volume_b578d41f-4c6a-49b3-b5ec-bcd6556e2e68/20260703095347/az_nova_backup_c52fbc4a-f7d8-49e2-bd92-5bbf2f7f98ba-00010: 25e317773f308e446cc84c503a6d1f85 {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 09:53:53.264055 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-e785f663-f83e-414e-8ac2-4ca69114ccec tempest-VolumesBackupsTest-807180270 None] Calling eventlet.sleep(0) {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 09:53:53.351925 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-0c8f0b9c-3469-46f6-ba0e-fba74e3be6db tempest-ProjectMemberTests33-2105464604 None] backup MD5 for volume_5f57fed7-aa36-44c5-af90-863bd3d3af9d/20260703095349/az_nova_backup_885775bd-f91a-424f-bc10-7913c6a90400-00007: 25e317773f308e446cc84c503a6d1f85 {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 09:53:53.352089 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-0c8f0b9c-3469-46f6-ba0e-fba74e3be6db tempest-ProjectMemberTests33-2105464604 None] Calling eventlet.sleep(0) {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 09:53:53.443119 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-e785f663-f83e-414e-8ac2-4ca69114ccec tempest-VolumesBackupsTest-807180270 None] Backing up chunk of data from volume. {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 09:53:53.552802 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-0c8f0b9c-3469-46f6-ba0e-fba74e3be6db tempest-ProjectMemberTests33-2105464604 None] Backing up chunk of data from volume. {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 09:53:53.598506 np0000004400 cinder-backup[101319]: INFO cinder.backup.manager [None req-19b5e5fb-ae9f-4a33-9612-fe58f64aa64c tempest-ProjectReaderTests33-761902925 None] Delete backup started, backup: 995de3de-d18a-4f2d-9b86-30dcb8a7d527. Jul 03 09:53:53.602211 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.drivers.swift [None req-19b5e5fb-ae9f-4a33-9612-fe58f64aa64c tempest-ProjectReaderTests33-761902925 None] Using swift URL https://10.4.3.95:8080/v1/AUTH_e331bd155b824bbb8979e9aac5023870 {{(pid=101319) initialize /opt/stack/cinder/cinder/backup/drivers/swift.py:300}} Jul 03 09:53:53.603090 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.drivers.swift [None req-19b5e5fb-ae9f-4a33-9612-fe58f64aa64c tempest-ProjectReaderTests33-761902925 None] Connect to https://10.4.3.95:8080/v1/AUTH_ in "per_user" mode {{(pid=101319) initialize /opt/stack/cinder/cinder/backup/drivers/swift.py:301}} Jul 03 09:53:53.603233 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-19b5e5fb-ae9f-4a33-9612-fe58f64aa64c tempest-ProjectReaderTests33-761902925 None] delete started, backup: 995de3de-d18a-4f2d-9b86-30dcb8a7d527, container: volumebackups, prefix: volume_91385958-bc9a-4b5d-ac21-22d57700a0e4/20260703095311/az_nova_backup_995de3de-d18a-4f2d-9b86-30dcb8a7d527. {{(pid=101319) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:822}} Jul 03 09:53:53.641744 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-19b5e5fb-ae9f-4a33-9612-fe58f64aa64c tempest-ProjectReaderTests33-761902925 None] generated object list: ['volume_91385958-bc9a-4b5d-ac21-22d57700a0e4/20260703095311/az_nova_backup_995de3de-d18a-4f2d-9b86-30dcb8a7d527-00001', 'volume_91385958-bc9a-4b5d-ac21-22d57700a0e4/20260703095311/az_nova_backup_995de3de-d18a-4f2d-9b86-30dcb8a7d527-00002', 'volume_91385958-bc9a-4b5d-ac21-22d57700a0e4/20260703095311/az_nova_backup_995de3de-d18a-4f2d-9b86-30dcb8a7d527-00003', 'volume_91385958-bc9a-4b5d-ac21-22d57700a0e4/20260703095311/az_nova_backup_995de3de-d18a-4f2d-9b86-30dcb8a7d527-00004', 'volume_91385958-bc9a-4b5d-ac21-22d57700a0e4/20260703095311/az_nova_backup_995de3de-d18a-4f2d-9b86-30dcb8a7d527-00005', 'volume_91385958-bc9a-4b5d-ac21-22d57700a0e4/20260703095311/az_nova_backup_995de3de-d18a-4f2d-9b86-30dcb8a7d527-00006', 'volume_91385958-bc9a-4b5d-ac21-22d57700a0e4/20260703095311/az_nova_backup_995de3de-d18a-4f2d-9b86-30dcb8a7d527-00007', 'volume_91385958-bc9a-4b5d-ac21-22d57700a0e4/20260703095311/az_nova_backup_995de3de-d18a-4f2d-9b86-30dcb8a7d527-00008', 'volume_91385958-bc9a-4b5d-ac21-22d57700a0e4/20260703095311/az_nova_backup_995de3de-d18a-4f2d-9b86-30dcb8a7d527-00009', 'volume_91385958-bc9a-4b5d-ac21-22d57700a0e4/20260703095311/az_nova_backup_995de3de-d18a-4f2d-9b86-30dcb8a7d527-00010', 'volume_91385958-bc9a-4b5d-ac21-22d57700a0e4/20260703095311/az_nova_backup_995de3de-d18a-4f2d-9b86-30dcb8a7d527-00011', 'volume_91385958-bc9a-4b5d-ac21-22d57700a0e4/20260703095311/az_nova_backup_995de3de-d18a-4f2d-9b86-30dcb8a7d527-00012', 'volume_91385958-bc9a-4b5d-ac21-22d57700a0e4/20260703095311/az_nova_backup_995de3de-d18a-4f2d-9b86-30dcb8a7d527-00013', 'volume_91385958-bc9a-4b5d-ac21-22d57700a0e4/20260703095311/az_nova_backup_995de3de-d18a-4f2d-9b86-30dcb8a7d527-00014', 'volume_91385958-bc9a-4b5d-ac21-22d57700a0e4/20260703095311/az_nova_backup_995de3de-d18a-4f2d-9b86-30dcb8a7d527-00015', 'volume_91385958-bc9a-4b5d-ac21-22d57700a0e4/20260703095311/az_nova_backup_995de3de-d18a-4f2d-9b86-30dcb8a7d527-00016', 'volume_91385958-bc9a-4b5d-ac21-22d57700a0e4/20260703095311/az_nova_backup_995de3de-d18a-4f2d-9b86-30dcb8a7d527-00017', 'volume_91385958-bc9a-4b5d-ac21-22d57700a0e4/20260703095311/az_nova_backup_995de3de-d18a-4f2d-9b86-30dcb8a7d527-00018', 'volume_91385958-bc9a-4b5d-ac21-22d57700a0e4/20260703095311/az_nova_backup_995de3de-d18a-4f2d-9b86-30dcb8a7d527-00019', 'volume_91385958-bc9a-4b5d-ac21-22d57700a0e4/20260703095311/az_nova_backup_995de3de-d18a-4f2d-9b86-30dcb8a7d527-00020', 'volume_91385958-bc9a-4b5d-ac21-22d57700a0e4/20260703095311/az_nova_backup_995de3de-d18a-4f2d-9b86-30dcb8a7d527-00021', 'volume_91385958-bc9a-4b5d-ac21-22d57700a0e4/20260703095311/az_nova_backup_995de3de-d18a-4f2d-9b86-30dcb8a7d527_metadata', 'volume_91385958-bc9a-4b5d-ac21-22d57700a0e4/20260703095311/az_nova_backup_995de3de-d18a-4f2d-9b86-30dcb8a7d527_sha256file']. {{(pid=101319) _generate_object_names /opt/stack/cinder/cinder/backup/chunkeddriver.py:260}} Jul 03 09:53:53.659328 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-19b5e5fb-ae9f-4a33-9612-fe58f64aa64c tempest-ProjectReaderTests33-761902925 None] deleted object: volume_91385958-bc9a-4b5d-ac21-22d57700a0e4/20260703095311/az_nova_backup_995de3de-d18a-4f2d-9b86-30dcb8a7d527-00001 in container: volumebackups. {{(pid=101319) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 09:53:53.675873 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-19b5e5fb-ae9f-4a33-9612-fe58f64aa64c tempest-ProjectReaderTests33-761902925 None] deleted object: volume_91385958-bc9a-4b5d-ac21-22d57700a0e4/20260703095311/az_nova_backup_995de3de-d18a-4f2d-9b86-30dcb8a7d527-00002 in container: volumebackups. {{(pid=101319) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 09:53:53.691210 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-e785f663-f83e-414e-8ac2-4ca69114ccec tempest-VolumesBackupsTest-807180270 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101319) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 09:53:53.691470 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-e785f663-f83e-414e-8ac2-4ca69114ccec tempest-VolumesBackupsTest-807180270 None] About to put_object {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 09:53:53.693232 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-19b5e5fb-ae9f-4a33-9612-fe58f64aa64c tempest-ProjectReaderTests33-761902925 None] deleted object: volume_91385958-bc9a-4b5d-ac21-22d57700a0e4/20260703095311/az_nova_backup_995de3de-d18a-4f2d-9b86-30dcb8a7d527-00003 in container: volumebackups. {{(pid=101319) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 09:53:53.712002 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-19b5e5fb-ae9f-4a33-9612-fe58f64aa64c tempest-ProjectReaderTests33-761902925 None] deleted object: volume_91385958-bc9a-4b5d-ac21-22d57700a0e4/20260703095311/az_nova_backup_995de3de-d18a-4f2d-9b86-30dcb8a7d527-00004 in container: volumebackups. {{(pid=101319) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 09:53:53.729109 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-19b5e5fb-ae9f-4a33-9612-fe58f64aa64c tempest-ProjectReaderTests33-761902925 None] deleted object: volume_91385958-bc9a-4b5d-ac21-22d57700a0e4/20260703095311/az_nova_backup_995de3de-d18a-4f2d-9b86-30dcb8a7d527-00005 in container: volumebackups. {{(pid=101319) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 09:53:53.745559 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-19b5e5fb-ae9f-4a33-9612-fe58f64aa64c tempest-ProjectReaderTests33-761902925 None] deleted object: volume_91385958-bc9a-4b5d-ac21-22d57700a0e4/20260703095311/az_nova_backup_995de3de-d18a-4f2d-9b86-30dcb8a7d527-00006 in container: volumebackups. {{(pid=101319) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 09:53:53.765509 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-19b5e5fb-ae9f-4a33-9612-fe58f64aa64c tempest-ProjectReaderTests33-761902925 None] deleted object: volume_91385958-bc9a-4b5d-ac21-22d57700a0e4/20260703095311/az_nova_backup_995de3de-d18a-4f2d-9b86-30dcb8a7d527-00007 in container: volumebackups. {{(pid=101319) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 09:53:53.789535 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-19b5e5fb-ae9f-4a33-9612-fe58f64aa64c tempest-ProjectReaderTests33-761902925 None] deleted object: volume_91385958-bc9a-4b5d-ac21-22d57700a0e4/20260703095311/az_nova_backup_995de3de-d18a-4f2d-9b86-30dcb8a7d527-00008 in container: volumebackups. {{(pid=101319) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 09:53:53.799808 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-0c8f0b9c-3469-46f6-ba0e-fba74e3be6db tempest-ProjectMemberTests33-2105464604 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101319) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 09:53:53.799984 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-0c8f0b9c-3469-46f6-ba0e-fba74e3be6db tempest-ProjectMemberTests33-2105464604 None] About to put_object {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 09:53:53.806667 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-19b5e5fb-ae9f-4a33-9612-fe58f64aa64c tempest-ProjectReaderTests33-761902925 None] deleted object: volume_91385958-bc9a-4b5d-ac21-22d57700a0e4/20260703095311/az_nova_backup_995de3de-d18a-4f2d-9b86-30dcb8a7d527-00009 in container: volumebackups. {{(pid=101319) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 09:53:53.806893 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-e785f663-f83e-414e-8ac2-4ca69114ccec tempest-VolumesBackupsTest-807180270 None] backup MD5 for volume_b578d41f-4c6a-49b3-b5ec-bcd6556e2e68/20260703095347/az_nova_backup_c52fbc4a-f7d8-49e2-bd92-5bbf2f7f98ba-00011: 25e317773f308e446cc84c503a6d1f85 {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 09:53:53.807061 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-e785f663-f83e-414e-8ac2-4ca69114ccec tempest-VolumesBackupsTest-807180270 None] Calling eventlet.sleep(0) {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 09:53:53.842254 np0000004400 cinder-backup[101319]: DEBUG oslo_db.sqlalchemy.engines [None req-e785f663-f83e-414e-8ac2-4ca69114ccec tempest-VolumesBackupsTest-807180270 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=101319) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 03 09:53:53.849136 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-19b5e5fb-ae9f-4a33-9612-fe58f64aa64c tempest-ProjectReaderTests33-761902925 None] deleted object: volume_91385958-bc9a-4b5d-ac21-22d57700a0e4/20260703095311/az_nova_backup_995de3de-d18a-4f2d-9b86-30dcb8a7d527-00010 in container: volumebackups. {{(pid=101319) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 09:53:53.868567 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-19b5e5fb-ae9f-4a33-9612-fe58f64aa64c tempest-ProjectReaderTests33-761902925 None] deleted object: volume_91385958-bc9a-4b5d-ac21-22d57700a0e4/20260703095311/az_nova_backup_995de3de-d18a-4f2d-9b86-30dcb8a7d527-00011 in container: volumebackups. {{(pid=101319) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 09:53:53.887770 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-19b5e5fb-ae9f-4a33-9612-fe58f64aa64c tempest-ProjectReaderTests33-761902925 None] deleted object: volume_91385958-bc9a-4b5d-ac21-22d57700a0e4/20260703095311/az_nova_backup_995de3de-d18a-4f2d-9b86-30dcb8a7d527-00012 in container: volumebackups. {{(pid=101319) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 09:53:53.908352 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-19b5e5fb-ae9f-4a33-9612-fe58f64aa64c tempest-ProjectReaderTests33-761902925 None] deleted object: volume_91385958-bc9a-4b5d-ac21-22d57700a0e4/20260703095311/az_nova_backup_995de3de-d18a-4f2d-9b86-30dcb8a7d527-00013 in container: volumebackups. {{(pid=101319) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 09:53:53.911684 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-0c8f0b9c-3469-46f6-ba0e-fba74e3be6db tempest-ProjectMemberTests33-2105464604 None] backup MD5 for volume_5f57fed7-aa36-44c5-af90-863bd3d3af9d/20260703095349/az_nova_backup_885775bd-f91a-424f-bc10-7913c6a90400-00008: 25e317773f308e446cc84c503a6d1f85 {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 09:53:53.911877 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-0c8f0b9c-3469-46f6-ba0e-fba74e3be6db tempest-ProjectMemberTests33-2105464604 None] Calling eventlet.sleep(0) {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 09:53:53.929252 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-19b5e5fb-ae9f-4a33-9612-fe58f64aa64c tempest-ProjectReaderTests33-761902925 None] deleted object: volume_91385958-bc9a-4b5d-ac21-22d57700a0e4/20260703095311/az_nova_backup_995de3de-d18a-4f2d-9b86-30dcb8a7d527-00014 in container: volumebackups. {{(pid=101319) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 09:53:53.949106 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-19b5e5fb-ae9f-4a33-9612-fe58f64aa64c tempest-ProjectReaderTests33-761902925 None] deleted object: volume_91385958-bc9a-4b5d-ac21-22d57700a0e4/20260703095311/az_nova_backup_995de3de-d18a-4f2d-9b86-30dcb8a7d527-00015 in container: volumebackups. {{(pid=101319) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 09:53:53.968462 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-19b5e5fb-ae9f-4a33-9612-fe58f64aa64c tempest-ProjectReaderTests33-761902925 None] deleted object: volume_91385958-bc9a-4b5d-ac21-22d57700a0e4/20260703095311/az_nova_backup_995de3de-d18a-4f2d-9b86-30dcb8a7d527-00016 in container: volumebackups. {{(pid=101319) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 09:53:53.986677 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-19b5e5fb-ae9f-4a33-9612-fe58f64aa64c tempest-ProjectReaderTests33-761902925 None] deleted object: volume_91385958-bc9a-4b5d-ac21-22d57700a0e4/20260703095311/az_nova_backup_995de3de-d18a-4f2d-9b86-30dcb8a7d527-00017 in container: volumebackups. {{(pid=101319) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 09:53:54.006086 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-19b5e5fb-ae9f-4a33-9612-fe58f64aa64c tempest-ProjectReaderTests33-761902925 None] deleted object: volume_91385958-bc9a-4b5d-ac21-22d57700a0e4/20260703095311/az_nova_backup_995de3de-d18a-4f2d-9b86-30dcb8a7d527-00018 in container: volumebackups. {{(pid=101319) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 09:53:54.025028 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-19b5e5fb-ae9f-4a33-9612-fe58f64aa64c tempest-ProjectReaderTests33-761902925 None] deleted object: volume_91385958-bc9a-4b5d-ac21-22d57700a0e4/20260703095311/az_nova_backup_995de3de-d18a-4f2d-9b86-30dcb8a7d527-00019 in container: volumebackups. {{(pid=101319) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 09:53:54.042504 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-19b5e5fb-ae9f-4a33-9612-fe58f64aa64c tempest-ProjectReaderTests33-761902925 None] deleted object: volume_91385958-bc9a-4b5d-ac21-22d57700a0e4/20260703095311/az_nova_backup_995de3de-d18a-4f2d-9b86-30dcb8a7d527-00020 in container: volumebackups. {{(pid=101319) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 09:53:54.061740 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-19b5e5fb-ae9f-4a33-9612-fe58f64aa64c tempest-ProjectReaderTests33-761902925 None] deleted object: volume_91385958-bc9a-4b5d-ac21-22d57700a0e4/20260703095311/az_nova_backup_995de3de-d18a-4f2d-9b86-30dcb8a7d527-00021 in container: volumebackups. {{(pid=101319) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 09:53:54.080912 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-19b5e5fb-ae9f-4a33-9612-fe58f64aa64c tempest-ProjectReaderTests33-761902925 None] deleted object: volume_91385958-bc9a-4b5d-ac21-22d57700a0e4/20260703095311/az_nova_backup_995de3de-d18a-4f2d-9b86-30dcb8a7d527_metadata in container: volumebackups. {{(pid=101319) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 09:53:54.086020 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-e785f663-f83e-414e-8ac2-4ca69114ccec tempest-VolumesBackupsTest-807180270 None] Backing up chunk of data from volume. {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 09:53:54.102148 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-19b5e5fb-ae9f-4a33-9612-fe58f64aa64c tempest-ProjectReaderTests33-761902925 None] deleted object: volume_91385958-bc9a-4b5d-ac21-22d57700a0e4/20260703095311/az_nova_backup_995de3de-d18a-4f2d-9b86-30dcb8a7d527_sha256file in container: volumebackups. {{(pid=101319) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 09:53:54.102410 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-19b5e5fb-ae9f-4a33-9612-fe58f64aa64c tempest-ProjectReaderTests33-761902925 None] delete 995de3de-d18a-4f2d-9b86-30dcb8a7d527 finished. {{(pid=101319) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:848}} Jul 03 09:53:54.115014 np0000004400 cinder-backup[101319]: DEBUG cinder.quota [None req-19b5e5fb-ae9f-4a33-9612-fe58f64aa64c tempest-ProjectReaderTests33-761902925 None] Created reservations ['14e28188-a84d-4416-aa17-781e6a1f9fb1', '01312813-babb-4b20-95ce-1cabf32d301b'] {{(pid=101319) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 09:53:54.128350 np0000004400 cinder-backup[101319]: INFO cinder.backup.manager [None req-19b5e5fb-ae9f-4a33-9612-fe58f64aa64c tempest-ProjectReaderTests33-761902925 None] Delete backup finished, backup 995de3de-d18a-4f2d-9b86-30dcb8a7d527 deleted. Jul 03 09:53:54.154564 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-0c8f0b9c-3469-46f6-ba0e-fba74e3be6db tempest-ProjectMemberTests33-2105464604 None] Backing up chunk of data from volume. {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 09:53:54.331765 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-e785f663-f83e-414e-8ac2-4ca69114ccec tempest-VolumesBackupsTest-807180270 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101319) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 09:53:54.332146 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-e785f663-f83e-414e-8ac2-4ca69114ccec tempest-VolumesBackupsTest-807180270 None] About to put_object {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 09:53:54.397505 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-0c8f0b9c-3469-46f6-ba0e-fba74e3be6db tempest-ProjectMemberTests33-2105464604 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101319) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 09:53:54.397852 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-0c8f0b9c-3469-46f6-ba0e-fba74e3be6db tempest-ProjectMemberTests33-2105464604 None] About to put_object {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 09:53:54.438477 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-e785f663-f83e-414e-8ac2-4ca69114ccec tempest-VolumesBackupsTest-807180270 None] backup MD5 for volume_b578d41f-4c6a-49b3-b5ec-bcd6556e2e68/20260703095347/az_nova_backup_c52fbc4a-f7d8-49e2-bd92-5bbf2f7f98ba-00012: 25e317773f308e446cc84c503a6d1f85 {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 09:53:54.438674 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-e785f663-f83e-414e-8ac2-4ca69114ccec tempest-VolumesBackupsTest-807180270 None] Calling eventlet.sleep(0) {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 09:53:54.499979 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-0c8f0b9c-3469-46f6-ba0e-fba74e3be6db tempest-ProjectMemberTests33-2105464604 None] backup MD5 for volume_5f57fed7-aa36-44c5-af90-863bd3d3af9d/20260703095349/az_nova_backup_885775bd-f91a-424f-bc10-7913c6a90400-00009: 25e317773f308e446cc84c503a6d1f85 {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 09:53:54.500180 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-0c8f0b9c-3469-46f6-ba0e-fba74e3be6db tempest-ProjectMemberTests33-2105464604 None] Calling eventlet.sleep(0) {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 09:53:54.667735 np0000004400 cinder-backup[101319]: INFO cinder.backup.manager [None req-23e02918-5c1a-4749-8690-ba8ba087773d tempest-ProjectReaderTests33-761902925 None] Delete backup started, backup: 6624fbb5-b72a-4c4d-bc8d-5f32665a951a. Jul 03 09:53:54.671395 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.drivers.swift [None req-23e02918-5c1a-4749-8690-ba8ba087773d tempest-ProjectReaderTests33-761902925 None] Using swift URL https://10.4.3.95:8080/v1/AUTH_e331bd155b824bbb8979e9aac5023870 {{(pid=101319) initialize /opt/stack/cinder/cinder/backup/drivers/swift.py:300}} Jul 03 09:53:54.671567 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.drivers.swift [None req-23e02918-5c1a-4749-8690-ba8ba087773d tempest-ProjectReaderTests33-761902925 None] Connect to https://10.4.3.95:8080/v1/AUTH_ in "per_user" mode {{(pid=101319) initialize /opt/stack/cinder/cinder/backup/drivers/swift.py:301}} Jul 03 09:53:54.671699 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-23e02918-5c1a-4749-8690-ba8ba087773d tempest-ProjectReaderTests33-761902925 None] delete started, backup: 6624fbb5-b72a-4c4d-bc8d-5f32665a951a, container: volumebackups, prefix: volume_44062477-adb9-4fe5-a2cb-600f263cd316/20260703095252/az_nova_backup_6624fbb5-b72a-4c4d-bc8d-5f32665a951a. {{(pid=101319) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:822}} Jul 03 09:53:54.707547 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-e785f663-f83e-414e-8ac2-4ca69114ccec tempest-VolumesBackupsTest-807180270 None] Backing up chunk of data from volume. {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 09:53:54.711227 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-23e02918-5c1a-4749-8690-ba8ba087773d tempest-ProjectReaderTests33-761902925 None] generated object list: ['volume_44062477-adb9-4fe5-a2cb-600f263cd316/20260703095252/az_nova_backup_6624fbb5-b72a-4c4d-bc8d-5f32665a951a-00001', 'volume_44062477-adb9-4fe5-a2cb-600f263cd316/20260703095252/az_nova_backup_6624fbb5-b72a-4c4d-bc8d-5f32665a951a-00002', 'volume_44062477-adb9-4fe5-a2cb-600f263cd316/20260703095252/az_nova_backup_6624fbb5-b72a-4c4d-bc8d-5f32665a951a-00003', 'volume_44062477-adb9-4fe5-a2cb-600f263cd316/20260703095252/az_nova_backup_6624fbb5-b72a-4c4d-bc8d-5f32665a951a-00004', 'volume_44062477-adb9-4fe5-a2cb-600f263cd316/20260703095252/az_nova_backup_6624fbb5-b72a-4c4d-bc8d-5f32665a951a-00005', 'volume_44062477-adb9-4fe5-a2cb-600f263cd316/20260703095252/az_nova_backup_6624fbb5-b72a-4c4d-bc8d-5f32665a951a-00006', 'volume_44062477-adb9-4fe5-a2cb-600f263cd316/20260703095252/az_nova_backup_6624fbb5-b72a-4c4d-bc8d-5f32665a951a-00007', 'volume_44062477-adb9-4fe5-a2cb-600f263cd316/20260703095252/az_nova_backup_6624fbb5-b72a-4c4d-bc8d-5f32665a951a-00008', 'volume_44062477-adb9-4fe5-a2cb-600f263cd316/20260703095252/az_nova_backup_6624fbb5-b72a-4c4d-bc8d-5f32665a951a-00009', 'volume_44062477-adb9-4fe5-a2cb-600f263cd316/20260703095252/az_nova_backup_6624fbb5-b72a-4c4d-bc8d-5f32665a951a-00010', 'volume_44062477-adb9-4fe5-a2cb-600f263cd316/20260703095252/az_nova_backup_6624fbb5-b72a-4c4d-bc8d-5f32665a951a-00011', 'volume_44062477-adb9-4fe5-a2cb-600f263cd316/20260703095252/az_nova_backup_6624fbb5-b72a-4c4d-bc8d-5f32665a951a-00012', 'volume_44062477-adb9-4fe5-a2cb-600f263cd316/20260703095252/az_nova_backup_6624fbb5-b72a-4c4d-bc8d-5f32665a951a-00013', 'volume_44062477-adb9-4fe5-a2cb-600f263cd316/20260703095252/az_nova_backup_6624fbb5-b72a-4c4d-bc8d-5f32665a951a-00014', 'volume_44062477-adb9-4fe5-a2cb-600f263cd316/20260703095252/az_nova_backup_6624fbb5-b72a-4c4d-bc8d-5f32665a951a-00015', 'volume_44062477-adb9-4fe5-a2cb-600f263cd316/20260703095252/az_nova_backup_6624fbb5-b72a-4c4d-bc8d-5f32665a951a-00016', 'volume_44062477-adb9-4fe5-a2cb-600f263cd316/20260703095252/az_nova_backup_6624fbb5-b72a-4c4d-bc8d-5f32665a951a-00017', 'volume_44062477-adb9-4fe5-a2cb-600f263cd316/20260703095252/az_nova_backup_6624fbb5-b72a-4c4d-bc8d-5f32665a951a-00018', 'volume_44062477-adb9-4fe5-a2cb-600f263cd316/20260703095252/az_nova_backup_6624fbb5-b72a-4c4d-bc8d-5f32665a951a-00019', 'volume_44062477-adb9-4fe5-a2cb-600f263cd316/20260703095252/az_nova_backup_6624fbb5-b72a-4c4d-bc8d-5f32665a951a-00020', 'volume_44062477-adb9-4fe5-a2cb-600f263cd316/20260703095252/az_nova_backup_6624fbb5-b72a-4c4d-bc8d-5f32665a951a-00021', 'volume_44062477-adb9-4fe5-a2cb-600f263cd316/20260703095252/az_nova_backup_6624fbb5-b72a-4c4d-bc8d-5f32665a951a_metadata', 'volume_44062477-adb9-4fe5-a2cb-600f263cd316/20260703095252/az_nova_backup_6624fbb5-b72a-4c4d-bc8d-5f32665a951a_sha256file']. {{(pid=101319) _generate_object_names /opt/stack/cinder/cinder/backup/chunkeddriver.py:260}} Jul 03 09:53:54.731777 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-23e02918-5c1a-4749-8690-ba8ba087773d tempest-ProjectReaderTests33-761902925 None] deleted object: volume_44062477-adb9-4fe5-a2cb-600f263cd316/20260703095252/az_nova_backup_6624fbb5-b72a-4c4d-bc8d-5f32665a951a-00001 in container: volumebackups. {{(pid=101319) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 09:53:54.748660 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-23e02918-5c1a-4749-8690-ba8ba087773d tempest-ProjectReaderTests33-761902925 None] deleted object: volume_44062477-adb9-4fe5-a2cb-600f263cd316/20260703095252/az_nova_backup_6624fbb5-b72a-4c4d-bc8d-5f32665a951a-00002 in container: volumebackups. {{(pid=101319) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 09:53:54.755992 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-0c8f0b9c-3469-46f6-ba0e-fba74e3be6db tempest-ProjectMemberTests33-2105464604 None] Backing up chunk of data from volume. {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 09:53:54.766557 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-23e02918-5c1a-4749-8690-ba8ba087773d tempest-ProjectReaderTests33-761902925 None] deleted object: volume_44062477-adb9-4fe5-a2cb-600f263cd316/20260703095252/az_nova_backup_6624fbb5-b72a-4c4d-bc8d-5f32665a951a-00003 in container: volumebackups. {{(pid=101319) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 09:53:54.786127 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-23e02918-5c1a-4749-8690-ba8ba087773d tempest-ProjectReaderTests33-761902925 None] deleted object: volume_44062477-adb9-4fe5-a2cb-600f263cd316/20260703095252/az_nova_backup_6624fbb5-b72a-4c4d-bc8d-5f32665a951a-00004 in container: volumebackups. {{(pid=101319) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 09:53:54.810500 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-23e02918-5c1a-4749-8690-ba8ba087773d tempest-ProjectReaderTests33-761902925 None] deleted object: volume_44062477-adb9-4fe5-a2cb-600f263cd316/20260703095252/az_nova_backup_6624fbb5-b72a-4c4d-bc8d-5f32665a951a-00005 in container: volumebackups. {{(pid=101319) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 09:53:54.828220 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-23e02918-5c1a-4749-8690-ba8ba087773d tempest-ProjectReaderTests33-761902925 None] deleted object: volume_44062477-adb9-4fe5-a2cb-600f263cd316/20260703095252/az_nova_backup_6624fbb5-b72a-4c4d-bc8d-5f32665a951a-00006 in container: volumebackups. {{(pid=101319) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 09:53:54.845235 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-23e02918-5c1a-4749-8690-ba8ba087773d tempest-ProjectReaderTests33-761902925 None] deleted object: volume_44062477-adb9-4fe5-a2cb-600f263cd316/20260703095252/az_nova_backup_6624fbb5-b72a-4c4d-bc8d-5f32665a951a-00007 in container: volumebackups. {{(pid=101319) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 09:53:54.861734 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-23e02918-5c1a-4749-8690-ba8ba087773d tempest-ProjectReaderTests33-761902925 None] deleted object: volume_44062477-adb9-4fe5-a2cb-600f263cd316/20260703095252/az_nova_backup_6624fbb5-b72a-4c4d-bc8d-5f32665a951a-00008 in container: volumebackups. {{(pid=101319) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 09:53:54.879979 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-23e02918-5c1a-4749-8690-ba8ba087773d tempest-ProjectReaderTests33-761902925 None] deleted object: volume_44062477-adb9-4fe5-a2cb-600f263cd316/20260703095252/az_nova_backup_6624fbb5-b72a-4c4d-bc8d-5f32665a951a-00009 in container: volumebackups. {{(pid=101319) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 09:53:54.896320 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-23e02918-5c1a-4749-8690-ba8ba087773d tempest-ProjectReaderTests33-761902925 None] deleted object: volume_44062477-adb9-4fe5-a2cb-600f263cd316/20260703095252/az_nova_backup_6624fbb5-b72a-4c4d-bc8d-5f32665a951a-00010 in container: volumebackups. {{(pid=101319) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 09:53:54.914793 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-23e02918-5c1a-4749-8690-ba8ba087773d tempest-ProjectReaderTests33-761902925 None] deleted object: volume_44062477-adb9-4fe5-a2cb-600f263cd316/20260703095252/az_nova_backup_6624fbb5-b72a-4c4d-bc8d-5f32665a951a-00011 in container: volumebackups. {{(pid=101319) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 09:53:54.932084 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-23e02918-5c1a-4749-8690-ba8ba087773d tempest-ProjectReaderTests33-761902925 None] deleted object: volume_44062477-adb9-4fe5-a2cb-600f263cd316/20260703095252/az_nova_backup_6624fbb5-b72a-4c4d-bc8d-5f32665a951a-00012 in container: volumebackups. {{(pid=101319) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 09:53:54.948785 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-23e02918-5c1a-4749-8690-ba8ba087773d tempest-ProjectReaderTests33-761902925 None] deleted object: volume_44062477-adb9-4fe5-a2cb-600f263cd316/20260703095252/az_nova_backup_6624fbb5-b72a-4c4d-bc8d-5f32665a951a-00013 in container: volumebackups. {{(pid=101319) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 09:53:54.961589 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-e785f663-f83e-414e-8ac2-4ca69114ccec tempest-VolumesBackupsTest-807180270 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101319) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 09:53:54.961817 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-e785f663-f83e-414e-8ac2-4ca69114ccec tempest-VolumesBackupsTest-807180270 None] About to put_object {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 09:53:54.966565 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-23e02918-5c1a-4749-8690-ba8ba087773d tempest-ProjectReaderTests33-761902925 None] deleted object: volume_44062477-adb9-4fe5-a2cb-600f263cd316/20260703095252/az_nova_backup_6624fbb5-b72a-4c4d-bc8d-5f32665a951a-00014 in container: volumebackups. {{(pid=101319) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 09:53:54.990800 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-23e02918-5c1a-4749-8690-ba8ba087773d tempest-ProjectReaderTests33-761902925 None] deleted object: volume_44062477-adb9-4fe5-a2cb-600f263cd316/20260703095252/az_nova_backup_6624fbb5-b72a-4c4d-bc8d-5f32665a951a-00015 in container: volumebackups. {{(pid=101319) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 09:53:54.995948 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-0c8f0b9c-3469-46f6-ba0e-fba74e3be6db tempest-ProjectMemberTests33-2105464604 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101319) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 09:53:54.995948 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-0c8f0b9c-3469-46f6-ba0e-fba74e3be6db tempest-ProjectMemberTests33-2105464604 None] About to put_object {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 09:53:55.009248 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-23e02918-5c1a-4749-8690-ba8ba087773d tempest-ProjectReaderTests33-761902925 None] deleted object: volume_44062477-adb9-4fe5-a2cb-600f263cd316/20260703095252/az_nova_backup_6624fbb5-b72a-4c4d-bc8d-5f32665a951a-00016 in container: volumebackups. {{(pid=101319) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 09:53:55.027375 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-23e02918-5c1a-4749-8690-ba8ba087773d tempest-ProjectReaderTests33-761902925 None] deleted object: volume_44062477-adb9-4fe5-a2cb-600f263cd316/20260703095252/az_nova_backup_6624fbb5-b72a-4c4d-bc8d-5f32665a951a-00017 in container: volumebackups. {{(pid=101319) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 09:53:55.043824 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-23e02918-5c1a-4749-8690-ba8ba087773d tempest-ProjectReaderTests33-761902925 None] deleted object: volume_44062477-adb9-4fe5-a2cb-600f263cd316/20260703095252/az_nova_backup_6624fbb5-b72a-4c4d-bc8d-5f32665a951a-00018 in container: volumebackups. {{(pid=101319) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 09:53:55.060336 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-23e02918-5c1a-4749-8690-ba8ba087773d tempest-ProjectReaderTests33-761902925 None] deleted object: volume_44062477-adb9-4fe5-a2cb-600f263cd316/20260703095252/az_nova_backup_6624fbb5-b72a-4c4d-bc8d-5f32665a951a-00019 in container: volumebackups. {{(pid=101319) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 09:53:55.067325 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-e785f663-f83e-414e-8ac2-4ca69114ccec tempest-VolumesBackupsTest-807180270 None] backup MD5 for volume_b578d41f-4c6a-49b3-b5ec-bcd6556e2e68/20260703095347/az_nova_backup_c52fbc4a-f7d8-49e2-bd92-5bbf2f7f98ba-00013: 25e317773f308e446cc84c503a6d1f85 {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 09:53:55.067493 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-e785f663-f83e-414e-8ac2-4ca69114ccec tempest-VolumesBackupsTest-807180270 None] Calling eventlet.sleep(0) {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 09:53:55.100374 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-23e02918-5c1a-4749-8690-ba8ba087773d tempest-ProjectReaderTests33-761902925 None] deleted object: volume_44062477-adb9-4fe5-a2cb-600f263cd316/20260703095252/az_nova_backup_6624fbb5-b72a-4c4d-bc8d-5f32665a951a-00020 in container: volumebackups. {{(pid=101319) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 09:53:55.101493 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-0c8f0b9c-3469-46f6-ba0e-fba74e3be6db tempest-ProjectMemberTests33-2105464604 None] backup MD5 for volume_5f57fed7-aa36-44c5-af90-863bd3d3af9d/20260703095349/az_nova_backup_885775bd-f91a-424f-bc10-7913c6a90400-00010: 25e317773f308e446cc84c503a6d1f85 {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 09:53:55.101638 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-0c8f0b9c-3469-46f6-ba0e-fba74e3be6db tempest-ProjectMemberTests33-2105464604 None] Calling eventlet.sleep(0) {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 09:53:55.133615 np0000004400 cinder-backup[101319]: DEBUG oslo_db.sqlalchemy.engines [None req-e785f663-f83e-414e-8ac2-4ca69114ccec tempest-VolumesBackupsTest-807180270 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=101319) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 03 09:53:55.140397 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-23e02918-5c1a-4749-8690-ba8ba087773d tempest-ProjectReaderTests33-761902925 None] deleted object: volume_44062477-adb9-4fe5-a2cb-600f263cd316/20260703095252/az_nova_backup_6624fbb5-b72a-4c4d-bc8d-5f32665a951a-00021 in container: volumebackups. {{(pid=101319) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 09:53:55.158712 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-23e02918-5c1a-4749-8690-ba8ba087773d tempest-ProjectReaderTests33-761902925 None] deleted object: volume_44062477-adb9-4fe5-a2cb-600f263cd316/20260703095252/az_nova_backup_6624fbb5-b72a-4c4d-bc8d-5f32665a951a_metadata in container: volumebackups. {{(pid=101319) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 09:53:55.178182 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-23e02918-5c1a-4749-8690-ba8ba087773d tempest-ProjectReaderTests33-761902925 None] deleted object: volume_44062477-adb9-4fe5-a2cb-600f263cd316/20260703095252/az_nova_backup_6624fbb5-b72a-4c4d-bc8d-5f32665a951a_sha256file in container: volumebackups. {{(pid=101319) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 09:53:55.178422 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-23e02918-5c1a-4749-8690-ba8ba087773d tempest-ProjectReaderTests33-761902925 None] delete 6624fbb5-b72a-4c4d-bc8d-5f32665a951a finished. {{(pid=101319) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:848}} Jul 03 09:53:55.192781 np0000004400 cinder-backup[101319]: DEBUG cinder.quota [None req-23e02918-5c1a-4749-8690-ba8ba087773d tempest-ProjectReaderTests33-761902925 None] Created reservations ['5cfa7a87-7e36-4023-b952-e8f2d6ffad4e', '58d709bb-ed1d-4095-b976-6436d7d55b70'] {{(pid=101319) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 09:53:55.207205 np0000004400 cinder-backup[101319]: INFO cinder.backup.manager [None req-23e02918-5c1a-4749-8690-ba8ba087773d tempest-ProjectReaderTests33-761902925 None] Delete backup finished, backup 6624fbb5-b72a-4c4d-bc8d-5f32665a951a deleted. Jul 03 09:53:55.415754 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-e785f663-f83e-414e-8ac2-4ca69114ccec tempest-VolumesBackupsTest-807180270 None] Backing up chunk of data from volume. {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 09:53:55.416255 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-0c8f0b9c-3469-46f6-ba0e-fba74e3be6db tempest-ProjectMemberTests33-2105464604 None] Backing up chunk of data from volume. {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 09:53:55.650022 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-e785f663-f83e-414e-8ac2-4ca69114ccec tempest-VolumesBackupsTest-807180270 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101319) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 09:53:55.650138 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-e785f663-f83e-414e-8ac2-4ca69114ccec tempest-VolumesBackupsTest-807180270 None] About to put_object {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 09:53:55.661276 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-0c8f0b9c-3469-46f6-ba0e-fba74e3be6db tempest-ProjectMemberTests33-2105464604 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101319) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 09:53:55.661884 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-0c8f0b9c-3469-46f6-ba0e-fba74e3be6db tempest-ProjectMemberTests33-2105464604 None] About to put_object {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 09:53:55.755457 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-e785f663-f83e-414e-8ac2-4ca69114ccec tempest-VolumesBackupsTest-807180270 None] backup MD5 for volume_b578d41f-4c6a-49b3-b5ec-bcd6556e2e68/20260703095347/az_nova_backup_c52fbc4a-f7d8-49e2-bd92-5bbf2f7f98ba-00014: 25e317773f308e446cc84c503a6d1f85 {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 09:53:55.755654 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-e785f663-f83e-414e-8ac2-4ca69114ccec tempest-VolumesBackupsTest-807180270 None] Calling eventlet.sleep(0) {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 09:53:55.759425 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-0c8f0b9c-3469-46f6-ba0e-fba74e3be6db tempest-ProjectMemberTests33-2105464604 None] backup MD5 for volume_5f57fed7-aa36-44c5-af90-863bd3d3af9d/20260703095349/az_nova_backup_885775bd-f91a-424f-bc10-7913c6a90400-00011: 25e317773f308e446cc84c503a6d1f85 {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 09:53:55.760299 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-0c8f0b9c-3469-46f6-ba0e-fba74e3be6db tempest-ProjectMemberTests33-2105464604 None] Calling eventlet.sleep(0) {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 09:53:56.044570 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-0c8f0b9c-3469-46f6-ba0e-fba74e3be6db tempest-ProjectMemberTests33-2105464604 None] Backing up chunk of data from volume. {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 09:53:56.046548 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-e785f663-f83e-414e-8ac2-4ca69114ccec tempest-VolumesBackupsTest-807180270 None] Backing up chunk of data from volume. {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 09:53:56.288452 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-e785f663-f83e-414e-8ac2-4ca69114ccec tempest-VolumesBackupsTest-807180270 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101319) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 09:53:56.288452 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-e785f663-f83e-414e-8ac2-4ca69114ccec tempest-VolumesBackupsTest-807180270 None] About to put_object {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 09:53:56.288748 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-0c8f0b9c-3469-46f6-ba0e-fba74e3be6db tempest-ProjectMemberTests33-2105464604 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101319) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 09:53:56.288898 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-0c8f0b9c-3469-46f6-ba0e-fba74e3be6db tempest-ProjectMemberTests33-2105464604 None] About to put_object {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 09:53:56.398243 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-0c8f0b9c-3469-46f6-ba0e-fba74e3be6db tempest-ProjectMemberTests33-2105464604 None] backup MD5 for volume_5f57fed7-aa36-44c5-af90-863bd3d3af9d/20260703095349/az_nova_backup_885775bd-f91a-424f-bc10-7913c6a90400-00012: 25e317773f308e446cc84c503a6d1f85 {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 09:53:56.398459 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-0c8f0b9c-3469-46f6-ba0e-fba74e3be6db tempest-ProjectMemberTests33-2105464604 None] Calling eventlet.sleep(0) {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 09:53:56.400869 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-e785f663-f83e-414e-8ac2-4ca69114ccec tempest-VolumesBackupsTest-807180270 None] backup MD5 for volume_b578d41f-4c6a-49b3-b5ec-bcd6556e2e68/20260703095347/az_nova_backup_c52fbc4a-f7d8-49e2-bd92-5bbf2f7f98ba-00015: 25e317773f308e446cc84c503a6d1f85 {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 09:53:56.401015 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-e785f663-f83e-414e-8ac2-4ca69114ccec tempest-VolumesBackupsTest-807180270 None] Calling eventlet.sleep(0) {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 09:53:56.692759 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-0c8f0b9c-3469-46f6-ba0e-fba74e3be6db tempest-ProjectMemberTests33-2105464604 None] Backing up chunk of data from volume. {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 09:53:56.693319 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-e785f663-f83e-414e-8ac2-4ca69114ccec tempest-VolumesBackupsTest-807180270 None] Backing up chunk of data from volume. {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 09:53:56.940103 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-e785f663-f83e-414e-8ac2-4ca69114ccec tempest-VolumesBackupsTest-807180270 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101319) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 09:53:56.940298 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-e785f663-f83e-414e-8ac2-4ca69114ccec tempest-VolumesBackupsTest-807180270 None] About to put_object {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 09:53:56.941507 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-0c8f0b9c-3469-46f6-ba0e-fba74e3be6db tempest-ProjectMemberTests33-2105464604 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101319) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 09:53:56.942471 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-0c8f0b9c-3469-46f6-ba0e-fba74e3be6db tempest-ProjectMemberTests33-2105464604 None] About to put_object {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 09:53:57.046127 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-e785f663-f83e-414e-8ac2-4ca69114ccec tempest-VolumesBackupsTest-807180270 None] backup MD5 for volume_b578d41f-4c6a-49b3-b5ec-bcd6556e2e68/20260703095347/az_nova_backup_c52fbc4a-f7d8-49e2-bd92-5bbf2f7f98ba-00016: 25e317773f308e446cc84c503a6d1f85 {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 09:53:57.046127 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-e785f663-f83e-414e-8ac2-4ca69114ccec tempest-VolumesBackupsTest-807180270 None] Calling eventlet.sleep(0) {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 09:53:57.047164 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-0c8f0b9c-3469-46f6-ba0e-fba74e3be6db tempest-ProjectMemberTests33-2105464604 None] backup MD5 for volume_5f57fed7-aa36-44c5-af90-863bd3d3af9d/20260703095349/az_nova_backup_885775bd-f91a-424f-bc10-7913c6a90400-00013: 25e317773f308e446cc84c503a6d1f85 {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 09:53:57.047289 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-0c8f0b9c-3469-46f6-ba0e-fba74e3be6db tempest-ProjectMemberTests33-2105464604 None] Calling eventlet.sleep(0) {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 09:53:57.317300 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-0c8f0b9c-3469-46f6-ba0e-fba74e3be6db tempest-ProjectMemberTests33-2105464604 None] Backing up chunk of data from volume. {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 09:53:57.326688 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-e785f663-f83e-414e-8ac2-4ca69114ccec tempest-VolumesBackupsTest-807180270 None] Backing up chunk of data from volume. {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 09:53:57.565390 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-0c8f0b9c-3469-46f6-ba0e-fba74e3be6db tempest-ProjectMemberTests33-2105464604 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101319) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 09:53:57.565541 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-0c8f0b9c-3469-46f6-ba0e-fba74e3be6db tempest-ProjectMemberTests33-2105464604 None] About to put_object {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 09:53:57.578508 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-e785f663-f83e-414e-8ac2-4ca69114ccec tempest-VolumesBackupsTest-807180270 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101319) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 09:53:57.578659 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-e785f663-f83e-414e-8ac2-4ca69114ccec tempest-VolumesBackupsTest-807180270 None] About to put_object {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 09:53:57.675657 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-0c8f0b9c-3469-46f6-ba0e-fba74e3be6db tempest-ProjectMemberTests33-2105464604 None] backup MD5 for volume_5f57fed7-aa36-44c5-af90-863bd3d3af9d/20260703095349/az_nova_backup_885775bd-f91a-424f-bc10-7913c6a90400-00014: 25e317773f308e446cc84c503a6d1f85 {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 09:53:57.675841 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-0c8f0b9c-3469-46f6-ba0e-fba74e3be6db tempest-ProjectMemberTests33-2105464604 None] Calling eventlet.sleep(0) {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 09:53:57.691542 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-e785f663-f83e-414e-8ac2-4ca69114ccec tempest-VolumesBackupsTest-807180270 None] backup MD5 for volume_b578d41f-4c6a-49b3-b5ec-bcd6556e2e68/20260703095347/az_nova_backup_c52fbc4a-f7d8-49e2-bd92-5bbf2f7f98ba-00017: 25e317773f308e446cc84c503a6d1f85 {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 09:53:57.692063 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-e785f663-f83e-414e-8ac2-4ca69114ccec tempest-VolumesBackupsTest-807180270 None] Calling eventlet.sleep(0) {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 09:53:57.968192 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-0c8f0b9c-3469-46f6-ba0e-fba74e3be6db tempest-ProjectMemberTests33-2105464604 None] Backing up chunk of data from volume. {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 09:53:57.989202 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-e785f663-f83e-414e-8ac2-4ca69114ccec tempest-VolumesBackupsTest-807180270 None] Backing up chunk of data from volume. {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 09:53:58.242964 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-0c8f0b9c-3469-46f6-ba0e-fba74e3be6db tempest-ProjectMemberTests33-2105464604 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101319) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 09:53:58.243211 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-0c8f0b9c-3469-46f6-ba0e-fba74e3be6db tempest-ProjectMemberTests33-2105464604 None] About to put_object {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 09:53:58.263483 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-e785f663-f83e-414e-8ac2-4ca69114ccec tempest-VolumesBackupsTest-807180270 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101319) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 09:53:58.263692 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-e785f663-f83e-414e-8ac2-4ca69114ccec tempest-VolumesBackupsTest-807180270 None] About to put_object {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 09:53:58.356976 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-0c8f0b9c-3469-46f6-ba0e-fba74e3be6db tempest-ProjectMemberTests33-2105464604 None] backup MD5 for volume_5f57fed7-aa36-44c5-af90-863bd3d3af9d/20260703095349/az_nova_backup_885775bd-f91a-424f-bc10-7913c6a90400-00015: 25e317773f308e446cc84c503a6d1f85 {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 09:53:58.357198 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-0c8f0b9c-3469-46f6-ba0e-fba74e3be6db tempest-ProjectMemberTests33-2105464604 None] Calling eventlet.sleep(0) {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 09:53:58.372292 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-e785f663-f83e-414e-8ac2-4ca69114ccec tempest-VolumesBackupsTest-807180270 None] backup MD5 for volume_b578d41f-4c6a-49b3-b5ec-bcd6556e2e68/20260703095347/az_nova_backup_c52fbc4a-f7d8-49e2-bd92-5bbf2f7f98ba-00018: 25e317773f308e446cc84c503a6d1f85 {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 09:53:58.372540 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-e785f663-f83e-414e-8ac2-4ca69114ccec tempest-VolumesBackupsTest-807180270 None] Calling eventlet.sleep(0) {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 09:53:58.666851 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-0c8f0b9c-3469-46f6-ba0e-fba74e3be6db tempest-ProjectMemberTests33-2105464604 None] Backing up chunk of data from volume. {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 09:53:58.683364 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-e785f663-f83e-414e-8ac2-4ca69114ccec tempest-VolumesBackupsTest-807180270 None] Backing up chunk of data from volume. {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 09:53:58.917678 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-0c8f0b9c-3469-46f6-ba0e-fba74e3be6db tempest-ProjectMemberTests33-2105464604 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101319) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 09:53:58.917840 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-0c8f0b9c-3469-46f6-ba0e-fba74e3be6db tempest-ProjectMemberTests33-2105464604 None] About to put_object {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 09:53:58.962250 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-e785f663-f83e-414e-8ac2-4ca69114ccec tempest-VolumesBackupsTest-807180270 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101319) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 09:53:58.962458 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-e785f663-f83e-414e-8ac2-4ca69114ccec tempest-VolumesBackupsTest-807180270 None] About to put_object {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 09:53:59.016199 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-0c8f0b9c-3469-46f6-ba0e-fba74e3be6db tempest-ProjectMemberTests33-2105464604 None] backup MD5 for volume_5f57fed7-aa36-44c5-af90-863bd3d3af9d/20260703095349/az_nova_backup_885775bd-f91a-424f-bc10-7913c6a90400-00016: 25e317773f308e446cc84c503a6d1f85 {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 09:53:59.016502 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-0c8f0b9c-3469-46f6-ba0e-fba74e3be6db tempest-ProjectMemberTests33-2105464604 None] Calling eventlet.sleep(0) {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 09:53:59.060559 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-e785f663-f83e-414e-8ac2-4ca69114ccec tempest-VolumesBackupsTest-807180270 None] backup MD5 for volume_b578d41f-4c6a-49b3-b5ec-bcd6556e2e68/20260703095347/az_nova_backup_c52fbc4a-f7d8-49e2-bd92-5bbf2f7f98ba-00019: 25e317773f308e446cc84c503a6d1f85 {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 09:53:59.060745 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-e785f663-f83e-414e-8ac2-4ca69114ccec tempest-VolumesBackupsTest-807180270 None] Calling eventlet.sleep(0) {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 09:53:59.244005 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-0c8f0b9c-3469-46f6-ba0e-fba74e3be6db tempest-ProjectMemberTests33-2105464604 None] Backing up chunk of data from volume. {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 09:53:59.301196 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-e785f663-f83e-414e-8ac2-4ca69114ccec tempest-VolumesBackupsTest-807180270 None] Backing up chunk of data from volume. {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 09:53:59.487084 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-0c8f0b9c-3469-46f6-ba0e-fba74e3be6db tempest-ProjectMemberTests33-2105464604 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101319) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 09:53:59.487204 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-0c8f0b9c-3469-46f6-ba0e-fba74e3be6db tempest-ProjectMemberTests33-2105464604 None] About to put_object {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 09:53:59.554556 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-e785f663-f83e-414e-8ac2-4ca69114ccec tempest-VolumesBackupsTest-807180270 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101319) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 09:53:59.554686 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-e785f663-f83e-414e-8ac2-4ca69114ccec tempest-VolumesBackupsTest-807180270 None] About to put_object {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 09:53:59.588038 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-0c8f0b9c-3469-46f6-ba0e-fba74e3be6db tempest-ProjectMemberTests33-2105464604 None] backup MD5 for volume_5f57fed7-aa36-44c5-af90-863bd3d3af9d/20260703095349/az_nova_backup_885775bd-f91a-424f-bc10-7913c6a90400-00017: 25e317773f308e446cc84c503a6d1f85 {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 09:53:59.588166 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-0c8f0b9c-3469-46f6-ba0e-fba74e3be6db tempest-ProjectMemberTests33-2105464604 None] Calling eventlet.sleep(0) {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 09:53:59.661288 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-e785f663-f83e-414e-8ac2-4ca69114ccec tempest-VolumesBackupsTest-807180270 None] backup MD5 for volume_b578d41f-4c6a-49b3-b5ec-bcd6556e2e68/20260703095347/az_nova_backup_c52fbc4a-f7d8-49e2-bd92-5bbf2f7f98ba-00020: 25e317773f308e446cc84c503a6d1f85 {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 09:53:59.661489 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-e785f663-f83e-414e-8ac2-4ca69114ccec tempest-VolumesBackupsTest-807180270 None] Calling eventlet.sleep(0) {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 09:53:59.795287 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-e785f663-f83e-414e-8ac2-4ca69114ccec tempest-VolumesBackupsTest-807180270 None] Backing up chunk of data from volume. {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 09:53:59.813737 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-0c8f0b9c-3469-46f6-ba0e-fba74e3be6db tempest-ProjectMemberTests33-2105464604 None] Backing up chunk of data from volume. {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 09:53:59.913071 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-e785f663-f83e-414e-8ac2-4ca69114ccec tempest-VolumesBackupsTest-807180270 None] Compressed 25165824 bytes of data to 24470 bytes using zlib. {{(pid=101319) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 09:53:59.913313 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-e785f663-f83e-414e-8ac2-4ca69114ccec tempest-VolumesBackupsTest-807180270 None] About to put_object {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 09:53:59.986027 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-e785f663-f83e-414e-8ac2-4ca69114ccec tempest-VolumesBackupsTest-807180270 None] backup MD5 for volume_b578d41f-4c6a-49b3-b5ec-bcd6556e2e68/20260703095347/az_nova_backup_c52fbc4a-f7d8-49e2-bd92-5bbf2f7f98ba-00021: 77377273b0a4b61febdbf7bbf52b9db9 {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 09:53:59.986198 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-e785f663-f83e-414e-8ac2-4ca69114ccec tempest-VolumesBackupsTest-807180270 None] Calling eventlet.sleep(0) {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 09:53:59.994272 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.driver [None req-e785f663-f83e-414e-8ac2-4ca69114ccec tempest-VolumesBackupsTest-807180270 None] Getting metadata type 'volume-base-metadata' {{(pid=101319) _save_vol_base_meta /opt/stack/cinder/cinder/backup/driver.py:79}} Jul 03 09:54:00.002135 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.driver [None req-e785f663-f83e-414e-8ac2-4ca69114ccec tempest-VolumesBackupsTest-807180270 None] Completed fetching metadata type 'volume-base-metadata' {{(pid=101319) _save_vol_base_meta /opt/stack/cinder/cinder/backup/driver.py:98}} Jul 03 09:54:00.002373 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.driver [None req-e785f663-f83e-414e-8ac2-4ca69114ccec tempest-VolumesBackupsTest-807180270 None] Getting metadata type 'volume-metadata' {{(pid=101319) _save_vol_meta /opt/stack/cinder/cinder/backup/driver.py:109}} Jul 03 09:54:00.006624 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.driver [None req-e785f663-f83e-414e-8ac2-4ca69114ccec tempest-VolumesBackupsTest-807180270 None] No metadata type 'volume-metadata' available {{(pid=101319) _save_vol_meta /opt/stack/cinder/cinder/backup/driver.py:123}} Jul 03 09:54:00.006807 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.driver [None req-e785f663-f83e-414e-8ac2-4ca69114ccec tempest-VolumesBackupsTest-807180270 None] Getting metadata type 'volume-glance-metadata' {{(pid=101319) _save_vol_glance_meta /opt/stack/cinder/cinder/backup/driver.py:132}} Jul 03 09:54:00.010024 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.driver [None req-e785f663-f83e-414e-8ac2-4ca69114ccec tempest-VolumesBackupsTest-807180270 None] No metadata type 'volume-glance-metadata' available {{(pid=101319) _save_vol_glance_meta /opt/stack/cinder/cinder/backup/driver.py:147}} Jul 03 09:54:00.010561 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-e785f663-f83e-414e-8ac2-4ca69114ccec tempest-VolumesBackupsTest-807180270 None] _write_sha256file started, container name: volumebackups, sha256file filename: volume_b578d41f-4c6a-49b3-b5ec-bcd6556e2e68/20260703095347/az_nova_backup_c52fbc4a-f7d8-49e2-bd92-5bbf2f7f98ba_sha256file. {{(pid=101319) _write_sha256file /opt/stack/cinder/cinder/backup/chunkeddriver.py:299}} Jul 03 09:54:00.062197 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-0c8f0b9c-3469-46f6-ba0e-fba74e3be6db tempest-ProjectMemberTests33-2105464604 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101319) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 09:54:00.062521 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-0c8f0b9c-3469-46f6-ba0e-fba74e3be6db tempest-ProjectMemberTests33-2105464604 None] About to put_object {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 09:54:00.064459 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-e785f663-f83e-414e-8ac2-4ca69114ccec tempest-VolumesBackupsTest-807180270 None] _write_sha256file finished. {{(pid=101319) _write_sha256file /opt/stack/cinder/cinder/backup/chunkeddriver.py:315}} Jul 03 09:54:00.065051 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-e785f663-f83e-414e-8ac2-4ca69114ccec tempest-VolumesBackupsTest-807180270 None] _write_metadata started, container name: volumebackups, metadata filename: volume_b578d41f-4c6a-49b3-b5ec-bcd6556e2e68/20260703095347/az_nova_backup_c52fbc4a-f7d8-49e2-bd92-5bbf2f7f98ba_metadata. {{(pid=101319) _write_metadata /opt/stack/cinder/cinder/backup/chunkeddriver.py:276}} Jul 03 09:54:00.089766 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-e785f663-f83e-414e-8ac2-4ca69114ccec tempest-VolumesBackupsTest-807180270 None] _write_metadata finished. Metadata: b'{\n "backup_description": null,\n "backup_id": "c52fbc4a-f7d8-49e2-bd92-5bbf2f7f98ba",\n "backup_name": "tempest-VolumesBackupsTest-Backup-550290701",\n "created_at": "2026-07-03 09:53:44+00:00",\n "objects": [\n {\n "volume_b578d41f-4c6a-49b3-b5ec-bcd6556e2e68/20260703095347/az_nova_backup_c52fbc4a-f7d8-49e2-bd92-5bbf2f7f98ba-00001": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 0\n }\n },\n {\n "volume_b578d41f-4c6a-49b3-b5ec-bcd6556e2e68/20260703095347/az_nova_backup_c52fbc4a-f7d8-49e2-bd92-5bbf2f7f98ba-00002": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 52428800\n }\n },\n {\n "volume_b578d41f-4c6a-49b3-b5ec-bcd6556e2e68/20260703095347/az_nova_backup_c52fbc4a-f7d8-49e2-bd92-5bbf2f7f98ba-00003": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 104857600\n }\n },\n {\n "volume_b578d41f-4c6a-49b3-b5ec-bcd6556e2e68/20260703095347/az_nova_backup_c52fbc4a-f7d8-49e2-bd92-5bbf2f7f98ba-00004": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 157286400\n }\n },\n {\n "volume_b578d41f-4c6a-49b3-b5ec-bcd6556e2e68/20260703095347/az_nova_backup_c52fbc4a-f7d8-49e2-bd92-5bbf2f7f98ba-00005": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 209715200\n }\n },\n {\n "volume_b578d41f-4c6a-49b3-b5ec-bcd6556e2e68/20260703095347/az_nova_backup_c52fbc4a-f7d8-49e2-bd92-5bbf2f7f98ba-00006": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 262144000\n }\n },\n {\n "volume_b578d41f-4c6a-49b3-b5ec-bcd6556e2e68/20260703095347/az_nova_backup_c52fbc4a-f7d8-49e2-bd92-5bbf2f7f98ba-00007": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 314572800\n }\n },\n {\n "volume_b578d41f-4c6a-49b3-b5ec-bcd6556e2e68/20260703095347/az_nova_backup_c52fbc4a-f7d8-49e2-bd92-5bbf2f7f98ba-00008": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 367001600\n }\n },\n {\n "volume_b578d41f-4c6a-49b3-b5ec-bcd6556e2e68/20260703095347/az_nova_backup_c52fbc4a-f7d8-49e2-bd92-5bbf2f7f98ba-00009": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 419430400\n }\n },\n {\n "volume_b578d41f-4c6a-49b3-b5ec-bcd6556e2e68/20260703095347/az_nova_backup_c52fbc4a-f7d8-49e2-bd92-5bbf2f7f98ba-00010": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 471859200\n }\n },\n {\n "volume_b578d41f-4c6a-49b3-b5ec-bcd6556e2e68/20260703095347/az_nova_backup_c52fbc4a-f7d8-49e2-bd92-5bbf2f7f98ba-00011": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 524288000\n }\n },\n {\n "volume_b578d41f-4c6a-49b3-b5ec-bcd6556e2e68/20260703095347/az_nova_backup_c52fbc4a-f7d8-49e2-bd92-5bbf2f7f98ba-00012": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 576716800\n }\n },\n {\n "volume_b578d41f-4c6a-49b3-b5ec-bcd6556e2e68/20260703095347/az_nova_backup_c52fbc4a-f7d8-49e2-bd92-5bbf2f7f98ba-00013": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 629145600\n }\n },\n {\n "volume_b578d41f-4c6a-49b3-b5ec-bcd6556e2e68/20260703095347/az_nova_backup_c52fbc4a-f7d8-49e2-bd92-5bbf2f7f98ba-00014": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 681574400\n }\n },\n {\n "volume_b578d41f-4c6a-49b3-b5ec-bcd6556e2e68/20260703095347/az_nova_backup_c52fbc4a-f7d8-49e2-bd92-5bbf2f7f98ba-00015": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 734003200\n }\n },\n {\n "volume_b578d41f-4c6a-49b3-b5ec-bcd6556e2e68/20260703095347/az_nova_backup_c52fbc4a-f7d8-49e2-bd92-5bbf2f7f98ba-00016": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 786432000\n }\n },\n {\n "volume_b578d41f-4c6a-49b3-b5ec-bcd6556e2e68/20260703095347/az_nova_backup_c52fbc4a-f7d8-49e2-bd92-5bbf2f7f98ba-00017": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 838860800\n }\n },\n {\n "volume_b578d41f-4c6a-49b3-b5ec-bcd6556e2e68/20260703095347/az_nova_backup_c52fbc4a-f7d8-49e2-bd92-5bbf2f7f98ba-00018": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 891289600\n }\n },\n {\n "volume_b578d41f-4c6a-49b3-b5ec-bcd6556e2e68/20260703095347/az_nova_backup_c52fbc4a-f7d8-49e2-bd92-5bbf2f7f98ba-00019": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 943718400\n }\n },\n {\n "volume_b578d41f-4c6a-49b3-b5ec-bcd6556e2e68/20260703095347/az_nova_backup_c52fbc4a-f7d8-49e2-bd92-5bbf2f7f98ba-00020": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 996147200\n }\n },\n {\n "volume_b578d41f-4c6a-49b3-b5ec-bcd6556e2e68/20260703095347/az_nova_backup_c52fbc4a-f7d8-49e2-bd92-5bbf2f7f98ba-00021": {\n "compression": "zlib",\n "length": 25165824,\n "md5": "77377273b0a4b61febdbf7bbf52b9db9",\n "offset": 1048576000\n }\n }\n ],\n "parent_id": null,\n "version": "1.0.0",\n "volume_id": "b578d41f-4c6a-49b3-b5ec-bcd6556e2e68",\n "volume_meta": "{\\"version\\": 2, \\"volume-base-metadata\\": {\\"id\\": \\"b578d41f-4c6a-49b3-b5ec-bcd6556e2e68\\", \\"_name_id\\": null, \\"use_quota\\": true, \\"ec2_id\\": null, \\"user_id\\": \\"e3b8ecc8212649f489f39b74eac8ff8f\\", \\"project_id\\": \\"c36863fd49104594b80b419fafd78f5c\\", \\"snapshot_id\\": null, \\"cluster_name\\": null, \\"host\\": \\"np0000004400@storpool#default\\", \\"size\\": 1, \\"availability_zone\\": \\"nova\\", \\"status\\": \\"backing-up\\", \\"attach_status\\": \\"detached\\", \\"migration_status\\": null, \\"scheduled_at\\": \\"2026-07-03T09:53:43.000000\\", \\"launched_at\\": \\"2026-07-03T09:53:43.000000\\", \\"terminated_at\\": null, \\"display_name\\": \\"tempest-VolumesBackupsTest-Volume-1091773389\\", \\"display_description\\": null, \\"provider_location\\": null, \\"provider_auth\\": null, \\"provider_geometry\\": null, \\"provider_id\\": null, \\"volume_type_id\\": \\"03e13fe6-0e30-4803-ace0-725d38e6dc24\\", \\"source_volid\\": null, \\"encryption_key_id\\": null, \\"consistencygroup_id\\": null, \\"group_id\\": null, \\"bootable\\": false, \\"multiattach\\": false, \\"replication_status\\": null, \\"replication_extended_status\\": null, \\"replication_driver_data\\": null, \\"previous_status\\": \\"available\\", \\"service_uuid\\": \\"6d4b0e79-fefe-4744-b25f-34be05095200\\", \\"shared_targets\\": true, \\"deleted_at\\": null, \\"deleted\\": false, \\"created_at\\": \\"2026-07-03T09:53:43.000000\\", \\"updated_at\\": \\"2026-07-03T09:53:44.000000\\"}}"\n}'. {{(pid=101319) _write_metadata /opt/stack/cinder/cinder/backup/chunkeddriver.py:295}} Jul 03 09:54:00.093711 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-e785f663-f83e-414e-8ac2-4ca69114ccec tempest-VolumesBackupsTest-807180270 None] backup c52fbc4a-f7d8-49e2-bd92-5bbf2f7f98ba finished. {{(pid=101319) _finalize_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:462}} Jul 03 09:54:00.216440 np0000004400 cinder-backup[101319]: DEBUG oslo_concurrency.processutils [None req-e785f663-f83e-414e-8ac2-4ca69114ccec tempest-VolumesBackupsTest-807180270 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chown 0 /dev/sdd {{(pid=101319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 09:54:00.224480 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-0c8f0b9c-3469-46f6-ba0e-fba74e3be6db tempest-ProjectMemberTests33-2105464604 None] backup MD5 for volume_5f57fed7-aa36-44c5-af90-863bd3d3af9d/20260703095349/az_nova_backup_885775bd-f91a-424f-bc10-7913c6a90400-00018: 25e317773f308e446cc84c503a6d1f85 {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 09:54:00.224750 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-0c8f0b9c-3469-46f6-ba0e-fba74e3be6db tempest-ProjectMemberTests33-2105464604 None] Calling eventlet.sleep(0) {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 09:54:00.259786 np0000004400 sudo[155748]: stack : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chown 0 /dev/sdd Jul 03 09:54:00.262518 np0000004400 sudo[155748]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1002) Jul 03 09:54:00.413194 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-0c8f0b9c-3469-46f6-ba0e-fba74e3be6db tempest-ProjectMemberTests33-2105464604 None] Backing up chunk of data from volume. {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 09:54:00.576870 np0000004400 sudo[155748]: pam_unix(sudo:session): session closed for user root Jul 03 09:54:00.580108 np0000004400 cinder-backup[101319]: DEBUG oslo_concurrency.processutils [None req-e785f663-f83e-414e-8ac2-4ca69114ccec tempest-VolumesBackupsTest-807180270 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chown 0 /dev/sdd" returned: 0 in 0.364s {{(pid=101319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 09:54:00.580825 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-e785f663-f83e-414e-8ac2-4ca69114ccec tempest-VolumesBackupsTest-807180270 None] ==> disconnect_volume: call "{'args': (, {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-b578d41f-4c6a-49b3-b5ec-bcd6556e2e68', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'b578d41f-4c6a-49b3-b5ec-bcd6556e2e68', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': False}, {'type': 'block', 'scsi_wwn': 'SStorPool_iSCSI_DISK_1034578903445799236', 'path': '/dev/sdd'}), 'kwargs': {'force': True, 'ignore_errors': True}}" {{(pid=101319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}} Jul 03 09:54:00.581077 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.base [None req-e785f663-f83e-414e-8ac2-4ca69114ccec tempest-VolumesBackupsTest-807180270 None] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=101319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jul 03 09:54:00.581568 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.base [None req-e785f663-f83e-414e-8ac2-4ca69114ccec tempest-VolumesBackupsTest-807180270 None] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=101319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jul 03 09:54:00.581982 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-e785f663-f83e-414e-8ac2-4ca69114ccec tempest-VolumesBackupsTest-807180270 None] _get_connection_devices called with parameters: connection_properties={'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-b578d41f-4c6a-49b3-b5ec-bcd6556e2e68', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'b578d41f-4c6a-49b3-b5ec-bcd6556e2e68', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': False}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=101319) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:847}} Jul 03 09:54:00.598058 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-e785f663-f83e-414e-8ac2-4ca69114ccec tempest-VolumesBackupsTest-807180270 None] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS: Jul 03 09:54:00.598058 np0000004400 cinder-backup[101319]: No targets found. Jul 03 09:54:00.598058 np0000004400 cinder-backup[101319]: iSNS: Jul 03 09:54:00.598058 np0000004400 cinder-backup[101319]: No targets found. Jul 03 09:54:00.598058 np0000004400 cinder-backup[101319]: STATIC: Jul 03 09:54:00.598058 np0000004400 cinder-backup[101319]: Target: iqn.2023-03.storpool.com:os--volume-b578d41f-4c6a-49b3-b5ec-bcd6556e2e68 Jul 03 09:54:00.598058 np0000004400 cinder-backup[101319]: Portal: 192.168.40.100:3260,-1 Jul 03 09:54:00.598058 np0000004400 cinder-backup[101319]: Iface Name: default Jul 03 09:54:00.598058 np0000004400 cinder-backup[101319]: Target: iqn.2023-03.storpool.com:os--volume-5f57fed7-aa36-44c5-af90-863bd3d3af9d Jul 03 09:54:00.598058 np0000004400 cinder-backup[101319]: Portal: 192.168.40.100:3260,-1 Jul 03 09:54:00.598058 np0000004400 cinder-backup[101319]: Iface Name: default Jul 03 09:54:00.598058 np0000004400 cinder-backup[101319]: Target: iqn.2023-03.storpool.com:os--volume-789ec59e-ea87-4784-8990-156a35276b5f Jul 03 09:54:00.598058 np0000004400 cinder-backup[101319]: Portal: 192.168.50.100:3260,-1 Jul 03 09:54:00.598058 np0000004400 cinder-backup[101319]: Iface Name: default Jul 03 09:54:00.598058 np0000004400 cinder-backup[101319]: Portal: 192.168.40.100:3260,-1 Jul 03 09:54:00.598058 np0000004400 cinder-backup[101319]: Iface Name: default Jul 03 09:54:00.598058 np0000004400 cinder-backup[101319]: FIRMWARE: Jul 03 09:54:00.598058 np0000004400 cinder-backup[101319]: No targets found. Jul 03 09:54:00.598058 np0000004400 cinder-backup[101319]: stderr= {{(pid=101319) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jul 03 09:54:00.598058 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-e785f663-f83e-414e-8ac2-4ca69114ccec tempest-VolumesBackupsTest-807180270 None] Regex to get portals from discoverydb: ^SENDTARGETS: Jul 03 09:54:00.598058 np0000004400 cinder-backup[101319]: .*?^DiscoveryAddress: 192.168.40.100,3260.*? Jul 03 09:54:00.598058 np0000004400 cinder-backup[101319]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=101319) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:390}} Jul 03 09:54:00.598058 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-e785f663-f83e-414e-8ac2-4ca69114ccec tempest-VolumesBackupsTest-807180270 None] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-b578d41f-4c6a-49b3-b5ec-bcd6556e2e68', 0)] {{(pid=101319) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:858}} Jul 03 09:54:00.622219 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-e785f663-f83e-414e-8ac2-4ca69114ccec tempest-VolumesBackupsTest-807180270 None] iscsiadm ('-m', 'session'): stdout=tcp: [206] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b578d41f-4c6a-49b3-b5ec-bcd6556e2e68 (non-flash) Jul 03 09:54:00.622219 np0000004400 cinder-backup[101319]: tcp: [207] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5f57fed7-aa36-44c5-af90-863bd3d3af9d (non-flash) Jul 03 09:54:00.622219 np0000004400 cinder-backup[101319]: tcp: [208] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-789ec59e-ea87-4784-8990-156a35276b5f (non-flash) Jul 03 09:54:00.622219 np0000004400 cinder-backup[101319]: tcp: [209] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-789ec59e-ea87-4784-8990-156a35276b5f (non-flash) Jul 03 09:54:00.622219 np0000004400 cinder-backup[101319]: stderr= {{(pid=101319) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jul 03 09:54:00.622715 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-e785f663-f83e-414e-8ac2-4ca69114ccec tempest-VolumesBackupsTest-807180270 None] iscsi session list stdout=tcp: [206] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b578d41f-4c6a-49b3-b5ec-bcd6556e2e68 (non-flash) Jul 03 09:54:00.622715 np0000004400 cinder-backup[101319]: tcp: [207] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5f57fed7-aa36-44c5-af90-863bd3d3af9d (non-flash) Jul 03 09:54:00.622715 np0000004400 cinder-backup[101319]: tcp: [208] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-789ec59e-ea87-4784-8990-156a35276b5f (non-flash) Jul 03 09:54:00.622715 np0000004400 cinder-backup[101319]: tcp: [209] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-789ec59e-ea87-4784-8990-156a35276b5f (non-flash) Jul 03 09:54:00.622715 np0000004400 cinder-backup[101319]: stderr= {{(pid=101319) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jul 03 09:54:00.623061 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-e785f663-f83e-414e-8ac2-4ca69114ccec tempest-VolumesBackupsTest-807180270 None] Sessions list: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-b578d41f-4c6a-49b3-b5ec-bcd6556e2e68', '206'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-5f57fed7-aa36-44c5-af90-863bd3d3af9d', '207'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-789ec59e-ea87-4784-8990-156a35276b5f', '208'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-789ec59e-ea87-4784-8990-156a35276b5f', '209')] {{(pid=101319) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:866}} Jul 03 09:54:00.623314 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-e785f663-f83e-414e-8ac2-4ca69114ccec tempest-VolumesBackupsTest-807180270 None] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-b578d41f-4c6a-49b3-b5ec-bcd6556e2e68, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-b578d41f-4c6a-49b3-b5ec-bcd6556e2e68', '206')] {{(pid=101319) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}} Jul 03 09:54:00.624609 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-e785f663-f83e-414e-8ac2-4ca69114ccec tempest-VolumesBackupsTest-807180270 None] Resulting device map defaultdict(. at 0x7e7705877240>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-b578d41f-4c6a-49b3-b5ec-bcd6556e2e68'): ({'sdd'}, set())}) {{(pid=101319) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:912}} Jul 03 09:54:00.624609 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.linuxscsi [None req-e785f663-f83e-414e-8ac2-4ca69114ccec tempest-VolumesBackupsTest-807180270 None] Removing single pathed devices sdd {{(pid=101319) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}} Jul 03 09:54:00.637285 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.linuxscsi [None req-e785f663-f83e-414e-8ac2-4ca69114ccec tempest-VolumesBackupsTest-807180270 None] Flushing IO for device /dev/sdd {{(pid=101319) flush_device_io /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:461}} Jul 03 09:54:00.642868 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.linuxscsi [None req-e785f663-f83e-414e-8ac2-4ca69114ccec tempest-VolumesBackupsTest-807180270 None] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=101319) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}} Jul 03 09:54:00.661049 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-0c8f0b9c-3469-46f6-ba0e-fba74e3be6db tempest-ProjectMemberTests33-2105464604 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101319) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 09:54:00.661454 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-0c8f0b9c-3469-46f6-ba0e-fba74e3be6db tempest-ProjectMemberTests33-2105464604 None] About to put_object {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 09:54:00.693840 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.linuxscsi [None req-e785f663-f83e-414e-8ac2-4ca69114ccec tempest-VolumesBackupsTest-807180270 None] Checking to see if SCSI volumes sdd have been removed. {{(pid=101319) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}} Jul 03 09:54:00.693840 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.linuxscsi [None req-e785f663-f83e-414e-8ac2-4ca69114ccec tempest-VolumesBackupsTest-807180270 None] SCSI volumes sdd have been removed. {{(pid=101319) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}} Jul 03 09:54:00.693840 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.linuxscsi [None req-e785f663-f83e-414e-8ac2-4ca69114ccec tempest-VolumesBackupsTest-807180270 None] Checking to see if device paths {'sdd'} are still under multipathd monitoring {{(pid=101319) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}} Jul 03 09:54:00.703116 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.linuxscsi [None req-e785f663-f83e-414e-8ac2-4ca69114ccec tempest-VolumesBackupsTest-807180270 None] Device paths {'sdd'} have been removed from multipathd monitoring. {{(pid=101319) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}} Jul 03 09:54:00.703476 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-e785f663-f83e-414e-8ac2-4ca69114ccec tempest-VolumesBackupsTest-807180270 None] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-b578d41f-4c6a-49b3-b5ec-bcd6556e2e68')] {{(pid=101319) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1225}} Jul 03 09:54:00.713056 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-e785f663-f83e-414e-8ac2-4ca69114ccec tempest-VolumesBackupsTest-807180270 None] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=101319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 03 09:54:00.742476 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-e785f663-f83e-414e-8ac2-4ca69114ccec tempest-VolumesBackupsTest-807180270 None] iscsiadm ('--logout',): stdout=Logging out of session [sid: 206, target: iqn.2023-03.storpool.com:os--volume-b578d41f-4c6a-49b3-b5ec-bcd6556e2e68, portal: 192.168.40.100,3260] Jul 03 09:54:00.742476 np0000004400 cinder-backup[101319]: Logout of [sid: 206, target: iqn.2023-03.storpool.com:os--volume-b578d41f-4c6a-49b3-b5ec-bcd6556e2e68, portal: 192.168.40.100,3260] successful. Jul 03 09:54:00.742476 np0000004400 cinder-backup[101319]: stderr= {{(pid=101319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 03 09:54:00.755217 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-e785f663-f83e-414e-8ac2-4ca69114ccec tempest-VolumesBackupsTest-807180270 None] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=101319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 03 09:54:00.755598 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.base [None req-e785f663-f83e-414e-8ac2-4ca69114ccec tempest-VolumesBackupsTest-807180270 None] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.174s {{(pid=101319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jul 03 09:54:00.755837 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-e785f663-f83e-414e-8ac2-4ca69114ccec tempest-VolumesBackupsTest-807180270 None] <== disconnect_volume: return (175ms) None {{(pid=101319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}} Jul 03 09:54:00.760056 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-0c8f0b9c-3469-46f6-ba0e-fba74e3be6db tempest-ProjectMemberTests33-2105464604 None] backup MD5 for volume_5f57fed7-aa36-44c5-af90-863bd3d3af9d/20260703095349/az_nova_backup_885775bd-f91a-424f-bc10-7913c6a90400-00019: 25e317773f308e446cc84c503a6d1f85 {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 09:54:00.760268 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-0c8f0b9c-3469-46f6-ba0e-fba74e3be6db tempest-ProjectMemberTests33-2105464604 None] Calling eventlet.sleep(0) {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 09:54:00.957141 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-0c8f0b9c-3469-46f6-ba0e-fba74e3be6db tempest-ProjectMemberTests33-2105464604 None] Backing up chunk of data from volume. {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 09:54:01.195245 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-0c8f0b9c-3469-46f6-ba0e-fba74e3be6db tempest-ProjectMemberTests33-2105464604 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101319) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 09:54:01.195681 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-0c8f0b9c-3469-46f6-ba0e-fba74e3be6db tempest-ProjectMemberTests33-2105464604 None] About to put_object {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 09:54:01.293746 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-0c8f0b9c-3469-46f6-ba0e-fba74e3be6db tempest-ProjectMemberTests33-2105464604 None] backup MD5 for volume_5f57fed7-aa36-44c5-af90-863bd3d3af9d/20260703095349/az_nova_backup_885775bd-f91a-424f-bc10-7913c6a90400-00020: 25e317773f308e446cc84c503a6d1f85 {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 09:54:01.293897 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-0c8f0b9c-3469-46f6-ba0e-fba74e3be6db tempest-ProjectMemberTests33-2105464604 None] Calling eventlet.sleep(0) {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 09:54:01.388901 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-0c8f0b9c-3469-46f6-ba0e-fba74e3be6db tempest-ProjectMemberTests33-2105464604 None] Backing up chunk of data from volume. {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 09:54:01.507053 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-0c8f0b9c-3469-46f6-ba0e-fba74e3be6db tempest-ProjectMemberTests33-2105464604 None] Compressed 25165824 bytes of data to 24470 bytes using zlib. {{(pid=101319) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 09:54:01.507252 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-0c8f0b9c-3469-46f6-ba0e-fba74e3be6db tempest-ProjectMemberTests33-2105464604 None] About to put_object {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 09:54:01.576197 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-0c8f0b9c-3469-46f6-ba0e-fba74e3be6db tempest-ProjectMemberTests33-2105464604 None] backup MD5 for volume_5f57fed7-aa36-44c5-af90-863bd3d3af9d/20260703095349/az_nova_backup_885775bd-f91a-424f-bc10-7913c6a90400-00021: 77377273b0a4b61febdbf7bbf52b9db9 {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 09:54:01.576346 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-0c8f0b9c-3469-46f6-ba0e-fba74e3be6db tempest-ProjectMemberTests33-2105464604 None] Calling eventlet.sleep(0) {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 09:54:01.586816 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.driver [None req-0c8f0b9c-3469-46f6-ba0e-fba74e3be6db tempest-ProjectMemberTests33-2105464604 None] Getting metadata type 'volume-base-metadata' {{(pid=101319) _save_vol_base_meta /opt/stack/cinder/cinder/backup/driver.py:79}} Jul 03 09:54:01.594661 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.driver [None req-0c8f0b9c-3469-46f6-ba0e-fba74e3be6db tempest-ProjectMemberTests33-2105464604 None] Completed fetching metadata type 'volume-base-metadata' {{(pid=101319) _save_vol_base_meta /opt/stack/cinder/cinder/backup/driver.py:98}} Jul 03 09:54:01.594845 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.driver [None req-0c8f0b9c-3469-46f6-ba0e-fba74e3be6db tempest-ProjectMemberTests33-2105464604 None] Getting metadata type 'volume-metadata' {{(pid=101319) _save_vol_meta /opt/stack/cinder/cinder/backup/driver.py:109}} Jul 03 09:54:01.598371 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.driver [None req-0c8f0b9c-3469-46f6-ba0e-fba74e3be6db tempest-ProjectMemberTests33-2105464604 None] No metadata type 'volume-metadata' available {{(pid=101319) _save_vol_meta /opt/stack/cinder/cinder/backup/driver.py:123}} Jul 03 09:54:01.598552 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.driver [None req-0c8f0b9c-3469-46f6-ba0e-fba74e3be6db tempest-ProjectMemberTests33-2105464604 None] Getting metadata type 'volume-glance-metadata' {{(pid=101319) _save_vol_glance_meta /opt/stack/cinder/cinder/backup/driver.py:132}} Jul 03 09:54:01.601160 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.driver [None req-0c8f0b9c-3469-46f6-ba0e-fba74e3be6db tempest-ProjectMemberTests33-2105464604 None] No metadata type 'volume-glance-metadata' available {{(pid=101319) _save_vol_glance_meta /opt/stack/cinder/cinder/backup/driver.py:147}} Jul 03 09:54:01.601412 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-0c8f0b9c-3469-46f6-ba0e-fba74e3be6db tempest-ProjectMemberTests33-2105464604 None] _write_sha256file started, container name: volumebackups, sha256file filename: volume_5f57fed7-aa36-44c5-af90-863bd3d3af9d/20260703095349/az_nova_backup_885775bd-f91a-424f-bc10-7913c6a90400_sha256file. {{(pid=101319) _write_sha256file /opt/stack/cinder/cinder/backup/chunkeddriver.py:299}} Jul 03 09:54:01.659755 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-0c8f0b9c-3469-46f6-ba0e-fba74e3be6db tempest-ProjectMemberTests33-2105464604 None] _write_sha256file finished. {{(pid=101319) _write_sha256file /opt/stack/cinder/cinder/backup/chunkeddriver.py:315}} Jul 03 09:54:01.660882 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-0c8f0b9c-3469-46f6-ba0e-fba74e3be6db tempest-ProjectMemberTests33-2105464604 None] _write_metadata started, container name: volumebackups, metadata filename: volume_5f57fed7-aa36-44c5-af90-863bd3d3af9d/20260703095349/az_nova_backup_885775bd-f91a-424f-bc10-7913c6a90400_metadata. {{(pid=101319) _write_metadata /opt/stack/cinder/cinder/backup/chunkeddriver.py:276}} Jul 03 09:54:01.690794 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-0c8f0b9c-3469-46f6-ba0e-fba74e3be6db tempest-ProjectMemberTests33-2105464604 None] _write_metadata finished. Metadata: b'{\n "backup_description": null,\n "backup_id": "885775bd-f91a-424f-bc10-7913c6a90400",\n "backup_name": null,\n "created_at": "2026-07-03 09:53:45+00:00",\n "objects": [\n {\n "volume_5f57fed7-aa36-44c5-af90-863bd3d3af9d/20260703095349/az_nova_backup_885775bd-f91a-424f-bc10-7913c6a90400-00001": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 0\n }\n },\n {\n "volume_5f57fed7-aa36-44c5-af90-863bd3d3af9d/20260703095349/az_nova_backup_885775bd-f91a-424f-bc10-7913c6a90400-00002": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 52428800\n }\n },\n {\n "volume_5f57fed7-aa36-44c5-af90-863bd3d3af9d/20260703095349/az_nova_backup_885775bd-f91a-424f-bc10-7913c6a90400-00003": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 104857600\n }\n },\n {\n "volume_5f57fed7-aa36-44c5-af90-863bd3d3af9d/20260703095349/az_nova_backup_885775bd-f91a-424f-bc10-7913c6a90400-00004": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 157286400\n }\n },\n {\n "volume_5f57fed7-aa36-44c5-af90-863bd3d3af9d/20260703095349/az_nova_backup_885775bd-f91a-424f-bc10-7913c6a90400-00005": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 209715200\n }\n },\n {\n "volume_5f57fed7-aa36-44c5-af90-863bd3d3af9d/20260703095349/az_nova_backup_885775bd-f91a-424f-bc10-7913c6a90400-00006": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 262144000\n }\n },\n {\n "volume_5f57fed7-aa36-44c5-af90-863bd3d3af9d/20260703095349/az_nova_backup_885775bd-f91a-424f-bc10-7913c6a90400-00007": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 314572800\n }\n },\n {\n "volume_5f57fed7-aa36-44c5-af90-863bd3d3af9d/20260703095349/az_nova_backup_885775bd-f91a-424f-bc10-7913c6a90400-00008": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 367001600\n }\n },\n {\n "volume_5f57fed7-aa36-44c5-af90-863bd3d3af9d/20260703095349/az_nova_backup_885775bd-f91a-424f-bc10-7913c6a90400-00009": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 419430400\n }\n },\n {\n "volume_5f57fed7-aa36-44c5-af90-863bd3d3af9d/20260703095349/az_nova_backup_885775bd-f91a-424f-bc10-7913c6a90400-00010": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 471859200\n }\n },\n {\n "volume_5f57fed7-aa36-44c5-af90-863bd3d3af9d/20260703095349/az_nova_backup_885775bd-f91a-424f-bc10-7913c6a90400-00011": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 524288000\n }\n },\n {\n "volume_5f57fed7-aa36-44c5-af90-863bd3d3af9d/20260703095349/az_nova_backup_885775bd-f91a-424f-bc10-7913c6a90400-00012": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 576716800\n }\n },\n {\n "volume_5f57fed7-aa36-44c5-af90-863bd3d3af9d/20260703095349/az_nova_backup_885775bd-f91a-424f-bc10-7913c6a90400-00013": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 629145600\n }\n },\n {\n "volume_5f57fed7-aa36-44c5-af90-863bd3d3af9d/20260703095349/az_nova_backup_885775bd-f91a-424f-bc10-7913c6a90400-00014": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 681574400\n }\n },\n {\n "volume_5f57fed7-aa36-44c5-af90-863bd3d3af9d/20260703095349/az_nova_backup_885775bd-f91a-424f-bc10-7913c6a90400-00015": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 734003200\n }\n },\n {\n "volume_5f57fed7-aa36-44c5-af90-863bd3d3af9d/20260703095349/az_nova_backup_885775bd-f91a-424f-bc10-7913c6a90400-00016": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 786432000\n }\n },\n {\n "volume_5f57fed7-aa36-44c5-af90-863bd3d3af9d/20260703095349/az_nova_backup_885775bd-f91a-424f-bc10-7913c6a90400-00017": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 838860800\n }\n },\n {\n "volume_5f57fed7-aa36-44c5-af90-863bd3d3af9d/20260703095349/az_nova_backup_885775bd-f91a-424f-bc10-7913c6a90400-00018": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 891289600\n }\n },\n {\n "volume_5f57fed7-aa36-44c5-af90-863bd3d3af9d/20260703095349/az_nova_backup_885775bd-f91a-424f-bc10-7913c6a90400-00019": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 943718400\n }\n },\n {\n "volume_5f57fed7-aa36-44c5-af90-863bd3d3af9d/20260703095349/az_nova_backup_885775bd-f91a-424f-bc10-7913c6a90400-00020": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 996147200\n }\n },\n {\n "volume_5f57fed7-aa36-44c5-af90-863bd3d3af9d/20260703095349/az_nova_backup_885775bd-f91a-424f-bc10-7913c6a90400-00021": {\n "compression": "zlib",\n "length": 25165824,\n "md5": "77377273b0a4b61febdbf7bbf52b9db9",\n "offset": 1048576000\n }\n }\n ],\n "parent_id": null,\n "version": "1.0.0",\n "volume_id": "5f57fed7-aa36-44c5-af90-863bd3d3af9d",\n "volume_meta": "{\\"version\\": 2, \\"volume-base-metadata\\": {\\"id\\": \\"5f57fed7-aa36-44c5-af90-863bd3d3af9d\\", \\"_name_id\\": null, \\"use_quota\\": true, \\"ec2_id\\": null, \\"user_id\\": \\"87abbb474f8a4baf840fcfdf286ff94e\\", \\"project_id\\": \\"e0b6e59b911e40b3acac38afb1f81e3a\\", \\"snapshot_id\\": null, \\"cluster_name\\": null, \\"host\\": \\"np0000004400@storpool#default\\", \\"size\\": 1, \\"availability_zone\\": \\"nova\\", \\"status\\": \\"backing-up\\", \\"attach_status\\": \\"detached\\", \\"migration_status\\": null, \\"scheduled_at\\": \\"2026-07-03T09:53:22.000000\\", \\"launched_at\\": \\"2026-07-03T09:53:22.000000\\", \\"terminated_at\\": null, \\"display_name\\": \\"tempest-VolumeV3RbacBaseTests-Volume-1340187584\\", \\"display_description\\": null, \\"provider_location\\": null, \\"provider_auth\\": null, \\"provider_geometry\\": null, \\"provider_id\\": null, \\"volume_type_id\\": \\"03e13fe6-0e30-4803-ace0-725d38e6dc24\\", \\"source_volid\\": null, \\"encryption_key_id\\": null, \\"consistencygroup_id\\": null, \\"group_id\\": null, \\"bootable\\": false, \\"multiattach\\": false, \\"replication_status\\": null, \\"replication_extended_status\\": null, \\"replication_driver_data\\": null, \\"previous_status\\": \\"available\\", \\"service_uuid\\": \\"6d4b0e79-fefe-4744-b25f-34be05095200\\", \\"shared_targets\\": true, \\"deleted_at\\": null, \\"deleted\\": false, \\"created_at\\": \\"2026-07-03T09:53:22.000000\\", \\"updated_at\\": \\"2026-07-03T09:53:45.000000\\"}}"\n}'. {{(pid=101319) _write_metadata /opt/stack/cinder/cinder/backup/chunkeddriver.py:295}} Jul 03 09:54:01.694091 np0000004400 cinder-backup[101319]: DEBUG dbcounter [-] [101319] Writing DB stats cinder:SELECT=260,cinder:UPDATE=71,cinder:INSERT=10 {{(pid=101319) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 03 09:54:01.697793 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-0c8f0b9c-3469-46f6-ba0e-fba74e3be6db tempest-ProjectMemberTests33-2105464604 None] backup 885775bd-f91a-424f-bc10-7913c6a90400 finished. {{(pid=101319) _finalize_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:462}} Jul 03 09:54:01.824573 np0000004400 cinder-backup[101319]: DEBUG oslo_concurrency.processutils [None req-0c8f0b9c-3469-46f6-ba0e-fba74e3be6db tempest-ProjectMemberTests33-2105464604 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chown 0 /dev/sde {{(pid=101319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 09:54:01.844809 np0000004400 sudo[155774]: stack : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chown 0 /dev/sde Jul 03 09:54:01.845478 np0000004400 sudo[155774]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1002) Jul 03 09:54:01.852769 np0000004400 cinder-backup[101319]: INFO cinder.backup.manager [None req-e785f663-f83e-414e-8ac2-4ca69114ccec tempest-VolumesBackupsTest-807180270 None] Create backup finished. backup: c52fbc4a-f7d8-49e2-bd92-5bbf2f7f98ba. Jul 03 09:54:02.155591 np0000004400 sudo[155774]: pam_unix(sudo:session): session closed for user root Jul 03 09:54:02.157255 np0000004400 cinder-backup[101319]: DEBUG oslo_concurrency.processutils [None req-0c8f0b9c-3469-46f6-ba0e-fba74e3be6db tempest-ProjectMemberTests33-2105464604 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chown 0 /dev/sde" returned: 0 in 0.333s {{(pid=101319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 09:54:02.157835 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c8f0b9c-3469-46f6-ba0e-fba74e3be6db tempest-ProjectMemberTests33-2105464604 None] ==> disconnect_volume: call "{'args': (, {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-5f57fed7-aa36-44c5-af90-863bd3d3af9d', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '5f57fed7-aa36-44c5-af90-863bd3d3af9d', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': False}, {'type': 'block', 'scsi_wwn': 'SStorPool_iSCSI_DISK_1034578903445799233', 'path': '/dev/sde'}), 'kwargs': {'force': True, 'ignore_errors': True}}" {{(pid=101319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}} Jul 03 09:54:02.158081 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.base [None req-0c8f0b9c-3469-46f6-ba0e-fba74e3be6db tempest-ProjectMemberTests33-2105464604 None] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=101319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jul 03 09:54:02.158591 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.base [None req-0c8f0b9c-3469-46f6-ba0e-fba74e3be6db tempest-ProjectMemberTests33-2105464604 None] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=101319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jul 03 09:54:02.158983 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c8f0b9c-3469-46f6-ba0e-fba74e3be6db tempest-ProjectMemberTests33-2105464604 None] _get_connection_devices called with parameters: connection_properties={'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-5f57fed7-aa36-44c5-af90-863bd3d3af9d', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '5f57fed7-aa36-44c5-af90-863bd3d3af9d', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': False}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=101319) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:847}} Jul 03 09:54:02.169356 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c8f0b9c-3469-46f6-ba0e-fba74e3be6db tempest-ProjectMemberTests33-2105464604 None] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS: Jul 03 09:54:02.169356 np0000004400 cinder-backup[101319]: No targets found. Jul 03 09:54:02.169356 np0000004400 cinder-backup[101319]: iSNS: Jul 03 09:54:02.169356 np0000004400 cinder-backup[101319]: No targets found. Jul 03 09:54:02.169356 np0000004400 cinder-backup[101319]: STATIC: Jul 03 09:54:02.169356 np0000004400 cinder-backup[101319]: Target: iqn.2023-03.storpool.com:os--volume-5f57fed7-aa36-44c5-af90-863bd3d3af9d Jul 03 09:54:02.169356 np0000004400 cinder-backup[101319]: Portal: 192.168.40.100:3260,-1 Jul 03 09:54:02.169356 np0000004400 cinder-backup[101319]: Iface Name: default Jul 03 09:54:02.169356 np0000004400 cinder-backup[101319]: Target: iqn.2023-03.storpool.com:os--volume-789ec59e-ea87-4784-8990-156a35276b5f Jul 03 09:54:02.169356 np0000004400 cinder-backup[101319]: Portal: 192.168.50.100:3260,-1 Jul 03 09:54:02.169356 np0000004400 cinder-backup[101319]: Iface Name: default Jul 03 09:54:02.169356 np0000004400 cinder-backup[101319]: Portal: 192.168.40.100:3260,-1 Jul 03 09:54:02.169356 np0000004400 cinder-backup[101319]: Iface Name: default Jul 03 09:54:02.169356 np0000004400 cinder-backup[101319]: FIRMWARE: Jul 03 09:54:02.169356 np0000004400 cinder-backup[101319]: No targets found. Jul 03 09:54:02.169356 np0000004400 cinder-backup[101319]: stderr= {{(pid=101319) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jul 03 09:54:02.169947 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c8f0b9c-3469-46f6-ba0e-fba74e3be6db tempest-ProjectMemberTests33-2105464604 None] Regex to get portals from discoverydb: ^SENDTARGETS: Jul 03 09:54:02.169947 np0000004400 cinder-backup[101319]: .*?^DiscoveryAddress: 192.168.40.100,3260.*? Jul 03 09:54:02.169947 np0000004400 cinder-backup[101319]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=101319) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:390}} Jul 03 09:54:02.169947 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c8f0b9c-3469-46f6-ba0e-fba74e3be6db tempest-ProjectMemberTests33-2105464604 None] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-5f57fed7-aa36-44c5-af90-863bd3d3af9d', 0)] {{(pid=101319) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:858}} Jul 03 09:54:02.190711 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c8f0b9c-3469-46f6-ba0e-fba74e3be6db tempest-ProjectMemberTests33-2105464604 None] iscsiadm ('-m', 'session'): stdout=tcp: [207] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5f57fed7-aa36-44c5-af90-863bd3d3af9d (non-flash) Jul 03 09:54:02.190711 np0000004400 cinder-backup[101319]: tcp: [208] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-789ec59e-ea87-4784-8990-156a35276b5f (non-flash) Jul 03 09:54:02.190711 np0000004400 cinder-backup[101319]: tcp: [209] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-789ec59e-ea87-4784-8990-156a35276b5f (non-flash) Jul 03 09:54:02.190711 np0000004400 cinder-backup[101319]: stderr= {{(pid=101319) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jul 03 09:54:02.190917 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c8f0b9c-3469-46f6-ba0e-fba74e3be6db tempest-ProjectMemberTests33-2105464604 None] iscsi session list stdout=tcp: [207] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5f57fed7-aa36-44c5-af90-863bd3d3af9d (non-flash) Jul 03 09:54:02.190917 np0000004400 cinder-backup[101319]: tcp: [208] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-789ec59e-ea87-4784-8990-156a35276b5f (non-flash) Jul 03 09:54:02.190917 np0000004400 cinder-backup[101319]: tcp: [209] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-789ec59e-ea87-4784-8990-156a35276b5f (non-flash) Jul 03 09:54:02.190917 np0000004400 cinder-backup[101319]: stderr= {{(pid=101319) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jul 03 09:54:02.190997 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c8f0b9c-3469-46f6-ba0e-fba74e3be6db tempest-ProjectMemberTests33-2105464604 None] Sessions list: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-5f57fed7-aa36-44c5-af90-863bd3d3af9d', '207'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-789ec59e-ea87-4784-8990-156a35276b5f', '208'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-789ec59e-ea87-4784-8990-156a35276b5f', '209')] {{(pid=101319) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:866}} Jul 03 09:54:02.191266 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c8f0b9c-3469-46f6-ba0e-fba74e3be6db tempest-ProjectMemberTests33-2105464604 None] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-5f57fed7-aa36-44c5-af90-863bd3d3af9d, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-5f57fed7-aa36-44c5-af90-863bd3d3af9d', '207')] {{(pid=101319) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}} Jul 03 09:54:02.192163 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c8f0b9c-3469-46f6-ba0e-fba74e3be6db tempest-ProjectMemberTests33-2105464604 None] Resulting device map defaultdict(. at 0x7e76e7131c60>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-5f57fed7-aa36-44c5-af90-863bd3d3af9d'): ({'sde'}, set())}) {{(pid=101319) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:912}} Jul 03 09:54:02.192381 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.linuxscsi [None req-0c8f0b9c-3469-46f6-ba0e-fba74e3be6db tempest-ProjectMemberTests33-2105464604 None] Removing single pathed devices sde {{(pid=101319) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}} Jul 03 09:54:02.202693 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.linuxscsi [None req-0c8f0b9c-3469-46f6-ba0e-fba74e3be6db tempest-ProjectMemberTests33-2105464604 None] Flushing IO for device /dev/sde {{(pid=101319) flush_device_io /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:461}} Jul 03 09:54:02.211246 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.linuxscsi [None req-0c8f0b9c-3469-46f6-ba0e-fba74e3be6db tempest-ProjectMemberTests33-2105464604 None] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=101319) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}} Jul 03 09:54:02.251969 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.linuxscsi [None req-0c8f0b9c-3469-46f6-ba0e-fba74e3be6db tempest-ProjectMemberTests33-2105464604 None] Checking to see if SCSI volumes sde have been removed. {{(pid=101319) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}} Jul 03 09:54:02.252158 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.linuxscsi [None req-0c8f0b9c-3469-46f6-ba0e-fba74e3be6db tempest-ProjectMemberTests33-2105464604 None] SCSI volumes sde have been removed. {{(pid=101319) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}} Jul 03 09:54:02.253053 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.linuxscsi [None req-0c8f0b9c-3469-46f6-ba0e-fba74e3be6db tempest-ProjectMemberTests33-2105464604 None] Checking to see if device paths {'sde'} are still under multipathd monitoring {{(pid=101319) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}} Jul 03 09:54:02.263142 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.linuxscsi [None req-0c8f0b9c-3469-46f6-ba0e-fba74e3be6db tempest-ProjectMemberTests33-2105464604 None] Device paths {'sde'} have been removed from multipathd monitoring. {{(pid=101319) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}} Jul 03 09:54:02.263368 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c8f0b9c-3469-46f6-ba0e-fba74e3be6db tempest-ProjectMemberTests33-2105464604 None] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-5f57fed7-aa36-44c5-af90-863bd3d3af9d')] {{(pid=101319) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1225}} Jul 03 09:54:02.275315 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c8f0b9c-3469-46f6-ba0e-fba74e3be6db tempest-ProjectMemberTests33-2105464604 None] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=101319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 03 09:54:02.308956 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c8f0b9c-3469-46f6-ba0e-fba74e3be6db tempest-ProjectMemberTests33-2105464604 None] iscsiadm ('--logout',): stdout=Logging out of session [sid: 207, target: iqn.2023-03.storpool.com:os--volume-5f57fed7-aa36-44c5-af90-863bd3d3af9d, portal: 192.168.40.100,3260] Jul 03 09:54:02.308956 np0000004400 cinder-backup[101319]: Logout of [sid: 207, target: iqn.2023-03.storpool.com:os--volume-5f57fed7-aa36-44c5-af90-863bd3d3af9d, portal: 192.168.40.100,3260] successful. Jul 03 09:54:02.308956 np0000004400 cinder-backup[101319]: stderr= {{(pid=101319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 03 09:54:02.321944 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c8f0b9c-3469-46f6-ba0e-fba74e3be6db tempest-ProjectMemberTests33-2105464604 None] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=101319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 03 09:54:02.322188 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.base [None req-0c8f0b9c-3469-46f6-ba0e-fba74e3be6db tempest-ProjectMemberTests33-2105464604 None] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.164s {{(pid=101319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jul 03 09:54:02.322322 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c8f0b9c-3469-46f6-ba0e-fba74e3be6db tempest-ProjectMemberTests33-2105464604 None] <== disconnect_volume: return (164ms) None {{(pid=101319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}} Jul 03 09:54:02.416741 np0000004400 cinder-backup[101319]: INFO cinder.backup.manager [None req-64934804-7f51-4da7-8394-8f3f480fa1a0 tempest-VolumesBackupsTest-1484886458 None] Create backup started, backup: 44885c93-b853-422a-9a76-29c7e7bf3d8e volume: b578d41f-4c6a-49b3-b5ec-bcd6556e2e68. Jul 03 09:54:02.421467 np0000004400 cinder-backup[101319]: INFO cinder.backup.manager [None req-64934804-7f51-4da7-8394-8f3f480fa1a0 tempest-VolumesBackupsTest-1484886458 None] Call Volume Manager to get_backup_device for Backup(availability_zone='nova',container=None,created_at=2026-07-03T09:54:02Z,data_timestamp=2026-07-03T09:54:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesBackupsTest-Backup-1842688753',encryption_key_id=None,fail_reason=None,host='np0000004400',id=44885c93-b853-422a-9a76-29c7e7bf3d8e,metadata={},num_dependent_backups=0,object_count=0,parent=None,parent_id=None,project_id='c36863fd49104594b80b419fafd78f5c',restore_volume_id=None,service='cinder.backup.drivers.swift.SwiftBackupDriver',service_metadata=None,size=1,snapshot_id=None,status='creating',temp_snapshot_id=None,temp_volume_id=None,updated_at=None,user_id='e3b8ecc8212649f489f39b74eac8ff8f',volume_id=b578d41f-4c6a-49b3-b5ec-bcd6556e2e68) Jul 03 09:54:02.451220 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.drivers.swift [None req-64934804-7f51-4da7-8394-8f3f480fa1a0 tempest-VolumesBackupsTest-1484886458 None] Using swift URL https://10.4.3.95:8080/v1/AUTH_c36863fd49104594b80b419fafd78f5c {{(pid=101319) initialize /opt/stack/cinder/cinder/backup/drivers/swift.py:300}} Jul 03 09:54:02.451413 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.drivers.swift [None req-64934804-7f51-4da7-8394-8f3f480fa1a0 tempest-VolumesBackupsTest-1484886458 None] Connect to https://10.4.3.95:8080/v1/AUTH_ in "per_user" mode {{(pid=101319) initialize /opt/stack/cinder/cinder/backup/drivers/swift.py:301}} Jul 03 09:54:02.451716 np0000004400 cinder-backup[101319]: DEBUG os_brick.utils [None req-64934804-7f51-4da7-8394-8f3f480fa1a0 tempest-VolumesBackupsTest-1484886458 None] ==> get_connector_properties: call "{'root_helper': 'sudo cinder-rootwrap /etc/cinder/rootwrap.conf', 'my_ip': '10.4.3.95', 'multipath': False, 'enforce_multipath': False, 'host': None, 'execute': None}" {{(pid=101319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}} Jul 03 09:54:02.461420 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.scaleio [None req-64934804-7f51-4da7-8394-8f3f480fa1a0 tempest-VolumesBackupsTest-1484886458 None] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=101319) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}} Jul 03 09:54:02.479686 np0000004400 cinder-backup[101319]: DEBUG oslo_concurrency.processutils [None req-64934804-7f51-4da7-8394-8f3f480fa1a0 tempest-VolumesBackupsTest-1484886458 None] Running cmd (subprocess): nvme version {{(pid=101319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 09:54:02.492977 np0000004400 cinder-backup[101319]: DEBUG oslo_concurrency.processutils [None req-64934804-7f51-4da7-8394-8f3f480fa1a0 tempest-VolumesBackupsTest-1484886458 None] 'nvme version' failed. Not Retrying. {{(pid=101319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 03 09:54:02.493627 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.nvmeof [None req-64934804-7f51-4da7-8394-8f3f480fa1a0 tempest-VolumesBackupsTest-1484886458 None] nvme not present on system {{(pid=101319) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}} Jul 03 09:54:02.501600 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.lightos [None req-64934804-7f51-4da7-8394-8f3f480fa1a0 tempest-VolumesBackupsTest-1484886458 None] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=101319) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}} Jul 03 09:54:02.502559 np0000004400 cinder-backup[101319]: INFO os_brick.initiator.connectors.lightos [None req-64934804-7f51-4da7-8394-8f3f480fa1a0 tempest-VolumesBackupsTest-1484886458 None] Current host hostNQN and IP(s) are ['10.4.3.95', 'fe80::f816:3eff:fe47:268c', '192.168.40.6', 'fe80::f816:3eff:febf:7be2', '192.168.50.6', 'fe80::f816:3eff:fe99:8914', '192.168.10.6', 'fe80::f816:3eff:fe2f:e696', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::bc9d:84ff:fec2:6b49', 'fe80::fc16:3eff:fec3:bd5f', 'fe80::8cea:42ff:fe99:b64a'] Jul 03 09:54:02.502746 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.lightos [None req-64934804-7f51-4da7-8394-8f3f480fa1a0 tempest-VolumesBackupsTest-1484886458 None] LIGHTOS: did not find dsc, continuing anyway. {{(pid=101319) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}} Jul 03 09:54:02.502962 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.lightos [None req-64934804-7f51-4da7-8394-8f3f480fa1a0 tempest-VolumesBackupsTest-1484886458 None] LIGHTOS: no hostnqn found. {{(pid=101319) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}} Jul 03 09:54:02.503257 np0000004400 cinder-backup[101319]: DEBUG os_brick.utils [None req-64934804-7f51-4da7-8394-8f3f480fa1a0 tempest-VolumesBackupsTest-1484886458 None] <== get_connector_properties: return (51ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.95', 'host': 'np0000004400', 'multipath': False, 'enforce_multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:ae7e5bb0ebe6', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': '6b284368-d0ba-4d18-af6f-4998d3955c52', 'nvme_native_multipath': False} {{(pid=101319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}} Jul 03 09:54:03.007152 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connector [None req-64934804-7f51-4da7-8394-8f3f480fa1a0 tempest-VolumesBackupsTest-1484886458 None] Factory for iscsi on None {{(pid=101319) factory /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connector.py:243}} Jul 03 09:54:03.007612 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-64934804-7f51-4da7-8394-8f3f480fa1a0 tempest-VolumesBackupsTest-1484886458 None] ==> connect_volume: call "{'self': , 'connection_properties': {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-b578d41f-4c6a-49b3-b5ec-bcd6556e2e68', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'b578d41f-4c6a-49b3-b5ec-bcd6556e2e68', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': False}}" {{(pid=101319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}} Jul 03 09:54:03.007807 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.base [None req-64934804-7f51-4da7-8394-8f3f480fa1a0 tempest-VolumesBackupsTest-1484886458 None] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=101319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jul 03 09:54:03.008289 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.base [None req-64934804-7f51-4da7-8394-8f3f480fa1a0 tempest-VolumesBackupsTest-1484886458 None] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.000s {{(pid=101319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jul 03 09:54:03.008488 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.base [None req-64934804-7f51-4da7-8394-8f3f480fa1a0 tempest-VolumesBackupsTest-1484886458 None] Connection properties {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-b578d41f-4c6a-49b3-b5ec-bcd6556e2e68', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'b578d41f-4c6a-49b3-b5ec-bcd6556e2e68', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': False} {{(pid=101319) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}} Jul 03 09:54:03.018293 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.base [None req-64934804-7f51-4da7-8394-8f3f480fa1a0 tempest-VolumesBackupsTest-1484886458 None] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-b578d41f-4c6a-49b3-b5ec-bcd6556e2e68" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=101319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jul 03 09:54:03.018751 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.base [None req-64934804-7f51-4da7-8394-8f3f480fa1a0 tempest-VolumesBackupsTest-1484886458 None] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-b578d41f-4c6a-49b3-b5ec-bcd6556e2e68" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=101319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jul 03 09:54:03.019064 np0000004400 cinder-backup[101319]: INFO os_brick.initiator.connectors.iscsi [None req-64934804-7f51-4da7-8394-8f3f480fa1a0 tempest-VolumesBackupsTest-1484886458 None] Trying to connect to iSCSI portal 192.168.40.100:3260 Jul 03 09:54:03.027041 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-64934804-7f51-4da7-8394-8f3f480fa1a0 tempest-VolumesBackupsTest-1484886458 None] iscsiadm (): stdout= stderr=iscsiadm: No records found Jul 03 09:54:03.027041 np0000004400 cinder-backup[101319]: {{(pid=101319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 03 09:54:03.035693 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-64934804-7f51-4da7-8394-8f3f480fa1a0 tempest-VolumesBackupsTest-1484886458 None] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-b578d41f-4c6a-49b3-b5ec-bcd6556e2e68] added Jul 03 09:54:03.035693 np0000004400 cinder-backup[101319]: stderr=iscsiadm: Config file line 363 does not have value Jul 03 09:54:03.035693 np0000004400 cinder-backup[101319]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs' Jul 03 09:54:03.035693 np0000004400 cinder-backup[101319]: iscsiadm: Config file line 363 does not have value Jul 03 09:54:03.035693 np0000004400 cinder-backup[101319]: iscsiadm: Config file line 363 does not have value Jul 03 09:54:03.035693 np0000004400 cinder-backup[101319]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs' Jul 03 09:54:03.035693 np0000004400 cinder-backup[101319]: {{(pid=101319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 03 09:54:03.035997 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-64934804-7f51-4da7-8394-8f3f480fa1a0 tempest-VolumesBackupsTest-1484886458 None] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=101319) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}} Jul 03 09:54:03.036415 np0000004400 cinder-backup[101319]: DEBUG os_brick.utils [None req-64934804-7f51-4da7-8394-8f3f480fa1a0 tempest-VolumesBackupsTest-1484886458 None] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0173(s), this was the 1st time calling it. {{(pid=101319) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}} Jul 03 09:54:03.036634 np0000004400 cinder-backup[101319]: DEBUG os_brick.utils [None req-64934804-7f51-4da7-8394-8f3f480fa1a0 tempest-VolumesBackupsTest-1484886458 None] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=101319) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}} Jul 03 09:54:03.368321 np0000004400 cinder-backup[101319]: DEBUG oslo_db.sqlalchemy.engines [None req-0c8f0b9c-3469-46f6-ba0e-fba74e3be6db tempest-ProjectMemberTests33-2105464604 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=101319) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 03 09:54:03.379918 np0000004400 cinder-backup[101319]: INFO cinder.backup.manager [None req-0c8f0b9c-3469-46f6-ba0e-fba74e3be6db tempest-ProjectMemberTests33-2105464604 None] Create backup finished. backup: 885775bd-f91a-424f-bc10-7913c6a90400. Jul 03 09:54:04.028160 np0000004400 cinder-backup[101319]: INFO cinder.backup.manager [None req-3335c39d-a089-4a56-beb6-67cc36cd89a7 tempest-ProjectMemberTests33-2105464604 None] Delete backup started, backup: 885775bd-f91a-424f-bc10-7913c6a90400. Jul 03 09:54:04.031807 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.drivers.swift [None req-3335c39d-a089-4a56-beb6-67cc36cd89a7 tempest-ProjectMemberTests33-2105464604 None] Using swift URL https://10.4.3.95:8080/v1/AUTH_e0b6e59b911e40b3acac38afb1f81e3a {{(pid=101319) initialize /opt/stack/cinder/cinder/backup/drivers/swift.py:300}} Jul 03 09:54:04.032415 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.drivers.swift [None req-3335c39d-a089-4a56-beb6-67cc36cd89a7 tempest-ProjectMemberTests33-2105464604 None] Connect to https://10.4.3.95:8080/v1/AUTH_ in "per_user" mode {{(pid=101319) initialize /opt/stack/cinder/cinder/backup/drivers/swift.py:301}} Jul 03 09:54:04.032692 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-3335c39d-a089-4a56-beb6-67cc36cd89a7 tempest-ProjectMemberTests33-2105464604 None] delete started, backup: 885775bd-f91a-424f-bc10-7913c6a90400, container: volumebackups, prefix: volume_5f57fed7-aa36-44c5-af90-863bd3d3af9d/20260703095349/az_nova_backup_885775bd-f91a-424f-bc10-7913c6a90400. {{(pid=101319) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:822}} Jul 03 09:54:04.038547 np0000004400 cinder-backup[101319]: INFO os_brick.initiator.connectors.iscsi [None req-64934804-7f51-4da7-8394-8f3f480fa1a0 tempest-VolumesBackupsTest-1484886458 None] Trying to connect to iSCSI portal 192.168.40.100:3260 Jul 03 09:54:04.048775 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-64934804-7f51-4da7-8394-8f3f480fa1a0 tempest-VolumesBackupsTest-1484886458 None] iscsiadm (): stdout=# BEGIN RECORD 2.1.9 Jul 03 09:54:04.048775 np0000004400 cinder-backup[101319]: node.name = iqn.2023-03.storpool.com:os--volume-b578d41f-4c6a-49b3-b5ec-bcd6556e2e68 Jul 03 09:54:04.048775 np0000004400 cinder-backup[101319]: node.tpgt = -1 Jul 03 09:54:04.048775 np0000004400 cinder-backup[101319]: node.startup = manual Jul 03 09:54:04.048775 np0000004400 cinder-backup[101319]: node.leading_login = No Jul 03 09:54:04.048775 np0000004400 cinder-backup[101319]: iface.iscsi_ifacename = default Jul 03 09:54:04.048775 np0000004400 cinder-backup[101319]: iface.net_ifacename = Jul 03 09:54:04.048775 np0000004400 cinder-backup[101319]: iface.ipaddress = Jul 03 09:54:04.048775 np0000004400 cinder-backup[101319]: iface.prefix_len = 0 Jul 03 09:54:04.048775 np0000004400 cinder-backup[101319]: iface.hwaddress = Jul 03 09:54:04.048775 np0000004400 cinder-backup[101319]: iface.transport_name = tcp Jul 03 09:54:04.048775 np0000004400 cinder-backup[101319]: iface.initiatorname = Jul 03 09:54:04.048775 np0000004400 cinder-backup[101319]: iface.state = Jul 03 09:54:04.048775 np0000004400 cinder-backup[101319]: iface.vlan_id = 0 Jul 03 09:54:04.048775 np0000004400 cinder-backup[101319]: iface.vlan_priority = 0 Jul 03 09:54:04.048775 np0000004400 cinder-backup[101319]: iface.vlan_state = Jul 03 09:54:04.048775 np0000004400 cinder-backup[101319]: iface.iface_num = 0 Jul 03 09:54:04.048775 np0000004400 cinder-backup[101319]: iface.mtu = 0 Jul 03 09:54:04.048775 np0000004400 cinder-backup[101319]: iface.port = 0 Jul 03 09:54:04.048775 np0000004400 cinder-backup[101319]: iface.bootproto = Jul 03 09:54:04.048775 np0000004400 cinder-backup[101319]: iface.subnet_mask = Jul 03 09:54:04.048775 np0000004400 cinder-backup[101319]: iface.gateway = Jul 03 09:54:04.048775 np0000004400 cinder-backup[101319]: iface.dhcp_alt_client_id_state = Jul 03 09:54:04.048775 np0000004400 cinder-backup[101319]: iface.dhcp_alt_client_id = Jul 03 09:54:04.048775 np0000004400 cinder-backup[101319]: iface.dhcp_dns = Jul 03 09:54:04.048775 np0000004400 cinder-backup[101319]: iface.dhcp_learn_iqn = Jul 03 09:54:04.048775 np0000004400 cinder-backup[101319]: iface.dhcp_req_vendor_id_state = Jul 03 09:54:04.048775 np0000004400 cinder-backup[101319]: iface.dhcp_vendor_id_state = Jul 03 09:54:04.048775 np0000004400 cinder-backup[101319]: iface.dhcp_vendor_id = Jul 03 09:54:04.048775 np0000004400 cinder-backup[101319]: iface.dhcp_slp_da = Jul 03 09:54:04.048775 np0000004400 cinder-backup[101319]: iface.fragmentation = Jul 03 09:54:04.048775 np0000004400 cinder-backup[101319]: iface.gratuitous_arp = Jul 03 09:54:04.048775 np0000004400 cinder-backup[101319]: iface.incoming_forwarding = Jul 03 09:54:04.048775 np0000004400 cinder-backup[101319]: iface.tos_state = Jul 03 09:54:04.048775 np0000004400 cinder-backup[101319]: iface.tos = 0 Jul 03 09:54:04.048775 np0000004400 cinder-backup[101319]: iface.ttl = 0 Jul 03 09:54:04.048775 np0000004400 cinder-backup[101319]: iface.delayed_ack = Jul 03 09:54:04.048775 np0000004400 cinder-backup[101319]: iface.tcp_nagle = Jul 03 09:54:04.048775 np0000004400 cinder-backup[101319]: iface.tcp_wsf_state = Jul 03 09:54:04.048775 np0000004400 cinder-backup[101319]: iface.tcp_wsf = 0 Jul 03 09:54:04.048775 np0000004400 cinder-backup[101319]: iface.tcp_timer_scale = 0 Jul 03 09:54:04.048775 np0000004400 cinder-backup[101319]: iface.tcp_timestamp = Jul 03 09:54:04.048775 np0000004400 cinder-backup[101319]: iface.redirect = Jul 03 09:54:04.048775 np0000004400 cinder-backup[101319]: iface.def_task_mgmt_timeout = 0 Jul 03 09:54:04.048775 np0000004400 cinder-backup[101319]: iface.header_digest = Jul 03 09:54:04.048775 np0000004400 cinder-backup[101319]: iface.data_digest = Jul 03 09:54:04.048775 np0000004400 cinder-backup[101319]: iface.immediate_data = Jul 03 09:54:04.048775 np0000004400 cinder-backup[101319]: iface.initial_r2t = Jul 03 09:54:04.048775 np0000004400 cinder-backup[101319]: iface.data_seq_inorder = Jul 03 09:54:04.048775 np0000004400 cinder-backup[101319]: iface.data_pdu_inorder = Jul 03 09:54:04.048775 np0000004400 cinder-backup[101319]: iface.erl = 0 Jul 03 09:54:04.048775 np0000004400 cinder-backup[101319]: iface.max_receive_data_len = 0 Jul 03 09:54:04.048775 np0000004400 cinder-backup[101319]: iface.first_burst_len = 0 Jul 03 09:54:04.048775 np0000004400 cinder-backup[101319]: iface.max_outstanding_r2t = 0 Jul 03 09:54:04.048775 np0000004400 cinder-backup[101319]: iface.max_burst_len = 0 Jul 03 09:54:04.048775 np0000004400 cinder-backup[101319]: iface.chap_auth = Jul 03 09:54:04.048775 np0000004400 cinder-backup[101319]: iface.bidi_chap = Jul 03 09:54:04.048775 np0000004400 cinder-backup[101319]: iface.strict_login_compliance = Jul 03 09:54:04.048775 np0000004400 cinder-backup[101319]: iface.discovery_auth = Jul 03 09:54:04.048775 np0000004400 cinder-backup[101319]: iface.discovery_logout = Jul 03 09:54:04.048775 np0000004400 cinder-backup[101319]: node.discovery_address = Jul 03 09:54:04.048775 np0000004400 cinder-backup[101319]: node.discovery_port = 0 Jul 03 09:54:04.048775 np0000004400 cinder-backup[101319]: node.discovery_type = fw Jul 03 09:54:04.048775 np0000004400 cinder-backup[101319]: node.session.initial_cmdsn = 0 Jul 03 09:54:04.048775 np0000004400 cinder-backup[101319]: node.session.initial_login_retry_max = 8 Jul 03 09:54:04.048775 np0000004400 cinder-backup[101319]: node.session.xmit_thread_priority = 0 Jul 03 09:54:04.048775 np0000004400 cinder-backup[101319]: node.session.cmds_max = 128 Jul 03 09:54:04.048775 np0000004400 cinder-backup[101319]: node.session.queue_depth = 32 Jul 03 09:54:04.048775 np0000004400 cinder-backup[101319]: node.session.nr_sessions = 1 Jul 03 09:54:04.048775 np0000004400 cinder-backup[101319]: node.session.auth.authmethod = None Jul 03 09:54:04.048775 np0000004400 cinder-backup[101319]: node.session.auth.username = Jul 03 09:54:04.048775 np0000004400 cinder-backup[101319]: node.session.auth.password = *** Jul 03 09:54:04.048775 np0000004400 cinder-backup[101319]: node.session.auth.username_in = Jul 03 09:54:04.048775 np0000004400 cinder-backup[101319]: node.session.auth.password_in = Jul 03 09:54:04.048775 np0000004400 cinder-backup[101319]: node.session.auth.chap_algs = SHA256 Jul 03 09:54:04.048775 np0000004400 cinder-backup[101319]: node.session.timeo.replacement_timeout = 120 Jul 03 09:54:04.048775 np0000004400 cinder-backup[101319]: node.session.err_timeo.abort_timeout = 15 Jul 03 09:54:04.048775 np0000004400 cinder-backup[101319]: node.session.err_timeo.lu_reset_timeout = 30 Jul 03 09:54:04.048775 np0000004400 cinder-backup[101319]: node.session.err_timeo.tgt_reset_timeout = 30 Jul 03 09:54:04.048775 np0000004400 cinder-backup[101319]: node.session.err_timeo.host_reset_timeout = 60 Jul 03 09:54:04.048775 np0000004400 cinder-backup[101319]: node.session.iscsi.FastAbort = Yes Jul 03 09:54:04.048775 np0000004400 cinder-backup[101319]: node.session.iscsi.InitialR2T = No Jul 03 09:54:04.048775 np0000004400 cinder-backup[101319]: node.session.iscsi.ImmediateData = Yes Jul 03 09:54:04.048775 np0000004400 cinder-backup[101319]: node.session.iscsi.FirstBurstLength = 262144 Jul 03 09:54:04.048775 np0000004400 cinder-backup[101319]: node.session.iscsi.MaxBurstLength = 16776192 Jul 03 09:54:04.048775 np0000004400 cinder-backup[101319]: node.session.iscsi.DefaultTime2Retain = 0 Jul 03 09:54:04.048775 np0000004400 cinder-backup[101319]: node.session.iscsi.DefaultTime2Wait = 2 Jul 03 09:54:04.048775 np0000004400 cinder-backup[101319]: node.session.iscsi.MaxConnections = 1 Jul 03 09:54:04.048775 np0000004400 cinder-backup[101319]: node.session.iscsi.MaxOutstandingR2T = 1 Jul 03 09:54:04.048775 np0000004400 cinder-backup[101319]: node.session.iscsi.ERL = 0 Jul 03 09:54:04.048775 np0000004400 cinder-backup[101319]: node.session.scan = auto Jul 03 09:54:04.048775 np0000004400 cinder-backup[101319]: node.session.reopen_max = 0 Jul 03 09:54:04.048775 np0000004400 cinder-backup[101319]: node.conn[0].address = 192.168.40.100 Jul 03 09:54:04.048775 np0000004400 cinder-backup[101319]: node.conn[0].port = 3260 Jul 03 09:54:04.048775 np0000004400 cinder-backup[101319]: node.conn[0].startup = manual Jul 03 09:54:04.048775 np0000004400 cinder-backup[101319]: node.conn[0].tcp.window_size = 524288 Jul 03 09:54:04.048775 np0000004400 cinder-backup[101319]: node.conn[0].tcp.type_of_service = 0 Jul 03 09:54:04.048775 np0000004400 cinder-backup[101319]: node.conn[0].timeo.logout_timeout = 15 Jul 03 09:54:04.048775 np0000004400 cinder-backup[101319]: node.conn[0].timeo.login_timeout = 15 Jul 03 09:54:04.048775 np0000004400 cinder-backup[101319]: node.conn[0].timeo.auth_timeout = 45 Jul 03 09:54:04.048775 np0000004400 cinder-backup[101319]: node.conn[0].timeo.noop_out_interval = 5 Jul 03 09:54:04.048775 np0000004400 cinder-backup[101319]: node.conn[0].timeo.noop_out_timeout = 5 Jul 03 09:54:04.048775 np0000004400 cinder-backup[101319]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0 Jul 03 09:54:04.048775 np0000004400 cinder-backup[101319]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144 Jul 03 09:54:04.048775 np0000004400 cinder-backup[101319]: node.conn[0].iscsi.HeaderDigest = None Jul 03 09:54:04.048775 np0000004400 cinder-backup[101319]: node.conn[0].iscsi.DataDigest = None Jul 03 09:54:04.048775 np0000004400 cinder-backup[101319]: node.conn[0].iscsi.IFMarker = No Jul 03 09:54:04.048775 np0000004400 cinder-backup[101319]: node.conn[0].iscsi.OFMarker = No Jul 03 09:54:04.048775 np0000004400 cinder-backup[101319]: # END RECORD Jul 03 09:54:04.048775 np0000004400 cinder-backup[101319]: stderr= {{(pid=101319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 03 09:54:04.059688 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-64934804-7f51-4da7-8394-8f3f480fa1a0 tempest-VolumesBackupsTest-1484886458 None] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=101319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 03 09:54:04.070580 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-64934804-7f51-4da7-8394-8f3f480fa1a0 tempest-VolumesBackupsTest-1484886458 None] iscsiadm ('-m', 'session'): stdout=tcp: [208] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-789ec59e-ea87-4784-8990-156a35276b5f (non-flash) Jul 03 09:54:04.070580 np0000004400 cinder-backup[101319]: tcp: [209] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-789ec59e-ea87-4784-8990-156a35276b5f (non-flash) Jul 03 09:54:04.070580 np0000004400 cinder-backup[101319]: stderr= {{(pid=101319) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jul 03 09:54:04.070970 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-64934804-7f51-4da7-8394-8f3f480fa1a0 tempest-VolumesBackupsTest-1484886458 None] iscsi session list stdout=tcp: [208] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-789ec59e-ea87-4784-8990-156a35276b5f (non-flash) Jul 03 09:54:04.070970 np0000004400 cinder-backup[101319]: tcp: [209] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-789ec59e-ea87-4784-8990-156a35276b5f (non-flash) Jul 03 09:54:04.070970 np0000004400 cinder-backup[101319]: stderr= {{(pid=101319) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jul 03 09:54:04.101022 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-3335c39d-a089-4a56-beb6-67cc36cd89a7 tempest-ProjectMemberTests33-2105464604 None] generated object list: ['volume_5f57fed7-aa36-44c5-af90-863bd3d3af9d/20260703095349/az_nova_backup_885775bd-f91a-424f-bc10-7913c6a90400-00001', 'volume_5f57fed7-aa36-44c5-af90-863bd3d3af9d/20260703095349/az_nova_backup_885775bd-f91a-424f-bc10-7913c6a90400-00002', 'volume_5f57fed7-aa36-44c5-af90-863bd3d3af9d/20260703095349/az_nova_backup_885775bd-f91a-424f-bc10-7913c6a90400-00003', 'volume_5f57fed7-aa36-44c5-af90-863bd3d3af9d/20260703095349/az_nova_backup_885775bd-f91a-424f-bc10-7913c6a90400-00004', 'volume_5f57fed7-aa36-44c5-af90-863bd3d3af9d/20260703095349/az_nova_backup_885775bd-f91a-424f-bc10-7913c6a90400-00005', 'volume_5f57fed7-aa36-44c5-af90-863bd3d3af9d/20260703095349/az_nova_backup_885775bd-f91a-424f-bc10-7913c6a90400-00006', 'volume_5f57fed7-aa36-44c5-af90-863bd3d3af9d/20260703095349/az_nova_backup_885775bd-f91a-424f-bc10-7913c6a90400-00007', 'volume_5f57fed7-aa36-44c5-af90-863bd3d3af9d/20260703095349/az_nova_backup_885775bd-f91a-424f-bc10-7913c6a90400-00008', 'volume_5f57fed7-aa36-44c5-af90-863bd3d3af9d/20260703095349/az_nova_backup_885775bd-f91a-424f-bc10-7913c6a90400-00009', 'volume_5f57fed7-aa36-44c5-af90-863bd3d3af9d/20260703095349/az_nova_backup_885775bd-f91a-424f-bc10-7913c6a90400-00010', 'volume_5f57fed7-aa36-44c5-af90-863bd3d3af9d/20260703095349/az_nova_backup_885775bd-f91a-424f-bc10-7913c6a90400-00011', 'volume_5f57fed7-aa36-44c5-af90-863bd3d3af9d/20260703095349/az_nova_backup_885775bd-f91a-424f-bc10-7913c6a90400-00012', 'volume_5f57fed7-aa36-44c5-af90-863bd3d3af9d/20260703095349/az_nova_backup_885775bd-f91a-424f-bc10-7913c6a90400-00013', 'volume_5f57fed7-aa36-44c5-af90-863bd3d3af9d/20260703095349/az_nova_backup_885775bd-f91a-424f-bc10-7913c6a90400-00014', 'volume_5f57fed7-aa36-44c5-af90-863bd3d3af9d/20260703095349/az_nova_backup_885775bd-f91a-424f-bc10-7913c6a90400-00015', 'volume_5f57fed7-aa36-44c5-af90-863bd3d3af9d/20260703095349/az_nova_backup_885775bd-f91a-424f-bc10-7913c6a90400-00016', 'volume_5f57fed7-aa36-44c5-af90-863bd3d3af9d/20260703095349/az_nova_backup_885775bd-f91a-424f-bc10-7913c6a90400-00017', 'volume_5f57fed7-aa36-44c5-af90-863bd3d3af9d/20260703095349/az_nova_backup_885775bd-f91a-424f-bc10-7913c6a90400-00018', 'volume_5f57fed7-aa36-44c5-af90-863bd3d3af9d/20260703095349/az_nova_backup_885775bd-f91a-424f-bc10-7913c6a90400-00019', 'volume_5f57fed7-aa36-44c5-af90-863bd3d3af9d/20260703095349/az_nova_backup_885775bd-f91a-424f-bc10-7913c6a90400-00020', 'volume_5f57fed7-aa36-44c5-af90-863bd3d3af9d/20260703095349/az_nova_backup_885775bd-f91a-424f-bc10-7913c6a90400-00021', 'volume_5f57fed7-aa36-44c5-af90-863bd3d3af9d/20260703095349/az_nova_backup_885775bd-f91a-424f-bc10-7913c6a90400_metadata', 'volume_5f57fed7-aa36-44c5-af90-863bd3d3af9d/20260703095349/az_nova_backup_885775bd-f91a-424f-bc10-7913c6a90400_sha256file']. {{(pid=101319) _generate_object_names /opt/stack/cinder/cinder/backup/chunkeddriver.py:260}} Jul 03 09:54:04.105660 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-64934804-7f51-4da7-8394-8f3f480fa1a0 tempest-VolumesBackupsTest-1484886458 None] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-b578d41f-4c6a-49b3-b5ec-bcd6556e2e68, portal: 192.168.40.100,3260] Jul 03 09:54:04.105660 np0000004400 cinder-backup[101319]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-b578d41f-4c6a-49b3-b5ec-bcd6556e2e68, portal: 192.168.40.100,3260] successful. Jul 03 09:54:04.105660 np0000004400 cinder-backup[101319]: stderr= {{(pid=101319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 03 09:54:04.117805 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-64934804-7f51-4da7-8394-8f3f480fa1a0 tempest-VolumesBackupsTest-1484886458 None] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=101319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 03 09:54:04.127224 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-3335c39d-a089-4a56-beb6-67cc36cd89a7 tempest-ProjectMemberTests33-2105464604 None] deleted object: volume_5f57fed7-aa36-44c5-af90-863bd3d3af9d/20260703095349/az_nova_backup_885775bd-f91a-424f-bc10-7913c6a90400-00001 in container: volumebackups. {{(pid=101319) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 09:54:04.130747 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-64934804-7f51-4da7-8394-8f3f480fa1a0 tempest-VolumesBackupsTest-1484886458 None] iscsiadm ('-m', 'session'): stdout=tcp: [208] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-789ec59e-ea87-4784-8990-156a35276b5f (non-flash) Jul 03 09:54:04.130747 np0000004400 cinder-backup[101319]: tcp: [209] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-789ec59e-ea87-4784-8990-156a35276b5f (non-flash) Jul 03 09:54:04.130747 np0000004400 cinder-backup[101319]: tcp: [210] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b578d41f-4c6a-49b3-b5ec-bcd6556e2e68 (non-flash) Jul 03 09:54:04.130747 np0000004400 cinder-backup[101319]: stderr= {{(pid=101319) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jul 03 09:54:04.131129 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-64934804-7f51-4da7-8394-8f3f480fa1a0 tempest-VolumesBackupsTest-1484886458 None] iscsi session list stdout=tcp: [208] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-789ec59e-ea87-4784-8990-156a35276b5f (non-flash) Jul 03 09:54:04.131129 np0000004400 cinder-backup[101319]: tcp: [209] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-789ec59e-ea87-4784-8990-156a35276b5f (non-flash) Jul 03 09:54:04.131129 np0000004400 cinder-backup[101319]: tcp: [210] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b578d41f-4c6a-49b3-b5ec-bcd6556e2e68 (non-flash) Jul 03 09:54:04.131129 np0000004400 cinder-backup[101319]: stderr= {{(pid=101319) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jul 03 09:54:04.131691 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.base [None req-64934804-7f51-4da7-8394-8f3f480fa1a0 tempest-VolumesBackupsTest-1484886458 None] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-b578d41f-4c6a-49b3-b5ec-bcd6556e2e68" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.113s {{(pid=101319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jul 03 09:54:04.131945 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-64934804-7f51-4da7-8394-8f3f480fa1a0 tempest-VolumesBackupsTest-1484886458 None] Connected to 192.168.40.100:3260 {{(pid=101319) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}} Jul 03 09:54:04.132831 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.linuxscsi [None req-64934804-7f51-4da7-8394-8f3f480fa1a0 tempest-VolumesBackupsTest-1484886458 None] HCTL ('7', '-', '-', 0) found on session 210 with lun 0 {{(pid=101319) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}} Jul 03 09:54:04.133165 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.linuxscsi [None req-64934804-7f51-4da7-8394-8f3f480fa1a0 tempest-VolumesBackupsTest-1484886458 None] Scanning host 7 c: -, t: -, l: 0) {{(pid=101319) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}} Jul 03 09:54:04.145944 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.linuxscsi [None req-64934804-7f51-4da7-8394-8f3f480fa1a0 tempest-VolumesBackupsTest-1484886458 None] Searching for a device in session 210 and hctl ['7', '*', '*', 0] yield: sdb {{(pid=101319) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}} Jul 03 09:54:04.145944 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-64934804-7f51-4da7-8394-8f3f480fa1a0 tempest-VolumesBackupsTest-1484886458 None] Connected to sdb using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-b578d41f-4c6a-49b3-b5ec-bcd6556e2e68', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'b578d41f-4c6a-49b3-b5ec-bcd6556e2e68', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': False} {{(pid=101319) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}} Jul 03 09:54:04.158745 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-3335c39d-a089-4a56-beb6-67cc36cd89a7 tempest-ProjectMemberTests33-2105464604 None] deleted object: volume_5f57fed7-aa36-44c5-af90-863bd3d3af9d/20260703095349/az_nova_backup_885775bd-f91a-424f-bc10-7913c6a90400-00002 in container: volumebackups. {{(pid=101319) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 09:54:04.187347 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-3335c39d-a089-4a56-beb6-67cc36cd89a7 tempest-ProjectMemberTests33-2105464604 None] deleted object: volume_5f57fed7-aa36-44c5-af90-863bd3d3af9d/20260703095349/az_nova_backup_885775bd-f91a-424f-bc10-7913c6a90400-00003 in container: volumebackups. {{(pid=101319) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 09:54:04.208841 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-3335c39d-a089-4a56-beb6-67cc36cd89a7 tempest-ProjectMemberTests33-2105464604 None] deleted object: volume_5f57fed7-aa36-44c5-af90-863bd3d3af9d/20260703095349/az_nova_backup_885775bd-f91a-424f-bc10-7913c6a90400-00004 in container: volumebackups. {{(pid=101319) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 09:54:04.231507 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-3335c39d-a089-4a56-beb6-67cc36cd89a7 tempest-ProjectMemberTests33-2105464604 None] deleted object: volume_5f57fed7-aa36-44c5-af90-863bd3d3af9d/20260703095349/az_nova_backup_885775bd-f91a-424f-bc10-7913c6a90400-00005 in container: volumebackups. {{(pid=101319) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 09:54:04.256765 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-3335c39d-a089-4a56-beb6-67cc36cd89a7 tempest-ProjectMemberTests33-2105464604 None] deleted object: volume_5f57fed7-aa36-44c5-af90-863bd3d3af9d/20260703095349/az_nova_backup_885775bd-f91a-424f-bc10-7913c6a90400-00006 in container: volumebackups. {{(pid=101319) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 09:54:04.275664 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-3335c39d-a089-4a56-beb6-67cc36cd89a7 tempest-ProjectMemberTests33-2105464604 None] deleted object: volume_5f57fed7-aa36-44c5-af90-863bd3d3af9d/20260703095349/az_nova_backup_885775bd-f91a-424f-bc10-7913c6a90400-00007 in container: volumebackups. {{(pid=101319) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 09:54:04.295270 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-3335c39d-a089-4a56-beb6-67cc36cd89a7 tempest-ProjectMemberTests33-2105464604 None] deleted object: volume_5f57fed7-aa36-44c5-af90-863bd3d3af9d/20260703095349/az_nova_backup_885775bd-f91a-424f-bc10-7913c6a90400-00008 in container: volumebackups. {{(pid=101319) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 09:54:04.315900 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-3335c39d-a089-4a56-beb6-67cc36cd89a7 tempest-ProjectMemberTests33-2105464604 None] deleted object: volume_5f57fed7-aa36-44c5-af90-863bd3d3af9d/20260703095349/az_nova_backup_885775bd-f91a-424f-bc10-7913c6a90400-00009 in container: volumebackups. {{(pid=101319) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 09:54:04.337556 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-3335c39d-a089-4a56-beb6-67cc36cd89a7 tempest-ProjectMemberTests33-2105464604 None] deleted object: volume_5f57fed7-aa36-44c5-af90-863bd3d3af9d/20260703095349/az_nova_backup_885775bd-f91a-424f-bc10-7913c6a90400-00010 in container: volumebackups. {{(pid=101319) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 09:54:04.358010 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-3335c39d-a089-4a56-beb6-67cc36cd89a7 tempest-ProjectMemberTests33-2105464604 None] deleted object: volume_5f57fed7-aa36-44c5-af90-863bd3d3af9d/20260703095349/az_nova_backup_885775bd-f91a-424f-bc10-7913c6a90400-00011 in container: volumebackups. {{(pid=101319) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 09:54:04.374631 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-3335c39d-a089-4a56-beb6-67cc36cd89a7 tempest-ProjectMemberTests33-2105464604 None] deleted object: volume_5f57fed7-aa36-44c5-af90-863bd3d3af9d/20260703095349/az_nova_backup_885775bd-f91a-424f-bc10-7913c6a90400-00012 in container: volumebackups. {{(pid=101319) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 09:54:04.390690 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-3335c39d-a089-4a56-beb6-67cc36cd89a7 tempest-ProjectMemberTests33-2105464604 None] deleted object: volume_5f57fed7-aa36-44c5-af90-863bd3d3af9d/20260703095349/az_nova_backup_885775bd-f91a-424f-bc10-7913c6a90400-00013 in container: volumebackups. {{(pid=101319) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 09:54:04.407455 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-3335c39d-a089-4a56-beb6-67cc36cd89a7 tempest-ProjectMemberTests33-2105464604 None] deleted object: volume_5f57fed7-aa36-44c5-af90-863bd3d3af9d/20260703095349/az_nova_backup_885775bd-f91a-424f-bc10-7913c6a90400-00014 in container: volumebackups. {{(pid=101319) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 09:54:04.425260 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-3335c39d-a089-4a56-beb6-67cc36cd89a7 tempest-ProjectMemberTests33-2105464604 None] deleted object: volume_5f57fed7-aa36-44c5-af90-863bd3d3af9d/20260703095349/az_nova_backup_885775bd-f91a-424f-bc10-7913c6a90400-00015 in container: volumebackups. {{(pid=101319) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 09:54:04.443992 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-3335c39d-a089-4a56-beb6-67cc36cd89a7 tempest-ProjectMemberTests33-2105464604 None] deleted object: volume_5f57fed7-aa36-44c5-af90-863bd3d3af9d/20260703095349/az_nova_backup_885775bd-f91a-424f-bc10-7913c6a90400-00016 in container: volumebackups. {{(pid=101319) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 09:54:04.466927 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-3335c39d-a089-4a56-beb6-67cc36cd89a7 tempest-ProjectMemberTests33-2105464604 None] deleted object: volume_5f57fed7-aa36-44c5-af90-863bd3d3af9d/20260703095349/az_nova_backup_885775bd-f91a-424f-bc10-7913c6a90400-00017 in container: volumebackups. {{(pid=101319) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 09:54:04.486299 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-3335c39d-a089-4a56-beb6-67cc36cd89a7 tempest-ProjectMemberTests33-2105464604 None] deleted object: volume_5f57fed7-aa36-44c5-af90-863bd3d3af9d/20260703095349/az_nova_backup_885775bd-f91a-424f-bc10-7913c6a90400-00018 in container: volumebackups. {{(pid=101319) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 09:54:04.504871 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-3335c39d-a089-4a56-beb6-67cc36cd89a7 tempest-ProjectMemberTests33-2105464604 None] deleted object: volume_5f57fed7-aa36-44c5-af90-863bd3d3af9d/20260703095349/az_nova_backup_885775bd-f91a-424f-bc10-7913c6a90400-00019 in container: volumebackups. {{(pid=101319) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 09:54:04.525583 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-3335c39d-a089-4a56-beb6-67cc36cd89a7 tempest-ProjectMemberTests33-2105464604 None] deleted object: volume_5f57fed7-aa36-44c5-af90-863bd3d3af9d/20260703095349/az_nova_backup_885775bd-f91a-424f-bc10-7913c6a90400-00020 in container: volumebackups. {{(pid=101319) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 09:54:04.545180 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-3335c39d-a089-4a56-beb6-67cc36cd89a7 tempest-ProjectMemberTests33-2105464604 None] deleted object: volume_5f57fed7-aa36-44c5-af90-863bd3d3af9d/20260703095349/az_nova_backup_885775bd-f91a-424f-bc10-7913c6a90400-00021 in container: volumebackups. {{(pid=101319) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 09:54:04.565426 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-3335c39d-a089-4a56-beb6-67cc36cd89a7 tempest-ProjectMemberTests33-2105464604 None] deleted object: volume_5f57fed7-aa36-44c5-af90-863bd3d3af9d/20260703095349/az_nova_backup_885775bd-f91a-424f-bc10-7913c6a90400_metadata in container: volumebackups. {{(pid=101319) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 09:54:04.588383 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-3335c39d-a089-4a56-beb6-67cc36cd89a7 tempest-ProjectMemberTests33-2105464604 None] deleted object: volume_5f57fed7-aa36-44c5-af90-863bd3d3af9d/20260703095349/az_nova_backup_885775bd-f91a-424f-bc10-7913c6a90400_sha256file in container: volumebackups. {{(pid=101319) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 09:54:04.588639 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-3335c39d-a089-4a56-beb6-67cc36cd89a7 tempest-ProjectMemberTests33-2105464604 None] delete 885775bd-f91a-424f-bc10-7913c6a90400 finished. {{(pid=101319) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:848}} Jul 03 09:54:04.624277 np0000004400 cinder-backup[101319]: DEBUG oslo_db.sqlalchemy.engines [None req-3335c39d-a089-4a56-beb6-67cc36cd89a7 tempest-ProjectMemberTests33-2105464604 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=101319) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 03 09:54:04.643859 np0000004400 cinder-backup[101319]: DEBUG cinder.quota [None req-3335c39d-a089-4a56-beb6-67cc36cd89a7 tempest-ProjectMemberTests33-2105464604 None] Created reservations ['751010bf-f5a3-4ee0-a93a-a7d5d29abc9b', 'f41a380d-c5bc-495e-ad71-4b3b4c34122f'] {{(pid=101319) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 09:54:04.660542 np0000004400 cinder-backup[101319]: INFO cinder.backup.manager [None req-3335c39d-a089-4a56-beb6-67cc36cd89a7 tempest-ProjectMemberTests33-2105464604 None] Delete backup finished, backup 885775bd-f91a-424f-bc10-7913c6a90400 deleted. Jul 03 09:54:05.148334 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.base [None req-64934804-7f51-4da7-8394-8f3f480fa1a0 tempest-VolumesBackupsTest-1484886458 None] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 2.140s {{(pid=101319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jul 03 09:54:05.148796 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-64934804-7f51-4da7-8394-8f3f480fa1a0 tempest-VolumesBackupsTest-1484886458 None] <== connect_volume: return (2140ms) {'type': 'block', 'scsi_wwn': 'SStorPool_iSCSI_DISK_1034578903445799236', 'path': '/dev/sdb'} {{(pid=101319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}} Jul 03 09:54:05.149014 np0000004400 cinder-backup[101319]: DEBUG oslo_concurrency.processutils [None req-64934804-7f51-4da7-8394-8f3f480fa1a0 tempest-VolumesBackupsTest-1484886458 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chown 1002 /dev/sdb {{(pid=101319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 09:54:05.166523 np0000004400 sudo[155861]: stack : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chown 1002 /dev/sdb Jul 03 09:54:05.167105 np0000004400 sudo[155861]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1002) Jul 03 09:54:05.382514 np0000004400 cinder-backup[101319]: INFO cinder.backup.manager [None req-dfea9dbc-7092-4bd8-8c85-cce5defc0f2e tempest-ProjectMemberTests33-2105464604 None] Create backup started, backup: 97903bb1-73b7-48fa-91c9-1d233582fece volume: 4883604b-dae6-422a-92df-ec0850150bc4. Jul 03 09:54:05.392738 np0000004400 cinder-backup[101319]: INFO cinder.backup.manager [None req-dfea9dbc-7092-4bd8-8c85-cce5defc0f2e tempest-ProjectMemberTests33-2105464604 None] Call Volume Manager to get_backup_device for Backup(availability_zone='nova',container=None,created_at=2026-07-03T09:54:05Z,data_timestamp=2026-07-03T09:54:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-type-Backup-38521341',encryption_key_id=None,fail_reason=None,host='np0000004400',id=97903bb1-73b7-48fa-91c9-1d233582fece,metadata={},num_dependent_backups=0,object_count=0,parent=None,parent_id=None,project_id='e0b6e59b911e40b3acac38afb1f81e3a',restore_volume_id=None,service='cinder.backup.drivers.swift.SwiftBackupDriver',service_metadata=None,size=1,snapshot_id=None,status='creating',temp_snapshot_id=None,temp_volume_id=None,updated_at=None,user_id='87abbb474f8a4baf840fcfdf286ff94e',volume_id=4883604b-dae6-422a-92df-ec0850150bc4) Jul 03 09:54:05.423789 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.drivers.swift [None req-dfea9dbc-7092-4bd8-8c85-cce5defc0f2e tempest-ProjectMemberTests33-2105464604 None] Using swift URL https://10.4.3.95:8080/v1/AUTH_e0b6e59b911e40b3acac38afb1f81e3a {{(pid=101319) initialize /opt/stack/cinder/cinder/backup/drivers/swift.py:300}} Jul 03 09:54:05.424082 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.drivers.swift [None req-dfea9dbc-7092-4bd8-8c85-cce5defc0f2e tempest-ProjectMemberTests33-2105464604 None] Connect to https://10.4.3.95:8080/v1/AUTH_ in "per_user" mode {{(pid=101319) initialize /opt/stack/cinder/cinder/backup/drivers/swift.py:301}} Jul 03 09:54:05.424719 np0000004400 cinder-backup[101319]: DEBUG os_brick.utils [None req-dfea9dbc-7092-4bd8-8c85-cce5defc0f2e tempest-ProjectMemberTests33-2105464604 None] ==> get_connector_properties: call "{'root_helper': 'sudo cinder-rootwrap /etc/cinder/rootwrap.conf', 'my_ip': '10.4.3.95', 'multipath': False, 'enforce_multipath': False, 'host': None, 'execute': None}" {{(pid=101319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}} Jul 03 09:54:05.435646 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.scaleio [None req-dfea9dbc-7092-4bd8-8c85-cce5defc0f2e tempest-ProjectMemberTests33-2105464604 None] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=101319) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}} Jul 03 09:54:05.456549 np0000004400 cinder-backup[101319]: DEBUG oslo_concurrency.processutils [None req-dfea9dbc-7092-4bd8-8c85-cce5defc0f2e tempest-ProjectMemberTests33-2105464604 None] Running cmd (subprocess): nvme version {{(pid=101319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 09:54:05.472334 np0000004400 cinder-backup[101319]: DEBUG oslo_concurrency.processutils [None req-dfea9dbc-7092-4bd8-8c85-cce5defc0f2e tempest-ProjectMemberTests33-2105464604 None] 'nvme version' failed. Not Retrying. {{(pid=101319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 03 09:54:05.472665 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.nvmeof [None req-dfea9dbc-7092-4bd8-8c85-cce5defc0f2e tempest-ProjectMemberTests33-2105464604 None] nvme not present on system {{(pid=101319) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}} Jul 03 09:54:05.480502 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.lightos [None req-dfea9dbc-7092-4bd8-8c85-cce5defc0f2e tempest-ProjectMemberTests33-2105464604 None] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=101319) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}} Jul 03 09:54:05.481426 np0000004400 cinder-backup[101319]: INFO os_brick.initiator.connectors.lightos [None req-dfea9dbc-7092-4bd8-8c85-cce5defc0f2e tempest-ProjectMemberTests33-2105464604 None] Current host hostNQN and IP(s) are ['10.4.3.95', 'fe80::f816:3eff:fe47:268c', '192.168.40.6', 'fe80::f816:3eff:febf:7be2', '192.168.50.6', 'fe80::f816:3eff:fe99:8914', '192.168.10.6', 'fe80::f816:3eff:fe2f:e696', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::bc9d:84ff:fec2:6b49', 'fe80::fc16:3eff:fec3:bd5f', 'fe80::8cea:42ff:fe99:b64a'] Jul 03 09:54:05.481550 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.lightos [None req-dfea9dbc-7092-4bd8-8c85-cce5defc0f2e tempest-ProjectMemberTests33-2105464604 None] LIGHTOS: did not find dsc, continuing anyway. {{(pid=101319) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}} Jul 03 09:54:05.481711 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.lightos [None req-dfea9dbc-7092-4bd8-8c85-cce5defc0f2e tempest-ProjectMemberTests33-2105464604 None] LIGHTOS: no hostnqn found. {{(pid=101319) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}} Jul 03 09:54:05.481946 np0000004400 cinder-backup[101319]: DEBUG os_brick.utils [None req-dfea9dbc-7092-4bd8-8c85-cce5defc0f2e tempest-ProjectMemberTests33-2105464604 None] <== get_connector_properties: return (57ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.95', 'host': 'np0000004400', 'multipath': False, 'enforce_multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:ae7e5bb0ebe6', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': '6b284368-d0ba-4d18-af6f-4998d3955c52', 'nvme_native_multipath': False} {{(pid=101319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}} Jul 03 09:54:05.485195 np0000004400 sudo[155861]: pam_unix(sudo:session): session closed for user root Jul 03 09:54:05.486832 np0000004400 cinder-backup[101319]: DEBUG oslo_concurrency.processutils [None req-64934804-7f51-4da7-8394-8f3f480fa1a0 tempest-VolumesBackupsTest-1484886458 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chown 1002 /dev/sdb" returned: 0 in 0.338s {{(pid=101319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 09:54:05.526050 np0000004400 cinder-backup[101319]: DEBUG oslo_db.sqlalchemy.engines [None req-64934804-7f51-4da7-8394-8f3f480fa1a0 tempest-VolumesBackupsTest-1484886458 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=101319) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 03 09:54:05.531153 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-64934804-7f51-4da7-8394-8f3f480fa1a0 tempest-VolumesBackupsTest-1484886458 None] _create_container started, container: volumebackups,backup: 44885c93-b853-422a-9a76-29c7e7bf3d8e. {{(pid=101319) _create_container /opt/stack/cinder/cinder/backup/chunkeddriver.py:249}} Jul 03 09:54:05.572807 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.drivers.swift [None req-64934804-7f51-4da7-8394-8f3f480fa1a0 tempest-VolumesBackupsTest-1484886458 None] generate_object_name_prefix: volume_b578d41f-4c6a-49b3-b5ec-bcd6556e2e68/20260703095405/az_nova_backup_44885c93-b853-422a-9a76-29c7e7bf3d8e {{(pid=101319) _generate_object_name_prefix /opt/stack/cinder/cinder/backup/drivers/swift.py:452}} Jul 03 09:54:05.577558 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-64934804-7f51-4da7-8394-8f3f480fa1a0 tempest-VolumesBackupsTest-1484886458 None] starting backup of volume: b578d41f-4c6a-49b3-b5ec-bcd6556e2e68, volume size: 1073741824, object names prefix volume_b578d41f-4c6a-49b3-b5ec-bcd6556e2e68/20260703095405/az_nova_backup_44885c93-b853-422a-9a76-29c7e7bf3d8e, availability zone: nova {{(pid=101319) _prepare_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:359}} Jul 03 09:54:05.786203 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-64934804-7f51-4da7-8394-8f3f480fa1a0 tempest-VolumesBackupsTest-1484886458 None] Backing up chunk of data from volume. {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 09:54:05.985455 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connector [None req-dfea9dbc-7092-4bd8-8c85-cce5defc0f2e tempest-ProjectMemberTests33-2105464604 None] Factory for iscsi on None {{(pid=101319) factory /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connector.py:243}} Jul 03 09:54:05.985843 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-dfea9dbc-7092-4bd8-8c85-cce5defc0f2e tempest-ProjectMemberTests33-2105464604 None] ==> connect_volume: call "{'self': , 'connection_properties': {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-4883604b-dae6-422a-92df-ec0850150bc4', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '4883604b-dae6-422a-92df-ec0850150bc4', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': False}}" {{(pid=101319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}} Jul 03 09:54:05.986072 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.base [None req-dfea9dbc-7092-4bd8-8c85-cce5defc0f2e tempest-ProjectMemberTests33-2105464604 None] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=101319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jul 03 09:54:05.986495 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.base [None req-dfea9dbc-7092-4bd8-8c85-cce5defc0f2e tempest-ProjectMemberTests33-2105464604 None] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.000s {{(pid=101319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jul 03 09:54:05.986717 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.base [None req-dfea9dbc-7092-4bd8-8c85-cce5defc0f2e tempest-ProjectMemberTests33-2105464604 None] Connection properties {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-4883604b-dae6-422a-92df-ec0850150bc4', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '4883604b-dae6-422a-92df-ec0850150bc4', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': False} {{(pid=101319) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}} Jul 03 09:54:05.997379 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.base [None req-dfea9dbc-7092-4bd8-8c85-cce5defc0f2e tempest-ProjectMemberTests33-2105464604 None] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-4883604b-dae6-422a-92df-ec0850150bc4" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=101319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jul 03 09:54:05.997841 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.base [None req-dfea9dbc-7092-4bd8-8c85-cce5defc0f2e tempest-ProjectMemberTests33-2105464604 None] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-4883604b-dae6-422a-92df-ec0850150bc4" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=101319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jul 03 09:54:05.998091 np0000004400 cinder-backup[101319]: INFO os_brick.initiator.connectors.iscsi [None req-dfea9dbc-7092-4bd8-8c85-cce5defc0f2e tempest-ProjectMemberTests33-2105464604 None] Trying to connect to iSCSI portal 192.168.40.100:3260 Jul 03 09:54:06.007426 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-dfea9dbc-7092-4bd8-8c85-cce5defc0f2e tempest-ProjectMemberTests33-2105464604 None] iscsiadm (): stdout= stderr=iscsiadm: No records found Jul 03 09:54:06.007426 np0000004400 cinder-backup[101319]: {{(pid=101319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 03 09:54:06.017122 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-dfea9dbc-7092-4bd8-8c85-cce5defc0f2e tempest-ProjectMemberTests33-2105464604 None] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-4883604b-dae6-422a-92df-ec0850150bc4] added Jul 03 09:54:06.017122 np0000004400 cinder-backup[101319]: stderr=iscsiadm: Config file line 363 does not have value Jul 03 09:54:06.017122 np0000004400 cinder-backup[101319]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs' Jul 03 09:54:06.017122 np0000004400 cinder-backup[101319]: iscsiadm: Config file line 363 does not have value Jul 03 09:54:06.017122 np0000004400 cinder-backup[101319]: iscsiadm: Config file line 363 does not have value Jul 03 09:54:06.017122 np0000004400 cinder-backup[101319]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs' Jul 03 09:54:06.017122 np0000004400 cinder-backup[101319]: {{(pid=101319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 03 09:54:06.017300 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-dfea9dbc-7092-4bd8-8c85-cce5defc0f2e tempest-ProjectMemberTests33-2105464604 None] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=101319) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}} Jul 03 09:54:06.017686 np0000004400 cinder-backup[101319]: DEBUG os_brick.utils [None req-dfea9dbc-7092-4bd8-8c85-cce5defc0f2e tempest-ProjectMemberTests33-2105464604 None] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0195(s), this was the 1st time calling it. {{(pid=101319) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}} Jul 03 09:54:06.017857 np0000004400 cinder-backup[101319]: DEBUG os_brick.utils [None req-dfea9dbc-7092-4bd8-8c85-cce5defc0f2e tempest-ProjectMemberTests33-2105464604 None] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=101319) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}} Jul 03 09:54:06.027489 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-64934804-7f51-4da7-8394-8f3f480fa1a0 tempest-VolumesBackupsTest-1484886458 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101319) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 09:54:06.027647 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-64934804-7f51-4da7-8394-8f3f480fa1a0 tempest-VolumesBackupsTest-1484886458 None] About to put_object {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 09:54:06.128249 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-64934804-7f51-4da7-8394-8f3f480fa1a0 tempest-VolumesBackupsTest-1484886458 None] backup MD5 for volume_b578d41f-4c6a-49b3-b5ec-bcd6556e2e68/20260703095405/az_nova_backup_44885c93-b853-422a-9a76-29c7e7bf3d8e-00001: 25e317773f308e446cc84c503a6d1f85 {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 09:54:06.128490 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-64934804-7f51-4da7-8394-8f3f480fa1a0 tempest-VolumesBackupsTest-1484886458 None] Calling eventlet.sleep(0) {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 09:54:06.300314 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-64934804-7f51-4da7-8394-8f3f480fa1a0 tempest-VolumesBackupsTest-1484886458 None] Backing up chunk of data from volume. {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 09:54:06.548505 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-64934804-7f51-4da7-8394-8f3f480fa1a0 tempest-VolumesBackupsTest-1484886458 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101319) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 09:54:06.548953 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-64934804-7f51-4da7-8394-8f3f480fa1a0 tempest-VolumesBackupsTest-1484886458 None] About to put_object {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 09:54:06.648054 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-64934804-7f51-4da7-8394-8f3f480fa1a0 tempest-VolumesBackupsTest-1484886458 None] backup MD5 for volume_b578d41f-4c6a-49b3-b5ec-bcd6556e2e68/20260703095405/az_nova_backup_44885c93-b853-422a-9a76-29c7e7bf3d8e-00002: 25e317773f308e446cc84c503a6d1f85 {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 09:54:06.648054 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-64934804-7f51-4da7-8394-8f3f480fa1a0 tempest-VolumesBackupsTest-1484886458 None] Calling eventlet.sleep(0) {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 09:54:06.825834 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-64934804-7f51-4da7-8394-8f3f480fa1a0 tempest-VolumesBackupsTest-1484886458 None] Backing up chunk of data from volume. {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 09:54:07.019858 np0000004400 cinder-backup[101319]: INFO os_brick.initiator.connectors.iscsi [None req-dfea9dbc-7092-4bd8-8c85-cce5defc0f2e tempest-ProjectMemberTests33-2105464604 None] Trying to connect to iSCSI portal 192.168.40.100:3260 Jul 03 09:54:07.030643 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-dfea9dbc-7092-4bd8-8c85-cce5defc0f2e tempest-ProjectMemberTests33-2105464604 None] iscsiadm (): stdout=# BEGIN RECORD 2.1.9 Jul 03 09:54:07.030643 np0000004400 cinder-backup[101319]: node.name = iqn.2023-03.storpool.com:os--volume-4883604b-dae6-422a-92df-ec0850150bc4 Jul 03 09:54:07.030643 np0000004400 cinder-backup[101319]: node.tpgt = -1 Jul 03 09:54:07.030643 np0000004400 cinder-backup[101319]: node.startup = manual Jul 03 09:54:07.030643 np0000004400 cinder-backup[101319]: node.leading_login = No Jul 03 09:54:07.030643 np0000004400 cinder-backup[101319]: iface.iscsi_ifacename = default Jul 03 09:54:07.030643 np0000004400 cinder-backup[101319]: iface.net_ifacename = Jul 03 09:54:07.030643 np0000004400 cinder-backup[101319]: iface.ipaddress = Jul 03 09:54:07.030643 np0000004400 cinder-backup[101319]: iface.prefix_len = 0 Jul 03 09:54:07.030643 np0000004400 cinder-backup[101319]: iface.hwaddress = Jul 03 09:54:07.030643 np0000004400 cinder-backup[101319]: iface.transport_name = tcp Jul 03 09:54:07.030643 np0000004400 cinder-backup[101319]: iface.initiatorname = Jul 03 09:54:07.030643 np0000004400 cinder-backup[101319]: iface.state = Jul 03 09:54:07.030643 np0000004400 cinder-backup[101319]: iface.vlan_id = 0 Jul 03 09:54:07.030643 np0000004400 cinder-backup[101319]: iface.vlan_priority = 0 Jul 03 09:54:07.030643 np0000004400 cinder-backup[101319]: iface.vlan_state = Jul 03 09:54:07.030643 np0000004400 cinder-backup[101319]: iface.iface_num = 0 Jul 03 09:54:07.030643 np0000004400 cinder-backup[101319]: iface.mtu = 0 Jul 03 09:54:07.030643 np0000004400 cinder-backup[101319]: iface.port = 0 Jul 03 09:54:07.030643 np0000004400 cinder-backup[101319]: iface.bootproto = Jul 03 09:54:07.030643 np0000004400 cinder-backup[101319]: iface.subnet_mask = Jul 03 09:54:07.030643 np0000004400 cinder-backup[101319]: iface.gateway = Jul 03 09:54:07.030643 np0000004400 cinder-backup[101319]: iface.dhcp_alt_client_id_state = Jul 03 09:54:07.030643 np0000004400 cinder-backup[101319]: iface.dhcp_alt_client_id = Jul 03 09:54:07.030643 np0000004400 cinder-backup[101319]: iface.dhcp_dns = Jul 03 09:54:07.030643 np0000004400 cinder-backup[101319]: iface.dhcp_learn_iqn = Jul 03 09:54:07.030643 np0000004400 cinder-backup[101319]: iface.dhcp_req_vendor_id_state = Jul 03 09:54:07.030643 np0000004400 cinder-backup[101319]: iface.dhcp_vendor_id_state = Jul 03 09:54:07.030643 np0000004400 cinder-backup[101319]: iface.dhcp_vendor_id = Jul 03 09:54:07.030643 np0000004400 cinder-backup[101319]: iface.dhcp_slp_da = Jul 03 09:54:07.030643 np0000004400 cinder-backup[101319]: iface.fragmentation = Jul 03 09:54:07.030643 np0000004400 cinder-backup[101319]: iface.gratuitous_arp = Jul 03 09:54:07.030643 np0000004400 cinder-backup[101319]: iface.incoming_forwarding = Jul 03 09:54:07.030643 np0000004400 cinder-backup[101319]: iface.tos_state = Jul 03 09:54:07.030643 np0000004400 cinder-backup[101319]: iface.tos = 0 Jul 03 09:54:07.030643 np0000004400 cinder-backup[101319]: iface.ttl = 0 Jul 03 09:54:07.030643 np0000004400 cinder-backup[101319]: iface.delayed_ack = Jul 03 09:54:07.030643 np0000004400 cinder-backup[101319]: iface.tcp_nagle = Jul 03 09:54:07.030643 np0000004400 cinder-backup[101319]: iface.tcp_wsf_state = Jul 03 09:54:07.030643 np0000004400 cinder-backup[101319]: iface.tcp_wsf = 0 Jul 03 09:54:07.030643 np0000004400 cinder-backup[101319]: iface.tcp_timer_scale = 0 Jul 03 09:54:07.030643 np0000004400 cinder-backup[101319]: iface.tcp_timestamp = Jul 03 09:54:07.030643 np0000004400 cinder-backup[101319]: iface.redirect = Jul 03 09:54:07.030643 np0000004400 cinder-backup[101319]: iface.def_task_mgmt_timeout = 0 Jul 03 09:54:07.030643 np0000004400 cinder-backup[101319]: iface.header_digest = Jul 03 09:54:07.030643 np0000004400 cinder-backup[101319]: iface.data_digest = Jul 03 09:54:07.030643 np0000004400 cinder-backup[101319]: iface.immediate_data = Jul 03 09:54:07.030643 np0000004400 cinder-backup[101319]: iface.initial_r2t = Jul 03 09:54:07.030643 np0000004400 cinder-backup[101319]: iface.data_seq_inorder = Jul 03 09:54:07.030643 np0000004400 cinder-backup[101319]: iface.data_pdu_inorder = Jul 03 09:54:07.030643 np0000004400 cinder-backup[101319]: iface.erl = 0 Jul 03 09:54:07.030643 np0000004400 cinder-backup[101319]: iface.max_receive_data_len = 0 Jul 03 09:54:07.030643 np0000004400 cinder-backup[101319]: iface.first_burst_len = 0 Jul 03 09:54:07.030643 np0000004400 cinder-backup[101319]: iface.max_outstanding_r2t = 0 Jul 03 09:54:07.030643 np0000004400 cinder-backup[101319]: iface.max_burst_len = 0 Jul 03 09:54:07.030643 np0000004400 cinder-backup[101319]: iface.chap_auth = Jul 03 09:54:07.030643 np0000004400 cinder-backup[101319]: iface.bidi_chap = Jul 03 09:54:07.030643 np0000004400 cinder-backup[101319]: iface.strict_login_compliance = Jul 03 09:54:07.030643 np0000004400 cinder-backup[101319]: iface.discovery_auth = Jul 03 09:54:07.030643 np0000004400 cinder-backup[101319]: iface.discovery_logout = Jul 03 09:54:07.030643 np0000004400 cinder-backup[101319]: node.discovery_address = Jul 03 09:54:07.030643 np0000004400 cinder-backup[101319]: node.discovery_port = 0 Jul 03 09:54:07.030643 np0000004400 cinder-backup[101319]: node.discovery_type = fw Jul 03 09:54:07.030643 np0000004400 cinder-backup[101319]: node.session.initial_cmdsn = 0 Jul 03 09:54:07.030643 np0000004400 cinder-backup[101319]: node.session.initial_login_retry_max = 8 Jul 03 09:54:07.030643 np0000004400 cinder-backup[101319]: node.session.xmit_thread_priority = 0 Jul 03 09:54:07.030643 np0000004400 cinder-backup[101319]: node.session.cmds_max = 128 Jul 03 09:54:07.030643 np0000004400 cinder-backup[101319]: node.session.queue_depth = 32 Jul 03 09:54:07.030643 np0000004400 cinder-backup[101319]: node.session.nr_sessions = 1 Jul 03 09:54:07.030643 np0000004400 cinder-backup[101319]: node.session.auth.authmethod = None Jul 03 09:54:07.030643 np0000004400 cinder-backup[101319]: node.session.auth.username = Jul 03 09:54:07.030643 np0000004400 cinder-backup[101319]: node.session.auth.password = *** Jul 03 09:54:07.030643 np0000004400 cinder-backup[101319]: node.session.auth.username_in = Jul 03 09:54:07.030643 np0000004400 cinder-backup[101319]: node.session.auth.password_in = Jul 03 09:54:07.030643 np0000004400 cinder-backup[101319]: node.session.auth.chap_algs = SHA256 Jul 03 09:54:07.030643 np0000004400 cinder-backup[101319]: node.session.timeo.replacement_timeout = 120 Jul 03 09:54:07.030643 np0000004400 cinder-backup[101319]: node.session.err_timeo.abort_timeout = 15 Jul 03 09:54:07.030643 np0000004400 cinder-backup[101319]: node.session.err_timeo.lu_reset_timeout = 30 Jul 03 09:54:07.030643 np0000004400 cinder-backup[101319]: node.session.err_timeo.tgt_reset_timeout = 30 Jul 03 09:54:07.030643 np0000004400 cinder-backup[101319]: node.session.err_timeo.host_reset_timeout = 60 Jul 03 09:54:07.030643 np0000004400 cinder-backup[101319]: node.session.iscsi.FastAbort = Yes Jul 03 09:54:07.030643 np0000004400 cinder-backup[101319]: node.session.iscsi.InitialR2T = No Jul 03 09:54:07.030643 np0000004400 cinder-backup[101319]: node.session.iscsi.ImmediateData = Yes Jul 03 09:54:07.030643 np0000004400 cinder-backup[101319]: node.session.iscsi.FirstBurstLength = 262144 Jul 03 09:54:07.030643 np0000004400 cinder-backup[101319]: node.session.iscsi.MaxBurstLength = 16776192 Jul 03 09:54:07.030643 np0000004400 cinder-backup[101319]: node.session.iscsi.DefaultTime2Retain = 0 Jul 03 09:54:07.030643 np0000004400 cinder-backup[101319]: node.session.iscsi.DefaultTime2Wait = 2 Jul 03 09:54:07.030643 np0000004400 cinder-backup[101319]: node.session.iscsi.MaxConnections = 1 Jul 03 09:54:07.030643 np0000004400 cinder-backup[101319]: node.session.iscsi.MaxOutstandingR2T = 1 Jul 03 09:54:07.030643 np0000004400 cinder-backup[101319]: node.session.iscsi.ERL = 0 Jul 03 09:54:07.030643 np0000004400 cinder-backup[101319]: node.session.scan = auto Jul 03 09:54:07.030643 np0000004400 cinder-backup[101319]: node.session.reopen_max = 0 Jul 03 09:54:07.030643 np0000004400 cinder-backup[101319]: node.conn[0].address = 192.168.40.100 Jul 03 09:54:07.030643 np0000004400 cinder-backup[101319]: node.conn[0].port = 3260 Jul 03 09:54:07.030643 np0000004400 cinder-backup[101319]: node.conn[0].startup = manual Jul 03 09:54:07.030643 np0000004400 cinder-backup[101319]: node.conn[0].tcp.window_size = 524288 Jul 03 09:54:07.030643 np0000004400 cinder-backup[101319]: node.conn[0].tcp.type_of_service = 0 Jul 03 09:54:07.030643 np0000004400 cinder-backup[101319]: node.conn[0].timeo.logout_timeout = 15 Jul 03 09:54:07.030643 np0000004400 cinder-backup[101319]: node.conn[0].timeo.login_timeout = 15 Jul 03 09:54:07.030643 np0000004400 cinder-backup[101319]: node.conn[0].timeo.auth_timeout = 45 Jul 03 09:54:07.030643 np0000004400 cinder-backup[101319]: node.conn[0].timeo.noop_out_interval = 5 Jul 03 09:54:07.030643 np0000004400 cinder-backup[101319]: node.conn[0].timeo.noop_out_timeout = 5 Jul 03 09:54:07.030643 np0000004400 cinder-backup[101319]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0 Jul 03 09:54:07.030643 np0000004400 cinder-backup[101319]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144 Jul 03 09:54:07.030643 np0000004400 cinder-backup[101319]: node.conn[0].iscsi.HeaderDigest = None Jul 03 09:54:07.030643 np0000004400 cinder-backup[101319]: node.conn[0].iscsi.DataDigest = None Jul 03 09:54:07.030643 np0000004400 cinder-backup[101319]: node.conn[0].iscsi.IFMarker = No Jul 03 09:54:07.030643 np0000004400 cinder-backup[101319]: node.conn[0].iscsi.OFMarker = No Jul 03 09:54:07.030643 np0000004400 cinder-backup[101319]: # END RECORD Jul 03 09:54:07.030643 np0000004400 cinder-backup[101319]: stderr= {{(pid=101319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 03 09:54:07.040474 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-dfea9dbc-7092-4bd8-8c85-cce5defc0f2e tempest-ProjectMemberTests33-2105464604 None] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=101319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 03 09:54:07.052092 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-dfea9dbc-7092-4bd8-8c85-cce5defc0f2e tempest-ProjectMemberTests33-2105464604 None] iscsiadm ('-m', 'session'): stdout=tcp: [208] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-789ec59e-ea87-4784-8990-156a35276b5f (non-flash) Jul 03 09:54:07.052092 np0000004400 cinder-backup[101319]: tcp: [209] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-789ec59e-ea87-4784-8990-156a35276b5f (non-flash) Jul 03 09:54:07.052092 np0000004400 cinder-backup[101319]: tcp: [210] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b578d41f-4c6a-49b3-b5ec-bcd6556e2e68 (non-flash) Jul 03 09:54:07.052092 np0000004400 cinder-backup[101319]: stderr= {{(pid=101319) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jul 03 09:54:07.052315 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-dfea9dbc-7092-4bd8-8c85-cce5defc0f2e tempest-ProjectMemberTests33-2105464604 None] iscsi session list stdout=tcp: [208] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-789ec59e-ea87-4784-8990-156a35276b5f (non-flash) Jul 03 09:54:07.052315 np0000004400 cinder-backup[101319]: tcp: [209] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-789ec59e-ea87-4784-8990-156a35276b5f (non-flash) Jul 03 09:54:07.052315 np0000004400 cinder-backup[101319]: tcp: [210] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b578d41f-4c6a-49b3-b5ec-bcd6556e2e68 (non-flash) Jul 03 09:54:07.052315 np0000004400 cinder-backup[101319]: stderr= {{(pid=101319) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jul 03 09:54:07.068364 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-64934804-7f51-4da7-8394-8f3f480fa1a0 tempest-VolumesBackupsTest-1484886458 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101319) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 09:54:07.068524 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-64934804-7f51-4da7-8394-8f3f480fa1a0 tempest-VolumesBackupsTest-1484886458 None] About to put_object {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 09:54:07.083823 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-dfea9dbc-7092-4bd8-8c85-cce5defc0f2e tempest-ProjectMemberTests33-2105464604 None] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-4883604b-dae6-422a-92df-ec0850150bc4, portal: 192.168.40.100,3260] Jul 03 09:54:07.083823 np0000004400 cinder-backup[101319]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-4883604b-dae6-422a-92df-ec0850150bc4, portal: 192.168.40.100,3260] successful. Jul 03 09:54:07.083823 np0000004400 cinder-backup[101319]: stderr= {{(pid=101319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 03 09:54:07.093835 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-dfea9dbc-7092-4bd8-8c85-cce5defc0f2e tempest-ProjectMemberTests33-2105464604 None] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=101319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 03 09:54:07.106188 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-dfea9dbc-7092-4bd8-8c85-cce5defc0f2e tempest-ProjectMemberTests33-2105464604 None] iscsiadm ('-m', 'session'): stdout=tcp: [208] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-789ec59e-ea87-4784-8990-156a35276b5f (non-flash) Jul 03 09:54:07.106188 np0000004400 cinder-backup[101319]: tcp: [209] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-789ec59e-ea87-4784-8990-156a35276b5f (non-flash) Jul 03 09:54:07.106188 np0000004400 cinder-backup[101319]: tcp: [210] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b578d41f-4c6a-49b3-b5ec-bcd6556e2e68 (non-flash) Jul 03 09:54:07.106188 np0000004400 cinder-backup[101319]: tcp: [211] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-4883604b-dae6-422a-92df-ec0850150bc4 (non-flash) Jul 03 09:54:07.106188 np0000004400 cinder-backup[101319]: stderr= {{(pid=101319) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jul 03 09:54:07.106382 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-dfea9dbc-7092-4bd8-8c85-cce5defc0f2e tempest-ProjectMemberTests33-2105464604 None] iscsi session list stdout=tcp: [208] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-789ec59e-ea87-4784-8990-156a35276b5f (non-flash) Jul 03 09:54:07.106382 np0000004400 cinder-backup[101319]: tcp: [209] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-789ec59e-ea87-4784-8990-156a35276b5f (non-flash) Jul 03 09:54:07.106382 np0000004400 cinder-backup[101319]: tcp: [210] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b578d41f-4c6a-49b3-b5ec-bcd6556e2e68 (non-flash) Jul 03 09:54:07.106382 np0000004400 cinder-backup[101319]: tcp: [211] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-4883604b-dae6-422a-92df-ec0850150bc4 (non-flash) Jul 03 09:54:07.106382 np0000004400 cinder-backup[101319]: stderr= {{(pid=101319) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jul 03 09:54:07.106776 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.base [None req-dfea9dbc-7092-4bd8-8c85-cce5defc0f2e tempest-ProjectMemberTests33-2105464604 None] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-4883604b-dae6-422a-92df-ec0850150bc4" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.109s {{(pid=101319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jul 03 09:54:07.106934 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-dfea9dbc-7092-4bd8-8c85-cce5defc0f2e tempest-ProjectMemberTests33-2105464604 None] Connected to 192.168.40.100:3260 {{(pid=101319) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}} Jul 03 09:54:07.107594 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.linuxscsi [None req-dfea9dbc-7092-4bd8-8c85-cce5defc0f2e tempest-ProjectMemberTests33-2105464604 None] HCTL ('8', '-', '-', 0) found on session 211 with lun 0 {{(pid=101319) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}} Jul 03 09:54:07.107774 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.linuxscsi [None req-dfea9dbc-7092-4bd8-8c85-cce5defc0f2e tempest-ProjectMemberTests33-2105464604 None] Scanning host 8 c: -, t: -, l: 0) {{(pid=101319) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}} Jul 03 09:54:07.119475 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.linuxscsi [None req-dfea9dbc-7092-4bd8-8c85-cce5defc0f2e tempest-ProjectMemberTests33-2105464604 None] Searching for a device in session 211 and hctl ['8', '*', '*', 0] yield: sdc {{(pid=101319) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}} Jul 03 09:54:07.119475 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-dfea9dbc-7092-4bd8-8c85-cce5defc0f2e tempest-ProjectMemberTests33-2105464604 None] Connected to sdc using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-4883604b-dae6-422a-92df-ec0850150bc4', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '4883604b-dae6-422a-92df-ec0850150bc4', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': False} {{(pid=101319) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}} Jul 03 09:54:07.175001 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-64934804-7f51-4da7-8394-8f3f480fa1a0 tempest-VolumesBackupsTest-1484886458 None] backup MD5 for volume_b578d41f-4c6a-49b3-b5ec-bcd6556e2e68/20260703095405/az_nova_backup_44885c93-b853-422a-9a76-29c7e7bf3d8e-00003: 25e317773f308e446cc84c503a6d1f85 {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 09:54:07.175178 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-64934804-7f51-4da7-8394-8f3f480fa1a0 tempest-VolumesBackupsTest-1484886458 None] Calling eventlet.sleep(0) {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 09:54:07.362236 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-64934804-7f51-4da7-8394-8f3f480fa1a0 tempest-VolumesBackupsTest-1484886458 None] Backing up chunk of data from volume. {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 09:54:07.609724 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-64934804-7f51-4da7-8394-8f3f480fa1a0 tempest-VolumesBackupsTest-1484886458 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101319) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 09:54:07.610092 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-64934804-7f51-4da7-8394-8f3f480fa1a0 tempest-VolumesBackupsTest-1484886458 None] About to put_object {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 09:54:07.705063 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-64934804-7f51-4da7-8394-8f3f480fa1a0 tempest-VolumesBackupsTest-1484886458 None] backup MD5 for volume_b578d41f-4c6a-49b3-b5ec-bcd6556e2e68/20260703095405/az_nova_backup_44885c93-b853-422a-9a76-29c7e7bf3d8e-00004: 25e317773f308e446cc84c503a6d1f85 {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 09:54:07.705245 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-64934804-7f51-4da7-8394-8f3f480fa1a0 tempest-VolumesBackupsTest-1484886458 None] Calling eventlet.sleep(0) {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 09:54:07.893624 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-64934804-7f51-4da7-8394-8f3f480fa1a0 tempest-VolumesBackupsTest-1484886458 None] Backing up chunk of data from volume. {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 09:54:08.121823 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.base [None req-dfea9dbc-7092-4bd8-8c85-cce5defc0f2e tempest-ProjectMemberTests33-2105464604 None] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 2.135s {{(pid=101319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jul 03 09:54:08.121946 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-dfea9dbc-7092-4bd8-8c85-cce5defc0f2e tempest-ProjectMemberTests33-2105464604 None] <== connect_volume: return (2136ms) {'type': 'block', 'scsi_wwn': '1StorPooliSCSI_DISK_1034578903445799237', 'path': '/dev/sdc'} {{(pid=101319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}} Jul 03 09:54:08.122184 np0000004400 cinder-backup[101319]: DEBUG oslo_concurrency.processutils [None req-dfea9dbc-7092-4bd8-8c85-cce5defc0f2e tempest-ProjectMemberTests33-2105464604 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chown 1002 /dev/sdc {{(pid=101319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 09:54:08.142159 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-64934804-7f51-4da7-8394-8f3f480fa1a0 tempest-VolumesBackupsTest-1484886458 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101319) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 09:54:08.142314 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-64934804-7f51-4da7-8394-8f3f480fa1a0 tempest-VolumesBackupsTest-1484886458 None] About to put_object {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 09:54:08.143555 np0000004400 sudo[155923]: stack : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chown 1002 /dev/sdc Jul 03 09:54:08.144363 np0000004400 sudo[155923]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1002) Jul 03 09:54:08.243903 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-64934804-7f51-4da7-8394-8f3f480fa1a0 tempest-VolumesBackupsTest-1484886458 None] backup MD5 for volume_b578d41f-4c6a-49b3-b5ec-bcd6556e2e68/20260703095405/az_nova_backup_44885c93-b853-422a-9a76-29c7e7bf3d8e-00005: 25e317773f308e446cc84c503a6d1f85 {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 09:54:08.244063 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-64934804-7f51-4da7-8394-8f3f480fa1a0 tempest-VolumesBackupsTest-1484886458 None] Calling eventlet.sleep(0) {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 09:54:08.426738 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-64934804-7f51-4da7-8394-8f3f480fa1a0 tempest-VolumesBackupsTest-1484886458 None] Backing up chunk of data from volume. {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 09:54:08.470976 np0000004400 sudo[155923]: pam_unix(sudo:session): session closed for user root Jul 03 09:54:08.473265 np0000004400 cinder-backup[101319]: DEBUG oslo_concurrency.processutils [None req-dfea9dbc-7092-4bd8-8c85-cce5defc0f2e tempest-ProjectMemberTests33-2105464604 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chown 1002 /dev/sdc" returned: 0 in 0.351s {{(pid=101319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 09:54:08.479040 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-dfea9dbc-7092-4bd8-8c85-cce5defc0f2e tempest-ProjectMemberTests33-2105464604 None] _create_container started, container: volumebackups,backup: 97903bb1-73b7-48fa-91c9-1d233582fece. {{(pid=101319) _create_container /opt/stack/cinder/cinder/backup/chunkeddriver.py:249}} Jul 03 09:54:08.506791 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.drivers.swift [None req-dfea9dbc-7092-4bd8-8c85-cce5defc0f2e tempest-ProjectMemberTests33-2105464604 None] generate_object_name_prefix: volume_4883604b-dae6-422a-92df-ec0850150bc4/20260703095408/az_nova_backup_97903bb1-73b7-48fa-91c9-1d233582fece {{(pid=101319) _generate_object_name_prefix /opt/stack/cinder/cinder/backup/drivers/swift.py:452}} Jul 03 09:54:08.512335 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-dfea9dbc-7092-4bd8-8c85-cce5defc0f2e tempest-ProjectMemberTests33-2105464604 None] starting backup of volume: 4883604b-dae6-422a-92df-ec0850150bc4, volume size: 1073741824, object names prefix volume_4883604b-dae6-422a-92df-ec0850150bc4/20260703095408/az_nova_backup_97903bb1-73b7-48fa-91c9-1d233582fece, availability zone: nova {{(pid=101319) _prepare_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:359}} Jul 03 09:54:08.691940 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-64934804-7f51-4da7-8394-8f3f480fa1a0 tempest-VolumesBackupsTest-1484886458 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101319) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 09:54:08.692269 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-64934804-7f51-4da7-8394-8f3f480fa1a0 tempest-VolumesBackupsTest-1484886458 None] About to put_object {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 09:54:08.705317 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-dfea9dbc-7092-4bd8-8c85-cce5defc0f2e tempest-ProjectMemberTests33-2105464604 None] Backing up chunk of data from volume. {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 09:54:08.806800 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-64934804-7f51-4da7-8394-8f3f480fa1a0 tempest-VolumesBackupsTest-1484886458 None] backup MD5 for volume_b578d41f-4c6a-49b3-b5ec-bcd6556e2e68/20260703095405/az_nova_backup_44885c93-b853-422a-9a76-29c7e7bf3d8e-00006: 25e317773f308e446cc84c503a6d1f85 {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 09:54:08.806985 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-64934804-7f51-4da7-8394-8f3f480fa1a0 tempest-VolumesBackupsTest-1484886458 None] Calling eventlet.sleep(0) {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 09:54:08.952135 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-dfea9dbc-7092-4bd8-8c85-cce5defc0f2e tempest-ProjectMemberTests33-2105464604 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101319) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 09:54:08.952275 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-dfea9dbc-7092-4bd8-8c85-cce5defc0f2e tempest-ProjectMemberTests33-2105464604 None] About to put_object {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 09:54:08.991607 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-64934804-7f51-4da7-8394-8f3f480fa1a0 tempest-VolumesBackupsTest-1484886458 None] Backing up chunk of data from volume. {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 09:54:09.055849 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-dfea9dbc-7092-4bd8-8c85-cce5defc0f2e tempest-ProjectMemberTests33-2105464604 None] backup MD5 for volume_4883604b-dae6-422a-92df-ec0850150bc4/20260703095408/az_nova_backup_97903bb1-73b7-48fa-91c9-1d233582fece-00001: 25e317773f308e446cc84c503a6d1f85 {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 09:54:09.055964 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-dfea9dbc-7092-4bd8-8c85-cce5defc0f2e tempest-ProjectMemberTests33-2105464604 None] Calling eventlet.sleep(0) {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 09:54:09.236913 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-dfea9dbc-7092-4bd8-8c85-cce5defc0f2e tempest-ProjectMemberTests33-2105464604 None] Backing up chunk of data from volume. {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 09:54:09.244216 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-64934804-7f51-4da7-8394-8f3f480fa1a0 tempest-VolumesBackupsTest-1484886458 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101319) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 09:54:09.244395 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-64934804-7f51-4da7-8394-8f3f480fa1a0 tempest-VolumesBackupsTest-1484886458 None] About to put_object {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 09:54:09.357485 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-64934804-7f51-4da7-8394-8f3f480fa1a0 tempest-VolumesBackupsTest-1484886458 None] backup MD5 for volume_b578d41f-4c6a-49b3-b5ec-bcd6556e2e68/20260703095405/az_nova_backup_44885c93-b853-422a-9a76-29c7e7bf3d8e-00007: 25e317773f308e446cc84c503a6d1f85 {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 09:54:09.357655 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-64934804-7f51-4da7-8394-8f3f480fa1a0 tempest-VolumesBackupsTest-1484886458 None] Calling eventlet.sleep(0) {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 09:54:09.493301 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-dfea9dbc-7092-4bd8-8c85-cce5defc0f2e tempest-ProjectMemberTests33-2105464604 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101319) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 09:54:09.493452 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-dfea9dbc-7092-4bd8-8c85-cce5defc0f2e tempest-ProjectMemberTests33-2105464604 None] About to put_object {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 09:54:09.531909 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-64934804-7f51-4da7-8394-8f3f480fa1a0 tempest-VolumesBackupsTest-1484886458 None] Backing up chunk of data from volume. {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 09:54:09.599142 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-dfea9dbc-7092-4bd8-8c85-cce5defc0f2e tempest-ProjectMemberTests33-2105464604 None] backup MD5 for volume_4883604b-dae6-422a-92df-ec0850150bc4/20260703095408/az_nova_backup_97903bb1-73b7-48fa-91c9-1d233582fece-00002: 25e317773f308e446cc84c503a6d1f85 {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 09:54:09.599382 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-dfea9dbc-7092-4bd8-8c85-cce5defc0f2e tempest-ProjectMemberTests33-2105464604 None] Calling eventlet.sleep(0) {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 09:54:09.784823 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-64934804-7f51-4da7-8394-8f3f480fa1a0 tempest-VolumesBackupsTest-1484886458 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101319) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 09:54:09.785208 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-64934804-7f51-4da7-8394-8f3f480fa1a0 tempest-VolumesBackupsTest-1484886458 None] About to put_object {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 09:54:09.799309 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-dfea9dbc-7092-4bd8-8c85-cce5defc0f2e tempest-ProjectMemberTests33-2105464604 None] Backing up chunk of data from volume. {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 09:54:09.888110 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-64934804-7f51-4da7-8394-8f3f480fa1a0 tempest-VolumesBackupsTest-1484886458 None] backup MD5 for volume_b578d41f-4c6a-49b3-b5ec-bcd6556e2e68/20260703095405/az_nova_backup_44885c93-b853-422a-9a76-29c7e7bf3d8e-00008: 25e317773f308e446cc84c503a6d1f85 {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 09:54:09.888265 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-64934804-7f51-4da7-8394-8f3f480fa1a0 tempest-VolumesBackupsTest-1484886458 None] Calling eventlet.sleep(0) {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 09:54:10.050146 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-dfea9dbc-7092-4bd8-8c85-cce5defc0f2e tempest-ProjectMemberTests33-2105464604 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101319) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 09:54:10.050358 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-dfea9dbc-7092-4bd8-8c85-cce5defc0f2e tempest-ProjectMemberTests33-2105464604 None] About to put_object {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 09:54:10.068807 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-64934804-7f51-4da7-8394-8f3f480fa1a0 tempest-VolumesBackupsTest-1484886458 None] Backing up chunk of data from volume. {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 09:54:10.162658 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-dfea9dbc-7092-4bd8-8c85-cce5defc0f2e tempest-ProjectMemberTests33-2105464604 None] backup MD5 for volume_4883604b-dae6-422a-92df-ec0850150bc4/20260703095408/az_nova_backup_97903bb1-73b7-48fa-91c9-1d233582fece-00003: 25e317773f308e446cc84c503a6d1f85 {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 09:54:10.162846 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-dfea9dbc-7092-4bd8-8c85-cce5defc0f2e tempest-ProjectMemberTests33-2105464604 None] Calling eventlet.sleep(0) {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 09:54:10.332790 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-64934804-7f51-4da7-8394-8f3f480fa1a0 tempest-VolumesBackupsTest-1484886458 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101319) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 09:54:10.332790 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-64934804-7f51-4da7-8394-8f3f480fa1a0 tempest-VolumesBackupsTest-1484886458 None] About to put_object {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 09:54:10.365769 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-dfea9dbc-7092-4bd8-8c85-cce5defc0f2e tempest-ProjectMemberTests33-2105464604 None] Backing up chunk of data from volume. {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 09:54:10.440150 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-64934804-7f51-4da7-8394-8f3f480fa1a0 tempest-VolumesBackupsTest-1484886458 None] backup MD5 for volume_b578d41f-4c6a-49b3-b5ec-bcd6556e2e68/20260703095405/az_nova_backup_44885c93-b853-422a-9a76-29c7e7bf3d8e-00009: 25e317773f308e446cc84c503a6d1f85 {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 09:54:10.440150 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-64934804-7f51-4da7-8394-8f3f480fa1a0 tempest-VolumesBackupsTest-1484886458 None] Calling eventlet.sleep(0) {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 09:54:10.617794 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-dfea9dbc-7092-4bd8-8c85-cce5defc0f2e tempest-ProjectMemberTests33-2105464604 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101319) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 09:54:10.617794 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-dfea9dbc-7092-4bd8-8c85-cce5defc0f2e tempest-ProjectMemberTests33-2105464604 None] About to put_object {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 09:54:10.654418 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-64934804-7f51-4da7-8394-8f3f480fa1a0 tempest-VolumesBackupsTest-1484886458 None] Backing up chunk of data from volume. {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 09:54:10.737285 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-dfea9dbc-7092-4bd8-8c85-cce5defc0f2e tempest-ProjectMemberTests33-2105464604 None] backup MD5 for volume_4883604b-dae6-422a-92df-ec0850150bc4/20260703095408/az_nova_backup_97903bb1-73b7-48fa-91c9-1d233582fece-00004: 25e317773f308e446cc84c503a6d1f85 {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 09:54:10.737468 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-dfea9dbc-7092-4bd8-8c85-cce5defc0f2e tempest-ProjectMemberTests33-2105464604 None] Calling eventlet.sleep(0) {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 09:54:10.916211 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-64934804-7f51-4da7-8394-8f3f480fa1a0 tempest-VolumesBackupsTest-1484886458 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101319) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 09:54:10.916591 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-64934804-7f51-4da7-8394-8f3f480fa1a0 tempest-VolumesBackupsTest-1484886458 None] About to put_object {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 09:54:10.923957 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-dfea9dbc-7092-4bd8-8c85-cce5defc0f2e tempest-ProjectMemberTests33-2105464604 None] Backing up chunk of data from volume. {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 09:54:11.019503 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-64934804-7f51-4da7-8394-8f3f480fa1a0 tempest-VolumesBackupsTest-1484886458 None] backup MD5 for volume_b578d41f-4c6a-49b3-b5ec-bcd6556e2e68/20260703095405/az_nova_backup_44885c93-b853-422a-9a76-29c7e7bf3d8e-00010: 25e317773f308e446cc84c503a6d1f85 {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 09:54:11.019704 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-64934804-7f51-4da7-8394-8f3f480fa1a0 tempest-VolumesBackupsTest-1484886458 None] Calling eventlet.sleep(0) {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 09:54:11.175594 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-dfea9dbc-7092-4bd8-8c85-cce5defc0f2e tempest-ProjectMemberTests33-2105464604 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101319) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 09:54:11.175780 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-dfea9dbc-7092-4bd8-8c85-cce5defc0f2e tempest-ProjectMemberTests33-2105464604 None] About to put_object {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 09:54:11.210109 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-64934804-7f51-4da7-8394-8f3f480fa1a0 tempest-VolumesBackupsTest-1484886458 None] Backing up chunk of data from volume. {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 09:54:11.279386 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-dfea9dbc-7092-4bd8-8c85-cce5defc0f2e tempest-ProjectMemberTests33-2105464604 None] backup MD5 for volume_4883604b-dae6-422a-92df-ec0850150bc4/20260703095408/az_nova_backup_97903bb1-73b7-48fa-91c9-1d233582fece-00005: 25e317773f308e446cc84c503a6d1f85 {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 09:54:11.279566 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-dfea9dbc-7092-4bd8-8c85-cce5defc0f2e tempest-ProjectMemberTests33-2105464604 None] Calling eventlet.sleep(0) {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 09:54:11.468183 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-64934804-7f51-4da7-8394-8f3f480fa1a0 tempest-VolumesBackupsTest-1484886458 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101319) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 09:54:11.468389 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-64934804-7f51-4da7-8394-8f3f480fa1a0 tempest-VolumesBackupsTest-1484886458 None] About to put_object {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 09:54:11.472053 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-dfea9dbc-7092-4bd8-8c85-cce5defc0f2e tempest-ProjectMemberTests33-2105464604 None] Backing up chunk of data from volume. {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 09:54:11.572129 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-64934804-7f51-4da7-8394-8f3f480fa1a0 tempest-VolumesBackupsTest-1484886458 None] backup MD5 for volume_b578d41f-4c6a-49b3-b5ec-bcd6556e2e68/20260703095405/az_nova_backup_44885c93-b853-422a-9a76-29c7e7bf3d8e-00011: 25e317773f308e446cc84c503a6d1f85 {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 09:54:11.572321 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-64934804-7f51-4da7-8394-8f3f480fa1a0 tempest-VolumesBackupsTest-1484886458 None] Calling eventlet.sleep(0) {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 09:54:11.723956 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-dfea9dbc-7092-4bd8-8c85-cce5defc0f2e tempest-ProjectMemberTests33-2105464604 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101319) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 09:54:11.724141 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-dfea9dbc-7092-4bd8-8c85-cce5defc0f2e tempest-ProjectMemberTests33-2105464604 None] About to put_object {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 09:54:11.763465 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-64934804-7f51-4da7-8394-8f3f480fa1a0 tempest-VolumesBackupsTest-1484886458 None] Backing up chunk of data from volume. {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 09:54:11.823973 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-dfea9dbc-7092-4bd8-8c85-cce5defc0f2e tempest-ProjectMemberTests33-2105464604 None] backup MD5 for volume_4883604b-dae6-422a-92df-ec0850150bc4/20260703095408/az_nova_backup_97903bb1-73b7-48fa-91c9-1d233582fece-00006: 25e317773f308e446cc84c503a6d1f85 {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 09:54:11.824198 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-dfea9dbc-7092-4bd8-8c85-cce5defc0f2e tempest-ProjectMemberTests33-2105464604 None] Calling eventlet.sleep(0) {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 09:54:12.007396 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-64934804-7f51-4da7-8394-8f3f480fa1a0 tempest-VolumesBackupsTest-1484886458 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101319) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 09:54:12.007841 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-64934804-7f51-4da7-8394-8f3f480fa1a0 tempest-VolumesBackupsTest-1484886458 None] About to put_object {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 09:54:12.011757 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-dfea9dbc-7092-4bd8-8c85-cce5defc0f2e tempest-ProjectMemberTests33-2105464604 None] Backing up chunk of data from volume. {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 09:54:12.107176 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-64934804-7f51-4da7-8394-8f3f480fa1a0 tempest-VolumesBackupsTest-1484886458 None] backup MD5 for volume_b578d41f-4c6a-49b3-b5ec-bcd6556e2e68/20260703095405/az_nova_backup_44885c93-b853-422a-9a76-29c7e7bf3d8e-00012: 25e317773f308e446cc84c503a6d1f85 {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 09:54:12.107333 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-64934804-7f51-4da7-8394-8f3f480fa1a0 tempest-VolumesBackupsTest-1484886458 None] Calling eventlet.sleep(0) {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 09:54:12.276230 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-dfea9dbc-7092-4bd8-8c85-cce5defc0f2e tempest-ProjectMemberTests33-2105464604 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101319) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 09:54:12.276877 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-dfea9dbc-7092-4bd8-8c85-cce5defc0f2e tempest-ProjectMemberTests33-2105464604 None] About to put_object {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 09:54:12.282180 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-64934804-7f51-4da7-8394-8f3f480fa1a0 tempest-VolumesBackupsTest-1484886458 None] Backing up chunk of data from volume. {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 09:54:12.383252 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-dfea9dbc-7092-4bd8-8c85-cce5defc0f2e tempest-ProjectMemberTests33-2105464604 None] backup MD5 for volume_4883604b-dae6-422a-92df-ec0850150bc4/20260703095408/az_nova_backup_97903bb1-73b7-48fa-91c9-1d233582fece-00007: 25e317773f308e446cc84c503a6d1f85 {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 09:54:12.384351 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-dfea9dbc-7092-4bd8-8c85-cce5defc0f2e tempest-ProjectMemberTests33-2105464604 None] Calling eventlet.sleep(0) {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 09:54:12.557881 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-64934804-7f51-4da7-8394-8f3f480fa1a0 tempest-VolumesBackupsTest-1484886458 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101319) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 09:54:12.558038 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-64934804-7f51-4da7-8394-8f3f480fa1a0 tempest-VolumesBackupsTest-1484886458 None] About to put_object {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 09:54:12.589161 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-dfea9dbc-7092-4bd8-8c85-cce5defc0f2e tempest-ProjectMemberTests33-2105464604 None] Backing up chunk of data from volume. {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 09:54:12.659984 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-64934804-7f51-4da7-8394-8f3f480fa1a0 tempest-VolumesBackupsTest-1484886458 None] backup MD5 for volume_b578d41f-4c6a-49b3-b5ec-bcd6556e2e68/20260703095405/az_nova_backup_44885c93-b853-422a-9a76-29c7e7bf3d8e-00013: 25e317773f308e446cc84c503a6d1f85 {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 09:54:12.660123 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-64934804-7f51-4da7-8394-8f3f480fa1a0 tempest-VolumesBackupsTest-1484886458 None] Calling eventlet.sleep(0) {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 09:54:12.842007 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-64934804-7f51-4da7-8394-8f3f480fa1a0 tempest-VolumesBackupsTest-1484886458 None] Backing up chunk of data from volume. {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 09:54:12.842440 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-dfea9dbc-7092-4bd8-8c85-cce5defc0f2e tempest-ProjectMemberTests33-2105464604 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101319) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 09:54:12.842614 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-dfea9dbc-7092-4bd8-8c85-cce5defc0f2e tempest-ProjectMemberTests33-2105464604 None] About to put_object {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 09:54:12.948778 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-dfea9dbc-7092-4bd8-8c85-cce5defc0f2e tempest-ProjectMemberTests33-2105464604 None] backup MD5 for volume_4883604b-dae6-422a-92df-ec0850150bc4/20260703095408/az_nova_backup_97903bb1-73b7-48fa-91c9-1d233582fece-00008: 25e317773f308e446cc84c503a6d1f85 {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 09:54:12.948987 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-dfea9dbc-7092-4bd8-8c85-cce5defc0f2e tempest-ProjectMemberTests33-2105464604 None] Calling eventlet.sleep(0) {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 09:54:13.096143 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-64934804-7f51-4da7-8394-8f3f480fa1a0 tempest-VolumesBackupsTest-1484886458 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101319) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 09:54:13.096889 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-64934804-7f51-4da7-8394-8f3f480fa1a0 tempest-VolumesBackupsTest-1484886458 None] About to put_object {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 09:54:13.160935 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-dfea9dbc-7092-4bd8-8c85-cce5defc0f2e tempest-ProjectMemberTests33-2105464604 None] Backing up chunk of data from volume. {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 09:54:13.214008 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-64934804-7f51-4da7-8394-8f3f480fa1a0 tempest-VolumesBackupsTest-1484886458 None] backup MD5 for volume_b578d41f-4c6a-49b3-b5ec-bcd6556e2e68/20260703095405/az_nova_backup_44885c93-b853-422a-9a76-29c7e7bf3d8e-00014: 25e317773f308e446cc84c503a6d1f85 {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 09:54:13.214209 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-64934804-7f51-4da7-8394-8f3f480fa1a0 tempest-VolumesBackupsTest-1484886458 None] Calling eventlet.sleep(0) {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 09:54:13.406030 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-dfea9dbc-7092-4bd8-8c85-cce5defc0f2e tempest-ProjectMemberTests33-2105464604 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101319) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 09:54:13.406192 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-dfea9dbc-7092-4bd8-8c85-cce5defc0f2e tempest-ProjectMemberTests33-2105464604 None] About to put_object {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 09:54:13.442539 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-64934804-7f51-4da7-8394-8f3f480fa1a0 tempest-VolumesBackupsTest-1484886458 None] Backing up chunk of data from volume. {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 09:54:13.510004 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-dfea9dbc-7092-4bd8-8c85-cce5defc0f2e tempest-ProjectMemberTests33-2105464604 None] backup MD5 for volume_4883604b-dae6-422a-92df-ec0850150bc4/20260703095408/az_nova_backup_97903bb1-73b7-48fa-91c9-1d233582fece-00009: 25e317773f308e446cc84c503a6d1f85 {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 09:54:13.510209 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-dfea9dbc-7092-4bd8-8c85-cce5defc0f2e tempest-ProjectMemberTests33-2105464604 None] Calling eventlet.sleep(0) {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 09:54:13.689777 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-dfea9dbc-7092-4bd8-8c85-cce5defc0f2e tempest-ProjectMemberTests33-2105464604 None] Backing up chunk of data from volume. {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 09:54:13.725865 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-64934804-7f51-4da7-8394-8f3f480fa1a0 tempest-VolumesBackupsTest-1484886458 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101319) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 09:54:13.726005 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-64934804-7f51-4da7-8394-8f3f480fa1a0 tempest-VolumesBackupsTest-1484886458 None] About to put_object {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 09:54:13.838304 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-64934804-7f51-4da7-8394-8f3f480fa1a0 tempest-VolumesBackupsTest-1484886458 None] backup MD5 for volume_b578d41f-4c6a-49b3-b5ec-bcd6556e2e68/20260703095405/az_nova_backup_44885c93-b853-422a-9a76-29c7e7bf3d8e-00015: 25e317773f308e446cc84c503a6d1f85 {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 09:54:13.838439 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-64934804-7f51-4da7-8394-8f3f480fa1a0 tempest-VolumesBackupsTest-1484886458 None] Calling eventlet.sleep(0) {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 09:54:14.001081 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-64934804-7f51-4da7-8394-8f3f480fa1a0 tempest-VolumesBackupsTest-1484886458 None] Backing up chunk of data from volume. {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 09:54:14.029226 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-dfea9dbc-7092-4bd8-8c85-cce5defc0f2e tempest-ProjectMemberTests33-2105464604 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101319) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 09:54:14.029432 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-dfea9dbc-7092-4bd8-8c85-cce5defc0f2e tempest-ProjectMemberTests33-2105464604 None] About to put_object {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 09:54:14.138684 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-dfea9dbc-7092-4bd8-8c85-cce5defc0f2e tempest-ProjectMemberTests33-2105464604 None] backup MD5 for volume_4883604b-dae6-422a-92df-ec0850150bc4/20260703095408/az_nova_backup_97903bb1-73b7-48fa-91c9-1d233582fece-00010: 25e317773f308e446cc84c503a6d1f85 {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 09:54:14.139100 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-dfea9dbc-7092-4bd8-8c85-cce5defc0f2e tempest-ProjectMemberTests33-2105464604 None] Calling eventlet.sleep(0) {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 09:54:14.269995 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-64934804-7f51-4da7-8394-8f3f480fa1a0 tempest-VolumesBackupsTest-1484886458 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101319) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 09:54:14.269995 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-64934804-7f51-4da7-8394-8f3f480fa1a0 tempest-VolumesBackupsTest-1484886458 None] About to put_object {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 09:54:14.337790 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-dfea9dbc-7092-4bd8-8c85-cce5defc0f2e tempest-ProjectMemberTests33-2105464604 None] Backing up chunk of data from volume. {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 09:54:14.390064 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-64934804-7f51-4da7-8394-8f3f480fa1a0 tempest-VolumesBackupsTest-1484886458 None] backup MD5 for volume_b578d41f-4c6a-49b3-b5ec-bcd6556e2e68/20260703095405/az_nova_backup_44885c93-b853-422a-9a76-29c7e7bf3d8e-00016: 25e317773f308e446cc84c503a6d1f85 {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 09:54:14.390254 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-64934804-7f51-4da7-8394-8f3f480fa1a0 tempest-VolumesBackupsTest-1484886458 None] Calling eventlet.sleep(0) {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 09:54:14.589337 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-64934804-7f51-4da7-8394-8f3f480fa1a0 tempest-VolumesBackupsTest-1484886458 None] Backing up chunk of data from volume. {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 09:54:14.591779 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-dfea9dbc-7092-4bd8-8c85-cce5defc0f2e tempest-ProjectMemberTests33-2105464604 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101319) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 09:54:14.591953 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-dfea9dbc-7092-4bd8-8c85-cce5defc0f2e tempest-ProjectMemberTests33-2105464604 None] About to put_object {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 09:54:14.694882 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-dfea9dbc-7092-4bd8-8c85-cce5defc0f2e tempest-ProjectMemberTests33-2105464604 None] backup MD5 for volume_4883604b-dae6-422a-92df-ec0850150bc4/20260703095408/az_nova_backup_97903bb1-73b7-48fa-91c9-1d233582fece-00011: 25e317773f308e446cc84c503a6d1f85 {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 09:54:14.695131 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-dfea9dbc-7092-4bd8-8c85-cce5defc0f2e tempest-ProjectMemberTests33-2105464604 None] Calling eventlet.sleep(0) {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 09:54:14.830970 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-64934804-7f51-4da7-8394-8f3f480fa1a0 tempest-VolumesBackupsTest-1484886458 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101319) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 09:54:14.830970 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-64934804-7f51-4da7-8394-8f3f480fa1a0 tempest-VolumesBackupsTest-1484886458 None] About to put_object {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 09:54:14.898045 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-dfea9dbc-7092-4bd8-8c85-cce5defc0f2e tempest-ProjectMemberTests33-2105464604 None] Backing up chunk of data from volume. {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 09:54:14.936395 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-64934804-7f51-4da7-8394-8f3f480fa1a0 tempest-VolumesBackupsTest-1484886458 None] backup MD5 for volume_b578d41f-4c6a-49b3-b5ec-bcd6556e2e68/20260703095405/az_nova_backup_44885c93-b853-422a-9a76-29c7e7bf3d8e-00017: 25e317773f308e446cc84c503a6d1f85 {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 09:54:14.936618 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-64934804-7f51-4da7-8394-8f3f480fa1a0 tempest-VolumesBackupsTest-1484886458 None] Calling eventlet.sleep(0) {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 09:54:15.119143 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-64934804-7f51-4da7-8394-8f3f480fa1a0 tempest-VolumesBackupsTest-1484886458 None] Backing up chunk of data from volume. {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 09:54:15.157437 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-dfea9dbc-7092-4bd8-8c85-cce5defc0f2e tempest-ProjectMemberTests33-2105464604 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101319) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 09:54:15.158018 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-dfea9dbc-7092-4bd8-8c85-cce5defc0f2e tempest-ProjectMemberTests33-2105464604 None] About to put_object {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 09:54:15.259759 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-dfea9dbc-7092-4bd8-8c85-cce5defc0f2e tempest-ProjectMemberTests33-2105464604 None] backup MD5 for volume_4883604b-dae6-422a-92df-ec0850150bc4/20260703095408/az_nova_backup_97903bb1-73b7-48fa-91c9-1d233582fece-00012: 25e317773f308e446cc84c503a6d1f85 {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 09:54:15.259991 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-dfea9dbc-7092-4bd8-8c85-cce5defc0f2e tempest-ProjectMemberTests33-2105464604 None] Calling eventlet.sleep(0) {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 09:54:15.374390 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-64934804-7f51-4da7-8394-8f3f480fa1a0 tempest-VolumesBackupsTest-1484886458 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101319) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 09:54:15.374390 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-64934804-7f51-4da7-8394-8f3f480fa1a0 tempest-VolumesBackupsTest-1484886458 None] About to put_object {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 09:54:15.473577 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-dfea9dbc-7092-4bd8-8c85-cce5defc0f2e tempest-ProjectMemberTests33-2105464604 None] Backing up chunk of data from volume. {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 09:54:15.481178 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-64934804-7f51-4da7-8394-8f3f480fa1a0 tempest-VolumesBackupsTest-1484886458 None] backup MD5 for volume_b578d41f-4c6a-49b3-b5ec-bcd6556e2e68/20260703095405/az_nova_backup_44885c93-b853-422a-9a76-29c7e7bf3d8e-00018: 25e317773f308e446cc84c503a6d1f85 {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 09:54:15.481178 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-64934804-7f51-4da7-8394-8f3f480fa1a0 tempest-VolumesBackupsTest-1484886458 None] Calling eventlet.sleep(0) {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 09:54:15.676948 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-64934804-7f51-4da7-8394-8f3f480fa1a0 tempest-VolumesBackupsTest-1484886458 None] Backing up chunk of data from volume. {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 09:54:15.737196 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-dfea9dbc-7092-4bd8-8c85-cce5defc0f2e tempest-ProjectMemberTests33-2105464604 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101319) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 09:54:15.737196 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-dfea9dbc-7092-4bd8-8c85-cce5defc0f2e tempest-ProjectMemberTests33-2105464604 None] About to put_object {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 09:54:15.884983 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-dfea9dbc-7092-4bd8-8c85-cce5defc0f2e tempest-ProjectMemberTests33-2105464604 None] backup MD5 for volume_4883604b-dae6-422a-92df-ec0850150bc4/20260703095408/az_nova_backup_97903bb1-73b7-48fa-91c9-1d233582fece-00013: 25e317773f308e446cc84c503a6d1f85 {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 09:54:15.884983 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-dfea9dbc-7092-4bd8-8c85-cce5defc0f2e tempest-ProjectMemberTests33-2105464604 None] Calling eventlet.sleep(0) {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 09:54:15.926199 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-64934804-7f51-4da7-8394-8f3f480fa1a0 tempest-VolumesBackupsTest-1484886458 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101319) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 09:54:15.926988 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-64934804-7f51-4da7-8394-8f3f480fa1a0 tempest-VolumesBackupsTest-1484886458 None] About to put_object {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 09:54:16.028174 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-64934804-7f51-4da7-8394-8f3f480fa1a0 tempest-VolumesBackupsTest-1484886458 None] backup MD5 for volume_b578d41f-4c6a-49b3-b5ec-bcd6556e2e68/20260703095405/az_nova_backup_44885c93-b853-422a-9a76-29c7e7bf3d8e-00019: 25e317773f308e446cc84c503a6d1f85 {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 09:54:16.030084 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-64934804-7f51-4da7-8394-8f3f480fa1a0 tempest-VolumesBackupsTest-1484886458 None] Calling eventlet.sleep(0) {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 09:54:16.072917 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-dfea9dbc-7092-4bd8-8c85-cce5defc0f2e tempest-ProjectMemberTests33-2105464604 None] Backing up chunk of data from volume. {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 09:54:16.218909 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-64934804-7f51-4da7-8394-8f3f480fa1a0 tempest-VolumesBackupsTest-1484886458 None] Backing up chunk of data from volume. {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 09:54:16.320993 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-dfea9dbc-7092-4bd8-8c85-cce5defc0f2e tempest-ProjectMemberTests33-2105464604 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101319) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 09:54:16.321777 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-dfea9dbc-7092-4bd8-8c85-cce5defc0f2e tempest-ProjectMemberTests33-2105464604 None] About to put_object {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 09:54:16.425321 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-dfea9dbc-7092-4bd8-8c85-cce5defc0f2e tempest-ProjectMemberTests33-2105464604 None] backup MD5 for volume_4883604b-dae6-422a-92df-ec0850150bc4/20260703095408/az_nova_backup_97903bb1-73b7-48fa-91c9-1d233582fece-00014: 25e317773f308e446cc84c503a6d1f85 {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 09:54:16.425452 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-dfea9dbc-7092-4bd8-8c85-cce5defc0f2e tempest-ProjectMemberTests33-2105464604 None] Calling eventlet.sleep(0) {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 09:54:16.465681 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-64934804-7f51-4da7-8394-8f3f480fa1a0 tempest-VolumesBackupsTest-1484886458 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101319) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 09:54:16.465838 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-64934804-7f51-4da7-8394-8f3f480fa1a0 tempest-VolumesBackupsTest-1484886458 None] About to put_object {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 09:54:16.572244 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-64934804-7f51-4da7-8394-8f3f480fa1a0 tempest-VolumesBackupsTest-1484886458 None] backup MD5 for volume_b578d41f-4c6a-49b3-b5ec-bcd6556e2e68/20260703095405/az_nova_backup_44885c93-b853-422a-9a76-29c7e7bf3d8e-00020: 25e317773f308e446cc84c503a6d1f85 {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 09:54:16.572501 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-64934804-7f51-4da7-8394-8f3f480fa1a0 tempest-VolumesBackupsTest-1484886458 None] Calling eventlet.sleep(0) {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 09:54:16.624958 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-dfea9dbc-7092-4bd8-8c85-cce5defc0f2e tempest-ProjectMemberTests33-2105464604 None] Backing up chunk of data from volume. {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 09:54:16.676149 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-64934804-7f51-4da7-8394-8f3f480fa1a0 tempest-VolumesBackupsTest-1484886458 None] Backing up chunk of data from volume. {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 09:54:16.790958 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-64934804-7f51-4da7-8394-8f3f480fa1a0 tempest-VolumesBackupsTest-1484886458 None] Compressed 25165824 bytes of data to 24470 bytes using zlib. {{(pid=101319) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 09:54:16.791167 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-64934804-7f51-4da7-8394-8f3f480fa1a0 tempest-VolumesBackupsTest-1484886458 None] About to put_object {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 09:54:16.850425 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-64934804-7f51-4da7-8394-8f3f480fa1a0 tempest-VolumesBackupsTest-1484886458 None] backup MD5 for volume_b578d41f-4c6a-49b3-b5ec-bcd6556e2e68/20260703095405/az_nova_backup_44885c93-b853-422a-9a76-29c7e7bf3d8e-00021: 77377273b0a4b61febdbf7bbf52b9db9 {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 09:54:16.850586 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-64934804-7f51-4da7-8394-8f3f480fa1a0 tempest-VolumesBackupsTest-1484886458 None] Calling eventlet.sleep(0) {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 09:54:16.856501 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.driver [None req-64934804-7f51-4da7-8394-8f3f480fa1a0 tempest-VolumesBackupsTest-1484886458 None] Getting metadata type 'volume-base-metadata' {{(pid=101319) _save_vol_base_meta /opt/stack/cinder/cinder/backup/driver.py:79}} Jul 03 09:54:16.862083 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.driver [None req-64934804-7f51-4da7-8394-8f3f480fa1a0 tempest-VolumesBackupsTest-1484886458 None] Completed fetching metadata type 'volume-base-metadata' {{(pid=101319) _save_vol_base_meta /opt/stack/cinder/cinder/backup/driver.py:98}} Jul 03 09:54:16.862083 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.driver [None req-64934804-7f51-4da7-8394-8f3f480fa1a0 tempest-VolumesBackupsTest-1484886458 None] Getting metadata type 'volume-metadata' {{(pid=101319) _save_vol_meta /opt/stack/cinder/cinder/backup/driver.py:109}} Jul 03 09:54:16.865339 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.driver [None req-64934804-7f51-4da7-8394-8f3f480fa1a0 tempest-VolumesBackupsTest-1484886458 None] No metadata type 'volume-metadata' available {{(pid=101319) _save_vol_meta /opt/stack/cinder/cinder/backup/driver.py:123}} Jul 03 09:54:16.865486 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.driver [None req-64934804-7f51-4da7-8394-8f3f480fa1a0 tempest-VolumesBackupsTest-1484886458 None] Getting metadata type 'volume-glance-metadata' {{(pid=101319) _save_vol_glance_meta /opt/stack/cinder/cinder/backup/driver.py:132}} Jul 03 09:54:16.868273 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-dfea9dbc-7092-4bd8-8c85-cce5defc0f2e tempest-ProjectMemberTests33-2105464604 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101319) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 09:54:16.868396 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-dfea9dbc-7092-4bd8-8c85-cce5defc0f2e tempest-ProjectMemberTests33-2105464604 None] About to put_object {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 09:54:16.868776 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.driver [None req-64934804-7f51-4da7-8394-8f3f480fa1a0 tempest-VolumesBackupsTest-1484886458 None] No metadata type 'volume-glance-metadata' available {{(pid=101319) _save_vol_glance_meta /opt/stack/cinder/cinder/backup/driver.py:147}} Jul 03 09:54:16.869014 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-64934804-7f51-4da7-8394-8f3f480fa1a0 tempest-VolumesBackupsTest-1484886458 None] _write_sha256file started, container name: volumebackups, sha256file filename: volume_b578d41f-4c6a-49b3-b5ec-bcd6556e2e68/20260703095405/az_nova_backup_44885c93-b853-422a-9a76-29c7e7bf3d8e_sha256file. {{(pid=101319) _write_sha256file /opt/stack/cinder/cinder/backup/chunkeddriver.py:299}} Jul 03 09:54:16.924258 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-64934804-7f51-4da7-8394-8f3f480fa1a0 tempest-VolumesBackupsTest-1484886458 None] _write_sha256file finished. {{(pid=101319) _write_sha256file /opt/stack/cinder/cinder/backup/chunkeddriver.py:315}} Jul 03 09:54:16.924972 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-64934804-7f51-4da7-8394-8f3f480fa1a0 tempest-VolumesBackupsTest-1484886458 None] _write_metadata started, container name: volumebackups, metadata filename: volume_b578d41f-4c6a-49b3-b5ec-bcd6556e2e68/20260703095405/az_nova_backup_44885c93-b853-422a-9a76-29c7e7bf3d8e_metadata. {{(pid=101319) _write_metadata /opt/stack/cinder/cinder/backup/chunkeddriver.py:276}} Jul 03 09:54:16.955566 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-64934804-7f51-4da7-8394-8f3f480fa1a0 tempest-VolumesBackupsTest-1484886458 None] _write_metadata finished. Metadata: b'{\n "backup_description": null,\n "backup_id": "44885c93-b853-422a-9a76-29c7e7bf3d8e",\n "backup_name": "tempest-VolumesBackupsTest-Backup-1842688753",\n "created_at": "2026-07-03 09:54:02+00:00",\n "objects": [\n {\n "volume_b578d41f-4c6a-49b3-b5ec-bcd6556e2e68/20260703095405/az_nova_backup_44885c93-b853-422a-9a76-29c7e7bf3d8e-00001": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 0\n }\n },\n {\n "volume_b578d41f-4c6a-49b3-b5ec-bcd6556e2e68/20260703095405/az_nova_backup_44885c93-b853-422a-9a76-29c7e7bf3d8e-00002": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 52428800\n }\n },\n {\n "volume_b578d41f-4c6a-49b3-b5ec-bcd6556e2e68/20260703095405/az_nova_backup_44885c93-b853-422a-9a76-29c7e7bf3d8e-00003": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 104857600\n }\n },\n {\n "volume_b578d41f-4c6a-49b3-b5ec-bcd6556e2e68/20260703095405/az_nova_backup_44885c93-b853-422a-9a76-29c7e7bf3d8e-00004": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 157286400\n }\n },\n {\n "volume_b578d41f-4c6a-49b3-b5ec-bcd6556e2e68/20260703095405/az_nova_backup_44885c93-b853-422a-9a76-29c7e7bf3d8e-00005": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 209715200\n }\n },\n {\n "volume_b578d41f-4c6a-49b3-b5ec-bcd6556e2e68/20260703095405/az_nova_backup_44885c93-b853-422a-9a76-29c7e7bf3d8e-00006": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 262144000\n }\n },\n {\n "volume_b578d41f-4c6a-49b3-b5ec-bcd6556e2e68/20260703095405/az_nova_backup_44885c93-b853-422a-9a76-29c7e7bf3d8e-00007": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 314572800\n }\n },\n {\n "volume_b578d41f-4c6a-49b3-b5ec-bcd6556e2e68/20260703095405/az_nova_backup_44885c93-b853-422a-9a76-29c7e7bf3d8e-00008": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 367001600\n }\n },\n {\n "volume_b578d41f-4c6a-49b3-b5ec-bcd6556e2e68/20260703095405/az_nova_backup_44885c93-b853-422a-9a76-29c7e7bf3d8e-00009": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 419430400\n }\n },\n {\n "volume_b578d41f-4c6a-49b3-b5ec-bcd6556e2e68/20260703095405/az_nova_backup_44885c93-b853-422a-9a76-29c7e7bf3d8e-00010": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 471859200\n }\n },\n {\n "volume_b578d41f-4c6a-49b3-b5ec-bcd6556e2e68/20260703095405/az_nova_backup_44885c93-b853-422a-9a76-29c7e7bf3d8e-00011": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 524288000\n }\n },\n {\n "volume_b578d41f-4c6a-49b3-b5ec-bcd6556e2e68/20260703095405/az_nova_backup_44885c93-b853-422a-9a76-29c7e7bf3d8e-00012": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 576716800\n }\n },\n {\n "volume_b578d41f-4c6a-49b3-b5ec-bcd6556e2e68/20260703095405/az_nova_backup_44885c93-b853-422a-9a76-29c7e7bf3d8e-00013": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 629145600\n }\n },\n {\n "volume_b578d41f-4c6a-49b3-b5ec-bcd6556e2e68/20260703095405/az_nova_backup_44885c93-b853-422a-9a76-29c7e7bf3d8e-00014": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 681574400\n }\n },\n {\n "volume_b578d41f-4c6a-49b3-b5ec-bcd6556e2e68/20260703095405/az_nova_backup_44885c93-b853-422a-9a76-29c7e7bf3d8e-00015": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 734003200\n }\n },\n {\n "volume_b578d41f-4c6a-49b3-b5ec-bcd6556e2e68/20260703095405/az_nova_backup_44885c93-b853-422a-9a76-29c7e7bf3d8e-00016": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 786432000\n }\n },\n {\n "volume_b578d41f-4c6a-49b3-b5ec-bcd6556e2e68/20260703095405/az_nova_backup_44885c93-b853-422a-9a76-29c7e7bf3d8e-00017": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 838860800\n }\n },\n {\n "volume_b578d41f-4c6a-49b3-b5ec-bcd6556e2e68/20260703095405/az_nova_backup_44885c93-b853-422a-9a76-29c7e7bf3d8e-00018": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 891289600\n }\n },\n {\n "volume_b578d41f-4c6a-49b3-b5ec-bcd6556e2e68/20260703095405/az_nova_backup_44885c93-b853-422a-9a76-29c7e7bf3d8e-00019": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 943718400\n }\n },\n {\n "volume_b578d41f-4c6a-49b3-b5ec-bcd6556e2e68/20260703095405/az_nova_backup_44885c93-b853-422a-9a76-29c7e7bf3d8e-00020": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 996147200\n }\n },\n {\n "volume_b578d41f-4c6a-49b3-b5ec-bcd6556e2e68/20260703095405/az_nova_backup_44885c93-b853-422a-9a76-29c7e7bf3d8e-00021": {\n "compression": "zlib",\n "length": 25165824,\n "md5": "77377273b0a4b61febdbf7bbf52b9db9",\n "offset": 1048576000\n }\n }\n ],\n "parent_id": null,\n "version": "1.0.0",\n "volume_id": "b578d41f-4c6a-49b3-b5ec-bcd6556e2e68",\n "volume_meta": "{\\"version\\": 2, \\"volume-base-metadata\\": {\\"id\\": \\"b578d41f-4c6a-49b3-b5ec-bcd6556e2e68\\", \\"_name_id\\": null, \\"use_quota\\": true, \\"ec2_id\\": null, \\"user_id\\": \\"e3b8ecc8212649f489f39b74eac8ff8f\\", \\"project_id\\": \\"c36863fd49104594b80b419fafd78f5c\\", \\"snapshot_id\\": null, \\"cluster_name\\": null, \\"host\\": \\"np0000004400@storpool#default\\", \\"size\\": 1, \\"availability_zone\\": \\"nova\\", \\"status\\": \\"backing-up\\", \\"attach_status\\": \\"detached\\", \\"migration_status\\": null, \\"scheduled_at\\": \\"2026-07-03T09:53:43.000000\\", \\"launched_at\\": \\"2026-07-03T09:53:43.000000\\", \\"terminated_at\\": null, \\"display_name\\": \\"tempest-VolumesBackupsTest-Volume-1091773389\\", \\"display_description\\": null, \\"provider_location\\": null, \\"provider_auth\\": null, \\"provider_geometry\\": null, \\"provider_id\\": null, \\"volume_type_id\\": \\"03e13fe6-0e30-4803-ace0-725d38e6dc24\\", \\"source_volid\\": null, \\"encryption_key_id\\": null, \\"consistencygroup_id\\": null, \\"group_id\\": null, \\"bootable\\": false, \\"multiattach\\": false, \\"replication_status\\": null, \\"replication_extended_status\\": null, \\"replication_driver_data\\": null, \\"previous_status\\": \\"available\\", \\"service_uuid\\": \\"6d4b0e79-fefe-4744-b25f-34be05095200\\", \\"shared_targets\\": true, \\"deleted_at\\": null, \\"deleted\\": false, \\"created_at\\": \\"2026-07-03T09:53:43.000000\\", \\"updated_at\\": \\"2026-07-03T09:54:02.000000\\"}}"\n}'. {{(pid=101319) _write_metadata /opt/stack/cinder/cinder/backup/chunkeddriver.py:295}} Jul 03 09:54:16.960185 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-64934804-7f51-4da7-8394-8f3f480fa1a0 tempest-VolumesBackupsTest-1484886458 None] backup 44885c93-b853-422a-9a76-29c7e7bf3d8e finished. {{(pid=101319) _finalize_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:462}} Jul 03 09:54:17.086953 np0000004400 cinder-backup[101319]: DEBUG oslo_concurrency.processutils [None req-64934804-7f51-4da7-8394-8f3f480fa1a0 tempest-VolumesBackupsTest-1484886458 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chown 0 /dev/sdb {{(pid=101319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 09:54:17.095214 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-dfea9dbc-7092-4bd8-8c85-cce5defc0f2e tempest-ProjectMemberTests33-2105464604 None] backup MD5 for volume_4883604b-dae6-422a-92df-ec0850150bc4/20260703095408/az_nova_backup_97903bb1-73b7-48fa-91c9-1d233582fece-00015: 25e317773f308e446cc84c503a6d1f85 {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 09:54:17.095437 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-dfea9dbc-7092-4bd8-8c85-cce5defc0f2e tempest-ProjectMemberTests33-2105464604 None] Calling eventlet.sleep(0) {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 09:54:17.107899 np0000004400 sudo[155938]: stack : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chown 0 /dev/sdb Jul 03 09:54:17.108632 np0000004400 sudo[155938]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1002) Jul 03 09:54:17.304107 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-dfea9dbc-7092-4bd8-8c85-cce5defc0f2e tempest-ProjectMemberTests33-2105464604 None] Backing up chunk of data from volume. {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 09:54:17.428957 np0000004400 sudo[155938]: pam_unix(sudo:session): session closed for user root Jul 03 09:54:17.430736 np0000004400 cinder-backup[101319]: DEBUG oslo_concurrency.processutils [None req-64934804-7f51-4da7-8394-8f3f480fa1a0 tempest-VolumesBackupsTest-1484886458 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chown 0 /dev/sdb" returned: 0 in 0.344s {{(pid=101319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 09:54:17.431269 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-64934804-7f51-4da7-8394-8f3f480fa1a0 tempest-VolumesBackupsTest-1484886458 None] ==> disconnect_volume: call "{'args': (, {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-b578d41f-4c6a-49b3-b5ec-bcd6556e2e68', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'b578d41f-4c6a-49b3-b5ec-bcd6556e2e68', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': False}, {'type': 'block', 'scsi_wwn': 'SStorPool_iSCSI_DISK_1034578903445799236', 'path': '/dev/sdb'}), 'kwargs': {'force': True, 'ignore_errors': True}}" {{(pid=101319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}} Jul 03 09:54:17.431469 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.base [None req-64934804-7f51-4da7-8394-8f3f480fa1a0 tempest-VolumesBackupsTest-1484886458 None] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=101319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jul 03 09:54:17.431920 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.base [None req-64934804-7f51-4da7-8394-8f3f480fa1a0 tempest-VolumesBackupsTest-1484886458 None] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=101319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jul 03 09:54:17.432289 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-64934804-7f51-4da7-8394-8f3f480fa1a0 tempest-VolumesBackupsTest-1484886458 None] _get_connection_devices called with parameters: connection_properties={'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-b578d41f-4c6a-49b3-b5ec-bcd6556e2e68', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'b578d41f-4c6a-49b3-b5ec-bcd6556e2e68', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': False}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=101319) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:847}} Jul 03 09:54:17.442650 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-64934804-7f51-4da7-8394-8f3f480fa1a0 tempest-VolumesBackupsTest-1484886458 None] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS: Jul 03 09:54:17.442650 np0000004400 cinder-backup[101319]: No targets found. Jul 03 09:54:17.442650 np0000004400 cinder-backup[101319]: iSNS: Jul 03 09:54:17.442650 np0000004400 cinder-backup[101319]: No targets found. Jul 03 09:54:17.442650 np0000004400 cinder-backup[101319]: STATIC: Jul 03 09:54:17.442650 np0000004400 cinder-backup[101319]: Target: iqn.2023-03.storpool.com:os--volume-b578d41f-4c6a-49b3-b5ec-bcd6556e2e68 Jul 03 09:54:17.442650 np0000004400 cinder-backup[101319]: Portal: 192.168.40.100:3260,-1 Jul 03 09:54:17.442650 np0000004400 cinder-backup[101319]: Iface Name: default Jul 03 09:54:17.442650 np0000004400 cinder-backup[101319]: Target: iqn.2023-03.storpool.com:os--volume-4883604b-dae6-422a-92df-ec0850150bc4 Jul 03 09:54:17.442650 np0000004400 cinder-backup[101319]: Portal: 192.168.40.100:3260,-1 Jul 03 09:54:17.442650 np0000004400 cinder-backup[101319]: Iface Name: default Jul 03 09:54:17.442650 np0000004400 cinder-backup[101319]: Target: iqn.2023-03.storpool.com:os--volume-789ec59e-ea87-4784-8990-156a35276b5f Jul 03 09:54:17.442650 np0000004400 cinder-backup[101319]: Portal: 192.168.50.100:3260,-1 Jul 03 09:54:17.442650 np0000004400 cinder-backup[101319]: Iface Name: default Jul 03 09:54:17.442650 np0000004400 cinder-backup[101319]: Portal: 192.168.40.100:3260,-1 Jul 03 09:54:17.442650 np0000004400 cinder-backup[101319]: Iface Name: default Jul 03 09:54:17.442650 np0000004400 cinder-backup[101319]: FIRMWARE: Jul 03 09:54:17.442650 np0000004400 cinder-backup[101319]: No targets found. Jul 03 09:54:17.442650 np0000004400 cinder-backup[101319]: stderr= {{(pid=101319) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jul 03 09:54:17.443043 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-64934804-7f51-4da7-8394-8f3f480fa1a0 tempest-VolumesBackupsTest-1484886458 None] Regex to get portals from discoverydb: ^SENDTARGETS: Jul 03 09:54:17.443043 np0000004400 cinder-backup[101319]: .*?^DiscoveryAddress: 192.168.40.100,3260.*? Jul 03 09:54:17.443043 np0000004400 cinder-backup[101319]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=101319) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:390}} Jul 03 09:54:17.443179 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-64934804-7f51-4da7-8394-8f3f480fa1a0 tempest-VolumesBackupsTest-1484886458 None] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-b578d41f-4c6a-49b3-b5ec-bcd6556e2e68', 0)] {{(pid=101319) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:858}} Jul 03 09:54:17.464388 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-64934804-7f51-4da7-8394-8f3f480fa1a0 tempest-VolumesBackupsTest-1484886458 None] iscsiadm ('-m', 'session'): stdout=tcp: [208] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-789ec59e-ea87-4784-8990-156a35276b5f (non-flash) Jul 03 09:54:17.464388 np0000004400 cinder-backup[101319]: tcp: [209] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-789ec59e-ea87-4784-8990-156a35276b5f (non-flash) Jul 03 09:54:17.464388 np0000004400 cinder-backup[101319]: tcp: [210] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b578d41f-4c6a-49b3-b5ec-bcd6556e2e68 (non-flash) Jul 03 09:54:17.464388 np0000004400 cinder-backup[101319]: tcp: [211] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-4883604b-dae6-422a-92df-ec0850150bc4 (non-flash) Jul 03 09:54:17.464388 np0000004400 cinder-backup[101319]: stderr= {{(pid=101319) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jul 03 09:54:17.464743 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-64934804-7f51-4da7-8394-8f3f480fa1a0 tempest-VolumesBackupsTest-1484886458 None] iscsi session list stdout=tcp: [208] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-789ec59e-ea87-4784-8990-156a35276b5f (non-flash) Jul 03 09:54:17.464743 np0000004400 cinder-backup[101319]: tcp: [209] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-789ec59e-ea87-4784-8990-156a35276b5f (non-flash) Jul 03 09:54:17.464743 np0000004400 cinder-backup[101319]: tcp: [210] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b578d41f-4c6a-49b3-b5ec-bcd6556e2e68 (non-flash) Jul 03 09:54:17.464743 np0000004400 cinder-backup[101319]: tcp: [211] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-4883604b-dae6-422a-92df-ec0850150bc4 (non-flash) Jul 03 09:54:17.464743 np0000004400 cinder-backup[101319]: stderr= {{(pid=101319) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jul 03 09:54:17.464903 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-64934804-7f51-4da7-8394-8f3f480fa1a0 tempest-VolumesBackupsTest-1484886458 None] Sessions list: [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-789ec59e-ea87-4784-8990-156a35276b5f', '208'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-789ec59e-ea87-4784-8990-156a35276b5f', '209'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-b578d41f-4c6a-49b3-b5ec-bcd6556e2e68', '210'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-4883604b-dae6-422a-92df-ec0850150bc4', '211')] {{(pid=101319) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:866}} Jul 03 09:54:17.465078 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-64934804-7f51-4da7-8394-8f3f480fa1a0 tempest-VolumesBackupsTest-1484886458 None] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-b578d41f-4c6a-49b3-b5ec-bcd6556e2e68, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-b578d41f-4c6a-49b3-b5ec-bcd6556e2e68', '210')] {{(pid=101319) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}} Jul 03 09:54:17.466193 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-64934804-7f51-4da7-8394-8f3f480fa1a0 tempest-VolumesBackupsTest-1484886458 None] Resulting device map defaultdict(. at 0x7e76e6d319e0>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-b578d41f-4c6a-49b3-b5ec-bcd6556e2e68'): ({'sdb'}, set())}) {{(pid=101319) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:912}} Jul 03 09:54:17.466476 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.linuxscsi [None req-64934804-7f51-4da7-8394-8f3f480fa1a0 tempest-VolumesBackupsTest-1484886458 None] Removing single pathed devices sdb {{(pid=101319) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}} Jul 03 09:54:17.475790 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.linuxscsi [None req-64934804-7f51-4da7-8394-8f3f480fa1a0 tempest-VolumesBackupsTest-1484886458 None] Flushing IO for device /dev/sdb {{(pid=101319) flush_device_io /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:461}} Jul 03 09:54:17.483052 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.linuxscsi [None req-64934804-7f51-4da7-8394-8f3f480fa1a0 tempest-VolumesBackupsTest-1484886458 None] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=101319) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}} Jul 03 09:54:17.531844 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.linuxscsi [None req-64934804-7f51-4da7-8394-8f3f480fa1a0 tempest-VolumesBackupsTest-1484886458 None] Checking to see if SCSI volumes sdb have been removed. {{(pid=101319) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}} Jul 03 09:54:17.532121 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.linuxscsi [None req-64934804-7f51-4da7-8394-8f3f480fa1a0 tempest-VolumesBackupsTest-1484886458 None] SCSI volumes sdb have been removed. {{(pid=101319) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}} Jul 03 09:54:17.533308 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.linuxscsi [None req-64934804-7f51-4da7-8394-8f3f480fa1a0 tempest-VolumesBackupsTest-1484886458 None] Checking to see if device paths {'sdb'} are still under multipathd monitoring {{(pid=101319) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}} Jul 03 09:54:17.542166 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.linuxscsi [None req-64934804-7f51-4da7-8394-8f3f480fa1a0 tempest-VolumesBackupsTest-1484886458 None] Device paths {'sdb'} have been removed from multipathd monitoring. {{(pid=101319) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}} Jul 03 09:54:17.542491 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-64934804-7f51-4da7-8394-8f3f480fa1a0 tempest-VolumesBackupsTest-1484886458 None] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-b578d41f-4c6a-49b3-b5ec-bcd6556e2e68')] {{(pid=101319) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1225}} Jul 03 09:54:17.550492 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-dfea9dbc-7092-4bd8-8c85-cce5defc0f2e tempest-ProjectMemberTests33-2105464604 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101319) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 09:54:17.550686 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-dfea9dbc-7092-4bd8-8c85-cce5defc0f2e tempest-ProjectMemberTests33-2105464604 None] About to put_object {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 09:54:17.552840 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-64934804-7f51-4da7-8394-8f3f480fa1a0 tempest-VolumesBackupsTest-1484886458 None] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=101319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 03 09:54:17.586144 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-64934804-7f51-4da7-8394-8f3f480fa1a0 tempest-VolumesBackupsTest-1484886458 None] iscsiadm ('--logout',): stdout=Logging out of session [sid: 210, target: iqn.2023-03.storpool.com:os--volume-b578d41f-4c6a-49b3-b5ec-bcd6556e2e68, portal: 192.168.40.100,3260] Jul 03 09:54:17.586144 np0000004400 cinder-backup[101319]: Logout of [sid: 210, target: iqn.2023-03.storpool.com:os--volume-b578d41f-4c6a-49b3-b5ec-bcd6556e2e68, portal: 192.168.40.100,3260] successful. Jul 03 09:54:17.586144 np0000004400 cinder-backup[101319]: stderr= {{(pid=101319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 03 09:54:17.597672 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-64934804-7f51-4da7-8394-8f3f480fa1a0 tempest-VolumesBackupsTest-1484886458 None] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=101319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 03 09:54:17.597866 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.base [None req-64934804-7f51-4da7-8394-8f3f480fa1a0 tempest-VolumesBackupsTest-1484886458 None] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.166s {{(pid=101319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jul 03 09:54:17.598026 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-64934804-7f51-4da7-8394-8f3f480fa1a0 tempest-VolumesBackupsTest-1484886458 None] <== disconnect_volume: return (166ms) None {{(pid=101319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}} Jul 03 09:54:17.657092 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-dfea9dbc-7092-4bd8-8c85-cce5defc0f2e tempest-ProjectMemberTests33-2105464604 None] backup MD5 for volume_4883604b-dae6-422a-92df-ec0850150bc4/20260703095408/az_nova_backup_97903bb1-73b7-48fa-91c9-1d233582fece-00016: 25e317773f308e446cc84c503a6d1f85 {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 09:54:17.657315 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-dfea9dbc-7092-4bd8-8c85-cce5defc0f2e tempest-ProjectMemberTests33-2105464604 None] Calling eventlet.sleep(0) {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 09:54:17.847263 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-dfea9dbc-7092-4bd8-8c85-cce5defc0f2e tempest-ProjectMemberTests33-2105464604 None] Backing up chunk of data from volume. {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 09:54:18.090389 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-dfea9dbc-7092-4bd8-8c85-cce5defc0f2e tempest-ProjectMemberTests33-2105464604 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101319) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 09:54:18.090557 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-dfea9dbc-7092-4bd8-8c85-cce5defc0f2e tempest-ProjectMemberTests33-2105464604 None] About to put_object {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 09:54:18.193133 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-dfea9dbc-7092-4bd8-8c85-cce5defc0f2e tempest-ProjectMemberTests33-2105464604 None] backup MD5 for volume_4883604b-dae6-422a-92df-ec0850150bc4/20260703095408/az_nova_backup_97903bb1-73b7-48fa-91c9-1d233582fece-00017: 25e317773f308e446cc84c503a6d1f85 {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 09:54:18.193332 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-dfea9dbc-7092-4bd8-8c85-cce5defc0f2e tempest-ProjectMemberTests33-2105464604 None] Calling eventlet.sleep(0) {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 09:54:18.376372 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-dfea9dbc-7092-4bd8-8c85-cce5defc0f2e tempest-ProjectMemberTests33-2105464604 None] Backing up chunk of data from volume. {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 09:54:18.615729 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-dfea9dbc-7092-4bd8-8c85-cce5defc0f2e tempest-ProjectMemberTests33-2105464604 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101319) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 09:54:18.615882 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-dfea9dbc-7092-4bd8-8c85-cce5defc0f2e tempest-ProjectMemberTests33-2105464604 None] About to put_object {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 09:54:18.617641 np0000004400 cinder-backup[101319]: INFO cinder.backup.manager [None req-64934804-7f51-4da7-8394-8f3f480fa1a0 tempest-VolumesBackupsTest-1484886458 None] Create backup finished. backup: 44885c93-b853-422a-9a76-29c7e7bf3d8e. Jul 03 09:54:18.715544 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-dfea9dbc-7092-4bd8-8c85-cce5defc0f2e tempest-ProjectMemberTests33-2105464604 None] backup MD5 for volume_4883604b-dae6-422a-92df-ec0850150bc4/20260703095408/az_nova_backup_97903bb1-73b7-48fa-91c9-1d233582fece-00018: 25e317773f308e446cc84c503a6d1f85 {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 09:54:18.715745 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-dfea9dbc-7092-4bd8-8c85-cce5defc0f2e tempest-ProjectMemberTests33-2105464604 None] Calling eventlet.sleep(0) {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 09:54:18.895337 np0000004400 cinder-backup[101319]: INFO cinder.backup.manager [None req-d869df1e-3dd0-4fc0-a37e-463bdac92c90 tempest-VolumesBackupsTest-807180270 None] Create backup started, backup: ab559f16-a070-4b18-9c05-f0f3a1985361 volume: b578d41f-4c6a-49b3-b5ec-bcd6556e2e68. Jul 03 09:54:18.904457 np0000004400 cinder-backup[101319]: INFO cinder.backup.manager [None req-d869df1e-3dd0-4fc0-a37e-463bdac92c90 tempest-VolumesBackupsTest-807180270 None] Call Volume Manager to get_backup_device for Backup(availability_zone='nova',container=None,created_at=2026-07-03T09:54:18Z,data_timestamp=2026-07-03T09:54:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesBackupsTest-Backup-1022559932',encryption_key_id=None,fail_reason=None,host='np0000004400',id=ab559f16-a070-4b18-9c05-f0f3a1985361,metadata={},num_dependent_backups=0,object_count=0,parent=Backup(c52fbc4a-f7d8-49e2-bd92-5bbf2f7f98ba),parent_id='c52fbc4a-f7d8-49e2-bd92-5bbf2f7f98ba',project_id='298e794341b64951b3fb757bfbffa698',restore_volume_id=None,service='cinder.backup.drivers.swift.SwiftBackupDriver',service_metadata=None,size=1,snapshot_id=None,status='creating',temp_snapshot_id=None,temp_volume_id=None,updated_at=None,user_id='64183001da094a09a87a9669ab4f899d',volume_id=b578d41f-4c6a-49b3-b5ec-bcd6556e2e68) Jul 03 09:54:18.933147 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.drivers.swift [None req-d869df1e-3dd0-4fc0-a37e-463bdac92c90 tempest-VolumesBackupsTest-807180270 None] Using swift URL https://10.4.3.95:8080/v1/AUTH_298e794341b64951b3fb757bfbffa698 {{(pid=101319) initialize /opt/stack/cinder/cinder/backup/drivers/swift.py:300}} Jul 03 09:54:18.933342 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.drivers.swift [None req-d869df1e-3dd0-4fc0-a37e-463bdac92c90 tempest-VolumesBackupsTest-807180270 None] Connect to https://10.4.3.95:8080/v1/AUTH_ in "per_user" mode {{(pid=101319) initialize /opt/stack/cinder/cinder/backup/drivers/swift.py:301}} Jul 03 09:54:18.934104 np0000004400 cinder-backup[101319]: DEBUG os_brick.utils [None req-d869df1e-3dd0-4fc0-a37e-463bdac92c90 tempest-VolumesBackupsTest-807180270 None] ==> get_connector_properties: call "{'root_helper': 'sudo cinder-rootwrap /etc/cinder/rootwrap.conf', 'my_ip': '10.4.3.95', 'multipath': False, 'enforce_multipath': False, 'host': None, 'execute': None}" {{(pid=101319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}} Jul 03 09:54:18.946929 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.scaleio [None req-d869df1e-3dd0-4fc0-a37e-463bdac92c90 tempest-VolumesBackupsTest-807180270 None] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=101319) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}} Jul 03 09:54:18.954889 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-dfea9dbc-7092-4bd8-8c85-cce5defc0f2e tempest-ProjectMemberTests33-2105464604 None] Backing up chunk of data from volume. {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 09:54:18.968795 np0000004400 cinder-backup[101319]: DEBUG oslo_concurrency.processutils [None req-d869df1e-3dd0-4fc0-a37e-463bdac92c90 tempest-VolumesBackupsTest-807180270 None] Running cmd (subprocess): nvme version {{(pid=101319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 09:54:18.985496 np0000004400 cinder-backup[101319]: DEBUG oslo_concurrency.processutils [None req-d869df1e-3dd0-4fc0-a37e-463bdac92c90 tempest-VolumesBackupsTest-807180270 None] 'nvme version' failed. Not Retrying. {{(pid=101319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 03 09:54:18.986300 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.nvmeof [None req-d869df1e-3dd0-4fc0-a37e-463bdac92c90 tempest-VolumesBackupsTest-807180270 None] nvme not present on system {{(pid=101319) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}} Jul 03 09:54:18.995713 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.lightos [None req-d869df1e-3dd0-4fc0-a37e-463bdac92c90 tempest-VolumesBackupsTest-807180270 None] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=101319) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}} Jul 03 09:54:18.996842 np0000004400 cinder-backup[101319]: INFO os_brick.initiator.connectors.lightos [None req-d869df1e-3dd0-4fc0-a37e-463bdac92c90 tempest-VolumesBackupsTest-807180270 None] Current host hostNQN and IP(s) are ['10.4.3.95', 'fe80::f816:3eff:fe47:268c', '192.168.40.6', 'fe80::f816:3eff:febf:7be2', '192.168.50.6', 'fe80::f816:3eff:fe99:8914', '192.168.10.6', 'fe80::f816:3eff:fe2f:e696', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::bc9d:84ff:fec2:6b49', 'fe80::fc16:3eff:fec3:bd5f', 'fe80::8cea:42ff:fe99:b64a'] Jul 03 09:54:18.997059 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.lightos [None req-d869df1e-3dd0-4fc0-a37e-463bdac92c90 tempest-VolumesBackupsTest-807180270 None] LIGHTOS: did not find dsc, continuing anyway. {{(pid=101319) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}} Jul 03 09:54:18.997165 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.lightos [None req-d869df1e-3dd0-4fc0-a37e-463bdac92c90 tempest-VolumesBackupsTest-807180270 None] LIGHTOS: no hostnqn found. {{(pid=101319) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}} Jul 03 09:54:18.997502 np0000004400 cinder-backup[101319]: DEBUG os_brick.utils [None req-d869df1e-3dd0-4fc0-a37e-463bdac92c90 tempest-VolumesBackupsTest-807180270 None] <== get_connector_properties: return (62ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.95', 'host': 'np0000004400', 'multipath': False, 'enforce_multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:ae7e5bb0ebe6', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': '6b284368-d0ba-4d18-af6f-4998d3955c52', 'nvme_native_multipath': False} {{(pid=101319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}} Jul 03 09:54:19.209335 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-dfea9dbc-7092-4bd8-8c85-cce5defc0f2e tempest-ProjectMemberTests33-2105464604 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101319) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 09:54:19.209511 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-dfea9dbc-7092-4bd8-8c85-cce5defc0f2e tempest-ProjectMemberTests33-2105464604 None] About to put_object {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 09:54:19.313768 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-dfea9dbc-7092-4bd8-8c85-cce5defc0f2e tempest-ProjectMemberTests33-2105464604 None] backup MD5 for volume_4883604b-dae6-422a-92df-ec0850150bc4/20260703095408/az_nova_backup_97903bb1-73b7-48fa-91c9-1d233582fece-00019: 25e317773f308e446cc84c503a6d1f85 {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 09:54:19.314015 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-dfea9dbc-7092-4bd8-8c85-cce5defc0f2e tempest-ProjectMemberTests33-2105464604 None] Calling eventlet.sleep(0) {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 09:54:19.351457 np0000004400 cinder-backup[101319]: DEBUG oslo_db.sqlalchemy.engines [None req-dfea9dbc-7092-4bd8-8c85-cce5defc0f2e tempest-ProjectMemberTests33-2105464604 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=101319) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 03 09:54:19.502504 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connector [None req-d869df1e-3dd0-4fc0-a37e-463bdac92c90 tempest-VolumesBackupsTest-807180270 None] Factory for iscsi on None {{(pid=101319) factory /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connector.py:243}} Jul 03 09:54:19.502982 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-d869df1e-3dd0-4fc0-a37e-463bdac92c90 tempest-VolumesBackupsTest-807180270 None] ==> connect_volume: call "{'self': , 'connection_properties': {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-b578d41f-4c6a-49b3-b5ec-bcd6556e2e68', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'b578d41f-4c6a-49b3-b5ec-bcd6556e2e68', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': False}}" {{(pid=101319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}} Jul 03 09:54:19.503172 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.base [None req-d869df1e-3dd0-4fc0-a37e-463bdac92c90 tempest-VolumesBackupsTest-807180270 None] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=101319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jul 03 09:54:19.503655 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.base [None req-d869df1e-3dd0-4fc0-a37e-463bdac92c90 tempest-VolumesBackupsTest-807180270 None] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.000s {{(pid=101319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jul 03 09:54:19.503850 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.base [None req-d869df1e-3dd0-4fc0-a37e-463bdac92c90 tempest-VolumesBackupsTest-807180270 None] Connection properties {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-b578d41f-4c6a-49b3-b5ec-bcd6556e2e68', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'b578d41f-4c6a-49b3-b5ec-bcd6556e2e68', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': False} {{(pid=101319) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}} Jul 03 09:54:19.514254 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.base [None req-d869df1e-3dd0-4fc0-a37e-463bdac92c90 tempest-VolumesBackupsTest-807180270 None] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-b578d41f-4c6a-49b3-b5ec-bcd6556e2e68" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=101319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jul 03 09:54:19.514666 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.base [None req-d869df1e-3dd0-4fc0-a37e-463bdac92c90 tempest-VolumesBackupsTest-807180270 None] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-b578d41f-4c6a-49b3-b5ec-bcd6556e2e68" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.000s {{(pid=101319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jul 03 09:54:19.514912 np0000004400 cinder-backup[101319]: INFO os_brick.initiator.connectors.iscsi [None req-d869df1e-3dd0-4fc0-a37e-463bdac92c90 tempest-VolumesBackupsTest-807180270 None] Trying to connect to iSCSI portal 192.168.40.100:3260 Jul 03 09:54:19.525505 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-d869df1e-3dd0-4fc0-a37e-463bdac92c90 tempest-VolumesBackupsTest-807180270 None] iscsiadm (): stdout= stderr=iscsiadm: No records found Jul 03 09:54:19.525505 np0000004400 cinder-backup[101319]: {{(pid=101319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 03 09:54:19.537300 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-d869df1e-3dd0-4fc0-a37e-463bdac92c90 tempest-VolumesBackupsTest-807180270 None] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-b578d41f-4c6a-49b3-b5ec-bcd6556e2e68] added Jul 03 09:54:19.537300 np0000004400 cinder-backup[101319]: stderr=iscsiadm: Config file line 363 does not have value Jul 03 09:54:19.537300 np0000004400 cinder-backup[101319]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs' Jul 03 09:54:19.537300 np0000004400 cinder-backup[101319]: iscsiadm: Config file line 363 does not have value Jul 03 09:54:19.537300 np0000004400 cinder-backup[101319]: iscsiadm: Config file line 363 does not have value Jul 03 09:54:19.537300 np0000004400 cinder-backup[101319]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs' Jul 03 09:54:19.537300 np0000004400 cinder-backup[101319]: {{(pid=101319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 03 09:54:19.537589 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-d869df1e-3dd0-4fc0-a37e-463bdac92c90 tempest-VolumesBackupsTest-807180270 None] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=101319) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}} Jul 03 09:54:19.537903 np0000004400 cinder-backup[101319]: DEBUG os_brick.utils [None req-d869df1e-3dd0-4fc0-a37e-463bdac92c90 tempest-VolumesBackupsTest-807180270 None] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0229(s), this was the 1st time calling it. {{(pid=101319) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}} Jul 03 09:54:19.538143 np0000004400 cinder-backup[101319]: DEBUG os_brick.utils [None req-d869df1e-3dd0-4fc0-a37e-463bdac92c90 tempest-VolumesBackupsTest-807180270 None] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=101319) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}} Jul 03 09:54:19.548658 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-dfea9dbc-7092-4bd8-8c85-cce5defc0f2e tempest-ProjectMemberTests33-2105464604 None] Backing up chunk of data from volume. {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 09:54:19.792540 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-dfea9dbc-7092-4bd8-8c85-cce5defc0f2e tempest-ProjectMemberTests33-2105464604 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101319) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 09:54:19.792736 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-dfea9dbc-7092-4bd8-8c85-cce5defc0f2e tempest-ProjectMemberTests33-2105464604 None] About to put_object {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 09:54:19.894832 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-dfea9dbc-7092-4bd8-8c85-cce5defc0f2e tempest-ProjectMemberTests33-2105464604 None] backup MD5 for volume_4883604b-dae6-422a-92df-ec0850150bc4/20260703095408/az_nova_backup_97903bb1-73b7-48fa-91c9-1d233582fece-00020: 25e317773f308e446cc84c503a6d1f85 {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 09:54:19.894979 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-dfea9dbc-7092-4bd8-8c85-cce5defc0f2e tempest-ProjectMemberTests33-2105464604 None] Calling eventlet.sleep(0) {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 09:54:19.982566 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-dfea9dbc-7092-4bd8-8c85-cce5defc0f2e tempest-ProjectMemberTests33-2105464604 None] Backing up chunk of data from volume. {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 09:54:20.105474 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-dfea9dbc-7092-4bd8-8c85-cce5defc0f2e tempest-ProjectMemberTests33-2105464604 None] Compressed 25165824 bytes of data to 24470 bytes using zlib. {{(pid=101319) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 09:54:20.105718 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-dfea9dbc-7092-4bd8-8c85-cce5defc0f2e tempest-ProjectMemberTests33-2105464604 None] About to put_object {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 09:54:20.166071 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-dfea9dbc-7092-4bd8-8c85-cce5defc0f2e tempest-ProjectMemberTests33-2105464604 None] backup MD5 for volume_4883604b-dae6-422a-92df-ec0850150bc4/20260703095408/az_nova_backup_97903bb1-73b7-48fa-91c9-1d233582fece-00021: 77377273b0a4b61febdbf7bbf52b9db9 {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 09:54:20.166220 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-dfea9dbc-7092-4bd8-8c85-cce5defc0f2e tempest-ProjectMemberTests33-2105464604 None] Calling eventlet.sleep(0) {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 09:54:20.172758 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.driver [None req-dfea9dbc-7092-4bd8-8c85-cce5defc0f2e tempest-ProjectMemberTests33-2105464604 None] Getting metadata type 'volume-base-metadata' {{(pid=101319) _save_vol_base_meta /opt/stack/cinder/cinder/backup/driver.py:79}} Jul 03 09:54:20.178093 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.driver [None req-dfea9dbc-7092-4bd8-8c85-cce5defc0f2e tempest-ProjectMemberTests33-2105464604 None] Completed fetching metadata type 'volume-base-metadata' {{(pid=101319) _save_vol_base_meta /opt/stack/cinder/cinder/backup/driver.py:98}} Jul 03 09:54:20.178230 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.driver [None req-dfea9dbc-7092-4bd8-8c85-cce5defc0f2e tempest-ProjectMemberTests33-2105464604 None] Getting metadata type 'volume-metadata' {{(pid=101319) _save_vol_meta /opt/stack/cinder/cinder/backup/driver.py:109}} Jul 03 09:54:20.181747 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.driver [None req-dfea9dbc-7092-4bd8-8c85-cce5defc0f2e tempest-ProjectMemberTests33-2105464604 None] No metadata type 'volume-metadata' available {{(pid=101319) _save_vol_meta /opt/stack/cinder/cinder/backup/driver.py:123}} Jul 03 09:54:20.181865 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.driver [None req-dfea9dbc-7092-4bd8-8c85-cce5defc0f2e tempest-ProjectMemberTests33-2105464604 None] Getting metadata type 'volume-glance-metadata' {{(pid=101319) _save_vol_glance_meta /opt/stack/cinder/cinder/backup/driver.py:132}} Jul 03 09:54:20.184418 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.driver [None req-dfea9dbc-7092-4bd8-8c85-cce5defc0f2e tempest-ProjectMemberTests33-2105464604 None] No metadata type 'volume-glance-metadata' available {{(pid=101319) _save_vol_glance_meta /opt/stack/cinder/cinder/backup/driver.py:147}} Jul 03 09:54:20.184661 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-dfea9dbc-7092-4bd8-8c85-cce5defc0f2e tempest-ProjectMemberTests33-2105464604 None] _write_sha256file started, container name: volumebackups, sha256file filename: volume_4883604b-dae6-422a-92df-ec0850150bc4/20260703095408/az_nova_backup_97903bb1-73b7-48fa-91c9-1d233582fece_sha256file. {{(pid=101319) _write_sha256file /opt/stack/cinder/cinder/backup/chunkeddriver.py:299}} Jul 03 09:54:20.235037 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-dfea9dbc-7092-4bd8-8c85-cce5defc0f2e tempest-ProjectMemberTests33-2105464604 None] _write_sha256file finished. {{(pid=101319) _write_sha256file /opt/stack/cinder/cinder/backup/chunkeddriver.py:315}} Jul 03 09:54:20.235716 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-dfea9dbc-7092-4bd8-8c85-cce5defc0f2e tempest-ProjectMemberTests33-2105464604 None] _write_metadata started, container name: volumebackups, metadata filename: volume_4883604b-dae6-422a-92df-ec0850150bc4/20260703095408/az_nova_backup_97903bb1-73b7-48fa-91c9-1d233582fece_metadata. {{(pid=101319) _write_metadata /opt/stack/cinder/cinder/backup/chunkeddriver.py:276}} Jul 03 09:54:20.254966 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-dfea9dbc-7092-4bd8-8c85-cce5defc0f2e tempest-ProjectMemberTests33-2105464604 None] _write_metadata finished. Metadata: b'{\n "backup_description": null,\n "backup_id": "97903bb1-73b7-48fa-91c9-1d233582fece",\n "backup_name": "tempest-type-Backup-38521341",\n "created_at": "2026-07-03 09:54:05+00:00",\n "objects": [\n {\n "volume_4883604b-dae6-422a-92df-ec0850150bc4/20260703095408/az_nova_backup_97903bb1-73b7-48fa-91c9-1d233582fece-00001": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 0\n }\n },\n {\n "volume_4883604b-dae6-422a-92df-ec0850150bc4/20260703095408/az_nova_backup_97903bb1-73b7-48fa-91c9-1d233582fece-00002": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 52428800\n }\n },\n {\n "volume_4883604b-dae6-422a-92df-ec0850150bc4/20260703095408/az_nova_backup_97903bb1-73b7-48fa-91c9-1d233582fece-00003": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 104857600\n }\n },\n {\n "volume_4883604b-dae6-422a-92df-ec0850150bc4/20260703095408/az_nova_backup_97903bb1-73b7-48fa-91c9-1d233582fece-00004": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 157286400\n }\n },\n {\n "volume_4883604b-dae6-422a-92df-ec0850150bc4/20260703095408/az_nova_backup_97903bb1-73b7-48fa-91c9-1d233582fece-00005": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 209715200\n }\n },\n {\n "volume_4883604b-dae6-422a-92df-ec0850150bc4/20260703095408/az_nova_backup_97903bb1-73b7-48fa-91c9-1d233582fece-00006": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 262144000\n }\n },\n {\n "volume_4883604b-dae6-422a-92df-ec0850150bc4/20260703095408/az_nova_backup_97903bb1-73b7-48fa-91c9-1d233582fece-00007": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 314572800\n }\n },\n {\n "volume_4883604b-dae6-422a-92df-ec0850150bc4/20260703095408/az_nova_backup_97903bb1-73b7-48fa-91c9-1d233582fece-00008": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 367001600\n }\n },\n {\n "volume_4883604b-dae6-422a-92df-ec0850150bc4/20260703095408/az_nova_backup_97903bb1-73b7-48fa-91c9-1d233582fece-00009": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 419430400\n }\n },\n {\n "volume_4883604b-dae6-422a-92df-ec0850150bc4/20260703095408/az_nova_backup_97903bb1-73b7-48fa-91c9-1d233582fece-00010": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 471859200\n }\n },\n {\n "volume_4883604b-dae6-422a-92df-ec0850150bc4/20260703095408/az_nova_backup_97903bb1-73b7-48fa-91c9-1d233582fece-00011": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 524288000\n }\n },\n {\n "volume_4883604b-dae6-422a-92df-ec0850150bc4/20260703095408/az_nova_backup_97903bb1-73b7-48fa-91c9-1d233582fece-00012": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 576716800\n }\n },\n {\n "volume_4883604b-dae6-422a-92df-ec0850150bc4/20260703095408/az_nova_backup_97903bb1-73b7-48fa-91c9-1d233582fece-00013": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 629145600\n }\n },\n {\n "volume_4883604b-dae6-422a-92df-ec0850150bc4/20260703095408/az_nova_backup_97903bb1-73b7-48fa-91c9-1d233582fece-00014": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 681574400\n }\n },\n {\n "volume_4883604b-dae6-422a-92df-ec0850150bc4/20260703095408/az_nova_backup_97903bb1-73b7-48fa-91c9-1d233582fece-00015": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 734003200\n }\n },\n {\n "volume_4883604b-dae6-422a-92df-ec0850150bc4/20260703095408/az_nova_backup_97903bb1-73b7-48fa-91c9-1d233582fece-00016": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 786432000\n }\n },\n {\n "volume_4883604b-dae6-422a-92df-ec0850150bc4/20260703095408/az_nova_backup_97903bb1-73b7-48fa-91c9-1d233582fece-00017": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 838860800\n }\n },\n {\n "volume_4883604b-dae6-422a-92df-ec0850150bc4/20260703095408/az_nova_backup_97903bb1-73b7-48fa-91c9-1d233582fece-00018": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 891289600\n }\n },\n {\n "volume_4883604b-dae6-422a-92df-ec0850150bc4/20260703095408/az_nova_backup_97903bb1-73b7-48fa-91c9-1d233582fece-00019": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 943718400\n }\n },\n {\n "volume_4883604b-dae6-422a-92df-ec0850150bc4/20260703095408/az_nova_backup_97903bb1-73b7-48fa-91c9-1d233582fece-00020": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 996147200\n }\n },\n {\n "volume_4883604b-dae6-422a-92df-ec0850150bc4/20260703095408/az_nova_backup_97903bb1-73b7-48fa-91c9-1d233582fece-00021": {\n "compression": "zlib",\n "length": 25165824,\n "md5": "77377273b0a4b61febdbf7bbf52b9db9",\n "offset": 1048576000\n }\n }\n ],\n "parent_id": null,\n "version": "1.0.0",\n "volume_id": "4883604b-dae6-422a-92df-ec0850150bc4",\n "volume_meta": "{\\"version\\": 2, \\"volume-base-metadata\\": {\\"id\\": \\"4883604b-dae6-422a-92df-ec0850150bc4\\", \\"_name_id\\": null, \\"use_quota\\": true, \\"ec2_id\\": null, \\"user_id\\": \\"87abbb474f8a4baf840fcfdf286ff94e\\", \\"project_id\\": \\"e0b6e59b911e40b3acac38afb1f81e3a\\", \\"snapshot_id\\": null, \\"cluster_name\\": null, \\"host\\": \\"np0000004400@storpool#default\\", \\"size\\": 1, \\"availability_zone\\": \\"nova\\", \\"status\\": \\"backing-up\\", \\"attach_status\\": \\"detached\\", \\"migration_status\\": null, \\"scheduled_at\\": \\"2026-07-03T09:54:04.000000\\", \\"launched_at\\": \\"2026-07-03T09:54:04.000000\\", \\"terminated_at\\": null, \\"display_name\\": \\"tempest-VolumeV3RbacBaseTests-Volume-196672385\\", \\"display_description\\": null, \\"provider_location\\": null, \\"provider_auth\\": null, \\"provider_geometry\\": null, \\"provider_id\\": null, \\"volume_type_id\\": \\"03e13fe6-0e30-4803-ace0-725d38e6dc24\\", \\"source_volid\\": null, \\"encryption_key_id\\": null, \\"consistencygroup_id\\": null, \\"group_id\\": null, \\"bootable\\": false, \\"multiattach\\": false, \\"replication_status\\": null, \\"replication_extended_status\\": null, \\"replication_driver_data\\": null, \\"previous_status\\": \\"available\\", \\"service_uuid\\": \\"6d4b0e79-fefe-4744-b25f-34be05095200\\", \\"shared_targets\\": true, \\"deleted_at\\": null, \\"deleted\\": false, \\"created_at\\": \\"2026-07-03T09:54:04.000000\\", \\"updated_at\\": \\"2026-07-03T09:54:05.000000\\"}}"\n}'. {{(pid=101319) _write_metadata /opt/stack/cinder/cinder/backup/chunkeddriver.py:295}} Jul 03 09:54:20.259252 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-dfea9dbc-7092-4bd8-8c85-cce5defc0f2e tempest-ProjectMemberTests33-2105464604 None] backup 97903bb1-73b7-48fa-91c9-1d233582fece finished. {{(pid=101319) _finalize_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:462}} Jul 03 09:54:20.383138 np0000004400 cinder-backup[101319]: DEBUG oslo_concurrency.processutils [None req-dfea9dbc-7092-4bd8-8c85-cce5defc0f2e tempest-ProjectMemberTests33-2105464604 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chown 0 /dev/sdc {{(pid=101319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 09:54:20.406579 np0000004400 sudo[155985]: stack : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chown 0 /dev/sdc Jul 03 09:54:20.407447 np0000004400 sudo[155985]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1002) Jul 03 09:54:20.540009 np0000004400 cinder-backup[101319]: INFO os_brick.initiator.connectors.iscsi [None req-d869df1e-3dd0-4fc0-a37e-463bdac92c90 tempest-VolumesBackupsTest-807180270 None] Trying to connect to iSCSI portal 192.168.40.100:3260 Jul 03 09:54:20.561983 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-d869df1e-3dd0-4fc0-a37e-463bdac92c90 tempest-VolumesBackupsTest-807180270 None] iscsiadm (): stdout=# BEGIN RECORD 2.1.9 Jul 03 09:54:20.561983 np0000004400 cinder-backup[101319]: node.name = iqn.2023-03.storpool.com:os--volume-b578d41f-4c6a-49b3-b5ec-bcd6556e2e68 Jul 03 09:54:20.561983 np0000004400 cinder-backup[101319]: node.tpgt = -1 Jul 03 09:54:20.561983 np0000004400 cinder-backup[101319]: node.startup = manual Jul 03 09:54:20.561983 np0000004400 cinder-backup[101319]: node.leading_login = No Jul 03 09:54:20.561983 np0000004400 cinder-backup[101319]: iface.iscsi_ifacename = default Jul 03 09:54:20.561983 np0000004400 cinder-backup[101319]: iface.net_ifacename = Jul 03 09:54:20.561983 np0000004400 cinder-backup[101319]: iface.ipaddress = Jul 03 09:54:20.561983 np0000004400 cinder-backup[101319]: iface.prefix_len = 0 Jul 03 09:54:20.561983 np0000004400 cinder-backup[101319]: iface.hwaddress = Jul 03 09:54:20.561983 np0000004400 cinder-backup[101319]: iface.transport_name = tcp Jul 03 09:54:20.561983 np0000004400 cinder-backup[101319]: iface.initiatorname = Jul 03 09:54:20.561983 np0000004400 cinder-backup[101319]: iface.state = Jul 03 09:54:20.561983 np0000004400 cinder-backup[101319]: iface.vlan_id = 0 Jul 03 09:54:20.561983 np0000004400 cinder-backup[101319]: iface.vlan_priority = 0 Jul 03 09:54:20.561983 np0000004400 cinder-backup[101319]: iface.vlan_state = Jul 03 09:54:20.561983 np0000004400 cinder-backup[101319]: iface.iface_num = 0 Jul 03 09:54:20.561983 np0000004400 cinder-backup[101319]: iface.mtu = 0 Jul 03 09:54:20.561983 np0000004400 cinder-backup[101319]: iface.port = 0 Jul 03 09:54:20.561983 np0000004400 cinder-backup[101319]: iface.bootproto = Jul 03 09:54:20.561983 np0000004400 cinder-backup[101319]: iface.subnet_mask = Jul 03 09:54:20.561983 np0000004400 cinder-backup[101319]: iface.gateway = Jul 03 09:54:20.561983 np0000004400 cinder-backup[101319]: iface.dhcp_alt_client_id_state = Jul 03 09:54:20.561983 np0000004400 cinder-backup[101319]: iface.dhcp_alt_client_id = Jul 03 09:54:20.561983 np0000004400 cinder-backup[101319]: iface.dhcp_dns = Jul 03 09:54:20.561983 np0000004400 cinder-backup[101319]: iface.dhcp_learn_iqn = Jul 03 09:54:20.561983 np0000004400 cinder-backup[101319]: iface.dhcp_req_vendor_id_state = Jul 03 09:54:20.561983 np0000004400 cinder-backup[101319]: iface.dhcp_vendor_id_state = Jul 03 09:54:20.561983 np0000004400 cinder-backup[101319]: iface.dhcp_vendor_id = Jul 03 09:54:20.561983 np0000004400 cinder-backup[101319]: iface.dhcp_slp_da = Jul 03 09:54:20.561983 np0000004400 cinder-backup[101319]: iface.fragmentation = Jul 03 09:54:20.561983 np0000004400 cinder-backup[101319]: iface.gratuitous_arp = Jul 03 09:54:20.561983 np0000004400 cinder-backup[101319]: iface.incoming_forwarding = Jul 03 09:54:20.561983 np0000004400 cinder-backup[101319]: iface.tos_state = Jul 03 09:54:20.561983 np0000004400 cinder-backup[101319]: iface.tos = 0 Jul 03 09:54:20.561983 np0000004400 cinder-backup[101319]: iface.ttl = 0 Jul 03 09:54:20.561983 np0000004400 cinder-backup[101319]: iface.delayed_ack = Jul 03 09:54:20.561983 np0000004400 cinder-backup[101319]: iface.tcp_nagle = Jul 03 09:54:20.561983 np0000004400 cinder-backup[101319]: iface.tcp_wsf_state = Jul 03 09:54:20.561983 np0000004400 cinder-backup[101319]: iface.tcp_wsf = 0 Jul 03 09:54:20.561983 np0000004400 cinder-backup[101319]: iface.tcp_timer_scale = 0 Jul 03 09:54:20.561983 np0000004400 cinder-backup[101319]: iface.tcp_timestamp = Jul 03 09:54:20.561983 np0000004400 cinder-backup[101319]: iface.redirect = Jul 03 09:54:20.561983 np0000004400 cinder-backup[101319]: iface.def_task_mgmt_timeout = 0 Jul 03 09:54:20.561983 np0000004400 cinder-backup[101319]: iface.header_digest = Jul 03 09:54:20.561983 np0000004400 cinder-backup[101319]: iface.data_digest = Jul 03 09:54:20.561983 np0000004400 cinder-backup[101319]: iface.immediate_data = Jul 03 09:54:20.561983 np0000004400 cinder-backup[101319]: iface.initial_r2t = Jul 03 09:54:20.561983 np0000004400 cinder-backup[101319]: iface.data_seq_inorder = Jul 03 09:54:20.561983 np0000004400 cinder-backup[101319]: iface.data_pdu_inorder = Jul 03 09:54:20.561983 np0000004400 cinder-backup[101319]: iface.erl = 0 Jul 03 09:54:20.561983 np0000004400 cinder-backup[101319]: iface.max_receive_data_len = 0 Jul 03 09:54:20.561983 np0000004400 cinder-backup[101319]: iface.first_burst_len = 0 Jul 03 09:54:20.561983 np0000004400 cinder-backup[101319]: iface.max_outstanding_r2t = 0 Jul 03 09:54:20.561983 np0000004400 cinder-backup[101319]: iface.max_burst_len = 0 Jul 03 09:54:20.561983 np0000004400 cinder-backup[101319]: iface.chap_auth = Jul 03 09:54:20.561983 np0000004400 cinder-backup[101319]: iface.bidi_chap = Jul 03 09:54:20.561983 np0000004400 cinder-backup[101319]: iface.strict_login_compliance = Jul 03 09:54:20.561983 np0000004400 cinder-backup[101319]: iface.discovery_auth = Jul 03 09:54:20.561983 np0000004400 cinder-backup[101319]: iface.discovery_logout = Jul 03 09:54:20.561983 np0000004400 cinder-backup[101319]: node.discovery_address = Jul 03 09:54:20.561983 np0000004400 cinder-backup[101319]: node.discovery_port = 0 Jul 03 09:54:20.561983 np0000004400 cinder-backup[101319]: node.discovery_type = fw Jul 03 09:54:20.561983 np0000004400 cinder-backup[101319]: node.session.initial_cmdsn = 0 Jul 03 09:54:20.561983 np0000004400 cinder-backup[101319]: node.session.initial_login_retry_max = 8 Jul 03 09:54:20.561983 np0000004400 cinder-backup[101319]: node.session.xmit_thread_priority = 0 Jul 03 09:54:20.561983 np0000004400 cinder-backup[101319]: node.session.cmds_max = 128 Jul 03 09:54:20.561983 np0000004400 cinder-backup[101319]: node.session.queue_depth = 32 Jul 03 09:54:20.561983 np0000004400 cinder-backup[101319]: node.session.nr_sessions = 1 Jul 03 09:54:20.561983 np0000004400 cinder-backup[101319]: node.session.auth.authmethod = None Jul 03 09:54:20.561983 np0000004400 cinder-backup[101319]: node.session.auth.username = Jul 03 09:54:20.561983 np0000004400 cinder-backup[101319]: node.session.auth.password = *** Jul 03 09:54:20.561983 np0000004400 cinder-backup[101319]: node.session.auth.username_in = Jul 03 09:54:20.561983 np0000004400 cinder-backup[101319]: node.session.auth.password_in = Jul 03 09:54:20.561983 np0000004400 cinder-backup[101319]: node.session.auth.chap_algs = SHA256 Jul 03 09:54:20.561983 np0000004400 cinder-backup[101319]: node.session.timeo.replacement_timeout = 120 Jul 03 09:54:20.561983 np0000004400 cinder-backup[101319]: node.session.err_timeo.abort_timeout = 15 Jul 03 09:54:20.561983 np0000004400 cinder-backup[101319]: node.session.err_timeo.lu_reset_timeout = 30 Jul 03 09:54:20.561983 np0000004400 cinder-backup[101319]: node.session.err_timeo.tgt_reset_timeout = 30 Jul 03 09:54:20.561983 np0000004400 cinder-backup[101319]: node.session.err_timeo.host_reset_timeout = 60 Jul 03 09:54:20.561983 np0000004400 cinder-backup[101319]: node.session.iscsi.FastAbort = Yes Jul 03 09:54:20.561983 np0000004400 cinder-backup[101319]: node.session.iscsi.InitialR2T = No Jul 03 09:54:20.561983 np0000004400 cinder-backup[101319]: node.session.iscsi.ImmediateData = Yes Jul 03 09:54:20.561983 np0000004400 cinder-backup[101319]: node.session.iscsi.FirstBurstLength = 262144 Jul 03 09:54:20.561983 np0000004400 cinder-backup[101319]: node.session.iscsi.MaxBurstLength = 16776192 Jul 03 09:54:20.561983 np0000004400 cinder-backup[101319]: node.session.iscsi.DefaultTime2Retain = 0 Jul 03 09:54:20.561983 np0000004400 cinder-backup[101319]: node.session.iscsi.DefaultTime2Wait = 2 Jul 03 09:54:20.561983 np0000004400 cinder-backup[101319]: node.session.iscsi.MaxConnections = 1 Jul 03 09:54:20.561983 np0000004400 cinder-backup[101319]: node.session.iscsi.MaxOutstandingR2T = 1 Jul 03 09:54:20.561983 np0000004400 cinder-backup[101319]: node.session.iscsi.ERL = 0 Jul 03 09:54:20.561983 np0000004400 cinder-backup[101319]: node.session.scan = auto Jul 03 09:54:20.561983 np0000004400 cinder-backup[101319]: node.session.reopen_max = 0 Jul 03 09:54:20.561983 np0000004400 cinder-backup[101319]: node.conn[0].address = 192.168.40.100 Jul 03 09:54:20.561983 np0000004400 cinder-backup[101319]: node.conn[0].port = 3260 Jul 03 09:54:20.561983 np0000004400 cinder-backup[101319]: node.conn[0].startup = manual Jul 03 09:54:20.561983 np0000004400 cinder-backup[101319]: node.conn[0].tcp.window_size = 524288 Jul 03 09:54:20.561983 np0000004400 cinder-backup[101319]: node.conn[0].tcp.type_of_service = 0 Jul 03 09:54:20.561983 np0000004400 cinder-backup[101319]: node.conn[0].timeo.logout_timeout = 15 Jul 03 09:54:20.561983 np0000004400 cinder-backup[101319]: node.conn[0].timeo.login_timeout = 15 Jul 03 09:54:20.561983 np0000004400 cinder-backup[101319]: node.conn[0].timeo.auth_timeout = 45 Jul 03 09:54:20.561983 np0000004400 cinder-backup[101319]: node.conn[0].timeo.noop_out_interval = 5 Jul 03 09:54:20.561983 np0000004400 cinder-backup[101319]: node.conn[0].timeo.noop_out_timeout = 5 Jul 03 09:54:20.561983 np0000004400 cinder-backup[101319]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0 Jul 03 09:54:20.561983 np0000004400 cinder-backup[101319]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144 Jul 03 09:54:20.561983 np0000004400 cinder-backup[101319]: node.conn[0].iscsi.HeaderDigest = None Jul 03 09:54:20.561983 np0000004400 cinder-backup[101319]: node.conn[0].iscsi.DataDigest = None Jul 03 09:54:20.561983 np0000004400 cinder-backup[101319]: node.conn[0].iscsi.IFMarker = No Jul 03 09:54:20.561983 np0000004400 cinder-backup[101319]: node.conn[0].iscsi.OFMarker = No Jul 03 09:54:20.561983 np0000004400 cinder-backup[101319]: # END RECORD Jul 03 09:54:20.561983 np0000004400 cinder-backup[101319]: stderr= {{(pid=101319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 03 09:54:20.568068 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-d869df1e-3dd0-4fc0-a37e-463bdac92c90 tempest-VolumesBackupsTest-807180270 None] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=101319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 03 09:54:20.579117 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-d869df1e-3dd0-4fc0-a37e-463bdac92c90 tempest-VolumesBackupsTest-807180270 None] iscsiadm ('-m', 'session'): stdout=tcp: [208] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-789ec59e-ea87-4784-8990-156a35276b5f (non-flash) Jul 03 09:54:20.579117 np0000004400 cinder-backup[101319]: tcp: [209] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-789ec59e-ea87-4784-8990-156a35276b5f (non-flash) Jul 03 09:54:20.579117 np0000004400 cinder-backup[101319]: tcp: [211] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-4883604b-dae6-422a-92df-ec0850150bc4 (non-flash) Jul 03 09:54:20.579117 np0000004400 cinder-backup[101319]: stderr= {{(pid=101319) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jul 03 09:54:20.579117 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-d869df1e-3dd0-4fc0-a37e-463bdac92c90 tempest-VolumesBackupsTest-807180270 None] iscsi session list stdout=tcp: [208] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-789ec59e-ea87-4784-8990-156a35276b5f (non-flash) Jul 03 09:54:20.579117 np0000004400 cinder-backup[101319]: tcp: [209] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-789ec59e-ea87-4784-8990-156a35276b5f (non-flash) Jul 03 09:54:20.579117 np0000004400 cinder-backup[101319]: tcp: [211] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-4883604b-dae6-422a-92df-ec0850150bc4 (non-flash) Jul 03 09:54:20.579117 np0000004400 cinder-backup[101319]: stderr= {{(pid=101319) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jul 03 09:54:20.605845 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-d869df1e-3dd0-4fc0-a37e-463bdac92c90 tempest-VolumesBackupsTest-807180270 None] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-b578d41f-4c6a-49b3-b5ec-bcd6556e2e68, portal: 192.168.40.100,3260] Jul 03 09:54:20.605845 np0000004400 cinder-backup[101319]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-b578d41f-4c6a-49b3-b5ec-bcd6556e2e68, portal: 192.168.40.100,3260] successful. Jul 03 09:54:20.605845 np0000004400 cinder-backup[101319]: stderr= {{(pid=101319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 03 09:54:20.616918 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-d869df1e-3dd0-4fc0-a37e-463bdac92c90 tempest-VolumesBackupsTest-807180270 None] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=101319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 03 09:54:20.633139 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-d869df1e-3dd0-4fc0-a37e-463bdac92c90 tempest-VolumesBackupsTest-807180270 None] iscsiadm ('-m', 'session'): stdout=tcp: [208] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-789ec59e-ea87-4784-8990-156a35276b5f (non-flash) Jul 03 09:54:20.633139 np0000004400 cinder-backup[101319]: tcp: [209] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-789ec59e-ea87-4784-8990-156a35276b5f (non-flash) Jul 03 09:54:20.633139 np0000004400 cinder-backup[101319]: tcp: [211] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-4883604b-dae6-422a-92df-ec0850150bc4 (non-flash) Jul 03 09:54:20.633139 np0000004400 cinder-backup[101319]: tcp: [212] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b578d41f-4c6a-49b3-b5ec-bcd6556e2e68 (non-flash) Jul 03 09:54:20.633139 np0000004400 cinder-backup[101319]: stderr= {{(pid=101319) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jul 03 09:54:20.633139 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-d869df1e-3dd0-4fc0-a37e-463bdac92c90 tempest-VolumesBackupsTest-807180270 None] iscsi session list stdout=tcp: [208] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-789ec59e-ea87-4784-8990-156a35276b5f (non-flash) Jul 03 09:54:20.633139 np0000004400 cinder-backup[101319]: tcp: [209] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-789ec59e-ea87-4784-8990-156a35276b5f (non-flash) Jul 03 09:54:20.633139 np0000004400 cinder-backup[101319]: tcp: [211] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-4883604b-dae6-422a-92df-ec0850150bc4 (non-flash) Jul 03 09:54:20.633139 np0000004400 cinder-backup[101319]: tcp: [212] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b578d41f-4c6a-49b3-b5ec-bcd6556e2e68 (non-flash) Jul 03 09:54:20.633139 np0000004400 cinder-backup[101319]: stderr= {{(pid=101319) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jul 03 09:54:20.633139 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.base [None req-d869df1e-3dd0-4fc0-a37e-463bdac92c90 tempest-VolumesBackupsTest-807180270 None] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-b578d41f-4c6a-49b3-b5ec-bcd6556e2e68" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.117s {{(pid=101319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jul 03 09:54:20.633139 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-d869df1e-3dd0-4fc0-a37e-463bdac92c90 tempest-VolumesBackupsTest-807180270 None] Connected to 192.168.40.100:3260 {{(pid=101319) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}} Jul 03 09:54:20.633139 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.linuxscsi [None req-d869df1e-3dd0-4fc0-a37e-463bdac92c90 tempest-VolumesBackupsTest-807180270 None] HCTL ('7', '-', '-', 0) found on session 212 with lun 0 {{(pid=101319) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}} Jul 03 09:54:20.633139 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.linuxscsi [None req-d869df1e-3dd0-4fc0-a37e-463bdac92c90 tempest-VolumesBackupsTest-807180270 None] Scanning host 7 c: -, t: -, l: 0) {{(pid=101319) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}} Jul 03 09:54:20.648344 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.linuxscsi [None req-d869df1e-3dd0-4fc0-a37e-463bdac92c90 tempest-VolumesBackupsTest-807180270 None] Searching for a device in session 212 and hctl ['7', '*', '*', 0] yield: sdb {{(pid=101319) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}} Jul 03 09:54:20.648344 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-d869df1e-3dd0-4fc0-a37e-463bdac92c90 tempest-VolumesBackupsTest-807180270 None] Connected to sdb using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-b578d41f-4c6a-49b3-b5ec-bcd6556e2e68', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'b578d41f-4c6a-49b3-b5ec-bcd6556e2e68', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': False} {{(pid=101319) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}} Jul 03 09:54:20.695376 np0000004400 sudo[155985]: pam_unix(sudo:session): session closed for user root Jul 03 09:54:20.697372 np0000004400 cinder-backup[101319]: DEBUG oslo_concurrency.processutils [None req-dfea9dbc-7092-4bd8-8c85-cce5defc0f2e tempest-ProjectMemberTests33-2105464604 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chown 0 /dev/sdc" returned: 0 in 0.314s {{(pid=101319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 09:54:20.697849 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-dfea9dbc-7092-4bd8-8c85-cce5defc0f2e tempest-ProjectMemberTests33-2105464604 None] ==> disconnect_volume: call "{'args': (, {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-4883604b-dae6-422a-92df-ec0850150bc4', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '4883604b-dae6-422a-92df-ec0850150bc4', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': False}, {'type': 'block', 'scsi_wwn': '1StorPooliSCSI_DISK_1034578903445799237', 'path': '/dev/sdc'}), 'kwargs': {'force': True, 'ignore_errors': True}}" {{(pid=101319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}} Jul 03 09:54:20.698058 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.base [None req-dfea9dbc-7092-4bd8-8c85-cce5defc0f2e tempest-ProjectMemberTests33-2105464604 None] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=101319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jul 03 09:54:21.648991 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.base [None req-d869df1e-3dd0-4fc0-a37e-463bdac92c90 tempest-VolumesBackupsTest-807180270 None] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 2.145s {{(pid=101319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jul 03 09:54:21.649494 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-d869df1e-3dd0-4fc0-a37e-463bdac92c90 tempest-VolumesBackupsTest-807180270 None] <== connect_volume: return (2146ms) {'type': 'block', 'scsi_wwn': '1StorPooliSCSI_DISK_1034578903445799236', 'path': '/dev/sdb'} {{(pid=101319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}} Jul 03 09:54:21.649494 np0000004400 cinder-backup[101319]: DEBUG oslo_concurrency.processutils [None req-d869df1e-3dd0-4fc0-a37e-463bdac92c90 tempest-VolumesBackupsTest-807180270 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chown 1002 /dev/sdb {{(pid=101319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 09:54:21.655720 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.base [None req-dfea9dbc-7092-4bd8-8c85-cce5defc0f2e tempest-ProjectMemberTests33-2105464604 None] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.957s {{(pid=101319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jul 03 09:54:21.656491 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-dfea9dbc-7092-4bd8-8c85-cce5defc0f2e tempest-ProjectMemberTests33-2105464604 None] _get_connection_devices called with parameters: connection_properties={'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-4883604b-dae6-422a-92df-ec0850150bc4', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '4883604b-dae6-422a-92df-ec0850150bc4', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': False}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=101319) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:847}} Jul 03 09:54:21.666046 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-dfea9dbc-7092-4bd8-8c85-cce5defc0f2e tempest-ProjectMemberTests33-2105464604 None] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS: Jul 03 09:54:21.666046 np0000004400 cinder-backup[101319]: No targets found. Jul 03 09:54:21.666046 np0000004400 cinder-backup[101319]: iSNS: Jul 03 09:54:21.666046 np0000004400 cinder-backup[101319]: No targets found. Jul 03 09:54:21.666046 np0000004400 cinder-backup[101319]: STATIC: Jul 03 09:54:21.666046 np0000004400 cinder-backup[101319]: Target: iqn.2023-03.storpool.com:os--volume-b578d41f-4c6a-49b3-b5ec-bcd6556e2e68 Jul 03 09:54:21.666046 np0000004400 cinder-backup[101319]: Portal: 192.168.40.100:3260,-1 Jul 03 09:54:21.666046 np0000004400 cinder-backup[101319]: Iface Name: default Jul 03 09:54:21.666046 np0000004400 cinder-backup[101319]: Target: iqn.2023-03.storpool.com:os--volume-4883604b-dae6-422a-92df-ec0850150bc4 Jul 03 09:54:21.666046 np0000004400 cinder-backup[101319]: Portal: 192.168.40.100:3260,-1 Jul 03 09:54:21.666046 np0000004400 cinder-backup[101319]: Iface Name: default Jul 03 09:54:21.666046 np0000004400 cinder-backup[101319]: Target: iqn.2023-03.storpool.com:os--volume-789ec59e-ea87-4784-8990-156a35276b5f Jul 03 09:54:21.666046 np0000004400 cinder-backup[101319]: Portal: 192.168.50.100:3260,-1 Jul 03 09:54:21.666046 np0000004400 cinder-backup[101319]: Iface Name: default Jul 03 09:54:21.666046 np0000004400 cinder-backup[101319]: Portal: 192.168.40.100:3260,-1 Jul 03 09:54:21.666046 np0000004400 cinder-backup[101319]: Iface Name: default Jul 03 09:54:21.666046 np0000004400 cinder-backup[101319]: FIRMWARE: Jul 03 09:54:21.666046 np0000004400 cinder-backup[101319]: No targets found. Jul 03 09:54:21.666046 np0000004400 cinder-backup[101319]: stderr= {{(pid=101319) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jul 03 09:54:21.666658 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-dfea9dbc-7092-4bd8-8c85-cce5defc0f2e tempest-ProjectMemberTests33-2105464604 None] Regex to get portals from discoverydb: ^SENDTARGETS: Jul 03 09:54:21.666658 np0000004400 cinder-backup[101319]: .*?^DiscoveryAddress: 192.168.40.100,3260.*? Jul 03 09:54:21.666658 np0000004400 cinder-backup[101319]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=101319) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:390}} Jul 03 09:54:21.666658 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-dfea9dbc-7092-4bd8-8c85-cce5defc0f2e tempest-ProjectMemberTests33-2105464604 None] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-4883604b-dae6-422a-92df-ec0850150bc4', 0)] {{(pid=101319) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:858}} Jul 03 09:54:21.666333 np0000004400 sudo[156034]: stack : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chown 1002 /dev/sdb Jul 03 09:54:21.666932 np0000004400 sudo[156034]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1002) Jul 03 09:54:21.685560 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-dfea9dbc-7092-4bd8-8c85-cce5defc0f2e tempest-ProjectMemberTests33-2105464604 None] iscsiadm ('-m', 'session'): stdout=tcp: [208] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-789ec59e-ea87-4784-8990-156a35276b5f (non-flash) Jul 03 09:54:21.685560 np0000004400 cinder-backup[101319]: tcp: [209] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-789ec59e-ea87-4784-8990-156a35276b5f (non-flash) Jul 03 09:54:21.685560 np0000004400 cinder-backup[101319]: tcp: [211] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-4883604b-dae6-422a-92df-ec0850150bc4 (non-flash) Jul 03 09:54:21.685560 np0000004400 cinder-backup[101319]: tcp: [212] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b578d41f-4c6a-49b3-b5ec-bcd6556e2e68 (non-flash) Jul 03 09:54:21.685560 np0000004400 cinder-backup[101319]: stderr= {{(pid=101319) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jul 03 09:54:21.685899 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-dfea9dbc-7092-4bd8-8c85-cce5defc0f2e tempest-ProjectMemberTests33-2105464604 None] iscsi session list stdout=tcp: [208] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-789ec59e-ea87-4784-8990-156a35276b5f (non-flash) Jul 03 09:54:21.685899 np0000004400 cinder-backup[101319]: tcp: [209] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-789ec59e-ea87-4784-8990-156a35276b5f (non-flash) Jul 03 09:54:21.685899 np0000004400 cinder-backup[101319]: tcp: [211] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-4883604b-dae6-422a-92df-ec0850150bc4 (non-flash) Jul 03 09:54:21.685899 np0000004400 cinder-backup[101319]: tcp: [212] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b578d41f-4c6a-49b3-b5ec-bcd6556e2e68 (non-flash) Jul 03 09:54:21.685899 np0000004400 cinder-backup[101319]: stderr= {{(pid=101319) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jul 03 09:54:21.685899 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-dfea9dbc-7092-4bd8-8c85-cce5defc0f2e tempest-ProjectMemberTests33-2105464604 None] Sessions list: [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-789ec59e-ea87-4784-8990-156a35276b5f', '208'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-789ec59e-ea87-4784-8990-156a35276b5f', '209'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-4883604b-dae6-422a-92df-ec0850150bc4', '211'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-b578d41f-4c6a-49b3-b5ec-bcd6556e2e68', '212')] {{(pid=101319) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:866}} Jul 03 09:54:21.686169 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-dfea9dbc-7092-4bd8-8c85-cce5defc0f2e tempest-ProjectMemberTests33-2105464604 None] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-4883604b-dae6-422a-92df-ec0850150bc4, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-4883604b-dae6-422a-92df-ec0850150bc4', '211')] {{(pid=101319) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}} Jul 03 09:54:21.686862 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-dfea9dbc-7092-4bd8-8c85-cce5defc0f2e tempest-ProjectMemberTests33-2105464604 None] Resulting device map defaultdict(. at 0x7e76e7354680>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-4883604b-dae6-422a-92df-ec0850150bc4'): ({'sdc'}, set())}) {{(pid=101319) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:912}} Jul 03 09:54:21.687063 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.linuxscsi [None req-dfea9dbc-7092-4bd8-8c85-cce5defc0f2e tempest-ProjectMemberTests33-2105464604 None] Removing single pathed devices sdc {{(pid=101319) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}} Jul 03 09:54:21.698184 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.linuxscsi [None req-dfea9dbc-7092-4bd8-8c85-cce5defc0f2e tempest-ProjectMemberTests33-2105464604 None] Flushing IO for device /dev/sdc {{(pid=101319) flush_device_io /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:461}} Jul 03 09:54:21.705466 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.linuxscsi [None req-dfea9dbc-7092-4bd8-8c85-cce5defc0f2e tempest-ProjectMemberTests33-2105464604 None] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=101319) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}} Jul 03 09:54:21.741713 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.linuxscsi [None req-dfea9dbc-7092-4bd8-8c85-cce5defc0f2e tempest-ProjectMemberTests33-2105464604 None] Checking to see if SCSI volumes sdc have been removed. {{(pid=101319) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}} Jul 03 09:54:21.741868 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.linuxscsi [None req-dfea9dbc-7092-4bd8-8c85-cce5defc0f2e tempest-ProjectMemberTests33-2105464604 None] SCSI volumes sdc have been removed. {{(pid=101319) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}} Jul 03 09:54:21.742760 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.linuxscsi [None req-dfea9dbc-7092-4bd8-8c85-cce5defc0f2e tempest-ProjectMemberTests33-2105464604 None] Checking to see if device paths {'sdc'} are still under multipathd monitoring {{(pid=101319) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}} Jul 03 09:54:21.751842 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.linuxscsi [None req-dfea9dbc-7092-4bd8-8c85-cce5defc0f2e tempest-ProjectMemberTests33-2105464604 None] Device paths {'sdc'} have been removed from multipathd monitoring. {{(pid=101319) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}} Jul 03 09:54:21.752166 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-dfea9dbc-7092-4bd8-8c85-cce5defc0f2e tempest-ProjectMemberTests33-2105464604 None] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-4883604b-dae6-422a-92df-ec0850150bc4')] {{(pid=101319) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1225}} Jul 03 09:54:21.761156 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-dfea9dbc-7092-4bd8-8c85-cce5defc0f2e tempest-ProjectMemberTests33-2105464604 None] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=101319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 03 09:54:21.791392 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-dfea9dbc-7092-4bd8-8c85-cce5defc0f2e tempest-ProjectMemberTests33-2105464604 None] iscsiadm ('--logout',): stdout=Logging out of session [sid: 211, target: iqn.2023-03.storpool.com:os--volume-4883604b-dae6-422a-92df-ec0850150bc4, portal: 192.168.40.100,3260] Jul 03 09:54:21.791392 np0000004400 cinder-backup[101319]: Logout of [sid: 211, target: iqn.2023-03.storpool.com:os--volume-4883604b-dae6-422a-92df-ec0850150bc4, portal: 192.168.40.100,3260] successful. Jul 03 09:54:21.791392 np0000004400 cinder-backup[101319]: stderr= {{(pid=101319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 03 09:54:21.802652 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-dfea9dbc-7092-4bd8-8c85-cce5defc0f2e tempest-ProjectMemberTests33-2105464604 None] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=101319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 03 09:54:21.802929 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.base [None req-dfea9dbc-7092-4bd8-8c85-cce5defc0f2e tempest-ProjectMemberTests33-2105464604 None] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.148s {{(pid=101319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jul 03 09:54:21.803065 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-dfea9dbc-7092-4bd8-8c85-cce5defc0f2e tempest-ProjectMemberTests33-2105464604 None] <== disconnect_volume: return (1105ms) None {{(pid=101319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}} Jul 03 09:54:21.953148 np0000004400 sudo[156034]: pam_unix(sudo:session): session closed for user root Jul 03 09:54:21.954716 np0000004400 cinder-backup[101319]: DEBUG oslo_concurrency.processutils [None req-d869df1e-3dd0-4fc0-a37e-463bdac92c90 tempest-VolumesBackupsTest-807180270 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chown 1002 /dev/sdb" returned: 0 in 0.305s {{(pid=101319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 09:54:21.964200 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-d869df1e-3dd0-4fc0-a37e-463bdac92c90 tempest-VolumesBackupsTest-807180270 None] _read_sha256file started, container name: volumebackups, sha256 filename: volume_b578d41f-4c6a-49b3-b5ec-bcd6556e2e68/20260703095347/az_nova_backup_c52fbc4a-f7d8-49e2-bd92-5bbf2f7f98ba_sha256file. {{(pid=101319) _read_sha256file /opt/stack/cinder/cinder/backup/chunkeddriver.py:333}} Jul 03 09:54:21.990960 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-d869df1e-3dd0-4fc0-a37e-463bdac92c90 tempest-VolumesBackupsTest-807180270 None] _read_sha256file finished. {{(pid=101319) _read_sha256file /opt/stack/cinder/cinder/backup/chunkeddriver.py:340}} Jul 03 09:54:21.997358 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-d869df1e-3dd0-4fc0-a37e-463bdac92c90 tempest-VolumesBackupsTest-807180270 None] _create_container started, container: volumebackups,backup: ab559f16-a070-4b18-9c05-f0f3a1985361. {{(pid=101319) _create_container /opt/stack/cinder/cinder/backup/chunkeddriver.py:249}} Jul 03 09:54:22.022942 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.drivers.swift [None req-d869df1e-3dd0-4fc0-a37e-463bdac92c90 tempest-VolumesBackupsTest-807180270 None] generate_object_name_prefix: volume_b578d41f-4c6a-49b3-b5ec-bcd6556e2e68/20260703095422/az_nova_backup_ab559f16-a070-4b18-9c05-f0f3a1985361 {{(pid=101319) _generate_object_name_prefix /opt/stack/cinder/cinder/backup/drivers/swift.py:452}} Jul 03 09:54:22.027765 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-d869df1e-3dd0-4fc0-a37e-463bdac92c90 tempest-VolumesBackupsTest-807180270 None] starting backup of volume: b578d41f-4c6a-49b3-b5ec-bcd6556e2e68, volume size: 1073741824, object names prefix volume_b578d41f-4c6a-49b3-b5ec-bcd6556e2e68/20260703095422/az_nova_backup_ab559f16-a070-4b18-9c05-f0f3a1985361, availability zone: nova {{(pid=101319) _prepare_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:359}} Jul 03 09:54:22.855485 np0000004400 cinder-backup[101319]: INFO cinder.backup.manager [None req-dfea9dbc-7092-4bd8-8c85-cce5defc0f2e tempest-ProjectMemberTests33-2105464604 None] Create backup finished. backup: 97903bb1-73b7-48fa-91c9-1d233582fece. Jul 03 09:54:23.775200 np0000004400 cinder-backup[101319]: INFO cinder.backup.manager [None req-fdc56de6-59ae-412a-83d9-6f53db9a63d4 tempest-ProjectMemberTests33-2105464604 None] Delete backup started, backup: 97903bb1-73b7-48fa-91c9-1d233582fece. Jul 03 09:54:23.782091 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.drivers.swift [None req-fdc56de6-59ae-412a-83d9-6f53db9a63d4 tempest-ProjectMemberTests33-2105464604 None] Using swift URL https://10.4.3.95:8080/v1/AUTH_e0b6e59b911e40b3acac38afb1f81e3a {{(pid=101319) initialize /opt/stack/cinder/cinder/backup/drivers/swift.py:300}} Jul 03 09:54:23.782434 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.drivers.swift [None req-fdc56de6-59ae-412a-83d9-6f53db9a63d4 tempest-ProjectMemberTests33-2105464604 None] Connect to https://10.4.3.95:8080/v1/AUTH_ in "per_user" mode {{(pid=101319) initialize /opt/stack/cinder/cinder/backup/drivers/swift.py:301}} Jul 03 09:54:23.782713 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-fdc56de6-59ae-412a-83d9-6f53db9a63d4 tempest-ProjectMemberTests33-2105464604 None] delete started, backup: 97903bb1-73b7-48fa-91c9-1d233582fece, container: volumebackups, prefix: volume_4883604b-dae6-422a-92df-ec0850150bc4/20260703095408/az_nova_backup_97903bb1-73b7-48fa-91c9-1d233582fece. {{(pid=101319) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:822}} Jul 03 09:54:23.854748 np0000004400 cinder-backup[101319]: DEBUG oslo_db.sqlalchemy.engines [None req-d869df1e-3dd0-4fc0-a37e-463bdac92c90 tempest-VolumesBackupsTest-807180270 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=101319) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 03 09:54:23.863130 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-fdc56de6-59ae-412a-83d9-6f53db9a63d4 tempest-ProjectMemberTests33-2105464604 None] generated object list: ['volume_4883604b-dae6-422a-92df-ec0850150bc4/20260703095408/az_nova_backup_97903bb1-73b7-48fa-91c9-1d233582fece-00001', 'volume_4883604b-dae6-422a-92df-ec0850150bc4/20260703095408/az_nova_backup_97903bb1-73b7-48fa-91c9-1d233582fece-00002', 'volume_4883604b-dae6-422a-92df-ec0850150bc4/20260703095408/az_nova_backup_97903bb1-73b7-48fa-91c9-1d233582fece-00003', 'volume_4883604b-dae6-422a-92df-ec0850150bc4/20260703095408/az_nova_backup_97903bb1-73b7-48fa-91c9-1d233582fece-00004', 'volume_4883604b-dae6-422a-92df-ec0850150bc4/20260703095408/az_nova_backup_97903bb1-73b7-48fa-91c9-1d233582fece-00005', 'volume_4883604b-dae6-422a-92df-ec0850150bc4/20260703095408/az_nova_backup_97903bb1-73b7-48fa-91c9-1d233582fece-00006', 'volume_4883604b-dae6-422a-92df-ec0850150bc4/20260703095408/az_nova_backup_97903bb1-73b7-48fa-91c9-1d233582fece-00007', 'volume_4883604b-dae6-422a-92df-ec0850150bc4/20260703095408/az_nova_backup_97903bb1-73b7-48fa-91c9-1d233582fece-00008', 'volume_4883604b-dae6-422a-92df-ec0850150bc4/20260703095408/az_nova_backup_97903bb1-73b7-48fa-91c9-1d233582fece-00009', 'volume_4883604b-dae6-422a-92df-ec0850150bc4/20260703095408/az_nova_backup_97903bb1-73b7-48fa-91c9-1d233582fece-00010', 'volume_4883604b-dae6-422a-92df-ec0850150bc4/20260703095408/az_nova_backup_97903bb1-73b7-48fa-91c9-1d233582fece-00011', 'volume_4883604b-dae6-422a-92df-ec0850150bc4/20260703095408/az_nova_backup_97903bb1-73b7-48fa-91c9-1d233582fece-00012', 'volume_4883604b-dae6-422a-92df-ec0850150bc4/20260703095408/az_nova_backup_97903bb1-73b7-48fa-91c9-1d233582fece-00013', 'volume_4883604b-dae6-422a-92df-ec0850150bc4/20260703095408/az_nova_backup_97903bb1-73b7-48fa-91c9-1d233582fece-00014', 'volume_4883604b-dae6-422a-92df-ec0850150bc4/20260703095408/az_nova_backup_97903bb1-73b7-48fa-91c9-1d233582fece-00015', 'volume_4883604b-dae6-422a-92df-ec0850150bc4/20260703095408/az_nova_backup_97903bb1-73b7-48fa-91c9-1d233582fece-00016', 'volume_4883604b-dae6-422a-92df-ec0850150bc4/20260703095408/az_nova_backup_97903bb1-73b7-48fa-91c9-1d233582fece-00017', 'volume_4883604b-dae6-422a-92df-ec0850150bc4/20260703095408/az_nova_backup_97903bb1-73b7-48fa-91c9-1d233582fece-00018', 'volume_4883604b-dae6-422a-92df-ec0850150bc4/20260703095408/az_nova_backup_97903bb1-73b7-48fa-91c9-1d233582fece-00019', 'volume_4883604b-dae6-422a-92df-ec0850150bc4/20260703095408/az_nova_backup_97903bb1-73b7-48fa-91c9-1d233582fece-00020', 'volume_4883604b-dae6-422a-92df-ec0850150bc4/20260703095408/az_nova_backup_97903bb1-73b7-48fa-91c9-1d233582fece-00021', 'volume_4883604b-dae6-422a-92df-ec0850150bc4/20260703095408/az_nova_backup_97903bb1-73b7-48fa-91c9-1d233582fece_metadata', 'volume_4883604b-dae6-422a-92df-ec0850150bc4/20260703095408/az_nova_backup_97903bb1-73b7-48fa-91c9-1d233582fece_sha256file']. {{(pid=101319) _generate_object_names /opt/stack/cinder/cinder/backup/chunkeddriver.py:260}} Jul 03 09:54:23.883906 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-fdc56de6-59ae-412a-83d9-6f53db9a63d4 tempest-ProjectMemberTests33-2105464604 None] deleted object: volume_4883604b-dae6-422a-92df-ec0850150bc4/20260703095408/az_nova_backup_97903bb1-73b7-48fa-91c9-1d233582fece-00001 in container: volumebackups. {{(pid=101319) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 09:54:23.903997 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-fdc56de6-59ae-412a-83d9-6f53db9a63d4 tempest-ProjectMemberTests33-2105464604 None] deleted object: volume_4883604b-dae6-422a-92df-ec0850150bc4/20260703095408/az_nova_backup_97903bb1-73b7-48fa-91c9-1d233582fece-00002 in container: volumebackups. {{(pid=101319) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 09:54:23.928994 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-fdc56de6-59ae-412a-83d9-6f53db9a63d4 tempest-ProjectMemberTests33-2105464604 None] deleted object: volume_4883604b-dae6-422a-92df-ec0850150bc4/20260703095408/az_nova_backup_97903bb1-73b7-48fa-91c9-1d233582fece-00003 in container: volumebackups. {{(pid=101319) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 09:54:23.948707 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-fdc56de6-59ae-412a-83d9-6f53db9a63d4 tempest-ProjectMemberTests33-2105464604 None] deleted object: volume_4883604b-dae6-422a-92df-ec0850150bc4/20260703095408/az_nova_backup_97903bb1-73b7-48fa-91c9-1d233582fece-00004 in container: volumebackups. {{(pid=101319) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 09:54:23.970004 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-fdc56de6-59ae-412a-83d9-6f53db9a63d4 tempest-ProjectMemberTests33-2105464604 None] deleted object: volume_4883604b-dae6-422a-92df-ec0850150bc4/20260703095408/az_nova_backup_97903bb1-73b7-48fa-91c9-1d233582fece-00005 in container: volumebackups. {{(pid=101319) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 09:54:23.990163 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-fdc56de6-59ae-412a-83d9-6f53db9a63d4 tempest-ProjectMemberTests33-2105464604 None] deleted object: volume_4883604b-dae6-422a-92df-ec0850150bc4/20260703095408/az_nova_backup_97903bb1-73b7-48fa-91c9-1d233582fece-00006 in container: volumebackups. {{(pid=101319) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 09:54:24.009702 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-fdc56de6-59ae-412a-83d9-6f53db9a63d4 tempest-ProjectMemberTests33-2105464604 None] deleted object: volume_4883604b-dae6-422a-92df-ec0850150bc4/20260703095408/az_nova_backup_97903bb1-73b7-48fa-91c9-1d233582fece-00007 in container: volumebackups. {{(pid=101319) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 09:54:24.028727 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-fdc56de6-59ae-412a-83d9-6f53db9a63d4 tempest-ProjectMemberTests33-2105464604 None] deleted object: volume_4883604b-dae6-422a-92df-ec0850150bc4/20260703095408/az_nova_backup_97903bb1-73b7-48fa-91c9-1d233582fece-00008 in container: volumebackups. {{(pid=101319) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 09:54:24.051610 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-fdc56de6-59ae-412a-83d9-6f53db9a63d4 tempest-ProjectMemberTests33-2105464604 None] deleted object: volume_4883604b-dae6-422a-92df-ec0850150bc4/20260703095408/az_nova_backup_97903bb1-73b7-48fa-91c9-1d233582fece-00009 in container: volumebackups. {{(pid=101319) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 09:54:24.071763 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-fdc56de6-59ae-412a-83d9-6f53db9a63d4 tempest-ProjectMemberTests33-2105464604 None] deleted object: volume_4883604b-dae6-422a-92df-ec0850150bc4/20260703095408/az_nova_backup_97903bb1-73b7-48fa-91c9-1d233582fece-00010 in container: volumebackups. {{(pid=101319) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 09:54:24.095936 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-fdc56de6-59ae-412a-83d9-6f53db9a63d4 tempest-ProjectMemberTests33-2105464604 None] deleted object: volume_4883604b-dae6-422a-92df-ec0850150bc4/20260703095408/az_nova_backup_97903bb1-73b7-48fa-91c9-1d233582fece-00011 in container: volumebackups. {{(pid=101319) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 09:54:24.117475 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-fdc56de6-59ae-412a-83d9-6f53db9a63d4 tempest-ProjectMemberTests33-2105464604 None] deleted object: volume_4883604b-dae6-422a-92df-ec0850150bc4/20260703095408/az_nova_backup_97903bb1-73b7-48fa-91c9-1d233582fece-00012 in container: volumebackups. {{(pid=101319) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 09:54:24.137988 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-fdc56de6-59ae-412a-83d9-6f53db9a63d4 tempest-ProjectMemberTests33-2105464604 None] deleted object: volume_4883604b-dae6-422a-92df-ec0850150bc4/20260703095408/az_nova_backup_97903bb1-73b7-48fa-91c9-1d233582fece-00013 in container: volumebackups. {{(pid=101319) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 09:54:24.157969 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-fdc56de6-59ae-412a-83d9-6f53db9a63d4 tempest-ProjectMemberTests33-2105464604 None] deleted object: volume_4883604b-dae6-422a-92df-ec0850150bc4/20260703095408/az_nova_backup_97903bb1-73b7-48fa-91c9-1d233582fece-00014 in container: volumebackups. {{(pid=101319) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 09:54:24.178356 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-fdc56de6-59ae-412a-83d9-6f53db9a63d4 tempest-ProjectMemberTests33-2105464604 None] deleted object: volume_4883604b-dae6-422a-92df-ec0850150bc4/20260703095408/az_nova_backup_97903bb1-73b7-48fa-91c9-1d233582fece-00015 in container: volumebackups. {{(pid=101319) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 09:54:24.202722 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-fdc56de6-59ae-412a-83d9-6f53db9a63d4 tempest-ProjectMemberTests33-2105464604 None] deleted object: volume_4883604b-dae6-422a-92df-ec0850150bc4/20260703095408/az_nova_backup_97903bb1-73b7-48fa-91c9-1d233582fece-00016 in container: volumebackups. {{(pid=101319) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 09:54:24.223685 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-fdc56de6-59ae-412a-83d9-6f53db9a63d4 tempest-ProjectMemberTests33-2105464604 None] deleted object: volume_4883604b-dae6-422a-92df-ec0850150bc4/20260703095408/az_nova_backup_97903bb1-73b7-48fa-91c9-1d233582fece-00017 in container: volumebackups. {{(pid=101319) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 09:54:24.282868 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-fdc56de6-59ae-412a-83d9-6f53db9a63d4 tempest-ProjectMemberTests33-2105464604 None] deleted object: volume_4883604b-dae6-422a-92df-ec0850150bc4/20260703095408/az_nova_backup_97903bb1-73b7-48fa-91c9-1d233582fece-00018 in container: volumebackups. {{(pid=101319) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 09:54:24.309154 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-fdc56de6-59ae-412a-83d9-6f53db9a63d4 tempest-ProjectMemberTests33-2105464604 None] deleted object: volume_4883604b-dae6-422a-92df-ec0850150bc4/20260703095408/az_nova_backup_97903bb1-73b7-48fa-91c9-1d233582fece-00019 in container: volumebackups. {{(pid=101319) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 09:54:24.332741 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-fdc56de6-59ae-412a-83d9-6f53db9a63d4 tempest-ProjectMemberTests33-2105464604 None] deleted object: volume_4883604b-dae6-422a-92df-ec0850150bc4/20260703095408/az_nova_backup_97903bb1-73b7-48fa-91c9-1d233582fece-00020 in container: volumebackups. {{(pid=101319) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 09:54:24.354461 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-fdc56de6-59ae-412a-83d9-6f53db9a63d4 tempest-ProjectMemberTests33-2105464604 None] deleted object: volume_4883604b-dae6-422a-92df-ec0850150bc4/20260703095408/az_nova_backup_97903bb1-73b7-48fa-91c9-1d233582fece-00021 in container: volumebackups. {{(pid=101319) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 09:54:24.382357 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-fdc56de6-59ae-412a-83d9-6f53db9a63d4 tempest-ProjectMemberTests33-2105464604 None] deleted object: volume_4883604b-dae6-422a-92df-ec0850150bc4/20260703095408/az_nova_backup_97903bb1-73b7-48fa-91c9-1d233582fece_metadata in container: volumebackups. {{(pid=101319) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 09:54:24.400988 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-fdc56de6-59ae-412a-83d9-6f53db9a63d4 tempest-ProjectMemberTests33-2105464604 None] deleted object: volume_4883604b-dae6-422a-92df-ec0850150bc4/20260703095408/az_nova_backup_97903bb1-73b7-48fa-91c9-1d233582fece_sha256file in container: volumebackups. {{(pid=101319) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 09:54:24.401219 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-fdc56de6-59ae-412a-83d9-6f53db9a63d4 tempest-ProjectMemberTests33-2105464604 None] delete 97903bb1-73b7-48fa-91c9-1d233582fece finished. {{(pid=101319) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:848}} Jul 03 09:54:24.415748 np0000004400 cinder-backup[101319]: DEBUG cinder.quota [None req-fdc56de6-59ae-412a-83d9-6f53db9a63d4 tempest-ProjectMemberTests33-2105464604 None] Created reservations ['6df16fd9-2e21-41fa-b784-0dfdf0da8fda', '93cb3934-b176-4f99-91f9-079349bc4ddd'] {{(pid=101319) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 09:54:24.430352 np0000004400 cinder-backup[101319]: INFO cinder.backup.manager [None req-fdc56de6-59ae-412a-83d9-6f53db9a63d4 tempest-ProjectMemberTests33-2105464604 None] Delete backup finished, backup 97903bb1-73b7-48fa-91c9-1d233582fece deleted. Jul 03 09:54:25.845787 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.driver [None req-d869df1e-3dd0-4fc0-a37e-463bdac92c90 tempest-VolumesBackupsTest-807180270 None] Getting metadata type 'volume-base-metadata' {{(pid=101319) _save_vol_base_meta /opt/stack/cinder/cinder/backup/driver.py:79}} Jul 03 09:54:25.852551 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.driver [None req-d869df1e-3dd0-4fc0-a37e-463bdac92c90 tempest-VolumesBackupsTest-807180270 None] Completed fetching metadata type 'volume-base-metadata' {{(pid=101319) _save_vol_base_meta /opt/stack/cinder/cinder/backup/driver.py:98}} Jul 03 09:54:25.852766 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.driver [None req-d869df1e-3dd0-4fc0-a37e-463bdac92c90 tempest-VolumesBackupsTest-807180270 None] Getting metadata type 'volume-metadata' {{(pid=101319) _save_vol_meta /opt/stack/cinder/cinder/backup/driver.py:109}} Jul 03 09:54:25.856772 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.driver [None req-d869df1e-3dd0-4fc0-a37e-463bdac92c90 tempest-VolumesBackupsTest-807180270 None] No metadata type 'volume-metadata' available {{(pid=101319) _save_vol_meta /opt/stack/cinder/cinder/backup/driver.py:123}} Jul 03 09:54:25.856954 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.driver [None req-d869df1e-3dd0-4fc0-a37e-463bdac92c90 tempest-VolumesBackupsTest-807180270 None] Getting metadata type 'volume-glance-metadata' {{(pid=101319) _save_vol_glance_meta /opt/stack/cinder/cinder/backup/driver.py:132}} Jul 03 09:54:25.860022 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.driver [None req-d869df1e-3dd0-4fc0-a37e-463bdac92c90 tempest-VolumesBackupsTest-807180270 None] No metadata type 'volume-glance-metadata' available {{(pid=101319) _save_vol_glance_meta /opt/stack/cinder/cinder/backup/driver.py:147}} Jul 03 09:54:25.860307 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-d869df1e-3dd0-4fc0-a37e-463bdac92c90 tempest-VolumesBackupsTest-807180270 None] _write_sha256file started, container name: volumebackups, sha256file filename: volume_b578d41f-4c6a-49b3-b5ec-bcd6556e2e68/20260703095422/az_nova_backup_ab559f16-a070-4b18-9c05-f0f3a1985361_sha256file. {{(pid=101319) _write_sha256file /opt/stack/cinder/cinder/backup/chunkeddriver.py:299}} Jul 03 09:54:25.919203 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-d869df1e-3dd0-4fc0-a37e-463bdac92c90 tempest-VolumesBackupsTest-807180270 None] _write_sha256file finished. {{(pid=101319) _write_sha256file /opt/stack/cinder/cinder/backup/chunkeddriver.py:315}} Jul 03 09:54:25.919896 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-d869df1e-3dd0-4fc0-a37e-463bdac92c90 tempest-VolumesBackupsTest-807180270 None] _write_metadata started, container name: volumebackups, metadata filename: volume_b578d41f-4c6a-49b3-b5ec-bcd6556e2e68/20260703095422/az_nova_backup_ab559f16-a070-4b18-9c05-f0f3a1985361_metadata. {{(pid=101319) _write_metadata /opt/stack/cinder/cinder/backup/chunkeddriver.py:276}} Jul 03 09:54:25.941187 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-d869df1e-3dd0-4fc0-a37e-463bdac92c90 tempest-VolumesBackupsTest-807180270 None] _write_metadata finished. Metadata: b'{\n "backup_description": null,\n "backup_id": "ab559f16-a070-4b18-9c05-f0f3a1985361",\n "backup_name": "tempest-VolumesBackupsTest-Backup-1022559932",\n "created_at": "2026-07-03 09:54:19+00:00",\n "objects": [],\n "parent_id": "c52fbc4a-f7d8-49e2-bd92-5bbf2f7f98ba",\n "version": "1.0.0",\n "volume_id": "b578d41f-4c6a-49b3-b5ec-bcd6556e2e68",\n "volume_meta": "{\\"version\\": 2, \\"volume-base-metadata\\": {\\"id\\": \\"b578d41f-4c6a-49b3-b5ec-bcd6556e2e68\\", \\"_name_id\\": null, \\"use_quota\\": true, \\"ec2_id\\": null, \\"user_id\\": \\"e3b8ecc8212649f489f39b74eac8ff8f\\", \\"project_id\\": \\"c36863fd49104594b80b419fafd78f5c\\", \\"snapshot_id\\": null, \\"cluster_name\\": null, \\"host\\": \\"np0000004400@storpool#default\\", \\"size\\": 1, \\"availability_zone\\": \\"nova\\", \\"status\\": \\"backing-up\\", \\"attach_status\\": \\"detached\\", \\"migration_status\\": null, \\"scheduled_at\\": \\"2026-07-03T09:53:43.000000\\", \\"launched_at\\": \\"2026-07-03T09:53:43.000000\\", \\"terminated_at\\": null, \\"display_name\\": \\"tempest-VolumesBackupsTest-Volume-1091773389\\", \\"display_description\\": null, \\"provider_location\\": null, \\"provider_auth\\": null, \\"provider_geometry\\": null, \\"provider_id\\": null, \\"volume_type_id\\": \\"03e13fe6-0e30-4803-ace0-725d38e6dc24\\", \\"source_volid\\": null, \\"encryption_key_id\\": null, \\"consistencygroup_id\\": null, \\"group_id\\": null, \\"bootable\\": false, \\"multiattach\\": false, \\"replication_status\\": null, \\"replication_extended_status\\": null, \\"replication_driver_data\\": null, \\"previous_status\\": \\"available\\", \\"service_uuid\\": \\"6d4b0e79-fefe-4744-b25f-34be05095200\\", \\"shared_targets\\": true, \\"deleted_at\\": null, \\"deleted\\": false, \\"created_at\\": \\"2026-07-03T09:53:43.000000\\", \\"updated_at\\": \\"2026-07-03T09:54:19.000000\\"}}"\n}'. {{(pid=101319) _write_metadata /opt/stack/cinder/cinder/backup/chunkeddriver.py:295}} Jul 03 09:54:25.945495 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-d869df1e-3dd0-4fc0-a37e-463bdac92c90 tempest-VolumesBackupsTest-807180270 None] backup ab559f16-a070-4b18-9c05-f0f3a1985361 finished. {{(pid=101319) _finalize_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:462}} Jul 03 09:54:26.063948 np0000004400 cinder-backup[101319]: DEBUG oslo_concurrency.processutils [None req-d869df1e-3dd0-4fc0-a37e-463bdac92c90 tempest-VolumesBackupsTest-807180270 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chown 0 /dev/sdb {{(pid=101319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 09:54:26.090139 np0000004400 sudo[156068]: stack : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chown 0 /dev/sdb Jul 03 09:54:26.090782 np0000004400 sudo[156068]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1002) Jul 03 09:54:26.208026 np0000004400 cinder-backup[101319]: INFO cinder.backup.manager [None req-c7a2f1c0-d186-4b36-b89b-132cc9579b18 tempest-ProjectMemberTests33-2105464604 None] Create backup started, backup: 6f767c43-dfb9-4a05-93e6-d969f7407465 volume: 28e6e1d6-2242-44e7-9f43-e6ae7f7d5f56. Jul 03 09:54:26.217264 np0000004400 cinder-backup[101319]: INFO cinder.backup.manager [None req-c7a2f1c0-d186-4b36-b89b-132cc9579b18 tempest-ProjectMemberTests33-2105464604 None] Call Volume Manager to get_backup_device for Backup(availability_zone='nova',container=None,created_at=2026-07-03T09:54:26Z,data_timestamp=2026-07-03T09:54:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-type-Backup-1802209562',encryption_key_id=None,fail_reason=None,host='np0000004400',id=6f767c43-dfb9-4a05-93e6-d969f7407465,metadata={},num_dependent_backups=0,object_count=0,parent=None,parent_id=None,project_id='e0b6e59b911e40b3acac38afb1f81e3a',restore_volume_id=None,service='cinder.backup.drivers.swift.SwiftBackupDriver',service_metadata=None,size=1,snapshot_id=None,status='creating',temp_snapshot_id=None,temp_volume_id=None,updated_at=None,user_id='87abbb474f8a4baf840fcfdf286ff94e',volume_id=28e6e1d6-2242-44e7-9f43-e6ae7f7d5f56) Jul 03 09:54:26.245364 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.drivers.swift [None req-c7a2f1c0-d186-4b36-b89b-132cc9579b18 tempest-ProjectMemberTests33-2105464604 None] Using swift URL https://10.4.3.95:8080/v1/AUTH_e0b6e59b911e40b3acac38afb1f81e3a {{(pid=101319) initialize /opt/stack/cinder/cinder/backup/drivers/swift.py:300}} Jul 03 09:54:26.245645 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.drivers.swift [None req-c7a2f1c0-d186-4b36-b89b-132cc9579b18 tempest-ProjectMemberTests33-2105464604 None] Connect to https://10.4.3.95:8080/v1/AUTH_ in "per_user" mode {{(pid=101319) initialize /opt/stack/cinder/cinder/backup/drivers/swift.py:301}} Jul 03 09:54:26.246103 np0000004400 cinder-backup[101319]: DEBUG os_brick.utils [None req-c7a2f1c0-d186-4b36-b89b-132cc9579b18 tempest-ProjectMemberTests33-2105464604 None] ==> get_connector_properties: call "{'root_helper': 'sudo cinder-rootwrap /etc/cinder/rootwrap.conf', 'my_ip': '10.4.3.95', 'multipath': False, 'enforce_multipath': False, 'host': None, 'execute': None}" {{(pid=101319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}} Jul 03 09:54:26.261803 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.scaleio [None req-c7a2f1c0-d186-4b36-b89b-132cc9579b18 tempest-ProjectMemberTests33-2105464604 None] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=101319) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}} Jul 03 09:54:26.281992 np0000004400 cinder-backup[101319]: DEBUG oslo_concurrency.processutils [None req-c7a2f1c0-d186-4b36-b89b-132cc9579b18 tempest-ProjectMemberTests33-2105464604 None] Running cmd (subprocess): nvme version {{(pid=101319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 09:54:26.296878 np0000004400 cinder-backup[101319]: DEBUG oslo_concurrency.processutils [None req-c7a2f1c0-d186-4b36-b89b-132cc9579b18 tempest-ProjectMemberTests33-2105464604 None] 'nvme version' failed. Not Retrying. {{(pid=101319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 03 09:54:26.297166 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.nvmeof [None req-c7a2f1c0-d186-4b36-b89b-132cc9579b18 tempest-ProjectMemberTests33-2105464604 None] nvme not present on system {{(pid=101319) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}} Jul 03 09:54:26.308165 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.lightos [None req-c7a2f1c0-d186-4b36-b89b-132cc9579b18 tempest-ProjectMemberTests33-2105464604 None] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=101319) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}} Jul 03 09:54:26.309214 np0000004400 cinder-backup[101319]: INFO os_brick.initiator.connectors.lightos [None req-c7a2f1c0-d186-4b36-b89b-132cc9579b18 tempest-ProjectMemberTests33-2105464604 None] Current host hostNQN and IP(s) are ['10.4.3.95', 'fe80::f816:3eff:fe47:268c', '192.168.40.6', 'fe80::f816:3eff:febf:7be2', '192.168.50.6', 'fe80::f816:3eff:fe99:8914', '192.168.10.6', 'fe80::f816:3eff:fe2f:e696', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::bc9d:84ff:fec2:6b49', 'fe80::fc16:3eff:fec3:bd5f', 'fe80::8cea:42ff:fe99:b64a'] Jul 03 09:54:26.309378 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.lightos [None req-c7a2f1c0-d186-4b36-b89b-132cc9579b18 tempest-ProjectMemberTests33-2105464604 None] LIGHTOS: did not find dsc, continuing anyway. {{(pid=101319) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}} Jul 03 09:54:26.309574 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.lightos [None req-c7a2f1c0-d186-4b36-b89b-132cc9579b18 tempest-ProjectMemberTests33-2105464604 None] LIGHTOS: no hostnqn found. {{(pid=101319) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}} Jul 03 09:54:26.309909 np0000004400 cinder-backup[101319]: DEBUG os_brick.utils [None req-c7a2f1c0-d186-4b36-b89b-132cc9579b18 tempest-ProjectMemberTests33-2105464604 None] <== get_connector_properties: return (63ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.95', 'host': 'np0000004400', 'multipath': False, 'enforce_multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:ae7e5bb0ebe6', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': '6b284368-d0ba-4d18-af6f-4998d3955c52', 'nvme_native_multipath': False} {{(pid=101319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}} Jul 03 09:54:26.397299 np0000004400 sudo[156068]: pam_unix(sudo:session): session closed for user root Jul 03 09:54:26.399171 np0000004400 cinder-backup[101319]: DEBUG oslo_concurrency.processutils [None req-d869df1e-3dd0-4fc0-a37e-463bdac92c90 tempest-VolumesBackupsTest-807180270 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chown 0 /dev/sdb" returned: 0 in 0.335s {{(pid=101319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 09:54:26.400004 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-d869df1e-3dd0-4fc0-a37e-463bdac92c90 tempest-VolumesBackupsTest-807180270 None] ==> disconnect_volume: call "{'args': (, {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-b578d41f-4c6a-49b3-b5ec-bcd6556e2e68', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'b578d41f-4c6a-49b3-b5ec-bcd6556e2e68', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': False}, {'type': 'block', 'scsi_wwn': '1StorPooliSCSI_DISK_1034578903445799236', 'path': '/dev/sdb'}), 'kwargs': {'force': True, 'ignore_errors': True}}" {{(pid=101319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}} Jul 03 09:54:26.400201 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.base [None req-d869df1e-3dd0-4fc0-a37e-463bdac92c90 tempest-VolumesBackupsTest-807180270 None] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=101319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jul 03 09:54:26.400690 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.base [None req-d869df1e-3dd0-4fc0-a37e-463bdac92c90 tempest-VolumesBackupsTest-807180270 None] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.000s {{(pid=101319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jul 03 09:54:26.401036 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-d869df1e-3dd0-4fc0-a37e-463bdac92c90 tempest-VolumesBackupsTest-807180270 None] _get_connection_devices called with parameters: connection_properties={'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-b578d41f-4c6a-49b3-b5ec-bcd6556e2e68', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'b578d41f-4c6a-49b3-b5ec-bcd6556e2e68', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': False}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=101319) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:847}} Jul 03 09:54:26.410603 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-d869df1e-3dd0-4fc0-a37e-463bdac92c90 tempest-VolumesBackupsTest-807180270 None] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS: Jul 03 09:54:26.410603 np0000004400 cinder-backup[101319]: No targets found. Jul 03 09:54:26.410603 np0000004400 cinder-backup[101319]: iSNS: Jul 03 09:54:26.410603 np0000004400 cinder-backup[101319]: No targets found. Jul 03 09:54:26.410603 np0000004400 cinder-backup[101319]: STATIC: Jul 03 09:54:26.410603 np0000004400 cinder-backup[101319]: Target: iqn.2023-03.storpool.com:os--volume-b578d41f-4c6a-49b3-b5ec-bcd6556e2e68 Jul 03 09:54:26.410603 np0000004400 cinder-backup[101319]: Portal: 192.168.40.100:3260,-1 Jul 03 09:54:26.410603 np0000004400 cinder-backup[101319]: Iface Name: default Jul 03 09:54:26.410603 np0000004400 cinder-backup[101319]: Target: iqn.2023-03.storpool.com:os--volume-789ec59e-ea87-4784-8990-156a35276b5f Jul 03 09:54:26.410603 np0000004400 cinder-backup[101319]: Portal: 192.168.50.100:3260,-1 Jul 03 09:54:26.410603 np0000004400 cinder-backup[101319]: Iface Name: default Jul 03 09:54:26.410603 np0000004400 cinder-backup[101319]: Portal: 192.168.40.100:3260,-1 Jul 03 09:54:26.410603 np0000004400 cinder-backup[101319]: Iface Name: default Jul 03 09:54:26.410603 np0000004400 cinder-backup[101319]: FIRMWARE: Jul 03 09:54:26.410603 np0000004400 cinder-backup[101319]: No targets found. Jul 03 09:54:26.410603 np0000004400 cinder-backup[101319]: stderr= {{(pid=101319) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jul 03 09:54:26.410992 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-d869df1e-3dd0-4fc0-a37e-463bdac92c90 tempest-VolumesBackupsTest-807180270 None] Regex to get portals from discoverydb: ^SENDTARGETS: Jul 03 09:54:26.410992 np0000004400 cinder-backup[101319]: .*?^DiscoveryAddress: 192.168.40.100,3260.*? Jul 03 09:54:26.410992 np0000004400 cinder-backup[101319]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=101319) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:390}} Jul 03 09:54:26.411054 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-d869df1e-3dd0-4fc0-a37e-463bdac92c90 tempest-VolumesBackupsTest-807180270 None] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-b578d41f-4c6a-49b3-b5ec-bcd6556e2e68', 0)] {{(pid=101319) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:858}} Jul 03 09:54:26.433905 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-d869df1e-3dd0-4fc0-a37e-463bdac92c90 tempest-VolumesBackupsTest-807180270 None] iscsiadm ('-m', 'session'): stdout=tcp: [208] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-789ec59e-ea87-4784-8990-156a35276b5f (non-flash) Jul 03 09:54:26.433905 np0000004400 cinder-backup[101319]: tcp: [209] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-789ec59e-ea87-4784-8990-156a35276b5f (non-flash) Jul 03 09:54:26.433905 np0000004400 cinder-backup[101319]: tcp: [212] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b578d41f-4c6a-49b3-b5ec-bcd6556e2e68 (non-flash) Jul 03 09:54:26.433905 np0000004400 cinder-backup[101319]: stderr= {{(pid=101319) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jul 03 09:54:26.434079 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-d869df1e-3dd0-4fc0-a37e-463bdac92c90 tempest-VolumesBackupsTest-807180270 None] iscsi session list stdout=tcp: [208] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-789ec59e-ea87-4784-8990-156a35276b5f (non-flash) Jul 03 09:54:26.434079 np0000004400 cinder-backup[101319]: tcp: [209] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-789ec59e-ea87-4784-8990-156a35276b5f (non-flash) Jul 03 09:54:26.434079 np0000004400 cinder-backup[101319]: tcp: [212] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b578d41f-4c6a-49b3-b5ec-bcd6556e2e68 (non-flash) Jul 03 09:54:26.434079 np0000004400 cinder-backup[101319]: stderr= {{(pid=101319) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jul 03 09:54:26.434184 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-d869df1e-3dd0-4fc0-a37e-463bdac92c90 tempest-VolumesBackupsTest-807180270 None] Sessions list: [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-789ec59e-ea87-4784-8990-156a35276b5f', '208'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-789ec59e-ea87-4784-8990-156a35276b5f', '209'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-b578d41f-4c6a-49b3-b5ec-bcd6556e2e68', '212')] {{(pid=101319) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:866}} Jul 03 09:54:26.434346 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-d869df1e-3dd0-4fc0-a37e-463bdac92c90 tempest-VolumesBackupsTest-807180270 None] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-b578d41f-4c6a-49b3-b5ec-bcd6556e2e68, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-b578d41f-4c6a-49b3-b5ec-bcd6556e2e68', '212')] {{(pid=101319) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}} Jul 03 09:54:26.435290 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-d869df1e-3dd0-4fc0-a37e-463bdac92c90 tempest-VolumesBackupsTest-807180270 None] Resulting device map defaultdict(. at 0x7e7705877240>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-b578d41f-4c6a-49b3-b5ec-bcd6556e2e68'): ({'sdb'}, set())}) {{(pid=101319) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:912}} Jul 03 09:54:26.435584 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.linuxscsi [None req-d869df1e-3dd0-4fc0-a37e-463bdac92c90 tempest-VolumesBackupsTest-807180270 None] Removing single pathed devices sdb {{(pid=101319) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}} Jul 03 09:54:26.446518 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.linuxscsi [None req-d869df1e-3dd0-4fc0-a37e-463bdac92c90 tempest-VolumesBackupsTest-807180270 None] Flushing IO for device /dev/sdb {{(pid=101319) flush_device_io /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:461}} Jul 03 09:54:26.453721 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.linuxscsi [None req-d869df1e-3dd0-4fc0-a37e-463bdac92c90 tempest-VolumesBackupsTest-807180270 None] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=101319) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}} Jul 03 09:54:26.488807 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.linuxscsi [None req-d869df1e-3dd0-4fc0-a37e-463bdac92c90 tempest-VolumesBackupsTest-807180270 None] Checking to see if SCSI volumes sdb have been removed. {{(pid=101319) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}} Jul 03 09:54:26.488995 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.linuxscsi [None req-d869df1e-3dd0-4fc0-a37e-463bdac92c90 tempest-VolumesBackupsTest-807180270 None] SCSI volumes sdb have been removed. {{(pid=101319) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}} Jul 03 09:54:26.489775 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.linuxscsi [None req-d869df1e-3dd0-4fc0-a37e-463bdac92c90 tempest-VolumesBackupsTest-807180270 None] Checking to see if device paths {'sdb'} are still under multipathd monitoring {{(pid=101319) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}} Jul 03 09:54:26.499521 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.linuxscsi [None req-d869df1e-3dd0-4fc0-a37e-463bdac92c90 tempest-VolumesBackupsTest-807180270 None] Device paths {'sdb'} have been removed from multipathd monitoring. {{(pid=101319) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}} Jul 03 09:54:26.499763 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-d869df1e-3dd0-4fc0-a37e-463bdac92c90 tempest-VolumesBackupsTest-807180270 None] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-b578d41f-4c6a-49b3-b5ec-bcd6556e2e68')] {{(pid=101319) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1225}} Jul 03 09:54:26.510139 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-d869df1e-3dd0-4fc0-a37e-463bdac92c90 tempest-VolumesBackupsTest-807180270 None] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=101319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 03 09:54:26.544207 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-d869df1e-3dd0-4fc0-a37e-463bdac92c90 tempest-VolumesBackupsTest-807180270 None] iscsiadm ('--logout',): stdout=Logging out of session [sid: 212, target: iqn.2023-03.storpool.com:os--volume-b578d41f-4c6a-49b3-b5ec-bcd6556e2e68, portal: 192.168.40.100,3260] Jul 03 09:54:26.544207 np0000004400 cinder-backup[101319]: Logout of [sid: 212, target: iqn.2023-03.storpool.com:os--volume-b578d41f-4c6a-49b3-b5ec-bcd6556e2e68, portal: 192.168.40.100,3260] successful. Jul 03 09:54:26.544207 np0000004400 cinder-backup[101319]: stderr= {{(pid=101319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 03 09:54:26.554559 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-d869df1e-3dd0-4fc0-a37e-463bdac92c90 tempest-VolumesBackupsTest-807180270 None] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=101319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 03 09:54:26.554788 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.base [None req-d869df1e-3dd0-4fc0-a37e-463bdac92c90 tempest-VolumesBackupsTest-807180270 None] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.154s {{(pid=101319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jul 03 09:54:26.554982 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-d869df1e-3dd0-4fc0-a37e-463bdac92c90 tempest-VolumesBackupsTest-807180270 None] <== disconnect_volume: return (154ms) None {{(pid=101319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}} Jul 03 09:54:26.813714 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connector [None req-c7a2f1c0-d186-4b36-b89b-132cc9579b18 tempest-ProjectMemberTests33-2105464604 None] Factory for iscsi on None {{(pid=101319) factory /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connector.py:243}} Jul 03 09:54:26.814043 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-c7a2f1c0-d186-4b36-b89b-132cc9579b18 tempest-ProjectMemberTests33-2105464604 None] ==> connect_volume: call "{'self': , 'connection_properties': {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-28e6e1d6-2242-44e7-9f43-e6ae7f7d5f56', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '28e6e1d6-2242-44e7-9f43-e6ae7f7d5f56', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': False}}" {{(pid=101319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}} Jul 03 09:54:26.814204 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.base [None req-c7a2f1c0-d186-4b36-b89b-132cc9579b18 tempest-ProjectMemberTests33-2105464604 None] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=101319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jul 03 09:54:26.814540 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.base [None req-c7a2f1c0-d186-4b36-b89b-132cc9579b18 tempest-ProjectMemberTests33-2105464604 None] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.000s {{(pid=101319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jul 03 09:54:26.814737 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.base [None req-c7a2f1c0-d186-4b36-b89b-132cc9579b18 tempest-ProjectMemberTests33-2105464604 None] Connection properties {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-28e6e1d6-2242-44e7-9f43-e6ae7f7d5f56', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '28e6e1d6-2242-44e7-9f43-e6ae7f7d5f56', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': False} {{(pid=101319) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}} Jul 03 09:54:26.824712 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.base [None req-c7a2f1c0-d186-4b36-b89b-132cc9579b18 tempest-ProjectMemberTests33-2105464604 None] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-28e6e1d6-2242-44e7-9f43-e6ae7f7d5f56" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=101319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jul 03 09:54:26.825039 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.base [None req-c7a2f1c0-d186-4b36-b89b-132cc9579b18 tempest-ProjectMemberTests33-2105464604 None] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-28e6e1d6-2242-44e7-9f43-e6ae7f7d5f56" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.000s {{(pid=101319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jul 03 09:54:26.825222 np0000004400 cinder-backup[101319]: INFO os_brick.initiator.connectors.iscsi [None req-c7a2f1c0-d186-4b36-b89b-132cc9579b18 tempest-ProjectMemberTests33-2105464604 None] Trying to connect to iSCSI portal 192.168.40.100:3260 Jul 03 09:54:26.836483 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-c7a2f1c0-d186-4b36-b89b-132cc9579b18 tempest-ProjectMemberTests33-2105464604 None] iscsiadm (): stdout= stderr=iscsiadm: No records found Jul 03 09:54:26.836483 np0000004400 cinder-backup[101319]: {{(pid=101319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 03 09:54:26.846718 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-c7a2f1c0-d186-4b36-b89b-132cc9579b18 tempest-ProjectMemberTests33-2105464604 None] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-28e6e1d6-2242-44e7-9f43-e6ae7f7d5f56] added Jul 03 09:54:26.846718 np0000004400 cinder-backup[101319]: stderr=iscsiadm: Config file line 363 does not have value Jul 03 09:54:26.846718 np0000004400 cinder-backup[101319]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs' Jul 03 09:54:26.846718 np0000004400 cinder-backup[101319]: iscsiadm: Config file line 363 does not have value Jul 03 09:54:26.846718 np0000004400 cinder-backup[101319]: iscsiadm: Config file line 363 does not have value Jul 03 09:54:26.846718 np0000004400 cinder-backup[101319]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs' Jul 03 09:54:26.846718 np0000004400 cinder-backup[101319]: {{(pid=101319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 03 09:54:26.847201 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-c7a2f1c0-d186-4b36-b89b-132cc9579b18 tempest-ProjectMemberTests33-2105464604 None] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=101319) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}} Jul 03 09:54:26.847339 np0000004400 cinder-backup[101319]: DEBUG os_brick.utils [None req-c7a2f1c0-d186-4b36-b89b-132cc9579b18 tempest-ProjectMemberTests33-2105464604 None] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0219(s), this was the 1st time calling it. {{(pid=101319) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}} Jul 03 09:54:26.847588 np0000004400 cinder-backup[101319]: DEBUG os_brick.utils [None req-c7a2f1c0-d186-4b36-b89b-132cc9579b18 tempest-ProjectMemberTests33-2105464604 None] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=101319) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}} Jul 03 09:54:27.614882 np0000004400 cinder-backup[101319]: DEBUG oslo_db.sqlalchemy.engines [None req-d869df1e-3dd0-4fc0-a37e-463bdac92c90 tempest-VolumesBackupsTest-807180270 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=101319) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 03 09:54:27.636463 np0000004400 cinder-backup[101319]: INFO cinder.backup.manager [None req-d869df1e-3dd0-4fc0-a37e-463bdac92c90 tempest-VolumesBackupsTest-807180270 None] Create backup finished. backup: ab559f16-a070-4b18-9c05-f0f3a1985361. Jul 03 09:54:27.848540 np0000004400 cinder-backup[101319]: INFO os_brick.initiator.connectors.iscsi [None req-c7a2f1c0-d186-4b36-b89b-132cc9579b18 tempest-ProjectMemberTests33-2105464604 None] Trying to connect to iSCSI portal 192.168.40.100:3260 Jul 03 09:54:27.859290 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-c7a2f1c0-d186-4b36-b89b-132cc9579b18 tempest-ProjectMemberTests33-2105464604 None] iscsiadm (): stdout=# BEGIN RECORD 2.1.9 Jul 03 09:54:27.859290 np0000004400 cinder-backup[101319]: node.name = iqn.2023-03.storpool.com:os--volume-28e6e1d6-2242-44e7-9f43-e6ae7f7d5f56 Jul 03 09:54:27.859290 np0000004400 cinder-backup[101319]: node.tpgt = -1 Jul 03 09:54:27.859290 np0000004400 cinder-backup[101319]: node.startup = manual Jul 03 09:54:27.859290 np0000004400 cinder-backup[101319]: node.leading_login = No Jul 03 09:54:27.859290 np0000004400 cinder-backup[101319]: iface.iscsi_ifacename = default Jul 03 09:54:27.859290 np0000004400 cinder-backup[101319]: iface.net_ifacename = Jul 03 09:54:27.859290 np0000004400 cinder-backup[101319]: iface.ipaddress = Jul 03 09:54:27.859290 np0000004400 cinder-backup[101319]: iface.prefix_len = 0 Jul 03 09:54:27.859290 np0000004400 cinder-backup[101319]: iface.hwaddress = Jul 03 09:54:27.859290 np0000004400 cinder-backup[101319]: iface.transport_name = tcp Jul 03 09:54:27.859290 np0000004400 cinder-backup[101319]: iface.initiatorname = Jul 03 09:54:27.859290 np0000004400 cinder-backup[101319]: iface.state = Jul 03 09:54:27.859290 np0000004400 cinder-backup[101319]: iface.vlan_id = 0 Jul 03 09:54:27.859290 np0000004400 cinder-backup[101319]: iface.vlan_priority = 0 Jul 03 09:54:27.859290 np0000004400 cinder-backup[101319]: iface.vlan_state = Jul 03 09:54:27.859290 np0000004400 cinder-backup[101319]: iface.iface_num = 0 Jul 03 09:54:27.859290 np0000004400 cinder-backup[101319]: iface.mtu = 0 Jul 03 09:54:27.859290 np0000004400 cinder-backup[101319]: iface.port = 0 Jul 03 09:54:27.859290 np0000004400 cinder-backup[101319]: iface.bootproto = Jul 03 09:54:27.859290 np0000004400 cinder-backup[101319]: iface.subnet_mask = Jul 03 09:54:27.859290 np0000004400 cinder-backup[101319]: iface.gateway = Jul 03 09:54:27.859290 np0000004400 cinder-backup[101319]: iface.dhcp_alt_client_id_state = Jul 03 09:54:27.859290 np0000004400 cinder-backup[101319]: iface.dhcp_alt_client_id = Jul 03 09:54:27.859290 np0000004400 cinder-backup[101319]: iface.dhcp_dns = Jul 03 09:54:27.859290 np0000004400 cinder-backup[101319]: iface.dhcp_learn_iqn = Jul 03 09:54:27.859290 np0000004400 cinder-backup[101319]: iface.dhcp_req_vendor_id_state = Jul 03 09:54:27.859290 np0000004400 cinder-backup[101319]: iface.dhcp_vendor_id_state = Jul 03 09:54:27.859290 np0000004400 cinder-backup[101319]: iface.dhcp_vendor_id = Jul 03 09:54:27.859290 np0000004400 cinder-backup[101319]: iface.dhcp_slp_da = Jul 03 09:54:27.859290 np0000004400 cinder-backup[101319]: iface.fragmentation = Jul 03 09:54:27.859290 np0000004400 cinder-backup[101319]: iface.gratuitous_arp = Jul 03 09:54:27.859290 np0000004400 cinder-backup[101319]: iface.incoming_forwarding = Jul 03 09:54:27.859290 np0000004400 cinder-backup[101319]: iface.tos_state = Jul 03 09:54:27.859290 np0000004400 cinder-backup[101319]: iface.tos = 0 Jul 03 09:54:27.859290 np0000004400 cinder-backup[101319]: iface.ttl = 0 Jul 03 09:54:27.859290 np0000004400 cinder-backup[101319]: iface.delayed_ack = Jul 03 09:54:27.859290 np0000004400 cinder-backup[101319]: iface.tcp_nagle = Jul 03 09:54:27.859290 np0000004400 cinder-backup[101319]: iface.tcp_wsf_state = Jul 03 09:54:27.859290 np0000004400 cinder-backup[101319]: iface.tcp_wsf = 0 Jul 03 09:54:27.859290 np0000004400 cinder-backup[101319]: iface.tcp_timer_scale = 0 Jul 03 09:54:27.859290 np0000004400 cinder-backup[101319]: iface.tcp_timestamp = Jul 03 09:54:27.859290 np0000004400 cinder-backup[101319]: iface.redirect = Jul 03 09:54:27.859290 np0000004400 cinder-backup[101319]: iface.def_task_mgmt_timeout = 0 Jul 03 09:54:27.859290 np0000004400 cinder-backup[101319]: iface.header_digest = Jul 03 09:54:27.859290 np0000004400 cinder-backup[101319]: iface.data_digest = Jul 03 09:54:27.859290 np0000004400 cinder-backup[101319]: iface.immediate_data = Jul 03 09:54:27.859290 np0000004400 cinder-backup[101319]: iface.initial_r2t = Jul 03 09:54:27.859290 np0000004400 cinder-backup[101319]: iface.data_seq_inorder = Jul 03 09:54:27.859290 np0000004400 cinder-backup[101319]: iface.data_pdu_inorder = Jul 03 09:54:27.859290 np0000004400 cinder-backup[101319]: iface.erl = 0 Jul 03 09:54:27.859290 np0000004400 cinder-backup[101319]: iface.max_receive_data_len = 0 Jul 03 09:54:27.859290 np0000004400 cinder-backup[101319]: iface.first_burst_len = 0 Jul 03 09:54:27.859290 np0000004400 cinder-backup[101319]: iface.max_outstanding_r2t = 0 Jul 03 09:54:27.859290 np0000004400 cinder-backup[101319]: iface.max_burst_len = 0 Jul 03 09:54:27.859290 np0000004400 cinder-backup[101319]: iface.chap_auth = Jul 03 09:54:27.859290 np0000004400 cinder-backup[101319]: iface.bidi_chap = Jul 03 09:54:27.859290 np0000004400 cinder-backup[101319]: iface.strict_login_compliance = Jul 03 09:54:27.859290 np0000004400 cinder-backup[101319]: iface.discovery_auth = Jul 03 09:54:27.859290 np0000004400 cinder-backup[101319]: iface.discovery_logout = Jul 03 09:54:27.859290 np0000004400 cinder-backup[101319]: node.discovery_address = Jul 03 09:54:27.859290 np0000004400 cinder-backup[101319]: node.discovery_port = 0 Jul 03 09:54:27.859290 np0000004400 cinder-backup[101319]: node.discovery_type = fw Jul 03 09:54:27.859290 np0000004400 cinder-backup[101319]: node.session.initial_cmdsn = 0 Jul 03 09:54:27.859290 np0000004400 cinder-backup[101319]: node.session.initial_login_retry_max = 8 Jul 03 09:54:27.859290 np0000004400 cinder-backup[101319]: node.session.xmit_thread_priority = 0 Jul 03 09:54:27.859290 np0000004400 cinder-backup[101319]: node.session.cmds_max = 128 Jul 03 09:54:27.859290 np0000004400 cinder-backup[101319]: node.session.queue_depth = 32 Jul 03 09:54:27.859290 np0000004400 cinder-backup[101319]: node.session.nr_sessions = 1 Jul 03 09:54:27.859290 np0000004400 cinder-backup[101319]: node.session.auth.authmethod = None Jul 03 09:54:27.859290 np0000004400 cinder-backup[101319]: node.session.auth.username = Jul 03 09:54:27.859290 np0000004400 cinder-backup[101319]: node.session.auth.password = *** Jul 03 09:54:27.859290 np0000004400 cinder-backup[101319]: node.session.auth.username_in = Jul 03 09:54:27.859290 np0000004400 cinder-backup[101319]: node.session.auth.password_in = Jul 03 09:54:27.859290 np0000004400 cinder-backup[101319]: node.session.auth.chap_algs = SHA256 Jul 03 09:54:27.859290 np0000004400 cinder-backup[101319]: node.session.timeo.replacement_timeout = 120 Jul 03 09:54:27.859290 np0000004400 cinder-backup[101319]: node.session.err_timeo.abort_timeout = 15 Jul 03 09:54:27.859290 np0000004400 cinder-backup[101319]: node.session.err_timeo.lu_reset_timeout = 30 Jul 03 09:54:27.859290 np0000004400 cinder-backup[101319]: node.session.err_timeo.tgt_reset_timeout = 30 Jul 03 09:54:27.859290 np0000004400 cinder-backup[101319]: node.session.err_timeo.host_reset_timeout = 60 Jul 03 09:54:27.859290 np0000004400 cinder-backup[101319]: node.session.iscsi.FastAbort = Yes Jul 03 09:54:27.859290 np0000004400 cinder-backup[101319]: node.session.iscsi.InitialR2T = No Jul 03 09:54:27.859290 np0000004400 cinder-backup[101319]: node.session.iscsi.ImmediateData = Yes Jul 03 09:54:27.859290 np0000004400 cinder-backup[101319]: node.session.iscsi.FirstBurstLength = 262144 Jul 03 09:54:27.859290 np0000004400 cinder-backup[101319]: node.session.iscsi.MaxBurstLength = 16776192 Jul 03 09:54:27.859290 np0000004400 cinder-backup[101319]: node.session.iscsi.DefaultTime2Retain = 0 Jul 03 09:54:27.859290 np0000004400 cinder-backup[101319]: node.session.iscsi.DefaultTime2Wait = 2 Jul 03 09:54:27.859290 np0000004400 cinder-backup[101319]: node.session.iscsi.MaxConnections = 1 Jul 03 09:54:27.859290 np0000004400 cinder-backup[101319]: node.session.iscsi.MaxOutstandingR2T = 1 Jul 03 09:54:27.859290 np0000004400 cinder-backup[101319]: node.session.iscsi.ERL = 0 Jul 03 09:54:27.859290 np0000004400 cinder-backup[101319]: node.session.scan = auto Jul 03 09:54:27.859290 np0000004400 cinder-backup[101319]: node.session.reopen_max = 0 Jul 03 09:54:27.859290 np0000004400 cinder-backup[101319]: node.conn[0].address = 192.168.40.100 Jul 03 09:54:27.859290 np0000004400 cinder-backup[101319]: node.conn[0].port = 3260 Jul 03 09:54:27.859290 np0000004400 cinder-backup[101319]: node.conn[0].startup = manual Jul 03 09:54:27.859290 np0000004400 cinder-backup[101319]: node.conn[0].tcp.window_size = 524288 Jul 03 09:54:27.859290 np0000004400 cinder-backup[101319]: node.conn[0].tcp.type_of_service = 0 Jul 03 09:54:27.859290 np0000004400 cinder-backup[101319]: node.conn[0].timeo.logout_timeout = 15 Jul 03 09:54:27.859290 np0000004400 cinder-backup[101319]: node.conn[0].timeo.login_timeout = 15 Jul 03 09:54:27.859290 np0000004400 cinder-backup[101319]: node.conn[0].timeo.auth_timeout = 45 Jul 03 09:54:27.859290 np0000004400 cinder-backup[101319]: node.conn[0].timeo.noop_out_interval = 5 Jul 03 09:54:27.859290 np0000004400 cinder-backup[101319]: node.conn[0].timeo.noop_out_timeout = 5 Jul 03 09:54:27.859290 np0000004400 cinder-backup[101319]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0 Jul 03 09:54:27.859290 np0000004400 cinder-backup[101319]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144 Jul 03 09:54:27.859290 np0000004400 cinder-backup[101319]: node.conn[0].iscsi.HeaderDigest = None Jul 03 09:54:27.859290 np0000004400 cinder-backup[101319]: node.conn[0].iscsi.DataDigest = None Jul 03 09:54:27.859290 np0000004400 cinder-backup[101319]: node.conn[0].iscsi.IFMarker = No Jul 03 09:54:27.859290 np0000004400 cinder-backup[101319]: node.conn[0].iscsi.OFMarker = No Jul 03 09:54:27.859290 np0000004400 cinder-backup[101319]: # END RECORD Jul 03 09:54:27.859290 np0000004400 cinder-backup[101319]: stderr= {{(pid=101319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 03 09:54:27.870043 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-c7a2f1c0-d186-4b36-b89b-132cc9579b18 tempest-ProjectMemberTests33-2105464604 None] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=101319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 03 09:54:27.881116 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-c7a2f1c0-d186-4b36-b89b-132cc9579b18 tempest-ProjectMemberTests33-2105464604 None] iscsiadm ('-m', 'session'): stdout=tcp: [208] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-789ec59e-ea87-4784-8990-156a35276b5f (non-flash) Jul 03 09:54:27.881116 np0000004400 cinder-backup[101319]: tcp: [209] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-789ec59e-ea87-4784-8990-156a35276b5f (non-flash) Jul 03 09:54:27.881116 np0000004400 cinder-backup[101319]: stderr= {{(pid=101319) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jul 03 09:54:27.881116 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-c7a2f1c0-d186-4b36-b89b-132cc9579b18 tempest-ProjectMemberTests33-2105464604 None] iscsi session list stdout=tcp: [208] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-789ec59e-ea87-4784-8990-156a35276b5f (non-flash) Jul 03 09:54:27.881116 np0000004400 cinder-backup[101319]: tcp: [209] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-789ec59e-ea87-4784-8990-156a35276b5f (non-flash) Jul 03 09:54:27.881116 np0000004400 cinder-backup[101319]: stderr= {{(pid=101319) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jul 03 09:54:27.912923 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-c7a2f1c0-d186-4b36-b89b-132cc9579b18 tempest-ProjectMemberTests33-2105464604 None] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-28e6e1d6-2242-44e7-9f43-e6ae7f7d5f56, portal: 192.168.40.100,3260] Jul 03 09:54:27.912923 np0000004400 cinder-backup[101319]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-28e6e1d6-2242-44e7-9f43-e6ae7f7d5f56, portal: 192.168.40.100,3260] successful. Jul 03 09:54:27.912923 np0000004400 cinder-backup[101319]: stderr= {{(pid=101319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 03 09:54:27.922593 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-c7a2f1c0-d186-4b36-b89b-132cc9579b18 tempest-ProjectMemberTests33-2105464604 None] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=101319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 03 09:54:27.934781 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-c7a2f1c0-d186-4b36-b89b-132cc9579b18 tempest-ProjectMemberTests33-2105464604 None] iscsiadm ('-m', 'session'): stdout=tcp: [208] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-789ec59e-ea87-4784-8990-156a35276b5f (non-flash) Jul 03 09:54:27.934781 np0000004400 cinder-backup[101319]: tcp: [209] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-789ec59e-ea87-4784-8990-156a35276b5f (non-flash) Jul 03 09:54:27.934781 np0000004400 cinder-backup[101319]: tcp: [213] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-28e6e1d6-2242-44e7-9f43-e6ae7f7d5f56 (non-flash) Jul 03 09:54:27.934781 np0000004400 cinder-backup[101319]: stderr= {{(pid=101319) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jul 03 09:54:27.934781 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-c7a2f1c0-d186-4b36-b89b-132cc9579b18 tempest-ProjectMemberTests33-2105464604 None] iscsi session list stdout=tcp: [208] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-789ec59e-ea87-4784-8990-156a35276b5f (non-flash) Jul 03 09:54:27.934781 np0000004400 cinder-backup[101319]: tcp: [209] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-789ec59e-ea87-4784-8990-156a35276b5f (non-flash) Jul 03 09:54:27.934781 np0000004400 cinder-backup[101319]: tcp: [213] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-28e6e1d6-2242-44e7-9f43-e6ae7f7d5f56 (non-flash) Jul 03 09:54:27.934781 np0000004400 cinder-backup[101319]: stderr= {{(pid=101319) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jul 03 09:54:27.934781 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.base [None req-c7a2f1c0-d186-4b36-b89b-132cc9579b18 tempest-ProjectMemberTests33-2105464604 None] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-28e6e1d6-2242-44e7-9f43-e6ae7f7d5f56" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.109s {{(pid=101319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jul 03 09:54:27.934781 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-c7a2f1c0-d186-4b36-b89b-132cc9579b18 tempest-ProjectMemberTests33-2105464604 None] Connected to 192.168.40.100:3260 {{(pid=101319) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}} Jul 03 09:54:27.934781 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.linuxscsi [None req-c7a2f1c0-d186-4b36-b89b-132cc9579b18 tempest-ProjectMemberTests33-2105464604 None] HCTL ('7', '-', '-', 0) found on session 213 with lun 0 {{(pid=101319) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}} Jul 03 09:54:27.934781 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.linuxscsi [None req-c7a2f1c0-d186-4b36-b89b-132cc9579b18 tempest-ProjectMemberTests33-2105464604 None] Scanning host 7 c: -, t: -, l: 0) {{(pid=101319) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}} Jul 03 09:54:27.949229 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.linuxscsi [None req-c7a2f1c0-d186-4b36-b89b-132cc9579b18 tempest-ProjectMemberTests33-2105464604 None] Searching for a device in session 213 and hctl ['7', '*', '*', 0] yield: sdb {{(pid=101319) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}} Jul 03 09:54:27.949229 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-c7a2f1c0-d186-4b36-b89b-132cc9579b18 tempest-ProjectMemberTests33-2105464604 None] Connected to sdb using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-28e6e1d6-2242-44e7-9f43-e6ae7f7d5f56', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '28e6e1d6-2242-44e7-9f43-e6ae7f7d5f56', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': False} {{(pid=101319) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}} Jul 03 09:54:28.185046 np0000004400 cinder-backup[101319]: INFO cinder.backup.manager [None req-6bc0875d-e30e-4007-874d-df215a6caa1d tempest-VolumesBackupsTest-1484886458 None] Create backup started, backup: 1d0329c6-9a47-475d-9e89-7237611956aa volume: b578d41f-4c6a-49b3-b5ec-bcd6556e2e68. Jul 03 09:54:28.193764 np0000004400 cinder-backup[101319]: INFO cinder.backup.manager [None req-6bc0875d-e30e-4007-874d-df215a6caa1d tempest-VolumesBackupsTest-1484886458 None] Call Volume Manager to get_backup_device for Backup(availability_zone='nova',container=None,created_at=2026-07-03T09:54:28Z,data_timestamp=2026-07-03T09:54:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesBackupsTest-Backup-347384200',encryption_key_id=None,fail_reason=None,host='np0000004400',id=1d0329c6-9a47-475d-9e89-7237611956aa,metadata={},num_dependent_backups=0,object_count=0,parent=Backup(44885c93-b853-422a-9a76-29c7e7bf3d8e),parent_id='44885c93-b853-422a-9a76-29c7e7bf3d8e',project_id='c36863fd49104594b80b419fafd78f5c',restore_volume_id=None,service='cinder.backup.drivers.swift.SwiftBackupDriver',service_metadata=None,size=1,snapshot_id=None,status='creating',temp_snapshot_id=None,temp_volume_id=None,updated_at=None,user_id='e3b8ecc8212649f489f39b74eac8ff8f',volume_id=b578d41f-4c6a-49b3-b5ec-bcd6556e2e68) Jul 03 09:54:28.217264 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.drivers.swift [None req-6bc0875d-e30e-4007-874d-df215a6caa1d tempest-VolumesBackupsTest-1484886458 None] Using swift URL https://10.4.3.95:8080/v1/AUTH_c36863fd49104594b80b419fafd78f5c {{(pid=101319) initialize /opt/stack/cinder/cinder/backup/drivers/swift.py:300}} Jul 03 09:54:28.217668 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.drivers.swift [None req-6bc0875d-e30e-4007-874d-df215a6caa1d tempest-VolumesBackupsTest-1484886458 None] Connect to https://10.4.3.95:8080/v1/AUTH_ in "per_user" mode {{(pid=101319) initialize /opt/stack/cinder/cinder/backup/drivers/swift.py:301}} Jul 03 09:54:28.217964 np0000004400 cinder-backup[101319]: DEBUG os_brick.utils [None req-6bc0875d-e30e-4007-874d-df215a6caa1d tempest-VolumesBackupsTest-1484886458 None] ==> get_connector_properties: call "{'root_helper': 'sudo cinder-rootwrap /etc/cinder/rootwrap.conf', 'my_ip': '10.4.3.95', 'multipath': False, 'enforce_multipath': False, 'host': None, 'execute': None}" {{(pid=101319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}} Jul 03 09:54:28.229466 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.scaleio [None req-6bc0875d-e30e-4007-874d-df215a6caa1d tempest-VolumesBackupsTest-1484886458 None] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=101319) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}} Jul 03 09:54:28.245748 np0000004400 cinder-backup[101319]: DEBUG oslo_concurrency.processutils [None req-6bc0875d-e30e-4007-874d-df215a6caa1d tempest-VolumesBackupsTest-1484886458 None] Running cmd (subprocess): nvme version {{(pid=101319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 09:54:28.258669 np0000004400 cinder-backup[101319]: DEBUG oslo_concurrency.processutils [None req-6bc0875d-e30e-4007-874d-df215a6caa1d tempest-VolumesBackupsTest-1484886458 None] 'nvme version' failed. Not Retrying. {{(pid=101319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 03 09:54:28.259229 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.nvmeof [None req-6bc0875d-e30e-4007-874d-df215a6caa1d tempest-VolumesBackupsTest-1484886458 None] nvme not present on system {{(pid=101319) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}} Jul 03 09:54:28.266927 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.lightos [None req-6bc0875d-e30e-4007-874d-df215a6caa1d tempest-VolumesBackupsTest-1484886458 None] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=101319) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}} Jul 03 09:54:28.267846 np0000004400 cinder-backup[101319]: INFO os_brick.initiator.connectors.lightos [None req-6bc0875d-e30e-4007-874d-df215a6caa1d tempest-VolumesBackupsTest-1484886458 None] Current host hostNQN and IP(s) are ['10.4.3.95', 'fe80::f816:3eff:fe47:268c', '192.168.40.6', 'fe80::f816:3eff:febf:7be2', '192.168.50.6', 'fe80::f816:3eff:fe99:8914', '192.168.10.6', 'fe80::f816:3eff:fe2f:e696', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::bc9d:84ff:fec2:6b49', 'fe80::fc16:3eff:fec3:bd5f', 'fe80::8cea:42ff:fe99:b64a'] Jul 03 09:54:28.268042 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.lightos [None req-6bc0875d-e30e-4007-874d-df215a6caa1d tempest-VolumesBackupsTest-1484886458 None] LIGHTOS: did not find dsc, continuing anyway. {{(pid=101319) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}} Jul 03 09:54:28.268220 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.lightos [None req-6bc0875d-e30e-4007-874d-df215a6caa1d tempest-VolumesBackupsTest-1484886458 None] LIGHTOS: no hostnqn found. {{(pid=101319) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}} Jul 03 09:54:28.268540 np0000004400 cinder-backup[101319]: DEBUG os_brick.utils [None req-6bc0875d-e30e-4007-874d-df215a6caa1d tempest-VolumesBackupsTest-1484886458 None] <== get_connector_properties: return (50ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.95', 'host': 'np0000004400', 'multipath': False, 'enforce_multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:ae7e5bb0ebe6', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': '6b284368-d0ba-4d18-af6f-4998d3955c52', 'nvme_native_multipath': False} {{(pid=101319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}} Jul 03 09:54:28.772308 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connector [None req-6bc0875d-e30e-4007-874d-df215a6caa1d tempest-VolumesBackupsTest-1484886458 None] Factory for iscsi on None {{(pid=101319) factory /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connector.py:243}} Jul 03 09:54:28.772691 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-6bc0875d-e30e-4007-874d-df215a6caa1d tempest-VolumesBackupsTest-1484886458 None] ==> connect_volume: call "{'self': , 'connection_properties': {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-b578d41f-4c6a-49b3-b5ec-bcd6556e2e68', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'b578d41f-4c6a-49b3-b5ec-bcd6556e2e68', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': False}}" {{(pid=101319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}} Jul 03 09:54:28.772838 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.base [None req-6bc0875d-e30e-4007-874d-df215a6caa1d tempest-VolumesBackupsTest-1484886458 None] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=101319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jul 03 09:54:28.950082 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.base [None req-c7a2f1c0-d186-4b36-b89b-132cc9579b18 tempest-ProjectMemberTests33-2105464604 None] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 2.135s {{(pid=101319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jul 03 09:54:28.950435 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-c7a2f1c0-d186-4b36-b89b-132cc9579b18 tempest-ProjectMemberTests33-2105464604 None] <== connect_volume: return (2135ms) {'type': 'block', 'scsi_wwn': '330000000f07ee644', 'path': '/dev/sdb'} {{(pid=101319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}} Jul 03 09:54:28.950620 np0000004400 cinder-backup[101319]: DEBUG oslo_concurrency.processutils [None req-c7a2f1c0-d186-4b36-b89b-132cc9579b18 tempest-ProjectMemberTests33-2105464604 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chown 1002 /dev/sdb {{(pid=101319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 09:54:28.956670 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.base [None req-6bc0875d-e30e-4007-874d-df215a6caa1d tempest-VolumesBackupsTest-1484886458 None] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.183s {{(pid=101319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jul 03 09:54:28.957028 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.base [None req-6bc0875d-e30e-4007-874d-df215a6caa1d tempest-VolumesBackupsTest-1484886458 None] Connection properties {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-b578d41f-4c6a-49b3-b5ec-bcd6556e2e68', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'b578d41f-4c6a-49b3-b5ec-bcd6556e2e68', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': False} {{(pid=101319) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}} Jul 03 09:54:28.967702 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.base [None req-6bc0875d-e30e-4007-874d-df215a6caa1d tempest-VolumesBackupsTest-1484886458 None] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-b578d41f-4c6a-49b3-b5ec-bcd6556e2e68" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=101319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jul 03 09:54:28.967911 np0000004400 sudo[156174]: stack : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chown 1002 /dev/sdb Jul 03 09:54:28.968228 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.base [None req-6bc0875d-e30e-4007-874d-df215a6caa1d tempest-VolumesBackupsTest-1484886458 None] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-b578d41f-4c6a-49b3-b5ec-bcd6556e2e68" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.000s {{(pid=101319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jul 03 09:54:28.968228 np0000004400 cinder-backup[101319]: INFO os_brick.initiator.connectors.iscsi [None req-6bc0875d-e30e-4007-874d-df215a6caa1d tempest-VolumesBackupsTest-1484886458 None] Trying to connect to iSCSI portal 192.168.40.100:3260 Jul 03 09:54:28.968521 np0000004400 sudo[156174]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1002) Jul 03 09:54:28.977271 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-6bc0875d-e30e-4007-874d-df215a6caa1d tempest-VolumesBackupsTest-1484886458 None] iscsiadm (): stdout= stderr=iscsiadm: No records found Jul 03 09:54:28.977271 np0000004400 cinder-backup[101319]: {{(pid=101319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 03 09:54:28.986311 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-6bc0875d-e30e-4007-874d-df215a6caa1d tempest-VolumesBackupsTest-1484886458 None] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-b578d41f-4c6a-49b3-b5ec-bcd6556e2e68] added Jul 03 09:54:28.986311 np0000004400 cinder-backup[101319]: stderr=iscsiadm: Config file line 363 does not have value Jul 03 09:54:28.986311 np0000004400 cinder-backup[101319]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs' Jul 03 09:54:28.986311 np0000004400 cinder-backup[101319]: iscsiadm: Config file line 363 does not have value Jul 03 09:54:28.986311 np0000004400 cinder-backup[101319]: iscsiadm: Config file line 363 does not have value Jul 03 09:54:28.986311 np0000004400 cinder-backup[101319]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs' Jul 03 09:54:28.986311 np0000004400 cinder-backup[101319]: {{(pid=101319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 03 09:54:28.986578 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-6bc0875d-e30e-4007-874d-df215a6caa1d tempest-VolumesBackupsTest-1484886458 None] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=101319) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}} Jul 03 09:54:28.986963 np0000004400 cinder-backup[101319]: DEBUG os_brick.utils [None req-6bc0875d-e30e-4007-874d-df215a6caa1d tempest-VolumesBackupsTest-1484886458 None] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0186(s), this was the 1st time calling it. {{(pid=101319) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}} Jul 03 09:54:28.987193 np0000004400 cinder-backup[101319]: DEBUG os_brick.utils [None req-6bc0875d-e30e-4007-874d-df215a6caa1d tempest-VolumesBackupsTest-1484886458 None] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=101319) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}} Jul 03 09:54:29.256425 np0000004400 sudo[156174]: pam_unix(sudo:session): session closed for user root Jul 03 09:54:29.258014 np0000004400 cinder-backup[101319]: DEBUG oslo_concurrency.processutils [None req-c7a2f1c0-d186-4b36-b89b-132cc9579b18 tempest-ProjectMemberTests33-2105464604 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chown 1002 /dev/sdb" returned: 0 in 0.307s {{(pid=101319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 09:54:29.295636 np0000004400 cinder-backup[101319]: DEBUG oslo_db.sqlalchemy.engines [None req-c7a2f1c0-d186-4b36-b89b-132cc9579b18 tempest-ProjectMemberTests33-2105464604 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=101319) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 03 09:54:29.301450 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-c7a2f1c0-d186-4b36-b89b-132cc9579b18 tempest-ProjectMemberTests33-2105464604 None] _create_container started, container: volumebackups,backup: 6f767c43-dfb9-4a05-93e6-d969f7407465. {{(pid=101319) _create_container /opt/stack/cinder/cinder/backup/chunkeddriver.py:249}} Jul 03 09:54:29.341016 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.drivers.swift [None req-c7a2f1c0-d186-4b36-b89b-132cc9579b18 tempest-ProjectMemberTests33-2105464604 None] generate_object_name_prefix: volume_28e6e1d6-2242-44e7-9f43-e6ae7f7d5f56/20260703095429/az_nova_backup_6f767c43-dfb9-4a05-93e6-d969f7407465 {{(pid=101319) _generate_object_name_prefix /opt/stack/cinder/cinder/backup/drivers/swift.py:452}} Jul 03 09:54:29.346983 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-c7a2f1c0-d186-4b36-b89b-132cc9579b18 tempest-ProjectMemberTests33-2105464604 None] starting backup of volume: 28e6e1d6-2242-44e7-9f43-e6ae7f7d5f56, volume size: 1073741824, object names prefix volume_28e6e1d6-2242-44e7-9f43-e6ae7f7d5f56/20260703095429/az_nova_backup_6f767c43-dfb9-4a05-93e6-d969f7407465, availability zone: nova {{(pid=101319) _prepare_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:359}} Jul 03 09:54:29.513080 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-c7a2f1c0-d186-4b36-b89b-132cc9579b18 tempest-ProjectMemberTests33-2105464604 None] Backing up chunk of data from volume. {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 09:54:29.750649 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-c7a2f1c0-d186-4b36-b89b-132cc9579b18 tempest-ProjectMemberTests33-2105464604 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101319) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 09:54:29.750810 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-c7a2f1c0-d186-4b36-b89b-132cc9579b18 tempest-ProjectMemberTests33-2105464604 None] About to put_object {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 09:54:29.849090 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-c7a2f1c0-d186-4b36-b89b-132cc9579b18 tempest-ProjectMemberTests33-2105464604 None] backup MD5 for volume_28e6e1d6-2242-44e7-9f43-e6ae7f7d5f56/20260703095429/az_nova_backup_6f767c43-dfb9-4a05-93e6-d969f7407465-00001: 25e317773f308e446cc84c503a6d1f85 {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 09:54:29.849239 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-c7a2f1c0-d186-4b36-b89b-132cc9579b18 tempest-ProjectMemberTests33-2105464604 None] Calling eventlet.sleep(0) {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 09:54:29.991247 np0000004400 cinder-backup[101319]: INFO os_brick.initiator.connectors.iscsi [None req-6bc0875d-e30e-4007-874d-df215a6caa1d tempest-VolumesBackupsTest-1484886458 None] Trying to connect to iSCSI portal 192.168.40.100:3260 Jul 03 09:54:30.001092 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-6bc0875d-e30e-4007-874d-df215a6caa1d tempest-VolumesBackupsTest-1484886458 None] iscsiadm (): stdout=# BEGIN RECORD 2.1.9 Jul 03 09:54:30.001092 np0000004400 cinder-backup[101319]: node.name = iqn.2023-03.storpool.com:os--volume-b578d41f-4c6a-49b3-b5ec-bcd6556e2e68 Jul 03 09:54:30.001092 np0000004400 cinder-backup[101319]: node.tpgt = -1 Jul 03 09:54:30.001092 np0000004400 cinder-backup[101319]: node.startup = manual Jul 03 09:54:30.001092 np0000004400 cinder-backup[101319]: node.leading_login = No Jul 03 09:54:30.001092 np0000004400 cinder-backup[101319]: iface.iscsi_ifacename = default Jul 03 09:54:30.001092 np0000004400 cinder-backup[101319]: iface.net_ifacename = Jul 03 09:54:30.001092 np0000004400 cinder-backup[101319]: iface.ipaddress = Jul 03 09:54:30.001092 np0000004400 cinder-backup[101319]: iface.prefix_len = 0 Jul 03 09:54:30.001092 np0000004400 cinder-backup[101319]: iface.hwaddress = Jul 03 09:54:30.001092 np0000004400 cinder-backup[101319]: iface.transport_name = tcp Jul 03 09:54:30.001092 np0000004400 cinder-backup[101319]: iface.initiatorname = Jul 03 09:54:30.001092 np0000004400 cinder-backup[101319]: iface.state = Jul 03 09:54:30.001092 np0000004400 cinder-backup[101319]: iface.vlan_id = 0 Jul 03 09:54:30.001092 np0000004400 cinder-backup[101319]: iface.vlan_priority = 0 Jul 03 09:54:30.001092 np0000004400 cinder-backup[101319]: iface.vlan_state = Jul 03 09:54:30.001092 np0000004400 cinder-backup[101319]: iface.iface_num = 0 Jul 03 09:54:30.001092 np0000004400 cinder-backup[101319]: iface.mtu = 0 Jul 03 09:54:30.001092 np0000004400 cinder-backup[101319]: iface.port = 0 Jul 03 09:54:30.001092 np0000004400 cinder-backup[101319]: iface.bootproto = Jul 03 09:54:30.001092 np0000004400 cinder-backup[101319]: iface.subnet_mask = Jul 03 09:54:30.001092 np0000004400 cinder-backup[101319]: iface.gateway = Jul 03 09:54:30.001092 np0000004400 cinder-backup[101319]: iface.dhcp_alt_client_id_state = Jul 03 09:54:30.001092 np0000004400 cinder-backup[101319]: iface.dhcp_alt_client_id = Jul 03 09:54:30.001092 np0000004400 cinder-backup[101319]: iface.dhcp_dns = Jul 03 09:54:30.001092 np0000004400 cinder-backup[101319]: iface.dhcp_learn_iqn = Jul 03 09:54:30.001092 np0000004400 cinder-backup[101319]: iface.dhcp_req_vendor_id_state = Jul 03 09:54:30.001092 np0000004400 cinder-backup[101319]: iface.dhcp_vendor_id_state = Jul 03 09:54:30.001092 np0000004400 cinder-backup[101319]: iface.dhcp_vendor_id = Jul 03 09:54:30.001092 np0000004400 cinder-backup[101319]: iface.dhcp_slp_da = Jul 03 09:54:30.001092 np0000004400 cinder-backup[101319]: iface.fragmentation = Jul 03 09:54:30.001092 np0000004400 cinder-backup[101319]: iface.gratuitous_arp = Jul 03 09:54:30.001092 np0000004400 cinder-backup[101319]: iface.incoming_forwarding = Jul 03 09:54:30.001092 np0000004400 cinder-backup[101319]: iface.tos_state = Jul 03 09:54:30.001092 np0000004400 cinder-backup[101319]: iface.tos = 0 Jul 03 09:54:30.001092 np0000004400 cinder-backup[101319]: iface.ttl = 0 Jul 03 09:54:30.001092 np0000004400 cinder-backup[101319]: iface.delayed_ack = Jul 03 09:54:30.001092 np0000004400 cinder-backup[101319]: iface.tcp_nagle = Jul 03 09:54:30.001092 np0000004400 cinder-backup[101319]: iface.tcp_wsf_state = Jul 03 09:54:30.001092 np0000004400 cinder-backup[101319]: iface.tcp_wsf = 0 Jul 03 09:54:30.001092 np0000004400 cinder-backup[101319]: iface.tcp_timer_scale = 0 Jul 03 09:54:30.001092 np0000004400 cinder-backup[101319]: iface.tcp_timestamp = Jul 03 09:54:30.001092 np0000004400 cinder-backup[101319]: iface.redirect = Jul 03 09:54:30.001092 np0000004400 cinder-backup[101319]: iface.def_task_mgmt_timeout = 0 Jul 03 09:54:30.001092 np0000004400 cinder-backup[101319]: iface.header_digest = Jul 03 09:54:30.001092 np0000004400 cinder-backup[101319]: iface.data_digest = Jul 03 09:54:30.001092 np0000004400 cinder-backup[101319]: iface.immediate_data = Jul 03 09:54:30.001092 np0000004400 cinder-backup[101319]: iface.initial_r2t = Jul 03 09:54:30.001092 np0000004400 cinder-backup[101319]: iface.data_seq_inorder = Jul 03 09:54:30.001092 np0000004400 cinder-backup[101319]: iface.data_pdu_inorder = Jul 03 09:54:30.001092 np0000004400 cinder-backup[101319]: iface.erl = 0 Jul 03 09:54:30.001092 np0000004400 cinder-backup[101319]: iface.max_receive_data_len = 0 Jul 03 09:54:30.001092 np0000004400 cinder-backup[101319]: iface.first_burst_len = 0 Jul 03 09:54:30.001092 np0000004400 cinder-backup[101319]: iface.max_outstanding_r2t = 0 Jul 03 09:54:30.001092 np0000004400 cinder-backup[101319]: iface.max_burst_len = 0 Jul 03 09:54:30.001092 np0000004400 cinder-backup[101319]: iface.chap_auth = Jul 03 09:54:30.001092 np0000004400 cinder-backup[101319]: iface.bidi_chap = Jul 03 09:54:30.001092 np0000004400 cinder-backup[101319]: iface.strict_login_compliance = Jul 03 09:54:30.001092 np0000004400 cinder-backup[101319]: iface.discovery_auth = Jul 03 09:54:30.001092 np0000004400 cinder-backup[101319]: iface.discovery_logout = Jul 03 09:54:30.001092 np0000004400 cinder-backup[101319]: node.discovery_address = Jul 03 09:54:30.001092 np0000004400 cinder-backup[101319]: node.discovery_port = 0 Jul 03 09:54:30.001092 np0000004400 cinder-backup[101319]: node.discovery_type = fw Jul 03 09:54:30.001092 np0000004400 cinder-backup[101319]: node.session.initial_cmdsn = 0 Jul 03 09:54:30.001092 np0000004400 cinder-backup[101319]: node.session.initial_login_retry_max = 8 Jul 03 09:54:30.001092 np0000004400 cinder-backup[101319]: node.session.xmit_thread_priority = 0 Jul 03 09:54:30.001092 np0000004400 cinder-backup[101319]: node.session.cmds_max = 128 Jul 03 09:54:30.001092 np0000004400 cinder-backup[101319]: node.session.queue_depth = 32 Jul 03 09:54:30.001092 np0000004400 cinder-backup[101319]: node.session.nr_sessions = 1 Jul 03 09:54:30.001092 np0000004400 cinder-backup[101319]: node.session.auth.authmethod = None Jul 03 09:54:30.001092 np0000004400 cinder-backup[101319]: node.session.auth.username = Jul 03 09:54:30.001092 np0000004400 cinder-backup[101319]: node.session.auth.password = *** Jul 03 09:54:30.001092 np0000004400 cinder-backup[101319]: node.session.auth.username_in = Jul 03 09:54:30.001092 np0000004400 cinder-backup[101319]: node.session.auth.password_in = Jul 03 09:54:30.001092 np0000004400 cinder-backup[101319]: node.session.auth.chap_algs = SHA256 Jul 03 09:54:30.001092 np0000004400 cinder-backup[101319]: node.session.timeo.replacement_timeout = 120 Jul 03 09:54:30.001092 np0000004400 cinder-backup[101319]: node.session.err_timeo.abort_timeout = 15 Jul 03 09:54:30.001092 np0000004400 cinder-backup[101319]: node.session.err_timeo.lu_reset_timeout = 30 Jul 03 09:54:30.001092 np0000004400 cinder-backup[101319]: node.session.err_timeo.tgt_reset_timeout = 30 Jul 03 09:54:30.001092 np0000004400 cinder-backup[101319]: node.session.err_timeo.host_reset_timeout = 60 Jul 03 09:54:30.001092 np0000004400 cinder-backup[101319]: node.session.iscsi.FastAbort = Yes Jul 03 09:54:30.001092 np0000004400 cinder-backup[101319]: node.session.iscsi.InitialR2T = No Jul 03 09:54:30.001092 np0000004400 cinder-backup[101319]: node.session.iscsi.ImmediateData = Yes Jul 03 09:54:30.001092 np0000004400 cinder-backup[101319]: node.session.iscsi.FirstBurstLength = 262144 Jul 03 09:54:30.001092 np0000004400 cinder-backup[101319]: node.session.iscsi.MaxBurstLength = 16776192 Jul 03 09:54:30.001092 np0000004400 cinder-backup[101319]: node.session.iscsi.DefaultTime2Retain = 0 Jul 03 09:54:30.001092 np0000004400 cinder-backup[101319]: node.session.iscsi.DefaultTime2Wait = 2 Jul 03 09:54:30.001092 np0000004400 cinder-backup[101319]: node.session.iscsi.MaxConnections = 1 Jul 03 09:54:30.001092 np0000004400 cinder-backup[101319]: node.session.iscsi.MaxOutstandingR2T = 1 Jul 03 09:54:30.001092 np0000004400 cinder-backup[101319]: node.session.iscsi.ERL = 0 Jul 03 09:54:30.001092 np0000004400 cinder-backup[101319]: node.session.scan = auto Jul 03 09:54:30.001092 np0000004400 cinder-backup[101319]: node.session.reopen_max = 0 Jul 03 09:54:30.001092 np0000004400 cinder-backup[101319]: node.conn[0].address = 192.168.40.100 Jul 03 09:54:30.001092 np0000004400 cinder-backup[101319]: node.conn[0].port = 3260 Jul 03 09:54:30.001092 np0000004400 cinder-backup[101319]: node.conn[0].startup = manual Jul 03 09:54:30.001092 np0000004400 cinder-backup[101319]: node.conn[0].tcp.window_size = 524288 Jul 03 09:54:30.001092 np0000004400 cinder-backup[101319]: node.conn[0].tcp.type_of_service = 0 Jul 03 09:54:30.001092 np0000004400 cinder-backup[101319]: node.conn[0].timeo.logout_timeout = 15 Jul 03 09:54:30.001092 np0000004400 cinder-backup[101319]: node.conn[0].timeo.login_timeout = 15 Jul 03 09:54:30.001092 np0000004400 cinder-backup[101319]: node.conn[0].timeo.auth_timeout = 45 Jul 03 09:54:30.001092 np0000004400 cinder-backup[101319]: node.conn[0].timeo.noop_out_interval = 5 Jul 03 09:54:30.001092 np0000004400 cinder-backup[101319]: node.conn[0].timeo.noop_out_timeout = 5 Jul 03 09:54:30.001092 np0000004400 cinder-backup[101319]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0 Jul 03 09:54:30.001092 np0000004400 cinder-backup[101319]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144 Jul 03 09:54:30.001092 np0000004400 cinder-backup[101319]: node.conn[0].iscsi.HeaderDigest = None Jul 03 09:54:30.001092 np0000004400 cinder-backup[101319]: node.conn[0].iscsi.DataDigest = None Jul 03 09:54:30.001092 np0000004400 cinder-backup[101319]: node.conn[0].iscsi.IFMarker = No Jul 03 09:54:30.001092 np0000004400 cinder-backup[101319]: node.conn[0].iscsi.OFMarker = No Jul 03 09:54:30.001092 np0000004400 cinder-backup[101319]: # END RECORD Jul 03 09:54:30.001092 np0000004400 cinder-backup[101319]: stderr= {{(pid=101319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 03 09:54:30.011146 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-6bc0875d-e30e-4007-874d-df215a6caa1d tempest-VolumesBackupsTest-1484886458 None] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=101319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 03 09:54:30.021942 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-6bc0875d-e30e-4007-874d-df215a6caa1d tempest-VolumesBackupsTest-1484886458 None] iscsiadm ('-m', 'session'): stdout=tcp: [208] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-789ec59e-ea87-4784-8990-156a35276b5f (non-flash) Jul 03 09:54:30.021942 np0000004400 cinder-backup[101319]: tcp: [209] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-789ec59e-ea87-4784-8990-156a35276b5f (non-flash) Jul 03 09:54:30.021942 np0000004400 cinder-backup[101319]: tcp: [213] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-28e6e1d6-2242-44e7-9f43-e6ae7f7d5f56 (non-flash) Jul 03 09:54:30.021942 np0000004400 cinder-backup[101319]: stderr= {{(pid=101319) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jul 03 09:54:30.022091 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-6bc0875d-e30e-4007-874d-df215a6caa1d tempest-VolumesBackupsTest-1484886458 None] iscsi session list stdout=tcp: [208] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-789ec59e-ea87-4784-8990-156a35276b5f (non-flash) Jul 03 09:54:30.022091 np0000004400 cinder-backup[101319]: tcp: [209] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-789ec59e-ea87-4784-8990-156a35276b5f (non-flash) Jul 03 09:54:30.022091 np0000004400 cinder-backup[101319]: tcp: [213] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-28e6e1d6-2242-44e7-9f43-e6ae7f7d5f56 (non-flash) Jul 03 09:54:30.022091 np0000004400 cinder-backup[101319]: stderr= {{(pid=101319) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jul 03 09:54:30.029599 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-c7a2f1c0-d186-4b36-b89b-132cc9579b18 tempest-ProjectMemberTests33-2105464604 None] Backing up chunk of data from volume. {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 09:54:30.053516 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-6bc0875d-e30e-4007-874d-df215a6caa1d tempest-VolumesBackupsTest-1484886458 None] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-b578d41f-4c6a-49b3-b5ec-bcd6556e2e68, portal: 192.168.40.100,3260] Jul 03 09:54:30.053516 np0000004400 cinder-backup[101319]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-b578d41f-4c6a-49b3-b5ec-bcd6556e2e68, portal: 192.168.40.100,3260] successful. Jul 03 09:54:30.053516 np0000004400 cinder-backup[101319]: stderr= {{(pid=101319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 03 09:54:30.063315 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-6bc0875d-e30e-4007-874d-df215a6caa1d tempest-VolumesBackupsTest-1484886458 None] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=101319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 03 09:54:30.074908 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-6bc0875d-e30e-4007-874d-df215a6caa1d tempest-VolumesBackupsTest-1484886458 None] iscsiadm ('-m', 'session'): stdout=tcp: [208] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-789ec59e-ea87-4784-8990-156a35276b5f (non-flash) Jul 03 09:54:30.074908 np0000004400 cinder-backup[101319]: tcp: [209] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-789ec59e-ea87-4784-8990-156a35276b5f (non-flash) Jul 03 09:54:30.074908 np0000004400 cinder-backup[101319]: tcp: [213] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-28e6e1d6-2242-44e7-9f43-e6ae7f7d5f56 (non-flash) Jul 03 09:54:30.074908 np0000004400 cinder-backup[101319]: tcp: [214] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b578d41f-4c6a-49b3-b5ec-bcd6556e2e68 (non-flash) Jul 03 09:54:30.074908 np0000004400 cinder-backup[101319]: stderr= {{(pid=101319) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jul 03 09:54:30.075061 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-6bc0875d-e30e-4007-874d-df215a6caa1d tempest-VolumesBackupsTest-1484886458 None] iscsi session list stdout=tcp: [208] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-789ec59e-ea87-4784-8990-156a35276b5f (non-flash) Jul 03 09:54:30.075061 np0000004400 cinder-backup[101319]: tcp: [209] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-789ec59e-ea87-4784-8990-156a35276b5f (non-flash) Jul 03 09:54:30.075061 np0000004400 cinder-backup[101319]: tcp: [213] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-28e6e1d6-2242-44e7-9f43-e6ae7f7d5f56 (non-flash) Jul 03 09:54:30.075061 np0000004400 cinder-backup[101319]: tcp: [214] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b578d41f-4c6a-49b3-b5ec-bcd6556e2e68 (non-flash) Jul 03 09:54:30.075061 np0000004400 cinder-backup[101319]: stderr= {{(pid=101319) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jul 03 09:54:30.075338 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.base [None req-6bc0875d-e30e-4007-874d-df215a6caa1d tempest-VolumesBackupsTest-1484886458 None] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-b578d41f-4c6a-49b3-b5ec-bcd6556e2e68" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.107s {{(pid=101319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jul 03 09:54:30.075514 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-6bc0875d-e30e-4007-874d-df215a6caa1d tempest-VolumesBackupsTest-1484886458 None] Connected to 192.168.40.100:3260 {{(pid=101319) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}} Jul 03 09:54:30.076081 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.linuxscsi [None req-6bc0875d-e30e-4007-874d-df215a6caa1d tempest-VolumesBackupsTest-1484886458 None] HCTL ('8', '-', '-', 0) found on session 214 with lun 0 {{(pid=101319) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}} Jul 03 09:54:30.076231 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.linuxscsi [None req-6bc0875d-e30e-4007-874d-df215a6caa1d tempest-VolumesBackupsTest-1484886458 None] Scanning host 8 c: -, t: -, l: 0) {{(pid=101319) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}} Jul 03 09:54:30.087016 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.linuxscsi [None req-6bc0875d-e30e-4007-874d-df215a6caa1d tempest-VolumesBackupsTest-1484886458 None] Searching for a device in session 214 and hctl ['8', '*', '*', 0] yield: sdc {{(pid=101319) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}} Jul 03 09:54:30.087249 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-6bc0875d-e30e-4007-874d-df215a6caa1d tempest-VolumesBackupsTest-1484886458 None] Connected to sdc using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-b578d41f-4c6a-49b3-b5ec-bcd6556e2e68', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'b578d41f-4c6a-49b3-b5ec-bcd6556e2e68', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': False} {{(pid=101319) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}} Jul 03 09:54:30.273884 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-c7a2f1c0-d186-4b36-b89b-132cc9579b18 tempest-ProjectMemberTests33-2105464604 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101319) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 09:54:30.274018 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-c7a2f1c0-d186-4b36-b89b-132cc9579b18 tempest-ProjectMemberTests33-2105464604 None] About to put_object {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 09:54:30.371626 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-c7a2f1c0-d186-4b36-b89b-132cc9579b18 tempest-ProjectMemberTests33-2105464604 None] backup MD5 for volume_28e6e1d6-2242-44e7-9f43-e6ae7f7d5f56/20260703095429/az_nova_backup_6f767c43-dfb9-4a05-93e6-d969f7407465-00002: 25e317773f308e446cc84c503a6d1f85 {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 09:54:30.371791 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-c7a2f1c0-d186-4b36-b89b-132cc9579b18 tempest-ProjectMemberTests33-2105464604 None] Calling eventlet.sleep(0) {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 09:54:30.559948 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-c7a2f1c0-d186-4b36-b89b-132cc9579b18 tempest-ProjectMemberTests33-2105464604 None] Backing up chunk of data from volume. {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 09:54:30.797528 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-c7a2f1c0-d186-4b36-b89b-132cc9579b18 tempest-ProjectMemberTests33-2105464604 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101319) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 09:54:30.797633 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-c7a2f1c0-d186-4b36-b89b-132cc9579b18 tempest-ProjectMemberTests33-2105464604 None] About to put_object {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 09:54:30.892932 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-c7a2f1c0-d186-4b36-b89b-132cc9579b18 tempest-ProjectMemberTests33-2105464604 None] backup MD5 for volume_28e6e1d6-2242-44e7-9f43-e6ae7f7d5f56/20260703095429/az_nova_backup_6f767c43-dfb9-4a05-93e6-d969f7407465-00003: 25e317773f308e446cc84c503a6d1f85 {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 09:54:30.893026 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-c7a2f1c0-d186-4b36-b89b-132cc9579b18 tempest-ProjectMemberTests33-2105464604 None] Calling eventlet.sleep(0) {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 09:54:31.059217 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-c7a2f1c0-d186-4b36-b89b-132cc9579b18 tempest-ProjectMemberTests33-2105464604 None] Backing up chunk of data from volume. {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 09:54:31.090105 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.base [None req-6bc0875d-e30e-4007-874d-df215a6caa1d tempest-VolumesBackupsTest-1484886458 None] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 2.134s {{(pid=101319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jul 03 09:54:31.090341 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-6bc0875d-e30e-4007-874d-df215a6caa1d tempest-VolumesBackupsTest-1484886458 None] <== connect_volume: return (2317ms) {'type': 'block', 'scsi_wwn': 'SStorPool_iSCSI_DISK_1034578903445799236', 'path': '/dev/sdc'} {{(pid=101319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}} Jul 03 09:54:31.090722 np0000004400 cinder-backup[101319]: DEBUG oslo_concurrency.processutils [None req-6bc0875d-e30e-4007-874d-df215a6caa1d tempest-VolumesBackupsTest-1484886458 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chown 1002 /dev/sdc {{(pid=101319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 09:54:31.117074 np0000004400 sudo[156224]: stack : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chown 1002 /dev/sdc Jul 03 09:54:31.117701 np0000004400 sudo[156224]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1002) Jul 03 09:54:31.302185 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-c7a2f1c0-d186-4b36-b89b-132cc9579b18 tempest-ProjectMemberTests33-2105464604 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101319) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 09:54:31.302379 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-c7a2f1c0-d186-4b36-b89b-132cc9579b18 tempest-ProjectMemberTests33-2105464604 None] About to put_object {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 09:54:31.399576 np0000004400 sudo[156224]: pam_unix(sudo:session): session closed for user root Jul 03 09:54:31.399971 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-c7a2f1c0-d186-4b36-b89b-132cc9579b18 tempest-ProjectMemberTests33-2105464604 None] backup MD5 for volume_28e6e1d6-2242-44e7-9f43-e6ae7f7d5f56/20260703095429/az_nova_backup_6f767c43-dfb9-4a05-93e6-d969f7407465-00004: 25e317773f308e446cc84c503a6d1f85 {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 09:54:31.400143 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-c7a2f1c0-d186-4b36-b89b-132cc9579b18 tempest-ProjectMemberTests33-2105464604 None] Calling eventlet.sleep(0) {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 09:54:31.403768 np0000004400 cinder-backup[101319]: DEBUG oslo_concurrency.processutils [None req-6bc0875d-e30e-4007-874d-df215a6caa1d tempest-VolumesBackupsTest-1484886458 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chown 1002 /dev/sdc" returned: 0 in 0.313s {{(pid=101319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 09:54:31.445266 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-6bc0875d-e30e-4007-874d-df215a6caa1d tempest-VolumesBackupsTest-1484886458 None] _read_sha256file started, container name: volumebackups, sha256 filename: volume_b578d41f-4c6a-49b3-b5ec-bcd6556e2e68/20260703095405/az_nova_backup_44885c93-b853-422a-9a76-29c7e7bf3d8e_sha256file. {{(pid=101319) _read_sha256file /opt/stack/cinder/cinder/backup/chunkeddriver.py:333}} Jul 03 09:54:31.473412 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-6bc0875d-e30e-4007-874d-df215a6caa1d tempest-VolumesBackupsTest-1484886458 None] _read_sha256file finished. {{(pid=101319) _read_sha256file /opt/stack/cinder/cinder/backup/chunkeddriver.py:340}} Jul 03 09:54:31.480047 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-6bc0875d-e30e-4007-874d-df215a6caa1d tempest-VolumesBackupsTest-1484886458 None] _create_container started, container: volumebackups,backup: 1d0329c6-9a47-475d-9e89-7237611956aa. {{(pid=101319) _create_container /opt/stack/cinder/cinder/backup/chunkeddriver.py:249}} Jul 03 09:54:31.505096 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.drivers.swift [None req-6bc0875d-e30e-4007-874d-df215a6caa1d tempest-VolumesBackupsTest-1484886458 None] generate_object_name_prefix: volume_b578d41f-4c6a-49b3-b5ec-bcd6556e2e68/20260703095431/az_nova_backup_1d0329c6-9a47-475d-9e89-7237611956aa {{(pid=101319) _generate_object_name_prefix /opt/stack/cinder/cinder/backup/drivers/swift.py:452}} Jul 03 09:54:31.510282 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-6bc0875d-e30e-4007-874d-df215a6caa1d tempest-VolumesBackupsTest-1484886458 None] starting backup of volume: b578d41f-4c6a-49b3-b5ec-bcd6556e2e68, volume size: 1073741824, object names prefix volume_b578d41f-4c6a-49b3-b5ec-bcd6556e2e68/20260703095431/az_nova_backup_1d0329c6-9a47-475d-9e89-7237611956aa, availability zone: nova {{(pid=101319) _prepare_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:359}} Jul 03 09:54:31.663265 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-c7a2f1c0-d186-4b36-b89b-132cc9579b18 tempest-ProjectMemberTests33-2105464604 None] Backing up chunk of data from volume. {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 09:54:31.913231 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-c7a2f1c0-d186-4b36-b89b-132cc9579b18 tempest-ProjectMemberTests33-2105464604 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101319) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 09:54:31.913475 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-c7a2f1c0-d186-4b36-b89b-132cc9579b18 tempest-ProjectMemberTests33-2105464604 None] About to put_object {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 09:54:32.009251 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-c7a2f1c0-d186-4b36-b89b-132cc9579b18 tempest-ProjectMemberTests33-2105464604 None] backup MD5 for volume_28e6e1d6-2242-44e7-9f43-e6ae7f7d5f56/20260703095429/az_nova_backup_6f767c43-dfb9-4a05-93e6-d969f7407465-00005: 25e317773f308e446cc84c503a6d1f85 {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 09:54:32.009470 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-c7a2f1c0-d186-4b36-b89b-132cc9579b18 tempest-ProjectMemberTests33-2105464604 None] Calling eventlet.sleep(0) {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 09:54:32.293783 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-c7a2f1c0-d186-4b36-b89b-132cc9579b18 tempest-ProjectMemberTests33-2105464604 None] Backing up chunk of data from volume. {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 09:54:32.541552 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-c7a2f1c0-d186-4b36-b89b-132cc9579b18 tempest-ProjectMemberTests33-2105464604 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101319) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 09:54:32.542000 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-c7a2f1c0-d186-4b36-b89b-132cc9579b18 tempest-ProjectMemberTests33-2105464604 None] About to put_object {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 09:54:32.640458 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-c7a2f1c0-d186-4b36-b89b-132cc9579b18 tempest-ProjectMemberTests33-2105464604 None] backup MD5 for volume_28e6e1d6-2242-44e7-9f43-e6ae7f7d5f56/20260703095429/az_nova_backup_6f767c43-dfb9-4a05-93e6-d969f7407465-00006: 25e317773f308e446cc84c503a6d1f85 {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 09:54:32.640458 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-c7a2f1c0-d186-4b36-b89b-132cc9579b18 tempest-ProjectMemberTests33-2105464604 None] Calling eventlet.sleep(0) {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 09:54:32.883335 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-c7a2f1c0-d186-4b36-b89b-132cc9579b18 tempest-ProjectMemberTests33-2105464604 None] Backing up chunk of data from volume. {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 09:54:33.137199 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-c7a2f1c0-d186-4b36-b89b-132cc9579b18 tempest-ProjectMemberTests33-2105464604 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101319) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 09:54:33.137199 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-c7a2f1c0-d186-4b36-b89b-132cc9579b18 tempest-ProjectMemberTests33-2105464604 None] About to put_object {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 09:54:33.237895 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-c7a2f1c0-d186-4b36-b89b-132cc9579b18 tempest-ProjectMemberTests33-2105464604 None] backup MD5 for volume_28e6e1d6-2242-44e7-9f43-e6ae7f7d5f56/20260703095429/az_nova_backup_6f767c43-dfb9-4a05-93e6-d969f7407465-00007: 25e317773f308e446cc84c503a6d1f85 {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 09:54:33.237895 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-c7a2f1c0-d186-4b36-b89b-132cc9579b18 tempest-ProjectMemberTests33-2105464604 None] Calling eventlet.sleep(0) {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 09:54:33.482263 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-c7a2f1c0-d186-4b36-b89b-132cc9579b18 tempest-ProjectMemberTests33-2105464604 None] Backing up chunk of data from volume. {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 09:54:33.719529 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-c7a2f1c0-d186-4b36-b89b-132cc9579b18 tempest-ProjectMemberTests33-2105464604 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101319) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 09:54:33.719666 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-c7a2f1c0-d186-4b36-b89b-132cc9579b18 tempest-ProjectMemberTests33-2105464604 None] About to put_object {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 09:54:33.818431 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-c7a2f1c0-d186-4b36-b89b-132cc9579b18 tempest-ProjectMemberTests33-2105464604 None] backup MD5 for volume_28e6e1d6-2242-44e7-9f43-e6ae7f7d5f56/20260703095429/az_nova_backup_6f767c43-dfb9-4a05-93e6-d969f7407465-00008: 25e317773f308e446cc84c503a6d1f85 {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 09:54:33.818664 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-c7a2f1c0-d186-4b36-b89b-132cc9579b18 tempest-ProjectMemberTests33-2105464604 None] Calling eventlet.sleep(0) {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 09:54:34.097633 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-c7a2f1c0-d186-4b36-b89b-132cc9579b18 tempest-ProjectMemberTests33-2105464604 None] Backing up chunk of data from volume. {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 09:54:34.344257 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-c7a2f1c0-d186-4b36-b89b-132cc9579b18 tempest-ProjectMemberTests33-2105464604 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101319) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 09:54:34.344517 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-c7a2f1c0-d186-4b36-b89b-132cc9579b18 tempest-ProjectMemberTests33-2105464604 None] About to put_object {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 09:54:34.462907 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-c7a2f1c0-d186-4b36-b89b-132cc9579b18 tempest-ProjectMemberTests33-2105464604 None] backup MD5 for volume_28e6e1d6-2242-44e7-9f43-e6ae7f7d5f56/20260703095429/az_nova_backup_6f767c43-dfb9-4a05-93e6-d969f7407465-00009: 25e317773f308e446cc84c503a6d1f85 {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 09:54:34.463078 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-c7a2f1c0-d186-4b36-b89b-132cc9579b18 tempest-ProjectMemberTests33-2105464604 None] Calling eventlet.sleep(0) {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 09:54:34.715856 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-c7a2f1c0-d186-4b36-b89b-132cc9579b18 tempest-ProjectMemberTests33-2105464604 None] Backing up chunk of data from volume. {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 09:54:34.961982 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-c7a2f1c0-d186-4b36-b89b-132cc9579b18 tempest-ProjectMemberTests33-2105464604 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101319) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 09:54:34.961982 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-c7a2f1c0-d186-4b36-b89b-132cc9579b18 tempest-ProjectMemberTests33-2105464604 None] About to put_object {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 09:54:35.061393 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-c7a2f1c0-d186-4b36-b89b-132cc9579b18 tempest-ProjectMemberTests33-2105464604 None] backup MD5 for volume_28e6e1d6-2242-44e7-9f43-e6ae7f7d5f56/20260703095429/az_nova_backup_6f767c43-dfb9-4a05-93e6-d969f7407465-00010: 25e317773f308e446cc84c503a6d1f85 {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 09:54:35.061726 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-c7a2f1c0-d186-4b36-b89b-132cc9579b18 tempest-ProjectMemberTests33-2105464604 None] Calling eventlet.sleep(0) {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 09:54:35.288250 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-c7a2f1c0-d186-4b36-b89b-132cc9579b18 tempest-ProjectMemberTests33-2105464604 None] Backing up chunk of data from volume. {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 09:54:35.535029 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-c7a2f1c0-d186-4b36-b89b-132cc9579b18 tempest-ProjectMemberTests33-2105464604 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101319) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 09:54:35.535291 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-c7a2f1c0-d186-4b36-b89b-132cc9579b18 tempest-ProjectMemberTests33-2105464604 None] About to put_object {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 09:54:35.588214 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.driver [None req-6bc0875d-e30e-4007-874d-df215a6caa1d tempest-VolumesBackupsTest-1484886458 None] Getting metadata type 'volume-base-metadata' {{(pid=101319) _save_vol_base_meta /opt/stack/cinder/cinder/backup/driver.py:79}} Jul 03 09:54:35.592625 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.driver [None req-6bc0875d-e30e-4007-874d-df215a6caa1d tempest-VolumesBackupsTest-1484886458 None] Completed fetching metadata type 'volume-base-metadata' {{(pid=101319) _save_vol_base_meta /opt/stack/cinder/cinder/backup/driver.py:98}} Jul 03 09:54:35.592785 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.driver [None req-6bc0875d-e30e-4007-874d-df215a6caa1d tempest-VolumesBackupsTest-1484886458 None] Getting metadata type 'volume-metadata' {{(pid=101319) _save_vol_meta /opt/stack/cinder/cinder/backup/driver.py:109}} Jul 03 09:54:35.595841 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.driver [None req-6bc0875d-e30e-4007-874d-df215a6caa1d tempest-VolumesBackupsTest-1484886458 None] No metadata type 'volume-metadata' available {{(pid=101319) _save_vol_meta /opt/stack/cinder/cinder/backup/driver.py:123}} Jul 03 09:54:35.595957 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.driver [None req-6bc0875d-e30e-4007-874d-df215a6caa1d tempest-VolumesBackupsTest-1484886458 None] Getting metadata type 'volume-glance-metadata' {{(pid=101319) _save_vol_glance_meta /opt/stack/cinder/cinder/backup/driver.py:132}} Jul 03 09:54:35.598287 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.driver [None req-6bc0875d-e30e-4007-874d-df215a6caa1d tempest-VolumesBackupsTest-1484886458 None] No metadata type 'volume-glance-metadata' available {{(pid=101319) _save_vol_glance_meta /opt/stack/cinder/cinder/backup/driver.py:147}} Jul 03 09:54:35.598509 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-6bc0875d-e30e-4007-874d-df215a6caa1d tempest-VolumesBackupsTest-1484886458 None] _write_sha256file started, container name: volumebackups, sha256file filename: volume_b578d41f-4c6a-49b3-b5ec-bcd6556e2e68/20260703095431/az_nova_backup_1d0329c6-9a47-475d-9e89-7237611956aa_sha256file. {{(pid=101319) _write_sha256file /opt/stack/cinder/cinder/backup/chunkeddriver.py:299}} Jul 03 09:54:35.633658 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-c7a2f1c0-d186-4b36-b89b-132cc9579b18 tempest-ProjectMemberTests33-2105464604 None] backup MD5 for volume_28e6e1d6-2242-44e7-9f43-e6ae7f7d5f56/20260703095429/az_nova_backup_6f767c43-dfb9-4a05-93e6-d969f7407465-00011: 25e317773f308e446cc84c503a6d1f85 {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 09:54:35.633742 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-c7a2f1c0-d186-4b36-b89b-132cc9579b18 tempest-ProjectMemberTests33-2105464604 None] Calling eventlet.sleep(0) {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 09:54:35.664010 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-6bc0875d-e30e-4007-874d-df215a6caa1d tempest-VolumesBackupsTest-1484886458 None] _write_sha256file finished. {{(pid=101319) _write_sha256file /opt/stack/cinder/cinder/backup/chunkeddriver.py:315}} Jul 03 09:54:35.664732 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-6bc0875d-e30e-4007-874d-df215a6caa1d tempest-VolumesBackupsTest-1484886458 None] _write_metadata started, container name: volumebackups, metadata filename: volume_b578d41f-4c6a-49b3-b5ec-bcd6556e2e68/20260703095431/az_nova_backup_1d0329c6-9a47-475d-9e89-7237611956aa_metadata. {{(pid=101319) _write_metadata /opt/stack/cinder/cinder/backup/chunkeddriver.py:276}} Jul 03 09:54:35.689269 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-6bc0875d-e30e-4007-874d-df215a6caa1d tempest-VolumesBackupsTest-1484886458 None] _write_metadata finished. Metadata: b'{\n "backup_description": null,\n "backup_id": "1d0329c6-9a47-475d-9e89-7237611956aa",\n "backup_name": "tempest-VolumesBackupsTest-Backup-347384200",\n "created_at": "2026-07-03 09:54:28+00:00",\n "objects": [],\n "parent_id": "44885c93-b853-422a-9a76-29c7e7bf3d8e",\n "version": "1.0.0",\n "volume_id": "b578d41f-4c6a-49b3-b5ec-bcd6556e2e68",\n "volume_meta": "{\\"version\\": 2, \\"volume-base-metadata\\": {\\"id\\": \\"b578d41f-4c6a-49b3-b5ec-bcd6556e2e68\\", \\"_name_id\\": null, \\"use_quota\\": true, \\"ec2_id\\": null, \\"user_id\\": \\"e3b8ecc8212649f489f39b74eac8ff8f\\", \\"project_id\\": \\"c36863fd49104594b80b419fafd78f5c\\", \\"snapshot_id\\": null, \\"cluster_name\\": null, \\"host\\": \\"np0000004400@storpool#default\\", \\"size\\": 1, \\"availability_zone\\": \\"nova\\", \\"status\\": \\"backing-up\\", \\"attach_status\\": \\"detached\\", \\"migration_status\\": null, \\"scheduled_at\\": \\"2026-07-03T09:53:43.000000\\", \\"launched_at\\": \\"2026-07-03T09:53:43.000000\\", \\"terminated_at\\": null, \\"display_name\\": \\"tempest-VolumesBackupsTest-Volume-1091773389\\", \\"display_description\\": null, \\"provider_location\\": null, \\"provider_auth\\": null, \\"provider_geometry\\": null, \\"provider_id\\": null, \\"volume_type_id\\": \\"03e13fe6-0e30-4803-ace0-725d38e6dc24\\", \\"source_volid\\": null, \\"encryption_key_id\\": null, \\"consistencygroup_id\\": null, \\"group_id\\": null, \\"bootable\\": false, \\"multiattach\\": false, \\"replication_status\\": null, \\"replication_extended_status\\": null, \\"replication_driver_data\\": null, \\"previous_status\\": \\"available\\", \\"service_uuid\\": \\"6d4b0e79-fefe-4744-b25f-34be05095200\\", \\"shared_targets\\": true, \\"deleted_at\\": null, \\"deleted\\": false, \\"created_at\\": \\"2026-07-03T09:53:43.000000\\", \\"updated_at\\": \\"2026-07-03T09:54:28.000000\\"}}"\n}'. {{(pid=101319) _write_metadata /opt/stack/cinder/cinder/backup/chunkeddriver.py:295}} Jul 03 09:54:35.701558 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-6bc0875d-e30e-4007-874d-df215a6caa1d tempest-VolumesBackupsTest-1484886458 None] backup 1d0329c6-9a47-475d-9e89-7237611956aa finished. {{(pid=101319) _finalize_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:462}} Jul 03 09:54:35.840391 np0000004400 cinder-backup[101319]: DEBUG oslo_concurrency.processutils [None req-6bc0875d-e30e-4007-874d-df215a6caa1d tempest-VolumesBackupsTest-1484886458 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chown 0 /dev/sdc {{(pid=101319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 09:54:35.871559 np0000004400 sudo[156389]: stack : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chown 0 /dev/sdc Jul 03 09:54:35.872143 np0000004400 sudo[156389]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1002) Jul 03 09:54:35.889635 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-c7a2f1c0-d186-4b36-b89b-132cc9579b18 tempest-ProjectMemberTests33-2105464604 None] Backing up chunk of data from volume. {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 09:54:36.131252 np0000004400 sudo[156389]: pam_unix(sudo:session): session closed for user root Jul 03 09:54:36.132541 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-c7a2f1c0-d186-4b36-b89b-132cc9579b18 tempest-ProjectMemberTests33-2105464604 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101319) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 09:54:36.132677 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-c7a2f1c0-d186-4b36-b89b-132cc9579b18 tempest-ProjectMemberTests33-2105464604 None] About to put_object {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 09:54:36.135029 np0000004400 cinder-backup[101319]: DEBUG oslo_concurrency.processutils [None req-6bc0875d-e30e-4007-874d-df215a6caa1d tempest-VolumesBackupsTest-1484886458 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chown 0 /dev/sdc" returned: 0 in 0.295s {{(pid=101319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 09:54:36.135554 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-6bc0875d-e30e-4007-874d-df215a6caa1d tempest-VolumesBackupsTest-1484886458 None] ==> disconnect_volume: call "{'args': (, {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-b578d41f-4c6a-49b3-b5ec-bcd6556e2e68', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'b578d41f-4c6a-49b3-b5ec-bcd6556e2e68', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': False}, {'type': 'block', 'scsi_wwn': 'SStorPool_iSCSI_DISK_1034578903445799236', 'path': '/dev/sdc'}), 'kwargs': {'force': True, 'ignore_errors': True}}" {{(pid=101319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}} Jul 03 09:54:36.135732 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.base [None req-6bc0875d-e30e-4007-874d-df215a6caa1d tempest-VolumesBackupsTest-1484886458 None] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=101319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jul 03 09:54:36.136803 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.base [None req-6bc0875d-e30e-4007-874d-df215a6caa1d tempest-VolumesBackupsTest-1484886458 None] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=101319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jul 03 09:54:36.137492 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-6bc0875d-e30e-4007-874d-df215a6caa1d tempest-VolumesBackupsTest-1484886458 None] _get_connection_devices called with parameters: connection_properties={'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-b578d41f-4c6a-49b3-b5ec-bcd6556e2e68', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'b578d41f-4c6a-49b3-b5ec-bcd6556e2e68', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': False}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=101319) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:847}} Jul 03 09:54:36.149173 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-6bc0875d-e30e-4007-874d-df215a6caa1d tempest-VolumesBackupsTest-1484886458 None] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS: Jul 03 09:54:36.149173 np0000004400 cinder-backup[101319]: No targets found. Jul 03 09:54:36.149173 np0000004400 cinder-backup[101319]: iSNS: Jul 03 09:54:36.149173 np0000004400 cinder-backup[101319]: No targets found. Jul 03 09:54:36.149173 np0000004400 cinder-backup[101319]: STATIC: Jul 03 09:54:36.149173 np0000004400 cinder-backup[101319]: Target: iqn.2023-03.storpool.com:os--volume-b578d41f-4c6a-49b3-b5ec-bcd6556e2e68 Jul 03 09:54:36.149173 np0000004400 cinder-backup[101319]: Portal: 192.168.40.100:3260,-1 Jul 03 09:54:36.149173 np0000004400 cinder-backup[101319]: Iface Name: default Jul 03 09:54:36.149173 np0000004400 cinder-backup[101319]: Target: iqn.2023-03.storpool.com:os--volume-28e6e1d6-2242-44e7-9f43-e6ae7f7d5f56 Jul 03 09:54:36.149173 np0000004400 cinder-backup[101319]: Portal: 192.168.40.100:3260,-1 Jul 03 09:54:36.149173 np0000004400 cinder-backup[101319]: Iface Name: default Jul 03 09:54:36.149173 np0000004400 cinder-backup[101319]: Target: iqn.2023-03.storpool.com:os--volume-789ec59e-ea87-4784-8990-156a35276b5f Jul 03 09:54:36.149173 np0000004400 cinder-backup[101319]: Portal: 192.168.50.100:3260,-1 Jul 03 09:54:36.149173 np0000004400 cinder-backup[101319]: Iface Name: default Jul 03 09:54:36.149173 np0000004400 cinder-backup[101319]: Portal: 192.168.40.100:3260,-1 Jul 03 09:54:36.149173 np0000004400 cinder-backup[101319]: Iface Name: default Jul 03 09:54:36.149173 np0000004400 cinder-backup[101319]: Target: iqn.2023-03.storpool.com:os--volume-f9e48e4b-6866-4ad9-bc3b-93ae778de731 Jul 03 09:54:36.149173 np0000004400 cinder-backup[101319]: Portal: 192.168.50.100:3260,-1 Jul 03 09:54:36.149173 np0000004400 cinder-backup[101319]: Iface Name: default Jul 03 09:54:36.149173 np0000004400 cinder-backup[101319]: Portal: 192.168.40.100:3260,-1 Jul 03 09:54:36.149173 np0000004400 cinder-backup[101319]: Iface Name: default Jul 03 09:54:36.149173 np0000004400 cinder-backup[101319]: FIRMWARE: Jul 03 09:54:36.149173 np0000004400 cinder-backup[101319]: No targets found. Jul 03 09:54:36.149173 np0000004400 cinder-backup[101319]: stderr= {{(pid=101319) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jul 03 09:54:36.149684 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-6bc0875d-e30e-4007-874d-df215a6caa1d tempest-VolumesBackupsTest-1484886458 None] Regex to get portals from discoverydb: ^SENDTARGETS: Jul 03 09:54:36.149684 np0000004400 cinder-backup[101319]: .*?^DiscoveryAddress: 192.168.40.100,3260.*? Jul 03 09:54:36.149684 np0000004400 cinder-backup[101319]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=101319) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:390}} Jul 03 09:54:36.149684 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-6bc0875d-e30e-4007-874d-df215a6caa1d tempest-VolumesBackupsTest-1484886458 None] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-b578d41f-4c6a-49b3-b5ec-bcd6556e2e68', 0)] {{(pid=101319) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:858}} Jul 03 09:54:36.172852 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-6bc0875d-e30e-4007-874d-df215a6caa1d tempest-VolumesBackupsTest-1484886458 None] iscsiadm ('-m', 'session'): stdout=tcp: [208] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-789ec59e-ea87-4784-8990-156a35276b5f (non-flash) Jul 03 09:54:36.172852 np0000004400 cinder-backup[101319]: tcp: [209] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-789ec59e-ea87-4784-8990-156a35276b5f (non-flash) Jul 03 09:54:36.172852 np0000004400 cinder-backup[101319]: tcp: [213] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-28e6e1d6-2242-44e7-9f43-e6ae7f7d5f56 (non-flash) Jul 03 09:54:36.172852 np0000004400 cinder-backup[101319]: tcp: [214] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b578d41f-4c6a-49b3-b5ec-bcd6556e2e68 (non-flash) Jul 03 09:54:36.172852 np0000004400 cinder-backup[101319]: tcp: [215] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f9e48e4b-6866-4ad9-bc3b-93ae778de731 (non-flash) Jul 03 09:54:36.172852 np0000004400 cinder-backup[101319]: tcp: [216] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f9e48e4b-6866-4ad9-bc3b-93ae778de731 (non-flash) Jul 03 09:54:36.172852 np0000004400 cinder-backup[101319]: stderr= {{(pid=101319) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jul 03 09:54:36.173167 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-6bc0875d-e30e-4007-874d-df215a6caa1d tempest-VolumesBackupsTest-1484886458 None] iscsi session list stdout=tcp: [208] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-789ec59e-ea87-4784-8990-156a35276b5f (non-flash) Jul 03 09:54:36.173167 np0000004400 cinder-backup[101319]: tcp: [209] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-789ec59e-ea87-4784-8990-156a35276b5f (non-flash) Jul 03 09:54:36.173167 np0000004400 cinder-backup[101319]: tcp: [213] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-28e6e1d6-2242-44e7-9f43-e6ae7f7d5f56 (non-flash) Jul 03 09:54:36.173167 np0000004400 cinder-backup[101319]: tcp: [214] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b578d41f-4c6a-49b3-b5ec-bcd6556e2e68 (non-flash) Jul 03 09:54:36.173167 np0000004400 cinder-backup[101319]: tcp: [215] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f9e48e4b-6866-4ad9-bc3b-93ae778de731 (non-flash) Jul 03 09:54:36.173167 np0000004400 cinder-backup[101319]: tcp: [216] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f9e48e4b-6866-4ad9-bc3b-93ae778de731 (non-flash) Jul 03 09:54:36.173167 np0000004400 cinder-backup[101319]: stderr= {{(pid=101319) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jul 03 09:54:36.173167 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-6bc0875d-e30e-4007-874d-df215a6caa1d tempest-VolumesBackupsTest-1484886458 None] Sessions list: [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-789ec59e-ea87-4784-8990-156a35276b5f', '208'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-789ec59e-ea87-4784-8990-156a35276b5f', '209'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-28e6e1d6-2242-44e7-9f43-e6ae7f7d5f56', '213'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-b578d41f-4c6a-49b3-b5ec-bcd6556e2e68', '214'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-f9e48e4b-6866-4ad9-bc3b-93ae778de731', '215'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-f9e48e4b-6866-4ad9-bc3b-93ae778de731', '216')] {{(pid=101319) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:866}} Jul 03 09:54:36.173361 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-6bc0875d-e30e-4007-874d-df215a6caa1d tempest-VolumesBackupsTest-1484886458 None] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-b578d41f-4c6a-49b3-b5ec-bcd6556e2e68, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-b578d41f-4c6a-49b3-b5ec-bcd6556e2e68', '214')] {{(pid=101319) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}} Jul 03 09:54:36.174110 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-6bc0875d-e30e-4007-874d-df215a6caa1d tempest-VolumesBackupsTest-1484886458 None] Resulting device map defaultdict(. at 0x7e7705856de0>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-b578d41f-4c6a-49b3-b5ec-bcd6556e2e68'): ({'sdc'}, set())}) {{(pid=101319) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:912}} Jul 03 09:54:36.174302 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.linuxscsi [None req-6bc0875d-e30e-4007-874d-df215a6caa1d tempest-VolumesBackupsTest-1484886458 None] Removing single pathed devices sdc {{(pid=101319) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}} Jul 03 09:54:36.183537 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.linuxscsi [None req-6bc0875d-e30e-4007-874d-df215a6caa1d tempest-VolumesBackupsTest-1484886458 None] Flushing IO for device /dev/sdc {{(pid=101319) flush_device_io /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:461}} Jul 03 09:54:36.192241 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.linuxscsi [None req-6bc0875d-e30e-4007-874d-df215a6caa1d tempest-VolumesBackupsTest-1484886458 None] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=101319) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}} Jul 03 09:54:36.231047 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.linuxscsi [None req-6bc0875d-e30e-4007-874d-df215a6caa1d tempest-VolumesBackupsTest-1484886458 None] Checking to see if SCSI volumes sdc have been removed. {{(pid=101319) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}} Jul 03 09:54:36.231200 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.linuxscsi [None req-6bc0875d-e30e-4007-874d-df215a6caa1d tempest-VolumesBackupsTest-1484886458 None] SCSI volumes sdc have been removed. {{(pid=101319) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}} Jul 03 09:54:36.232111 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.linuxscsi [None req-6bc0875d-e30e-4007-874d-df215a6caa1d tempest-VolumesBackupsTest-1484886458 None] Checking to see if device paths {'sdc'} are still under multipathd monitoring {{(pid=101319) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}} Jul 03 09:54:36.243324 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-c7a2f1c0-d186-4b36-b89b-132cc9579b18 tempest-ProjectMemberTests33-2105464604 None] backup MD5 for volume_28e6e1d6-2242-44e7-9f43-e6ae7f7d5f56/20260703095429/az_nova_backup_6f767c43-dfb9-4a05-93e6-d969f7407465-00012: 25e317773f308e446cc84c503a6d1f85 {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 09:54:36.243508 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-c7a2f1c0-d186-4b36-b89b-132cc9579b18 tempest-ProjectMemberTests33-2105464604 None] Calling eventlet.sleep(0) {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 09:54:36.245338 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.linuxscsi [None req-6bc0875d-e30e-4007-874d-df215a6caa1d tempest-VolumesBackupsTest-1484886458 None] Device paths {'sdc'} have been removed from multipathd monitoring. {{(pid=101319) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}} Jul 03 09:54:36.245579 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-6bc0875d-e30e-4007-874d-df215a6caa1d tempest-VolumesBackupsTest-1484886458 None] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-b578d41f-4c6a-49b3-b5ec-bcd6556e2e68')] {{(pid=101319) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1225}} Jul 03 09:54:36.257356 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-6bc0875d-e30e-4007-874d-df215a6caa1d tempest-VolumesBackupsTest-1484886458 None] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=101319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 03 09:54:36.295640 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-6bc0875d-e30e-4007-874d-df215a6caa1d tempest-VolumesBackupsTest-1484886458 None] iscsiadm ('--logout',): stdout=Logging out of session [sid: 214, target: iqn.2023-03.storpool.com:os--volume-b578d41f-4c6a-49b3-b5ec-bcd6556e2e68, portal: 192.168.40.100,3260] Jul 03 09:54:36.295640 np0000004400 cinder-backup[101319]: Logout of [sid: 214, target: iqn.2023-03.storpool.com:os--volume-b578d41f-4c6a-49b3-b5ec-bcd6556e2e68, portal: 192.168.40.100,3260] successful. Jul 03 09:54:36.295640 np0000004400 cinder-backup[101319]: stderr= {{(pid=101319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 03 09:54:36.309357 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-6bc0875d-e30e-4007-874d-df215a6caa1d tempest-VolumesBackupsTest-1484886458 None] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=101319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 03 09:54:36.309658 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.base [None req-6bc0875d-e30e-4007-874d-df215a6caa1d tempest-VolumesBackupsTest-1484886458 None] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.173s {{(pid=101319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jul 03 09:54:36.309824 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-6bc0875d-e30e-4007-874d-df215a6caa1d tempest-VolumesBackupsTest-1484886458 None] <== disconnect_volume: return (174ms) None {{(pid=101319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}} Jul 03 09:54:36.453100 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-c7a2f1c0-d186-4b36-b89b-132cc9579b18 tempest-ProjectMemberTests33-2105464604 None] Backing up chunk of data from volume. {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 09:54:36.692645 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-c7a2f1c0-d186-4b36-b89b-132cc9579b18 tempest-ProjectMemberTests33-2105464604 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101319) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 09:54:36.692823 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-c7a2f1c0-d186-4b36-b89b-132cc9579b18 tempest-ProjectMemberTests33-2105464604 None] About to put_object {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 09:54:36.790320 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-c7a2f1c0-d186-4b36-b89b-132cc9579b18 tempest-ProjectMemberTests33-2105464604 None] backup MD5 for volume_28e6e1d6-2242-44e7-9f43-e6ae7f7d5f56/20260703095429/az_nova_backup_6f767c43-dfb9-4a05-93e6-d969f7407465-00013: 25e317773f308e446cc84c503a6d1f85 {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 09:54:36.790495 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-c7a2f1c0-d186-4b36-b89b-132cc9579b18 tempest-ProjectMemberTests33-2105464604 None] Calling eventlet.sleep(0) {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 09:54:36.954285 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-c7a2f1c0-d186-4b36-b89b-132cc9579b18 tempest-ProjectMemberTests33-2105464604 None] Backing up chunk of data from volume. {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 09:54:37.192990 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-c7a2f1c0-d186-4b36-b89b-132cc9579b18 tempest-ProjectMemberTests33-2105464604 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101319) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 09:54:37.193102 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-c7a2f1c0-d186-4b36-b89b-132cc9579b18 tempest-ProjectMemberTests33-2105464604 None] About to put_object {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 09:54:37.292259 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-c7a2f1c0-d186-4b36-b89b-132cc9579b18 tempest-ProjectMemberTests33-2105464604 None] backup MD5 for volume_28e6e1d6-2242-44e7-9f43-e6ae7f7d5f56/20260703095429/az_nova_backup_6f767c43-dfb9-4a05-93e6-d969f7407465-00014: 25e317773f308e446cc84c503a6d1f85 {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 09:54:37.292433 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-c7a2f1c0-d186-4b36-b89b-132cc9579b18 tempest-ProjectMemberTests33-2105464604 None] Calling eventlet.sleep(0) {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 09:54:37.335552 np0000004400 cinder-backup[101319]: INFO cinder.backup.manager [None req-6bc0875d-e30e-4007-874d-df215a6caa1d tempest-VolumesBackupsTest-1484886458 None] Create backup finished. backup: 1d0329c6-9a47-475d-9e89-7237611956aa. Jul 03 09:54:37.404652 np0000004400 cinder-backup[101319]: INFO cinder.backup.manager [None req-23abc11d-0ea3-4386-81ab-65f73b1328e9 tempest-VolumesBackupsTest-1484886458 None] Delete backup started, backup: 1d0329c6-9a47-475d-9e89-7237611956aa. Jul 03 09:54:37.413604 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.drivers.swift [None req-23abc11d-0ea3-4386-81ab-65f73b1328e9 tempest-VolumesBackupsTest-1484886458 None] Using swift URL https://10.4.3.95:8080/v1/AUTH_c36863fd49104594b80b419fafd78f5c {{(pid=101319) initialize /opt/stack/cinder/cinder/backup/drivers/swift.py:300}} Jul 03 09:54:37.413898 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.drivers.swift [None req-23abc11d-0ea3-4386-81ab-65f73b1328e9 tempest-VolumesBackupsTest-1484886458 None] Connect to https://10.4.3.95:8080/v1/AUTH_ in "per_user" mode {{(pid=101319) initialize /opt/stack/cinder/cinder/backup/drivers/swift.py:301}} Jul 03 09:54:37.414321 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-23abc11d-0ea3-4386-81ab-65f73b1328e9 tempest-VolumesBackupsTest-1484886458 None] delete started, backup: 1d0329c6-9a47-475d-9e89-7237611956aa, container: volumebackups, prefix: volume_b578d41f-4c6a-49b3-b5ec-bcd6556e2e68/20260703095431/az_nova_backup_1d0329c6-9a47-475d-9e89-7237611956aa. {{(pid=101319) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:822}} Jul 03 09:54:37.461360 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-23abc11d-0ea3-4386-81ab-65f73b1328e9 tempest-VolumesBackupsTest-1484886458 None] generated object list: ['volume_b578d41f-4c6a-49b3-b5ec-bcd6556e2e68/20260703095431/az_nova_backup_1d0329c6-9a47-475d-9e89-7237611956aa_metadata', 'volume_b578d41f-4c6a-49b3-b5ec-bcd6556e2e68/20260703095431/az_nova_backup_1d0329c6-9a47-475d-9e89-7237611956aa_sha256file']. {{(pid=101319) _generate_object_names /opt/stack/cinder/cinder/backup/chunkeddriver.py:260}} Jul 03 09:54:37.477115 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-c7a2f1c0-d186-4b36-b89b-132cc9579b18 tempest-ProjectMemberTests33-2105464604 None] Backing up chunk of data from volume. {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 09:54:37.481946 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-23abc11d-0ea3-4386-81ab-65f73b1328e9 tempest-VolumesBackupsTest-1484886458 None] deleted object: volume_b578d41f-4c6a-49b3-b5ec-bcd6556e2e68/20260703095431/az_nova_backup_1d0329c6-9a47-475d-9e89-7237611956aa_metadata in container: volumebackups. {{(pid=101319) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 09:54:37.498528 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-23abc11d-0ea3-4386-81ab-65f73b1328e9 tempest-VolumesBackupsTest-1484886458 None] deleted object: volume_b578d41f-4c6a-49b3-b5ec-bcd6556e2e68/20260703095431/az_nova_backup_1d0329c6-9a47-475d-9e89-7237611956aa_sha256file in container: volumebackups. {{(pid=101319) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 09:54:37.498740 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-23abc11d-0ea3-4386-81ab-65f73b1328e9 tempest-VolumesBackupsTest-1484886458 None] delete 1d0329c6-9a47-475d-9e89-7237611956aa finished. {{(pid=101319) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:848}} Jul 03 09:54:37.529180 np0000004400 cinder-backup[101319]: DEBUG oslo_db.sqlalchemy.engines [None req-23abc11d-0ea3-4386-81ab-65f73b1328e9 tempest-VolumesBackupsTest-1484886458 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=101319) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 03 09:54:37.541854 np0000004400 cinder-backup[101319]: DEBUG cinder.quota [None req-23abc11d-0ea3-4386-81ab-65f73b1328e9 tempest-VolumesBackupsTest-1484886458 None] Created reservations ['78b8cd83-cbe6-49d0-8fd9-5c1906c337cb', '2586a124-ad32-44c1-90cd-15d9a1e2250d'] {{(pid=101319) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 09:54:37.564478 np0000004400 cinder-backup[101319]: INFO cinder.backup.manager [None req-23abc11d-0ea3-4386-81ab-65f73b1328e9 tempest-VolumesBackupsTest-1484886458 None] Delete backup finished, backup 1d0329c6-9a47-475d-9e89-7237611956aa deleted. Jul 03 09:54:37.715147 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-c7a2f1c0-d186-4b36-b89b-132cc9579b18 tempest-ProjectMemberTests33-2105464604 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101319) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 09:54:37.715572 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-c7a2f1c0-d186-4b36-b89b-132cc9579b18 tempest-ProjectMemberTests33-2105464604 None] About to put_object {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 09:54:37.811355 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-c7a2f1c0-d186-4b36-b89b-132cc9579b18 tempest-ProjectMemberTests33-2105464604 None] backup MD5 for volume_28e6e1d6-2242-44e7-9f43-e6ae7f7d5f56/20260703095429/az_nova_backup_6f767c43-dfb9-4a05-93e6-d969f7407465-00015: 25e317773f308e446cc84c503a6d1f85 {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 09:54:37.811536 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-c7a2f1c0-d186-4b36-b89b-132cc9579b18 tempest-ProjectMemberTests33-2105464604 None] Calling eventlet.sleep(0) {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 09:54:37.981618 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-c7a2f1c0-d186-4b36-b89b-132cc9579b18 tempest-ProjectMemberTests33-2105464604 None] Backing up chunk of data from volume. {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 09:54:38.222533 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-c7a2f1c0-d186-4b36-b89b-132cc9579b18 tempest-ProjectMemberTests33-2105464604 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101319) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 09:54:38.222735 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-c7a2f1c0-d186-4b36-b89b-132cc9579b18 tempest-ProjectMemberTests33-2105464604 None] About to put_object {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 09:54:38.319300 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-c7a2f1c0-d186-4b36-b89b-132cc9579b18 tempest-ProjectMemberTests33-2105464604 None] backup MD5 for volume_28e6e1d6-2242-44e7-9f43-e6ae7f7d5f56/20260703095429/az_nova_backup_6f767c43-dfb9-4a05-93e6-d969f7407465-00016: 25e317773f308e446cc84c503a6d1f85 {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 09:54:38.319443 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-c7a2f1c0-d186-4b36-b89b-132cc9579b18 tempest-ProjectMemberTests33-2105464604 None] Calling eventlet.sleep(0) {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 09:54:38.468969 np0000004400 cinder-backup[101319]: INFO cinder.backup.manager [None req-b4d2b370-8f09-4b45-ad9e-11c317977d3e tempest-VolumesBackupsTest-807180270 None] Delete backup started, backup: ab559f16-a070-4b18-9c05-f0f3a1985361. Jul 03 09:54:38.472947 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.drivers.swift [None req-b4d2b370-8f09-4b45-ad9e-11c317977d3e tempest-VolumesBackupsTest-807180270 None] Using swift URL https://10.4.3.95:8080/v1/AUTH_298e794341b64951b3fb757bfbffa698 {{(pid=101319) initialize /opt/stack/cinder/cinder/backup/drivers/swift.py:300}} Jul 03 09:54:38.473494 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.drivers.swift [None req-b4d2b370-8f09-4b45-ad9e-11c317977d3e tempest-VolumesBackupsTest-807180270 None] Connect to https://10.4.3.95:8080/v1/AUTH_ in "per_user" mode {{(pid=101319) initialize /opt/stack/cinder/cinder/backup/drivers/swift.py:301}} Jul 03 09:54:38.473728 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-b4d2b370-8f09-4b45-ad9e-11c317977d3e tempest-VolumesBackupsTest-807180270 None] delete started, backup: ab559f16-a070-4b18-9c05-f0f3a1985361, container: volumebackups, prefix: volume_b578d41f-4c6a-49b3-b5ec-bcd6556e2e68/20260703095422/az_nova_backup_ab559f16-a070-4b18-9c05-f0f3a1985361. {{(pid=101319) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:822}} Jul 03 09:54:38.520681 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-c7a2f1c0-d186-4b36-b89b-132cc9579b18 tempest-ProjectMemberTests33-2105464604 None] Backing up chunk of data from volume. {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 09:54:38.527104 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-b4d2b370-8f09-4b45-ad9e-11c317977d3e tempest-VolumesBackupsTest-807180270 None] generated object list: ['volume_b578d41f-4c6a-49b3-b5ec-bcd6556e2e68/20260703095422/az_nova_backup_ab559f16-a070-4b18-9c05-f0f3a1985361_metadata', 'volume_b578d41f-4c6a-49b3-b5ec-bcd6556e2e68/20260703095422/az_nova_backup_ab559f16-a070-4b18-9c05-f0f3a1985361_sha256file']. {{(pid=101319) _generate_object_names /opt/stack/cinder/cinder/backup/chunkeddriver.py:260}} Jul 03 09:54:38.546541 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-b4d2b370-8f09-4b45-ad9e-11c317977d3e tempest-VolumesBackupsTest-807180270 None] deleted object: volume_b578d41f-4c6a-49b3-b5ec-bcd6556e2e68/20260703095422/az_nova_backup_ab559f16-a070-4b18-9c05-f0f3a1985361_metadata in container: volumebackups. {{(pid=101319) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 09:54:38.563566 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-b4d2b370-8f09-4b45-ad9e-11c317977d3e tempest-VolumesBackupsTest-807180270 None] deleted object: volume_b578d41f-4c6a-49b3-b5ec-bcd6556e2e68/20260703095422/az_nova_backup_ab559f16-a070-4b18-9c05-f0f3a1985361_sha256file in container: volumebackups. {{(pid=101319) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 09:54:38.563892 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-b4d2b370-8f09-4b45-ad9e-11c317977d3e tempest-VolumesBackupsTest-807180270 None] delete ab559f16-a070-4b18-9c05-f0f3a1985361 finished. {{(pid=101319) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:848}} Jul 03 09:54:38.601014 np0000004400 cinder-backup[101319]: DEBUG oslo_db.sqlalchemy.engines [None req-b4d2b370-8f09-4b45-ad9e-11c317977d3e tempest-VolumesBackupsTest-807180270 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=101319) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 03 09:54:38.617178 np0000004400 cinder-backup[101319]: DEBUG cinder.quota [None req-b4d2b370-8f09-4b45-ad9e-11c317977d3e tempest-VolumesBackupsTest-807180270 None] Created reservations ['e535da97-d248-48cf-81e4-78a6a3f3244c', '197ec9bd-c0d6-4f6d-ae8e-dcf5680d86ae'] {{(pid=101319) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 09:54:38.642155 np0000004400 cinder-backup[101319]: INFO cinder.backup.manager [None req-b4d2b370-8f09-4b45-ad9e-11c317977d3e tempest-VolumesBackupsTest-807180270 None] Delete backup finished, backup ab559f16-a070-4b18-9c05-f0f3a1985361 deleted. Jul 03 09:54:38.766890 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-c7a2f1c0-d186-4b36-b89b-132cc9579b18 tempest-ProjectMemberTests33-2105464604 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101319) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 09:54:38.767009 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-c7a2f1c0-d186-4b36-b89b-132cc9579b18 tempest-ProjectMemberTests33-2105464604 None] About to put_object {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 09:54:38.862952 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-c7a2f1c0-d186-4b36-b89b-132cc9579b18 tempest-ProjectMemberTests33-2105464604 None] backup MD5 for volume_28e6e1d6-2242-44e7-9f43-e6ae7f7d5f56/20260703095429/az_nova_backup_6f767c43-dfb9-4a05-93e6-d969f7407465-00017: 25e317773f308e446cc84c503a6d1f85 {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 09:54:38.863217 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-c7a2f1c0-d186-4b36-b89b-132cc9579b18 tempest-ProjectMemberTests33-2105464604 None] Calling eventlet.sleep(0) {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 09:54:39.037236 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-c7a2f1c0-d186-4b36-b89b-132cc9579b18 tempest-ProjectMemberTests33-2105464604 None] Backing up chunk of data from volume. {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 09:54:39.279439 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-c7a2f1c0-d186-4b36-b89b-132cc9579b18 tempest-ProjectMemberTests33-2105464604 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101319) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 09:54:39.279677 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-c7a2f1c0-d186-4b36-b89b-132cc9579b18 tempest-ProjectMemberTests33-2105464604 None] About to put_object {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 09:54:39.379505 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-c7a2f1c0-d186-4b36-b89b-132cc9579b18 tempest-ProjectMemberTests33-2105464604 None] backup MD5 for volume_28e6e1d6-2242-44e7-9f43-e6ae7f7d5f56/20260703095429/az_nova_backup_6f767c43-dfb9-4a05-93e6-d969f7407465-00018: 25e317773f308e446cc84c503a6d1f85 {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 09:54:39.379661 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-c7a2f1c0-d186-4b36-b89b-132cc9579b18 tempest-ProjectMemberTests33-2105464604 None] Calling eventlet.sleep(0) {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 09:54:39.529120 np0000004400 cinder-backup[101319]: INFO cinder.backup.manager [None req-7798130a-35d4-4493-9272-c6ff5c5baa5c tempest-VolumesBackupsTest-1484886458 None] Delete backup started, backup: 44885c93-b853-422a-9a76-29c7e7bf3d8e. Jul 03 09:54:39.532426 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.drivers.swift [None req-7798130a-35d4-4493-9272-c6ff5c5baa5c tempest-VolumesBackupsTest-1484886458 None] Using swift URL https://10.4.3.95:8080/v1/AUTH_c36863fd49104594b80b419fafd78f5c {{(pid=101319) initialize /opt/stack/cinder/cinder/backup/drivers/swift.py:300}} Jul 03 09:54:39.532608 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.drivers.swift [None req-7798130a-35d4-4493-9272-c6ff5c5baa5c tempest-VolumesBackupsTest-1484886458 None] Connect to https://10.4.3.95:8080/v1/AUTH_ in "per_user" mode {{(pid=101319) initialize /opt/stack/cinder/cinder/backup/drivers/swift.py:301}} Jul 03 09:54:39.532911 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-7798130a-35d4-4493-9272-c6ff5c5baa5c tempest-VolumesBackupsTest-1484886458 None] delete started, backup: 44885c93-b853-422a-9a76-29c7e7bf3d8e, container: volumebackups, prefix: volume_b578d41f-4c6a-49b3-b5ec-bcd6556e2e68/20260703095405/az_nova_backup_44885c93-b853-422a-9a76-29c7e7bf3d8e. {{(pid=101319) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:822}} Jul 03 09:54:39.566153 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-7798130a-35d4-4493-9272-c6ff5c5baa5c tempest-VolumesBackupsTest-1484886458 None] generated object list: ['volume_b578d41f-4c6a-49b3-b5ec-bcd6556e2e68/20260703095405/az_nova_backup_44885c93-b853-422a-9a76-29c7e7bf3d8e-00001', 'volume_b578d41f-4c6a-49b3-b5ec-bcd6556e2e68/20260703095405/az_nova_backup_44885c93-b853-422a-9a76-29c7e7bf3d8e-00002', 'volume_b578d41f-4c6a-49b3-b5ec-bcd6556e2e68/20260703095405/az_nova_backup_44885c93-b853-422a-9a76-29c7e7bf3d8e-00003', 'volume_b578d41f-4c6a-49b3-b5ec-bcd6556e2e68/20260703095405/az_nova_backup_44885c93-b853-422a-9a76-29c7e7bf3d8e-00004', 'volume_b578d41f-4c6a-49b3-b5ec-bcd6556e2e68/20260703095405/az_nova_backup_44885c93-b853-422a-9a76-29c7e7bf3d8e-00005', 'volume_b578d41f-4c6a-49b3-b5ec-bcd6556e2e68/20260703095405/az_nova_backup_44885c93-b853-422a-9a76-29c7e7bf3d8e-00006', 'volume_b578d41f-4c6a-49b3-b5ec-bcd6556e2e68/20260703095405/az_nova_backup_44885c93-b853-422a-9a76-29c7e7bf3d8e-00007', 'volume_b578d41f-4c6a-49b3-b5ec-bcd6556e2e68/20260703095405/az_nova_backup_44885c93-b853-422a-9a76-29c7e7bf3d8e-00008', 'volume_b578d41f-4c6a-49b3-b5ec-bcd6556e2e68/20260703095405/az_nova_backup_44885c93-b853-422a-9a76-29c7e7bf3d8e-00009', 'volume_b578d41f-4c6a-49b3-b5ec-bcd6556e2e68/20260703095405/az_nova_backup_44885c93-b853-422a-9a76-29c7e7bf3d8e-00010', 'volume_b578d41f-4c6a-49b3-b5ec-bcd6556e2e68/20260703095405/az_nova_backup_44885c93-b853-422a-9a76-29c7e7bf3d8e-00011', 'volume_b578d41f-4c6a-49b3-b5ec-bcd6556e2e68/20260703095405/az_nova_backup_44885c93-b853-422a-9a76-29c7e7bf3d8e-00012', 'volume_b578d41f-4c6a-49b3-b5ec-bcd6556e2e68/20260703095405/az_nova_backup_44885c93-b853-422a-9a76-29c7e7bf3d8e-00013', 'volume_b578d41f-4c6a-49b3-b5ec-bcd6556e2e68/20260703095405/az_nova_backup_44885c93-b853-422a-9a76-29c7e7bf3d8e-00014', 'volume_b578d41f-4c6a-49b3-b5ec-bcd6556e2e68/20260703095405/az_nova_backup_44885c93-b853-422a-9a76-29c7e7bf3d8e-00015', 'volume_b578d41f-4c6a-49b3-b5ec-bcd6556e2e68/20260703095405/az_nova_backup_44885c93-b853-422a-9a76-29c7e7bf3d8e-00016', 'volume_b578d41f-4c6a-49b3-b5ec-bcd6556e2e68/20260703095405/az_nova_backup_44885c93-b853-422a-9a76-29c7e7bf3d8e-00017', 'volume_b578d41f-4c6a-49b3-b5ec-bcd6556e2e68/20260703095405/az_nova_backup_44885c93-b853-422a-9a76-29c7e7bf3d8e-00018', 'volume_b578d41f-4c6a-49b3-b5ec-bcd6556e2e68/20260703095405/az_nova_backup_44885c93-b853-422a-9a76-29c7e7bf3d8e-00019', 'volume_b578d41f-4c6a-49b3-b5ec-bcd6556e2e68/20260703095405/az_nova_backup_44885c93-b853-422a-9a76-29c7e7bf3d8e-00020', 'volume_b578d41f-4c6a-49b3-b5ec-bcd6556e2e68/20260703095405/az_nova_backup_44885c93-b853-422a-9a76-29c7e7bf3d8e-00021', 'volume_b578d41f-4c6a-49b3-b5ec-bcd6556e2e68/20260703095405/az_nova_backup_44885c93-b853-422a-9a76-29c7e7bf3d8e_metadata', 'volume_b578d41f-4c6a-49b3-b5ec-bcd6556e2e68/20260703095405/az_nova_backup_44885c93-b853-422a-9a76-29c7e7bf3d8e_sha256file']. {{(pid=101319) _generate_object_names /opt/stack/cinder/cinder/backup/chunkeddriver.py:260}} Jul 03 09:54:39.573984 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-c7a2f1c0-d186-4b36-b89b-132cc9579b18 tempest-ProjectMemberTests33-2105464604 None] Backing up chunk of data from volume. {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 09:54:39.581197 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-7798130a-35d4-4493-9272-c6ff5c5baa5c tempest-VolumesBackupsTest-1484886458 None] deleted object: volume_b578d41f-4c6a-49b3-b5ec-bcd6556e2e68/20260703095405/az_nova_backup_44885c93-b853-422a-9a76-29c7e7bf3d8e-00001 in container: volumebackups. {{(pid=101319) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 09:54:39.597307 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-7798130a-35d4-4493-9272-c6ff5c5baa5c tempest-VolumesBackupsTest-1484886458 None] deleted object: volume_b578d41f-4c6a-49b3-b5ec-bcd6556e2e68/20260703095405/az_nova_backup_44885c93-b853-422a-9a76-29c7e7bf3d8e-00002 in container: volumebackups. {{(pid=101319) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 09:54:39.614078 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-7798130a-35d4-4493-9272-c6ff5c5baa5c tempest-VolumesBackupsTest-1484886458 None] deleted object: volume_b578d41f-4c6a-49b3-b5ec-bcd6556e2e68/20260703095405/az_nova_backup_44885c93-b853-422a-9a76-29c7e7bf3d8e-00003 in container: volumebackups. {{(pid=101319) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 09:54:39.630758 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-7798130a-35d4-4493-9272-c6ff5c5baa5c tempest-VolumesBackupsTest-1484886458 None] deleted object: volume_b578d41f-4c6a-49b3-b5ec-bcd6556e2e68/20260703095405/az_nova_backup_44885c93-b853-422a-9a76-29c7e7bf3d8e-00004 in container: volumebackups. {{(pid=101319) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 09:54:39.650237 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-7798130a-35d4-4493-9272-c6ff5c5baa5c tempest-VolumesBackupsTest-1484886458 None] deleted object: volume_b578d41f-4c6a-49b3-b5ec-bcd6556e2e68/20260703095405/az_nova_backup_44885c93-b853-422a-9a76-29c7e7bf3d8e-00005 in container: volumebackups. {{(pid=101319) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 09:54:39.666390 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-7798130a-35d4-4493-9272-c6ff5c5baa5c tempest-VolumesBackupsTest-1484886458 None] deleted object: volume_b578d41f-4c6a-49b3-b5ec-bcd6556e2e68/20260703095405/az_nova_backup_44885c93-b853-422a-9a76-29c7e7bf3d8e-00006 in container: volumebackups. {{(pid=101319) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 09:54:39.681913 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-7798130a-35d4-4493-9272-c6ff5c5baa5c tempest-VolumesBackupsTest-1484886458 None] deleted object: volume_b578d41f-4c6a-49b3-b5ec-bcd6556e2e68/20260703095405/az_nova_backup_44885c93-b853-422a-9a76-29c7e7bf3d8e-00007 in container: volumebackups. {{(pid=101319) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 09:54:39.697413 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-7798130a-35d4-4493-9272-c6ff5c5baa5c tempest-VolumesBackupsTest-1484886458 None] deleted object: volume_b578d41f-4c6a-49b3-b5ec-bcd6556e2e68/20260703095405/az_nova_backup_44885c93-b853-422a-9a76-29c7e7bf3d8e-00008 in container: volumebackups. {{(pid=101319) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 09:54:39.712715 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-7798130a-35d4-4493-9272-c6ff5c5baa5c tempest-VolumesBackupsTest-1484886458 None] deleted object: volume_b578d41f-4c6a-49b3-b5ec-bcd6556e2e68/20260703095405/az_nova_backup_44885c93-b853-422a-9a76-29c7e7bf3d8e-00009 in container: volumebackups. {{(pid=101319) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 09:54:39.733270 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-7798130a-35d4-4493-9272-c6ff5c5baa5c tempest-VolumesBackupsTest-1484886458 None] deleted object: volume_b578d41f-4c6a-49b3-b5ec-bcd6556e2e68/20260703095405/az_nova_backup_44885c93-b853-422a-9a76-29c7e7bf3d8e-00010 in container: volumebackups. {{(pid=101319) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 09:54:39.749624 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-7798130a-35d4-4493-9272-c6ff5c5baa5c tempest-VolumesBackupsTest-1484886458 None] deleted object: volume_b578d41f-4c6a-49b3-b5ec-bcd6556e2e68/20260703095405/az_nova_backup_44885c93-b853-422a-9a76-29c7e7bf3d8e-00011 in container: volumebackups. {{(pid=101319) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 09:54:39.766942 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-7798130a-35d4-4493-9272-c6ff5c5baa5c tempest-VolumesBackupsTest-1484886458 None] deleted object: volume_b578d41f-4c6a-49b3-b5ec-bcd6556e2e68/20260703095405/az_nova_backup_44885c93-b853-422a-9a76-29c7e7bf3d8e-00012 in container: volumebackups. {{(pid=101319) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 09:54:39.790040 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-7798130a-35d4-4493-9272-c6ff5c5baa5c tempest-VolumesBackupsTest-1484886458 None] deleted object: volume_b578d41f-4c6a-49b3-b5ec-bcd6556e2e68/20260703095405/az_nova_backup_44885c93-b853-422a-9a76-29c7e7bf3d8e-00013 in container: volumebackups. {{(pid=101319) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 09:54:39.806562 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-7798130a-35d4-4493-9272-c6ff5c5baa5c tempest-VolumesBackupsTest-1484886458 None] deleted object: volume_b578d41f-4c6a-49b3-b5ec-bcd6556e2e68/20260703095405/az_nova_backup_44885c93-b853-422a-9a76-29c7e7bf3d8e-00014 in container: volumebackups. {{(pid=101319) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 09:54:39.820847 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-c7a2f1c0-d186-4b36-b89b-132cc9579b18 tempest-ProjectMemberTests33-2105464604 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101319) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 09:54:39.820989 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-c7a2f1c0-d186-4b36-b89b-132cc9579b18 tempest-ProjectMemberTests33-2105464604 None] About to put_object {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 09:54:39.821731 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-7798130a-35d4-4493-9272-c6ff5c5baa5c tempest-VolumesBackupsTest-1484886458 None] deleted object: volume_b578d41f-4c6a-49b3-b5ec-bcd6556e2e68/20260703095405/az_nova_backup_44885c93-b853-422a-9a76-29c7e7bf3d8e-00015 in container: volumebackups. {{(pid=101319) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 09:54:39.837621 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-7798130a-35d4-4493-9272-c6ff5c5baa5c tempest-VolumesBackupsTest-1484886458 None] deleted object: volume_b578d41f-4c6a-49b3-b5ec-bcd6556e2e68/20260703095405/az_nova_backup_44885c93-b853-422a-9a76-29c7e7bf3d8e-00016 in container: volumebackups. {{(pid=101319) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 09:54:39.854579 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-7798130a-35d4-4493-9272-c6ff5c5baa5c tempest-VolumesBackupsTest-1484886458 None] deleted object: volume_b578d41f-4c6a-49b3-b5ec-bcd6556e2e68/20260703095405/az_nova_backup_44885c93-b853-422a-9a76-29c7e7bf3d8e-00017 in container: volumebackups. {{(pid=101319) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 09:54:39.870376 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-7798130a-35d4-4493-9272-c6ff5c5baa5c tempest-VolumesBackupsTest-1484886458 None] deleted object: volume_b578d41f-4c6a-49b3-b5ec-bcd6556e2e68/20260703095405/az_nova_backup_44885c93-b853-422a-9a76-29c7e7bf3d8e-00018 in container: volumebackups. {{(pid=101319) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 09:54:39.886509 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-7798130a-35d4-4493-9272-c6ff5c5baa5c tempest-VolumesBackupsTest-1484886458 None] deleted object: volume_b578d41f-4c6a-49b3-b5ec-bcd6556e2e68/20260703095405/az_nova_backup_44885c93-b853-422a-9a76-29c7e7bf3d8e-00019 in container: volumebackups. {{(pid=101319) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 09:54:39.902622 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-7798130a-35d4-4493-9272-c6ff5c5baa5c tempest-VolumesBackupsTest-1484886458 None] deleted object: volume_b578d41f-4c6a-49b3-b5ec-bcd6556e2e68/20260703095405/az_nova_backup_44885c93-b853-422a-9a76-29c7e7bf3d8e-00020 in container: volumebackups. {{(pid=101319) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 09:54:39.918195 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-7798130a-35d4-4493-9272-c6ff5c5baa5c tempest-VolumesBackupsTest-1484886458 None] deleted object: volume_b578d41f-4c6a-49b3-b5ec-bcd6556e2e68/20260703095405/az_nova_backup_44885c93-b853-422a-9a76-29c7e7bf3d8e-00021 in container: volumebackups. {{(pid=101319) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 09:54:39.922835 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-c7a2f1c0-d186-4b36-b89b-132cc9579b18 tempest-ProjectMemberTests33-2105464604 None] backup MD5 for volume_28e6e1d6-2242-44e7-9f43-e6ae7f7d5f56/20260703095429/az_nova_backup_6f767c43-dfb9-4a05-93e6-d969f7407465-00019: 25e317773f308e446cc84c503a6d1f85 {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 09:54:39.922962 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-c7a2f1c0-d186-4b36-b89b-132cc9579b18 tempest-ProjectMemberTests33-2105464604 None] Calling eventlet.sleep(0) {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 09:54:39.947951 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-7798130a-35d4-4493-9272-c6ff5c5baa5c tempest-VolumesBackupsTest-1484886458 None] deleted object: volume_b578d41f-4c6a-49b3-b5ec-bcd6556e2e68/20260703095405/az_nova_backup_44885c93-b853-422a-9a76-29c7e7bf3d8e_metadata in container: volumebackups. {{(pid=101319) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 09:54:39.955089 np0000004400 cinder-backup[101319]: DEBUG oslo_db.sqlalchemy.engines [None req-c7a2f1c0-d186-4b36-b89b-132cc9579b18 tempest-ProjectMemberTests33-2105464604 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=101319) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 03 09:54:39.966335 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-7798130a-35d4-4493-9272-c6ff5c5baa5c tempest-VolumesBackupsTest-1484886458 None] deleted object: volume_b578d41f-4c6a-49b3-b5ec-bcd6556e2e68/20260703095405/az_nova_backup_44885c93-b853-422a-9a76-29c7e7bf3d8e_sha256file in container: volumebackups. {{(pid=101319) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 09:54:39.966568 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-7798130a-35d4-4493-9272-c6ff5c5baa5c tempest-VolumesBackupsTest-1484886458 None] delete 44885c93-b853-422a-9a76-29c7e7bf3d8e finished. {{(pid=101319) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:848}} Jul 03 09:54:39.978828 np0000004400 cinder-backup[101319]: DEBUG cinder.quota [None req-7798130a-35d4-4493-9272-c6ff5c5baa5c tempest-VolumesBackupsTest-1484886458 None] Created reservations ['0e137118-cc78-419c-8b3b-35764f7f1b9f', '7fe6b9e1-2a7c-486c-87bb-8c28deee5a68'] {{(pid=101319) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 09:54:39.995282 np0000004400 cinder-backup[101319]: INFO cinder.backup.manager [None req-7798130a-35d4-4493-9272-c6ff5c5baa5c tempest-VolumesBackupsTest-1484886458 None] Delete backup finished, backup 44885c93-b853-422a-9a76-29c7e7bf3d8e deleted. Jul 03 09:54:40.125079 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-c7a2f1c0-d186-4b36-b89b-132cc9579b18 tempest-ProjectMemberTests33-2105464604 None] Backing up chunk of data from volume. {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 09:54:40.366551 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-c7a2f1c0-d186-4b36-b89b-132cc9579b18 tempest-ProjectMemberTests33-2105464604 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101319) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 09:54:40.366683 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-c7a2f1c0-d186-4b36-b89b-132cc9579b18 tempest-ProjectMemberTests33-2105464604 None] About to put_object {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 09:54:40.386863 np0000004400 cinder-backup[101319]: DEBUG oslo_service.periodic_task [None req-ffd932d2-122c-4e68-b5ba-628aff7ae7b8 None None] Running periodic task BackupManager.publish_service_capabilities {{(pid=101319) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 03 09:54:40.387024 np0000004400 cinder-backup[101319]: DEBUG cinder.manager [None req-ffd932d2-122c-4e68-b5ba-628aff7ae7b8 None None] Notifying Schedulers of capabilities ... {{(pid=101319) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 03 09:54:40.467116 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-c7a2f1c0-d186-4b36-b89b-132cc9579b18 tempest-ProjectMemberTests33-2105464604 None] backup MD5 for volume_28e6e1d6-2242-44e7-9f43-e6ae7f7d5f56/20260703095429/az_nova_backup_6f767c43-dfb9-4a05-93e6-d969f7407465-00020: 25e317773f308e446cc84c503a6d1f85 {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 09:54:40.467278 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-c7a2f1c0-d186-4b36-b89b-132cc9579b18 tempest-ProjectMemberTests33-2105464604 None] Calling eventlet.sleep(0) {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 09:54:40.559179 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-c7a2f1c0-d186-4b36-b89b-132cc9579b18 tempest-ProjectMemberTests33-2105464604 None] Backing up chunk of data from volume. {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 09:54:40.581622 np0000004400 cinder-backup[101319]: INFO cinder.backup.manager [None req-38eba58a-549f-4629-99e6-1ad5c4baa659 tempest-VolumesBackupsTest-807180270 None] Delete backup started, backup: c52fbc4a-f7d8-49e2-bd92-5bbf2f7f98ba. Jul 03 09:54:40.584814 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.drivers.swift [None req-38eba58a-549f-4629-99e6-1ad5c4baa659 tempest-VolumesBackupsTest-807180270 None] Using swift URL https://10.4.3.95:8080/v1/AUTH_298e794341b64951b3fb757bfbffa698 {{(pid=101319) initialize /opt/stack/cinder/cinder/backup/drivers/swift.py:300}} Jul 03 09:54:40.585276 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.drivers.swift [None req-38eba58a-549f-4629-99e6-1ad5c4baa659 tempest-VolumesBackupsTest-807180270 None] Connect to https://10.4.3.95:8080/v1/AUTH_ in "per_user" mode {{(pid=101319) initialize /opt/stack/cinder/cinder/backup/drivers/swift.py:301}} Jul 03 09:54:40.585499 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-38eba58a-549f-4629-99e6-1ad5c4baa659 tempest-VolumesBackupsTest-807180270 None] delete started, backup: c52fbc4a-f7d8-49e2-bd92-5bbf2f7f98ba, container: volumebackups, prefix: volume_b578d41f-4c6a-49b3-b5ec-bcd6556e2e68/20260703095347/az_nova_backup_c52fbc4a-f7d8-49e2-bd92-5bbf2f7f98ba. {{(pid=101319) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:822}} Jul 03 09:54:40.624104 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-38eba58a-549f-4629-99e6-1ad5c4baa659 tempest-VolumesBackupsTest-807180270 None] generated object list: ['volume_b578d41f-4c6a-49b3-b5ec-bcd6556e2e68/20260703095347/az_nova_backup_c52fbc4a-f7d8-49e2-bd92-5bbf2f7f98ba-00001', 'volume_b578d41f-4c6a-49b3-b5ec-bcd6556e2e68/20260703095347/az_nova_backup_c52fbc4a-f7d8-49e2-bd92-5bbf2f7f98ba-00002', 'volume_b578d41f-4c6a-49b3-b5ec-bcd6556e2e68/20260703095347/az_nova_backup_c52fbc4a-f7d8-49e2-bd92-5bbf2f7f98ba-00003', 'volume_b578d41f-4c6a-49b3-b5ec-bcd6556e2e68/20260703095347/az_nova_backup_c52fbc4a-f7d8-49e2-bd92-5bbf2f7f98ba-00004', 'volume_b578d41f-4c6a-49b3-b5ec-bcd6556e2e68/20260703095347/az_nova_backup_c52fbc4a-f7d8-49e2-bd92-5bbf2f7f98ba-00005', 'volume_b578d41f-4c6a-49b3-b5ec-bcd6556e2e68/20260703095347/az_nova_backup_c52fbc4a-f7d8-49e2-bd92-5bbf2f7f98ba-00006', 'volume_b578d41f-4c6a-49b3-b5ec-bcd6556e2e68/20260703095347/az_nova_backup_c52fbc4a-f7d8-49e2-bd92-5bbf2f7f98ba-00007', 'volume_b578d41f-4c6a-49b3-b5ec-bcd6556e2e68/20260703095347/az_nova_backup_c52fbc4a-f7d8-49e2-bd92-5bbf2f7f98ba-00008', 'volume_b578d41f-4c6a-49b3-b5ec-bcd6556e2e68/20260703095347/az_nova_backup_c52fbc4a-f7d8-49e2-bd92-5bbf2f7f98ba-00009', 'volume_b578d41f-4c6a-49b3-b5ec-bcd6556e2e68/20260703095347/az_nova_backup_c52fbc4a-f7d8-49e2-bd92-5bbf2f7f98ba-00010', 'volume_b578d41f-4c6a-49b3-b5ec-bcd6556e2e68/20260703095347/az_nova_backup_c52fbc4a-f7d8-49e2-bd92-5bbf2f7f98ba-00011', 'volume_b578d41f-4c6a-49b3-b5ec-bcd6556e2e68/20260703095347/az_nova_backup_c52fbc4a-f7d8-49e2-bd92-5bbf2f7f98ba-00012', 'volume_b578d41f-4c6a-49b3-b5ec-bcd6556e2e68/20260703095347/az_nova_backup_c52fbc4a-f7d8-49e2-bd92-5bbf2f7f98ba-00013', 'volume_b578d41f-4c6a-49b3-b5ec-bcd6556e2e68/20260703095347/az_nova_backup_c52fbc4a-f7d8-49e2-bd92-5bbf2f7f98ba-00014', 'volume_b578d41f-4c6a-49b3-b5ec-bcd6556e2e68/20260703095347/az_nova_backup_c52fbc4a-f7d8-49e2-bd92-5bbf2f7f98ba-00015', 'volume_b578d41f-4c6a-49b3-b5ec-bcd6556e2e68/20260703095347/az_nova_backup_c52fbc4a-f7d8-49e2-bd92-5bbf2f7f98ba-00016', 'volume_b578d41f-4c6a-49b3-b5ec-bcd6556e2e68/20260703095347/az_nova_backup_c52fbc4a-f7d8-49e2-bd92-5bbf2f7f98ba-00017', 'volume_b578d41f-4c6a-49b3-b5ec-bcd6556e2e68/20260703095347/az_nova_backup_c52fbc4a-f7d8-49e2-bd92-5bbf2f7f98ba-00018', 'volume_b578d41f-4c6a-49b3-b5ec-bcd6556e2e68/20260703095347/az_nova_backup_c52fbc4a-f7d8-49e2-bd92-5bbf2f7f98ba-00019', 'volume_b578d41f-4c6a-49b3-b5ec-bcd6556e2e68/20260703095347/az_nova_backup_c52fbc4a-f7d8-49e2-bd92-5bbf2f7f98ba-00020', 'volume_b578d41f-4c6a-49b3-b5ec-bcd6556e2e68/20260703095347/az_nova_backup_c52fbc4a-f7d8-49e2-bd92-5bbf2f7f98ba-00021', 'volume_b578d41f-4c6a-49b3-b5ec-bcd6556e2e68/20260703095347/az_nova_backup_c52fbc4a-f7d8-49e2-bd92-5bbf2f7f98ba_metadata', 'volume_b578d41f-4c6a-49b3-b5ec-bcd6556e2e68/20260703095347/az_nova_backup_c52fbc4a-f7d8-49e2-bd92-5bbf2f7f98ba_sha256file']. {{(pid=101319) _generate_object_names /opt/stack/cinder/cinder/backup/chunkeddriver.py:260}} Jul 03 09:54:40.642019 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-38eba58a-549f-4629-99e6-1ad5c4baa659 tempest-VolumesBackupsTest-807180270 None] deleted object: volume_b578d41f-4c6a-49b3-b5ec-bcd6556e2e68/20260703095347/az_nova_backup_c52fbc4a-f7d8-49e2-bd92-5bbf2f7f98ba-00001 in container: volumebackups. {{(pid=101319) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 09:54:40.659591 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-38eba58a-549f-4629-99e6-1ad5c4baa659 tempest-VolumesBackupsTest-807180270 None] deleted object: volume_b578d41f-4c6a-49b3-b5ec-bcd6556e2e68/20260703095347/az_nova_backup_c52fbc4a-f7d8-49e2-bd92-5bbf2f7f98ba-00002 in container: volumebackups. {{(pid=101319) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 09:54:40.680474 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-38eba58a-549f-4629-99e6-1ad5c4baa659 tempest-VolumesBackupsTest-807180270 None] deleted object: volume_b578d41f-4c6a-49b3-b5ec-bcd6556e2e68/20260703095347/az_nova_backup_c52fbc4a-f7d8-49e2-bd92-5bbf2f7f98ba-00003 in container: volumebackups. {{(pid=101319) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 09:54:40.682916 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-c7a2f1c0-d186-4b36-b89b-132cc9579b18 tempest-ProjectMemberTests33-2105464604 None] Compressed 25165824 bytes of data to 24470 bytes using zlib. {{(pid=101319) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 09:54:40.683090 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-c7a2f1c0-d186-4b36-b89b-132cc9579b18 tempest-ProjectMemberTests33-2105464604 None] About to put_object {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 09:54:40.701021 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-38eba58a-549f-4629-99e6-1ad5c4baa659 tempest-VolumesBackupsTest-807180270 None] deleted object: volume_b578d41f-4c6a-49b3-b5ec-bcd6556e2e68/20260703095347/az_nova_backup_c52fbc4a-f7d8-49e2-bd92-5bbf2f7f98ba-00004 in container: volumebackups. {{(pid=101319) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 09:54:40.721649 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-38eba58a-549f-4629-99e6-1ad5c4baa659 tempest-VolumesBackupsTest-807180270 None] deleted object: volume_b578d41f-4c6a-49b3-b5ec-bcd6556e2e68/20260703095347/az_nova_backup_c52fbc4a-f7d8-49e2-bd92-5bbf2f7f98ba-00005 in container: volumebackups. {{(pid=101319) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 09:54:40.742018 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-38eba58a-549f-4629-99e6-1ad5c4baa659 tempest-VolumesBackupsTest-807180270 None] deleted object: volume_b578d41f-4c6a-49b3-b5ec-bcd6556e2e68/20260703095347/az_nova_backup_c52fbc4a-f7d8-49e2-bd92-5bbf2f7f98ba-00006 in container: volumebackups. {{(pid=101319) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 09:54:40.744550 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-c7a2f1c0-d186-4b36-b89b-132cc9579b18 tempest-ProjectMemberTests33-2105464604 None] backup MD5 for volume_28e6e1d6-2242-44e7-9f43-e6ae7f7d5f56/20260703095429/az_nova_backup_6f767c43-dfb9-4a05-93e6-d969f7407465-00021: 77377273b0a4b61febdbf7bbf52b9db9 {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 09:54:40.744690 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-c7a2f1c0-d186-4b36-b89b-132cc9579b18 tempest-ProjectMemberTests33-2105464604 None] Calling eventlet.sleep(0) {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 09:54:40.777636 np0000004400 cinder-backup[101319]: DEBUG oslo_db.sqlalchemy.engines [None req-c7a2f1c0-d186-4b36-b89b-132cc9579b18 tempest-ProjectMemberTests33-2105464604 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=101319) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 03 09:54:40.785425 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.driver [None req-c7a2f1c0-d186-4b36-b89b-132cc9579b18 tempest-ProjectMemberTests33-2105464604 None] Getting metadata type 'volume-base-metadata' {{(pid=101319) _save_vol_base_meta /opt/stack/cinder/cinder/backup/driver.py:79}} Jul 03 09:54:40.790345 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.driver [None req-c7a2f1c0-d186-4b36-b89b-132cc9579b18 tempest-ProjectMemberTests33-2105464604 None] Completed fetching metadata type 'volume-base-metadata' {{(pid=101319) _save_vol_base_meta /opt/stack/cinder/cinder/backup/driver.py:98}} Jul 03 09:54:40.790599 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.driver [None req-c7a2f1c0-d186-4b36-b89b-132cc9579b18 tempest-ProjectMemberTests33-2105464604 None] Getting metadata type 'volume-metadata' {{(pid=101319) _save_vol_meta /opt/stack/cinder/cinder/backup/driver.py:109}} Jul 03 09:54:40.792581 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-38eba58a-549f-4629-99e6-1ad5c4baa659 tempest-VolumesBackupsTest-807180270 None] deleted object: volume_b578d41f-4c6a-49b3-b5ec-bcd6556e2e68/20260703095347/az_nova_backup_c52fbc4a-f7d8-49e2-bd92-5bbf2f7f98ba-00007 in container: volumebackups. {{(pid=101319) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 09:54:40.800002 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.driver [None req-c7a2f1c0-d186-4b36-b89b-132cc9579b18 tempest-ProjectMemberTests33-2105464604 None] No metadata type 'volume-metadata' available {{(pid=101319) _save_vol_meta /opt/stack/cinder/cinder/backup/driver.py:123}} Jul 03 09:54:40.800310 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.driver [None req-c7a2f1c0-d186-4b36-b89b-132cc9579b18 tempest-ProjectMemberTests33-2105464604 None] Getting metadata type 'volume-glance-metadata' {{(pid=101319) _save_vol_glance_meta /opt/stack/cinder/cinder/backup/driver.py:132}} Jul 03 09:54:40.803168 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.driver [None req-c7a2f1c0-d186-4b36-b89b-132cc9579b18 tempest-ProjectMemberTests33-2105464604 None] No metadata type 'volume-glance-metadata' available {{(pid=101319) _save_vol_glance_meta /opt/stack/cinder/cinder/backup/driver.py:147}} Jul 03 09:54:40.803289 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-c7a2f1c0-d186-4b36-b89b-132cc9579b18 tempest-ProjectMemberTests33-2105464604 None] _write_sha256file started, container name: volumebackups, sha256file filename: volume_28e6e1d6-2242-44e7-9f43-e6ae7f7d5f56/20260703095429/az_nova_backup_6f767c43-dfb9-4a05-93e6-d969f7407465_sha256file. {{(pid=101319) _write_sha256file /opt/stack/cinder/cinder/backup/chunkeddriver.py:299}} Jul 03 09:54:40.818243 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-38eba58a-549f-4629-99e6-1ad5c4baa659 tempest-VolumesBackupsTest-807180270 None] deleted object: volume_b578d41f-4c6a-49b3-b5ec-bcd6556e2e68/20260703095347/az_nova_backup_c52fbc4a-f7d8-49e2-bd92-5bbf2f7f98ba-00008 in container: volumebackups. {{(pid=101319) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 09:54:40.841734 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-38eba58a-549f-4629-99e6-1ad5c4baa659 tempest-VolumesBackupsTest-807180270 None] deleted object: volume_b578d41f-4c6a-49b3-b5ec-bcd6556e2e68/20260703095347/az_nova_backup_c52fbc4a-f7d8-49e2-bd92-5bbf2f7f98ba-00009 in container: volumebackups. {{(pid=101319) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 09:54:40.861951 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-38eba58a-549f-4629-99e6-1ad5c4baa659 tempest-VolumesBackupsTest-807180270 None] deleted object: volume_b578d41f-4c6a-49b3-b5ec-bcd6556e2e68/20260703095347/az_nova_backup_c52fbc4a-f7d8-49e2-bd92-5bbf2f7f98ba-00010 in container: volumebackups. {{(pid=101319) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 09:54:40.864328 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-c7a2f1c0-d186-4b36-b89b-132cc9579b18 tempest-ProjectMemberTests33-2105464604 None] _write_sha256file finished. {{(pid=101319) _write_sha256file /opt/stack/cinder/cinder/backup/chunkeddriver.py:315}} Jul 03 09:54:40.864957 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-c7a2f1c0-d186-4b36-b89b-132cc9579b18 tempest-ProjectMemberTests33-2105464604 None] _write_metadata started, container name: volumebackups, metadata filename: volume_28e6e1d6-2242-44e7-9f43-e6ae7f7d5f56/20260703095429/az_nova_backup_6f767c43-dfb9-4a05-93e6-d969f7407465_metadata. {{(pid=101319) _write_metadata /opt/stack/cinder/cinder/backup/chunkeddriver.py:276}} Jul 03 09:54:40.880687 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-38eba58a-549f-4629-99e6-1ad5c4baa659 tempest-VolumesBackupsTest-807180270 None] deleted object: volume_b578d41f-4c6a-49b3-b5ec-bcd6556e2e68/20260703095347/az_nova_backup_c52fbc4a-f7d8-49e2-bd92-5bbf2f7f98ba-00011 in container: volumebackups. {{(pid=101319) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 09:54:40.889963 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-c7a2f1c0-d186-4b36-b89b-132cc9579b18 tempest-ProjectMemberTests33-2105464604 None] _write_metadata finished. Metadata: b'{\n "backup_description": null,\n "backup_id": "6f767c43-dfb9-4a05-93e6-d969f7407465",\n "backup_name": "tempest-type-Backup-1802209562",\n "created_at": "2026-07-03 09:54:26+00:00",\n "objects": [\n {\n "volume_28e6e1d6-2242-44e7-9f43-e6ae7f7d5f56/20260703095429/az_nova_backup_6f767c43-dfb9-4a05-93e6-d969f7407465-00001": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 0\n }\n },\n {\n "volume_28e6e1d6-2242-44e7-9f43-e6ae7f7d5f56/20260703095429/az_nova_backup_6f767c43-dfb9-4a05-93e6-d969f7407465-00002": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 52428800\n }\n },\n {\n "volume_28e6e1d6-2242-44e7-9f43-e6ae7f7d5f56/20260703095429/az_nova_backup_6f767c43-dfb9-4a05-93e6-d969f7407465-00003": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 104857600\n }\n },\n {\n "volume_28e6e1d6-2242-44e7-9f43-e6ae7f7d5f56/20260703095429/az_nova_backup_6f767c43-dfb9-4a05-93e6-d969f7407465-00004": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 157286400\n }\n },\n {\n "volume_28e6e1d6-2242-44e7-9f43-e6ae7f7d5f56/20260703095429/az_nova_backup_6f767c43-dfb9-4a05-93e6-d969f7407465-00005": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 209715200\n }\n },\n {\n "volume_28e6e1d6-2242-44e7-9f43-e6ae7f7d5f56/20260703095429/az_nova_backup_6f767c43-dfb9-4a05-93e6-d969f7407465-00006": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 262144000\n }\n },\n {\n "volume_28e6e1d6-2242-44e7-9f43-e6ae7f7d5f56/20260703095429/az_nova_backup_6f767c43-dfb9-4a05-93e6-d969f7407465-00007": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 314572800\n }\n },\n {\n "volume_28e6e1d6-2242-44e7-9f43-e6ae7f7d5f56/20260703095429/az_nova_backup_6f767c43-dfb9-4a05-93e6-d969f7407465-00008": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 367001600\n }\n },\n {\n "volume_28e6e1d6-2242-44e7-9f43-e6ae7f7d5f56/20260703095429/az_nova_backup_6f767c43-dfb9-4a05-93e6-d969f7407465-00009": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 419430400\n }\n },\n {\n "volume_28e6e1d6-2242-44e7-9f43-e6ae7f7d5f56/20260703095429/az_nova_backup_6f767c43-dfb9-4a05-93e6-d969f7407465-00010": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 471859200\n }\n },\n {\n "volume_28e6e1d6-2242-44e7-9f43-e6ae7f7d5f56/20260703095429/az_nova_backup_6f767c43-dfb9-4a05-93e6-d969f7407465-00011": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 524288000\n }\n },\n {\n "volume_28e6e1d6-2242-44e7-9f43-e6ae7f7d5f56/20260703095429/az_nova_backup_6f767c43-dfb9-4a05-93e6-d969f7407465-00012": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 576716800\n }\n },\n {\n "volume_28e6e1d6-2242-44e7-9f43-e6ae7f7d5f56/20260703095429/az_nova_backup_6f767c43-dfb9-4a05-93e6-d969f7407465-00013": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 629145600\n }\n },\n {\n "volume_28e6e1d6-2242-44e7-9f43-e6ae7f7d5f56/20260703095429/az_nova_backup_6f767c43-dfb9-4a05-93e6-d969f7407465-00014": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 681574400\n }\n },\n {\n "volume_28e6e1d6-2242-44e7-9f43-e6ae7f7d5f56/20260703095429/az_nova_backup_6f767c43-dfb9-4a05-93e6-d969f7407465-00015": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 734003200\n }\n },\n {\n "volume_28e6e1d6-2242-44e7-9f43-e6ae7f7d5f56/20260703095429/az_nova_backup_6f767c43-dfb9-4a05-93e6-d969f7407465-00016": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 786432000\n }\n },\n {\n "volume_28e6e1d6-2242-44e7-9f43-e6ae7f7d5f56/20260703095429/az_nova_backup_6f767c43-dfb9-4a05-93e6-d969f7407465-00017": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 838860800\n }\n },\n {\n "volume_28e6e1d6-2242-44e7-9f43-e6ae7f7d5f56/20260703095429/az_nova_backup_6f767c43-dfb9-4a05-93e6-d969f7407465-00018": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 891289600\n }\n },\n {\n "volume_28e6e1d6-2242-44e7-9f43-e6ae7f7d5f56/20260703095429/az_nova_backup_6f767c43-dfb9-4a05-93e6-d969f7407465-00019": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 943718400\n }\n },\n {\n "volume_28e6e1d6-2242-44e7-9f43-e6ae7f7d5f56/20260703095429/az_nova_backup_6f767c43-dfb9-4a05-93e6-d969f7407465-00020": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 996147200\n }\n },\n {\n "volume_28e6e1d6-2242-44e7-9f43-e6ae7f7d5f56/20260703095429/az_nova_backup_6f767c43-dfb9-4a05-93e6-d969f7407465-00021": {\n "compression": "zlib",\n "length": 25165824,\n "md5": "77377273b0a4b61febdbf7bbf52b9db9",\n "offset": 1048576000\n }\n }\n ],\n "parent_id": null,\n "version": "1.0.0",\n "volume_id": "28e6e1d6-2242-44e7-9f43-e6ae7f7d5f56",\n "volume_meta": "{\\"version\\": 2, \\"volume-base-metadata\\": {\\"id\\": \\"28e6e1d6-2242-44e7-9f43-e6ae7f7d5f56\\", \\"_name_id\\": null, \\"use_quota\\": true, \\"ec2_id\\": null, \\"user_id\\": \\"87abbb474f8a4baf840fcfdf286ff94e\\", \\"project_id\\": \\"e0b6e59b911e40b3acac38afb1f81e3a\\", \\"snapshot_id\\": null, \\"cluster_name\\": null, \\"host\\": \\"np0000004400@storpool#default\\", \\"size\\": 1, \\"availability_zone\\": \\"nova\\", \\"status\\": \\"backing-up\\", \\"attach_status\\": \\"detached\\", \\"migration_status\\": null, \\"scheduled_at\\": \\"2026-07-03T09:54:25.000000\\", \\"launched_at\\": \\"2026-07-03T09:54:25.000000\\", \\"terminated_at\\": null, \\"display_name\\": \\"tempest-VolumeV3RbacBaseTests-Volume-1474494611\\", \\"display_description\\": null, \\"provider_location\\": null, \\"provider_auth\\": null, \\"provider_geometry\\": null, \\"provider_id\\": null, \\"volume_type_id\\": \\"03e13fe6-0e30-4803-ace0-725d38e6dc24\\", \\"source_volid\\": null, \\"encryption_key_id\\": null, \\"consistencygroup_id\\": null, \\"group_id\\": null, \\"bootable\\": false, \\"multiattach\\": false, \\"replication_status\\": null, \\"replication_extended_status\\": null, \\"replication_driver_data\\": null, \\"previous_status\\": \\"available\\", \\"service_uuid\\": \\"6d4b0e79-fefe-4744-b25f-34be05095200\\", \\"shared_targets\\": true, \\"deleted_at\\": null, \\"deleted\\": false, \\"created_at\\": \\"2026-07-03T09:54:25.000000\\", \\"updated_at\\": \\"2026-07-03T09:54:26.000000\\"}}"\n}'. {{(pid=101319) _write_metadata /opt/stack/cinder/cinder/backup/chunkeddriver.py:295}} Jul 03 09:54:40.897274 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-c7a2f1c0-d186-4b36-b89b-132cc9579b18 tempest-ProjectMemberTests33-2105464604 None] backup 6f767c43-dfb9-4a05-93e6-d969f7407465 finished. {{(pid=101319) _finalize_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:462}} Jul 03 09:54:41.018994 np0000004400 cinder-backup[101319]: DEBUG oslo_concurrency.processutils [None req-c7a2f1c0-d186-4b36-b89b-132cc9579b18 tempest-ProjectMemberTests33-2105464604 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chown 0 /dev/sdb {{(pid=101319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 09:54:41.030189 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-38eba58a-549f-4629-99e6-1ad5c4baa659 tempest-VolumesBackupsTest-807180270 None] deleted object: volume_b578d41f-4c6a-49b3-b5ec-bcd6556e2e68/20260703095347/az_nova_backup_c52fbc4a-f7d8-49e2-bd92-5bbf2f7f98ba-00012 in container: volumebackups. {{(pid=101319) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 09:54:41.042917 np0000004400 sudo[156466]: stack : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chown 0 /dev/sdb Jul 03 09:54:41.043780 np0000004400 sudo[156466]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1002) Jul 03 09:54:41.057317 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-38eba58a-549f-4629-99e6-1ad5c4baa659 tempest-VolumesBackupsTest-807180270 None] deleted object: volume_b578d41f-4c6a-49b3-b5ec-bcd6556e2e68/20260703095347/az_nova_backup_c52fbc4a-f7d8-49e2-bd92-5bbf2f7f98ba-00013 in container: volumebackups. {{(pid=101319) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 09:54:41.082835 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-38eba58a-549f-4629-99e6-1ad5c4baa659 tempest-VolumesBackupsTest-807180270 None] deleted object: volume_b578d41f-4c6a-49b3-b5ec-bcd6556e2e68/20260703095347/az_nova_backup_c52fbc4a-f7d8-49e2-bd92-5bbf2f7f98ba-00014 in container: volumebackups. {{(pid=101319) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 09:54:41.100747 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-38eba58a-549f-4629-99e6-1ad5c4baa659 tempest-VolumesBackupsTest-807180270 None] deleted object: volume_b578d41f-4c6a-49b3-b5ec-bcd6556e2e68/20260703095347/az_nova_backup_c52fbc4a-f7d8-49e2-bd92-5bbf2f7f98ba-00015 in container: volumebackups. {{(pid=101319) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 09:54:41.121364 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-38eba58a-549f-4629-99e6-1ad5c4baa659 tempest-VolumesBackupsTest-807180270 None] deleted object: volume_b578d41f-4c6a-49b3-b5ec-bcd6556e2e68/20260703095347/az_nova_backup_c52fbc4a-f7d8-49e2-bd92-5bbf2f7f98ba-00016 in container: volumebackups. {{(pid=101319) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 09:54:41.139107 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-38eba58a-549f-4629-99e6-1ad5c4baa659 tempest-VolumesBackupsTest-807180270 None] deleted object: volume_b578d41f-4c6a-49b3-b5ec-bcd6556e2e68/20260703095347/az_nova_backup_c52fbc4a-f7d8-49e2-bd92-5bbf2f7f98ba-00017 in container: volumebackups. {{(pid=101319) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 09:54:41.157036 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-38eba58a-549f-4629-99e6-1ad5c4baa659 tempest-VolumesBackupsTest-807180270 None] deleted object: volume_b578d41f-4c6a-49b3-b5ec-bcd6556e2e68/20260703095347/az_nova_backup_c52fbc4a-f7d8-49e2-bd92-5bbf2f7f98ba-00018 in container: volumebackups. {{(pid=101319) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 09:54:41.173857 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-38eba58a-549f-4629-99e6-1ad5c4baa659 tempest-VolumesBackupsTest-807180270 None] deleted object: volume_b578d41f-4c6a-49b3-b5ec-bcd6556e2e68/20260703095347/az_nova_backup_c52fbc4a-f7d8-49e2-bd92-5bbf2f7f98ba-00019 in container: volumebackups. {{(pid=101319) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 09:54:41.191342 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-38eba58a-549f-4629-99e6-1ad5c4baa659 tempest-VolumesBackupsTest-807180270 None] deleted object: volume_b578d41f-4c6a-49b3-b5ec-bcd6556e2e68/20260703095347/az_nova_backup_c52fbc4a-f7d8-49e2-bd92-5bbf2f7f98ba-00020 in container: volumebackups. {{(pid=101319) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 09:54:41.207720 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-38eba58a-549f-4629-99e6-1ad5c4baa659 tempest-VolumesBackupsTest-807180270 None] deleted object: volume_b578d41f-4c6a-49b3-b5ec-bcd6556e2e68/20260703095347/az_nova_backup_c52fbc4a-f7d8-49e2-bd92-5bbf2f7f98ba-00021 in container: volumebackups. {{(pid=101319) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 09:54:41.223794 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-38eba58a-549f-4629-99e6-1ad5c4baa659 tempest-VolumesBackupsTest-807180270 None] deleted object: volume_b578d41f-4c6a-49b3-b5ec-bcd6556e2e68/20260703095347/az_nova_backup_c52fbc4a-f7d8-49e2-bd92-5bbf2f7f98ba_metadata in container: volumebackups. {{(pid=101319) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 09:54:41.240476 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-38eba58a-549f-4629-99e6-1ad5c4baa659 tempest-VolumesBackupsTest-807180270 None] deleted object: volume_b578d41f-4c6a-49b3-b5ec-bcd6556e2e68/20260703095347/az_nova_backup_c52fbc4a-f7d8-49e2-bd92-5bbf2f7f98ba_sha256file in container: volumebackups. {{(pid=101319) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 09:54:41.240723 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-38eba58a-549f-4629-99e6-1ad5c4baa659 tempest-VolumesBackupsTest-807180270 None] delete c52fbc4a-f7d8-49e2-bd92-5bbf2f7f98ba finished. {{(pid=101319) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:848}} Jul 03 09:54:41.255667 np0000004400 cinder-backup[101319]: DEBUG cinder.quota [None req-38eba58a-549f-4629-99e6-1ad5c4baa659 tempest-VolumesBackupsTest-807180270 None] Created reservations ['9e95e617-f6fd-4f4f-ad9d-a57124b9b46f', 'b0f80533-19ac-4ed7-935c-6184e4a450ef'] {{(pid=101319) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 09:54:41.270421 np0000004400 cinder-backup[101319]: INFO cinder.backup.manager [None req-38eba58a-549f-4629-99e6-1ad5c4baa659 tempest-VolumesBackupsTest-807180270 None] Delete backup finished, backup c52fbc4a-f7d8-49e2-bd92-5bbf2f7f98ba deleted. Jul 03 09:54:41.345304 np0000004400 sudo[156466]: pam_unix(sudo:session): session closed for user root Jul 03 09:54:41.347072 np0000004400 cinder-backup[101319]: DEBUG oslo_concurrency.processutils [None req-c7a2f1c0-d186-4b36-b89b-132cc9579b18 tempest-ProjectMemberTests33-2105464604 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chown 0 /dev/sdb" returned: 0 in 0.328s {{(pid=101319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 09:54:41.347662 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-c7a2f1c0-d186-4b36-b89b-132cc9579b18 tempest-ProjectMemberTests33-2105464604 None] ==> disconnect_volume: call "{'args': (, {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-28e6e1d6-2242-44e7-9f43-e6ae7f7d5f56', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '28e6e1d6-2242-44e7-9f43-e6ae7f7d5f56', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': False}, {'type': 'block', 'scsi_wwn': '330000000f07ee644', 'path': '/dev/sdb'}), 'kwargs': {'force': True, 'ignore_errors': True}}" {{(pid=101319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}} Jul 03 09:54:41.347866 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.base [None req-c7a2f1c0-d186-4b36-b89b-132cc9579b18 tempest-ProjectMemberTests33-2105464604 None] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=101319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jul 03 09:54:41.348303 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.base [None req-c7a2f1c0-d186-4b36-b89b-132cc9579b18 tempest-ProjectMemberTests33-2105464604 None] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.000s {{(pid=101319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jul 03 09:54:41.348676 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-c7a2f1c0-d186-4b36-b89b-132cc9579b18 tempest-ProjectMemberTests33-2105464604 None] _get_connection_devices called with parameters: connection_properties={'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-28e6e1d6-2242-44e7-9f43-e6ae7f7d5f56', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '28e6e1d6-2242-44e7-9f43-e6ae7f7d5f56', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': False}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=101319) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:847}} Jul 03 09:54:41.358851 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-c7a2f1c0-d186-4b36-b89b-132cc9579b18 tempest-ProjectMemberTests33-2105464604 None] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS: Jul 03 09:54:41.358851 np0000004400 cinder-backup[101319]: No targets found. Jul 03 09:54:41.358851 np0000004400 cinder-backup[101319]: iSNS: Jul 03 09:54:41.358851 np0000004400 cinder-backup[101319]: No targets found. Jul 03 09:54:41.358851 np0000004400 cinder-backup[101319]: STATIC: Jul 03 09:54:41.358851 np0000004400 cinder-backup[101319]: Target: iqn.2023-03.storpool.com:os--volume-28e6e1d6-2242-44e7-9f43-e6ae7f7d5f56 Jul 03 09:54:41.358851 np0000004400 cinder-backup[101319]: Portal: 192.168.40.100:3260,-1 Jul 03 09:54:41.358851 np0000004400 cinder-backup[101319]: Iface Name: default Jul 03 09:54:41.358851 np0000004400 cinder-backup[101319]: Target: iqn.2023-03.storpool.com:os--volume-789ec59e-ea87-4784-8990-156a35276b5f Jul 03 09:54:41.358851 np0000004400 cinder-backup[101319]: Portal: 192.168.50.100:3260,-1 Jul 03 09:54:41.358851 np0000004400 cinder-backup[101319]: Iface Name: default Jul 03 09:54:41.358851 np0000004400 cinder-backup[101319]: Portal: 192.168.40.100:3260,-1 Jul 03 09:54:41.358851 np0000004400 cinder-backup[101319]: Iface Name: default Jul 03 09:54:41.358851 np0000004400 cinder-backup[101319]: Target: iqn.2023-03.storpool.com:os--volume-f9e48e4b-6866-4ad9-bc3b-93ae778de731 Jul 03 09:54:41.358851 np0000004400 cinder-backup[101319]: Portal: 192.168.50.100:3260,-1 Jul 03 09:54:41.358851 np0000004400 cinder-backup[101319]: Iface Name: default Jul 03 09:54:41.358851 np0000004400 cinder-backup[101319]: Portal: 192.168.40.100:3260,-1 Jul 03 09:54:41.358851 np0000004400 cinder-backup[101319]: Iface Name: default Jul 03 09:54:41.358851 np0000004400 cinder-backup[101319]: FIRMWARE: Jul 03 09:54:41.358851 np0000004400 cinder-backup[101319]: No targets found. Jul 03 09:54:41.358851 np0000004400 cinder-backup[101319]: stderr= {{(pid=101319) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jul 03 09:54:41.358851 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-c7a2f1c0-d186-4b36-b89b-132cc9579b18 tempest-ProjectMemberTests33-2105464604 None] Regex to get portals from discoverydb: ^SENDTARGETS: Jul 03 09:54:41.358851 np0000004400 cinder-backup[101319]: .*?^DiscoveryAddress: 192.168.40.100,3260.*? Jul 03 09:54:41.358851 np0000004400 cinder-backup[101319]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=101319) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:390}} Jul 03 09:54:41.358851 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-c7a2f1c0-d186-4b36-b89b-132cc9579b18 tempest-ProjectMemberTests33-2105464604 None] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-28e6e1d6-2242-44e7-9f43-e6ae7f7d5f56', 0)] {{(pid=101319) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:858}} Jul 03 09:54:41.377566 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-c7a2f1c0-d186-4b36-b89b-132cc9579b18 tempest-ProjectMemberTests33-2105464604 None] iscsiadm ('-m', 'session'): stdout=tcp: [208] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-789ec59e-ea87-4784-8990-156a35276b5f (non-flash) Jul 03 09:54:41.377566 np0000004400 cinder-backup[101319]: tcp: [209] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-789ec59e-ea87-4784-8990-156a35276b5f (non-flash) Jul 03 09:54:41.377566 np0000004400 cinder-backup[101319]: tcp: [213] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-28e6e1d6-2242-44e7-9f43-e6ae7f7d5f56 (non-flash) Jul 03 09:54:41.377566 np0000004400 cinder-backup[101319]: tcp: [215] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f9e48e4b-6866-4ad9-bc3b-93ae778de731 (non-flash) Jul 03 09:54:41.377566 np0000004400 cinder-backup[101319]: tcp: [216] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f9e48e4b-6866-4ad9-bc3b-93ae778de731 (non-flash) Jul 03 09:54:41.377566 np0000004400 cinder-backup[101319]: stderr= {{(pid=101319) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jul 03 09:54:41.377770 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-c7a2f1c0-d186-4b36-b89b-132cc9579b18 tempest-ProjectMemberTests33-2105464604 None] iscsi session list stdout=tcp: [208] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-789ec59e-ea87-4784-8990-156a35276b5f (non-flash) Jul 03 09:54:41.377770 np0000004400 cinder-backup[101319]: tcp: [209] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-789ec59e-ea87-4784-8990-156a35276b5f (non-flash) Jul 03 09:54:41.377770 np0000004400 cinder-backup[101319]: tcp: [213] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-28e6e1d6-2242-44e7-9f43-e6ae7f7d5f56 (non-flash) Jul 03 09:54:41.377770 np0000004400 cinder-backup[101319]: tcp: [215] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f9e48e4b-6866-4ad9-bc3b-93ae778de731 (non-flash) Jul 03 09:54:41.377770 np0000004400 cinder-backup[101319]: tcp: [216] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f9e48e4b-6866-4ad9-bc3b-93ae778de731 (non-flash) Jul 03 09:54:41.377770 np0000004400 cinder-backup[101319]: stderr= {{(pid=101319) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jul 03 09:54:41.377896 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-c7a2f1c0-d186-4b36-b89b-132cc9579b18 tempest-ProjectMemberTests33-2105464604 None] Sessions list: [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-789ec59e-ea87-4784-8990-156a35276b5f', '208'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-789ec59e-ea87-4784-8990-156a35276b5f', '209'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-28e6e1d6-2242-44e7-9f43-e6ae7f7d5f56', '213'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-f9e48e4b-6866-4ad9-bc3b-93ae778de731', '215'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-f9e48e4b-6866-4ad9-bc3b-93ae778de731', '216')] {{(pid=101319) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:866}} Jul 03 09:54:41.378030 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-c7a2f1c0-d186-4b36-b89b-132cc9579b18 tempest-ProjectMemberTests33-2105464604 None] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-28e6e1d6-2242-44e7-9f43-e6ae7f7d5f56, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-28e6e1d6-2242-44e7-9f43-e6ae7f7d5f56', '213')] {{(pid=101319) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}} Jul 03 09:54:41.378921 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-c7a2f1c0-d186-4b36-b89b-132cc9579b18 tempest-ProjectMemberTests33-2105464604 None] Resulting device map defaultdict(. at 0x7e76e75299e0>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-28e6e1d6-2242-44e7-9f43-e6ae7f7d5f56'): ({'sdb'}, set())}) {{(pid=101319) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:912}} Jul 03 09:54:41.379114 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.linuxscsi [None req-c7a2f1c0-d186-4b36-b89b-132cc9579b18 tempest-ProjectMemberTests33-2105464604 None] Removing single pathed devices sdb {{(pid=101319) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}} Jul 03 09:54:41.387995 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.linuxscsi [None req-c7a2f1c0-d186-4b36-b89b-132cc9579b18 tempest-ProjectMemberTests33-2105464604 None] Flushing IO for device /dev/sdb {{(pid=101319) flush_device_io /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:461}} Jul 03 09:54:41.395713 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.linuxscsi [None req-c7a2f1c0-d186-4b36-b89b-132cc9579b18 tempest-ProjectMemberTests33-2105464604 None] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=101319) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}} Jul 03 09:54:41.438717 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.linuxscsi [None req-c7a2f1c0-d186-4b36-b89b-132cc9579b18 tempest-ProjectMemberTests33-2105464604 None] Checking to see if SCSI volumes sdb have been removed. {{(pid=101319) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}} Jul 03 09:54:41.438913 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.linuxscsi [None req-c7a2f1c0-d186-4b36-b89b-132cc9579b18 tempest-ProjectMemberTests33-2105464604 None] SCSI volumes sdb have been removed. {{(pid=101319) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}} Jul 03 09:54:41.439835 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.linuxscsi [None req-c7a2f1c0-d186-4b36-b89b-132cc9579b18 tempest-ProjectMemberTests33-2105464604 None] Checking to see if device paths {'sdb'} are still under multipathd monitoring {{(pid=101319) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}} Jul 03 09:54:41.449866 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.linuxscsi [None req-c7a2f1c0-d186-4b36-b89b-132cc9579b18 tempest-ProjectMemberTests33-2105464604 None] Device paths {'sdb'} have been removed from multipathd monitoring. {{(pid=101319) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}} Jul 03 09:54:41.450074 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-c7a2f1c0-d186-4b36-b89b-132cc9579b18 tempest-ProjectMemberTests33-2105464604 None] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-28e6e1d6-2242-44e7-9f43-e6ae7f7d5f56')] {{(pid=101319) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1225}} Jul 03 09:54:41.459301 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-c7a2f1c0-d186-4b36-b89b-132cc9579b18 tempest-ProjectMemberTests33-2105464604 None] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=101319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 03 09:54:41.483133 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-c7a2f1c0-d186-4b36-b89b-132cc9579b18 tempest-ProjectMemberTests33-2105464604 None] iscsiadm ('--logout',): stdout=Logging out of session [sid: 213, target: iqn.2023-03.storpool.com:os--volume-28e6e1d6-2242-44e7-9f43-e6ae7f7d5f56, portal: 192.168.40.100,3260] Jul 03 09:54:41.483133 np0000004400 cinder-backup[101319]: Logout of [sid: 213, target: iqn.2023-03.storpool.com:os--volume-28e6e1d6-2242-44e7-9f43-e6ae7f7d5f56, portal: 192.168.40.100,3260] successful. Jul 03 09:54:41.483133 np0000004400 cinder-backup[101319]: stderr= {{(pid=101319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 03 09:54:41.496644 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-c7a2f1c0-d186-4b36-b89b-132cc9579b18 tempest-ProjectMemberTests33-2105464604 None] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=101319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 03 09:54:41.496944 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.base [None req-c7a2f1c0-d186-4b36-b89b-132cc9579b18 tempest-ProjectMemberTests33-2105464604 None] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.149s {{(pid=101319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jul 03 09:54:41.497096 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-c7a2f1c0-d186-4b36-b89b-132cc9579b18 tempest-ProjectMemberTests33-2105464604 None] <== disconnect_volume: return (149ms) None {{(pid=101319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}} Jul 03 09:54:42.515218 np0000004400 cinder-backup[101319]: INFO cinder.backup.manager [None req-c7a2f1c0-d186-4b36-b89b-132cc9579b18 tempest-ProjectMemberTests33-2105464604 None] Create backup finished. backup: 6f767c43-dfb9-4a05-93e6-d969f7407465. Jul 03 09:54:43.515775 np0000004400 cinder-backup[101319]: INFO cinder.backup.manager [None req-566e4181-ac5c-4e7f-acd9-5c2c546223d1 tempest-ProjectMemberTests33-2105464604 None] Export record started, backup: 6f767c43-dfb9-4a05-93e6-d969f7407465. Jul 03 09:54:43.521570 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.drivers.swift [None req-566e4181-ac5c-4e7f-acd9-5c2c546223d1 tempest-ProjectMemberTests33-2105464604 None] Using swift URL https://10.4.3.95:8080/v1/AUTH_e0b6e59b911e40b3acac38afb1f81e3a {{(pid=101319) initialize /opt/stack/cinder/cinder/backup/drivers/swift.py:300}} Jul 03 09:54:43.522025 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.drivers.swift [None req-566e4181-ac5c-4e7f-acd9-5c2c546223d1 tempest-ProjectMemberTests33-2105464604 None] Connect to https://10.4.3.95:8080/v1/AUTH_ in "per_user" mode {{(pid=101319) initialize /opt/stack/cinder/cinder/backup/drivers/swift.py:301}} Jul 03 09:54:43.522355 np0000004400 cinder-backup[101319]: INFO cinder.backup.manager [None req-566e4181-ac5c-4e7f-acd9-5c2c546223d1 tempest-ProjectMemberTests33-2105464604 None] Export record finished, backup 6f767c43-dfb9-4a05-93e6-d969f7407465 exported. Jul 03 09:54:46.498697 np0000004400 cinder-backup[101319]: DEBUG oslo_db.sqlalchemy.engines [None req-f75b0311-c2ca-4c40-baf9-2dada74036c9 tempest-ProjectMemberTests33-2105464604 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=101319) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 03 09:54:46.505112 np0000004400 cinder-backup[101319]: INFO cinder.backup.manager [None req-f75b0311-c2ca-4c40-baf9-2dada74036c9 tempest-ProjectMemberTests33-2105464604 None] Create backup started, backup: 0254456b-0a66-4125-8e17-8e1f79f703fe volume: a28b52f0-456d-4821-8de5-ec41566e1234. Jul 03 09:54:46.511015 np0000004400 cinder-backup[101319]: INFO cinder.backup.manager [None req-f75b0311-c2ca-4c40-baf9-2dada74036c9 tempest-ProjectMemberTests33-2105464604 None] Call Volume Manager to get_backup_device for Backup(availability_zone='nova',container=None,created_at=2026-07-03T09:54:46Z,data_timestamp=2026-07-03T09:54:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-type-Backup-81881469',encryption_key_id=None,fail_reason=None,host='np0000004400',id=0254456b-0a66-4125-8e17-8e1f79f703fe,metadata={},num_dependent_backups=0,object_count=0,parent=None,parent_id=None,project_id='e0b6e59b911e40b3acac38afb1f81e3a',restore_volume_id=None,service='cinder.backup.drivers.swift.SwiftBackupDriver',service_metadata=None,size=1,snapshot_id=None,status='creating',temp_snapshot_id=None,temp_volume_id=None,updated_at=None,user_id='87abbb474f8a4baf840fcfdf286ff94e',volume_id=a28b52f0-456d-4821-8de5-ec41566e1234) Jul 03 09:54:46.534081 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.drivers.swift [None req-f75b0311-c2ca-4c40-baf9-2dada74036c9 tempest-ProjectMemberTests33-2105464604 None] Using swift URL https://10.4.3.95:8080/v1/AUTH_e0b6e59b911e40b3acac38afb1f81e3a {{(pid=101319) initialize /opt/stack/cinder/cinder/backup/drivers/swift.py:300}} Jul 03 09:54:46.534591 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.drivers.swift [None req-f75b0311-c2ca-4c40-baf9-2dada74036c9 tempest-ProjectMemberTests33-2105464604 None] Connect to https://10.4.3.95:8080/v1/AUTH_ in "per_user" mode {{(pid=101319) initialize /opt/stack/cinder/cinder/backup/drivers/swift.py:301}} Jul 03 09:54:46.534906 np0000004400 cinder-backup[101319]: DEBUG os_brick.utils [None req-f75b0311-c2ca-4c40-baf9-2dada74036c9 tempest-ProjectMemberTests33-2105464604 None] ==> get_connector_properties: call "{'root_helper': 'sudo cinder-rootwrap /etc/cinder/rootwrap.conf', 'my_ip': '10.4.3.95', 'multipath': False, 'enforce_multipath': False, 'host': None, 'execute': None}" {{(pid=101319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}} Jul 03 09:54:46.544739 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.scaleio [None req-f75b0311-c2ca-4c40-baf9-2dada74036c9 tempest-ProjectMemberTests33-2105464604 None] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=101319) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}} Jul 03 09:54:46.562797 np0000004400 cinder-backup[101319]: DEBUG oslo_concurrency.processutils [None req-f75b0311-c2ca-4c40-baf9-2dada74036c9 tempest-ProjectMemberTests33-2105464604 None] Running cmd (subprocess): nvme version {{(pid=101319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 09:54:46.575486 np0000004400 cinder-backup[101319]: DEBUG oslo_concurrency.processutils [None req-f75b0311-c2ca-4c40-baf9-2dada74036c9 tempest-ProjectMemberTests33-2105464604 None] 'nvme version' failed. Not Retrying. {{(pid=101319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 03 09:54:46.575739 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.nvmeof [None req-f75b0311-c2ca-4c40-baf9-2dada74036c9 tempest-ProjectMemberTests33-2105464604 None] nvme not present on system {{(pid=101319) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}} Jul 03 09:54:46.584679 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.lightos [None req-f75b0311-c2ca-4c40-baf9-2dada74036c9 tempest-ProjectMemberTests33-2105464604 None] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=101319) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}} Jul 03 09:54:46.585687 np0000004400 cinder-backup[101319]: INFO os_brick.initiator.connectors.lightos [None req-f75b0311-c2ca-4c40-baf9-2dada74036c9 tempest-ProjectMemberTests33-2105464604 None] Current host hostNQN and IP(s) are ['10.4.3.95', 'fe80::f816:3eff:fe47:268c', '192.168.40.6', 'fe80::f816:3eff:febf:7be2', '192.168.50.6', 'fe80::f816:3eff:fe99:8914', '192.168.10.6', 'fe80::f816:3eff:fe2f:e696', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::bc9d:84ff:fec2:6b49', 'fe80::fc16:3eff:fe92:d54e', 'fe80::902b:f8ff:fe3c:fd0f'] Jul 03 09:54:46.585779 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.lightos [None req-f75b0311-c2ca-4c40-baf9-2dada74036c9 tempest-ProjectMemberTests33-2105464604 None] LIGHTOS: did not find dsc, continuing anyway. {{(pid=101319) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}} Jul 03 09:54:46.585865 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.lightos [None req-f75b0311-c2ca-4c40-baf9-2dada74036c9 tempest-ProjectMemberTests33-2105464604 None] LIGHTOS: no hostnqn found. {{(pid=101319) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}} Jul 03 09:54:46.586089 np0000004400 cinder-backup[101319]: DEBUG os_brick.utils [None req-f75b0311-c2ca-4c40-baf9-2dada74036c9 tempest-ProjectMemberTests33-2105464604 None] <== get_connector_properties: return (51ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.95', 'host': 'np0000004400', 'multipath': False, 'enforce_multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:ae7e5bb0ebe6', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': '6b284368-d0ba-4d18-af6f-4998d3955c52', 'nvme_native_multipath': False} {{(pid=101319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}} Jul 03 09:54:47.090026 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connector [None req-f75b0311-c2ca-4c40-baf9-2dada74036c9 tempest-ProjectMemberTests33-2105464604 None] Factory for iscsi on None {{(pid=101319) factory /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connector.py:243}} Jul 03 09:54:47.090466 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-f75b0311-c2ca-4c40-baf9-2dada74036c9 tempest-ProjectMemberTests33-2105464604 None] ==> connect_volume: call "{'self': , 'connection_properties': {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-a28b52f0-456d-4821-8de5-ec41566e1234', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'a28b52f0-456d-4821-8de5-ec41566e1234', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': False}}" {{(pid=101319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}} Jul 03 09:54:47.091119 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.base [None req-f75b0311-c2ca-4c40-baf9-2dada74036c9 tempest-ProjectMemberTests33-2105464604 None] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=101319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jul 03 09:54:47.091119 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.base [None req-f75b0311-c2ca-4c40-baf9-2dada74036c9 tempest-ProjectMemberTests33-2105464604 None] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.000s {{(pid=101319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jul 03 09:54:47.091302 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.base [None req-f75b0311-c2ca-4c40-baf9-2dada74036c9 tempest-ProjectMemberTests33-2105464604 None] Connection properties {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-a28b52f0-456d-4821-8de5-ec41566e1234', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'a28b52f0-456d-4821-8de5-ec41566e1234', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': False} {{(pid=101319) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}} Jul 03 09:54:47.101201 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.base [None req-f75b0311-c2ca-4c40-baf9-2dada74036c9 tempest-ProjectMemberTests33-2105464604 None] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-a28b52f0-456d-4821-8de5-ec41566e1234" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=101319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jul 03 09:54:47.101636 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.base [None req-f75b0311-c2ca-4c40-baf9-2dada74036c9 tempest-ProjectMemberTests33-2105464604 None] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-a28b52f0-456d-4821-8de5-ec41566e1234" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.000s {{(pid=101319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jul 03 09:54:47.101851 np0000004400 cinder-backup[101319]: INFO os_brick.initiator.connectors.iscsi [None req-f75b0311-c2ca-4c40-baf9-2dada74036c9 tempest-ProjectMemberTests33-2105464604 None] Trying to connect to iSCSI portal 192.168.40.100:3260 Jul 03 09:54:47.110896 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-f75b0311-c2ca-4c40-baf9-2dada74036c9 tempest-ProjectMemberTests33-2105464604 None] iscsiadm (): stdout= stderr=iscsiadm: No records found Jul 03 09:54:47.110896 np0000004400 cinder-backup[101319]: {{(pid=101319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 03 09:54:47.120758 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-f75b0311-c2ca-4c40-baf9-2dada74036c9 tempest-ProjectMemberTests33-2105464604 None] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-a28b52f0-456d-4821-8de5-ec41566e1234] added Jul 03 09:54:47.120758 np0000004400 cinder-backup[101319]: stderr=iscsiadm: Config file line 363 does not have value Jul 03 09:54:47.120758 np0000004400 cinder-backup[101319]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs' Jul 03 09:54:47.120758 np0000004400 cinder-backup[101319]: iscsiadm: Config file line 363 does not have value Jul 03 09:54:47.120758 np0000004400 cinder-backup[101319]: iscsiadm: Config file line 363 does not have value Jul 03 09:54:47.120758 np0000004400 cinder-backup[101319]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs' Jul 03 09:54:47.120758 np0000004400 cinder-backup[101319]: {{(pid=101319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 03 09:54:47.120941 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-f75b0311-c2ca-4c40-baf9-2dada74036c9 tempest-ProjectMemberTests33-2105464604 None] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=101319) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}} Jul 03 09:54:47.121336 np0000004400 cinder-backup[101319]: DEBUG os_brick.utils [None req-f75b0311-c2ca-4c40-baf9-2dada74036c9 tempest-ProjectMemberTests33-2105464604 None] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0194(s), this was the 1st time calling it. {{(pid=101319) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}} Jul 03 09:54:47.121567 np0000004400 cinder-backup[101319]: DEBUG os_brick.utils [None req-f75b0311-c2ca-4c40-baf9-2dada74036c9 tempest-ProjectMemberTests33-2105464604 None] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=101319) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}} Jul 03 09:54:48.123238 np0000004400 cinder-backup[101319]: INFO os_brick.initiator.connectors.iscsi [None req-f75b0311-c2ca-4c40-baf9-2dada74036c9 tempest-ProjectMemberTests33-2105464604 None] Trying to connect to iSCSI portal 192.168.40.100:3260 Jul 03 09:54:48.133641 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-f75b0311-c2ca-4c40-baf9-2dada74036c9 tempest-ProjectMemberTests33-2105464604 None] iscsiadm (): stdout=# BEGIN RECORD 2.1.9 Jul 03 09:54:48.133641 np0000004400 cinder-backup[101319]: node.name = iqn.2023-03.storpool.com:os--volume-a28b52f0-456d-4821-8de5-ec41566e1234 Jul 03 09:54:48.133641 np0000004400 cinder-backup[101319]: node.tpgt = -1 Jul 03 09:54:48.133641 np0000004400 cinder-backup[101319]: node.startup = manual Jul 03 09:54:48.133641 np0000004400 cinder-backup[101319]: node.leading_login = No Jul 03 09:54:48.133641 np0000004400 cinder-backup[101319]: iface.iscsi_ifacename = default Jul 03 09:54:48.133641 np0000004400 cinder-backup[101319]: iface.net_ifacename = Jul 03 09:54:48.133641 np0000004400 cinder-backup[101319]: iface.ipaddress = Jul 03 09:54:48.133641 np0000004400 cinder-backup[101319]: iface.prefix_len = 0 Jul 03 09:54:48.133641 np0000004400 cinder-backup[101319]: iface.hwaddress = Jul 03 09:54:48.133641 np0000004400 cinder-backup[101319]: iface.transport_name = tcp Jul 03 09:54:48.133641 np0000004400 cinder-backup[101319]: iface.initiatorname = Jul 03 09:54:48.133641 np0000004400 cinder-backup[101319]: iface.state = Jul 03 09:54:48.133641 np0000004400 cinder-backup[101319]: iface.vlan_id = 0 Jul 03 09:54:48.133641 np0000004400 cinder-backup[101319]: iface.vlan_priority = 0 Jul 03 09:54:48.133641 np0000004400 cinder-backup[101319]: iface.vlan_state = Jul 03 09:54:48.133641 np0000004400 cinder-backup[101319]: iface.iface_num = 0 Jul 03 09:54:48.133641 np0000004400 cinder-backup[101319]: iface.mtu = 0 Jul 03 09:54:48.133641 np0000004400 cinder-backup[101319]: iface.port = 0 Jul 03 09:54:48.133641 np0000004400 cinder-backup[101319]: iface.bootproto = Jul 03 09:54:48.133641 np0000004400 cinder-backup[101319]: iface.subnet_mask = Jul 03 09:54:48.133641 np0000004400 cinder-backup[101319]: iface.gateway = Jul 03 09:54:48.133641 np0000004400 cinder-backup[101319]: iface.dhcp_alt_client_id_state = Jul 03 09:54:48.133641 np0000004400 cinder-backup[101319]: iface.dhcp_alt_client_id = Jul 03 09:54:48.133641 np0000004400 cinder-backup[101319]: iface.dhcp_dns = Jul 03 09:54:48.133641 np0000004400 cinder-backup[101319]: iface.dhcp_learn_iqn = Jul 03 09:54:48.133641 np0000004400 cinder-backup[101319]: iface.dhcp_req_vendor_id_state = Jul 03 09:54:48.133641 np0000004400 cinder-backup[101319]: iface.dhcp_vendor_id_state = Jul 03 09:54:48.133641 np0000004400 cinder-backup[101319]: iface.dhcp_vendor_id = Jul 03 09:54:48.133641 np0000004400 cinder-backup[101319]: iface.dhcp_slp_da = Jul 03 09:54:48.133641 np0000004400 cinder-backup[101319]: iface.fragmentation = Jul 03 09:54:48.133641 np0000004400 cinder-backup[101319]: iface.gratuitous_arp = Jul 03 09:54:48.133641 np0000004400 cinder-backup[101319]: iface.incoming_forwarding = Jul 03 09:54:48.133641 np0000004400 cinder-backup[101319]: iface.tos_state = Jul 03 09:54:48.133641 np0000004400 cinder-backup[101319]: iface.tos = 0 Jul 03 09:54:48.133641 np0000004400 cinder-backup[101319]: iface.ttl = 0 Jul 03 09:54:48.133641 np0000004400 cinder-backup[101319]: iface.delayed_ack = Jul 03 09:54:48.133641 np0000004400 cinder-backup[101319]: iface.tcp_nagle = Jul 03 09:54:48.133641 np0000004400 cinder-backup[101319]: iface.tcp_wsf_state = Jul 03 09:54:48.133641 np0000004400 cinder-backup[101319]: iface.tcp_wsf = 0 Jul 03 09:54:48.133641 np0000004400 cinder-backup[101319]: iface.tcp_timer_scale = 0 Jul 03 09:54:48.133641 np0000004400 cinder-backup[101319]: iface.tcp_timestamp = Jul 03 09:54:48.133641 np0000004400 cinder-backup[101319]: iface.redirect = Jul 03 09:54:48.133641 np0000004400 cinder-backup[101319]: iface.def_task_mgmt_timeout = 0 Jul 03 09:54:48.133641 np0000004400 cinder-backup[101319]: iface.header_digest = Jul 03 09:54:48.133641 np0000004400 cinder-backup[101319]: iface.data_digest = Jul 03 09:54:48.133641 np0000004400 cinder-backup[101319]: iface.immediate_data = Jul 03 09:54:48.133641 np0000004400 cinder-backup[101319]: iface.initial_r2t = Jul 03 09:54:48.133641 np0000004400 cinder-backup[101319]: iface.data_seq_inorder = Jul 03 09:54:48.133641 np0000004400 cinder-backup[101319]: iface.data_pdu_inorder = Jul 03 09:54:48.133641 np0000004400 cinder-backup[101319]: iface.erl = 0 Jul 03 09:54:48.133641 np0000004400 cinder-backup[101319]: iface.max_receive_data_len = 0 Jul 03 09:54:48.133641 np0000004400 cinder-backup[101319]: iface.first_burst_len = 0 Jul 03 09:54:48.133641 np0000004400 cinder-backup[101319]: iface.max_outstanding_r2t = 0 Jul 03 09:54:48.133641 np0000004400 cinder-backup[101319]: iface.max_burst_len = 0 Jul 03 09:54:48.133641 np0000004400 cinder-backup[101319]: iface.chap_auth = Jul 03 09:54:48.133641 np0000004400 cinder-backup[101319]: iface.bidi_chap = Jul 03 09:54:48.133641 np0000004400 cinder-backup[101319]: iface.strict_login_compliance = Jul 03 09:54:48.133641 np0000004400 cinder-backup[101319]: iface.discovery_auth = Jul 03 09:54:48.133641 np0000004400 cinder-backup[101319]: iface.discovery_logout = Jul 03 09:54:48.133641 np0000004400 cinder-backup[101319]: node.discovery_address = Jul 03 09:54:48.133641 np0000004400 cinder-backup[101319]: node.discovery_port = 0 Jul 03 09:54:48.133641 np0000004400 cinder-backup[101319]: node.discovery_type = fw Jul 03 09:54:48.133641 np0000004400 cinder-backup[101319]: node.session.initial_cmdsn = 0 Jul 03 09:54:48.133641 np0000004400 cinder-backup[101319]: node.session.initial_login_retry_max = 8 Jul 03 09:54:48.133641 np0000004400 cinder-backup[101319]: node.session.xmit_thread_priority = 0 Jul 03 09:54:48.133641 np0000004400 cinder-backup[101319]: node.session.cmds_max = 128 Jul 03 09:54:48.133641 np0000004400 cinder-backup[101319]: node.session.queue_depth = 32 Jul 03 09:54:48.133641 np0000004400 cinder-backup[101319]: node.session.nr_sessions = 1 Jul 03 09:54:48.133641 np0000004400 cinder-backup[101319]: node.session.auth.authmethod = None Jul 03 09:54:48.133641 np0000004400 cinder-backup[101319]: node.session.auth.username = Jul 03 09:54:48.133641 np0000004400 cinder-backup[101319]: node.session.auth.password = *** Jul 03 09:54:48.133641 np0000004400 cinder-backup[101319]: node.session.auth.username_in = Jul 03 09:54:48.133641 np0000004400 cinder-backup[101319]: node.session.auth.password_in = Jul 03 09:54:48.133641 np0000004400 cinder-backup[101319]: node.session.auth.chap_algs = SHA256 Jul 03 09:54:48.133641 np0000004400 cinder-backup[101319]: node.session.timeo.replacement_timeout = 120 Jul 03 09:54:48.133641 np0000004400 cinder-backup[101319]: node.session.err_timeo.abort_timeout = 15 Jul 03 09:54:48.133641 np0000004400 cinder-backup[101319]: node.session.err_timeo.lu_reset_timeout = 30 Jul 03 09:54:48.133641 np0000004400 cinder-backup[101319]: node.session.err_timeo.tgt_reset_timeout = 30 Jul 03 09:54:48.133641 np0000004400 cinder-backup[101319]: node.session.err_timeo.host_reset_timeout = 60 Jul 03 09:54:48.133641 np0000004400 cinder-backup[101319]: node.session.iscsi.FastAbort = Yes Jul 03 09:54:48.133641 np0000004400 cinder-backup[101319]: node.session.iscsi.InitialR2T = No Jul 03 09:54:48.133641 np0000004400 cinder-backup[101319]: node.session.iscsi.ImmediateData = Yes Jul 03 09:54:48.133641 np0000004400 cinder-backup[101319]: node.session.iscsi.FirstBurstLength = 262144 Jul 03 09:54:48.133641 np0000004400 cinder-backup[101319]: node.session.iscsi.MaxBurstLength = 16776192 Jul 03 09:54:48.133641 np0000004400 cinder-backup[101319]: node.session.iscsi.DefaultTime2Retain = 0 Jul 03 09:54:48.133641 np0000004400 cinder-backup[101319]: node.session.iscsi.DefaultTime2Wait = 2 Jul 03 09:54:48.133641 np0000004400 cinder-backup[101319]: node.session.iscsi.MaxConnections = 1 Jul 03 09:54:48.133641 np0000004400 cinder-backup[101319]: node.session.iscsi.MaxOutstandingR2T = 1 Jul 03 09:54:48.133641 np0000004400 cinder-backup[101319]: node.session.iscsi.ERL = 0 Jul 03 09:54:48.133641 np0000004400 cinder-backup[101319]: node.session.scan = auto Jul 03 09:54:48.133641 np0000004400 cinder-backup[101319]: node.session.reopen_max = 0 Jul 03 09:54:48.133641 np0000004400 cinder-backup[101319]: node.conn[0].address = 192.168.40.100 Jul 03 09:54:48.133641 np0000004400 cinder-backup[101319]: node.conn[0].port = 3260 Jul 03 09:54:48.133641 np0000004400 cinder-backup[101319]: node.conn[0].startup = manual Jul 03 09:54:48.133641 np0000004400 cinder-backup[101319]: node.conn[0].tcp.window_size = 524288 Jul 03 09:54:48.133641 np0000004400 cinder-backup[101319]: node.conn[0].tcp.type_of_service = 0 Jul 03 09:54:48.133641 np0000004400 cinder-backup[101319]: node.conn[0].timeo.logout_timeout = 15 Jul 03 09:54:48.133641 np0000004400 cinder-backup[101319]: node.conn[0].timeo.login_timeout = 15 Jul 03 09:54:48.133641 np0000004400 cinder-backup[101319]: node.conn[0].timeo.auth_timeout = 45 Jul 03 09:54:48.133641 np0000004400 cinder-backup[101319]: node.conn[0].timeo.noop_out_interval = 5 Jul 03 09:54:48.133641 np0000004400 cinder-backup[101319]: node.conn[0].timeo.noop_out_timeout = 5 Jul 03 09:54:48.133641 np0000004400 cinder-backup[101319]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0 Jul 03 09:54:48.133641 np0000004400 cinder-backup[101319]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144 Jul 03 09:54:48.133641 np0000004400 cinder-backup[101319]: node.conn[0].iscsi.HeaderDigest = None Jul 03 09:54:48.133641 np0000004400 cinder-backup[101319]: node.conn[0].iscsi.DataDigest = None Jul 03 09:54:48.133641 np0000004400 cinder-backup[101319]: node.conn[0].iscsi.IFMarker = No Jul 03 09:54:48.133641 np0000004400 cinder-backup[101319]: node.conn[0].iscsi.OFMarker = No Jul 03 09:54:48.133641 np0000004400 cinder-backup[101319]: # END RECORD Jul 03 09:54:48.133641 np0000004400 cinder-backup[101319]: stderr= {{(pid=101319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 03 09:54:48.143188 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-f75b0311-c2ca-4c40-baf9-2dada74036c9 tempest-ProjectMemberTests33-2105464604 None] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=101319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 03 09:54:48.153882 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-f75b0311-c2ca-4c40-baf9-2dada74036c9 tempest-ProjectMemberTests33-2105464604 None] iscsiadm ('-m', 'session'): stdout=tcp: [215] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f9e48e4b-6866-4ad9-bc3b-93ae778de731 (non-flash) Jul 03 09:54:48.153882 np0000004400 cinder-backup[101319]: tcp: [216] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f9e48e4b-6866-4ad9-bc3b-93ae778de731 (non-flash) Jul 03 09:54:48.153882 np0000004400 cinder-backup[101319]: stderr= {{(pid=101319) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jul 03 09:54:48.163493 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-f75b0311-c2ca-4c40-baf9-2dada74036c9 tempest-ProjectMemberTests33-2105464604 None] iscsi session list stdout=tcp: [215] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f9e48e4b-6866-4ad9-bc3b-93ae778de731 (non-flash) Jul 03 09:54:48.163493 np0000004400 cinder-backup[101319]: tcp: [216] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f9e48e4b-6866-4ad9-bc3b-93ae778de731 (non-flash) Jul 03 09:54:48.163493 np0000004400 cinder-backup[101319]: stderr= {{(pid=101319) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jul 03 09:54:48.187754 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-f75b0311-c2ca-4c40-baf9-2dada74036c9 tempest-ProjectMemberTests33-2105464604 None] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-a28b52f0-456d-4821-8de5-ec41566e1234, portal: 192.168.40.100,3260] Jul 03 09:54:48.187754 np0000004400 cinder-backup[101319]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-a28b52f0-456d-4821-8de5-ec41566e1234, portal: 192.168.40.100,3260] successful. Jul 03 09:54:48.187754 np0000004400 cinder-backup[101319]: stderr= {{(pid=101319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 03 09:54:48.198059 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-f75b0311-c2ca-4c40-baf9-2dada74036c9 tempest-ProjectMemberTests33-2105464604 None] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=101319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 03 09:54:48.210287 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-f75b0311-c2ca-4c40-baf9-2dada74036c9 tempest-ProjectMemberTests33-2105464604 None] iscsiadm ('-m', 'session'): stdout=tcp: [215] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f9e48e4b-6866-4ad9-bc3b-93ae778de731 (non-flash) Jul 03 09:54:48.210287 np0000004400 cinder-backup[101319]: tcp: [216] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f9e48e4b-6866-4ad9-bc3b-93ae778de731 (non-flash) Jul 03 09:54:48.210287 np0000004400 cinder-backup[101319]: tcp: [217] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a28b52f0-456d-4821-8de5-ec41566e1234 (non-flash) Jul 03 09:54:48.210287 np0000004400 cinder-backup[101319]: stderr= {{(pid=101319) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jul 03 09:54:48.210575 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-f75b0311-c2ca-4c40-baf9-2dada74036c9 tempest-ProjectMemberTests33-2105464604 None] iscsi session list stdout=tcp: [215] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f9e48e4b-6866-4ad9-bc3b-93ae778de731 (non-flash) Jul 03 09:54:48.210575 np0000004400 cinder-backup[101319]: tcp: [216] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f9e48e4b-6866-4ad9-bc3b-93ae778de731 (non-flash) Jul 03 09:54:48.210575 np0000004400 cinder-backup[101319]: tcp: [217] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a28b52f0-456d-4821-8de5-ec41566e1234 (non-flash) Jul 03 09:54:48.210575 np0000004400 cinder-backup[101319]: stderr= {{(pid=101319) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jul 03 09:54:48.210973 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.base [None req-f75b0311-c2ca-4c40-baf9-2dada74036c9 tempest-ProjectMemberTests33-2105464604 None] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-a28b52f0-456d-4821-8de5-ec41566e1234" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.109s {{(pid=101319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jul 03 09:54:48.211148 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-f75b0311-c2ca-4c40-baf9-2dada74036c9 tempest-ProjectMemberTests33-2105464604 None] Connected to 192.168.40.100:3260 {{(pid=101319) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}} Jul 03 09:54:48.211907 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.linuxscsi [None req-f75b0311-c2ca-4c40-baf9-2dada74036c9 tempest-ProjectMemberTests33-2105464604 None] HCTL ('7', '-', '-', 0) found on session 217 with lun 0 {{(pid=101319) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}} Jul 03 09:54:48.212096 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.linuxscsi [None req-f75b0311-c2ca-4c40-baf9-2dada74036c9 tempest-ProjectMemberTests33-2105464604 None] Scanning host 7 c: -, t: -, l: 0) {{(pid=101319) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}} Jul 03 09:54:48.225715 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.linuxscsi [None req-f75b0311-c2ca-4c40-baf9-2dada74036c9 tempest-ProjectMemberTests33-2105464604 None] Searching for a device in session 217 and hctl ['7', '*', '*', 0] yield: sdb {{(pid=101319) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}} Jul 03 09:54:48.225715 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-f75b0311-c2ca-4c40-baf9-2dada74036c9 tempest-ProjectMemberTests33-2105464604 None] Connected to sdb using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-a28b52f0-456d-4821-8de5-ec41566e1234', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'a28b52f0-456d-4821-8de5-ec41566e1234', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': False} {{(pid=101319) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}} Jul 03 09:54:49.227306 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.base [None req-f75b0311-c2ca-4c40-baf9-2dada74036c9 tempest-ProjectMemberTests33-2105464604 None] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 2.136s {{(pid=101319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jul 03 09:54:49.227793 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-f75b0311-c2ca-4c40-baf9-2dada74036c9 tempest-ProjectMemberTests33-2105464604 None] <== connect_volume: return (2136ms) {'type': 'block', 'scsi_wwn': 'SStorPool_iSCSI_DISK_1034578903445799240', 'path': '/dev/sdb'} {{(pid=101319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}} Jul 03 09:54:49.227846 np0000004400 cinder-backup[101319]: DEBUG oslo_concurrency.processutils [None req-f75b0311-c2ca-4c40-baf9-2dada74036c9 tempest-ProjectMemberTests33-2105464604 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chown 1002 /dev/sdb {{(pid=101319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 09:54:49.249888 np0000004400 sudo[156835]: stack : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chown 1002 /dev/sdb Jul 03 09:54:49.250510 np0000004400 sudo[156835]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1002) Jul 03 09:54:49.539245 np0000004400 sudo[156835]: pam_unix(sudo:session): session closed for user root Jul 03 09:54:49.541184 np0000004400 cinder-backup[101319]: DEBUG oslo_concurrency.processutils [None req-f75b0311-c2ca-4c40-baf9-2dada74036c9 tempest-ProjectMemberTests33-2105464604 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chown 1002 /dev/sdb" returned: 0 in 0.313s {{(pid=101319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 09:54:49.578603 np0000004400 cinder-backup[101319]: DEBUG oslo_db.sqlalchemy.engines [None req-f75b0311-c2ca-4c40-baf9-2dada74036c9 tempest-ProjectMemberTests33-2105464604 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=101319) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 03 09:54:49.584744 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-f75b0311-c2ca-4c40-baf9-2dada74036c9 tempest-ProjectMemberTests33-2105464604 None] _create_container started, container: volumebackups,backup: 0254456b-0a66-4125-8e17-8e1f79f703fe. {{(pid=101319) _create_container /opt/stack/cinder/cinder/backup/chunkeddriver.py:249}} Jul 03 09:54:49.612550 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.drivers.swift [None req-f75b0311-c2ca-4c40-baf9-2dada74036c9 tempest-ProjectMemberTests33-2105464604 None] generate_object_name_prefix: volume_a28b52f0-456d-4821-8de5-ec41566e1234/20260703095449/az_nova_backup_0254456b-0a66-4125-8e17-8e1f79f703fe {{(pid=101319) _generate_object_name_prefix /opt/stack/cinder/cinder/backup/drivers/swift.py:452}} Jul 03 09:54:49.617100 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-f75b0311-c2ca-4c40-baf9-2dada74036c9 tempest-ProjectMemberTests33-2105464604 None] starting backup of volume: a28b52f0-456d-4821-8de5-ec41566e1234, volume size: 1073741824, object names prefix volume_a28b52f0-456d-4821-8de5-ec41566e1234/20260703095449/az_nova_backup_0254456b-0a66-4125-8e17-8e1f79f703fe, availability zone: nova {{(pid=101319) _prepare_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:359}} Jul 03 09:54:49.780830 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-f75b0311-c2ca-4c40-baf9-2dada74036c9 tempest-ProjectMemberTests33-2105464604 None] Backing up chunk of data from volume. {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 09:54:50.019717 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-f75b0311-c2ca-4c40-baf9-2dada74036c9 tempest-ProjectMemberTests33-2105464604 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101319) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 09:54:50.019865 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-f75b0311-c2ca-4c40-baf9-2dada74036c9 tempest-ProjectMemberTests33-2105464604 None] About to put_object {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 09:54:50.114656 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-f75b0311-c2ca-4c40-baf9-2dada74036c9 tempest-ProjectMemberTests33-2105464604 None] backup MD5 for volume_a28b52f0-456d-4821-8de5-ec41566e1234/20260703095449/az_nova_backup_0254456b-0a66-4125-8e17-8e1f79f703fe-00001: 25e317773f308e446cc84c503a6d1f85 {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 09:54:50.114796 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-f75b0311-c2ca-4c40-baf9-2dada74036c9 tempest-ProjectMemberTests33-2105464604 None] Calling eventlet.sleep(0) {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 09:54:50.285593 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-f75b0311-c2ca-4c40-baf9-2dada74036c9 tempest-ProjectMemberTests33-2105464604 None] Backing up chunk of data from volume. {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 09:54:50.535783 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-f75b0311-c2ca-4c40-baf9-2dada74036c9 tempest-ProjectMemberTests33-2105464604 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101319) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 09:54:50.535943 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-f75b0311-c2ca-4c40-baf9-2dada74036c9 tempest-ProjectMemberTests33-2105464604 None] About to put_object {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 09:54:50.631716 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-f75b0311-c2ca-4c40-baf9-2dada74036c9 tempest-ProjectMemberTests33-2105464604 None] backup MD5 for volume_a28b52f0-456d-4821-8de5-ec41566e1234/20260703095449/az_nova_backup_0254456b-0a66-4125-8e17-8e1f79f703fe-00002: 25e317773f308e446cc84c503a6d1f85 {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 09:54:50.631904 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-f75b0311-c2ca-4c40-baf9-2dada74036c9 tempest-ProjectMemberTests33-2105464604 None] Calling eventlet.sleep(0) {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 09:54:50.811837 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-f75b0311-c2ca-4c40-baf9-2dada74036c9 tempest-ProjectMemberTests33-2105464604 None] Backing up chunk of data from volume. {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 09:54:51.057855 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-f75b0311-c2ca-4c40-baf9-2dada74036c9 tempest-ProjectMemberTests33-2105464604 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101319) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 09:54:51.057965 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-f75b0311-c2ca-4c40-baf9-2dada74036c9 tempest-ProjectMemberTests33-2105464604 None] About to put_object {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 09:54:51.154112 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-f75b0311-c2ca-4c40-baf9-2dada74036c9 tempest-ProjectMemberTests33-2105464604 None] backup MD5 for volume_a28b52f0-456d-4821-8de5-ec41566e1234/20260703095449/az_nova_backup_0254456b-0a66-4125-8e17-8e1f79f703fe-00003: 25e317773f308e446cc84c503a6d1f85 {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 09:54:51.154259 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-f75b0311-c2ca-4c40-baf9-2dada74036c9 tempest-ProjectMemberTests33-2105464604 None] Calling eventlet.sleep(0) {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 09:54:51.329926 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-f75b0311-c2ca-4c40-baf9-2dada74036c9 tempest-ProjectMemberTests33-2105464604 None] Backing up chunk of data from volume. {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 09:54:51.574235 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-f75b0311-c2ca-4c40-baf9-2dada74036c9 tempest-ProjectMemberTests33-2105464604 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101319) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 09:54:51.574346 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-f75b0311-c2ca-4c40-baf9-2dada74036c9 tempest-ProjectMemberTests33-2105464604 None] About to put_object {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 09:54:51.672507 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-f75b0311-c2ca-4c40-baf9-2dada74036c9 tempest-ProjectMemberTests33-2105464604 None] backup MD5 for volume_a28b52f0-456d-4821-8de5-ec41566e1234/20260703095449/az_nova_backup_0254456b-0a66-4125-8e17-8e1f79f703fe-00004: 25e317773f308e446cc84c503a6d1f85 {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 09:54:51.672632 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-f75b0311-c2ca-4c40-baf9-2dada74036c9 tempest-ProjectMemberTests33-2105464604 None] Calling eventlet.sleep(0) {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 09:54:51.825975 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-f75b0311-c2ca-4c40-baf9-2dada74036c9 tempest-ProjectMemberTests33-2105464604 None] Backing up chunk of data from volume. {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 09:54:52.068393 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-f75b0311-c2ca-4c40-baf9-2dada74036c9 tempest-ProjectMemberTests33-2105464604 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101319) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 09:54:52.068631 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-f75b0311-c2ca-4c40-baf9-2dada74036c9 tempest-ProjectMemberTests33-2105464604 None] About to put_object {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 09:54:52.165722 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-f75b0311-c2ca-4c40-baf9-2dada74036c9 tempest-ProjectMemberTests33-2105464604 None] backup MD5 for volume_a28b52f0-456d-4821-8de5-ec41566e1234/20260703095449/az_nova_backup_0254456b-0a66-4125-8e17-8e1f79f703fe-00005: 25e317773f308e446cc84c503a6d1f85 {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 09:54:52.165992 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-f75b0311-c2ca-4c40-baf9-2dada74036c9 tempest-ProjectMemberTests33-2105464604 None] Calling eventlet.sleep(0) {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 09:54:52.335363 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-f75b0311-c2ca-4c40-baf9-2dada74036c9 tempest-ProjectMemberTests33-2105464604 None] Backing up chunk of data from volume. {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 09:54:52.579878 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-f75b0311-c2ca-4c40-baf9-2dada74036c9 tempest-ProjectMemberTests33-2105464604 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101319) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 09:54:52.580030 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-f75b0311-c2ca-4c40-baf9-2dada74036c9 tempest-ProjectMemberTests33-2105464604 None] About to put_object {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 09:54:52.688277 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-f75b0311-c2ca-4c40-baf9-2dada74036c9 tempest-ProjectMemberTests33-2105464604 None] backup MD5 for volume_a28b52f0-456d-4821-8de5-ec41566e1234/20260703095449/az_nova_backup_0254456b-0a66-4125-8e17-8e1f79f703fe-00006: 25e317773f308e446cc84c503a6d1f85 {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 09:54:52.688667 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-f75b0311-c2ca-4c40-baf9-2dada74036c9 tempest-ProjectMemberTests33-2105464604 None] Calling eventlet.sleep(0) {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 09:54:52.858379 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-f75b0311-c2ca-4c40-baf9-2dada74036c9 tempest-ProjectMemberTests33-2105464604 None] Backing up chunk of data from volume. {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 09:54:53.101478 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-f75b0311-c2ca-4c40-baf9-2dada74036c9 tempest-ProjectMemberTests33-2105464604 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101319) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 09:54:53.101626 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-f75b0311-c2ca-4c40-baf9-2dada74036c9 tempest-ProjectMemberTests33-2105464604 None] About to put_object {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 09:54:53.205859 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-f75b0311-c2ca-4c40-baf9-2dada74036c9 tempest-ProjectMemberTests33-2105464604 None] backup MD5 for volume_a28b52f0-456d-4821-8de5-ec41566e1234/20260703095449/az_nova_backup_0254456b-0a66-4125-8e17-8e1f79f703fe-00007: 25e317773f308e446cc84c503a6d1f85 {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 09:54:53.205995 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-f75b0311-c2ca-4c40-baf9-2dada74036c9 tempest-ProjectMemberTests33-2105464604 None] Calling eventlet.sleep(0) {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 09:54:53.401302 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-f75b0311-c2ca-4c40-baf9-2dada74036c9 tempest-ProjectMemberTests33-2105464604 None] Backing up chunk of data from volume. {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 09:54:53.649586 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-f75b0311-c2ca-4c40-baf9-2dada74036c9 tempest-ProjectMemberTests33-2105464604 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101319) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 09:54:53.649685 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-f75b0311-c2ca-4c40-baf9-2dada74036c9 tempest-ProjectMemberTests33-2105464604 None] About to put_object {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 09:54:53.746888 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-f75b0311-c2ca-4c40-baf9-2dada74036c9 tempest-ProjectMemberTests33-2105464604 None] backup MD5 for volume_a28b52f0-456d-4821-8de5-ec41566e1234/20260703095449/az_nova_backup_0254456b-0a66-4125-8e17-8e1f79f703fe-00008: 25e317773f308e446cc84c503a6d1f85 {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 09:54:53.747084 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-f75b0311-c2ca-4c40-baf9-2dada74036c9 tempest-ProjectMemberTests33-2105464604 None] Calling eventlet.sleep(0) {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 09:54:53.918499 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-f75b0311-c2ca-4c40-baf9-2dada74036c9 tempest-ProjectMemberTests33-2105464604 None] Backing up chunk of data from volume. {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 09:54:54.156596 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-f75b0311-c2ca-4c40-baf9-2dada74036c9 tempest-ProjectMemberTests33-2105464604 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101319) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 09:54:54.156808 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-f75b0311-c2ca-4c40-baf9-2dada74036c9 tempest-ProjectMemberTests33-2105464604 None] About to put_object {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 09:54:54.252342 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-f75b0311-c2ca-4c40-baf9-2dada74036c9 tempest-ProjectMemberTests33-2105464604 None] backup MD5 for volume_a28b52f0-456d-4821-8de5-ec41566e1234/20260703095449/az_nova_backup_0254456b-0a66-4125-8e17-8e1f79f703fe-00009: 25e317773f308e446cc84c503a6d1f85 {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 09:54:54.252551 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-f75b0311-c2ca-4c40-baf9-2dada74036c9 tempest-ProjectMemberTests33-2105464604 None] Calling eventlet.sleep(0) {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 09:54:54.421288 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-f75b0311-c2ca-4c40-baf9-2dada74036c9 tempest-ProjectMemberTests33-2105464604 None] Backing up chunk of data from volume. {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 09:54:54.666332 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-f75b0311-c2ca-4c40-baf9-2dada74036c9 tempest-ProjectMemberTests33-2105464604 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101319) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 09:54:54.666553 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-f75b0311-c2ca-4c40-baf9-2dada74036c9 tempest-ProjectMemberTests33-2105464604 None] About to put_object {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 09:54:54.761979 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-f75b0311-c2ca-4c40-baf9-2dada74036c9 tempest-ProjectMemberTests33-2105464604 None] backup MD5 for volume_a28b52f0-456d-4821-8de5-ec41566e1234/20260703095449/az_nova_backup_0254456b-0a66-4125-8e17-8e1f79f703fe-00010: 25e317773f308e446cc84c503a6d1f85 {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 09:54:54.762151 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-f75b0311-c2ca-4c40-baf9-2dada74036c9 tempest-ProjectMemberTests33-2105464604 None] Calling eventlet.sleep(0) {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 09:54:54.934967 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-f75b0311-c2ca-4c40-baf9-2dada74036c9 tempest-ProjectMemberTests33-2105464604 None] Backing up chunk of data from volume. {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 09:54:55.199011 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-f75b0311-c2ca-4c40-baf9-2dada74036c9 tempest-ProjectMemberTests33-2105464604 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101319) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 09:54:55.199146 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-f75b0311-c2ca-4c40-baf9-2dada74036c9 tempest-ProjectMemberTests33-2105464604 None] About to put_object {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 09:54:55.294513 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-f75b0311-c2ca-4c40-baf9-2dada74036c9 tempest-ProjectMemberTests33-2105464604 None] backup MD5 for volume_a28b52f0-456d-4821-8de5-ec41566e1234/20260703095449/az_nova_backup_0254456b-0a66-4125-8e17-8e1f79f703fe-00011: 25e317773f308e446cc84c503a6d1f85 {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 09:54:55.294690 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-f75b0311-c2ca-4c40-baf9-2dada74036c9 tempest-ProjectMemberTests33-2105464604 None] Calling eventlet.sleep(0) {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 09:54:55.465203 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-f75b0311-c2ca-4c40-baf9-2dada74036c9 tempest-ProjectMemberTests33-2105464604 None] Backing up chunk of data from volume. {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 09:54:55.711292 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-f75b0311-c2ca-4c40-baf9-2dada74036c9 tempest-ProjectMemberTests33-2105464604 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101319) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 09:54:55.711470 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-f75b0311-c2ca-4c40-baf9-2dada74036c9 tempest-ProjectMemberTests33-2105464604 None] About to put_object {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 09:54:55.805836 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-f75b0311-c2ca-4c40-baf9-2dada74036c9 tempest-ProjectMemberTests33-2105464604 None] backup MD5 for volume_a28b52f0-456d-4821-8de5-ec41566e1234/20260703095449/az_nova_backup_0254456b-0a66-4125-8e17-8e1f79f703fe-00012: 25e317773f308e446cc84c503a6d1f85 {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 09:54:55.805989 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-f75b0311-c2ca-4c40-baf9-2dada74036c9 tempest-ProjectMemberTests33-2105464604 None] Calling eventlet.sleep(0) {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 09:54:55.970888 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-f75b0311-c2ca-4c40-baf9-2dada74036c9 tempest-ProjectMemberTests33-2105464604 None] Backing up chunk of data from volume. {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 09:54:56.212447 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-f75b0311-c2ca-4c40-baf9-2dada74036c9 tempest-ProjectMemberTests33-2105464604 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101319) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 09:54:56.212711 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-f75b0311-c2ca-4c40-baf9-2dada74036c9 tempest-ProjectMemberTests33-2105464604 None] About to put_object {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 09:54:56.307962 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-f75b0311-c2ca-4c40-baf9-2dada74036c9 tempest-ProjectMemberTests33-2105464604 None] backup MD5 for volume_a28b52f0-456d-4821-8de5-ec41566e1234/20260703095449/az_nova_backup_0254456b-0a66-4125-8e17-8e1f79f703fe-00013: 25e317773f308e446cc84c503a6d1f85 {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 09:54:56.308193 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-f75b0311-c2ca-4c40-baf9-2dada74036c9 tempest-ProjectMemberTests33-2105464604 None] Calling eventlet.sleep(0) {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 09:54:56.487057 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-f75b0311-c2ca-4c40-baf9-2dada74036c9 tempest-ProjectMemberTests33-2105464604 None] Backing up chunk of data from volume. {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 09:54:56.747159 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-f75b0311-c2ca-4c40-baf9-2dada74036c9 tempest-ProjectMemberTests33-2105464604 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101319) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 09:54:56.747294 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-f75b0311-c2ca-4c40-baf9-2dada74036c9 tempest-ProjectMemberTests33-2105464604 None] About to put_object {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 09:54:56.846756 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-f75b0311-c2ca-4c40-baf9-2dada74036c9 tempest-ProjectMemberTests33-2105464604 None] backup MD5 for volume_a28b52f0-456d-4821-8de5-ec41566e1234/20260703095449/az_nova_backup_0254456b-0a66-4125-8e17-8e1f79f703fe-00014: 25e317773f308e446cc84c503a6d1f85 {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 09:54:56.846893 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-f75b0311-c2ca-4c40-baf9-2dada74036c9 tempest-ProjectMemberTests33-2105464604 None] Calling eventlet.sleep(0) {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 09:54:57.024329 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-f75b0311-c2ca-4c40-baf9-2dada74036c9 tempest-ProjectMemberTests33-2105464604 None] Backing up chunk of data from volume. {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 09:54:57.266372 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-f75b0311-c2ca-4c40-baf9-2dada74036c9 tempest-ProjectMemberTests33-2105464604 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101319) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 09:54:57.266583 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-f75b0311-c2ca-4c40-baf9-2dada74036c9 tempest-ProjectMemberTests33-2105464604 None] About to put_object {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 09:54:57.363058 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-f75b0311-c2ca-4c40-baf9-2dada74036c9 tempest-ProjectMemberTests33-2105464604 None] backup MD5 for volume_a28b52f0-456d-4821-8de5-ec41566e1234/20260703095449/az_nova_backup_0254456b-0a66-4125-8e17-8e1f79f703fe-00015: 25e317773f308e446cc84c503a6d1f85 {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 09:54:57.363207 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-f75b0311-c2ca-4c40-baf9-2dada74036c9 tempest-ProjectMemberTests33-2105464604 None] Calling eventlet.sleep(0) {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 09:54:57.530799 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-f75b0311-c2ca-4c40-baf9-2dada74036c9 tempest-ProjectMemberTests33-2105464604 None] Backing up chunk of data from volume. {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 09:54:57.774969 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-f75b0311-c2ca-4c40-baf9-2dada74036c9 tempest-ProjectMemberTests33-2105464604 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101319) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 09:54:57.775117 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-f75b0311-c2ca-4c40-baf9-2dada74036c9 tempest-ProjectMemberTests33-2105464604 None] About to put_object {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 09:54:57.873059 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-f75b0311-c2ca-4c40-baf9-2dada74036c9 tempest-ProjectMemberTests33-2105464604 None] backup MD5 for volume_a28b52f0-456d-4821-8de5-ec41566e1234/20260703095449/az_nova_backup_0254456b-0a66-4125-8e17-8e1f79f703fe-00016: 25e317773f308e446cc84c503a6d1f85 {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 09:54:57.873281 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-f75b0311-c2ca-4c40-baf9-2dada74036c9 tempest-ProjectMemberTests33-2105464604 None] Calling eventlet.sleep(0) {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 09:54:58.047314 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-f75b0311-c2ca-4c40-baf9-2dada74036c9 tempest-ProjectMemberTests33-2105464604 None] Backing up chunk of data from volume. {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 09:54:58.290244 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-f75b0311-c2ca-4c40-baf9-2dada74036c9 tempest-ProjectMemberTests33-2105464604 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101319) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 09:54:58.290441 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-f75b0311-c2ca-4c40-baf9-2dada74036c9 tempest-ProjectMemberTests33-2105464604 None] About to put_object {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 09:54:58.393783 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-f75b0311-c2ca-4c40-baf9-2dada74036c9 tempest-ProjectMemberTests33-2105464604 None] backup MD5 for volume_a28b52f0-456d-4821-8de5-ec41566e1234/20260703095449/az_nova_backup_0254456b-0a66-4125-8e17-8e1f79f703fe-00017: 25e317773f308e446cc84c503a6d1f85 {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 09:54:58.393932 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-f75b0311-c2ca-4c40-baf9-2dada74036c9 tempest-ProjectMemberTests33-2105464604 None] Calling eventlet.sleep(0) {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 09:54:58.565531 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-f75b0311-c2ca-4c40-baf9-2dada74036c9 tempest-ProjectMemberTests33-2105464604 None] Backing up chunk of data from volume. {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 09:54:58.809686 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-f75b0311-c2ca-4c40-baf9-2dada74036c9 tempest-ProjectMemberTests33-2105464604 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101319) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 09:54:58.809848 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-f75b0311-c2ca-4c40-baf9-2dada74036c9 tempest-ProjectMemberTests33-2105464604 None] About to put_object {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 09:54:58.907202 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-f75b0311-c2ca-4c40-baf9-2dada74036c9 tempest-ProjectMemberTests33-2105464604 None] backup MD5 for volume_a28b52f0-456d-4821-8de5-ec41566e1234/20260703095449/az_nova_backup_0254456b-0a66-4125-8e17-8e1f79f703fe-00018: 25e317773f308e446cc84c503a6d1f85 {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 09:54:58.907366 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-f75b0311-c2ca-4c40-baf9-2dada74036c9 tempest-ProjectMemberTests33-2105464604 None] Calling eventlet.sleep(0) {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 09:54:59.075194 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-f75b0311-c2ca-4c40-baf9-2dada74036c9 tempest-ProjectMemberTests33-2105464604 None] Backing up chunk of data from volume. {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 09:54:59.318042 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-f75b0311-c2ca-4c40-baf9-2dada74036c9 tempest-ProjectMemberTests33-2105464604 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101319) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 09:54:59.318042 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-f75b0311-c2ca-4c40-baf9-2dada74036c9 tempest-ProjectMemberTests33-2105464604 None] About to put_object {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 09:54:59.416182 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-f75b0311-c2ca-4c40-baf9-2dada74036c9 tempest-ProjectMemberTests33-2105464604 None] backup MD5 for volume_a28b52f0-456d-4821-8de5-ec41566e1234/20260703095449/az_nova_backup_0254456b-0a66-4125-8e17-8e1f79f703fe-00019: 25e317773f308e446cc84c503a6d1f85 {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 09:54:59.416345 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-f75b0311-c2ca-4c40-baf9-2dada74036c9 tempest-ProjectMemberTests33-2105464604 None] Calling eventlet.sleep(0) {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 09:54:59.599840 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-f75b0311-c2ca-4c40-baf9-2dada74036c9 tempest-ProjectMemberTests33-2105464604 None] Backing up chunk of data from volume. {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 09:54:59.842346 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-f75b0311-c2ca-4c40-baf9-2dada74036c9 tempest-ProjectMemberTests33-2105464604 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101319) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 09:54:59.842514 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-f75b0311-c2ca-4c40-baf9-2dada74036c9 tempest-ProjectMemberTests33-2105464604 None] About to put_object {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 09:54:59.940109 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-f75b0311-c2ca-4c40-baf9-2dada74036c9 tempest-ProjectMemberTests33-2105464604 None] backup MD5 for volume_a28b52f0-456d-4821-8de5-ec41566e1234/20260703095449/az_nova_backup_0254456b-0a66-4125-8e17-8e1f79f703fe-00020: 25e317773f308e446cc84c503a6d1f85 {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 09:54:59.940271 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-f75b0311-c2ca-4c40-baf9-2dada74036c9 tempest-ProjectMemberTests33-2105464604 None] Calling eventlet.sleep(0) {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 09:55:00.020189 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-f75b0311-c2ca-4c40-baf9-2dada74036c9 tempest-ProjectMemberTests33-2105464604 None] Backing up chunk of data from volume. {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 09:55:00.138833 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-f75b0311-c2ca-4c40-baf9-2dada74036c9 tempest-ProjectMemberTests33-2105464604 None] Compressed 25165824 bytes of data to 24470 bytes using zlib. {{(pid=101319) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 09:55:00.138975 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-f75b0311-c2ca-4c40-baf9-2dada74036c9 tempest-ProjectMemberTests33-2105464604 None] About to put_object {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 09:55:00.200378 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-f75b0311-c2ca-4c40-baf9-2dada74036c9 tempest-ProjectMemberTests33-2105464604 None] backup MD5 for volume_a28b52f0-456d-4821-8de5-ec41566e1234/20260703095449/az_nova_backup_0254456b-0a66-4125-8e17-8e1f79f703fe-00021: 77377273b0a4b61febdbf7bbf52b9db9 {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 09:55:00.200700 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-f75b0311-c2ca-4c40-baf9-2dada74036c9 tempest-ProjectMemberTests33-2105464604 None] Calling eventlet.sleep(0) {{(pid=101319) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 09:55:00.207291 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.driver [None req-f75b0311-c2ca-4c40-baf9-2dada74036c9 tempest-ProjectMemberTests33-2105464604 None] Getting metadata type 'volume-base-metadata' {{(pid=101319) _save_vol_base_meta /opt/stack/cinder/cinder/backup/driver.py:79}} Jul 03 09:55:00.213653 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.driver [None req-f75b0311-c2ca-4c40-baf9-2dada74036c9 tempest-ProjectMemberTests33-2105464604 None] Completed fetching metadata type 'volume-base-metadata' {{(pid=101319) _save_vol_base_meta /opt/stack/cinder/cinder/backup/driver.py:98}} Jul 03 09:55:00.213860 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.driver [None req-f75b0311-c2ca-4c40-baf9-2dada74036c9 tempest-ProjectMemberTests33-2105464604 None] Getting metadata type 'volume-metadata' {{(pid=101319) _save_vol_meta /opt/stack/cinder/cinder/backup/driver.py:109}} Jul 03 09:55:00.218008 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.driver [None req-f75b0311-c2ca-4c40-baf9-2dada74036c9 tempest-ProjectMemberTests33-2105464604 None] No metadata type 'volume-metadata' available {{(pid=101319) _save_vol_meta /opt/stack/cinder/cinder/backup/driver.py:123}} Jul 03 09:55:00.218165 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.driver [None req-f75b0311-c2ca-4c40-baf9-2dada74036c9 tempest-ProjectMemberTests33-2105464604 None] Getting metadata type 'volume-glance-metadata' {{(pid=101319) _save_vol_glance_meta /opt/stack/cinder/cinder/backup/driver.py:132}} Jul 03 09:55:00.221213 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.driver [None req-f75b0311-c2ca-4c40-baf9-2dada74036c9 tempest-ProjectMemberTests33-2105464604 None] No metadata type 'volume-glance-metadata' available {{(pid=101319) _save_vol_glance_meta /opt/stack/cinder/cinder/backup/driver.py:147}} Jul 03 09:55:00.221499 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-f75b0311-c2ca-4c40-baf9-2dada74036c9 tempest-ProjectMemberTests33-2105464604 None] _write_sha256file started, container name: volumebackups, sha256file filename: volume_a28b52f0-456d-4821-8de5-ec41566e1234/20260703095449/az_nova_backup_0254456b-0a66-4125-8e17-8e1f79f703fe_sha256file. {{(pid=101319) _write_sha256file /opt/stack/cinder/cinder/backup/chunkeddriver.py:299}} Jul 03 09:55:00.278324 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-f75b0311-c2ca-4c40-baf9-2dada74036c9 tempest-ProjectMemberTests33-2105464604 None] _write_sha256file finished. {{(pid=101319) _write_sha256file /opt/stack/cinder/cinder/backup/chunkeddriver.py:315}} Jul 03 09:55:00.279034 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-f75b0311-c2ca-4c40-baf9-2dada74036c9 tempest-ProjectMemberTests33-2105464604 None] _write_metadata started, container name: volumebackups, metadata filename: volume_a28b52f0-456d-4821-8de5-ec41566e1234/20260703095449/az_nova_backup_0254456b-0a66-4125-8e17-8e1f79f703fe_metadata. {{(pid=101319) _write_metadata /opt/stack/cinder/cinder/backup/chunkeddriver.py:276}} Jul 03 09:55:00.301512 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-f75b0311-c2ca-4c40-baf9-2dada74036c9 tempest-ProjectMemberTests33-2105464604 None] _write_metadata finished. Metadata: b'{\n "backup_description": null,\n "backup_id": "0254456b-0a66-4125-8e17-8e1f79f703fe",\n "backup_name": "tempest-type-Backup-81881469",\n "created_at": "2026-07-03 09:54:46+00:00",\n "objects": [\n {\n "volume_a28b52f0-456d-4821-8de5-ec41566e1234/20260703095449/az_nova_backup_0254456b-0a66-4125-8e17-8e1f79f703fe-00001": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 0\n }\n },\n {\n "volume_a28b52f0-456d-4821-8de5-ec41566e1234/20260703095449/az_nova_backup_0254456b-0a66-4125-8e17-8e1f79f703fe-00002": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 52428800\n }\n },\n {\n "volume_a28b52f0-456d-4821-8de5-ec41566e1234/20260703095449/az_nova_backup_0254456b-0a66-4125-8e17-8e1f79f703fe-00003": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 104857600\n }\n },\n {\n "volume_a28b52f0-456d-4821-8de5-ec41566e1234/20260703095449/az_nova_backup_0254456b-0a66-4125-8e17-8e1f79f703fe-00004": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 157286400\n }\n },\n {\n "volume_a28b52f0-456d-4821-8de5-ec41566e1234/20260703095449/az_nova_backup_0254456b-0a66-4125-8e17-8e1f79f703fe-00005": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 209715200\n }\n },\n {\n "volume_a28b52f0-456d-4821-8de5-ec41566e1234/20260703095449/az_nova_backup_0254456b-0a66-4125-8e17-8e1f79f703fe-00006": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 262144000\n }\n },\n {\n "volume_a28b52f0-456d-4821-8de5-ec41566e1234/20260703095449/az_nova_backup_0254456b-0a66-4125-8e17-8e1f79f703fe-00007": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 314572800\n }\n },\n {\n "volume_a28b52f0-456d-4821-8de5-ec41566e1234/20260703095449/az_nova_backup_0254456b-0a66-4125-8e17-8e1f79f703fe-00008": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 367001600\n }\n },\n {\n "volume_a28b52f0-456d-4821-8de5-ec41566e1234/20260703095449/az_nova_backup_0254456b-0a66-4125-8e17-8e1f79f703fe-00009": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 419430400\n }\n },\n {\n "volume_a28b52f0-456d-4821-8de5-ec41566e1234/20260703095449/az_nova_backup_0254456b-0a66-4125-8e17-8e1f79f703fe-00010": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 471859200\n }\n },\n {\n "volume_a28b52f0-456d-4821-8de5-ec41566e1234/20260703095449/az_nova_backup_0254456b-0a66-4125-8e17-8e1f79f703fe-00011": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 524288000\n }\n },\n {\n "volume_a28b52f0-456d-4821-8de5-ec41566e1234/20260703095449/az_nova_backup_0254456b-0a66-4125-8e17-8e1f79f703fe-00012": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 576716800\n }\n },\n {\n "volume_a28b52f0-456d-4821-8de5-ec41566e1234/20260703095449/az_nova_backup_0254456b-0a66-4125-8e17-8e1f79f703fe-00013": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 629145600\n }\n },\n {\n "volume_a28b52f0-456d-4821-8de5-ec41566e1234/20260703095449/az_nova_backup_0254456b-0a66-4125-8e17-8e1f79f703fe-00014": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 681574400\n }\n },\n {\n "volume_a28b52f0-456d-4821-8de5-ec41566e1234/20260703095449/az_nova_backup_0254456b-0a66-4125-8e17-8e1f79f703fe-00015": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 734003200\n }\n },\n {\n "volume_a28b52f0-456d-4821-8de5-ec41566e1234/20260703095449/az_nova_backup_0254456b-0a66-4125-8e17-8e1f79f703fe-00016": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 786432000\n }\n },\n {\n "volume_a28b52f0-456d-4821-8de5-ec41566e1234/20260703095449/az_nova_backup_0254456b-0a66-4125-8e17-8e1f79f703fe-00017": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 838860800\n }\n },\n {\n "volume_a28b52f0-456d-4821-8de5-ec41566e1234/20260703095449/az_nova_backup_0254456b-0a66-4125-8e17-8e1f79f703fe-00018": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 891289600\n }\n },\n {\n "volume_a28b52f0-456d-4821-8de5-ec41566e1234/20260703095449/az_nova_backup_0254456b-0a66-4125-8e17-8e1f79f703fe-00019": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 943718400\n }\n },\n {\n "volume_a28b52f0-456d-4821-8de5-ec41566e1234/20260703095449/az_nova_backup_0254456b-0a66-4125-8e17-8e1f79f703fe-00020": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 996147200\n }\n },\n {\n "volume_a28b52f0-456d-4821-8de5-ec41566e1234/20260703095449/az_nova_backup_0254456b-0a66-4125-8e17-8e1f79f703fe-00021": {\n "compression": "zlib",\n "length": 25165824,\n "md5": "77377273b0a4b61febdbf7bbf52b9db9",\n "offset": 1048576000\n }\n }\n ],\n "parent_id": null,\n "version": "1.0.0",\n "volume_id": "a28b52f0-456d-4821-8de5-ec41566e1234",\n "volume_meta": "{\\"version\\": 2, \\"volume-base-metadata\\": {\\"id\\": \\"a28b52f0-456d-4821-8de5-ec41566e1234\\", \\"_name_id\\": null, \\"use_quota\\": true, \\"ec2_id\\": null, \\"user_id\\": \\"87abbb474f8a4baf840fcfdf286ff94e\\", \\"project_id\\": \\"e0b6e59b911e40b3acac38afb1f81e3a\\", \\"snapshot_id\\": null, \\"cluster_name\\": null, \\"host\\": \\"np0000004400@storpool#default\\", \\"size\\": 1, \\"availability_zone\\": \\"nova\\", \\"status\\": \\"backing-up\\", \\"attach_status\\": \\"detached\\", \\"migration_status\\": null, \\"scheduled_at\\": \\"2026-07-03T09:54:45.000000\\", \\"launched_at\\": \\"2026-07-03T09:54:45.000000\\", \\"terminated_at\\": null, \\"display_name\\": \\"tempest-VolumeV3RbacBaseTests-Volume-1618091047\\", \\"display_description\\": null, \\"provider_location\\": null, \\"provider_auth\\": null, \\"provider_geometry\\": null, \\"provider_id\\": null, \\"volume_type_id\\": \\"03e13fe6-0e30-4803-ace0-725d38e6dc24\\", \\"source_volid\\": null, \\"encryption_key_id\\": null, \\"consistencygroup_id\\": null, \\"group_id\\": null, \\"bootable\\": false, \\"multiattach\\": false, \\"replication_status\\": null, \\"replication_extended_status\\": null, \\"replication_driver_data\\": null, \\"previous_status\\": \\"available\\", \\"service_uuid\\": \\"6d4b0e79-fefe-4744-b25f-34be05095200\\", \\"shared_targets\\": true, \\"deleted_at\\": null, \\"deleted\\": false, \\"created_at\\": \\"2026-07-03T09:54:45.000000\\", \\"updated_at\\": \\"2026-07-03T09:54:46.000000\\"}}"\n}'. {{(pid=101319) _write_metadata /opt/stack/cinder/cinder/backup/chunkeddriver.py:295}} Jul 03 09:55:00.306160 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-f75b0311-c2ca-4c40-baf9-2dada74036c9 tempest-ProjectMemberTests33-2105464604 None] backup 0254456b-0a66-4125-8e17-8e1f79f703fe finished. {{(pid=101319) _finalize_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:462}} Jul 03 09:55:00.427490 np0000004400 cinder-backup[101319]: DEBUG oslo_concurrency.processutils [None req-f75b0311-c2ca-4c40-baf9-2dada74036c9 tempest-ProjectMemberTests33-2105464604 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chown 0 /dev/sdb {{(pid=101319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 09:55:00.444575 np0000004400 sudo[157026]: stack : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chown 0 /dev/sdb Jul 03 09:55:00.445279 np0000004400 sudo[157026]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1002) Jul 03 09:55:00.733445 np0000004400 sudo[157026]: pam_unix(sudo:session): session closed for user root Jul 03 09:55:00.735422 np0000004400 cinder-backup[101319]: DEBUG oslo_concurrency.processutils [None req-f75b0311-c2ca-4c40-baf9-2dada74036c9 tempest-ProjectMemberTests33-2105464604 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chown 0 /dev/sdb" returned: 0 in 0.308s {{(pid=101319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 09:55:00.736107 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-f75b0311-c2ca-4c40-baf9-2dada74036c9 tempest-ProjectMemberTests33-2105464604 None] ==> disconnect_volume: call "{'args': (, {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-a28b52f0-456d-4821-8de5-ec41566e1234', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'a28b52f0-456d-4821-8de5-ec41566e1234', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': False}, {'type': 'block', 'scsi_wwn': 'SStorPool_iSCSI_DISK_1034578903445799240', 'path': '/dev/sdb'}), 'kwargs': {'force': True, 'ignore_errors': True}}" {{(pid=101319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}} Jul 03 09:55:00.736294 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.base [None req-f75b0311-c2ca-4c40-baf9-2dada74036c9 tempest-ProjectMemberTests33-2105464604 None] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=101319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jul 03 09:55:00.948689 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.base [None req-f75b0311-c2ca-4c40-baf9-2dada74036c9 tempest-ProjectMemberTests33-2105464604 None] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.212s {{(pid=101319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jul 03 09:55:00.949240 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-f75b0311-c2ca-4c40-baf9-2dada74036c9 tempest-ProjectMemberTests33-2105464604 None] _get_connection_devices called with parameters: connection_properties={'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-a28b52f0-456d-4821-8de5-ec41566e1234', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'a28b52f0-456d-4821-8de5-ec41566e1234', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': False}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=101319) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:847}} Jul 03 09:55:00.960667 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-f75b0311-c2ca-4c40-baf9-2dada74036c9 tempest-ProjectMemberTests33-2105464604 None] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS: Jul 03 09:55:00.960667 np0000004400 cinder-backup[101319]: No targets found. Jul 03 09:55:00.960667 np0000004400 cinder-backup[101319]: iSNS: Jul 03 09:55:00.960667 np0000004400 cinder-backup[101319]: No targets found. Jul 03 09:55:00.960667 np0000004400 cinder-backup[101319]: STATIC: Jul 03 09:55:00.960667 np0000004400 cinder-backup[101319]: Target: iqn.2023-03.storpool.com:os--volume-a28b52f0-456d-4821-8de5-ec41566e1234 Jul 03 09:55:00.960667 np0000004400 cinder-backup[101319]: Portal: 192.168.40.100:3260,-1 Jul 03 09:55:00.960667 np0000004400 cinder-backup[101319]: Iface Name: default Jul 03 09:55:00.960667 np0000004400 cinder-backup[101319]: FIRMWARE: Jul 03 09:55:00.960667 np0000004400 cinder-backup[101319]: No targets found. Jul 03 09:55:00.960667 np0000004400 cinder-backup[101319]: stderr= {{(pid=101319) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jul 03 09:55:00.961008 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-f75b0311-c2ca-4c40-baf9-2dada74036c9 tempest-ProjectMemberTests33-2105464604 None] Regex to get portals from discoverydb: ^SENDTARGETS: Jul 03 09:55:00.961008 np0000004400 cinder-backup[101319]: .*?^DiscoveryAddress: 192.168.40.100,3260.*? Jul 03 09:55:00.961008 np0000004400 cinder-backup[101319]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=101319) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:390}} Jul 03 09:55:00.961137 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-f75b0311-c2ca-4c40-baf9-2dada74036c9 tempest-ProjectMemberTests33-2105464604 None] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-a28b52f0-456d-4821-8de5-ec41566e1234', 0)] {{(pid=101319) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:858}} Jul 03 09:55:00.980568 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-f75b0311-c2ca-4c40-baf9-2dada74036c9 tempest-ProjectMemberTests33-2105464604 None] iscsiadm ('-m', 'session'): stdout=tcp: [217] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a28b52f0-456d-4821-8de5-ec41566e1234 (non-flash) Jul 03 09:55:00.980568 np0000004400 cinder-backup[101319]: stderr= {{(pid=101319) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jul 03 09:55:00.980706 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-f75b0311-c2ca-4c40-baf9-2dada74036c9 tempest-ProjectMemberTests33-2105464604 None] iscsi session list stdout=tcp: [217] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a28b52f0-456d-4821-8de5-ec41566e1234 (non-flash) Jul 03 09:55:00.980706 np0000004400 cinder-backup[101319]: stderr= {{(pid=101319) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jul 03 09:55:00.980838 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-f75b0311-c2ca-4c40-baf9-2dada74036c9 tempest-ProjectMemberTests33-2105464604 None] Sessions list: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-a28b52f0-456d-4821-8de5-ec41566e1234', '217')] {{(pid=101319) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:866}} Jul 03 09:55:00.980970 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-f75b0311-c2ca-4c40-baf9-2dada74036c9 tempest-ProjectMemberTests33-2105464604 None] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-a28b52f0-456d-4821-8de5-ec41566e1234, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-a28b52f0-456d-4821-8de5-ec41566e1234', '217')] {{(pid=101319) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}} Jul 03 09:55:00.981735 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-f75b0311-c2ca-4c40-baf9-2dada74036c9 tempest-ProjectMemberTests33-2105464604 None] Resulting device map defaultdict(. at 0x7e76e757efc0>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-a28b52f0-456d-4821-8de5-ec41566e1234'): ({'sdb'}, set())}) {{(pid=101319) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:912}} Jul 03 09:55:00.982113 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.linuxscsi [None req-f75b0311-c2ca-4c40-baf9-2dada74036c9 tempest-ProjectMemberTests33-2105464604 None] Removing single pathed devices sdb {{(pid=101319) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}} Jul 03 09:55:00.992432 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.linuxscsi [None req-f75b0311-c2ca-4c40-baf9-2dada74036c9 tempest-ProjectMemberTests33-2105464604 None] Flushing IO for device /dev/sdb {{(pid=101319) flush_device_io /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:461}} Jul 03 09:55:01.000393 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.linuxscsi [None req-f75b0311-c2ca-4c40-baf9-2dada74036c9 tempest-ProjectMemberTests33-2105464604 None] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=101319) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}} Jul 03 09:55:01.038018 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.linuxscsi [None req-f75b0311-c2ca-4c40-baf9-2dada74036c9 tempest-ProjectMemberTests33-2105464604 None] Checking to see if SCSI volumes sdb have been removed. {{(pid=101319) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}} Jul 03 09:55:01.038242 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.linuxscsi [None req-f75b0311-c2ca-4c40-baf9-2dada74036c9 tempest-ProjectMemberTests33-2105464604 None] SCSI volumes sdb have been removed. {{(pid=101319) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}} Jul 03 09:55:01.039191 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.linuxscsi [None req-f75b0311-c2ca-4c40-baf9-2dada74036c9 tempest-ProjectMemberTests33-2105464604 None] Checking to see if device paths {'sdb'} are still under multipathd monitoring {{(pid=101319) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}} Jul 03 09:55:01.048900 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.linuxscsi [None req-f75b0311-c2ca-4c40-baf9-2dada74036c9 tempest-ProjectMemberTests33-2105464604 None] Device paths {'sdb'} have been removed from multipathd monitoring. {{(pid=101319) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}} Jul 03 09:55:01.049212 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-f75b0311-c2ca-4c40-baf9-2dada74036c9 tempest-ProjectMemberTests33-2105464604 None] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-a28b52f0-456d-4821-8de5-ec41566e1234')] {{(pid=101319) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1225}} Jul 03 09:55:01.058300 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-f75b0311-c2ca-4c40-baf9-2dada74036c9 tempest-ProjectMemberTests33-2105464604 None] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=101319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 03 09:55:01.083344 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-f75b0311-c2ca-4c40-baf9-2dada74036c9 tempest-ProjectMemberTests33-2105464604 None] iscsiadm ('--logout',): stdout=Logging out of session [sid: 217, target: iqn.2023-03.storpool.com:os--volume-a28b52f0-456d-4821-8de5-ec41566e1234, portal: 192.168.40.100,3260] Jul 03 09:55:01.083344 np0000004400 cinder-backup[101319]: Logout of [sid: 217, target: iqn.2023-03.storpool.com:os--volume-a28b52f0-456d-4821-8de5-ec41566e1234, portal: 192.168.40.100,3260] successful. Jul 03 09:55:01.083344 np0000004400 cinder-backup[101319]: stderr= {{(pid=101319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 03 09:55:01.093367 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-f75b0311-c2ca-4c40-baf9-2dada74036c9 tempest-ProjectMemberTests33-2105464604 None] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=101319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 03 09:55:01.093647 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.base [None req-f75b0311-c2ca-4c40-baf9-2dada74036c9 tempest-ProjectMemberTests33-2105464604 None] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.145s {{(pid=101319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jul 03 09:55:01.093783 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-f75b0311-c2ca-4c40-baf9-2dada74036c9 tempest-ProjectMemberTests33-2105464604 None] <== disconnect_volume: return (357ms) None {{(pid=101319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}} Jul 03 09:55:02.101682 np0000004400 cinder-backup[101319]: DEBUG dbcounter [-] [101319] Writing DB stats cinder:SELECT=237,cinder:UPDATE=79,cinder:INSERT=12 {{(pid=101319) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 03 09:55:02.112894 np0000004400 cinder-backup[101319]: INFO cinder.backup.manager [None req-f75b0311-c2ca-4c40-baf9-2dada74036c9 tempest-ProjectMemberTests33-2105464604 None] Create backup finished. backup: 0254456b-0a66-4125-8e17-8e1f79f703fe. Jul 03 09:55:05.035341 np0000004400 cinder-backup[101319]: INFO cinder.backup.manager [None req-2d411271-819e-4ff8-9ff7-19c4dc43a294 tempest-ProjectMemberTests33-2105464604 None] Restore backup started, backup: 0871942a-e198-4230-a099-29a52a21849b volume: 0f290778-6281-48b9-8149-decd4057b72c. Jul 03 09:55:05.048245 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.drivers.swift [None req-2d411271-819e-4ff8-9ff7-19c4dc43a294 tempest-ProjectMemberTests33-2105464604 None] Using swift URL https://10.4.3.95:8080/v1/AUTH_e0b6e59b911e40b3acac38afb1f81e3a {{(pid=101319) initialize /opt/stack/cinder/cinder/backup/drivers/swift.py:300}} Jul 03 09:55:05.048783 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.drivers.swift [None req-2d411271-819e-4ff8-9ff7-19c4dc43a294 tempest-ProjectMemberTests33-2105464604 None] Connect to https://10.4.3.95:8080/v1/AUTH_ in "per_user" mode {{(pid=101319) initialize /opt/stack/cinder/cinder/backup/drivers/swift.py:301}} Jul 03 09:55:05.049082 np0000004400 cinder-backup[101319]: DEBUG os_brick.utils [None req-2d411271-819e-4ff8-9ff7-19c4dc43a294 tempest-ProjectMemberTests33-2105464604 None] ==> get_connector_properties: call "{'root_helper': 'sudo cinder-rootwrap /etc/cinder/rootwrap.conf', 'my_ip': '10.4.3.95', 'multipath': False, 'enforce_multipath': False, 'host': None, 'execute': None}" {{(pid=101319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}} Jul 03 09:55:05.059782 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.scaleio [None req-2d411271-819e-4ff8-9ff7-19c4dc43a294 tempest-ProjectMemberTests33-2105464604 None] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=101319) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}} Jul 03 09:55:05.079029 np0000004400 cinder-backup[101319]: DEBUG oslo_concurrency.processutils [None req-2d411271-819e-4ff8-9ff7-19c4dc43a294 tempest-ProjectMemberTests33-2105464604 None] Running cmd (subprocess): nvme version {{(pid=101319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 09:55:05.090656 np0000004400 cinder-backup[101319]: DEBUG oslo_concurrency.processutils [None req-2d411271-819e-4ff8-9ff7-19c4dc43a294 tempest-ProjectMemberTests33-2105464604 None] 'nvme version' failed. Not Retrying. {{(pid=101319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 03 09:55:05.090890 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.nvmeof [None req-2d411271-819e-4ff8-9ff7-19c4dc43a294 tempest-ProjectMemberTests33-2105464604 None] nvme not present on system {{(pid=101319) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}} Jul 03 09:55:05.098296 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.lightos [None req-2d411271-819e-4ff8-9ff7-19c4dc43a294 tempest-ProjectMemberTests33-2105464604 None] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=101319) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}} Jul 03 09:55:05.099140 np0000004400 cinder-backup[101319]: INFO os_brick.initiator.connectors.lightos [None req-2d411271-819e-4ff8-9ff7-19c4dc43a294 tempest-ProjectMemberTests33-2105464604 None] Current host hostNQN and IP(s) are ['10.4.3.95', 'fe80::f816:3eff:fe47:268c', '192.168.40.6', 'fe80::f816:3eff:febf:7be2', '192.168.50.6', 'fe80::f816:3eff:fe99:8914', '192.168.10.6', 'fe80::f816:3eff:fe2f:e696', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::bc9d:84ff:fec2:6b49'] Jul 03 09:55:05.099281 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.lightos [None req-2d411271-819e-4ff8-9ff7-19c4dc43a294 tempest-ProjectMemberTests33-2105464604 None] LIGHTOS: did not find dsc, continuing anyway. {{(pid=101319) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}} Jul 03 09:55:05.099413 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.lightos [None req-2d411271-819e-4ff8-9ff7-19c4dc43a294 tempest-ProjectMemberTests33-2105464604 None] LIGHTOS: no hostnqn found. {{(pid=101319) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}} Jul 03 09:55:05.099664 np0000004400 cinder-backup[101319]: DEBUG os_brick.utils [None req-2d411271-819e-4ff8-9ff7-19c4dc43a294 tempest-ProjectMemberTests33-2105464604 None] <== get_connector_properties: return (49ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.95', 'host': 'np0000004400', 'multipath': False, 'enforce_multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:ae7e5bb0ebe6', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': '6b284368-d0ba-4d18-af6f-4998d3955c52', 'nvme_native_multipath': False} {{(pid=101319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}} Jul 03 09:55:06.107220 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connector [None req-2d411271-819e-4ff8-9ff7-19c4dc43a294 tempest-ProjectMemberTests33-2105464604 None] Factory for iscsi on None {{(pid=101319) factory /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connector.py:243}} Jul 03 09:55:06.107621 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-2d411271-819e-4ff8-9ff7-19c4dc43a294 tempest-ProjectMemberTests33-2105464604 None] ==> connect_volume: call "{'self': , 'connection_properties': {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-0f290778-6281-48b9-8149-decd4057b72c', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '0f290778-6281-48b9-8149-decd4057b72c', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': False}}" {{(pid=101319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}} Jul 03 09:55:06.107802 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.base [None req-2d411271-819e-4ff8-9ff7-19c4dc43a294 tempest-ProjectMemberTests33-2105464604 None] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=101319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jul 03 09:55:06.108275 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.base [None req-2d411271-819e-4ff8-9ff7-19c4dc43a294 tempest-ProjectMemberTests33-2105464604 None] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.000s {{(pid=101319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jul 03 09:55:06.108501 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.base [None req-2d411271-819e-4ff8-9ff7-19c4dc43a294 tempest-ProjectMemberTests33-2105464604 None] Connection properties {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-0f290778-6281-48b9-8149-decd4057b72c', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '0f290778-6281-48b9-8149-decd4057b72c', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': False} {{(pid=101319) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}} Jul 03 09:55:06.121529 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.base [None req-2d411271-819e-4ff8-9ff7-19c4dc43a294 tempest-ProjectMemberTests33-2105464604 None] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-0f290778-6281-48b9-8149-decd4057b72c" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=101319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jul 03 09:55:06.121935 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.base [None req-2d411271-819e-4ff8-9ff7-19c4dc43a294 tempest-ProjectMemberTests33-2105464604 None] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-0f290778-6281-48b9-8149-decd4057b72c" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=101319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jul 03 09:55:06.122190 np0000004400 cinder-backup[101319]: INFO os_brick.initiator.connectors.iscsi [None req-2d411271-819e-4ff8-9ff7-19c4dc43a294 tempest-ProjectMemberTests33-2105464604 None] Trying to connect to iSCSI portal 192.168.40.100:3260 Jul 03 09:55:06.132088 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-2d411271-819e-4ff8-9ff7-19c4dc43a294 tempest-ProjectMemberTests33-2105464604 None] iscsiadm (): stdout= stderr=iscsiadm: No records found Jul 03 09:55:06.132088 np0000004400 cinder-backup[101319]: {{(pid=101319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 03 09:55:06.142569 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-2d411271-819e-4ff8-9ff7-19c4dc43a294 tempest-ProjectMemberTests33-2105464604 None] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-0f290778-6281-48b9-8149-decd4057b72c] added Jul 03 09:55:06.142569 np0000004400 cinder-backup[101319]: stderr=iscsiadm: Config file line 363 does not have value Jul 03 09:55:06.142569 np0000004400 cinder-backup[101319]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs' Jul 03 09:55:06.142569 np0000004400 cinder-backup[101319]: iscsiadm: Config file line 363 does not have value Jul 03 09:55:06.142569 np0000004400 cinder-backup[101319]: iscsiadm: Config file line 363 does not have value Jul 03 09:55:06.142569 np0000004400 cinder-backup[101319]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs' Jul 03 09:55:06.142569 np0000004400 cinder-backup[101319]: {{(pid=101319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 03 09:55:06.142844 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-2d411271-819e-4ff8-9ff7-19c4dc43a294 tempest-ProjectMemberTests33-2105464604 None] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=101319) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}} Jul 03 09:55:06.143220 np0000004400 cinder-backup[101319]: DEBUG os_brick.utils [None req-2d411271-819e-4ff8-9ff7-19c4dc43a294 tempest-ProjectMemberTests33-2105464604 None] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0209(s), this was the 1st time calling it. {{(pid=101319) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}} Jul 03 09:55:06.143481 np0000004400 cinder-backup[101319]: DEBUG os_brick.utils [None req-2d411271-819e-4ff8-9ff7-19c4dc43a294 tempest-ProjectMemberTests33-2105464604 None] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=101319) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}} Jul 03 09:55:07.144061 np0000004400 cinder-backup[101319]: INFO os_brick.initiator.connectors.iscsi [None req-2d411271-819e-4ff8-9ff7-19c4dc43a294 tempest-ProjectMemberTests33-2105464604 None] Trying to connect to iSCSI portal 192.168.40.100:3260 Jul 03 09:55:07.154044 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-2d411271-819e-4ff8-9ff7-19c4dc43a294 tempest-ProjectMemberTests33-2105464604 None] iscsiadm (): stdout=# BEGIN RECORD 2.1.9 Jul 03 09:55:07.154044 np0000004400 cinder-backup[101319]: node.name = iqn.2023-03.storpool.com:os--volume-0f290778-6281-48b9-8149-decd4057b72c Jul 03 09:55:07.154044 np0000004400 cinder-backup[101319]: node.tpgt = -1 Jul 03 09:55:07.154044 np0000004400 cinder-backup[101319]: node.startup = manual Jul 03 09:55:07.154044 np0000004400 cinder-backup[101319]: node.leading_login = No Jul 03 09:55:07.154044 np0000004400 cinder-backup[101319]: iface.iscsi_ifacename = default Jul 03 09:55:07.154044 np0000004400 cinder-backup[101319]: iface.net_ifacename = Jul 03 09:55:07.154044 np0000004400 cinder-backup[101319]: iface.ipaddress = Jul 03 09:55:07.154044 np0000004400 cinder-backup[101319]: iface.prefix_len = 0 Jul 03 09:55:07.154044 np0000004400 cinder-backup[101319]: iface.hwaddress = Jul 03 09:55:07.154044 np0000004400 cinder-backup[101319]: iface.transport_name = tcp Jul 03 09:55:07.154044 np0000004400 cinder-backup[101319]: iface.initiatorname = Jul 03 09:55:07.154044 np0000004400 cinder-backup[101319]: iface.state = Jul 03 09:55:07.154044 np0000004400 cinder-backup[101319]: iface.vlan_id = 0 Jul 03 09:55:07.154044 np0000004400 cinder-backup[101319]: iface.vlan_priority = 0 Jul 03 09:55:07.154044 np0000004400 cinder-backup[101319]: iface.vlan_state = Jul 03 09:55:07.154044 np0000004400 cinder-backup[101319]: iface.iface_num = 0 Jul 03 09:55:07.154044 np0000004400 cinder-backup[101319]: iface.mtu = 0 Jul 03 09:55:07.154044 np0000004400 cinder-backup[101319]: iface.port = 0 Jul 03 09:55:07.154044 np0000004400 cinder-backup[101319]: iface.bootproto = Jul 03 09:55:07.154044 np0000004400 cinder-backup[101319]: iface.subnet_mask = Jul 03 09:55:07.154044 np0000004400 cinder-backup[101319]: iface.gateway = Jul 03 09:55:07.154044 np0000004400 cinder-backup[101319]: iface.dhcp_alt_client_id_state = Jul 03 09:55:07.154044 np0000004400 cinder-backup[101319]: iface.dhcp_alt_client_id = Jul 03 09:55:07.154044 np0000004400 cinder-backup[101319]: iface.dhcp_dns = Jul 03 09:55:07.154044 np0000004400 cinder-backup[101319]: iface.dhcp_learn_iqn = Jul 03 09:55:07.154044 np0000004400 cinder-backup[101319]: iface.dhcp_req_vendor_id_state = Jul 03 09:55:07.154044 np0000004400 cinder-backup[101319]: iface.dhcp_vendor_id_state = Jul 03 09:55:07.154044 np0000004400 cinder-backup[101319]: iface.dhcp_vendor_id = Jul 03 09:55:07.154044 np0000004400 cinder-backup[101319]: iface.dhcp_slp_da = Jul 03 09:55:07.154044 np0000004400 cinder-backup[101319]: iface.fragmentation = Jul 03 09:55:07.154044 np0000004400 cinder-backup[101319]: iface.gratuitous_arp = Jul 03 09:55:07.154044 np0000004400 cinder-backup[101319]: iface.incoming_forwarding = Jul 03 09:55:07.154044 np0000004400 cinder-backup[101319]: iface.tos_state = Jul 03 09:55:07.154044 np0000004400 cinder-backup[101319]: iface.tos = 0 Jul 03 09:55:07.154044 np0000004400 cinder-backup[101319]: iface.ttl = 0 Jul 03 09:55:07.154044 np0000004400 cinder-backup[101319]: iface.delayed_ack = Jul 03 09:55:07.154044 np0000004400 cinder-backup[101319]: iface.tcp_nagle = Jul 03 09:55:07.154044 np0000004400 cinder-backup[101319]: iface.tcp_wsf_state = Jul 03 09:55:07.154044 np0000004400 cinder-backup[101319]: iface.tcp_wsf = 0 Jul 03 09:55:07.154044 np0000004400 cinder-backup[101319]: iface.tcp_timer_scale = 0 Jul 03 09:55:07.154044 np0000004400 cinder-backup[101319]: iface.tcp_timestamp = Jul 03 09:55:07.154044 np0000004400 cinder-backup[101319]: iface.redirect = Jul 03 09:55:07.154044 np0000004400 cinder-backup[101319]: iface.def_task_mgmt_timeout = 0 Jul 03 09:55:07.154044 np0000004400 cinder-backup[101319]: iface.header_digest = Jul 03 09:55:07.154044 np0000004400 cinder-backup[101319]: iface.data_digest = Jul 03 09:55:07.154044 np0000004400 cinder-backup[101319]: iface.immediate_data = Jul 03 09:55:07.154044 np0000004400 cinder-backup[101319]: iface.initial_r2t = Jul 03 09:55:07.154044 np0000004400 cinder-backup[101319]: iface.data_seq_inorder = Jul 03 09:55:07.154044 np0000004400 cinder-backup[101319]: iface.data_pdu_inorder = Jul 03 09:55:07.154044 np0000004400 cinder-backup[101319]: iface.erl = 0 Jul 03 09:55:07.154044 np0000004400 cinder-backup[101319]: iface.max_receive_data_len = 0 Jul 03 09:55:07.154044 np0000004400 cinder-backup[101319]: iface.first_burst_len = 0 Jul 03 09:55:07.154044 np0000004400 cinder-backup[101319]: iface.max_outstanding_r2t = 0 Jul 03 09:55:07.154044 np0000004400 cinder-backup[101319]: iface.max_burst_len = 0 Jul 03 09:55:07.154044 np0000004400 cinder-backup[101319]: iface.chap_auth = Jul 03 09:55:07.154044 np0000004400 cinder-backup[101319]: iface.bidi_chap = Jul 03 09:55:07.154044 np0000004400 cinder-backup[101319]: iface.strict_login_compliance = Jul 03 09:55:07.154044 np0000004400 cinder-backup[101319]: iface.discovery_auth = Jul 03 09:55:07.154044 np0000004400 cinder-backup[101319]: iface.discovery_logout = Jul 03 09:55:07.154044 np0000004400 cinder-backup[101319]: node.discovery_address = Jul 03 09:55:07.154044 np0000004400 cinder-backup[101319]: node.discovery_port = 0 Jul 03 09:55:07.154044 np0000004400 cinder-backup[101319]: node.discovery_type = fw Jul 03 09:55:07.154044 np0000004400 cinder-backup[101319]: node.session.initial_cmdsn = 0 Jul 03 09:55:07.154044 np0000004400 cinder-backup[101319]: node.session.initial_login_retry_max = 8 Jul 03 09:55:07.154044 np0000004400 cinder-backup[101319]: node.session.xmit_thread_priority = 0 Jul 03 09:55:07.154044 np0000004400 cinder-backup[101319]: node.session.cmds_max = 128 Jul 03 09:55:07.154044 np0000004400 cinder-backup[101319]: node.session.queue_depth = 32 Jul 03 09:55:07.154044 np0000004400 cinder-backup[101319]: node.session.nr_sessions = 1 Jul 03 09:55:07.154044 np0000004400 cinder-backup[101319]: node.session.auth.authmethod = None Jul 03 09:55:07.154044 np0000004400 cinder-backup[101319]: node.session.auth.username = Jul 03 09:55:07.154044 np0000004400 cinder-backup[101319]: node.session.auth.password = *** Jul 03 09:55:07.154044 np0000004400 cinder-backup[101319]: node.session.auth.username_in = Jul 03 09:55:07.154044 np0000004400 cinder-backup[101319]: node.session.auth.password_in = Jul 03 09:55:07.154044 np0000004400 cinder-backup[101319]: node.session.auth.chap_algs = SHA256 Jul 03 09:55:07.154044 np0000004400 cinder-backup[101319]: node.session.timeo.replacement_timeout = 120 Jul 03 09:55:07.154044 np0000004400 cinder-backup[101319]: node.session.err_timeo.abort_timeout = 15 Jul 03 09:55:07.154044 np0000004400 cinder-backup[101319]: node.session.err_timeo.lu_reset_timeout = 30 Jul 03 09:55:07.154044 np0000004400 cinder-backup[101319]: node.session.err_timeo.tgt_reset_timeout = 30 Jul 03 09:55:07.154044 np0000004400 cinder-backup[101319]: node.session.err_timeo.host_reset_timeout = 60 Jul 03 09:55:07.154044 np0000004400 cinder-backup[101319]: node.session.iscsi.FastAbort = Yes Jul 03 09:55:07.154044 np0000004400 cinder-backup[101319]: node.session.iscsi.InitialR2T = No Jul 03 09:55:07.154044 np0000004400 cinder-backup[101319]: node.session.iscsi.ImmediateData = Yes Jul 03 09:55:07.154044 np0000004400 cinder-backup[101319]: node.session.iscsi.FirstBurstLength = 262144 Jul 03 09:55:07.154044 np0000004400 cinder-backup[101319]: node.session.iscsi.MaxBurstLength = 16776192 Jul 03 09:55:07.154044 np0000004400 cinder-backup[101319]: node.session.iscsi.DefaultTime2Retain = 0 Jul 03 09:55:07.154044 np0000004400 cinder-backup[101319]: node.session.iscsi.DefaultTime2Wait = 2 Jul 03 09:55:07.154044 np0000004400 cinder-backup[101319]: node.session.iscsi.MaxConnections = 1 Jul 03 09:55:07.154044 np0000004400 cinder-backup[101319]: node.session.iscsi.MaxOutstandingR2T = 1 Jul 03 09:55:07.154044 np0000004400 cinder-backup[101319]: node.session.iscsi.ERL = 0 Jul 03 09:55:07.154044 np0000004400 cinder-backup[101319]: node.session.scan = auto Jul 03 09:55:07.154044 np0000004400 cinder-backup[101319]: node.session.reopen_max = 0 Jul 03 09:55:07.154044 np0000004400 cinder-backup[101319]: node.conn[0].address = 192.168.40.100 Jul 03 09:55:07.154044 np0000004400 cinder-backup[101319]: node.conn[0].port = 3260 Jul 03 09:55:07.154044 np0000004400 cinder-backup[101319]: node.conn[0].startup = manual Jul 03 09:55:07.154044 np0000004400 cinder-backup[101319]: node.conn[0].tcp.window_size = 524288 Jul 03 09:55:07.154044 np0000004400 cinder-backup[101319]: node.conn[0].tcp.type_of_service = 0 Jul 03 09:55:07.154044 np0000004400 cinder-backup[101319]: node.conn[0].timeo.logout_timeout = 15 Jul 03 09:55:07.154044 np0000004400 cinder-backup[101319]: node.conn[0].timeo.login_timeout = 15 Jul 03 09:55:07.154044 np0000004400 cinder-backup[101319]: node.conn[0].timeo.auth_timeout = 45 Jul 03 09:55:07.154044 np0000004400 cinder-backup[101319]: node.conn[0].timeo.noop_out_interval = 5 Jul 03 09:55:07.154044 np0000004400 cinder-backup[101319]: node.conn[0].timeo.noop_out_timeout = 5 Jul 03 09:55:07.154044 np0000004400 cinder-backup[101319]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0 Jul 03 09:55:07.154044 np0000004400 cinder-backup[101319]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144 Jul 03 09:55:07.154044 np0000004400 cinder-backup[101319]: node.conn[0].iscsi.HeaderDigest = None Jul 03 09:55:07.154044 np0000004400 cinder-backup[101319]: node.conn[0].iscsi.DataDigest = None Jul 03 09:55:07.154044 np0000004400 cinder-backup[101319]: node.conn[0].iscsi.IFMarker = No Jul 03 09:55:07.154044 np0000004400 cinder-backup[101319]: node.conn[0].iscsi.OFMarker = No Jul 03 09:55:07.154044 np0000004400 cinder-backup[101319]: # END RECORD Jul 03 09:55:07.154044 np0000004400 cinder-backup[101319]: stderr= {{(pid=101319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 03 09:55:07.163873 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-2d411271-819e-4ff8-9ff7-19c4dc43a294 tempest-ProjectMemberTests33-2105464604 None] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=101319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 03 09:55:07.172608 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-2d411271-819e-4ff8-9ff7-19c4dc43a294 tempest-ProjectMemberTests33-2105464604 None] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions. Jul 03 09:55:07.172608 np0000004400 cinder-backup[101319]: {{(pid=101319) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jul 03 09:55:07.172786 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-2d411271-819e-4ff8-9ff7-19c4dc43a294 tempest-ProjectMemberTests33-2105464604 None] iscsi session list stdout= stderr=iscsiadm: No active sessions. Jul 03 09:55:07.172786 np0000004400 cinder-backup[101319]: {{(pid=101319) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jul 03 09:55:07.172933 np0000004400 cinder-backup[101319]: WARNING os_brick.initiator.connectors.iscsi [None req-2d411271-819e-4ff8-9ff7-19c4dc43a294 tempest-ProjectMemberTests33-2105464604 None] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions. Jul 03 09:55:07.172933 np0000004400 cinder-backup[101319]: Jul 03 09:55:07.197535 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-2d411271-819e-4ff8-9ff7-19c4dc43a294 tempest-ProjectMemberTests33-2105464604 None] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-0f290778-6281-48b9-8149-decd4057b72c, portal: 192.168.40.100,3260] Jul 03 09:55:07.197535 np0000004400 cinder-backup[101319]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-0f290778-6281-48b9-8149-decd4057b72c, portal: 192.168.40.100,3260] successful. Jul 03 09:55:07.197535 np0000004400 cinder-backup[101319]: stderr= {{(pid=101319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 03 09:55:07.207510 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-2d411271-819e-4ff8-9ff7-19c4dc43a294 tempest-ProjectMemberTests33-2105464604 None] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=101319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 03 09:55:07.217508 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-2d411271-819e-4ff8-9ff7-19c4dc43a294 tempest-ProjectMemberTests33-2105464604 None] iscsiadm ('-m', 'session'): stdout=tcp: [220] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0f290778-6281-48b9-8149-decd4057b72c (non-flash) Jul 03 09:55:07.217508 np0000004400 cinder-backup[101319]: stderr= {{(pid=101319) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jul 03 09:55:07.217660 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-2d411271-819e-4ff8-9ff7-19c4dc43a294 tempest-ProjectMemberTests33-2105464604 None] iscsi session list stdout=tcp: [220] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0f290778-6281-48b9-8149-decd4057b72c (non-flash) Jul 03 09:55:07.217660 np0000004400 cinder-backup[101319]: stderr= {{(pid=101319) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jul 03 09:55:07.217964 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.base [None req-2d411271-819e-4ff8-9ff7-19c4dc43a294 tempest-ProjectMemberTests33-2105464604 None] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-0f290778-6281-48b9-8149-decd4057b72c" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.096s {{(pid=101319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jul 03 09:55:07.218076 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-2d411271-819e-4ff8-9ff7-19c4dc43a294 tempest-ProjectMemberTests33-2105464604 None] Connected to 192.168.40.100:3260 {{(pid=101319) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}} Jul 03 09:55:07.218519 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.linuxscsi [None req-2d411271-819e-4ff8-9ff7-19c4dc43a294 tempest-ProjectMemberTests33-2105464604 None] HCTL ('7', '-', '-', 0) found on session 220 with lun 0 {{(pid=101319) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}} Jul 03 09:55:07.218649 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.linuxscsi [None req-2d411271-819e-4ff8-9ff7-19c4dc43a294 tempest-ProjectMemberTests33-2105464604 None] Scanning host 7 c: -, t: -, l: 0) {{(pid=101319) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}} Jul 03 09:55:07.234209 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.linuxscsi [None req-2d411271-819e-4ff8-9ff7-19c4dc43a294 tempest-ProjectMemberTests33-2105464604 None] Searching for a device in session 220 and hctl ['7', '*', '*', 0] yield: sdb {{(pid=101319) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}} Jul 03 09:55:07.234471 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-2d411271-819e-4ff8-9ff7-19c4dc43a294 tempest-ProjectMemberTests33-2105464604 None] Connected to sdb using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-0f290778-6281-48b9-8149-decd4057b72c', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '0f290778-6281-48b9-8149-decd4057b72c', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': False} {{(pid=101319) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}} Jul 03 09:55:08.237007 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.base [None req-2d411271-819e-4ff8-9ff7-19c4dc43a294 tempest-ProjectMemberTests33-2105464604 None] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 2.128s {{(pid=101319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jul 03 09:55:08.237007 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-2d411271-819e-4ff8-9ff7-19c4dc43a294 tempest-ProjectMemberTests33-2105464604 None] <== connect_volume: return (2129ms) {'type': 'block', 'scsi_wwn': 'SStorPool_iSCSI_DISK_1034578903445799244', 'path': '/dev/sdb'} {{(pid=101319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}} Jul 03 09:55:08.237663 np0000004400 cinder-backup[101319]: DEBUG oslo_concurrency.processutils [None req-2d411271-819e-4ff8-9ff7-19c4dc43a294 tempest-ProjectMemberTests33-2105464604 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chown 1002 /dev/sdb {{(pid=101319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 09:55:08.257582 np0000004400 sudo[157176]: stack : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chown 1002 /dev/sdb Jul 03 09:55:08.258198 np0000004400 sudo[157176]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1002) Jul 03 09:55:08.584239 np0000004400 sudo[157176]: pam_unix(sudo:session): session closed for user root Jul 03 09:55:08.586319 np0000004400 cinder-backup[101319]: DEBUG oslo_concurrency.processutils [None req-2d411271-819e-4ff8-9ff7-19c4dc43a294 tempest-ProjectMemberTests33-2105464604 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chown 1002 /dev/sdb" returned: 0 in 0.349s {{(pid=101319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 09:55:08.586816 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-2d411271-819e-4ff8-9ff7-19c4dc43a294 tempest-ProjectMemberTests33-2105464604 None] starting restore of backup volume_5f57fed7-aa36-44c5-af90-863bd3d3af9d/20260703095328/az_nova_backup_0871942a-e198-4230-a099-29a52a21849b container: volumebackups, to new volume 0f290778-6281-48b9-8149-decd4057b72c, backup: 0871942a-e198-4230-a099-29a52a21849b. {{(pid=101319) restore /opt/stack/cinder/cinder/backup/chunkeddriver.py:761}} Jul 03 09:55:08.586998 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-2d411271-819e-4ff8-9ff7-19c4dc43a294 tempest-ProjectMemberTests33-2105464604 None] _read_metadata started, container name: volumebackups, metadata filename: volume_5f57fed7-aa36-44c5-af90-863bd3d3af9d/20260703095328/az_nova_backup_0871942a-e198-4230-a099-29a52a21849b_metadata. {{(pid=101319) _read_metadata /opt/stack/cinder/cinder/backup/chunkeddriver.py:320}} Jul 03 09:55:08.606306 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-2d411271-819e-4ff8-9ff7-19c4dc43a294 tempest-ProjectMemberTests33-2105464604 None] _read_metadata finished. Metadata: { Jul 03 09:55:08.606306 np0000004400 cinder-backup[101319]: "backup_description": null, Jul 03 09:55:08.606306 np0000004400 cinder-backup[101319]: "backup_id": "0871942a-e198-4230-a099-29a52a21849b", Jul 03 09:55:08.606306 np0000004400 cinder-backup[101319]: "backup_name": "tempest-type-Backup-859092992", Jul 03 09:55:08.606306 np0000004400 cinder-backup[101319]: "created_at": "2026-07-03 09:53:23+00:00", Jul 03 09:55:08.606306 np0000004400 cinder-backup[101319]: "objects": [ Jul 03 09:55:08.606306 np0000004400 cinder-backup[101319]: { Jul 03 09:55:08.606306 np0000004400 cinder-backup[101319]: "volume_5f57fed7-aa36-44c5-af90-863bd3d3af9d/20260703095328/az_nova_backup_0871942a-e198-4230-a099-29a52a21849b-00001": { Jul 03 09:55:08.606306 np0000004400 cinder-backup[101319]: "compression": "zlib", Jul 03 09:55:08.606306 np0000004400 cinder-backup[101319]: "length": 52428800, Jul 03 09:55:08.606306 np0000004400 cinder-backup[101319]: "md5": "25e317773f308e446cc84c503a6d1f85", Jul 03 09:55:08.606306 np0000004400 cinder-backup[101319]: "offset": 0 Jul 03 09:55:08.606306 np0000004400 cinder-backup[101319]: } Jul 03 09:55:08.606306 np0000004400 cinder-backup[101319]: }, Jul 03 09:55:08.606306 np0000004400 cinder-backup[101319]: { Jul 03 09:55:08.606306 np0000004400 cinder-backup[101319]: "volume_5f57fed7-aa36-44c5-af90-863bd3d3af9d/20260703095328/az_nova_backup_0871942a-e198-4230-a099-29a52a21849b-00002": { Jul 03 09:55:08.606306 np0000004400 cinder-backup[101319]: "compression": "zlib", Jul 03 09:55:08.606306 np0000004400 cinder-backup[101319]: "length": 52428800, Jul 03 09:55:08.606306 np0000004400 cinder-backup[101319]: "md5": "25e317773f308e446cc84c503a6d1f85", Jul 03 09:55:08.606306 np0000004400 cinder-backup[101319]: "offset": 52428800 Jul 03 09:55:08.606306 np0000004400 cinder-backup[101319]: } Jul 03 09:55:08.606306 np0000004400 cinder-backup[101319]: }, Jul 03 09:55:08.606306 np0000004400 cinder-backup[101319]: { Jul 03 09:55:08.606306 np0000004400 cinder-backup[101319]: "volume_5f57fed7-aa36-44c5-af90-863bd3d3af9d/20260703095328/az_nova_backup_0871942a-e198-4230-a099-29a52a21849b-00003": { Jul 03 09:55:08.606306 np0000004400 cinder-backup[101319]: "compression": "zlib", Jul 03 09:55:08.606306 np0000004400 cinder-backup[101319]: "length": 52428800, Jul 03 09:55:08.606306 np0000004400 cinder-backup[101319]: "md5": "25e317773f308e446cc84c503a6d1f85", Jul 03 09:55:08.606306 np0000004400 cinder-backup[101319]: "offset": 104857600 Jul 03 09:55:08.606306 np0000004400 cinder-backup[101319]: } Jul 03 09:55:08.606306 np0000004400 cinder-backup[101319]: }, Jul 03 09:55:08.606306 np0000004400 cinder-backup[101319]: { Jul 03 09:55:08.606306 np0000004400 cinder-backup[101319]: "volume_5f57fed7-aa36-44c5-af90-863bd3d3af9d/20260703095328/az_nova_backup_0871942a-e198-4230-a099-29a52a21849b-00004": { Jul 03 09:55:08.606306 np0000004400 cinder-backup[101319]: "compression": "zlib", Jul 03 09:55:08.606306 np0000004400 cinder-backup[101319]: "length": 52428800, Jul 03 09:55:08.606306 np0000004400 cinder-backup[101319]: "md5": "25e317773f308e446cc84c503a6d1f85", Jul 03 09:55:08.606306 np0000004400 cinder-backup[101319]: "offset": 157286400 Jul 03 09:55:08.606306 np0000004400 cinder-backup[101319]: } Jul 03 09:55:08.606306 np0000004400 cinder-backup[101319]: }, Jul 03 09:55:08.606306 np0000004400 cinder-backup[101319]: { Jul 03 09:55:08.606306 np0000004400 cinder-backup[101319]: "volume_5f57fed7-aa36-44c5-af90-863bd3d3af9d/20260703095328/az_nova_backup_0871942a-e198-4230-a099-29a52a21849b-00005": { Jul 03 09:55:08.606306 np0000004400 cinder-backup[101319]: "compression": "zlib", Jul 03 09:55:08.606306 np0000004400 cinder-backup[101319]: "length": 52428800, Jul 03 09:55:08.606306 np0000004400 cinder-backup[101319]: "md5": "25e317773f308e446cc84c503a6d1f85", Jul 03 09:55:08.606306 np0000004400 cinder-backup[101319]: "offset": 209715200 Jul 03 09:55:08.606306 np0000004400 cinder-backup[101319]: } Jul 03 09:55:08.606306 np0000004400 cinder-backup[101319]: }, Jul 03 09:55:08.606306 np0000004400 cinder-backup[101319]: { Jul 03 09:55:08.606306 np0000004400 cinder-backup[101319]: "volume_5f57fed7-aa36-44c5-af90-863bd3d3af9d/20260703095328/az_nova_backup_0871942a-e198-4230-a099-29a52a21849b-00006": { Jul 03 09:55:08.606306 np0000004400 cinder-backup[101319]: "compression": "zlib", Jul 03 09:55:08.606306 np0000004400 cinder-backup[101319]: "length": 52428800, Jul 03 09:55:08.606306 np0000004400 cinder-backup[101319]: "md5": "25e317773f308e446cc84c503a6d1f85", Jul 03 09:55:08.606306 np0000004400 cinder-backup[101319]: "offset": 262144000 Jul 03 09:55:08.606306 np0000004400 cinder-backup[101319]: } Jul 03 09:55:08.606306 np0000004400 cinder-backup[101319]: }, Jul 03 09:55:08.606306 np0000004400 cinder-backup[101319]: { Jul 03 09:55:08.606306 np0000004400 cinder-backup[101319]: "volume_5f57fed7-aa36-44c5-af90-863bd3d3af9d/20260703095328/az_nova_backup_0871942a-e198-4230-a099-29a52a21849b-00007": { Jul 03 09:55:08.606306 np0000004400 cinder-backup[101319]: "compression": "zlib", Jul 03 09:55:08.606306 np0000004400 cinder-backup[101319]: "length": 52428800, Jul 03 09:55:08.606306 np0000004400 cinder-backup[101319]: "md5": "25e317773f308e446cc84c503a6d1f85", Jul 03 09:55:08.606306 np0000004400 cinder-backup[101319]: "offset": 314572800 Jul 03 09:55:08.606306 np0000004400 cinder-backup[101319]: } Jul 03 09:55:08.606306 np0000004400 cinder-backup[101319]: }, Jul 03 09:55:08.606306 np0000004400 cinder-backup[101319]: { Jul 03 09:55:08.606306 np0000004400 cinder-backup[101319]: "volume_5f57fed7-aa36-44c5-af90-863bd3d3af9d/20260703095328/az_nova_backup_0871942a-e198-4230-a099-29a52a21849b-00008": { Jul 03 09:55:08.606306 np0000004400 cinder-backup[101319]: "compression": "zlib", Jul 03 09:55:08.606306 np0000004400 cinder-backup[101319]: "length": 52428800, Jul 03 09:55:08.606306 np0000004400 cinder-backup[101319]: "md5": "25e317773f308e446cc84c503a6d1f85", Jul 03 09:55:08.606306 np0000004400 cinder-backup[101319]: "offset": 367001600 Jul 03 09:55:08.606306 np0000004400 cinder-backup[101319]: } Jul 03 09:55:08.606306 np0000004400 cinder-backup[101319]: }, Jul 03 09:55:08.606306 np0000004400 cinder-backup[101319]: { Jul 03 09:55:08.606306 np0000004400 cinder-backup[101319]: "volume_5f57fed7-aa36-44c5-af90-863bd3d3af9d/20260703095328/az_nova_backup_0871942a-e198-4230-a099-29a52a21849b-00009": { Jul 03 09:55:08.606306 np0000004400 cinder-backup[101319]: "compression": "zlib", Jul 03 09:55:08.606306 np0000004400 cinder-backup[101319]: "length": 52428800, Jul 03 09:55:08.606306 np0000004400 cinder-backup[101319]: "md5": "25e317773f308e446cc84c503a6d1f85", Jul 03 09:55:08.606306 np0000004400 cinder-backup[101319]: "offset": 419430400 Jul 03 09:55:08.606306 np0000004400 cinder-backup[101319]: } Jul 03 09:55:08.606306 np0000004400 cinder-backup[101319]: }, Jul 03 09:55:08.606306 np0000004400 cinder-backup[101319]: { Jul 03 09:55:08.606306 np0000004400 cinder-backup[101319]: "volume_5f57fed7-aa36-44c5-af90-863bd3d3af9d/20260703095328/az_nova_backup_0871942a-e198-4230-a099-29a52a21849b-00010": { Jul 03 09:55:08.606306 np0000004400 cinder-backup[101319]: "compression": "zlib", Jul 03 09:55:08.606306 np0000004400 cinder-backup[101319]: "length": 52428800, Jul 03 09:55:08.606306 np0000004400 cinder-backup[101319]: "md5": "25e317773f308e446cc84c503a6d1f85", Jul 03 09:55:08.606306 np0000004400 cinder-backup[101319]: "offset": 471859200 Jul 03 09:55:08.606306 np0000004400 cinder-backup[101319]: } Jul 03 09:55:08.606306 np0000004400 cinder-backup[101319]: }, Jul 03 09:55:08.606306 np0000004400 cinder-backup[101319]: { Jul 03 09:55:08.606306 np0000004400 cinder-backup[101319]: "volume_5f57fed7-aa36-44c5-af90-863bd3d3af9d/20260703095328/az_nova_backup_0871942a-e198-4230-a099-29a52a21849b-00011": { Jul 03 09:55:08.606306 np0000004400 cinder-backup[101319]: "compression": "zlib", Jul 03 09:55:08.606306 np0000004400 cinder-backup[101319]: "length": 52428800, Jul 03 09:55:08.606306 np0000004400 cinder-backup[101319]: "md5": "25e317773f308e446cc84c503a6d1f85", Jul 03 09:55:08.606306 np0000004400 cinder-backup[101319]: "offset": 524288000 Jul 03 09:55:08.606306 np0000004400 cinder-backup[101319]: } Jul 03 09:55:08.606306 np0000004400 cinder-backup[101319]: }, Jul 03 09:55:08.606306 np0000004400 cinder-backup[101319]: { Jul 03 09:55:08.606306 np0000004400 cinder-backup[101319]: "volume_5f57fed7-aa36-44c5-af90-863bd3d3af9d/20260703095328/az_nova_backup_0871942a-e198-4230-a099-29a52a21849b-00012": { Jul 03 09:55:08.606306 np0000004400 cinder-backup[101319]: "compression": "zlib", Jul 03 09:55:08.606306 np0000004400 cinder-backup[101319]: "length": 52428800, Jul 03 09:55:08.606306 np0000004400 cinder-backup[101319]: "md5": "25e317773f308e446cc84c503a6d1f85", Jul 03 09:55:08.606306 np0000004400 cinder-backup[101319]: "offset": 576716800 Jul 03 09:55:08.606306 np0000004400 cinder-backup[101319]: } Jul 03 09:55:08.606306 np0000004400 cinder-backup[101319]: }, Jul 03 09:55:08.606306 np0000004400 cinder-backup[101319]: { Jul 03 09:55:08.606306 np0000004400 cinder-backup[101319]: "volume_5f57fed7-aa36-44c5-af90-863bd3d3af9d/20260703095328/az_nova_backup_0871942a-e198-4230-a099-29a52a21849b-00013": { Jul 03 09:55:08.606306 np0000004400 cinder-backup[101319]: "compression": "zlib", Jul 03 09:55:08.606306 np0000004400 cinder-backup[101319]: "length": 52428800, Jul 03 09:55:08.606306 np0000004400 cinder-backup[101319]: "md5": "25e317773f308e446cc84c503a6d1f85", Jul 03 09:55:08.606306 np0000004400 cinder-backup[101319]: "offset": 629145600 Jul 03 09:55:08.606306 np0000004400 cinder-backup[101319]: } Jul 03 09:55:08.606306 np0000004400 cinder-backup[101319]: }, Jul 03 09:55:08.606306 np0000004400 cinder-backup[101319]: { Jul 03 09:55:08.606306 np0000004400 cinder-backup[101319]: "volume_5f57fed7-aa36-44c5-af90-863bd3d3af9d/20260703095328/az_nova_backup_0871942a-e198-4230-a099-29a52a21849b-00014": { Jul 03 09:55:08.606306 np0000004400 cinder-backup[101319]: "compression": "zlib", Jul 03 09:55:08.606306 np0000004400 cinder-backup[101319]: "length": 52428800, Jul 03 09:55:08.606306 np0000004400 cinder-backup[101319]: "md5": "25e317773f308e446cc84c503a6d1f85", Jul 03 09:55:08.606306 np0000004400 cinder-backup[101319]: "offset": 681574400 Jul 03 09:55:08.606306 np0000004400 cinder-backup[101319]: } Jul 03 09:55:08.606306 np0000004400 cinder-backup[101319]: }, Jul 03 09:55:08.606306 np0000004400 cinder-backup[101319]: { Jul 03 09:55:08.606306 np0000004400 cinder-backup[101319]: "volume_5f57fed7-aa36-44c5-af90-863bd3d3af9d/20260703095328/az_nova_backup_0871942a-e198-4230-a099-29a52a21849b-00015": { Jul 03 09:55:08.606306 np0000004400 cinder-backup[101319]: "compression": "zlib", Jul 03 09:55:08.606306 np0000004400 cinder-backup[101319]: "length": 52428800, Jul 03 09:55:08.606306 np0000004400 cinder-backup[101319]: "md5": "25e317773f308e446cc84c503a6d1f85", Jul 03 09:55:08.606306 np0000004400 cinder-backup[101319]: "offset": 734003200 Jul 03 09:55:08.606306 np0000004400 cinder-backup[101319]: } Jul 03 09:55:08.606306 np0000004400 cinder-backup[101319]: }, Jul 03 09:55:08.606306 np0000004400 cinder-backup[101319]: { Jul 03 09:55:08.606306 np0000004400 cinder-backup[101319]: "volume_5f57fed7-aa36-44c5-af90-863bd3d3af9d/20260703095328/az_nova_backup_0871942a-e198-4230-a099-29a52a21849b-00016": { Jul 03 09:55:08.606306 np0000004400 cinder-backup[101319]: "compression": "zlib", Jul 03 09:55:08.606306 np0000004400 cinder-backup[101319]: "length": 52428800, Jul 03 09:55:08.606306 np0000004400 cinder-backup[101319]: "md5": "25e317773f308e446cc84c503a6d1f85", Jul 03 09:55:08.606306 np0000004400 cinder-backup[101319]: "offset": 786432000 Jul 03 09:55:08.606306 np0000004400 cinder-backup[101319]: } Jul 03 09:55:08.606306 np0000004400 cinder-backup[101319]: }, Jul 03 09:55:08.606306 np0000004400 cinder-backup[101319]: { Jul 03 09:55:08.606306 np0000004400 cinder-backup[101319]: "volume_5f57fed7-aa36-44c5-af90-863bd3d3af9d/20260703095328/az_nova_backup_0871942a-e198-4230-a099-29a52a21849b-00017": { Jul 03 09:55:08.606306 np0000004400 cinder-backup[101319]: "compression": "zlib", Jul 03 09:55:08.606306 np0000004400 cinder-backup[101319]: "length": 52428800, Jul 03 09:55:08.606306 np0000004400 cinder-backup[101319]: "md5": "25e317773f308e446cc84c503a6d1f85", Jul 03 09:55:08.606306 np0000004400 cinder-backup[101319]: "offset": 838860800 Jul 03 09:55:08.606306 np0000004400 cinder-backup[101319]: } Jul 03 09:55:08.606306 np0000004400 cinder-backup[101319]: }, Jul 03 09:55:08.606306 np0000004400 cinder-backup[101319]: { Jul 03 09:55:08.606306 np0000004400 cinder-backup[101319]: "volume_5f57fed7-aa36-44c5-af90-863bd3d3af9d/20260703095328/az_nova_backup_0871942a-e198-4230-a099-29a52a21849b-00018": { Jul 03 09:55:08.606306 np0000004400 cinder-backup[101319]: "compression": "zlib", Jul 03 09:55:08.606306 np0000004400 cinder-backup[101319]: "length": 52428800, Jul 03 09:55:08.606306 np0000004400 cinder-backup[101319]: "md5": "25e317773f308e446cc84c503a6d1f85", Jul 03 09:55:08.606306 np0000004400 cinder-backup[101319]: "offset": 891289600 Jul 03 09:55:08.606306 np0000004400 cinder-backup[101319]: } Jul 03 09:55:08.606306 np0000004400 cinder-backup[101319]: }, Jul 03 09:55:08.606306 np0000004400 cinder-backup[101319]: { Jul 03 09:55:08.606306 np0000004400 cinder-backup[101319]: "volume_5f57fed7-aa36-44c5-af90-863bd3d3af9d/20260703095328/az_nova_backup_0871942a-e198-4230-a099-29a52a21849b-00019": { Jul 03 09:55:08.606306 np0000004400 cinder-backup[101319]: "compression": "zlib", Jul 03 09:55:08.606306 np0000004400 cinder-backup[101319]: "length": 52428800, Jul 03 09:55:08.606306 np0000004400 cinder-backup[101319]: "md5": "25e317773f308e446cc84c503a6d1f85", Jul 03 09:55:08.606306 np0000004400 cinder-backup[101319]: "offset": 943718400 Jul 03 09:55:08.606306 np0000004400 cinder-backup[101319]: } Jul 03 09:55:08.606306 np0000004400 cinder-backup[101319]: }, Jul 03 09:55:08.606306 np0000004400 cinder-backup[101319]: { Jul 03 09:55:08.606306 np0000004400 cinder-backup[101319]: "volume_5f57fed7-aa36-44c5-af90-863bd3d3af9d/20260703095328/az_nova_backup_0871942a-e198-4230-a099-29a52a21849b-00020": { Jul 03 09:55:08.606306 np0000004400 cinder-backup[101319]: "compression": "zlib", Jul 03 09:55:08.606306 np0000004400 cinder-backup[101319]: "length": 52428800, Jul 03 09:55:08.606306 np0000004400 cinder-backup[101319]: "md5": "25e317773f308e446cc84c503a6d1f85", Jul 03 09:55:08.606306 np0000004400 cinder-backup[101319]: "offset": 996147200 Jul 03 09:55:08.606306 np0000004400 cinder-backup[101319]: } Jul 03 09:55:08.606306 np0000004400 cinder-backup[101319]: }, Jul 03 09:55:08.606306 np0000004400 cinder-backup[101319]: { Jul 03 09:55:08.606306 np0000004400 cinder-backup[101319]: "volume_5f57fed7-aa36-44c5-af90-863bd3d3af9d/20260703095328/az_nova_backup_0871942a-e198-4230-a099-29a52a21849b-00021": { Jul 03 09:55:08.606306 np0000004400 cinder-backup[101319]: "compression": "zlib", Jul 03 09:55:08.606306 np0000004400 cinder-backup[101319]: "length": 25165824, Jul 03 09:55:08.606306 np0000004400 cinder-backup[101319]: "md5": "77377273b0a4b61febdbf7bbf52b9db9", Jul 03 09:55:08.606306 np0000004400 cinder-backup[101319]: "offset": 1048576000 Jul 03 09:55:08.606306 np0000004400 cinder-backup[101319]: } Jul 03 09:55:08.606306 np0000004400 cinder-backup[101319]: } Jul 03 09:55:08.606306 np0000004400 cinder-backup[101319]: ], Jul 03 09:55:08.606306 np0000004400 cinder-backup[101319]: "parent_id": null, Jul 03 09:55:08.606306 np0000004400 cinder-backup[101319]: "version": "1.0.0", Jul 03 09:55:08.606306 np0000004400 cinder-backup[101319]: "volume_id": "5f57fed7-aa36-44c5-af90-863bd3d3af9d", Jul 03 09:55:08.606306 np0000004400 cinder-backup[101319]: "volume_meta": "{\"version\": 2, \"volume-base-metadata\": {\"id\": \"5f57fed7-aa36-44c5-af90-863bd3d3af9d\", \"_name_id\": null, \"use_quota\": true, \"ec2_id\": null, \"user_id\": \"87abbb474f8a4baf840fcfdf286ff94e\", \"project_id\": \"e0b6e59b911e40b3acac38afb1f81e3a\", \"snapshot_id\": null, \"cluster_name\": null, \"host\": \"np0000004400@storpool#default\", \"size\": 1, \"availability_zone\": \"nova\", \"status\": \"backing-up\", \"attach_status\": \"detached\", \"migration_status\": null, \"scheduled_at\": \"2026-07-03T09:53:22.000000\", \"launched_at\": \"2026-07-03T09:53:22.000000\", \"terminated_at\": null, \"display_name\": \"tempest-VolumeV3RbacBaseTests-Volume-1340187584\", \"display_description\": null, \"provider_location\": null, \"provider_auth\": null, \"provider_geometry\": null, \"provider_id\": null, \"volume_type_id\": \"03e13fe6-0e30-4803-ace0-725d38e6dc24\", \"source_volid\": null, \"encryption_key_id\": null, \"consistencygroup_id\": null, \"group_id\": null, \"bootable\": false, \"multiattach\": false, \"replication_status\": null, \"replication_extended_status\": null, \"replication_driver_data\": null, \"previous_status\": \"available\", \"service_uuid\": \"6d4b0e79-fefe-4744-b25f-34be05095200\", \"shared_targets\": true, \"deleted_at\": null, \"deleted\": false, \"created_at\": \"2026-07-03T09:53:22.000000\", \"updated_at\": \"2026-07-03T09:53:23.000000\"}}" Jul 03 09:55:08.606306 np0000004400 cinder-backup[101319]: }. {{(pid=101319) _read_metadata /opt/stack/cinder/cinder/backup/chunkeddriver.py:327}} Jul 03 09:55:08.611607 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-2d411271-819e-4ff8-9ff7-19c4dc43a294 tempest-ProjectMemberTests33-2105464604 None] Restoring backup version 1.0.0 {{(pid=101319) restore /opt/stack/cinder/cinder/backup/chunkeddriver.py:774}} Jul 03 09:55:08.611607 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-2d411271-819e-4ff8-9ff7-19c4dc43a294 tempest-ProjectMemberTests33-2105464604 None] _read_metadata started, container name: volumebackups, metadata filename: volume_5f57fed7-aa36-44c5-af90-863bd3d3af9d/20260703095328/az_nova_backup_0871942a-e198-4230-a099-29a52a21849b_metadata. {{(pid=101319) _read_metadata /opt/stack/cinder/cinder/backup/chunkeddriver.py:320}} Jul 03 09:55:08.625415 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-2d411271-819e-4ff8-9ff7-19c4dc43a294 tempest-ProjectMemberTests33-2105464604 None] _read_metadata finished. Metadata: { Jul 03 09:55:08.625415 np0000004400 cinder-backup[101319]: "backup_description": null, Jul 03 09:55:08.625415 np0000004400 cinder-backup[101319]: "backup_id": "0871942a-e198-4230-a099-29a52a21849b", Jul 03 09:55:08.625415 np0000004400 cinder-backup[101319]: "backup_name": "tempest-type-Backup-859092992", Jul 03 09:55:08.625415 np0000004400 cinder-backup[101319]: "created_at": "2026-07-03 09:53:23+00:00", Jul 03 09:55:08.625415 np0000004400 cinder-backup[101319]: "objects": [ Jul 03 09:55:08.625415 np0000004400 cinder-backup[101319]: { Jul 03 09:55:08.625415 np0000004400 cinder-backup[101319]: "volume_5f57fed7-aa36-44c5-af90-863bd3d3af9d/20260703095328/az_nova_backup_0871942a-e198-4230-a099-29a52a21849b-00001": { Jul 03 09:55:08.625415 np0000004400 cinder-backup[101319]: "compression": "zlib", Jul 03 09:55:08.625415 np0000004400 cinder-backup[101319]: "length": 52428800, Jul 03 09:55:08.625415 np0000004400 cinder-backup[101319]: "md5": "25e317773f308e446cc84c503a6d1f85", Jul 03 09:55:08.625415 np0000004400 cinder-backup[101319]: "offset": 0 Jul 03 09:55:08.625415 np0000004400 cinder-backup[101319]: } Jul 03 09:55:08.625415 np0000004400 cinder-backup[101319]: }, Jul 03 09:55:08.625415 np0000004400 cinder-backup[101319]: { Jul 03 09:55:08.625415 np0000004400 cinder-backup[101319]: "volume_5f57fed7-aa36-44c5-af90-863bd3d3af9d/20260703095328/az_nova_backup_0871942a-e198-4230-a099-29a52a21849b-00002": { Jul 03 09:55:08.625415 np0000004400 cinder-backup[101319]: "compression": "zlib", Jul 03 09:55:08.625415 np0000004400 cinder-backup[101319]: "length": 52428800, Jul 03 09:55:08.625415 np0000004400 cinder-backup[101319]: "md5": "25e317773f308e446cc84c503a6d1f85", Jul 03 09:55:08.625415 np0000004400 cinder-backup[101319]: "offset": 52428800 Jul 03 09:55:08.625415 np0000004400 cinder-backup[101319]: } Jul 03 09:55:08.625415 np0000004400 cinder-backup[101319]: }, Jul 03 09:55:08.625415 np0000004400 cinder-backup[101319]: { Jul 03 09:55:08.625415 np0000004400 cinder-backup[101319]: "volume_5f57fed7-aa36-44c5-af90-863bd3d3af9d/20260703095328/az_nova_backup_0871942a-e198-4230-a099-29a52a21849b-00003": { Jul 03 09:55:08.625415 np0000004400 cinder-backup[101319]: "compression": "zlib", Jul 03 09:55:08.625415 np0000004400 cinder-backup[101319]: "length": 52428800, Jul 03 09:55:08.625415 np0000004400 cinder-backup[101319]: "md5": "25e317773f308e446cc84c503a6d1f85", Jul 03 09:55:08.625415 np0000004400 cinder-backup[101319]: "offset": 104857600 Jul 03 09:55:08.625415 np0000004400 cinder-backup[101319]: } Jul 03 09:55:08.625415 np0000004400 cinder-backup[101319]: }, Jul 03 09:55:08.625415 np0000004400 cinder-backup[101319]: { Jul 03 09:55:08.625415 np0000004400 cinder-backup[101319]: "volume_5f57fed7-aa36-44c5-af90-863bd3d3af9d/20260703095328/az_nova_backup_0871942a-e198-4230-a099-29a52a21849b-00004": { Jul 03 09:55:08.625415 np0000004400 cinder-backup[101319]: "compression": "zlib", Jul 03 09:55:08.625415 np0000004400 cinder-backup[101319]: "length": 52428800, Jul 03 09:55:08.625415 np0000004400 cinder-backup[101319]: "md5": "25e317773f308e446cc84c503a6d1f85", Jul 03 09:55:08.625415 np0000004400 cinder-backup[101319]: "offset": 157286400 Jul 03 09:55:08.625415 np0000004400 cinder-backup[101319]: } Jul 03 09:55:08.625415 np0000004400 cinder-backup[101319]: }, Jul 03 09:55:08.625415 np0000004400 cinder-backup[101319]: { Jul 03 09:55:08.625415 np0000004400 cinder-backup[101319]: "volume_5f57fed7-aa36-44c5-af90-863bd3d3af9d/20260703095328/az_nova_backup_0871942a-e198-4230-a099-29a52a21849b-00005": { Jul 03 09:55:08.625415 np0000004400 cinder-backup[101319]: "compression": "zlib", Jul 03 09:55:08.625415 np0000004400 cinder-backup[101319]: "length": 52428800, Jul 03 09:55:08.625415 np0000004400 cinder-backup[101319]: "md5": "25e317773f308e446cc84c503a6d1f85", Jul 03 09:55:08.625415 np0000004400 cinder-backup[101319]: "offset": 209715200 Jul 03 09:55:08.625415 np0000004400 cinder-backup[101319]: } Jul 03 09:55:08.625415 np0000004400 cinder-backup[101319]: }, Jul 03 09:55:08.625415 np0000004400 cinder-backup[101319]: { Jul 03 09:55:08.625415 np0000004400 cinder-backup[101319]: "volume_5f57fed7-aa36-44c5-af90-863bd3d3af9d/20260703095328/az_nova_backup_0871942a-e198-4230-a099-29a52a21849b-00006": { Jul 03 09:55:08.625415 np0000004400 cinder-backup[101319]: "compression": "zlib", Jul 03 09:55:08.625415 np0000004400 cinder-backup[101319]: "length": 52428800, Jul 03 09:55:08.625415 np0000004400 cinder-backup[101319]: "md5": "25e317773f308e446cc84c503a6d1f85", Jul 03 09:55:08.625415 np0000004400 cinder-backup[101319]: "offset": 262144000 Jul 03 09:55:08.625415 np0000004400 cinder-backup[101319]: } Jul 03 09:55:08.625415 np0000004400 cinder-backup[101319]: }, Jul 03 09:55:08.625415 np0000004400 cinder-backup[101319]: { Jul 03 09:55:08.625415 np0000004400 cinder-backup[101319]: "volume_5f57fed7-aa36-44c5-af90-863bd3d3af9d/20260703095328/az_nova_backup_0871942a-e198-4230-a099-29a52a21849b-00007": { Jul 03 09:55:08.625415 np0000004400 cinder-backup[101319]: "compression": "zlib", Jul 03 09:55:08.625415 np0000004400 cinder-backup[101319]: "length": 52428800, Jul 03 09:55:08.625415 np0000004400 cinder-backup[101319]: "md5": "25e317773f308e446cc84c503a6d1f85", Jul 03 09:55:08.625415 np0000004400 cinder-backup[101319]: "offset": 314572800 Jul 03 09:55:08.625415 np0000004400 cinder-backup[101319]: } Jul 03 09:55:08.625415 np0000004400 cinder-backup[101319]: }, Jul 03 09:55:08.625415 np0000004400 cinder-backup[101319]: { Jul 03 09:55:08.625415 np0000004400 cinder-backup[101319]: "volume_5f57fed7-aa36-44c5-af90-863bd3d3af9d/20260703095328/az_nova_backup_0871942a-e198-4230-a099-29a52a21849b-00008": { Jul 03 09:55:08.625415 np0000004400 cinder-backup[101319]: "compression": "zlib", Jul 03 09:55:08.625415 np0000004400 cinder-backup[101319]: "length": 52428800, Jul 03 09:55:08.625415 np0000004400 cinder-backup[101319]: "md5": "25e317773f308e446cc84c503a6d1f85", Jul 03 09:55:08.625415 np0000004400 cinder-backup[101319]: "offset": 367001600 Jul 03 09:55:08.625415 np0000004400 cinder-backup[101319]: } Jul 03 09:55:08.625415 np0000004400 cinder-backup[101319]: }, Jul 03 09:55:08.625415 np0000004400 cinder-backup[101319]: { Jul 03 09:55:08.625415 np0000004400 cinder-backup[101319]: "volume_5f57fed7-aa36-44c5-af90-863bd3d3af9d/20260703095328/az_nova_backup_0871942a-e198-4230-a099-29a52a21849b-00009": { Jul 03 09:55:08.625415 np0000004400 cinder-backup[101319]: "compression": "zlib", Jul 03 09:55:08.625415 np0000004400 cinder-backup[101319]: "length": 52428800, Jul 03 09:55:08.625415 np0000004400 cinder-backup[101319]: "md5": "25e317773f308e446cc84c503a6d1f85", Jul 03 09:55:08.625415 np0000004400 cinder-backup[101319]: "offset": 419430400 Jul 03 09:55:08.625415 np0000004400 cinder-backup[101319]: } Jul 03 09:55:08.625415 np0000004400 cinder-backup[101319]: }, Jul 03 09:55:08.625415 np0000004400 cinder-backup[101319]: { Jul 03 09:55:08.625415 np0000004400 cinder-backup[101319]: "volume_5f57fed7-aa36-44c5-af90-863bd3d3af9d/20260703095328/az_nova_backup_0871942a-e198-4230-a099-29a52a21849b-00010": { Jul 03 09:55:08.625415 np0000004400 cinder-backup[101319]: "compression": "zlib", Jul 03 09:55:08.625415 np0000004400 cinder-backup[101319]: "length": 52428800, Jul 03 09:55:08.625415 np0000004400 cinder-backup[101319]: "md5": "25e317773f308e446cc84c503a6d1f85", Jul 03 09:55:08.625415 np0000004400 cinder-backup[101319]: "offset": 471859200 Jul 03 09:55:08.625415 np0000004400 cinder-backup[101319]: } Jul 03 09:55:08.625415 np0000004400 cinder-backup[101319]: }, Jul 03 09:55:08.625415 np0000004400 cinder-backup[101319]: { Jul 03 09:55:08.625415 np0000004400 cinder-backup[101319]: "volume_5f57fed7-aa36-44c5-af90-863bd3d3af9d/20260703095328/az_nova_backup_0871942a-e198-4230-a099-29a52a21849b-00011": { Jul 03 09:55:08.625415 np0000004400 cinder-backup[101319]: "compression": "zlib", Jul 03 09:55:08.625415 np0000004400 cinder-backup[101319]: "length": 52428800, Jul 03 09:55:08.625415 np0000004400 cinder-backup[101319]: "md5": "25e317773f308e446cc84c503a6d1f85", Jul 03 09:55:08.625415 np0000004400 cinder-backup[101319]: "offset": 524288000 Jul 03 09:55:08.625415 np0000004400 cinder-backup[101319]: } Jul 03 09:55:08.625415 np0000004400 cinder-backup[101319]: }, Jul 03 09:55:08.625415 np0000004400 cinder-backup[101319]: { Jul 03 09:55:08.625415 np0000004400 cinder-backup[101319]: "volume_5f57fed7-aa36-44c5-af90-863bd3d3af9d/20260703095328/az_nova_backup_0871942a-e198-4230-a099-29a52a21849b-00012": { Jul 03 09:55:08.625415 np0000004400 cinder-backup[101319]: "compression": "zlib", Jul 03 09:55:08.625415 np0000004400 cinder-backup[101319]: "length": 52428800, Jul 03 09:55:08.625415 np0000004400 cinder-backup[101319]: "md5": "25e317773f308e446cc84c503a6d1f85", Jul 03 09:55:08.625415 np0000004400 cinder-backup[101319]: "offset": 576716800 Jul 03 09:55:08.625415 np0000004400 cinder-backup[101319]: } Jul 03 09:55:08.625415 np0000004400 cinder-backup[101319]: }, Jul 03 09:55:08.625415 np0000004400 cinder-backup[101319]: { Jul 03 09:55:08.625415 np0000004400 cinder-backup[101319]: "volume_5f57fed7-aa36-44c5-af90-863bd3d3af9d/20260703095328/az_nova_backup_0871942a-e198-4230-a099-29a52a21849b-00013": { Jul 03 09:55:08.625415 np0000004400 cinder-backup[101319]: "compression": "zlib", Jul 03 09:55:08.625415 np0000004400 cinder-backup[101319]: "length": 52428800, Jul 03 09:55:08.625415 np0000004400 cinder-backup[101319]: "md5": "25e317773f308e446cc84c503a6d1f85", Jul 03 09:55:08.625415 np0000004400 cinder-backup[101319]: "offset": 629145600 Jul 03 09:55:08.625415 np0000004400 cinder-backup[101319]: } Jul 03 09:55:08.625415 np0000004400 cinder-backup[101319]: }, Jul 03 09:55:08.625415 np0000004400 cinder-backup[101319]: { Jul 03 09:55:08.625415 np0000004400 cinder-backup[101319]: "volume_5f57fed7-aa36-44c5-af90-863bd3d3af9d/20260703095328/az_nova_backup_0871942a-e198-4230-a099-29a52a21849b-00014": { Jul 03 09:55:08.625415 np0000004400 cinder-backup[101319]: "compression": "zlib", Jul 03 09:55:08.625415 np0000004400 cinder-backup[101319]: "length": 52428800, Jul 03 09:55:08.625415 np0000004400 cinder-backup[101319]: "md5": "25e317773f308e446cc84c503a6d1f85", Jul 03 09:55:08.625415 np0000004400 cinder-backup[101319]: "offset": 681574400 Jul 03 09:55:08.625415 np0000004400 cinder-backup[101319]: } Jul 03 09:55:08.625415 np0000004400 cinder-backup[101319]: }, Jul 03 09:55:08.625415 np0000004400 cinder-backup[101319]: { Jul 03 09:55:08.625415 np0000004400 cinder-backup[101319]: "volume_5f57fed7-aa36-44c5-af90-863bd3d3af9d/20260703095328/az_nova_backup_0871942a-e198-4230-a099-29a52a21849b-00015": { Jul 03 09:55:08.625415 np0000004400 cinder-backup[101319]: "compression": "zlib", Jul 03 09:55:08.625415 np0000004400 cinder-backup[101319]: "length": 52428800, Jul 03 09:55:08.625415 np0000004400 cinder-backup[101319]: "md5": "25e317773f308e446cc84c503a6d1f85", Jul 03 09:55:08.625415 np0000004400 cinder-backup[101319]: "offset": 734003200 Jul 03 09:55:08.625415 np0000004400 cinder-backup[101319]: } Jul 03 09:55:08.625415 np0000004400 cinder-backup[101319]: }, Jul 03 09:55:08.625415 np0000004400 cinder-backup[101319]: { Jul 03 09:55:08.625415 np0000004400 cinder-backup[101319]: "volume_5f57fed7-aa36-44c5-af90-863bd3d3af9d/20260703095328/az_nova_backup_0871942a-e198-4230-a099-29a52a21849b-00016": { Jul 03 09:55:08.625415 np0000004400 cinder-backup[101319]: "compression": "zlib", Jul 03 09:55:08.625415 np0000004400 cinder-backup[101319]: "length": 52428800, Jul 03 09:55:08.625415 np0000004400 cinder-backup[101319]: "md5": "25e317773f308e446cc84c503a6d1f85", Jul 03 09:55:08.625415 np0000004400 cinder-backup[101319]: "offset": 786432000 Jul 03 09:55:08.625415 np0000004400 cinder-backup[101319]: } Jul 03 09:55:08.625415 np0000004400 cinder-backup[101319]: }, Jul 03 09:55:08.625415 np0000004400 cinder-backup[101319]: { Jul 03 09:55:08.625415 np0000004400 cinder-backup[101319]: "volume_5f57fed7-aa36-44c5-af90-863bd3d3af9d/20260703095328/az_nova_backup_0871942a-e198-4230-a099-29a52a21849b-00017": { Jul 03 09:55:08.625415 np0000004400 cinder-backup[101319]: "compression": "zlib", Jul 03 09:55:08.625415 np0000004400 cinder-backup[101319]: "length": 52428800, Jul 03 09:55:08.625415 np0000004400 cinder-backup[101319]: "md5": "25e317773f308e446cc84c503a6d1f85", Jul 03 09:55:08.625415 np0000004400 cinder-backup[101319]: "offset": 838860800 Jul 03 09:55:08.625415 np0000004400 cinder-backup[101319]: } Jul 03 09:55:08.625415 np0000004400 cinder-backup[101319]: }, Jul 03 09:55:08.625415 np0000004400 cinder-backup[101319]: { Jul 03 09:55:08.625415 np0000004400 cinder-backup[101319]: "volume_5f57fed7-aa36-44c5-af90-863bd3d3af9d/20260703095328/az_nova_backup_0871942a-e198-4230-a099-29a52a21849b-00018": { Jul 03 09:55:08.625415 np0000004400 cinder-backup[101319]: "compression": "zlib", Jul 03 09:55:08.625415 np0000004400 cinder-backup[101319]: "length": 52428800, Jul 03 09:55:08.625415 np0000004400 cinder-backup[101319]: "md5": "25e317773f308e446cc84c503a6d1f85", Jul 03 09:55:08.625415 np0000004400 cinder-backup[101319]: "offset": 891289600 Jul 03 09:55:08.625415 np0000004400 cinder-backup[101319]: } Jul 03 09:55:08.625415 np0000004400 cinder-backup[101319]: }, Jul 03 09:55:08.625415 np0000004400 cinder-backup[101319]: { Jul 03 09:55:08.625415 np0000004400 cinder-backup[101319]: "volume_5f57fed7-aa36-44c5-af90-863bd3d3af9d/20260703095328/az_nova_backup_0871942a-e198-4230-a099-29a52a21849b-00019": { Jul 03 09:55:08.625415 np0000004400 cinder-backup[101319]: "compression": "zlib", Jul 03 09:55:08.625415 np0000004400 cinder-backup[101319]: "length": 52428800, Jul 03 09:55:08.625415 np0000004400 cinder-backup[101319]: "md5": "25e317773f308e446cc84c503a6d1f85", Jul 03 09:55:08.625415 np0000004400 cinder-backup[101319]: "offset": 943718400 Jul 03 09:55:08.625415 np0000004400 cinder-backup[101319]: } Jul 03 09:55:08.625415 np0000004400 cinder-backup[101319]: }, Jul 03 09:55:08.625415 np0000004400 cinder-backup[101319]: { Jul 03 09:55:08.625415 np0000004400 cinder-backup[101319]: "volume_5f57fed7-aa36-44c5-af90-863bd3d3af9d/20260703095328/az_nova_backup_0871942a-e198-4230-a099-29a52a21849b-00020": { Jul 03 09:55:08.625415 np0000004400 cinder-backup[101319]: "compression": "zlib", Jul 03 09:55:08.625415 np0000004400 cinder-backup[101319]: "length": 52428800, Jul 03 09:55:08.625415 np0000004400 cinder-backup[101319]: "md5": "25e317773f308e446cc84c503a6d1f85", Jul 03 09:55:08.625415 np0000004400 cinder-backup[101319]: "offset": 996147200 Jul 03 09:55:08.625415 np0000004400 cinder-backup[101319]: } Jul 03 09:55:08.625415 np0000004400 cinder-backup[101319]: }, Jul 03 09:55:08.625415 np0000004400 cinder-backup[101319]: { Jul 03 09:55:08.625415 np0000004400 cinder-backup[101319]: "volume_5f57fed7-aa36-44c5-af90-863bd3d3af9d/20260703095328/az_nova_backup_0871942a-e198-4230-a099-29a52a21849b-00021": { Jul 03 09:55:08.625415 np0000004400 cinder-backup[101319]: "compression": "zlib", Jul 03 09:55:08.625415 np0000004400 cinder-backup[101319]: "length": 25165824, Jul 03 09:55:08.625415 np0000004400 cinder-backup[101319]: "md5": "77377273b0a4b61febdbf7bbf52b9db9", Jul 03 09:55:08.625415 np0000004400 cinder-backup[101319]: "offset": 1048576000 Jul 03 09:55:08.625415 np0000004400 cinder-backup[101319]: } Jul 03 09:55:08.625415 np0000004400 cinder-backup[101319]: } Jul 03 09:55:08.625415 np0000004400 cinder-backup[101319]: ], Jul 03 09:55:08.625415 np0000004400 cinder-backup[101319]: "parent_id": null, Jul 03 09:55:08.625415 np0000004400 cinder-backup[101319]: "version": "1.0.0", Jul 03 09:55:08.625415 np0000004400 cinder-backup[101319]: "volume_id": "5f57fed7-aa36-44c5-af90-863bd3d3af9d", Jul 03 09:55:08.625415 np0000004400 cinder-backup[101319]: "volume_meta": "{\"version\": 2, \"volume-base-metadata\": {\"id\": \"5f57fed7-aa36-44c5-af90-863bd3d3af9d\", \"_name_id\": null, \"use_quota\": true, \"ec2_id\": null, \"user_id\": \"87abbb474f8a4baf840fcfdf286ff94e\", \"project_id\": \"e0b6e59b911e40b3acac38afb1f81e3a\", \"snapshot_id\": null, \"cluster_name\": null, \"host\": \"np0000004400@storpool#default\", \"size\": 1, \"availability_zone\": \"nova\", \"status\": \"backing-up\", \"attach_status\": \"detached\", \"migration_status\": null, \"scheduled_at\": \"2026-07-03T09:53:22.000000\", \"launched_at\": \"2026-07-03T09:53:22.000000\", \"terminated_at\": null, \"display_name\": \"tempest-VolumeV3RbacBaseTests-Volume-1340187584\", \"display_description\": null, \"provider_location\": null, \"provider_auth\": null, \"provider_geometry\": null, \"provider_id\": null, \"volume_type_id\": \"03e13fe6-0e30-4803-ace0-725d38e6dc24\", \"source_volid\": null, \"encryption_key_id\": null, \"consistencygroup_id\": null, \"group_id\": null, \"bootable\": false, \"multiattach\": false, \"replication_status\": null, \"replication_extended_status\": null, \"replication_driver_data\": null, \"previous_status\": \"available\", \"service_uuid\": \"6d4b0e79-fefe-4744-b25f-34be05095200\", \"shared_targets\": true, \"deleted_at\": null, \"deleted\": false, \"created_at\": \"2026-07-03T09:53:22.000000\", \"updated_at\": \"2026-07-03T09:53:23.000000\"}}" Jul 03 09:55:08.625415 np0000004400 cinder-backup[101319]: }. {{(pid=101319) _read_metadata /opt/stack/cinder/cinder/backup/chunkeddriver.py:327}} Jul 03 09:55:08.629087 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-2d411271-819e-4ff8-9ff7-19c4dc43a294 tempest-ProjectMemberTests33-2105464604 None] v1 volume backup restore of 0871942a-e198-4230-a099-29a52a21849b started. {{(pid=101319) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:678}} Jul 03 09:55:08.629087 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-2d411271-819e-4ff8-9ff7-19c4dc43a294 tempest-ProjectMemberTests33-2105464604 None] metadata_object_names = ['volume_5f57fed7-aa36-44c5-af90-863bd3d3af9d/20260703095328/az_nova_backup_0871942a-e198-4230-a099-29a52a21849b-00001', 'volume_5f57fed7-aa36-44c5-af90-863bd3d3af9d/20260703095328/az_nova_backup_0871942a-e198-4230-a099-29a52a21849b-00002', 'volume_5f57fed7-aa36-44c5-af90-863bd3d3af9d/20260703095328/az_nova_backup_0871942a-e198-4230-a099-29a52a21849b-00003', 'volume_5f57fed7-aa36-44c5-af90-863bd3d3af9d/20260703095328/az_nova_backup_0871942a-e198-4230-a099-29a52a21849b-00004', 'volume_5f57fed7-aa36-44c5-af90-863bd3d3af9d/20260703095328/az_nova_backup_0871942a-e198-4230-a099-29a52a21849b-00005', 'volume_5f57fed7-aa36-44c5-af90-863bd3d3af9d/20260703095328/az_nova_backup_0871942a-e198-4230-a099-29a52a21849b-00006', 'volume_5f57fed7-aa36-44c5-af90-863bd3d3af9d/20260703095328/az_nova_backup_0871942a-e198-4230-a099-29a52a21849b-00007', 'volume_5f57fed7-aa36-44c5-af90-863bd3d3af9d/20260703095328/az_nova_backup_0871942a-e198-4230-a099-29a52a21849b-00008', 'volume_5f57fed7-aa36-44c5-af90-863bd3d3af9d/20260703095328/az_nova_backup_0871942a-e198-4230-a099-29a52a21849b-00009', 'volume_5f57fed7-aa36-44c5-af90-863bd3d3af9d/20260703095328/az_nova_backup_0871942a-e198-4230-a099-29a52a21849b-00010', 'volume_5f57fed7-aa36-44c5-af90-863bd3d3af9d/20260703095328/az_nova_backup_0871942a-e198-4230-a099-29a52a21849b-00011', 'volume_5f57fed7-aa36-44c5-af90-863bd3d3af9d/20260703095328/az_nova_backup_0871942a-e198-4230-a099-29a52a21849b-00012', 'volume_5f57fed7-aa36-44c5-af90-863bd3d3af9d/20260703095328/az_nova_backup_0871942a-e198-4230-a099-29a52a21849b-00013', 'volume_5f57fed7-aa36-44c5-af90-863bd3d3af9d/20260703095328/az_nova_backup_0871942a-e198-4230-a099-29a52a21849b-00014', 'volume_5f57fed7-aa36-44c5-af90-863bd3d3af9d/20260703095328/az_nova_backup_0871942a-e198-4230-a099-29a52a21849b-00015', 'volume_5f57fed7-aa36-44c5-af90-863bd3d3af9d/20260703095328/az_nova_backup_0871942a-e198-4230-a099-29a52a21849b-00016', 'volume_5f57fed7-aa36-44c5-af90-863bd3d3af9d/20260703095328/az_nova_backup_0871942a-e198-4230-a099-29a52a21849b-00017', 'volume_5f57fed7-aa36-44c5-af90-863bd3d3af9d/20260703095328/az_nova_backup_0871942a-e198-4230-a099-29a52a21849b-00018', 'volume_5f57fed7-aa36-44c5-af90-863bd3d3af9d/20260703095328/az_nova_backup_0871942a-e198-4230-a099-29a52a21849b-00019', 'volume_5f57fed7-aa36-44c5-af90-863bd3d3af9d/20260703095328/az_nova_backup_0871942a-e198-4230-a099-29a52a21849b-00020', 'volume_5f57fed7-aa36-44c5-af90-863bd3d3af9d/20260703095328/az_nova_backup_0871942a-e198-4230-a099-29a52a21849b-00021']. {{(pid=101319) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:685}} Jul 03 09:55:08.669874 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-2d411271-819e-4ff8-9ff7-19c4dc43a294 tempest-ProjectMemberTests33-2105464604 None] generated object list: ['volume_5f57fed7-aa36-44c5-af90-863bd3d3af9d/20260703095328/az_nova_backup_0871942a-e198-4230-a099-29a52a21849b-00001', 'volume_5f57fed7-aa36-44c5-af90-863bd3d3af9d/20260703095328/az_nova_backup_0871942a-e198-4230-a099-29a52a21849b-00002', 'volume_5f57fed7-aa36-44c5-af90-863bd3d3af9d/20260703095328/az_nova_backup_0871942a-e198-4230-a099-29a52a21849b-00003', 'volume_5f57fed7-aa36-44c5-af90-863bd3d3af9d/20260703095328/az_nova_backup_0871942a-e198-4230-a099-29a52a21849b-00004', 'volume_5f57fed7-aa36-44c5-af90-863bd3d3af9d/20260703095328/az_nova_backup_0871942a-e198-4230-a099-29a52a21849b-00005', 'volume_5f57fed7-aa36-44c5-af90-863bd3d3af9d/20260703095328/az_nova_backup_0871942a-e198-4230-a099-29a52a21849b-00006', 'volume_5f57fed7-aa36-44c5-af90-863bd3d3af9d/20260703095328/az_nova_backup_0871942a-e198-4230-a099-29a52a21849b-00007', 'volume_5f57fed7-aa36-44c5-af90-863bd3d3af9d/20260703095328/az_nova_backup_0871942a-e198-4230-a099-29a52a21849b-00008', 'volume_5f57fed7-aa36-44c5-af90-863bd3d3af9d/20260703095328/az_nova_backup_0871942a-e198-4230-a099-29a52a21849b-00009', 'volume_5f57fed7-aa36-44c5-af90-863bd3d3af9d/20260703095328/az_nova_backup_0871942a-e198-4230-a099-29a52a21849b-00010', 'volume_5f57fed7-aa36-44c5-af90-863bd3d3af9d/20260703095328/az_nova_backup_0871942a-e198-4230-a099-29a52a21849b-00011', 'volume_5f57fed7-aa36-44c5-af90-863bd3d3af9d/20260703095328/az_nova_backup_0871942a-e198-4230-a099-29a52a21849b-00012', 'volume_5f57fed7-aa36-44c5-af90-863bd3d3af9d/20260703095328/az_nova_backup_0871942a-e198-4230-a099-29a52a21849b-00013', 'volume_5f57fed7-aa36-44c5-af90-863bd3d3af9d/20260703095328/az_nova_backup_0871942a-e198-4230-a099-29a52a21849b-00014', 'volume_5f57fed7-aa36-44c5-af90-863bd3d3af9d/20260703095328/az_nova_backup_0871942a-e198-4230-a099-29a52a21849b-00015', 'volume_5f57fed7-aa36-44c5-af90-863bd3d3af9d/20260703095328/az_nova_backup_0871942a-e198-4230-a099-29a52a21849b-00016', 'volume_5f57fed7-aa36-44c5-af90-863bd3d3af9d/20260703095328/az_nova_backup_0871942a-e198-4230-a099-29a52a21849b-00017', 'volume_5f57fed7-aa36-44c5-af90-863bd3d3af9d/20260703095328/az_nova_backup_0871942a-e198-4230-a099-29a52a21849b-00018', 'volume_5f57fed7-aa36-44c5-af90-863bd3d3af9d/20260703095328/az_nova_backup_0871942a-e198-4230-a099-29a52a21849b-00019', 'volume_5f57fed7-aa36-44c5-af90-863bd3d3af9d/20260703095328/az_nova_backup_0871942a-e198-4230-a099-29a52a21849b-00020', 'volume_5f57fed7-aa36-44c5-af90-863bd3d3af9d/20260703095328/az_nova_backup_0871942a-e198-4230-a099-29a52a21849b-00021', 'volume_5f57fed7-aa36-44c5-af90-863bd3d3af9d/20260703095328/az_nova_backup_0871942a-e198-4230-a099-29a52a21849b_metadata', 'volume_5f57fed7-aa36-44c5-af90-863bd3d3af9d/20260703095328/az_nova_backup_0871942a-e198-4230-a099-29a52a21849b_sha256file']. {{(pid=101319) _generate_object_names /opt/stack/cinder/cinder/backup/chunkeddriver.py:260}} Jul 03 09:55:08.710175 np0000004400 cinder-backup[101319]: DEBUG oslo_db.sqlalchemy.engines [None req-2d411271-819e-4ff8-9ff7-19c4dc43a294 tempest-ProjectMemberTests33-2105464604 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=101319) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 03 09:55:08.713847 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-2d411271-819e-4ff8-9ff7-19c4dc43a294 tempest-ProjectMemberTests33-2105464604 None] restoring object. backup: 0871942a-e198-4230-a099-29a52a21849b, container: volumebackups, object name: volume_5f57fed7-aa36-44c5-af90-863bd3d3af9d/20260703095328/az_nova_backup_0871942a-e198-4230-a099-29a52a21849b-00001, volume: 0f290778-6281-48b9-8149-decd4057b72c. {{(pid=101319) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:705}} Jul 03 09:55:08.725561 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-2d411271-819e-4ff8-9ff7-19c4dc43a294 tempest-ProjectMemberTests33-2105464604 None] decompressing data using zlib algorithm {{(pid=101319) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:722}} Jul 03 09:55:09.048368 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-2d411271-819e-4ff8-9ff7-19c4dc43a294 tempest-ProjectMemberTests33-2105464604 None] restoring object. backup: 0871942a-e198-4230-a099-29a52a21849b, container: volumebackups, object name: volume_5f57fed7-aa36-44c5-af90-863bd3d3af9d/20260703095328/az_nova_backup_0871942a-e198-4230-a099-29a52a21849b-00002, volume: 0f290778-6281-48b9-8149-decd4057b72c. {{(pid=101319) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:705}} Jul 03 09:55:09.060770 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-2d411271-819e-4ff8-9ff7-19c4dc43a294 tempest-ProjectMemberTests33-2105464604 None] decompressing data using zlib algorithm {{(pid=101319) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:722}} Jul 03 09:55:09.385183 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-2d411271-819e-4ff8-9ff7-19c4dc43a294 tempest-ProjectMemberTests33-2105464604 None] restoring object. backup: 0871942a-e198-4230-a099-29a52a21849b, container: volumebackups, object name: volume_5f57fed7-aa36-44c5-af90-863bd3d3af9d/20260703095328/az_nova_backup_0871942a-e198-4230-a099-29a52a21849b-00003, volume: 0f290778-6281-48b9-8149-decd4057b72c. {{(pid=101319) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:705}} Jul 03 09:55:09.401055 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-2d411271-819e-4ff8-9ff7-19c4dc43a294 tempest-ProjectMemberTests33-2105464604 None] decompressing data using zlib algorithm {{(pid=101319) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:722}} Jul 03 09:55:09.731023 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-2d411271-819e-4ff8-9ff7-19c4dc43a294 tempest-ProjectMemberTests33-2105464604 None] restoring object. backup: 0871942a-e198-4230-a099-29a52a21849b, container: volumebackups, object name: volume_5f57fed7-aa36-44c5-af90-863bd3d3af9d/20260703095328/az_nova_backup_0871942a-e198-4230-a099-29a52a21849b-00004, volume: 0f290778-6281-48b9-8149-decd4057b72c. {{(pid=101319) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:705}} Jul 03 09:55:09.743179 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-2d411271-819e-4ff8-9ff7-19c4dc43a294 tempest-ProjectMemberTests33-2105464604 None] decompressing data using zlib algorithm {{(pid=101319) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:722}} Jul 03 09:55:10.063870 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-2d411271-819e-4ff8-9ff7-19c4dc43a294 tempest-ProjectMemberTests33-2105464604 None] restoring object. backup: 0871942a-e198-4230-a099-29a52a21849b, container: volumebackups, object name: volume_5f57fed7-aa36-44c5-af90-863bd3d3af9d/20260703095328/az_nova_backup_0871942a-e198-4230-a099-29a52a21849b-00005, volume: 0f290778-6281-48b9-8149-decd4057b72c. {{(pid=101319) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:705}} Jul 03 09:55:10.076663 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-2d411271-819e-4ff8-9ff7-19c4dc43a294 tempest-ProjectMemberTests33-2105464604 None] decompressing data using zlib algorithm {{(pid=101319) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:722}} Jul 03 09:55:10.397230 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-2d411271-819e-4ff8-9ff7-19c4dc43a294 tempest-ProjectMemberTests33-2105464604 None] restoring object. backup: 0871942a-e198-4230-a099-29a52a21849b, container: volumebackups, object name: volume_5f57fed7-aa36-44c5-af90-863bd3d3af9d/20260703095328/az_nova_backup_0871942a-e198-4230-a099-29a52a21849b-00006, volume: 0f290778-6281-48b9-8149-decd4057b72c. {{(pid=101319) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:705}} Jul 03 09:55:10.410259 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-2d411271-819e-4ff8-9ff7-19c4dc43a294 tempest-ProjectMemberTests33-2105464604 None] decompressing data using zlib algorithm {{(pid=101319) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:722}} Jul 03 09:55:10.739786 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-2d411271-819e-4ff8-9ff7-19c4dc43a294 tempest-ProjectMemberTests33-2105464604 None] restoring object. backup: 0871942a-e198-4230-a099-29a52a21849b, container: volumebackups, object name: volume_5f57fed7-aa36-44c5-af90-863bd3d3af9d/20260703095328/az_nova_backup_0871942a-e198-4230-a099-29a52a21849b-00007, volume: 0f290778-6281-48b9-8149-decd4057b72c. {{(pid=101319) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:705}} Jul 03 09:55:10.754779 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-2d411271-819e-4ff8-9ff7-19c4dc43a294 tempest-ProjectMemberTests33-2105464604 None] decompressing data using zlib algorithm {{(pid=101319) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:722}} Jul 03 09:55:11.079350 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-2d411271-819e-4ff8-9ff7-19c4dc43a294 tempest-ProjectMemberTests33-2105464604 None] restoring object. backup: 0871942a-e198-4230-a099-29a52a21849b, container: volumebackups, object name: volume_5f57fed7-aa36-44c5-af90-863bd3d3af9d/20260703095328/az_nova_backup_0871942a-e198-4230-a099-29a52a21849b-00008, volume: 0f290778-6281-48b9-8149-decd4057b72c. {{(pid=101319) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:705}} Jul 03 09:55:11.093166 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-2d411271-819e-4ff8-9ff7-19c4dc43a294 tempest-ProjectMemberTests33-2105464604 None] decompressing data using zlib algorithm {{(pid=101319) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:722}} Jul 03 09:55:11.409764 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-2d411271-819e-4ff8-9ff7-19c4dc43a294 tempest-ProjectMemberTests33-2105464604 None] restoring object. backup: 0871942a-e198-4230-a099-29a52a21849b, container: volumebackups, object name: volume_5f57fed7-aa36-44c5-af90-863bd3d3af9d/20260703095328/az_nova_backup_0871942a-e198-4230-a099-29a52a21849b-00009, volume: 0f290778-6281-48b9-8149-decd4057b72c. {{(pid=101319) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:705}} Jul 03 09:55:11.422351 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-2d411271-819e-4ff8-9ff7-19c4dc43a294 tempest-ProjectMemberTests33-2105464604 None] decompressing data using zlib algorithm {{(pid=101319) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:722}} Jul 03 09:55:11.750019 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-2d411271-819e-4ff8-9ff7-19c4dc43a294 tempest-ProjectMemberTests33-2105464604 None] restoring object. backup: 0871942a-e198-4230-a099-29a52a21849b, container: volumebackups, object name: volume_5f57fed7-aa36-44c5-af90-863bd3d3af9d/20260703095328/az_nova_backup_0871942a-e198-4230-a099-29a52a21849b-00010, volume: 0f290778-6281-48b9-8149-decd4057b72c. {{(pid=101319) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:705}} Jul 03 09:55:11.762025 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-2d411271-819e-4ff8-9ff7-19c4dc43a294 tempest-ProjectMemberTests33-2105464604 None] decompressing data using zlib algorithm {{(pid=101319) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:722}} Jul 03 09:55:12.083603 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-2d411271-819e-4ff8-9ff7-19c4dc43a294 tempest-ProjectMemberTests33-2105464604 None] restoring object. backup: 0871942a-e198-4230-a099-29a52a21849b, container: volumebackups, object name: volume_5f57fed7-aa36-44c5-af90-863bd3d3af9d/20260703095328/az_nova_backup_0871942a-e198-4230-a099-29a52a21849b-00011, volume: 0f290778-6281-48b9-8149-decd4057b72c. {{(pid=101319) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:705}} Jul 03 09:55:12.096836 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-2d411271-819e-4ff8-9ff7-19c4dc43a294 tempest-ProjectMemberTests33-2105464604 None] decompressing data using zlib algorithm {{(pid=101319) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:722}} Jul 03 09:55:12.413902 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-2d411271-819e-4ff8-9ff7-19c4dc43a294 tempest-ProjectMemberTests33-2105464604 None] restoring object. backup: 0871942a-e198-4230-a099-29a52a21849b, container: volumebackups, object name: volume_5f57fed7-aa36-44c5-af90-863bd3d3af9d/20260703095328/az_nova_backup_0871942a-e198-4230-a099-29a52a21849b-00012, volume: 0f290778-6281-48b9-8149-decd4057b72c. {{(pid=101319) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:705}} Jul 03 09:55:12.426906 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-2d411271-819e-4ff8-9ff7-19c4dc43a294 tempest-ProjectMemberTests33-2105464604 None] decompressing data using zlib algorithm {{(pid=101319) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:722}} Jul 03 09:55:12.757003 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-2d411271-819e-4ff8-9ff7-19c4dc43a294 tempest-ProjectMemberTests33-2105464604 None] restoring object. backup: 0871942a-e198-4230-a099-29a52a21849b, container: volumebackups, object name: volume_5f57fed7-aa36-44c5-af90-863bd3d3af9d/20260703095328/az_nova_backup_0871942a-e198-4230-a099-29a52a21849b-00013, volume: 0f290778-6281-48b9-8149-decd4057b72c. {{(pid=101319) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:705}} Jul 03 09:55:12.770947 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-2d411271-819e-4ff8-9ff7-19c4dc43a294 tempest-ProjectMemberTests33-2105464604 None] decompressing data using zlib algorithm {{(pid=101319) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:722}} Jul 03 09:55:13.093096 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-2d411271-819e-4ff8-9ff7-19c4dc43a294 tempest-ProjectMemberTests33-2105464604 None] restoring object. backup: 0871942a-e198-4230-a099-29a52a21849b, container: volumebackups, object name: volume_5f57fed7-aa36-44c5-af90-863bd3d3af9d/20260703095328/az_nova_backup_0871942a-e198-4230-a099-29a52a21849b-00014, volume: 0f290778-6281-48b9-8149-decd4057b72c. {{(pid=101319) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:705}} Jul 03 09:55:13.105147 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-2d411271-819e-4ff8-9ff7-19c4dc43a294 tempest-ProjectMemberTests33-2105464604 None] decompressing data using zlib algorithm {{(pid=101319) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:722}} Jul 03 09:55:13.429655 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-2d411271-819e-4ff8-9ff7-19c4dc43a294 tempest-ProjectMemberTests33-2105464604 None] restoring object. backup: 0871942a-e198-4230-a099-29a52a21849b, container: volumebackups, object name: volume_5f57fed7-aa36-44c5-af90-863bd3d3af9d/20260703095328/az_nova_backup_0871942a-e198-4230-a099-29a52a21849b-00015, volume: 0f290778-6281-48b9-8149-decd4057b72c. {{(pid=101319) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:705}} Jul 03 09:55:13.442671 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-2d411271-819e-4ff8-9ff7-19c4dc43a294 tempest-ProjectMemberTests33-2105464604 None] decompressing data using zlib algorithm {{(pid=101319) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:722}} Jul 03 09:55:13.771117 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-2d411271-819e-4ff8-9ff7-19c4dc43a294 tempest-ProjectMemberTests33-2105464604 None] restoring object. backup: 0871942a-e198-4230-a099-29a52a21849b, container: volumebackups, object name: volume_5f57fed7-aa36-44c5-af90-863bd3d3af9d/20260703095328/az_nova_backup_0871942a-e198-4230-a099-29a52a21849b-00016, volume: 0f290778-6281-48b9-8149-decd4057b72c. {{(pid=101319) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:705}} Jul 03 09:55:13.785348 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-2d411271-819e-4ff8-9ff7-19c4dc43a294 tempest-ProjectMemberTests33-2105464604 None] decompressing data using zlib algorithm {{(pid=101319) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:722}} Jul 03 09:55:14.112204 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-2d411271-819e-4ff8-9ff7-19c4dc43a294 tempest-ProjectMemberTests33-2105464604 None] restoring object. backup: 0871942a-e198-4230-a099-29a52a21849b, container: volumebackups, object name: volume_5f57fed7-aa36-44c5-af90-863bd3d3af9d/20260703095328/az_nova_backup_0871942a-e198-4230-a099-29a52a21849b-00017, volume: 0f290778-6281-48b9-8149-decd4057b72c. {{(pid=101319) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:705}} Jul 03 09:55:14.126135 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-2d411271-819e-4ff8-9ff7-19c4dc43a294 tempest-ProjectMemberTests33-2105464604 None] decompressing data using zlib algorithm {{(pid=101319) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:722}} Jul 03 09:55:14.454829 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-2d411271-819e-4ff8-9ff7-19c4dc43a294 tempest-ProjectMemberTests33-2105464604 None] restoring object. backup: 0871942a-e198-4230-a099-29a52a21849b, container: volumebackups, object name: volume_5f57fed7-aa36-44c5-af90-863bd3d3af9d/20260703095328/az_nova_backup_0871942a-e198-4230-a099-29a52a21849b-00018, volume: 0f290778-6281-48b9-8149-decd4057b72c. {{(pid=101319) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:705}} Jul 03 09:55:14.471745 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-2d411271-819e-4ff8-9ff7-19c4dc43a294 tempest-ProjectMemberTests33-2105464604 None] decompressing data using zlib algorithm {{(pid=101319) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:722}} Jul 03 09:55:14.808812 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-2d411271-819e-4ff8-9ff7-19c4dc43a294 tempest-ProjectMemberTests33-2105464604 None] restoring object. backup: 0871942a-e198-4230-a099-29a52a21849b, container: volumebackups, object name: volume_5f57fed7-aa36-44c5-af90-863bd3d3af9d/20260703095328/az_nova_backup_0871942a-e198-4230-a099-29a52a21849b-00019, volume: 0f290778-6281-48b9-8149-decd4057b72c. {{(pid=101319) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:705}} Jul 03 09:55:14.823207 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-2d411271-819e-4ff8-9ff7-19c4dc43a294 tempest-ProjectMemberTests33-2105464604 None] decompressing data using zlib algorithm {{(pid=101319) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:722}} Jul 03 09:55:15.150886 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-2d411271-819e-4ff8-9ff7-19c4dc43a294 tempest-ProjectMemberTests33-2105464604 None] restoring object. backup: 0871942a-e198-4230-a099-29a52a21849b, container: volumebackups, object name: volume_5f57fed7-aa36-44c5-af90-863bd3d3af9d/20260703095328/az_nova_backup_0871942a-e198-4230-a099-29a52a21849b-00020, volume: 0f290778-6281-48b9-8149-decd4057b72c. {{(pid=101319) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:705}} Jul 03 09:55:15.165742 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-2d411271-819e-4ff8-9ff7-19c4dc43a294 tempest-ProjectMemberTests33-2105464604 None] decompressing data using zlib algorithm {{(pid=101319) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:722}} Jul 03 09:55:15.495945 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-2d411271-819e-4ff8-9ff7-19c4dc43a294 tempest-ProjectMemberTests33-2105464604 None] restoring object. backup: 0871942a-e198-4230-a099-29a52a21849b, container: volumebackups, object name: volume_5f57fed7-aa36-44c5-af90-863bd3d3af9d/20260703095328/az_nova_backup_0871942a-e198-4230-a099-29a52a21849b-00021, volume: 0f290778-6281-48b9-8149-decd4057b72c. {{(pid=101319) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:705}} Jul 03 09:55:15.511683 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-2d411271-819e-4ff8-9ff7-19c4dc43a294 tempest-ProjectMemberTests33-2105464604 None] decompressing data using zlib algorithm {{(pid=101319) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:722}} Jul 03 09:55:15.675923 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-2d411271-819e-4ff8-9ff7-19c4dc43a294 tempest-ProjectMemberTests33-2105464604 None] v1 volume backup restore of 0871942a-e198-4230-a099-29a52a21849b finished. {{(pid=101319) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:750}} Jul 03 09:55:15.676278 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.driver [None req-2d411271-819e-4ff8-9ff7-19c4dc43a294 tempest-ProjectMemberTests33-2105464604 None] Restoring volume base metadata {{(pid=101319) _restore_vol_base_meta /opt/stack/cinder/cinder/backup/driver.py:177}} Jul 03 09:55:15.684423 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.driver [None req-2d411271-819e-4ff8-9ff7-19c4dc43a294 tempest-ProjectMemberTests33-2105464604 None] Excluding field 'display_name' {{(pid=101319) _filter /opt/stack/cinder/cinder/backup/driver.py:171}} Jul 03 09:55:15.684635 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.driver [None req-2d411271-819e-4ff8-9ff7-19c4dc43a294 tempest-ProjectMemberTests33-2105464604 None] Excluding field 'display_description' {{(pid=101319) _filter /opt/stack/cinder/cinder/backup/driver.py:171}} Jul 03 09:55:15.690963 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.driver [None req-2d411271-819e-4ff8-9ff7-19c4dc43a294 tempest-ProjectMemberTests33-2105464604 None] No metadata of type 'volume-metadata' to restore {{(pid=101319) put /opt/stack/cinder/cinder/backup/driver.py:345}} Jul 03 09:55:15.691258 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.driver [None req-2d411271-819e-4ff8-9ff7-19c4dc43a294 tempest-ProjectMemberTests33-2105464604 None] No metadata of type 'volume-glance-metadata' to restore {{(pid=101319) put /opt/stack/cinder/cinder/backup/driver.py:345}} Jul 03 09:55:15.691548 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-2d411271-819e-4ff8-9ff7-19c4dc43a294 tempest-ProjectMemberTests33-2105464604 None] restore 0871942a-e198-4230-a099-29a52a21849b to 0f290778-6281-48b9-8149-decd4057b72c finished. {{(pid=101319) restore /opt/stack/cinder/cinder/backup/chunkeddriver.py:815}} Jul 03 09:55:15.692139 np0000004400 cinder-backup[101319]: DEBUG oslo_concurrency.processutils [None req-2d411271-819e-4ff8-9ff7-19c4dc43a294 tempest-ProjectMemberTests33-2105464604 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chown 0 /dev/sdb {{(pid=101319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 09:55:15.712464 np0000004400 sudo[157871]: stack : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chown 0 /dev/sdb Jul 03 09:55:15.713083 np0000004400 sudo[157871]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1002) Jul 03 09:55:16.005626 np0000004400 sudo[157871]: pam_unix(sudo:session): session closed for user root Jul 03 09:55:16.007786 np0000004400 cinder-backup[101319]: DEBUG oslo_concurrency.processutils [None req-2d411271-819e-4ff8-9ff7-19c4dc43a294 tempest-ProjectMemberTests33-2105464604 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chown 0 /dev/sdb" returned: 0 in 0.315s {{(pid=101319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 09:55:16.008535 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-2d411271-819e-4ff8-9ff7-19c4dc43a294 tempest-ProjectMemberTests33-2105464604 None] ==> disconnect_volume: call "{'args': (, {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-0f290778-6281-48b9-8149-decd4057b72c', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '0f290778-6281-48b9-8149-decd4057b72c', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': False}, {'type': 'block', 'scsi_wwn': 'SStorPool_iSCSI_DISK_1034578903445799244', 'path': '/dev/sdb'}), 'kwargs': {'force': True, 'ignore_errors': False}}" {{(pid=101319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}} Jul 03 09:55:16.008812 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.base [None req-2d411271-819e-4ff8-9ff7-19c4dc43a294 tempest-ProjectMemberTests33-2105464604 None] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=101319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jul 03 09:55:16.009451 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.base [None req-2d411271-819e-4ff8-9ff7-19c4dc43a294 tempest-ProjectMemberTests33-2105464604 None] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=101319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jul 03 09:55:16.009922 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-2d411271-819e-4ff8-9ff7-19c4dc43a294 tempest-ProjectMemberTests33-2105464604 None] _get_connection_devices called with parameters: connection_properties={'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-0f290778-6281-48b9-8149-decd4057b72c', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '0f290778-6281-48b9-8149-decd4057b72c', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': False}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=101319) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:847}} Jul 03 09:55:16.020010 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-2d411271-819e-4ff8-9ff7-19c4dc43a294 tempest-ProjectMemberTests33-2105464604 None] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS: Jul 03 09:55:16.020010 np0000004400 cinder-backup[101319]: No targets found. Jul 03 09:55:16.020010 np0000004400 cinder-backup[101319]: iSNS: Jul 03 09:55:16.020010 np0000004400 cinder-backup[101319]: No targets found. Jul 03 09:55:16.020010 np0000004400 cinder-backup[101319]: STATIC: Jul 03 09:55:16.020010 np0000004400 cinder-backup[101319]: Target: iqn.2023-03.storpool.com:os--volume-89e76f2c-a2cb-4033-b4b5-23cd05348d51 Jul 03 09:55:16.020010 np0000004400 cinder-backup[101319]: Portal: 192.168.50.100:3260,-1 Jul 03 09:55:16.020010 np0000004400 cinder-backup[101319]: Iface Name: default Jul 03 09:55:16.020010 np0000004400 cinder-backup[101319]: Portal: 192.168.40.100:3260,-1 Jul 03 09:55:16.020010 np0000004400 cinder-backup[101319]: Iface Name: default Jul 03 09:55:16.020010 np0000004400 cinder-backup[101319]: Target: iqn.2023-03.storpool.com:os--volume-0f290778-6281-48b9-8149-decd4057b72c Jul 03 09:55:16.020010 np0000004400 cinder-backup[101319]: Portal: 192.168.40.100:3260,-1 Jul 03 09:55:16.020010 np0000004400 cinder-backup[101319]: Iface Name: default Jul 03 09:55:16.020010 np0000004400 cinder-backup[101319]: Target: iqn.2023-03.storpool.com:os--volume-445f2376-ada3-45fa-89b0-1bd9e9029079 Jul 03 09:55:16.020010 np0000004400 cinder-backup[101319]: Portal: 192.168.50.100:3260,-1 Jul 03 09:55:16.020010 np0000004400 cinder-backup[101319]: Iface Name: default Jul 03 09:55:16.020010 np0000004400 cinder-backup[101319]: Portal: 192.168.40.100:3260,-1 Jul 03 09:55:16.020010 np0000004400 cinder-backup[101319]: Iface Name: default Jul 03 09:55:16.020010 np0000004400 cinder-backup[101319]: FIRMWARE: Jul 03 09:55:16.020010 np0000004400 cinder-backup[101319]: No targets found. Jul 03 09:55:16.020010 np0000004400 cinder-backup[101319]: stderr= {{(pid=101319) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jul 03 09:55:16.020481 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-2d411271-819e-4ff8-9ff7-19c4dc43a294 tempest-ProjectMemberTests33-2105464604 None] Regex to get portals from discoverydb: ^SENDTARGETS: Jul 03 09:55:16.020481 np0000004400 cinder-backup[101319]: .*?^DiscoveryAddress: 192.168.40.100,3260.*? Jul 03 09:55:16.020481 np0000004400 cinder-backup[101319]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=101319) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:390}} Jul 03 09:55:16.020625 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-2d411271-819e-4ff8-9ff7-19c4dc43a294 tempest-ProjectMemberTests33-2105464604 None] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-0f290778-6281-48b9-8149-decd4057b72c', 0)] {{(pid=101319) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:858}} Jul 03 09:55:16.041151 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-2d411271-819e-4ff8-9ff7-19c4dc43a294 tempest-ProjectMemberTests33-2105464604 None] iscsiadm ('-m', 'session'): stdout=tcp: [220] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0f290778-6281-48b9-8149-decd4057b72c (non-flash) Jul 03 09:55:16.041151 np0000004400 cinder-backup[101319]: tcp: [221] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-89e76f2c-a2cb-4033-b4b5-23cd05348d51 (non-flash) Jul 03 09:55:16.041151 np0000004400 cinder-backup[101319]: tcp: [222] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-89e76f2c-a2cb-4033-b4b5-23cd05348d51 (non-flash) Jul 03 09:55:16.041151 np0000004400 cinder-backup[101319]: tcp: [223] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-445f2376-ada3-45fa-89b0-1bd9e9029079 (non-flash) Jul 03 09:55:16.041151 np0000004400 cinder-backup[101319]: tcp: [224] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-445f2376-ada3-45fa-89b0-1bd9e9029079 (non-flash) Jul 03 09:55:16.041151 np0000004400 cinder-backup[101319]: stderr= {{(pid=101319) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jul 03 09:55:16.041363 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-2d411271-819e-4ff8-9ff7-19c4dc43a294 tempest-ProjectMemberTests33-2105464604 None] iscsi session list stdout=tcp: [220] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0f290778-6281-48b9-8149-decd4057b72c (non-flash) Jul 03 09:55:16.041363 np0000004400 cinder-backup[101319]: tcp: [221] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-89e76f2c-a2cb-4033-b4b5-23cd05348d51 (non-flash) Jul 03 09:55:16.041363 np0000004400 cinder-backup[101319]: tcp: [222] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-89e76f2c-a2cb-4033-b4b5-23cd05348d51 (non-flash) Jul 03 09:55:16.041363 np0000004400 cinder-backup[101319]: tcp: [223] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-445f2376-ada3-45fa-89b0-1bd9e9029079 (non-flash) Jul 03 09:55:16.041363 np0000004400 cinder-backup[101319]: tcp: [224] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-445f2376-ada3-45fa-89b0-1bd9e9029079 (non-flash) Jul 03 09:55:16.041363 np0000004400 cinder-backup[101319]: stderr= {{(pid=101319) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jul 03 09:55:16.041656 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-2d411271-819e-4ff8-9ff7-19c4dc43a294 tempest-ProjectMemberTests33-2105464604 None] Sessions list: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-0f290778-6281-48b9-8149-decd4057b72c', '220'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-89e76f2c-a2cb-4033-b4b5-23cd05348d51', '221'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-89e76f2c-a2cb-4033-b4b5-23cd05348d51', '222'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-445f2376-ada3-45fa-89b0-1bd9e9029079', '223'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-445f2376-ada3-45fa-89b0-1bd9e9029079', '224')] {{(pid=101319) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:866}} Jul 03 09:55:16.041892 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-2d411271-819e-4ff8-9ff7-19c4dc43a294 tempest-ProjectMemberTests33-2105464604 None] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-0f290778-6281-48b9-8149-decd4057b72c, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-0f290778-6281-48b9-8149-decd4057b72c', '220')] {{(pid=101319) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}} Jul 03 09:55:16.042996 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-2d411271-819e-4ff8-9ff7-19c4dc43a294 tempest-ProjectMemberTests33-2105464604 None] Resulting device map defaultdict(. at 0x7e76e7355d00>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-0f290778-6281-48b9-8149-decd4057b72c'): ({'sdb'}, set())}) {{(pid=101319) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:912}} Jul 03 09:55:16.043266 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.linuxscsi [None req-2d411271-819e-4ff8-9ff7-19c4dc43a294 tempest-ProjectMemberTests33-2105464604 None] Removing single pathed devices sdb {{(pid=101319) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}} Jul 03 09:55:16.052821 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.linuxscsi [None req-2d411271-819e-4ff8-9ff7-19c4dc43a294 tempest-ProjectMemberTests33-2105464604 None] Flushing IO for device /dev/sdb {{(pid=101319) flush_device_io /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:461}} Jul 03 09:55:16.059076 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.linuxscsi [None req-2d411271-819e-4ff8-9ff7-19c4dc43a294 tempest-ProjectMemberTests33-2105464604 None] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=101319) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}} Jul 03 09:55:16.092991 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.linuxscsi [None req-2d411271-819e-4ff8-9ff7-19c4dc43a294 tempest-ProjectMemberTests33-2105464604 None] Checking to see if SCSI volumes sdb have been removed. {{(pid=101319) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}} Jul 03 09:55:16.093239 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.linuxscsi [None req-2d411271-819e-4ff8-9ff7-19c4dc43a294 tempest-ProjectMemberTests33-2105464604 None] SCSI volumes sdb have been removed. {{(pid=101319) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}} Jul 03 09:55:16.094340 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.linuxscsi [None req-2d411271-819e-4ff8-9ff7-19c4dc43a294 tempest-ProjectMemberTests33-2105464604 None] Checking to see if device paths {'sdb'} are still under multipathd monitoring {{(pid=101319) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}} Jul 03 09:55:16.106359 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.linuxscsi [None req-2d411271-819e-4ff8-9ff7-19c4dc43a294 tempest-ProjectMemberTests33-2105464604 None] Device paths {'sdb'} have been removed from multipathd monitoring. {{(pid=101319) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}} Jul 03 09:55:16.106359 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-2d411271-819e-4ff8-9ff7-19c4dc43a294 tempest-ProjectMemberTests33-2105464604 None] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-0f290778-6281-48b9-8149-decd4057b72c')] {{(pid=101319) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1225}} Jul 03 09:55:16.117824 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-2d411271-819e-4ff8-9ff7-19c4dc43a294 tempest-ProjectMemberTests33-2105464604 None] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=101319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 03 09:55:16.148324 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-2d411271-819e-4ff8-9ff7-19c4dc43a294 tempest-ProjectMemberTests33-2105464604 None] iscsiadm ('--logout',): stdout=Logging out of session [sid: 220, target: iqn.2023-03.storpool.com:os--volume-0f290778-6281-48b9-8149-decd4057b72c, portal: 192.168.40.100,3260] Jul 03 09:55:16.148324 np0000004400 cinder-backup[101319]: Logout of [sid: 220, target: iqn.2023-03.storpool.com:os--volume-0f290778-6281-48b9-8149-decd4057b72c, portal: 192.168.40.100,3260] successful. Jul 03 09:55:16.148324 np0000004400 cinder-backup[101319]: stderr= {{(pid=101319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 03 09:55:16.162630 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-2d411271-819e-4ff8-9ff7-19c4dc43a294 tempest-ProjectMemberTests33-2105464604 None] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=101319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 03 09:55:16.162955 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.base [None req-2d411271-819e-4ff8-9ff7-19c4dc43a294 tempest-ProjectMemberTests33-2105464604 None] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.154s {{(pid=101319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jul 03 09:55:16.163135 np0000004400 cinder-backup[101319]: DEBUG os_brick.initiator.connectors.iscsi [None req-2d411271-819e-4ff8-9ff7-19c4dc43a294 tempest-ProjectMemberTests33-2105464604 None] <== disconnect_volume: return (154ms) None {{(pid=101319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}} Jul 03 09:55:17.176523 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.manager [None req-2d411271-819e-4ff8-9ff7-19c4dc43a294 tempest-ProjectMemberTests33-2105464604 None] Encryption key ID for volume 0f290778-6281-48b9-8149-decd4057b72c already matches encryption key ID in backup 0871942a-e198-4230-a099-29a52a21849b. {{(pid=101319) _run_restore /opt/stack/cinder/cinder/backup/manager.py:873}} Jul 03 09:55:17.192753 np0000004400 cinder-backup[101319]: INFO cinder.backup.manager [None req-2d411271-819e-4ff8-9ff7-19c4dc43a294 tempest-ProjectMemberTests33-2105464604 None] Finished restoring backup 0871942a-e198-4230-a099-29a52a21849b to volume 0f290778-6281-48b9-8149-decd4057b72c. Jul 03 09:55:18.399993 np0000004400 cinder-backup[101319]: INFO cinder.backup.manager [None req-1a73a775-82a8-4c85-a8a6-59aa02e61f61 tempest-ProjectMemberTests33-2105464604 None] Delete backup started, backup: 0254456b-0a66-4125-8e17-8e1f79f703fe. Jul 03 09:55:18.406886 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.drivers.swift [None req-1a73a775-82a8-4c85-a8a6-59aa02e61f61 tempest-ProjectMemberTests33-2105464604 None] Using swift URL https://10.4.3.95:8080/v1/AUTH_e0b6e59b911e40b3acac38afb1f81e3a {{(pid=101319) initialize /opt/stack/cinder/cinder/backup/drivers/swift.py:300}} Jul 03 09:55:18.407166 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.drivers.swift [None req-1a73a775-82a8-4c85-a8a6-59aa02e61f61 tempest-ProjectMemberTests33-2105464604 None] Connect to https://10.4.3.95:8080/v1/AUTH_ in "per_user" mode {{(pid=101319) initialize /opt/stack/cinder/cinder/backup/drivers/swift.py:301}} Jul 03 09:55:18.407394 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-1a73a775-82a8-4c85-a8a6-59aa02e61f61 tempest-ProjectMemberTests33-2105464604 None] delete started, backup: 0254456b-0a66-4125-8e17-8e1f79f703fe, container: volumebackups, prefix: volume_a28b52f0-456d-4821-8de5-ec41566e1234/20260703095449/az_nova_backup_0254456b-0a66-4125-8e17-8e1f79f703fe. {{(pid=101319) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:822}} Jul 03 09:55:18.442586 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-1a73a775-82a8-4c85-a8a6-59aa02e61f61 tempest-ProjectMemberTests33-2105464604 None] generated object list: ['volume_a28b52f0-456d-4821-8de5-ec41566e1234/20260703095449/az_nova_backup_0254456b-0a66-4125-8e17-8e1f79f703fe-00001', 'volume_a28b52f0-456d-4821-8de5-ec41566e1234/20260703095449/az_nova_backup_0254456b-0a66-4125-8e17-8e1f79f703fe-00002', 'volume_a28b52f0-456d-4821-8de5-ec41566e1234/20260703095449/az_nova_backup_0254456b-0a66-4125-8e17-8e1f79f703fe-00003', 'volume_a28b52f0-456d-4821-8de5-ec41566e1234/20260703095449/az_nova_backup_0254456b-0a66-4125-8e17-8e1f79f703fe-00004', 'volume_a28b52f0-456d-4821-8de5-ec41566e1234/20260703095449/az_nova_backup_0254456b-0a66-4125-8e17-8e1f79f703fe-00005', 'volume_a28b52f0-456d-4821-8de5-ec41566e1234/20260703095449/az_nova_backup_0254456b-0a66-4125-8e17-8e1f79f703fe-00006', 'volume_a28b52f0-456d-4821-8de5-ec41566e1234/20260703095449/az_nova_backup_0254456b-0a66-4125-8e17-8e1f79f703fe-00007', 'volume_a28b52f0-456d-4821-8de5-ec41566e1234/20260703095449/az_nova_backup_0254456b-0a66-4125-8e17-8e1f79f703fe-00008', 'volume_a28b52f0-456d-4821-8de5-ec41566e1234/20260703095449/az_nova_backup_0254456b-0a66-4125-8e17-8e1f79f703fe-00009', 'volume_a28b52f0-456d-4821-8de5-ec41566e1234/20260703095449/az_nova_backup_0254456b-0a66-4125-8e17-8e1f79f703fe-00010', 'volume_a28b52f0-456d-4821-8de5-ec41566e1234/20260703095449/az_nova_backup_0254456b-0a66-4125-8e17-8e1f79f703fe-00011', 'volume_a28b52f0-456d-4821-8de5-ec41566e1234/20260703095449/az_nova_backup_0254456b-0a66-4125-8e17-8e1f79f703fe-00012', 'volume_a28b52f0-456d-4821-8de5-ec41566e1234/20260703095449/az_nova_backup_0254456b-0a66-4125-8e17-8e1f79f703fe-00013', 'volume_a28b52f0-456d-4821-8de5-ec41566e1234/20260703095449/az_nova_backup_0254456b-0a66-4125-8e17-8e1f79f703fe-00014', 'volume_a28b52f0-456d-4821-8de5-ec41566e1234/20260703095449/az_nova_backup_0254456b-0a66-4125-8e17-8e1f79f703fe-00015', 'volume_a28b52f0-456d-4821-8de5-ec41566e1234/20260703095449/az_nova_backup_0254456b-0a66-4125-8e17-8e1f79f703fe-00016', 'volume_a28b52f0-456d-4821-8de5-ec41566e1234/20260703095449/az_nova_backup_0254456b-0a66-4125-8e17-8e1f79f703fe-00017', 'volume_a28b52f0-456d-4821-8de5-ec41566e1234/20260703095449/az_nova_backup_0254456b-0a66-4125-8e17-8e1f79f703fe-00018', 'volume_a28b52f0-456d-4821-8de5-ec41566e1234/20260703095449/az_nova_backup_0254456b-0a66-4125-8e17-8e1f79f703fe-00019', 'volume_a28b52f0-456d-4821-8de5-ec41566e1234/20260703095449/az_nova_backup_0254456b-0a66-4125-8e17-8e1f79f703fe-00020', 'volume_a28b52f0-456d-4821-8de5-ec41566e1234/20260703095449/az_nova_backup_0254456b-0a66-4125-8e17-8e1f79f703fe-00021', 'volume_a28b52f0-456d-4821-8de5-ec41566e1234/20260703095449/az_nova_backup_0254456b-0a66-4125-8e17-8e1f79f703fe_metadata', 'volume_a28b52f0-456d-4821-8de5-ec41566e1234/20260703095449/az_nova_backup_0254456b-0a66-4125-8e17-8e1f79f703fe_sha256file']. {{(pid=101319) _generate_object_names /opt/stack/cinder/cinder/backup/chunkeddriver.py:260}} Jul 03 09:55:18.463947 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-1a73a775-82a8-4c85-a8a6-59aa02e61f61 tempest-ProjectMemberTests33-2105464604 None] deleted object: volume_a28b52f0-456d-4821-8de5-ec41566e1234/20260703095449/az_nova_backup_0254456b-0a66-4125-8e17-8e1f79f703fe-00001 in container: volumebackups. {{(pid=101319) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 09:55:18.482831 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-1a73a775-82a8-4c85-a8a6-59aa02e61f61 tempest-ProjectMemberTests33-2105464604 None] deleted object: volume_a28b52f0-456d-4821-8de5-ec41566e1234/20260703095449/az_nova_backup_0254456b-0a66-4125-8e17-8e1f79f703fe-00002 in container: volumebackups. {{(pid=101319) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 09:55:18.502710 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-1a73a775-82a8-4c85-a8a6-59aa02e61f61 tempest-ProjectMemberTests33-2105464604 None] deleted object: volume_a28b52f0-456d-4821-8de5-ec41566e1234/20260703095449/az_nova_backup_0254456b-0a66-4125-8e17-8e1f79f703fe-00003 in container: volumebackups. {{(pid=101319) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 09:55:18.520781 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-1a73a775-82a8-4c85-a8a6-59aa02e61f61 tempest-ProjectMemberTests33-2105464604 None] deleted object: volume_a28b52f0-456d-4821-8de5-ec41566e1234/20260703095449/az_nova_backup_0254456b-0a66-4125-8e17-8e1f79f703fe-00004 in container: volumebackups. {{(pid=101319) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 09:55:18.551043 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-1a73a775-82a8-4c85-a8a6-59aa02e61f61 tempest-ProjectMemberTests33-2105464604 None] deleted object: volume_a28b52f0-456d-4821-8de5-ec41566e1234/20260703095449/az_nova_backup_0254456b-0a66-4125-8e17-8e1f79f703fe-00005 in container: volumebackups. {{(pid=101319) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 09:55:18.571116 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-1a73a775-82a8-4c85-a8a6-59aa02e61f61 tempest-ProjectMemberTests33-2105464604 None] deleted object: volume_a28b52f0-456d-4821-8de5-ec41566e1234/20260703095449/az_nova_backup_0254456b-0a66-4125-8e17-8e1f79f703fe-00006 in container: volumebackups. {{(pid=101319) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 09:55:18.589798 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-1a73a775-82a8-4c85-a8a6-59aa02e61f61 tempest-ProjectMemberTests33-2105464604 None] deleted object: volume_a28b52f0-456d-4821-8de5-ec41566e1234/20260703095449/az_nova_backup_0254456b-0a66-4125-8e17-8e1f79f703fe-00007 in container: volumebackups. {{(pid=101319) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 09:55:18.611199 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-1a73a775-82a8-4c85-a8a6-59aa02e61f61 tempest-ProjectMemberTests33-2105464604 None] deleted object: volume_a28b52f0-456d-4821-8de5-ec41566e1234/20260703095449/az_nova_backup_0254456b-0a66-4125-8e17-8e1f79f703fe-00008 in container: volumebackups. {{(pid=101319) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 09:55:18.630705 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-1a73a775-82a8-4c85-a8a6-59aa02e61f61 tempest-ProjectMemberTests33-2105464604 None] deleted object: volume_a28b52f0-456d-4821-8de5-ec41566e1234/20260703095449/az_nova_backup_0254456b-0a66-4125-8e17-8e1f79f703fe-00009 in container: volumebackups. {{(pid=101319) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 09:55:18.650393 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-1a73a775-82a8-4c85-a8a6-59aa02e61f61 tempest-ProjectMemberTests33-2105464604 None] deleted object: volume_a28b52f0-456d-4821-8de5-ec41566e1234/20260703095449/az_nova_backup_0254456b-0a66-4125-8e17-8e1f79f703fe-00010 in container: volumebackups. {{(pid=101319) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 09:55:18.670417 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-1a73a775-82a8-4c85-a8a6-59aa02e61f61 tempest-ProjectMemberTests33-2105464604 None] deleted object: volume_a28b52f0-456d-4821-8de5-ec41566e1234/20260703095449/az_nova_backup_0254456b-0a66-4125-8e17-8e1f79f703fe-00011 in container: volumebackups. {{(pid=101319) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 09:55:18.691429 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-1a73a775-82a8-4c85-a8a6-59aa02e61f61 tempest-ProjectMemberTests33-2105464604 None] deleted object: volume_a28b52f0-456d-4821-8de5-ec41566e1234/20260703095449/az_nova_backup_0254456b-0a66-4125-8e17-8e1f79f703fe-00012 in container: volumebackups. {{(pid=101319) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 09:55:18.715145 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-1a73a775-82a8-4c85-a8a6-59aa02e61f61 tempest-ProjectMemberTests33-2105464604 None] deleted object: volume_a28b52f0-456d-4821-8de5-ec41566e1234/20260703095449/az_nova_backup_0254456b-0a66-4125-8e17-8e1f79f703fe-00013 in container: volumebackups. {{(pid=101319) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 09:55:18.734982 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-1a73a775-82a8-4c85-a8a6-59aa02e61f61 tempest-ProjectMemberTests33-2105464604 None] deleted object: volume_a28b52f0-456d-4821-8de5-ec41566e1234/20260703095449/az_nova_backup_0254456b-0a66-4125-8e17-8e1f79f703fe-00014 in container: volumebackups. {{(pid=101319) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 09:55:18.756611 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-1a73a775-82a8-4c85-a8a6-59aa02e61f61 tempest-ProjectMemberTests33-2105464604 None] deleted object: volume_a28b52f0-456d-4821-8de5-ec41566e1234/20260703095449/az_nova_backup_0254456b-0a66-4125-8e17-8e1f79f703fe-00015 in container: volumebackups. {{(pid=101319) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 09:55:18.775734 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-1a73a775-82a8-4c85-a8a6-59aa02e61f61 tempest-ProjectMemberTests33-2105464604 None] deleted object: volume_a28b52f0-456d-4821-8de5-ec41566e1234/20260703095449/az_nova_backup_0254456b-0a66-4125-8e17-8e1f79f703fe-00016 in container: volumebackups. {{(pid=101319) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 09:55:18.795208 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-1a73a775-82a8-4c85-a8a6-59aa02e61f61 tempest-ProjectMemberTests33-2105464604 None] deleted object: volume_a28b52f0-456d-4821-8de5-ec41566e1234/20260703095449/az_nova_backup_0254456b-0a66-4125-8e17-8e1f79f703fe-00017 in container: volumebackups. {{(pid=101319) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 09:55:18.815925 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-1a73a775-82a8-4c85-a8a6-59aa02e61f61 tempest-ProjectMemberTests33-2105464604 None] deleted object: volume_a28b52f0-456d-4821-8de5-ec41566e1234/20260703095449/az_nova_backup_0254456b-0a66-4125-8e17-8e1f79f703fe-00018 in container: volumebackups. {{(pid=101319) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 09:55:18.835260 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-1a73a775-82a8-4c85-a8a6-59aa02e61f61 tempest-ProjectMemberTests33-2105464604 None] deleted object: volume_a28b52f0-456d-4821-8de5-ec41566e1234/20260703095449/az_nova_backup_0254456b-0a66-4125-8e17-8e1f79f703fe-00019 in container: volumebackups. {{(pid=101319) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 09:55:18.856786 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-1a73a775-82a8-4c85-a8a6-59aa02e61f61 tempest-ProjectMemberTests33-2105464604 None] deleted object: volume_a28b52f0-456d-4821-8de5-ec41566e1234/20260703095449/az_nova_backup_0254456b-0a66-4125-8e17-8e1f79f703fe-00020 in container: volumebackups. {{(pid=101319) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 09:55:18.877184 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-1a73a775-82a8-4c85-a8a6-59aa02e61f61 tempest-ProjectMemberTests33-2105464604 None] deleted object: volume_a28b52f0-456d-4821-8de5-ec41566e1234/20260703095449/az_nova_backup_0254456b-0a66-4125-8e17-8e1f79f703fe-00021 in container: volumebackups. {{(pid=101319) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 09:55:18.897714 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-1a73a775-82a8-4c85-a8a6-59aa02e61f61 tempest-ProjectMemberTests33-2105464604 None] deleted object: volume_a28b52f0-456d-4821-8de5-ec41566e1234/20260703095449/az_nova_backup_0254456b-0a66-4125-8e17-8e1f79f703fe_metadata in container: volumebackups. {{(pid=101319) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 09:55:18.947219 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-1a73a775-82a8-4c85-a8a6-59aa02e61f61 tempest-ProjectMemberTests33-2105464604 None] deleted object: volume_a28b52f0-456d-4821-8de5-ec41566e1234/20260703095449/az_nova_backup_0254456b-0a66-4125-8e17-8e1f79f703fe_sha256file in container: volumebackups. {{(pid=101319) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 09:55:18.947219 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-1a73a775-82a8-4c85-a8a6-59aa02e61f61 tempest-ProjectMemberTests33-2105464604 None] delete 0254456b-0a66-4125-8e17-8e1f79f703fe finished. {{(pid=101319) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:848}} Jul 03 09:55:18.958314 np0000004400 cinder-backup[101319]: DEBUG oslo_db.sqlalchemy.engines [None req-1a73a775-82a8-4c85-a8a6-59aa02e61f61 tempest-ProjectMemberTests33-2105464604 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=101319) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 03 09:55:18.974141 np0000004400 cinder-backup[101319]: DEBUG cinder.quota [None req-1a73a775-82a8-4c85-a8a6-59aa02e61f61 tempest-ProjectMemberTests33-2105464604 None] Created reservations ['557f8321-db37-4209-a2a9-f1c8ae1874a1', '1c9398ad-2c36-4633-b534-857736aef29c'] {{(pid=101319) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 09:55:18.992750 np0000004400 cinder-backup[101319]: INFO cinder.backup.manager [None req-1a73a775-82a8-4c85-a8a6-59aa02e61f61 tempest-ProjectMemberTests33-2105464604 None] Delete backup finished, backup 0254456b-0a66-4125-8e17-8e1f79f703fe deleted. Jul 03 09:55:19.465492 np0000004400 cinder-backup[101319]: INFO cinder.backup.manager [None req-b0c7e7cf-1f32-4957-8525-ebe5ad3bcbeb tempest-ProjectMemberTests33-2105464604 None] Delete backup started, backup: 6f767c43-dfb9-4a05-93e6-d969f7407465. Jul 03 09:55:19.470113 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.drivers.swift [None req-b0c7e7cf-1f32-4957-8525-ebe5ad3bcbeb tempest-ProjectMemberTests33-2105464604 None] Using swift URL https://10.4.3.95:8080/v1/AUTH_e0b6e59b911e40b3acac38afb1f81e3a {{(pid=101319) initialize /opt/stack/cinder/cinder/backup/drivers/swift.py:300}} Jul 03 09:55:19.470682 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.drivers.swift [None req-b0c7e7cf-1f32-4957-8525-ebe5ad3bcbeb tempest-ProjectMemberTests33-2105464604 None] Connect to https://10.4.3.95:8080/v1/AUTH_ in "per_user" mode {{(pid=101319) initialize /opt/stack/cinder/cinder/backup/drivers/swift.py:301}} Jul 03 09:55:19.470955 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-b0c7e7cf-1f32-4957-8525-ebe5ad3bcbeb tempest-ProjectMemberTests33-2105464604 None] delete started, backup: 6f767c43-dfb9-4a05-93e6-d969f7407465, container: volumebackups, prefix: volume_28e6e1d6-2242-44e7-9f43-e6ae7f7d5f56/20260703095429/az_nova_backup_6f767c43-dfb9-4a05-93e6-d969f7407465. {{(pid=101319) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:822}} Jul 03 09:55:19.518342 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-b0c7e7cf-1f32-4957-8525-ebe5ad3bcbeb tempest-ProjectMemberTests33-2105464604 None] generated object list: ['volume_28e6e1d6-2242-44e7-9f43-e6ae7f7d5f56/20260703095429/az_nova_backup_6f767c43-dfb9-4a05-93e6-d969f7407465-00001', 'volume_28e6e1d6-2242-44e7-9f43-e6ae7f7d5f56/20260703095429/az_nova_backup_6f767c43-dfb9-4a05-93e6-d969f7407465-00002', 'volume_28e6e1d6-2242-44e7-9f43-e6ae7f7d5f56/20260703095429/az_nova_backup_6f767c43-dfb9-4a05-93e6-d969f7407465-00003', 'volume_28e6e1d6-2242-44e7-9f43-e6ae7f7d5f56/20260703095429/az_nova_backup_6f767c43-dfb9-4a05-93e6-d969f7407465-00004', 'volume_28e6e1d6-2242-44e7-9f43-e6ae7f7d5f56/20260703095429/az_nova_backup_6f767c43-dfb9-4a05-93e6-d969f7407465-00005', 'volume_28e6e1d6-2242-44e7-9f43-e6ae7f7d5f56/20260703095429/az_nova_backup_6f767c43-dfb9-4a05-93e6-d969f7407465-00006', 'volume_28e6e1d6-2242-44e7-9f43-e6ae7f7d5f56/20260703095429/az_nova_backup_6f767c43-dfb9-4a05-93e6-d969f7407465-00007', 'volume_28e6e1d6-2242-44e7-9f43-e6ae7f7d5f56/20260703095429/az_nova_backup_6f767c43-dfb9-4a05-93e6-d969f7407465-00008', 'volume_28e6e1d6-2242-44e7-9f43-e6ae7f7d5f56/20260703095429/az_nova_backup_6f767c43-dfb9-4a05-93e6-d969f7407465-00009', 'volume_28e6e1d6-2242-44e7-9f43-e6ae7f7d5f56/20260703095429/az_nova_backup_6f767c43-dfb9-4a05-93e6-d969f7407465-00010', 'volume_28e6e1d6-2242-44e7-9f43-e6ae7f7d5f56/20260703095429/az_nova_backup_6f767c43-dfb9-4a05-93e6-d969f7407465-00011', 'volume_28e6e1d6-2242-44e7-9f43-e6ae7f7d5f56/20260703095429/az_nova_backup_6f767c43-dfb9-4a05-93e6-d969f7407465-00012', 'volume_28e6e1d6-2242-44e7-9f43-e6ae7f7d5f56/20260703095429/az_nova_backup_6f767c43-dfb9-4a05-93e6-d969f7407465-00013', 'volume_28e6e1d6-2242-44e7-9f43-e6ae7f7d5f56/20260703095429/az_nova_backup_6f767c43-dfb9-4a05-93e6-d969f7407465-00014', 'volume_28e6e1d6-2242-44e7-9f43-e6ae7f7d5f56/20260703095429/az_nova_backup_6f767c43-dfb9-4a05-93e6-d969f7407465-00015', 'volume_28e6e1d6-2242-44e7-9f43-e6ae7f7d5f56/20260703095429/az_nova_backup_6f767c43-dfb9-4a05-93e6-d969f7407465-00016', 'volume_28e6e1d6-2242-44e7-9f43-e6ae7f7d5f56/20260703095429/az_nova_backup_6f767c43-dfb9-4a05-93e6-d969f7407465-00017', 'volume_28e6e1d6-2242-44e7-9f43-e6ae7f7d5f56/20260703095429/az_nova_backup_6f767c43-dfb9-4a05-93e6-d969f7407465-00018', 'volume_28e6e1d6-2242-44e7-9f43-e6ae7f7d5f56/20260703095429/az_nova_backup_6f767c43-dfb9-4a05-93e6-d969f7407465-00019', 'volume_28e6e1d6-2242-44e7-9f43-e6ae7f7d5f56/20260703095429/az_nova_backup_6f767c43-dfb9-4a05-93e6-d969f7407465-00020', 'volume_28e6e1d6-2242-44e7-9f43-e6ae7f7d5f56/20260703095429/az_nova_backup_6f767c43-dfb9-4a05-93e6-d969f7407465-00021', 'volume_28e6e1d6-2242-44e7-9f43-e6ae7f7d5f56/20260703095429/az_nova_backup_6f767c43-dfb9-4a05-93e6-d969f7407465_metadata', 'volume_28e6e1d6-2242-44e7-9f43-e6ae7f7d5f56/20260703095429/az_nova_backup_6f767c43-dfb9-4a05-93e6-d969f7407465_sha256file']. {{(pid=101319) _generate_object_names /opt/stack/cinder/cinder/backup/chunkeddriver.py:260}} Jul 03 09:55:19.535877 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-b0c7e7cf-1f32-4957-8525-ebe5ad3bcbeb tempest-ProjectMemberTests33-2105464604 None] deleted object: volume_28e6e1d6-2242-44e7-9f43-e6ae7f7d5f56/20260703095429/az_nova_backup_6f767c43-dfb9-4a05-93e6-d969f7407465-00001 in container: volumebackups. {{(pid=101319) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 09:55:19.563009 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-b0c7e7cf-1f32-4957-8525-ebe5ad3bcbeb tempest-ProjectMemberTests33-2105464604 None] deleted object: volume_28e6e1d6-2242-44e7-9f43-e6ae7f7d5f56/20260703095429/az_nova_backup_6f767c43-dfb9-4a05-93e6-d969f7407465-00002 in container: volumebackups. {{(pid=101319) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 09:55:19.594679 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-b0c7e7cf-1f32-4957-8525-ebe5ad3bcbeb tempest-ProjectMemberTests33-2105464604 None] deleted object: volume_28e6e1d6-2242-44e7-9f43-e6ae7f7d5f56/20260703095429/az_nova_backup_6f767c43-dfb9-4a05-93e6-d969f7407465-00003 in container: volumebackups. {{(pid=101319) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 09:55:19.636514 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-b0c7e7cf-1f32-4957-8525-ebe5ad3bcbeb tempest-ProjectMemberTests33-2105464604 None] deleted object: volume_28e6e1d6-2242-44e7-9f43-e6ae7f7d5f56/20260703095429/az_nova_backup_6f767c43-dfb9-4a05-93e6-d969f7407465-00004 in container: volumebackups. {{(pid=101319) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 09:55:19.667645 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-b0c7e7cf-1f32-4957-8525-ebe5ad3bcbeb tempest-ProjectMemberTests33-2105464604 None] deleted object: volume_28e6e1d6-2242-44e7-9f43-e6ae7f7d5f56/20260703095429/az_nova_backup_6f767c43-dfb9-4a05-93e6-d969f7407465-00005 in container: volumebackups. {{(pid=101319) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 09:55:19.692721 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-b0c7e7cf-1f32-4957-8525-ebe5ad3bcbeb tempest-ProjectMemberTests33-2105464604 None] deleted object: volume_28e6e1d6-2242-44e7-9f43-e6ae7f7d5f56/20260703095429/az_nova_backup_6f767c43-dfb9-4a05-93e6-d969f7407465-00006 in container: volumebackups. {{(pid=101319) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 09:55:19.718891 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-b0c7e7cf-1f32-4957-8525-ebe5ad3bcbeb tempest-ProjectMemberTests33-2105464604 None] deleted object: volume_28e6e1d6-2242-44e7-9f43-e6ae7f7d5f56/20260703095429/az_nova_backup_6f767c43-dfb9-4a05-93e6-d969f7407465-00007 in container: volumebackups. {{(pid=101319) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 09:55:19.746371 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-b0c7e7cf-1f32-4957-8525-ebe5ad3bcbeb tempest-ProjectMemberTests33-2105464604 None] deleted object: volume_28e6e1d6-2242-44e7-9f43-e6ae7f7d5f56/20260703095429/az_nova_backup_6f767c43-dfb9-4a05-93e6-d969f7407465-00008 in container: volumebackups. {{(pid=101319) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 09:55:19.765044 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-b0c7e7cf-1f32-4957-8525-ebe5ad3bcbeb tempest-ProjectMemberTests33-2105464604 None] deleted object: volume_28e6e1d6-2242-44e7-9f43-e6ae7f7d5f56/20260703095429/az_nova_backup_6f767c43-dfb9-4a05-93e6-d969f7407465-00009 in container: volumebackups. {{(pid=101319) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 09:55:19.785929 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-b0c7e7cf-1f32-4957-8525-ebe5ad3bcbeb tempest-ProjectMemberTests33-2105464604 None] deleted object: volume_28e6e1d6-2242-44e7-9f43-e6ae7f7d5f56/20260703095429/az_nova_backup_6f767c43-dfb9-4a05-93e6-d969f7407465-00010 in container: volumebackups. {{(pid=101319) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 09:55:19.809090 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-b0c7e7cf-1f32-4957-8525-ebe5ad3bcbeb tempest-ProjectMemberTests33-2105464604 None] deleted object: volume_28e6e1d6-2242-44e7-9f43-e6ae7f7d5f56/20260703095429/az_nova_backup_6f767c43-dfb9-4a05-93e6-d969f7407465-00011 in container: volumebackups. {{(pid=101319) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 09:55:19.839794 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-b0c7e7cf-1f32-4957-8525-ebe5ad3bcbeb tempest-ProjectMemberTests33-2105464604 None] deleted object: volume_28e6e1d6-2242-44e7-9f43-e6ae7f7d5f56/20260703095429/az_nova_backup_6f767c43-dfb9-4a05-93e6-d969f7407465-00012 in container: volumebackups. {{(pid=101319) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 09:55:19.867367 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-b0c7e7cf-1f32-4957-8525-ebe5ad3bcbeb tempest-ProjectMemberTests33-2105464604 None] deleted object: volume_28e6e1d6-2242-44e7-9f43-e6ae7f7d5f56/20260703095429/az_nova_backup_6f767c43-dfb9-4a05-93e6-d969f7407465-00013 in container: volumebackups. {{(pid=101319) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 09:55:19.892796 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-b0c7e7cf-1f32-4957-8525-ebe5ad3bcbeb tempest-ProjectMemberTests33-2105464604 None] deleted object: volume_28e6e1d6-2242-44e7-9f43-e6ae7f7d5f56/20260703095429/az_nova_backup_6f767c43-dfb9-4a05-93e6-d969f7407465-00014 in container: volumebackups. {{(pid=101319) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 09:55:19.910233 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-b0c7e7cf-1f32-4957-8525-ebe5ad3bcbeb tempest-ProjectMemberTests33-2105464604 None] deleted object: volume_28e6e1d6-2242-44e7-9f43-e6ae7f7d5f56/20260703095429/az_nova_backup_6f767c43-dfb9-4a05-93e6-d969f7407465-00015 in container: volumebackups. {{(pid=101319) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 09:55:19.936332 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-b0c7e7cf-1f32-4957-8525-ebe5ad3bcbeb tempest-ProjectMemberTests33-2105464604 None] deleted object: volume_28e6e1d6-2242-44e7-9f43-e6ae7f7d5f56/20260703095429/az_nova_backup_6f767c43-dfb9-4a05-93e6-d969f7407465-00016 in container: volumebackups. {{(pid=101319) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 09:55:19.955260 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-b0c7e7cf-1f32-4957-8525-ebe5ad3bcbeb tempest-ProjectMemberTests33-2105464604 None] deleted object: volume_28e6e1d6-2242-44e7-9f43-e6ae7f7d5f56/20260703095429/az_nova_backup_6f767c43-dfb9-4a05-93e6-d969f7407465-00017 in container: volumebackups. {{(pid=101319) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 09:55:19.975862 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-b0c7e7cf-1f32-4957-8525-ebe5ad3bcbeb tempest-ProjectMemberTests33-2105464604 None] deleted object: volume_28e6e1d6-2242-44e7-9f43-e6ae7f7d5f56/20260703095429/az_nova_backup_6f767c43-dfb9-4a05-93e6-d969f7407465-00018 in container: volumebackups. {{(pid=101319) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 09:55:19.995615 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-b0c7e7cf-1f32-4957-8525-ebe5ad3bcbeb tempest-ProjectMemberTests33-2105464604 None] deleted object: volume_28e6e1d6-2242-44e7-9f43-e6ae7f7d5f56/20260703095429/az_nova_backup_6f767c43-dfb9-4a05-93e6-d969f7407465-00019 in container: volumebackups. {{(pid=101319) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 09:55:20.017748 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-b0c7e7cf-1f32-4957-8525-ebe5ad3bcbeb tempest-ProjectMemberTests33-2105464604 None] deleted object: volume_28e6e1d6-2242-44e7-9f43-e6ae7f7d5f56/20260703095429/az_nova_backup_6f767c43-dfb9-4a05-93e6-d969f7407465-00020 in container: volumebackups. {{(pid=101319) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 09:55:20.038666 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-b0c7e7cf-1f32-4957-8525-ebe5ad3bcbeb tempest-ProjectMemberTests33-2105464604 None] deleted object: volume_28e6e1d6-2242-44e7-9f43-e6ae7f7d5f56/20260703095429/az_nova_backup_6f767c43-dfb9-4a05-93e6-d969f7407465-00021 in container: volumebackups. {{(pid=101319) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 09:55:20.058725 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-b0c7e7cf-1f32-4957-8525-ebe5ad3bcbeb tempest-ProjectMemberTests33-2105464604 None] deleted object: volume_28e6e1d6-2242-44e7-9f43-e6ae7f7d5f56/20260703095429/az_nova_backup_6f767c43-dfb9-4a05-93e6-d969f7407465_metadata in container: volumebackups. {{(pid=101319) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 09:55:20.078691 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-b0c7e7cf-1f32-4957-8525-ebe5ad3bcbeb tempest-ProjectMemberTests33-2105464604 None] deleted object: volume_28e6e1d6-2242-44e7-9f43-e6ae7f7d5f56/20260703095429/az_nova_backup_6f767c43-dfb9-4a05-93e6-d969f7407465_sha256file in container: volumebackups. {{(pid=101319) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 09:55:20.079043 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-b0c7e7cf-1f32-4957-8525-ebe5ad3bcbeb tempest-ProjectMemberTests33-2105464604 None] delete 6f767c43-dfb9-4a05-93e6-d969f7407465 finished. {{(pid=101319) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:848}} Jul 03 09:55:20.109784 np0000004400 cinder-backup[101319]: DEBUG oslo_db.sqlalchemy.engines [None req-b0c7e7cf-1f32-4957-8525-ebe5ad3bcbeb tempest-ProjectMemberTests33-2105464604 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=101319) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 03 09:55:20.123127 np0000004400 cinder-backup[101319]: DEBUG cinder.quota [None req-b0c7e7cf-1f32-4957-8525-ebe5ad3bcbeb tempest-ProjectMemberTests33-2105464604 None] Created reservations ['a8270b4a-9024-4fb4-bd7f-091001c36a81', 'c881f971-c16a-4ea6-85f7-b53a948c5716'] {{(pid=101319) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 09:55:20.138239 np0000004400 cinder-backup[101319]: INFO cinder.backup.manager [None req-b0c7e7cf-1f32-4957-8525-ebe5ad3bcbeb tempest-ProjectMemberTests33-2105464604 None] Delete backup finished, backup 6f767c43-dfb9-4a05-93e6-d969f7407465 deleted. Jul 03 09:55:20.530712 np0000004400 cinder-backup[101319]: INFO cinder.backup.manager [None req-7c090c6c-53e8-434d-93e8-4f0272c84bd7 tempest-ProjectMemberTests33-2105464604 None] Delete backup started, backup: 0871942a-e198-4230-a099-29a52a21849b. Jul 03 09:55:20.535558 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.drivers.swift [None req-7c090c6c-53e8-434d-93e8-4f0272c84bd7 tempest-ProjectMemberTests33-2105464604 None] Using swift URL https://10.4.3.95:8080/v1/AUTH_e0b6e59b911e40b3acac38afb1f81e3a {{(pid=101319) initialize /opt/stack/cinder/cinder/backup/drivers/swift.py:300}} Jul 03 09:55:20.535807 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.drivers.swift [None req-7c090c6c-53e8-434d-93e8-4f0272c84bd7 tempest-ProjectMemberTests33-2105464604 None] Connect to https://10.4.3.95:8080/v1/AUTH_ in "per_user" mode {{(pid=101319) initialize /opt/stack/cinder/cinder/backup/drivers/swift.py:301}} Jul 03 09:55:20.536036 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-7c090c6c-53e8-434d-93e8-4f0272c84bd7 tempest-ProjectMemberTests33-2105464604 None] delete started, backup: 0871942a-e198-4230-a099-29a52a21849b, container: volumebackups, prefix: volume_5f57fed7-aa36-44c5-af90-863bd3d3af9d/20260703095328/az_nova_backup_0871942a-e198-4230-a099-29a52a21849b. {{(pid=101319) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:822}} Jul 03 09:55:20.583226 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-7c090c6c-53e8-434d-93e8-4f0272c84bd7 tempest-ProjectMemberTests33-2105464604 None] generated object list: ['volume_5f57fed7-aa36-44c5-af90-863bd3d3af9d/20260703095328/az_nova_backup_0871942a-e198-4230-a099-29a52a21849b-00001', 'volume_5f57fed7-aa36-44c5-af90-863bd3d3af9d/20260703095328/az_nova_backup_0871942a-e198-4230-a099-29a52a21849b-00002', 'volume_5f57fed7-aa36-44c5-af90-863bd3d3af9d/20260703095328/az_nova_backup_0871942a-e198-4230-a099-29a52a21849b-00003', 'volume_5f57fed7-aa36-44c5-af90-863bd3d3af9d/20260703095328/az_nova_backup_0871942a-e198-4230-a099-29a52a21849b-00004', 'volume_5f57fed7-aa36-44c5-af90-863bd3d3af9d/20260703095328/az_nova_backup_0871942a-e198-4230-a099-29a52a21849b-00005', 'volume_5f57fed7-aa36-44c5-af90-863bd3d3af9d/20260703095328/az_nova_backup_0871942a-e198-4230-a099-29a52a21849b-00006', 'volume_5f57fed7-aa36-44c5-af90-863bd3d3af9d/20260703095328/az_nova_backup_0871942a-e198-4230-a099-29a52a21849b-00007', 'volume_5f57fed7-aa36-44c5-af90-863bd3d3af9d/20260703095328/az_nova_backup_0871942a-e198-4230-a099-29a52a21849b-00008', 'volume_5f57fed7-aa36-44c5-af90-863bd3d3af9d/20260703095328/az_nova_backup_0871942a-e198-4230-a099-29a52a21849b-00009', 'volume_5f57fed7-aa36-44c5-af90-863bd3d3af9d/20260703095328/az_nova_backup_0871942a-e198-4230-a099-29a52a21849b-00010', 'volume_5f57fed7-aa36-44c5-af90-863bd3d3af9d/20260703095328/az_nova_backup_0871942a-e198-4230-a099-29a52a21849b-00011', 'volume_5f57fed7-aa36-44c5-af90-863bd3d3af9d/20260703095328/az_nova_backup_0871942a-e198-4230-a099-29a52a21849b-00012', 'volume_5f57fed7-aa36-44c5-af90-863bd3d3af9d/20260703095328/az_nova_backup_0871942a-e198-4230-a099-29a52a21849b-00013', 'volume_5f57fed7-aa36-44c5-af90-863bd3d3af9d/20260703095328/az_nova_backup_0871942a-e198-4230-a099-29a52a21849b-00014', 'volume_5f57fed7-aa36-44c5-af90-863bd3d3af9d/20260703095328/az_nova_backup_0871942a-e198-4230-a099-29a52a21849b-00015', 'volume_5f57fed7-aa36-44c5-af90-863bd3d3af9d/20260703095328/az_nova_backup_0871942a-e198-4230-a099-29a52a21849b-00016', 'volume_5f57fed7-aa36-44c5-af90-863bd3d3af9d/20260703095328/az_nova_backup_0871942a-e198-4230-a099-29a52a21849b-00017', 'volume_5f57fed7-aa36-44c5-af90-863bd3d3af9d/20260703095328/az_nova_backup_0871942a-e198-4230-a099-29a52a21849b-00018', 'volume_5f57fed7-aa36-44c5-af90-863bd3d3af9d/20260703095328/az_nova_backup_0871942a-e198-4230-a099-29a52a21849b-00019', 'volume_5f57fed7-aa36-44c5-af90-863bd3d3af9d/20260703095328/az_nova_backup_0871942a-e198-4230-a099-29a52a21849b-00020', 'volume_5f57fed7-aa36-44c5-af90-863bd3d3af9d/20260703095328/az_nova_backup_0871942a-e198-4230-a099-29a52a21849b-00021', 'volume_5f57fed7-aa36-44c5-af90-863bd3d3af9d/20260703095328/az_nova_backup_0871942a-e198-4230-a099-29a52a21849b_metadata', 'volume_5f57fed7-aa36-44c5-af90-863bd3d3af9d/20260703095328/az_nova_backup_0871942a-e198-4230-a099-29a52a21849b_sha256file']. {{(pid=101319) _generate_object_names /opt/stack/cinder/cinder/backup/chunkeddriver.py:260}} Jul 03 09:55:20.606111 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-7c090c6c-53e8-434d-93e8-4f0272c84bd7 tempest-ProjectMemberTests33-2105464604 None] deleted object: volume_5f57fed7-aa36-44c5-af90-863bd3d3af9d/20260703095328/az_nova_backup_0871942a-e198-4230-a099-29a52a21849b-00001 in container: volumebackups. {{(pid=101319) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 09:55:20.627554 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-7c090c6c-53e8-434d-93e8-4f0272c84bd7 tempest-ProjectMemberTests33-2105464604 None] deleted object: volume_5f57fed7-aa36-44c5-af90-863bd3d3af9d/20260703095328/az_nova_backup_0871942a-e198-4230-a099-29a52a21849b-00002 in container: volumebackups. {{(pid=101319) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 09:55:20.651964 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-7c090c6c-53e8-434d-93e8-4f0272c84bd7 tempest-ProjectMemberTests33-2105464604 None] deleted object: volume_5f57fed7-aa36-44c5-af90-863bd3d3af9d/20260703095328/az_nova_backup_0871942a-e198-4230-a099-29a52a21849b-00003 in container: volumebackups. {{(pid=101319) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 09:55:20.679082 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-7c090c6c-53e8-434d-93e8-4f0272c84bd7 tempest-ProjectMemberTests33-2105464604 None] deleted object: volume_5f57fed7-aa36-44c5-af90-863bd3d3af9d/20260703095328/az_nova_backup_0871942a-e198-4230-a099-29a52a21849b-00004 in container: volumebackups. {{(pid=101319) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 09:55:20.700633 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-7c090c6c-53e8-434d-93e8-4f0272c84bd7 tempest-ProjectMemberTests33-2105464604 None] deleted object: volume_5f57fed7-aa36-44c5-af90-863bd3d3af9d/20260703095328/az_nova_backup_0871942a-e198-4230-a099-29a52a21849b-00005 in container: volumebackups. {{(pid=101319) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 09:55:20.720341 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-7c090c6c-53e8-434d-93e8-4f0272c84bd7 tempest-ProjectMemberTests33-2105464604 None] deleted object: volume_5f57fed7-aa36-44c5-af90-863bd3d3af9d/20260703095328/az_nova_backup_0871942a-e198-4230-a099-29a52a21849b-00006 in container: volumebackups. {{(pid=101319) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 09:55:20.738140 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-7c090c6c-53e8-434d-93e8-4f0272c84bd7 tempest-ProjectMemberTests33-2105464604 None] deleted object: volume_5f57fed7-aa36-44c5-af90-863bd3d3af9d/20260703095328/az_nova_backup_0871942a-e198-4230-a099-29a52a21849b-00007 in container: volumebackups. {{(pid=101319) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 09:55:20.755220 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-7c090c6c-53e8-434d-93e8-4f0272c84bd7 tempest-ProjectMemberTests33-2105464604 None] deleted object: volume_5f57fed7-aa36-44c5-af90-863bd3d3af9d/20260703095328/az_nova_backup_0871942a-e198-4230-a099-29a52a21849b-00008 in container: volumebackups. {{(pid=101319) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 09:55:20.774218 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-7c090c6c-53e8-434d-93e8-4f0272c84bd7 tempest-ProjectMemberTests33-2105464604 None] deleted object: volume_5f57fed7-aa36-44c5-af90-863bd3d3af9d/20260703095328/az_nova_backup_0871942a-e198-4230-a099-29a52a21849b-00009 in container: volumebackups. {{(pid=101319) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 09:55:20.791980 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-7c090c6c-53e8-434d-93e8-4f0272c84bd7 tempest-ProjectMemberTests33-2105464604 None] deleted object: volume_5f57fed7-aa36-44c5-af90-863bd3d3af9d/20260703095328/az_nova_backup_0871942a-e198-4230-a099-29a52a21849b-00010 in container: volumebackups. {{(pid=101319) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 09:55:20.811178 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-7c090c6c-53e8-434d-93e8-4f0272c84bd7 tempest-ProjectMemberTests33-2105464604 None] deleted object: volume_5f57fed7-aa36-44c5-af90-863bd3d3af9d/20260703095328/az_nova_backup_0871942a-e198-4230-a099-29a52a21849b-00011 in container: volumebackups. {{(pid=101319) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 09:55:20.828224 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-7c090c6c-53e8-434d-93e8-4f0272c84bd7 tempest-ProjectMemberTests33-2105464604 None] deleted object: volume_5f57fed7-aa36-44c5-af90-863bd3d3af9d/20260703095328/az_nova_backup_0871942a-e198-4230-a099-29a52a21849b-00012 in container: volumebackups. {{(pid=101319) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 09:55:20.847130 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-7c090c6c-53e8-434d-93e8-4f0272c84bd7 tempest-ProjectMemberTests33-2105464604 None] deleted object: volume_5f57fed7-aa36-44c5-af90-863bd3d3af9d/20260703095328/az_nova_backup_0871942a-e198-4230-a099-29a52a21849b-00013 in container: volumebackups. {{(pid=101319) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 09:55:20.866420 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-7c090c6c-53e8-434d-93e8-4f0272c84bd7 tempest-ProjectMemberTests33-2105464604 None] deleted object: volume_5f57fed7-aa36-44c5-af90-863bd3d3af9d/20260703095328/az_nova_backup_0871942a-e198-4230-a099-29a52a21849b-00014 in container: volumebackups. {{(pid=101319) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 09:55:20.885914 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-7c090c6c-53e8-434d-93e8-4f0272c84bd7 tempest-ProjectMemberTests33-2105464604 None] deleted object: volume_5f57fed7-aa36-44c5-af90-863bd3d3af9d/20260703095328/az_nova_backup_0871942a-e198-4230-a099-29a52a21849b-00015 in container: volumebackups. {{(pid=101319) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 09:55:20.906886 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-7c090c6c-53e8-434d-93e8-4f0272c84bd7 tempest-ProjectMemberTests33-2105464604 None] deleted object: volume_5f57fed7-aa36-44c5-af90-863bd3d3af9d/20260703095328/az_nova_backup_0871942a-e198-4230-a099-29a52a21849b-00016 in container: volumebackups. {{(pid=101319) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 09:55:20.926651 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-7c090c6c-53e8-434d-93e8-4f0272c84bd7 tempest-ProjectMemberTests33-2105464604 None] deleted object: volume_5f57fed7-aa36-44c5-af90-863bd3d3af9d/20260703095328/az_nova_backup_0871942a-e198-4230-a099-29a52a21849b-00017 in container: volumebackups. {{(pid=101319) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 09:55:20.946996 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-7c090c6c-53e8-434d-93e8-4f0272c84bd7 tempest-ProjectMemberTests33-2105464604 None] deleted object: volume_5f57fed7-aa36-44c5-af90-863bd3d3af9d/20260703095328/az_nova_backup_0871942a-e198-4230-a099-29a52a21849b-00018 in container: volumebackups. {{(pid=101319) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 09:55:20.968606 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-7c090c6c-53e8-434d-93e8-4f0272c84bd7 tempest-ProjectMemberTests33-2105464604 None] deleted object: volume_5f57fed7-aa36-44c5-af90-863bd3d3af9d/20260703095328/az_nova_backup_0871942a-e198-4230-a099-29a52a21849b-00019 in container: volumebackups. {{(pid=101319) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 09:55:20.989002 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-7c090c6c-53e8-434d-93e8-4f0272c84bd7 tempest-ProjectMemberTests33-2105464604 None] deleted object: volume_5f57fed7-aa36-44c5-af90-863bd3d3af9d/20260703095328/az_nova_backup_0871942a-e198-4230-a099-29a52a21849b-00020 in container: volumebackups. {{(pid=101319) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 09:55:21.009318 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-7c090c6c-53e8-434d-93e8-4f0272c84bd7 tempest-ProjectMemberTests33-2105464604 None] deleted object: volume_5f57fed7-aa36-44c5-af90-863bd3d3af9d/20260703095328/az_nova_backup_0871942a-e198-4230-a099-29a52a21849b-00021 in container: volumebackups. {{(pid=101319) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 09:55:21.027467 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-7c090c6c-53e8-434d-93e8-4f0272c84bd7 tempest-ProjectMemberTests33-2105464604 None] deleted object: volume_5f57fed7-aa36-44c5-af90-863bd3d3af9d/20260703095328/az_nova_backup_0871942a-e198-4230-a099-29a52a21849b_metadata in container: volumebackups. {{(pid=101319) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 09:55:21.045527 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-7c090c6c-53e8-434d-93e8-4f0272c84bd7 tempest-ProjectMemberTests33-2105464604 None] deleted object: volume_5f57fed7-aa36-44c5-af90-863bd3d3af9d/20260703095328/az_nova_backup_0871942a-e198-4230-a099-29a52a21849b_sha256file in container: volumebackups. {{(pid=101319) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 09:55:21.045700 np0000004400 cinder-backup[101319]: DEBUG cinder.backup.chunkeddriver [None req-7c090c6c-53e8-434d-93e8-4f0272c84bd7 tempest-ProjectMemberTests33-2105464604 None] delete 0871942a-e198-4230-a099-29a52a21849b finished. {{(pid=101319) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:848}} Jul 03 09:55:21.080769 np0000004400 cinder-backup[101319]: DEBUG oslo_db.sqlalchemy.engines [None req-7c090c6c-53e8-434d-93e8-4f0272c84bd7 tempest-ProjectMemberTests33-2105464604 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=101319) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 03 09:55:21.096258 np0000004400 cinder-backup[101319]: DEBUG cinder.quota [None req-7c090c6c-53e8-434d-93e8-4f0272c84bd7 tempest-ProjectMemberTests33-2105464604 None] Created reservations ['a9d8d5b7-6cb2-4e9b-a4d9-092582ec1afe', 'b0a7bcaf-dccc-4005-a9df-e0a1800f38dc'] {{(pid=101319) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 09:55:21.110808 np0000004400 cinder-backup[101319]: INFO cinder.backup.manager [None req-7c090c6c-53e8-434d-93e8-4f0272c84bd7 tempest-ProjectMemberTests33-2105464604 None] Delete backup finished, backup 0871942a-e198-4230-a099-29a52a21849b deleted. Jul 03 09:55:31.108592 np0000004400 cinder-backup[101319]: DEBUG dbcounter [-] [101319] Writing DB stats cinder:UPDATE=23,cinder:SELECT=49,cinder:INSERT=7 {{(pid=101319) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 03 09:55:40.391464 np0000004400 cinder-backup[101319]: DEBUG oslo_service.periodic_task [None req-ffd932d2-122c-4e68-b5ba-628aff7ae7b8 None None] Running periodic task BackupManager.publish_service_capabilities {{(pid=101319) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 03 09:55:40.391921 np0000004400 cinder-backup[101319]: DEBUG cinder.manager [None req-ffd932d2-122c-4e68-b5ba-628aff7ae7b8 None None] Notifying Schedulers of capabilities ... {{(pid=101319) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 03 09:56:21.115542 np0000004400 cinder-backup[101319]: DEBUG dbcounter [-] [101319] Writing DB stats cinder:SELECT=1,cinder:UPDATE=1 {{(pid=101319) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 03 09:56:40.394497 np0000004400 cinder-backup[101319]: DEBUG oslo_service.periodic_task [None req-ffd932d2-122c-4e68-b5ba-628aff7ae7b8 None None] Running periodic task BackupManager.publish_service_capabilities {{(pid=101319) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 03 09:56:40.394868 np0000004400 cinder-backup[101319]: DEBUG cinder.manager [None req-ffd932d2-122c-4e68-b5ba-628aff7ae7b8 None None] Notifying Schedulers of capabilities ... {{(pid=101319) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 03 09:57:40.400048 np0000004400 cinder-backup[101319]: DEBUG oslo_service.periodic_task [None req-ffd932d2-122c-4e68-b5ba-628aff7ae7b8 None None] Running periodic task BackupManager.publish_service_capabilities {{(pid=101319) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 03 09:57:40.400551 np0000004400 cinder-backup[101319]: DEBUG cinder.manager [None req-ffd932d2-122c-4e68-b5ba-628aff7ae7b8 None None] Notifying Schedulers of capabilities ... {{(pid=101319) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 03 09:58:21.113762 np0000004400 cinder-backup[101319]: DEBUG dbcounter [-] [101319] Writing DB stats cinder:SELECT=1,cinder:UPDATE=1 {{(pid=101319) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 03 09:58:40.405931 np0000004400 cinder-backup[101319]: DEBUG oslo_service.periodic_task [None req-ffd932d2-122c-4e68-b5ba-628aff7ae7b8 None None] Running periodic task BackupManager.publish_service_capabilities {{(pid=101319) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 03 09:58:40.406337 np0000004400 cinder-backup[101319]: DEBUG cinder.manager [None req-ffd932d2-122c-4e68-b5ba-628aff7ae7b8 None None] Notifying Schedulers of capabilities ... {{(pid=101319) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 03 09:59:40.411179 np0000004400 cinder-backup[101319]: DEBUG oslo_service.periodic_task [None req-ffd932d2-122c-4e68-b5ba-628aff7ae7b8 None None] Running periodic task BackupManager.publish_service_capabilities {{(pid=101319) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 03 09:59:40.411729 np0000004400 cinder-backup[101319]: DEBUG cinder.manager [None req-ffd932d2-122c-4e68-b5ba-628aff7ae7b8 None None] Notifying Schedulers of capabilities ... {{(pid=101319) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 03 10:00:21.116894 np0000004400 cinder-backup[101319]: DEBUG dbcounter [-] [101319] Writing DB stats cinder:SELECT=1,cinder:UPDATE=1 {{(pid=101319) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 03 10:00:40.417375 np0000004400 cinder-backup[101319]: DEBUG oslo_service.periodic_task [None req-ffd932d2-122c-4e68-b5ba-628aff7ae7b8 None None] Running periodic task BackupManager.publish_service_capabilities {{(pid=101319) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 03 10:00:40.417795 np0000004400 cinder-backup[101319]: DEBUG cinder.manager [None req-ffd932d2-122c-4e68-b5ba-628aff7ae7b8 None None] Notifying Schedulers of capabilities ... {{(pid=101319) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 03 10:01:40.423771 np0000004400 cinder-backup[101319]: DEBUG oslo_service.periodic_task [None req-ffd932d2-122c-4e68-b5ba-628aff7ae7b8 None None] Running periodic task BackupManager.publish_service_capabilities {{(pid=101319) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 03 10:01:40.424303 np0000004400 cinder-backup[101319]: DEBUG cinder.manager [None req-ffd932d2-122c-4e68-b5ba-628aff7ae7b8 None None] Notifying Schedulers of capabilities ... {{(pid=101319) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 03 10:02:21.115025 np0000004400 cinder-backup[101319]: DEBUG dbcounter [-] [101319] Writing DB stats cinder:SELECT=1,cinder:UPDATE=1 {{(pid=101319) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 03 10:03:40.429937 np0000004400 cinder-backup[101319]: DEBUG oslo_service.periodic_task [None req-ffd932d2-122c-4e68-b5ba-628aff7ae7b8 None None] Running periodic task BackupManager.publish_service_capabilities {{(pid=101319) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 03 10:03:40.430360 np0000004400 cinder-backup[101319]: DEBUG cinder.manager [None req-ffd932d2-122c-4e68-b5ba-628aff7ae7b8 None None] Notifying Schedulers of capabilities ... {{(pid=101319) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 03 10:04:21.119888 np0000004400 cinder-backup[101319]: DEBUG dbcounter [-] [101319] Writing DB stats cinder:SELECT=1,cinder:UPDATE=1 {{(pid=101319) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 03 10:04:40.436180 np0000004400 cinder-backup[101319]: DEBUG oslo_service.periodic_task [None req-ffd932d2-122c-4e68-b5ba-628aff7ae7b8 None None] Running periodic task BackupManager.publish_service_capabilities {{(pid=101319) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 03 10:04:40.436708 np0000004400 cinder-backup[101319]: DEBUG cinder.manager [None req-ffd932d2-122c-4e68-b5ba-628aff7ae7b8 None None] Notifying Schedulers of capabilities ... {{(pid=101319) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 03 10:05:40.442309 np0000004400 cinder-backup[101319]: DEBUG oslo_service.periodic_task [None req-ffd932d2-122c-4e68-b5ba-628aff7ae7b8 None None] Running periodic task BackupManager.publish_service_capabilities {{(pid=101319) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 03 10:05:40.442309 np0000004400 cinder-backup[101319]: DEBUG cinder.manager [None req-ffd932d2-122c-4e68-b5ba-628aff7ae7b8 None None] Notifying Schedulers of capabilities ... {{(pid=101319) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 03 10:06:21.117202 np0000004400 cinder-backup[101319]: DEBUG dbcounter [-] [101319] Writing DB stats cinder:SELECT=1,cinder:UPDATE=1 {{(pid=101319) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}